From owner-freebsd-hackers@freebsd.org Sun May 19 10:25:29 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F289F15A9D87 for ; Sun, 19 May 2019 10:25:28 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D45AA87CF7 for ; Sun, 19 May 2019 10:25:26 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.15.2) with ESMTPS id x4JA6cES005253 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sun, 19 May 2019 12:06:38 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.15.2/8.15.2/Submit) with ESMTP id x4JA6ckD005250 for ; Sun, 19 May 2019 12:06:38 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) Date: Sun, 19 May 2019 12:06:38 +0200 (CEST) From: Wojciech Puchar To: freebsd-hackers@freebsd.org Subject: total configured swap exceeds maximum Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Rspamd-Queue-Id: D45AA87CF7 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-6.18 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[puchar.net]; NEURAL_HAM_SHORT(-0.87)[-0.873,0]; RCVD_IN_DNSWL_NONE(0.00)[90.144.1.194.list.dnswl.org : 127.0.10.0]; IP_SCORE(-3.50)[ip: (-9.25), ipnet: 194.1.144.0/24(-4.62), asn: 43476(-3.70), country: PL(0.06)]; DMARC_NA(0.00)[puchar.net]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 10:25:29 -0000 got this after configuring 160GB in 2 page partitions on 32GB RAM system. warning: total configured swap (36700158 pages) exceeds maximum recommended amount (32536376 pages). warning: increase kern.maxswzone or reduce amount of swap. what should i set kern.maxswzone to ? it is 0 # sysctl kern.maxswzone kern.maxswzone: 0 From owner-freebsd-hackers@freebsd.org Sun May 19 12:55:17 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B407F15AD39C for ; Sun, 19 May 2019 12:55:17 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7B8808B65D for ; Sun, 19 May 2019 12:55:15 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 87F77220AA for ; Sun, 19 May 2019 08:55:09 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Sun, 19 May 2019 08:55:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=rEzA1dTn3edBxIQYkBycKtoxm1G oNZA7nLX6xClcjoE=; b=my7w83fcDmLZ0LKBY0N874njGPD06Sgkw05yANpDe+v HTLvzAxF/ed8jXbxSDnVueFjX/sbMfv7QmDwoaXWt80eVhIXIIb2hJ4fSJL2V1ET n1TOVcVu7V3vi9kkILPrmw5AZ6Q3adyX5udpChXDvt6ch8+X61RMB3YtVWVVaT+w hC/mFkWScHWhcrDswHBZq/QdJz2edrbmmfNryaMePw5OdNRskMNqiA0XWpoCE6MS fW1cwhM5e0PA497AVZ4D9ghBwKCM29kAR2qNhajWj99c+HGhHDcOs+eek9+g80x5 M0LA9e4yE24u1XXMSLqFNzozvNP3ofczK5J7C7VNUEw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=rEzA1d Tn3edBxIQYkBycKtoxm1GoNZA7nLX6xClcjoE=; b=sr9t+a1c7c6HGuroH7eVZY PeEImpZUhjJobzedPzz+Amvkj9BQI76Lp/rCEa2RnMhVC5hH+hsAEI6FNObcW0KU IAkOHL5HFzxoYasf+0QiOaDSUTkddwG7hThBkoLkV6pOjjZ+wncGe9V/RCYTn84p /ifGkK0K2XSlBHDp+X31yg342gCjl5tLoO9uG57WX4p4qm6DE/bpzoXfj6WimEQw 3M/WiE8nPiewhheDL5abXs/lgjYh2OrUHbewjrhVGxt5NTJu+klbWJB4CfrTnKkW 0B65Uaz3D1v20nbelvyw6u7EibquzCGOTQhv49b8S1oCJ4lH/Z+CZPZYrwVdEaEw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduuddruddtiedgheelucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujggfsehgtd erredtredvnecuhfhrohhmpehtvggthhdqlhhishhtshcuoehtvggthhdqlhhishhtshes iiihgihsthdrnhgvtheqnecukfhppeekvddrjedtrdeluddruddtudenucfrrghrrghmpe hmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhnvghtnecuvehluhhs thgvrhfuihiivgeptd X-ME-Proxy: Received: from rpi3.zyxst.net (rpi3.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id B11528005B for ; Sun, 19 May 2019 08:55:08 -0400 (EDT) Date: Sun, 19 May 2019 13:55:06 +0100 From: tech-lists To: freebsd-hackers@freebsd.org Subject: Re: total configured swap exceeds maximum Message-ID: <20190519125505.GB6971@rpi3.zyxst.net> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="K8nIJk4ghYZn606h" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.4 (2019-03-13) X-Rspamd-Queue-Id: 7B8808B65D X-Spamd-Bar: --------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=my7w83fc; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=sr9t+a1c; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-9.07 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; MX_GOOD(-0.01)[in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com]; NEURAL_HAM_SHORT(-0.98)[-0.983,0]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; IP_SCORE(-3.38)[ip: (-9.13), ipnet: 66.111.4.0/24(-4.51), asn: 11403(-3.20), country: US(-0.06)]; RCVD_IN_DNSWL_LOW(-0.10)[25.4.111.66.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 12:55:17 -0000 --K8nIJk4ghYZn606h Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, May 19, 2019 at 12:06:38PM +0200, Wojciech Puchar wrote: >got this after configuring 160GB in 2 page partitions on 32GB RAM system. > > >warning: total configured swap (36700158 pages) exceeds maximum >recommended amount (32536376 pages). >warning: increase kern.maxswzone or reduce amount of swap. > > >what should i set kern.maxswzone to ? it is 0 > ># sysctl kern.maxswzone >kern.maxswzone: 0 Hi, Not sure if this answers your question, but my experience of swap was that it "likes"[1] (4 or 8 or 16GB) * N(umber of swapfiles/partitions)=20 and N=3D1 is usual for a system not doing heavy compiling work like poudrie= re.=20 It doesn't "like" 32GB or 64GB etc etc So on one poudriere system there is 32GB ram and 2*16GB swap partitions and one 16GB swapfile. On another there is 192GB RAM and 3* 16GB swap partitions. On a regular workstation with 8GB there's just one 8GB swap partition which is almost never used it seems. If it's one huge swapfile, it never seems to clear after the build completes. I have no idea why this might be. Then there's the thing about dump/panic. IIRC doesn't total swap have to be at least size_of_ram ? Like I say, I don't know if the above is "correct" or not. It's just my experience. [1] by which I mean "is effective" [2] swap partition or file is on SSD hardware --=20 J. --K8nIJk4ghYZn606h Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAlzhUh8ACgkQs8o7QhFz NAUJNw/9Efr8NVTghKAftLQzj7f39R/T6VZhEGvM9Qex6sBpTM3zih6DekcKOrNS fY8tTHr/ETJe2uOZLgOoW07dtQ4vaAD06R39OkJ++rWmBq4dEHPQR5gVixx5Lzge Ziwx0ND7GnGl1Xo5lFVIp65GwVbfwweqbY9G7eF6vC/mh6AcE/hnJnGbpLpAlIEC sQmA6xedKIV9VGETzJYPoZe7Blu7OuAJHBcIlCXVYREIxxdIykTIHaEhUj+tu48f IzjReyWgR1n9ah2+v0anLZMOvI6fqsIftJNBHRdkHM4pnSPS2Rb19XEB3FNs71Rr Dwc+NmvppRq0t4pKZs9gO4Yy8Bxo3C0paYuGenooLD14xmv2oTSd8MobQkf/M04+ W7nYpxcwt4Y3rLTC/zKxcLZF5I+UBmMYeGhifdUDZHkT3pNSPuTVo/xFS9SaqS3f Zb+YQr0GbPkB953EkIVgRyuW58xe97sXP3dVKYswub6xz30NAHTD8BXJlb9XyU6U cHhjui+/uPfoqwpN8kasyYFfLB4cSSe14jpVjTU7tWsLI1s2FBU6F8Bd+QxKcYAa Df07vJhTu7mDhh060byJlu+Q1j+jGVyuvS0OkN8x7Dg330ylMSMh0juwJVR36R/i GHlm7yDtJ/z/XLDy4H0D9GW/HzEOldgnVeeMI3ugRj9V7xHgWgY= =WIuP -----END PGP SIGNATURE----- --K8nIJk4ghYZn606h-- From owner-freebsd-hackers@freebsd.org Sun May 19 15:00:39 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33A5615B00F3 for ; Sun, 19 May 2019 15:00:39 +0000 (UTC) (envelope-from rwmaillists@googlemail.com) Received: from mail-wr1-x429.google.com (mail-wr1-x429.google.com [IPv6:2a00:1450:4864:20::429]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9204B8F20F for ; Sun, 19 May 2019 15:00:37 +0000 (UTC) (envelope-from rwmaillists@googlemail.com) Received: by mail-wr1-x429.google.com with SMTP id f8so5356324wrt.1 for ; Sun, 19 May 2019 08:00:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=cXtv6Ve954dTKHlaF4SNif6nFoqCvM8TTwHRrfcqUMQ=; b=jtKHeLfUG5EYGO3mj4AtmtjjHsaju3928Iz7f9uJ45zFtTwQpmeo5PbTJQRDPtq54N BrMZb6GL6Xj77hJrvOvj5FYm5pmtF1mm5ZJGOxZ9t18xQUMVETMvscO1Eh35C+60m3ox pBd38ZVQpVHv8Ggda2qcpcA/dF3TaLJleh6GKhR760pk/gX21HkCh7ZE4OZDH+dWtG4g hFEsEJG0jjWhzYdqBtG6IwWXeIkawyhH/6x5VTvEbPO9WzuC8CF11I6i6zkpoDMe3qfR jTgf+w3kOewwl5XrApYaTx/aNg+6N3QTC5ARneE029ffb7gIDhJ9j1JaZJ/kJmBTguvN zALw== X-Gm-Message-State: APjAAAWJ7b+ngh4js1SRgFkaAVx7dU63YWU9dEomh9vvtQO1fS5EcpZ2 HqsEU4VU5kI3uEb6aMBIcF11/kBJzUg= X-Google-Smtp-Source: APXvYqxQfQKSW0OUV7R5U+y0vnsvxxVz0d6O+itVJEysq81G4dOyeHVyVIO+Eplhc4eT1vdAeXg0gw== X-Received: by 2002:a5d:4d11:: with SMTP id z17mr16407665wrt.308.1558278036172; Sun, 19 May 2019 08:00:36 -0700 (PDT) Received: from gumby.homeunix.com ([2.121.235.191]) by smtp.gmail.com with ESMTPSA id o11sm2087811wrp.23.2019.05.19.08.00.34 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 19 May 2019 08:00:35 -0700 (PDT) Date: Sun, 19 May 2019 16:00:33 +0100 From: RW To: freebsd-hackers@freebsd.org Subject: Re: total configured swap exceeds maximum Message-ID: <20190519160033.0b0e47fa@gumby.homeunix.com> In-Reply-To: References: X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 9204B8F20F X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.75 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[googlemail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[googlemail.com:+]; DMARC_POLICY_ALLOW(-0.50)[googlemail.com,quarantine]; MX_GOOD(-0.01)[alt3.gmail-smtp-in.l.google.com,alt4.gmail-smtp-in.l.google.com,gmail-smtp-in.l.google.com,alt2.gmail-smtp-in.l.google.com,alt1.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.96)[-0.957,0]; RECEIVED_SPAMHAUS_PBL(0.00)[191.235.121.2.zen.spamhaus.org : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[googlemail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[googlemail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[googlemail.com:s=20161025]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.78)[ip: (-9.39), ipnet: 2a00:1450::/32(-2.20), asn: 15169(-2.27), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[9.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 15:00:39 -0000 On Sun, 19 May 2019 12:06:38 +0200 (CEST) Wojciech Puchar wrote: > got this after configuring 160GB in 2 page partitions on 32GB RAM > system. > > > warning: total configured swap (36700158 pages) exceeds maximum > recommended amount (32536376 pages). > warning: increase kern.maxswzone or reduce amount of swap. > > > what should i set kern.maxswzone to ? it is 0 > > # sysctl kern.maxswzone > kern.maxswzone: 0 IIRC for amd64 kern.maxswzone=0 represents the maximum allowed. From owner-freebsd-hackers@freebsd.org Sun May 19 15:33:41 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AED0615B0B14 for ; Sun, 19 May 2019 15:33:41 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 83B20682A0 for ; Sun, 19 May 2019 15:33:40 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.15.2) with ESMTPS id x4JFXfxr061568 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 19 May 2019 17:33:41 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.15.2/8.15.2/Submit) with ESMTP id x4JFXfUp061565; Sun, 19 May 2019 17:33:41 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) Date: Sun, 19 May 2019 17:33:41 +0200 (CEST) From: Wojciech Puchar To: RW cc: freebsd-hackers@freebsd.org Subject: Re: total configured swap exceeds maximum In-Reply-To: <20190519160033.0b0e47fa@gumby.homeunix.com> Message-ID: References: <20190519160033.0b0e47fa@gumby.homeunix.com> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 83B20682A0 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-6.67 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[puchar.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: puchar.net]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.144.1.194.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.86)[-0.858,0]; IP_SCORE(-3.50)[ip: (-9.25), ipnet: 194.1.144.0/24(-4.63), asn: 43476(-3.70), country: PL(0.06)]; FREEMAIL_TO(0.00)[googlemail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 15:33:41 -0000 >> what should i set kern.maxswzone to ? it is 0 >> >> # sysctl kern.maxswzone >> kern.maxswzone: 0 > > IIRC for amd64 kern.maxswzone=0 represents the maximum allowed. so i cannot have more VM than 5*RAM? From owner-freebsd-hackers@freebsd.org Sun May 19 15:42:30 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0203015B0E0D for ; Sun, 19 May 2019 15:42:30 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: from mail-io1-f47.google.com (mail-io1-f47.google.com [209.85.166.47]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B07D369A30 for ; Sun, 19 May 2019 15:42:28 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: by mail-io1-f47.google.com with SMTP id g84so9156794ioa.1 for ; Sun, 19 May 2019 08:42:28 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc; bh=/Csyzs8xm+Zetz6QoMG7p71y2CSq9y7H3MO0mCjIk4c=; b=btcjJ5gqt5M7DJDpJrQ3CfMKxlFRiZ7p85ELeh2TkirqtW53BJtwuO8ii3Qw0Jo48W DUrfvtIDQA2Mof4TlLt6ClXN+PFjlYz2W2EWCTaBY7pCBbfzinqXSrgYpk+iWrXlyOmQ fVmktumz5rmw6AqYJl+UGPqEGtvr2rrLzYwvEnWEyThWHaLFZjL1W+S1Q3niePVqHVjd JOypOykBdUn5nbnouh3aH4hTqn0W/ipieqnerLC/VHDVwkFMhBbCZ3PVbZDAcMeuKOxZ /6bjLGGaI7d4vHnOSaBL8kayfVsYnRW0k7nDkQWlzJQ6Df/I0dxAQ0HM2RzA4ngUJ1CI usRA== X-Gm-Message-State: APjAAAX1Z+k7M9olmlZ1wTQK0N/7rfKqJNgpHJ+UDD4/G62CsI2QOaJ3 lrMi1+NDN4I+q3r/ooSL0WwZZpK+ X-Google-Smtp-Source: APXvYqzdhOGir09WcTkl389HWvDflbRfNySgGmko0ZkH+RdKHxjx5F4rT8jSTmFhBxEmaDqepQTBLQ== X-Received: by 2002:a5e:9505:: with SMTP id r5mr38217845ioj.285.1558280080967; Sun, 19 May 2019 08:34:40 -0700 (PDT) Received: from mail-it1-f177.google.com (mail-it1-f177.google.com. [209.85.166.177]) by smtp.gmail.com with ESMTPSA id r9sm4962239ioj.9.2019.05.19.08.34.40 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 19 May 2019 08:34:40 -0700 (PDT) Received: by mail-it1-f177.google.com with SMTP id m141so19122070ita.3 for ; Sun, 19 May 2019 08:34:40 -0700 (PDT) X-Received: by 2002:a24:e10c:: with SMTP id n12mr23626372ith.89.1558280080217; Sun, 19 May 2019 08:34:40 -0700 (PDT) MIME-Version: 1.0 References: <20190519125505.GB6971@rpi3.zyxst.net> In-Reply-To: <20190519125505.GB6971@rpi3.zyxst.net> Reply-To: cem@freebsd.org From: Conrad Meyer Date: Sun, 19 May 2019 08:34:28 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: total configured swap exceeds maximum To: tech-lists Cc: "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: B07D369A30 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of csecem@gmail.com designates 209.85.166.47 as permitted sender) smtp.mailfrom=csecem@gmail.com X-Spamd-Result: default: False [-5.67 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[cem@freebsd.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.90)[-0.904,0]; FORGED_SENDER(0.30)[cem@freebsd.org,csecem@gmail.com]; IP_SCORE(-2.76)[ip: (-7.97), ipnet: 209.85.128.0/17(-3.50), asn: 15169(-2.27), country: US(-0.06)]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[cem@freebsd.org,csecem@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; TAGGED_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[47.166.85.209.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 15:42:30 -0000 Tangent to this thread, but: On Sun, May 19, 2019 at 5:56 AM tech-lists wrote: > Then there's the thing about dump/panic. IIRC doesn't total swap have to > be at least size_of_ram ? It can be smaller if occasional failure is acceptable. Minidumps are on by default and only dump active pages. Additionally, dumpon_flags can set "-Z" for zstd compression in 12.x+. The numeric speed/compression level is configured with sysctl kern.kerneldump_gzlevel (perhaps misnamed at this point, but originally only supported gzip). In practice, Zstd compression can often achieve good compression at level 1 or 3, reducing the size of swap needed to store a complete dump by a factor of maybe 3 without significant slowdown to the dump process. Cheers, Conrad From owner-freebsd-hackers@freebsd.org Sun May 19 15:53:24 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9ECE515B1350 for ; Sun, 19 May 2019 15:53:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-23.consmr.mail.ne1.yahoo.com (sonic312-23.consmr.mail.ne1.yahoo.com [66.163.191.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2AAAA6A1C1 for ; Sun, 19 May 2019 15:53:22 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 4avksnMVM1lOnJw95Y4nxh7FdqZLPruLXg_RU8KvVnLHrHbmX8GwMtkfk55TQLw jezBQru4OIVxpvJvCflk60OyMl8ep9UAlTbQGHl1jFjDZVnCL_NbIbrUH4rYq7l5pbUwprpzK2ku dUqF6Kj1bcauk18Bzw6.kE3nSU.pioRqASi7kyWG0.HfKDkDHHiS8YpXEQJBoDeK1Jr4ErCHkJ0f XaMdbTsTI4FCWSTarDEfzuEQcXrTU4Z4WqK.27IjP9trvJ0j38QfuQEV2mvfA1iXd_L0BBaANl7T eq2KeE7XrY37e9bXMWZJeE2HX5QuxCdpEOvYC1ucrWOsP21WaKGcGDgYbt2ohWvOMn0mcB_N5xvm .KTGrMwa68OCiCrICgb19u3AtQscTfWpDs_RHPV8kVBekD3nmuaswPuawAR1DKTzl_NhCmyNNTOT CI2om7vpiugKR6DRz5mrT_HQy0oEIU49NTqzXkLzyiq64NN9lI4C3574eCwnegIoJ5v.ilsjdT4B xH2tjNkNKkA2hfM3uMT6I90OXapIv8gc8ZWfEfi9u8sB2kZ7mgA6NDBvFUIjkKturM2r.FeP3TkQ rCB2VLDu1wiuHyHY2MI_UNBAfEMRVJZ5M.E968VvIxoohYni92.1dCHZ9BKzlI_XIP3RfE7MVuOy PgJUh5dQEKFObY5wDhoYOOte5tYmRkVhMXf58seAXyuL0obDqZB6n40IUbzXObZSX7RZ4Ykj72Hz aeLwCrjbBoNfd_j.j6c_gEy77LIdSns.M4_.mb0qlTl5SmWCYaLQrt9YPZJWLVFfa4NnqW_cB4Qd 5sQHhr9j2BWIHnVKHKryVmrPAJY0rfNS4nrkqjNCUzfImFsn6cyHDR8f1jd0mK0Fw8.ficmBnP5. PIy1TcWjF1_9oxwdkxB0YrLC_gWMTywGRivustijaVT5F0Zr92ZXqYzCt7Oy3TnohwbqF.BD.eBo KBTgplPUDrTVcZvcmXL5cPo76D4TmxJu_V1YhnPFDvbrRcRwnAzuM3ehR5DczhN.aU41gNaiKDgY nj476_08Q6PPFs08zQHi8DO9_mjU5eClsJBNSremIabzjblnuTu2tV04LlCxDJS3GPQ_h0tQg9xd euuiAmLcbXGPP357lOdBccq6qf5HOpNgAKkkYQ7aaEgD_rZKWizhzYwZWiqb6XumjTumFd243blW pms8VfxCf2J3PhtVvvmQYX9OxLNKvt78SE.Xo0zy9E8E9DpGFMRvIJsRzNQ2fvyfLssRp9JI- Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.ne1.yahoo.com with HTTP; Sun, 19 May 2019 15:53:21 +0000 Received: from c-76-115-7-162.hsd1.or.comcast.net (EHLO [192.168.1.103]) ([76.115.7.162]) by smtp427.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 2f26cc64315f70001cffdb4cf9a774b4; Sun, 19 May 2019 15:53:17 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: total configured swap exceeds maximum From: Mark Millard In-Reply-To: Date: Sun, 19 May 2019 08:53:15 -0700 Cc: RW , freebsd-hackers@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <18598E43-CFB1-4C3C-BC46-A4F0DEB569CF@yahoo.com> References: <20190519160033.0b0e47fa@gumby.homeunix.com> To: Wojciech Puchar X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 2AAAA6A1C1 X-Spamd-Bar: + X-Spamd-Result: default: False [1.71 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-0.28)[-0.282,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.81)[0.813,0]; NEURAL_HAM_LONG(-0.37)[-0.375,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.56)[ip: (5.33), ipnet: 66.163.184.0/21(1.42), asn: 36646(1.13), country: US(-0.06)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[204.191.163.66.list.dnswl.org : 127.0.5.0]; FREEMAIL_CC(0.00)[googlemail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 15:53:24 -0000 On 2019-May-19, at 08:33, Wojciech Puchar wrote: >>> what should i set kern.maxswzone to ? it is 0 >>> >>> # sysctl kern.maxswzone >>> kern.maxswzone: 0 >> >> IIRC for amd64 kern.maxswzone=0 represents the maximum allowed. > so i cannot have more VM than 5*RAM? There is is a kernel memory tradeoff structure to increase in kern.maxswzone being larger as I understand. Quoting "man 8 loader" (but the "eight times" is system/architecture specific and will likely be different): kern.maxswzone Limits the amount of KVM to be used to hold swap metadata, which directly governs the maximum amount of swap the system can support, at the rate of approximately 200 MB of swap space per 1 MB of metadata. This value is specified in bytes of KVA space. If no value is provided, the system allocates enough memory to handle an amount of swap that corresponds to eight times the amount of physical memory present in the system. Note that swap metadata can be fragmented, which means that the system can run out of space before it reaches the theoretical limit. Therefore, care should be taken to not configure more swap than approximately half of the theoretical maximum. Running out of space for swap metadata can leave the system in an unrecoverable state. Therefore, you should only change this parameter if you need to greatly extend the KVM reservation for other resources such as the buffer cache or kern.ipc.nmbclusters. Modifies kernel option VM_SWZONE_SIZE_MAX. === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-hackers@freebsd.org Sun May 19 16:40:35 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8049415B2380 for ; Sun, 19 May 2019 16:40:35 +0000 (UTC) (envelope-from rwmaillists@googlemail.com) Received: from mail-wr1-x436.google.com (mail-wr1-x436.google.com [IPv6:2a00:1450:4864:20::436]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D69066B952 for ; Sun, 19 May 2019 16:40:33 +0000 (UTC) (envelope-from rwmaillists@googlemail.com) Received: by mail-wr1-x436.google.com with SMTP id d18so11904291wrs.5 for ; Sun, 19 May 2019 09:40:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=pTRWWJ8+GQS26Hm89JbizCcNtCo974tQAHQynzTSKOk=; b=Sx1wLPmQka++x3YrgHdb02Pu+hgM+Ozql8U8EoqwsiPyZJ1pUOqKPRTfs5O2xAxOOi yLQ0BekRdRsZaDYVKC4gz8Mvtp1WtMyL8GMB/rKtUMTxDD6tVELs/YVkMvrFmMcbHmBl lsaEFd+a4fIzuA9WZWwOD5LrsgTYwQARifygLEcuS8F7MjsUyp/i/3rs3TbiYWy4t1KN VQHzxXc9jGHZ52UHNjjAFPTQrB2pdcaG1JzuF2rrtKr3KqMDxKV1QZJ/D6R2bOp6jw+m 7pgt8tMPGu8vM81SUlnXmQLfLAkHIfDoAwvmdbCwF1SsgjigVoF7pr/lYn+HgesuNbmU bpVw== X-Gm-Message-State: APjAAAWB+99xysBprjKqdZ89SMupaIITzJKn3AIZnKr1s3qj7G0ZQrt/ tFt/sIoauTPRk8Q+aB/Hj1IPB44eQkg= X-Google-Smtp-Source: APXvYqxU9KbzZflkpRo4JXu7cbDHyosdTybiR1SEmavZLxxMQ7QWIFb7dwUxoJA73u+LvMGXn3oY5Q== X-Received: by 2002:adf:9ccc:: with SMTP id h12mr9793636wre.21.1558284032367; Sun, 19 May 2019 09:40:32 -0700 (PDT) Received: from gumby.homeunix.com ([2.121.235.191]) by smtp.gmail.com with ESMTPSA id g13sm11627381wrw.63.2019.05.19.09.40.31 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 19 May 2019 09:40:31 -0700 (PDT) Date: Sun, 19 May 2019 17:40:30 +0100 From: RW To: freebsd-hackers@freebsd.org Subject: Re: total configured swap exceeds maximum Message-ID: <20190519174030.0206eb41@gumby.homeunix.com> In-Reply-To: <18598E43-CFB1-4C3C-BC46-A4F0DEB569CF@yahoo.com> References: <20190519160033.0b0e47fa@gumby.homeunix.com> <18598E43-CFB1-4C3C-BC46-A4F0DEB569CF@yahoo.com> X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: D69066B952 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.72 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[googlemail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[googlemail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[googlemail.com,quarantine]; NEURAL_HAM_SHORT(-0.95)[-0.950,0]; RECEIVED_SPAMHAUS_PBL(0.00)[191.235.121.2.zen.spamhaus.org : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[googlemail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[googlemail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[googlemail.com:s=20161025]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.76)[ip: (-9.29), ipnet: 2a00:1450::/32(-2.20), asn: 15169(-2.27), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[6.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 16:40:35 -0000 On Sun, 19 May 2019 08:53:15 -0700 Mark Millard wrote: > On 2019-May-19, at 08:33, Wojciech Puchar wrote: > > >>> what should i set kern.maxswzone to ? it is 0 > >>> > >>> # sysctl kern.maxswzone > >>> kern.maxswzone: 0 > >> > >> IIRC for amd64 kern.maxswzone=0 represents the maximum allowed. > > so i cannot have more VM than 5*RAM? > > There is is a kernel memory tradeoff structure to increase in > kern.maxswzone being larger as I understand. Quoting "man 8 loader" > (but the "eight times" is system/architecture specific and will > likely be different): > > kern.maxswzone > Limits the amount of KVM to be used to hold swap > metadata, which directly governs the maximum amount of swap the > system can support, at the rate of approximately 200 > MB of swap space per 1 MB of metadata. This value is specified > in bytes of KVA space. If no value is provided, the > system allocates enough memory to handle an amount of swap that > corresponds to eight times the amount of physical > memory present in the system. In swap_pager.c /* * Initialize our zone, guessing on the number we need based * on the number of pages in the system. */ n = vm_cnt.v_page_count / 2; if (maxswzone && n > maxswzone / sizeof(struct swblk)) n = maxswzone / sizeof(struct swblk); In i386 maxswzone defaults to a specific value and it is possible to increase the size. In amd64 maxswzone defaults to 0 which give the highest value of n permitted. From owner-freebsd-hackers@freebsd.org Mon May 20 15:38:22 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ADF1215B06B3; Mon, 20 May 2019 15:38:22 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1639F8392F; Mon, 20 May 2019 15:38:22 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id B605E1CE0A; Mon, 20 May 2019 15:38:21 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 96B86186AD; Mon, 20 May 2019 18:38:19 +0300 (MSK) To: freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: Commit r345200 (new ARC reclamation threads) looks suspicious to me. Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABtCFMZXYgU2VyZWJy eWFrb3YgPGxldkBGcmVlQlNELm9yZz6JAlYEEwEIAEACGwMHCwkIBwMCAQYVCAIJCgsEFgID AQIeAQIXgBYhBPltHKC19DGLZ0szCuqwPFi/3EePBQJb/TeXBQkPBbfGAAoJEOqwPFi/3EeP LtEQANQLS89OCDSnLDZLyCj7sH5GZbTikJp9Or2McqEOpjgtfY/OgqCe7lfo8f71tTN3gL2t VGtNEtsl6CqKeBdm6fqsetCAed2+waJfbXLZWReLRSFQJ/cbof8MB3h/uEw8Zng1ZbyEU0eG rc41Mhk8bTfxjNRjkXDbp0+2xug+eRr2RYhiY2SxH+iy57AbRIu9gkjfL05VztfvsV5dPxt7 +reHf2Vhtu+qCRtCytGQqDvYWGpVZ8U5fHJxFdsJpn66LAe8w+iRGCbppB5TKeHkqWqDb++u sd5ZHzwep/7qcLBeKggi8+a2C3J1J4TpYBwdPgusrGtBPf2EYSTc/0mW5j86g1l8UDN9qXAI FvWbKf22p5SlYUzf5qRLny4ZdDl1mH13lmJV7ZkZGMKnt0IjJ2x0LRgLGhiSm/D4Lh8yc/MX uhj9BB020XbWcMUPpA7S7YaWeIXbnK3NrPU0yk77prFJblfskOwuaxJIwa2mX+cCAQA95As5 2talifo4Kh8OLSvS1gpbMo64LllTzuGbCWuKecH3fpMlZlD7/10z9lBvkSXA7KgadDfN0yHO xGCK8KE9gXXmEVRlbgGDYOJw9FLWHuSZHUvQTkmr4goXrmMIKa9A4BKO3s9vowP4pJ0vp3kz MIBeEwKSvAeZZfgKbIKggKUuQ5gsAqvF360sG3+UuQINBFKbGksBEAC0a9wfjo2P3JyT7Lc+ QlbFVshGbSbazb4ma7QYG5IZZD5vfLBFkePoG6cnrn3WCXp4A43hszAynCwe4eXyAkv4+gPF 3ZSeNE5Wz3zYG+jh2nm2iGCkyaVykfbA+2chor2DKH5tHpuNMBlF+wSJHZKJmlo/sFIktAnV 1NBVg4/cL+9/hIpvl82cl3hYCD7/e7/qRE+w38CpAAzn65FvbODn7xlY3fsJt+cHPBJ4EBM9 KnTwcce+F+72RQMZQEl7vIAwSRmLdgZHN0MFC533l62SVoKjT0eaOOIBrvesmojhWjfwugib Xr+WRF/tGcW77Bxwe2eQLbEVESqWeMORxRxocx7Q7aACoHmf4G4U1Vzx7zUEfNfHjfjZeQVf AURf/MoUelZSW/BmMIfKCg3lRlWAt+Pq2h2UADPVqAZze45beE/c8z8LZsOZiGoRhYL8NSg6 +ziLTdmYLWdtFGAuZhqOtNp5h6tGj21OksBotcaIa5YjbCmmnImIjGlSBkUKvIhq/RXth5b2 gNwaQdu+Yv4AlZVHRsuVywL/skDFL5+We11bDK6MQ5PzvmntRJcgbyoisn1hiV04OV1LpJJM kJn1j8VlBqDQNT/z+BjB0ru/0anv+5uLj7v0ck06rEo4yiXT/ZAcBM76j7V7FaGbkoba6bUU CQ2H5YYBOKpikjCnpwARAQABiQI8BBgBCAAmAhsMFiEE+W0coLX0MYtnSzMK6rA8WL/cR48F Alv9N7IFCQ8Ft+cACgkQ6rA8WL/cR49wpw//W7QrZHKYUWEVHtPLVMlcM1f7MgwnYlIRe/I6 gykwvt87sqxSYu7eHxfX6JZR2M9UYuUYscSR57gxXKu2Uzqaz2KjvEIXJCwCTsuXZjkQ19oL hAPsucw2AcMI6YqPXbZ7hO0Mh8jMeJzD6vDvx3zvunQxGQoZKxr3BvRUyO7NCYbA7N8ccI3E Tmdjj9JTbtue9WaUeGLszFDiITmkASBdsK07y4ylLAJzUGCvYLBU3gx0bBOB2S8SbxHYmQlj ewjovbp+MbT+CoXNxZp+gDRModGyIMdRIotkRiDbgNl0VWIT0SS1GUUlUHKzQ/ZPUvpvk6Gq s/SYBS7rBQNSoXXmJxNW6I6atVNW7JhInC1tkHxBlbpik4FK07J6NHFTx+9ygyCxbxwNA/Le FGkL3kU0VFXR2dNiAVbeueUPF6tU5Bye5ftgpLKOSAbo1g++EKUkc8335/4oYRBMcGEk4xUr NAvzoFPhA2W3KtklruJ9ThrFt9+//NB5ySlVgTwGWMuBJoskEmNOTBv34/UQPUIuE4xSwy6y H+nRQJooiMFo5QCosslJPlwyV63NS9lYXB6n3QWOCP6sFdWACNUCOFv4uk7LQdY9BsCmt2Tk cLuHmoS+fvUesQXnYV2aQi9HciriPIj2gvJ6WjgiaC/PpePil0fzyrfG/JMyHL0qcgmYoj0= Organization: FreeBSD Message-ID: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> Date: Mon, 20 May 2019 18:38:07 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="2otz2YBkNKpHdJOidjhGzRvIgUzq6EAGT" X-Rspamd-Queue-Id: 1639F8392F X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.98)[-0.983,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 15:38:23 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --2otz2YBkNKpHdJOidjhGzRvIgUzq6EAGT Content-Type: multipart/mixed; boundary="vr8o0Z3UyUbX9pqkufPdmsagmN2NSX6yY"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Message-ID: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> Subject: Commit r345200 (new ARC reclamation threads) looks suspicious to me. --vr8o0Z3UyUbX9pqkufPdmsagmN2NSX6yY Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I'm looking at last commit to 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and have one question. Is it Ok for two threads to communicate via simple global variable? Now new code has (line 315): static boolean_t arc_adjust_needed =3D B_FALSE; And after that some threads run code like this: mutex_enter(&arc_adjust_lock); arc_adjust_needed =3D B_TRUE; mutex_exit(&arc_adjust_lock); zthr_wakeup(arc_adjust_zthr); And thread `arc_adjust_zthr` has code like this (line 4874): return (arc_adjust_needed); This variable is not atomic. It is not updated and/or read in atomic way. What code gives guarantees that `arc_adjust_zthr` will detect this change? I don't see any. Am I wrong? --=20 // Lev Serebryakov --vr8o0Z3UyUbX9pqkufPdmsagmN2NSX6yY-- --2otz2YBkNKpHdJOidjhGzRvIgUzq6EAGT Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlziyd9fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R48yvxAApPXpt46m0ejunWWcU6ul4k4m+c0UvPn3AbQuS6DB1gHcAY4lOyTe0XTy xOsl3JJD3CYyK3IGjFt29WqrPSbZzRGR7Jxew/mS9alJztElkCVGfPZccJkf2sJo WxBwJAv0zERVJM6tlml3E+8gjS0IJje0Own2zSHUOorv6c+uXQhQQTC1G+EYdEnY lmghAf105yi8ur0HSCadp0jSlGZ+RWLc/RDldQMCPnNdLLl8xKjAxnaOSCPsaOXn vDZ5OWinQBtCQtMk4eBhFxXhWiBUzOEYMYYy6PJWfmVMfsIodrx8Vakx2J4GeVXl lLPuvc0Xiftp94ya6C7FdIUiuxktDixo0571EFMNQqUrJTxTAVOtKkCC4KCzEnZt Eb3f8Uk0Mrdn2GW0ML/0Dr0jzXw6SzyaApsH9LO1twCAtVj6VTGJA1j9yTHljbeS D7CusKEETGuE8/We/ni7V7x2sLAsXH5HyLBdYVwNRGRLFWdEIINH6yNZnHS893+K ZzWLWfnsOHPXyLNcoLtNiXKnvVS1cLDlOzGcMBG0MvGY1ua0An7r2RYX2HdJhbw2 GIgNu/hiG9v/v91RazB9rZvNijAk7QBasf14qsnFQg9hDp6QSXyGQjXFxOkJC1Pr 3UzrtIpEgpZ8Ls+uQtFOT+vZJEBQNNuZ5d7H4vbU2lUj7LajMJw= =176T -----END PGP SIGNATURE----- --2otz2YBkNKpHdJOidjhGzRvIgUzq6EAGT-- From owner-freebsd-hackers@freebsd.org Mon May 20 16:05:13 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1701015B135F; Mon, 20 May 2019 16:05:13 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BFC984C62; Mon, 20 May 2019 16:05:12 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 11C611D185; Mon, 20 May 2019 16:05:12 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id A215C186C0; Mon, 20 May 2019 19:05:07 +0300 (MSK) From: Lev Serebryakov Subject: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Reply-To: lev@FreeBSD.org To: freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABtCFMZXYgU2VyZWJy eWFrb3YgPGxldkBGcmVlQlNELm9yZz6JAlYEEwEIAEACGwMHCwkIBwMCAQYVCAIJCgsEFgID AQIeAQIXgBYhBPltHKC19DGLZ0szCuqwPFi/3EePBQJb/TeXBQkPBbfGAAoJEOqwPFi/3EeP LtEQANQLS89OCDSnLDZLyCj7sH5GZbTikJp9Or2McqEOpjgtfY/OgqCe7lfo8f71tTN3gL2t VGtNEtsl6CqKeBdm6fqsetCAed2+waJfbXLZWReLRSFQJ/cbof8MB3h/uEw8Zng1ZbyEU0eG rc41Mhk8bTfxjNRjkXDbp0+2xug+eRr2RYhiY2SxH+iy57AbRIu9gkjfL05VztfvsV5dPxt7 +reHf2Vhtu+qCRtCytGQqDvYWGpVZ8U5fHJxFdsJpn66LAe8w+iRGCbppB5TKeHkqWqDb++u sd5ZHzwep/7qcLBeKggi8+a2C3J1J4TpYBwdPgusrGtBPf2EYSTc/0mW5j86g1l8UDN9qXAI FvWbKf22p5SlYUzf5qRLny4ZdDl1mH13lmJV7ZkZGMKnt0IjJ2x0LRgLGhiSm/D4Lh8yc/MX uhj9BB020XbWcMUPpA7S7YaWeIXbnK3NrPU0yk77prFJblfskOwuaxJIwa2mX+cCAQA95As5 2talifo4Kh8OLSvS1gpbMo64LllTzuGbCWuKecH3fpMlZlD7/10z9lBvkSXA7KgadDfN0yHO xGCK8KE9gXXmEVRlbgGDYOJw9FLWHuSZHUvQTkmr4goXrmMIKa9A4BKO3s9vowP4pJ0vp3kz MIBeEwKSvAeZZfgKbIKggKUuQ5gsAqvF360sG3+UuQINBFKbGksBEAC0a9wfjo2P3JyT7Lc+ QlbFVshGbSbazb4ma7QYG5IZZD5vfLBFkePoG6cnrn3WCXp4A43hszAynCwe4eXyAkv4+gPF 3ZSeNE5Wz3zYG+jh2nm2iGCkyaVykfbA+2chor2DKH5tHpuNMBlF+wSJHZKJmlo/sFIktAnV 1NBVg4/cL+9/hIpvl82cl3hYCD7/e7/qRE+w38CpAAzn65FvbODn7xlY3fsJt+cHPBJ4EBM9 KnTwcce+F+72RQMZQEl7vIAwSRmLdgZHN0MFC533l62SVoKjT0eaOOIBrvesmojhWjfwugib Xr+WRF/tGcW77Bxwe2eQLbEVESqWeMORxRxocx7Q7aACoHmf4G4U1Vzx7zUEfNfHjfjZeQVf AURf/MoUelZSW/BmMIfKCg3lRlWAt+Pq2h2UADPVqAZze45beE/c8z8LZsOZiGoRhYL8NSg6 +ziLTdmYLWdtFGAuZhqOtNp5h6tGj21OksBotcaIa5YjbCmmnImIjGlSBkUKvIhq/RXth5b2 gNwaQdu+Yv4AlZVHRsuVywL/skDFL5+We11bDK6MQ5PzvmntRJcgbyoisn1hiV04OV1LpJJM kJn1j8VlBqDQNT/z+BjB0ru/0anv+5uLj7v0ck06rEo4yiXT/ZAcBM76j7V7FaGbkoba6bUU CQ2H5YYBOKpikjCnpwARAQABiQI8BBgBCAAmAhsMFiEE+W0coLX0MYtnSzMK6rA8WL/cR48F Alv9N7IFCQ8Ft+cACgkQ6rA8WL/cR49wpw//W7QrZHKYUWEVHtPLVMlcM1f7MgwnYlIRe/I6 gykwvt87sqxSYu7eHxfX6JZR2M9UYuUYscSR57gxXKu2Uzqaz2KjvEIXJCwCTsuXZjkQ19oL hAPsucw2AcMI6YqPXbZ7hO0Mh8jMeJzD6vDvx3zvunQxGQoZKxr3BvRUyO7NCYbA7N8ccI3E Tmdjj9JTbtue9WaUeGLszFDiITmkASBdsK07y4ylLAJzUGCvYLBU3gx0bBOB2S8SbxHYmQlj ewjovbp+MbT+CoXNxZp+gDRModGyIMdRIotkRiDbgNl0VWIT0SS1GUUlUHKzQ/ZPUvpvk6Gq s/SYBS7rBQNSoXXmJxNW6I6atVNW7JhInC1tkHxBlbpik4FK07J6NHFTx+9ygyCxbxwNA/Le FGkL3kU0VFXR2dNiAVbeueUPF6tU5Bye5ftgpLKOSAbo1g++EKUkc8335/4oYRBMcGEk4xUr NAvzoFPhA2W3KtklruJ9ThrFt9+//NB5ySlVgTwGWMuBJoskEmNOTBv34/UQPUIuE4xSwy6y H+nRQJooiMFo5QCosslJPlwyV63NS9lYXB6n3QWOCP6sFdWACNUCOFv4uk7LQdY9BsCmt2Tk cLuHmoS+fvUesQXnYV2aQi9HciriPIj2gvJ6WjgiaC/PpePil0fzyrfG/JMyHL0qcgmYoj0= Organization: FreeBSD Message-ID: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> Date: Mon, 20 May 2019 19:05:07 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="UjA9hsut7pP6HXGyYiI8hkW1DMFekAsUU" X-Rspamd-Queue-Id: 4BFC984C62 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.980,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:05:13 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --UjA9hsut7pP6HXGyYiI8hkW1DMFekAsUU Content-Type: multipart/mixed; boundary="e5XAhQSTvMSs9v9w4opHL9AcywXVm0rTy"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Message-ID: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> Subject: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem --e5XAhQSTvMSs9v9w4opHL9AcywXVm0rTy Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I'm looking at last commit to 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and have another question. Here are such code: 4960 /* 4961 * Kick off asynchronous kmem_reap()'s of all our caches. 4962 */ 4963 arc_kmem_reap_soon(); 4964 =09 4965 /* 4966 * Wait at least arc_kmem_cache_reap_retry_ms between 4967 * arc_kmem_reap_soon() calls. Without this check it is possible to 4968 * end up in a situation where we spend lots of time reapin= g 4969 * caches, while we're near arc_c_min. Waiting here also gives the 4970 * subsequent free memory check a chance of finding that th= e 4971 * asynchronous reap has already freed enough memory, and we don't 4972 * need to call arc_reduce_target_size(). 4973 */ 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / 1000); 4975 =09 But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, this `delay()` looks very wrong. Am I right? Looks like it should be `#ifdef illumos`. --=20 // Lev Serebryakov --e5XAhQSTvMSs9v9w4opHL9AcywXVm0rTy-- --UjA9hsut7pP6HXGyYiI8hkW1DMFekAsUU Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlzi0DNfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R4/G2xAAgTzfzeDRycWw5jwlXWAJwExJh4ItBjDoWwe1U+1Yn0tcd+ZbsZX2iH2K R6MJllylJlYF/VHc1Np022vViKrP0bj9vG26QsRjhXZSoGvBYf9exPEp7GMmO81b U6Rm6JyUeuPvc19Kqusrk3FV2CWtu5dUqgp68n5cmujyztZLi1wobRapAHZ+YnrZ SdwnAF28E9LucgNIb4obbe00gkRNlgfXMhMeVi7Q+If/FTJOApoB5dZRdqkv80DF 7wmRhd/423k3ETrkGbRkJNXkWM2jIU13WAbFLbgcDcHZptdePIA2vQ5/CL1W0yV7 1ShZIk3jLgSI/Ue55UpJkf6kgEhZ9v7fOUCNaN5+BhgEut+shVY+Yd7meii7+vsh 6rOVyuXuOoFZFqbkDSLxhLz/zF/zm3Ee9KTIC8WTyuGpHxtFWY6InJFXlZIoiV+A 6gHbYUoKpDOuSwjW+HsGrSEZfZVaH9PeRb7P8UUu6pcrU6UFJFvnX9zqrG/4Hrvi NHCf8rweBnMUuimmeAa6H4kX7sOaK93azqLrk6wuSQYvZ69r8KIcsRKI6Up48rtn pQgT8bJOG5z4Ayk/PYRcltmug/SCGJnf+dtEDgomLb+qsBUdpmP6j4a9Wcxo66pz 4xUmyU2KzqFmx7Gj2oswGTZk1QS+ONj5dhza0gt+gGZU0CFDaWU= =V3Nd -----END PGP SIGNATURE----- --UjA9hsut7pP6HXGyYiI8hkW1DMFekAsUU-- From owner-freebsd-hackers@freebsd.org Mon May 20 16:20:50 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 66D3915B1A62 for ; Mon, 20 May 2019 16:20:50 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound3d.ore.mailhop.org (outbound3d.ore.mailhop.org [54.186.57.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D81578553E for ; Mon, 20 May 2019 16:20:49 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1558369248; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=Q9C2yE1DEzEvavTiBes2JrWahNX0QLReE2+opnzWhvabcjqsA74tfyXOvCjZCRWuZ2H0ypcJx9C6+ YcJ7qNT+rqFla7FN6mAWUqBtiC97KvHumZLgwtOLM3KxuAfzN5kkjsOHScRt/8yeJLfNF2u8QIpCNA jbqrl/KCzNgICN14mZPQUomGYLEXTeFxCrKlJI24ehngyTxveWo2+oi0wPLHEMglDc5T874A3vH8vk IiWoF5e4ObnfG6tKZYdvKJFoeGgRF+eCzr6V9KAh1dCLUaOUA+BKVCfv01GhJs7YnxNNlgQ1NKZOXw iUwoJ2LoqM7CVbG84eKpBzh/bjiQsPA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:dkim-signature:from; bh=14WWBiocjAfZezhw4SrVUMCriDCHv4r+HKSo15KGdrU=; b=eCTrHMq0E/LtUYHSn6LxMtQiMtM08MFqk4WO4exec+ZRmtDyPPTt2OR5V+4giEpHo9g4EasGfg+Tw 4rHEtuaX+FIDMXj5UDe7WXy66SYd1tc3rn4n+B7cDisIj37que2TBB0H3laGrX4gE3D0xSbHhtDx7F A9UO/Ry1Cy6joEnuV+GvD3Yq88dGn99jJAWGFtJsW1XZpbXDnFRgsLRHLDT++2fst8jZtWVmgU6FsE E04dpdlIeh+DqTzBEZaTeabr1scHniIzg+IKWtmWRbMYkiejjRiRMy+0tjmeHSpKY/w6d88wipzRR5 iwvVvOmbDj80Ng9WYzJkpCRyvfwMYIw== ARC-Authentication-Results: i=1; outbound3.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:from; bh=14WWBiocjAfZezhw4SrVUMCriDCHv4r+HKSo15KGdrU=; b=ivBKPH9aqOmJMPFFMPcI8Io7zf7sgyitKeU07IiLIIxN1j4aah9/1WllZynxeXSRZNAFEwwJCkDlq d5PzJLPJGvtjS3UKFoPkXmre60XkPwIu9AeQSY36WzcpvWtaQL49zQcesirU/wT1n8yfJpXLIJObaI gPpsuVlJsuPphe8z4P6MIy7zZqF2ZIfZ4V/nt+GmGhLUCkEMkHGB1I2bUCctdq1UItsaJatgnVL+m/ 7Mg59qDwn0M5jWd9QdHV9kL0b1nZ24y2/JD14HqPGV5tY05sGUMOx62UqTrUHap+OU/8O2LrQlXNGs VBX+YlZDxTxqaGxuIhl1LD5mvUtXFqw== X-MHO-RoutePath: aGlwcGll X-MHO-User: 38f03783-7b1b-11e9-990f-673a89bc4518 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [67.177.211.60]) by outbound3.ore.mailhop.org (Halon) with ESMTPSA id 38f03783-7b1b-11e9-990f-673a89bc4518; Mon, 20 May 2019 16:20:46 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id x4KGKjFw024929; Mon, 20 May 2019 10:20:45 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <8160c9149c04d2b622292abf582bcbb9a541d2ed.camel@freebsd.org> Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem From: Ian Lepore To: lev@FreeBSD.org, freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Date: Mon, 20 May 2019 10:20:45 -0600 In-Reply-To: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: D81578553E X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.990,0]; ASN(0.00)[asn:16509, ipnet:54.186.0.0/15, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:20:50 -0000 On Mon, 2019-05-20 at 19:05 +0300, Lev Serebryakov wrote: > I'm looking at last commit to > 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and > have another question. > > Here are such code: > > 4960 /* > 4961 * Kick off asynchronous kmem_reap()'s of all our > caches. > 4962 */ > 4963 arc_kmem_reap_soon(); > 4964 > 4965 /* > 4966 * Wait at least arc_kmem_cache_reap_retry_ms between > 4967 * arc_kmem_reap_soon() calls. Without this check it is > possible to > 4968 * end up in a situation where we spend lots of time > reaping > 4969 * caches, while we're near arc_c_min. Waiting here > also > gives the > 4970 * subsequent free memory check a chance of finding > that the > 4971 * asynchronous reap has already freed enough memory, > and > we don't > 4972 * need to call arc_reduce_target_size(). > 4973 */ > 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / > 1000); > 4975 > > But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > this `delay()` looks very wrong. Am I right? > > Looks like it should be `#ifdef illumos`. > One of the things arc_kmem_reap_soon() does is call dnlc_reduce_cache(), and that sets a variable and does a condition variable broadcast, presumably causing other threads to wake up and do some work. So, presumably the delay (which appears to really be a call to pause(9) on freebsd) allows time for that async work to happen before calling arc_available_memory(). -- Ian From owner-freebsd-hackers@freebsd.org Mon May 20 16:26:32 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0A3115B1C9F for ; Mon, 20 May 2019 16:26:31 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound1a.eu.mailhop.org (outbound1a.eu.mailhop.org [52.58.109.202]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F315E85ADF for ; Mon, 20 May 2019 16:26:30 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1558368620; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=rTrqzHhg/ZQJQcTWm1Cepem5kH0ZiUnUwcP/Z6u4HPG+6KSj6pNg6LdDBn3t6/nue15oWpNKxrSuS wd3kcc9NlUx3xC1DTsR8A5XwR6tuWaywPp5f3f5DdAUiKZuP+UHBdMnxNcZM51HHget49IWl5VR0YU pfM+6N8G75SIxgAQ38KkEGaLsbCIflfLB27lE9rk+GdoqmE4X6KLaV4AIHFsfUpdRIMZRUS8hAARRQ 2OQLZpYjIER80DNttxDofI5zZ55D0+JWABBLfwxXImNc9H6KK4okMrG+Gsh4POjfpPio9zEbkIV6AE t+6ED3h2PNz7/s5Q2LFvFUOILaSoJ3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:dkim-signature:from; bh=O2Lw82ky9ld8ggooTZudj58wNggpWoWPWmDaXwDYlV8=; b=SLU8L7DG8aH7yXt3WEhp8g4eqBTjW59zHa7h4TQ7Qawz4spt8AmERzWL3VFcXYReL97W0lx6Rn2KC z5eD269SN4JwI8nBgHlZ1dfRbY/R0nqO3Eg5OA8/WNlGvXWKeGSvLX9Gwfq2b0jJCbc7mRo+/r1LSq vE/whgRiBRwDWsxmbzd9/RNW+jba034fbDuEXraopK+x9Kq/xIpUW3ylwz8o4tqMUbn4+JuoTlaZci BomvFcUg6zNImw7BEIZ2JSfO044jVwyxaPEp2tcphMFJ2kauvuUmkQpANuRbzPN006IWERVSWy9xH4 1JGrPxPNriKSB8lDBGr+xqmmWIWBwSQ== ARC-Authentication-Results: i=1; outbound2.eu.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:from; bh=O2Lw82ky9ld8ggooTZudj58wNggpWoWPWmDaXwDYlV8=; b=LB15JlqGEc/hcNz0vk6EIORpLacFWT1Vkh+sVi3mTsYV2YHGAm57MJWWpjXsGynyMz7vrOyxekuCf F73Rq1H58IovPO3mO86Q/EMv02YAWsfU0iJX2S4UvvUaohSs8dYxgeCV8yZdFmW2zEhgl2B7j854Ub FEmKI5c5SThbhJnXuzDevUB510hujF1Cr2qVBejnOjM3bHZzBRnIZGlbYjk7WjMRv8HolOIxLwwLg/ 4rFd53zOpR7rR8vXjzfAubqAKhxGdwl2fd3qpew08sE45dDalnuNMpDle7ezbPHY8xwEBnPCK8WZmi 3P9arKYh/gVq1K9PsQ8aeC315GG5EUA== X-MHO-RoutePath: aGlwcGll X-MHO-User: c1ac49d9-7b19-11e9-85c6-c97e5c048ed3 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [67.177.211.60]) by outbound2.eu.mailhop.org (Halon) with ESMTPSA id c1ac49d9-7b19-11e9-85c6-c97e5c048ed3; Mon, 20 May 2019 16:10:18 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id x4KGAGjq024895; Mon, 20 May 2019 10:10:16 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <174f71126ca39907370a8904c07546b712ad91b9.camel@freebsd.org> Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me. From: Ian Lepore To: lev@FreeBSD.org, freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Date: Mon, 20 May 2019 10:10:16 -0600 In-Reply-To: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> References: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: F315E85ADF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.988,0]; ASN(0.00)[asn:16509, ipnet:52.58.0.0/15, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:26:32 -0000 On Mon, 2019-05-20 at 18:38 +0300, Lev Serebryakov wrote: > I'm looking at last commit to > 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and > have one question. > > Is it Ok for two threads to communicate via simple global variable? > Now > new code has (line 315): > > static boolean_t arc_adjust_needed = B_FALSE; > > And after that some threads run code like this: > > mutex_enter(&arc_adjust_lock); > arc_adjust_needed = B_TRUE; > mutex_exit(&arc_adjust_lock); > zthr_wakeup(arc_adjust_zthr); > > And thread `arc_adjust_zthr` has code like this (line 4874): > > return (arc_adjust_needed); > > This variable is not atomic. It is not updated and/or read in atomic > way. What code gives guarantees that `arc_adjust_zthr` will detect > this > change? I don't see any. Am I wrong? The arc_adjust_needed variable is the gating condition associated with a condition variable and lock. It is only read or changed while holding a lock, and the acquiring and releasing of that lock provides the needed memory barriers. In this case, the association with the condition variable and lock is somewhat obscured by the way the zthread timer stuff works. The arc_adjust_cb_check() function is called from line 193 of contrib/opensolaris/uts/common/fs/zfs/zthr.c, and that's where you'll find the code that makes it clear this is an idiomatic condition variable pattern. -- Ian From owner-freebsd-hackers@freebsd.org Mon May 20 16:40:26 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 80C8E15B2892; Mon, 20 May 2019 16:40:26 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2016786C18; Mon, 20 May 2019 16:40:25 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1hSlKg-00010C-GH; Mon, 20 May 2019 19:40:14 +0300 Date: Mon, 20 May 2019 19:40:14 +0300 From: Slawa Olhovchenkov To: Ian Lepore Cc: lev@FreeBSD.org, freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190520164014.GA47119@zxy.spb.ru> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <8160c9149c04d2b622292abf582bcbb9a541d2ed.camel@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8160c9149c04d2b622292abf582bcbb9a541d2ed.camel@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: 2016786C18 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [3.57 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.909,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; NEURAL_SPAM_MEDIUM(0.88)[0.885,0]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[zxy.spb.ru]; NEURAL_SPAM_LONG(0.88)[0.882,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:40:26 -0000 On Mon, May 20, 2019 at 10:20:45AM -0600, Ian Lepore wrote: > On Mon, 2019-05-20 at 19:05 +0300, Lev Serebryakov wrote: > > I'm looking at last commit to > > 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and > > have another question. > > > > Here are such code: > > > > 4960 /* > > 4961 * Kick off asynchronous kmem_reap()'s of all our > > caches. > > 4962 */ > > 4963 arc_kmem_reap_soon(); > > 4964 > > 4965 /* > > 4966 * Wait at least arc_kmem_cache_reap_retry_ms between > > 4967 * arc_kmem_reap_soon() calls. Without this check it is > > possible to > > 4968 * end up in a situation where we spend lots of time > > reaping > > 4969 * caches, while we're near arc_c_min. Waiting here > > also > > gives the > > 4970 * subsequent free memory check a chance of finding > > that the > > 4971 * asynchronous reap has already freed enough memory, > > and > > we don't > > 4972 * need to call arc_reduce_target_size(). > > 4973 */ > > 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / > > 1000); > > 4975 > > > > But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > > this `delay()` looks very wrong. Am I right? > > > > Looks like it should be `#ifdef illumos`. > > > > One of the things arc_kmem_reap_soon() does is call > dnlc_reduce_cache(), and that sets a variable and does a condition > variable broadcast, presumably causing other threads to wake up and do > some work. So, presumably the delay (which appears to really be a call > to pause(9) on freebsd) allows time for that async work to happen > before calling arc_available_memory(). This call perform before any kmem reap and only conditional by arc_meta_used>=arc_meta_limit. In any way kmem reap is very long operation, longest any work in arc_dnlc_evicts_thread() (vnlru_free()). From owner-freebsd-hackers@freebsd.org Mon May 20 16:42:20 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4EA4D15B2B82; Mon, 20 May 2019 16:42:19 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-it1-x12a.google.com (mail-it1-x12a.google.com [IPv6:2607:f8b0:4864:20::12a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9EE2B86F8C; Mon, 20 May 2019 16:42:17 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-it1-x12a.google.com with SMTP id u186so92281ith.0; Mon, 20 May 2019 09:42:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=QVS3wROcc8DYEgTWE7PfKECHg+AqAwGpqSkoKJAOa5E=; b=tIi4z9qU3Tq3ZIOa36yVNjt1/57wHHEGfIAqwYqw1Gq9FNMdrllKYU411KOBfNxLt1 aBH0EJc6NyaEhOcEc5wryX2sB0nnLwyt4hJXgDNQv/GYcKNncZv8BhPerByx6Y4ENlsd MW43YvKakTuinpjgiOqCDqJyKNeVgiuIscnGe8oKUm+XY8ZOxEDlFWIBi4BgiSxbzsoQ j38T7FGI9yMISCQ9159D8etaT1zGLL10rJX+q51t+b8sDWmJ+iPZ81dDYCaibArUCd8k jcrPsK+7N5VKWrol+nCnbjJzIpkI1r4k/hzRssvBkwo22zUM+O7lLIXVhQmBKpftZ2jM 49tQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=QVS3wROcc8DYEgTWE7PfKECHg+AqAwGpqSkoKJAOa5E=; b=sYsp+yRoAdNW6aiskyfkyIscIs+ySMZF5j0A8iAjRpsb/9RULfeX0KOnet8tYNizz+ LCAWHPGeT0kw+qT3nkiFnqWzaw7Zd8YZfk7vyEX8HpdiI+j56xOVfQFPqC9UX5z8qW3x aUuGV11eRp3PJq9lhItd8ICViQDxqxuKgs5N+c1hsfqlzGvNH3f/hF0MLB6CZRztMUhG LrMsSCusyYW6O3HAeYT61Ugrk3rzTZiMQpEKf6Fs3DiYBShpdTb5OkA7uwKDSGStkL+I DawiGa8ovzrhldnilyE9a+7gmYCb6cRJHakOdlGoNsX7K+cyWd8Dbeyv1zrDQD7e6EBf D0uA== X-Gm-Message-State: APjAAAU/w8Hs6mR0fiT9fz1CFJyC9xd9XEQqmEGEOyqoFjEkxvcDDQgN VdJKK3qfAvHK96NBlcELACHFLmUs X-Google-Smtp-Source: APXvYqwO/W5mLHxeVKGJO7kzfXvs1W0R168nrcWkPols5PYThHq8ue0xo/xOj2+cZGEm+OHwkAG0YA== X-Received: by 2002:a02:b707:: with SMTP id g7mr3354030jam.23.1558370536434; Mon, 20 May 2019 09:42:16 -0700 (PDT) Received: from spy (cs-auth-dc-129-97-60-193.dynamic.uwaterloo.ca. [129.97.60.193]) by smtp.gmail.com with ESMTPSA id l136sm16247itc.23.2019.05.20.09.42.14 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 20 May 2019 09:42:14 -0700 (PDT) Sender: Mark Johnston Date: Mon, 20 May 2019 12:42:10 -0400 From: Mark Johnston To: Lev Serebryakov Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Alexander Motin Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190520164202.GA2130@spy> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> User-Agent: Mutt/1.11.4 (2019-03-13) X-Rspamd-Queue-Id: 9EE2B86F8C X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=tIi4z9qU; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::12a as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-5.49 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-2.79)[ip: (-8.38), ipnet: 2607:f8b0::/32(-3.25), asn: 15169(-2.26), country: US(-0.06)]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[a.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.98)[-0.985,0]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:42:21 -0000 On Mon, May 20, 2019 at 07:05:07PM +0300, Lev Serebryakov wrote: > > I'm looking at last commit to > 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and > have another question. > > Here are such code: > > 4960 /* > 4961 * Kick off asynchronous kmem_reap()'s of all our caches. > 4962 */ > 4963 arc_kmem_reap_soon(); > 4964 > 4965 /* > 4966 * Wait at least arc_kmem_cache_reap_retry_ms between > 4967 * arc_kmem_reap_soon() calls. Without this check it is > possible to > 4968 * end up in a situation where we spend lots of time reaping > 4969 * caches, while we're near arc_c_min. Waiting here also > gives the > 4970 * subsequent free memory check a chance of finding that the > 4971 * asynchronous reap has already freed enough memory, and > we don't > 4972 * need to call arc_reduce_target_size(). > 4973 */ > 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / 1000); > 4975 > > But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > this `delay()` looks very wrong. Am I right? > > Looks like it should be `#ifdef illumos`. See also r338142, which I believe was reverted by the update. From owner-freebsd-hackers@freebsd.org Mon May 20 16:54:49 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3859E15B3006 for ; Mon, 20 May 2019 16:54:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3678787947; Mon, 20 May 2019 16:54:48 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1hSlYk-0001Cz-MH; Mon, 20 May 2019 19:54:46 +0300 Date: Mon, 20 May 2019 19:54:46 +0300 From: Slawa Olhovchenkov To: Mark Johnston Cc: freebsd-hackers@freebsd.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190520165446.GC47119@zxy.spb.ru> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190520164202.GA2130@spy> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: 3678787947 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [3.34 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.87)[0.874,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.79)[0.792,0]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[cached: zxy.spb.ru]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.78)[0.785,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 16:54:49 -0000 On Mon, May 20, 2019 at 12:42:10PM -0400, Mark Johnston wrote: > On Mon, May 20, 2019 at 07:05:07PM +0300, Lev Serebryakov wrote: > > > > I'm looking at last commit to > > 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and > > have another question. > > > > Here are such code: > > > > 4960 /* > > 4961 * Kick off asynchronous kmem_reap()'s of all our caches. > > 4962 */ > > 4963 arc_kmem_reap_soon(); > > 4964 > > 4965 /* > > 4966 * Wait at least arc_kmem_cache_reap_retry_ms between > > 4967 * arc_kmem_reap_soon() calls. Without this check it is > > possible to > > 4968 * end up in a situation where we spend lots of time reaping > > 4969 * caches, while we're near arc_c_min. Waiting here also > > gives the > > 4970 * subsequent free memory check a chance of finding that the > > 4971 * asynchronous reap has already freed enough memory, and > > we don't > > 4972 * need to call arc_reduce_target_size(). > > 4973 */ > > 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / 1000); > > 4975 > > > > But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > > this `delay()` looks very wrong. Am I right? > > > > Looks like it should be `#ifdef illumos`. > > See also r338142, which I believe was reverted by the update. Some throttling realy need for reducing ARC size (and for reap calls too, and this is not equal) (memory freeing to kernel-wide is too expensive and can realy take seconds and more), but this implementation for FreeBSD is too bad. From owner-freebsd-hackers@freebsd.org Mon May 20 17:14:40 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59AA115B3674; Mon, 20 May 2019 17:14:40 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DFA128865B; Mon, 20 May 2019 17:14:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 986D51D9CC; Mon, 20 May 2019 17:14:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 68C20186F6; Mon, 20 May 2019 20:14:37 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me. To: Ian Lepore , freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin References: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> <174f71126ca39907370a8904c07546b712ad91b9.camel@freebsd.org> From: Lev Serebryakov Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABtCFMZXYgU2VyZWJy eWFrb3YgPGxldkBGcmVlQlNELm9yZz6JAlYEEwEIAEACGwMHCwkIBwMCAQYVCAIJCgsEFgID AQIeAQIXgBYhBPltHKC19DGLZ0szCuqwPFi/3EePBQJb/TeXBQkPBbfGAAoJEOqwPFi/3EeP LtEQANQLS89OCDSnLDZLyCj7sH5GZbTikJp9Or2McqEOpjgtfY/OgqCe7lfo8f71tTN3gL2t VGtNEtsl6CqKeBdm6fqsetCAed2+waJfbXLZWReLRSFQJ/cbof8MB3h/uEw8Zng1ZbyEU0eG rc41Mhk8bTfxjNRjkXDbp0+2xug+eRr2RYhiY2SxH+iy57AbRIu9gkjfL05VztfvsV5dPxt7 +reHf2Vhtu+qCRtCytGQqDvYWGpVZ8U5fHJxFdsJpn66LAe8w+iRGCbppB5TKeHkqWqDb++u sd5ZHzwep/7qcLBeKggi8+a2C3J1J4TpYBwdPgusrGtBPf2EYSTc/0mW5j86g1l8UDN9qXAI FvWbKf22p5SlYUzf5qRLny4ZdDl1mH13lmJV7ZkZGMKnt0IjJ2x0LRgLGhiSm/D4Lh8yc/MX uhj9BB020XbWcMUPpA7S7YaWeIXbnK3NrPU0yk77prFJblfskOwuaxJIwa2mX+cCAQA95As5 2talifo4Kh8OLSvS1gpbMo64LllTzuGbCWuKecH3fpMlZlD7/10z9lBvkSXA7KgadDfN0yHO xGCK8KE9gXXmEVRlbgGDYOJw9FLWHuSZHUvQTkmr4goXrmMIKa9A4BKO3s9vowP4pJ0vp3kz MIBeEwKSvAeZZfgKbIKggKUuQ5gsAqvF360sG3+UuQINBFKbGksBEAC0a9wfjo2P3JyT7Lc+ QlbFVshGbSbazb4ma7QYG5IZZD5vfLBFkePoG6cnrn3WCXp4A43hszAynCwe4eXyAkv4+gPF 3ZSeNE5Wz3zYG+jh2nm2iGCkyaVykfbA+2chor2DKH5tHpuNMBlF+wSJHZKJmlo/sFIktAnV 1NBVg4/cL+9/hIpvl82cl3hYCD7/e7/qRE+w38CpAAzn65FvbODn7xlY3fsJt+cHPBJ4EBM9 KnTwcce+F+72RQMZQEl7vIAwSRmLdgZHN0MFC533l62SVoKjT0eaOOIBrvesmojhWjfwugib Xr+WRF/tGcW77Bxwe2eQLbEVESqWeMORxRxocx7Q7aACoHmf4G4U1Vzx7zUEfNfHjfjZeQVf AURf/MoUelZSW/BmMIfKCg3lRlWAt+Pq2h2UADPVqAZze45beE/c8z8LZsOZiGoRhYL8NSg6 +ziLTdmYLWdtFGAuZhqOtNp5h6tGj21OksBotcaIa5YjbCmmnImIjGlSBkUKvIhq/RXth5b2 gNwaQdu+Yv4AlZVHRsuVywL/skDFL5+We11bDK6MQ5PzvmntRJcgbyoisn1hiV04OV1LpJJM kJn1j8VlBqDQNT/z+BjB0ru/0anv+5uLj7v0ck06rEo4yiXT/ZAcBM76j7V7FaGbkoba6bUU CQ2H5YYBOKpikjCnpwARAQABiQI8BBgBCAAmAhsMFiEE+W0coLX0MYtnSzMK6rA8WL/cR48F Alv9N7IFCQ8Ft+cACgkQ6rA8WL/cR49wpw//W7QrZHKYUWEVHtPLVMlcM1f7MgwnYlIRe/I6 gykwvt87sqxSYu7eHxfX6JZR2M9UYuUYscSR57gxXKu2Uzqaz2KjvEIXJCwCTsuXZjkQ19oL hAPsucw2AcMI6YqPXbZ7hO0Mh8jMeJzD6vDvx3zvunQxGQoZKxr3BvRUyO7NCYbA7N8ccI3E Tmdjj9JTbtue9WaUeGLszFDiITmkASBdsK07y4ylLAJzUGCvYLBU3gx0bBOB2S8SbxHYmQlj ewjovbp+MbT+CoXNxZp+gDRModGyIMdRIotkRiDbgNl0VWIT0SS1GUUlUHKzQ/ZPUvpvk6Gq s/SYBS7rBQNSoXXmJxNW6I6atVNW7JhInC1tkHxBlbpik4FK07J6NHFTx+9ygyCxbxwNA/Le FGkL3kU0VFXR2dNiAVbeueUPF6tU5Bye5ftgpLKOSAbo1g++EKUkc8335/4oYRBMcGEk4xUr NAvzoFPhA2W3KtklruJ9ThrFt9+//NB5ySlVgTwGWMuBJoskEmNOTBv34/UQPUIuE4xSwy6y H+nRQJooiMFo5QCosslJPlwyV63NS9lYXB6n3QWOCP6sFdWACNUCOFv4uk7LQdY9BsCmt2Tk cLuHmoS+fvUesQXnYV2aQi9HciriPIj2gvJ6WjgiaC/PpePil0fzyrfG/JMyHL0qcgmYoj0= Organization: FreeBSD Message-ID: Date: Mon, 20 May 2019 20:14:31 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <174f71126ca39907370a8904c07546b712ad91b9.camel@freebsd.org> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="tMa0gZRrxl7pCAF587GN3CtCFfW54v7kb" X-Rspamd-Queue-Id: DFA128865B X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 17:14:40 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --tMa0gZRrxl7pCAF587GN3CtCFfW54v7kb Content-Type: multipart/mixed; boundary="n1o4LvrciTjF6iW6sioyfJbmdqP5wRYyf"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: Ian Lepore , freebsd-fs@freebsd.org, freebsd-hackers@FreeBSD.org, Alexander Motin Message-ID: Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me. References: <55989579-a228-498e-2842-453cad6f315f@FreeBSD.org> <174f71126ca39907370a8904c07546b712ad91b9.camel@freebsd.org> In-Reply-To: <174f71126ca39907370a8904c07546b712ad91b9.camel@freebsd.org> --n1o4LvrciTjF6iW6sioyfJbmdqP5wRYyf Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 20.05.2019 19:10, Ian Lepore wrote: > The arc_adjust_needed variable is the gating condition associated with > a condition variable and lock. It is only read or changed while > holding a lock, and the acquiring and releasing of that lock provides > the needed memory barriers. In this case, the association with the > condition variable and lock is somewhat obscured by the way the zthread= > timer stuff works. The arc_adjust_cb_check() function is called from > line 193 of contrib/opensolaris/uts/common/fs/zfs/zthr.c, and that's > where you'll find the code that makes it clear this is an idiomatic > condition variable pattern. Oh, I see now. Right. Thank you for explanation. --=20 // Lev Serebryakov --n1o4LvrciTjF6iW6sioyfJbmdqP5wRYyf-- --tMa0gZRrxl7pCAF587GN3CtCFfW54v7kb Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlzi4HdfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R49AiA//UnGRvpmcwtG8U2Fxl4bv5CsaIKS1KPCtArSrAfIFQzJeDIeZA77NJ2a1 JCE6FdcgtdIYmPJNQ9AIgr5Nd/xArlnX52ATjRLeAYQYAVB+q3skkZ3p4DveXFEZ sNkz0D9KrpirdILa4crzv5AvIDYfKomHifWuYRb2aLUVZ7uSCeVLB1mRYlTxVQhx usyukK8gGqyWmLDOE0fIV3V1lZn9HL1QDndowsaJEk2LrtR6H5mT62cT9bJ0QDqD SNUS1aEpNVZboh4uscrZdUZMPv77kZsH41r4S7yvfVwqYkhQctJ/iBvwFa0UNUW5 h4mrwB6VlEcWxv0AQ1DjNEbYoGsLM7gJRJ2pTftO/i1wStjZt/W8X6SSzyvJaujr J4878PHwl0N+YKBcfe361u7V7oLBy6SAB4I6AMcDBZQyNePJXWxSuagL8pUKlqGp D9VlOeCzuSwRci43OnnWMNA+rvyNfRwFc5iQNv0ick2gqqrun0cErTrE8YVdtAbC NwZAl481F1mPTBtiqGnDbnbr90uO0VxQfo/S8H54KR6i+Ptx9NjfogpKmqfQKlis zpzLm9VSD0uyyGjoE2FgemKZXc2jLjuy+00NUVRoE9J6ItnSkvVLzMINQWjy4ubd ue+IQvnL3Iz3dlU1cblFL6aYqLNfEcKprT6UKIcQmMHOsnYj2mc= =ykE3 -----END PGP SIGNATURE----- --tMa0gZRrxl7pCAF587GN3CtCFfW54v7kb-- From owner-freebsd-hackers@freebsd.org Mon May 20 17:40:10 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A61815B3C33 for ; Mon, 20 May 2019 17:40:10 +0000 (UTC) (envelope-from papowell@astart.com) Received: from smtp-out3.electric.net (smtp-out3.electric.net [208.70.128.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 882D4890F5 for ; Mon, 20 May 2019 17:40:03 +0000 (UTC) (envelope-from papowell@astart.com) Received: from 1hSlzs-0002tB-UF by out3d.electric.net with emc1-ok (Exim 4.90_1) (envelope-from ) id 1hSlzu-0002xs-Un for freebsd-hackers@freebsd.org; Mon, 20 May 2019 10:22:50 -0700 Received: by emcmailer; Mon, 20 May 2019 10:22:50 -0700 Received: from [207.246.88.68] (helo=vultr.guest) by out3d.electric.net with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.90_1) (envelope-from ) id 1hSlzs-0002tB-UF for freebsd-hackers@freebsd.org; Mon, 20 May 2019 10:22:48 -0700 Received: from laptop112ku.private (localhost [IPv6:0:0:0:0:0:0:0:1]) by vultr.guest (8.15.2/8.15.2) with ESMTP id x4KHMkLd050148 for ; Mon, 20 May 2019 10:22:47 -0700 (PDT) (envelope-from papowell@astart.com) Reply-To: papowell@astart.com Subject: Re: FreeBSD flood of 8 breakage announcements in 3 mins. To: freebsd-hackers@freebsd.org References: <201905151715.x4FHF4eC068579@fire.js.berklix.net> <77e2f17fe5c1acf5a64cdebf0f28eb10d2802a5b.camel@bnc.net> <20190516130603.KFP-4%steffen@sdaoden.eu> <20190516133417.GH42338@aurora.gregv.net> <20190516150351.qevpo%steffen@sdaoden.eu> From: Patrick Powell Organization: Astart Technologies Message-ID: <35b802b1-168e-8c7f-bb53-a2742e8aa72a@astart.com> Date: Mon, 20 May 2019 10:22:46 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <20190516150351.qevpo%steffen@sdaoden.eu> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Outbound-IP: 207.246.88.68 X-Env-From: papowell@astart.com X-Proto: esmtps X-Revdns: X-HELO: vultr.guest X-TLS: TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256 X-Authenticated_ID: X-PolicySMART: 9383282 X-Virus-Status: Scanned by VirusSMART (b) X-Virus-Status: Scanned by VirusSMART (c) X-Rspamd-Queue-Id: 882D4890F5 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-3.84 / 15.00]; HAS_REPLYTO(0.00)[papowell@astart.com]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; HAS_ORG_HEADER(0.00)[]; MX_GOOD(-0.01)[astart.com.mx1-na.mailanyone.net,astart.com.mx3-na.mailanyone.net,astart.com.mx2-na.mailanyone.net]; NEURAL_HAM_SHORT(-0.97)[-0.969,0]; RCVD_IN_DNSWL_LOW(-0.10)[178.128.70.208.list.dnswl.org : 127.0.3.1]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16941, ipnet:208.70.128.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[astart.com]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; R_SPF_NA(0.00)[]; IP_SCORE(-1.66)[ipnet: 208.70.128.0/24(-4.53), asn: 16941(-3.72), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 May 2019 17:40:10 -0000 This appears to be a Good Idea.   I was about to suggest this as well. On 2019-05-16 08:03, Steffen Nurpmeso wrote: > Greg Veldman wrote in <20190516133417.GH42338@aurora.gregv.net>: > |On Thu, May 16, 2019 at 03:06:03PM +0200, Steffen Nurpmeso wrote: > |> Has anyone on this thread ever mentioned the possibility of some > |> short abstract be send first, as in "[notice][abstract][11.1] > |> 8 updates to be expected", or something. > | > |Yes. I did, yesterday[1]. :-) > | > |[1] https://lists.freebsd.org/pipermail/freebsd-hackers/2019-May/054595.\ > |html > > Indeed. Then i apologise. +.+ > > --steffen > | > |Der Kragenbaer, The moon bear, > |der holt sich munter he cheerfully and one by one > |einen nach dem anderen runter wa.ks himself off > |(By Robert Gernhardt) > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > -- Patrick Powell Astart Technologies papowell@astart.com 1509 Hollow Ct., Network and System San Diego, CA 92019 Consulting Cell 858-518-7581 FAX 858-751-2435 Web: papowell at astart dot com From owner-freebsd-hackers@freebsd.org Tue May 21 16:03:31 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 456CB15B14A5 for ; Tue, 21 May 2019 16:03:31 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id B56C06C4FA for ; Tue, 21 May 2019 16:03:30 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: by mailman.ysv.freebsd.org (Postfix) id 6ED7115B14A4; Tue, 21 May 2019 16:03:30 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33DA015B14A3 for ; Tue, 21 May 2019 16:03:30 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E5B3B6C4EF for ; Tue, 21 May 2019 16:03:21 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:Date:Message-Id:Subject:Mime-Version:Content-Transfer-Encoding:Content-Type:From; bh=ATy8BsCWGHuW0oy0h82F0lDwcAtrvXSr2UEiRjjIU/w=; b=bx8C/X22nhdmcfQBW/2DCPcIh4mj/hBQ+LVaHqpI1jWMkJQvRK3gxX63JARqEWroC/c1+DtjkP3hSDYg8dTJxWQUvl9ouQSlmqq9dMvyYETDsQ9FU2vWHoPJ3b7U6SoQamS2JZAW7X5LwW9w6LxlNwilWL0yHW/mOBHUjgc6UWOvsYr0QlJRH4zD/2JdEaQ6wjMKfWOLRdL2kAfiRpOmGax3t0bjwmRtTZ6NHiNyUSPsUio/HNp9seobKuuj0K8LTE9MkbCFJNlOZmqjryBN4pLHinIiid+0Dbv1s9BLS3QYFESsdiDmT7yUG5u2uCWGEt46wzj422Nr18lKT5pXUQ==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hT7EH-000K5F-R5 for hackers@freebsd.org; Tue, 21 May 2019 19:03:05 +0300 From: Daniel Braniss Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.8\)) Subject: ERR#78 'function not implemented' Message-Id: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> Date: Tue, 21 May 2019 19:03:05 +0300 To: hackers@freebsd.org X-Mailer: Apple Mail (2.3445.104.8) X-Rspamd-Queue-Id: E5B3B6C4EF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.huji.ac.il header.s=57791128 header.b=bx8C/X22 X-Spamd-Result: default: False [-2.08 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; R_DKIM_ALLOW(-0.20)[cs.huji.ac.il:s=57791128]; NEURAL_HAM_MEDIUM(-0.99)[-0.987,0]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[huji.ac.il]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-0.48)[ipnet: 132.64.0.0/13(-1.37), asn: 378(-1.10), country: IL(0.05)]; DKIM_TRACE(0.00)[cs.huji.ac.il:+]; MX_GOOD(-0.01)[kabab.cs.huji.ac.il,post.cs.huji.ac.il]; RCVD_IN_DNSWL_NONE(0.00)[210.116.65.132.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.30)[-0.296,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:378, ipnet:132.64.0.0/13, country:IL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2019 16:03:31 -0000 Hi, Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I have = been doing it for some time without any issues, but today I decided to try out release.sh and it = failes. I have run the =E2=80=98bad=E2=80=99 command: truss chroot /h/arm/scratch mount /dev/md0s2a = /usr/obj/usr/src/arm.armv7/release/GENERIC mmap(0x0,32768,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34366169088 (0x800622000) issetugid() =3D 0 (0x0) lstat("/etc",{ mode=3Ddrwxr-xr-x ,inode=3D81791,size=3D2560,blksize=3D3276= 8 }) =3D 0 (0x0) lstat("/etc/libmap.conf",{ mode=3D-rw-r--r-- = ,inode=3D89393,size=3D47,blksize=3D32768 }) =3D 0 (0x0) openat(AT_FDCWD,"/etc/libmap.conf",O_RDONLY|O_CLOEXEC,00) =3D 3 (0x3) fstat(3,{ mode=3D-rw-r--r-- ,inode=3D89393,size=3D47,blksize=3D32768 }) = =3D 0 (0x0) mmap(0x0,47,PROT_READ,MAP_PRIVATE,3,0x0) =3D 34366201856 = (0x80062a000) close(3) =3D 0 (0x0) lstat("/usr",{ mode=3Ddrwxr-xr-x ,inode=3D240768,size=3D512,blksize=3D3276= 8 }) =3D 0 (0x0) lstat("/usr/local",{ mode=3Ddrwxr-xr-x ,inode=3D4,size=3D32,blksize=3D4096= }) =3D 0 (0x0) lstat("/usr/local/etc",{ mode=3Ddrwxr-xr-x = ,inode=3D16,size=3D106,blksize=3D7168 }) =3D 0 (0x0) lstat("/usr/local/etc/libmap.d",{ mode=3Ddrwxr-xr-x = ,inode=3D221917,size=3D4,blksize=3D4096 }) =3D 0 (0x0) = open("/usr/local/etc/libmap.d",O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC,0= 165) =3D 3 (0x3) __sysctl(0x7fffffffcc78,0x2,0x8008238b4,0x7fffffffcc70,0x0,0x0) =3D 0 = (0x0) fstatfs(3,{ = fstypename=3Dzfs,mntonname=3D/usr/local,mntfromname=3Dh/local,fsid=3De7e0a= 6ccde16856e }) =3D 0 (0x0) getdirentries(3,"\M-]b\^C\0\f\0\^D\^A.\0\0\0\^P\0"...,4096,{ 0x0 }) =3D = 64 (0x40) mmap(0x0,36864,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34366205952 (0x80062b000) lstat("/usr",{ mode=3Ddrwxr-xr-x ,inode=3D240768,size=3D512,blksize=3D3276= 8 }) =3D 0 (0x0) lstat("/usr/local",{ mode=3Ddrwxr-xr-x ,inode=3D4,size=3D32,blksize=3D4096= }) =3D 0 (0x0) lstat("/usr/local/etc",{ mode=3Ddrwxr-xr-x = ,inode=3D16,size=3D106,blksize=3D7168 }) =3D 0 (0x0) lstat("/usr/local/etc/libmap.d",{ mode=3Ddrwxr-xr-x = ,inode=3D221917,size=3D4,blksize=3D4096 }) =3D 0 (0x0) lstat("/usr/local/etc/libmap.d/nvidia.conf",{ mode=3D-rw-r--r-- = ,inode=3D325894,size=3D234,blksize=3D4096 }) =3D 0 (0x0) = openat(AT_FDCWD,"/usr/local/etc/libmap.d/nvidia.conf",O_RDONLY|O_CLOEXEC,0= 0) =3D 4 (0x4) fstat(4,{ mode=3D-rw-r--r-- ,inode=3D325894,size=3D234,blksize=3D4096 }) = =3D 0 (0x0) mmap(0x0,234,PROT_READ,MAP_PRIVATE,4,0x0) =3D 34366242816 = (0x800634000) close(4) =3D 0 (0x0) munmap(0x800634000,234) =3D 0 (0x0) getdirentries(3,0x800628000,4096,{ 0x1adfcbb0 }) =3D 0 (0x0) close(3) =3D 0 (0x0) munmap(0x80062a000,47) =3D 0 (0x0) openat(AT_FDCWD,"/var/run/ld-elf.so.hints",O_RDONLY|O_CLOEXEC,00) =3D 3 = (0x3) read(3,"Ehnt\^A\0\0\0\M^@\0\0\0\M-G\^A\0"...,128) =3D 128 (0x80) fstat(3,{ mode=3D-r--r--r-- ,inode=3D230490,size=3D583,blksize=3D4096 }) = =3D 0 (0x0) lseek(3,0x80,SEEK_SET) =3D 128 (0x80) read(3,"/lib:/usr/lib:/usr/lib/compat:/u"...,455) =3D 455 (0x1c7) close(3) =3D 0 (0x0) access("/lib/libc.so.7",F_OK) =3D 0 (0x0) openat(AT_FDCWD,"/lib/libc.so.7",O_RDONLY|O_CLOEXEC|O_VERIFY,00) =3D 3 = (0x3) fstat(3,{ mode=3D-r--r--r-- ,inode=3D12898,size=3D1716608,blksize=3D32768 = }) =3D 0 (0x0) mmap(0x0,4096,PROT_READ,MAP_PRIVATE|MAP_PREFAULT_READ,3,0x0) =3D = 34366201856 (0x80062a000) mmap(0x0,3915776,PROT_NONE,MAP_GUARD,-1,0x0) =3D 34368274432 = (0x800824000) = mmap(0x800824000,1667072,PROT_READ|PROT_EXEC,MAP_PRIVATE|MAP_FIXED|MAP_NOC= ORE|MAP_PREFAULT_READ,3,0x0) =3D 34368274432 (0x800824000) = mmap(0x800bba000,53248,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_PREF= AULT_READ,3,0x196000) =3D 34372034560 (0x800bba000) = mmap(0x800bc7000,102400,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_ANO= N,-1,0x0) =3D 34372087808 (0x800bc7000) munmap(0x80062a000,4096) =3D 0 (0x0) close(3) =3D 0 (0x0) munmap(0x80062f000,20480) =3D 0 (0x0) mmap(0x0,102400,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34366222336 (0x80062f000) sysarch(AMD64_SET_FSBASE,0x7fffffffdbe0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) readlink("/etc/malloc.conf",0x7fffffffd2e0,1024) ERR#2 'No such file or = directory' issetugid() =3D 0 (0x0) = __sysctl(0x7fffffffd180,0x2,0x7fffffffd1d0,0x7fffffffd1c8,0x800989d33,0xd)= =3D 0 (0x0) __sysctl(0x7fffffffd1d0,0x2,0x7fffffffd294,0x7fffffffd288,0x0,0x0) =3D 0 = (0x0) mmap(0x0,2097152,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34372190208 (0x800be0000) munmap(0x800be0000,2097152) =3D 0 (0x0) mmap(0x0,4190208,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34372190208 (0x800be0000) munmap(0x800be0000,131072) =3D 0 (0x0) munmap(0x800e00000,1961984) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) __sysctl(0x7fffffffe5d8,0x2,0x7fffffffe5c4,0x7fffffffe5c8,0x0,0x0) =3D 0 = (0x0) mmap(0x0,2097152,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34374418432 (0x800e00000) chdir("/h/arm/scratch") =3D 0 (0x0) chroot(".") =3D 0 (0x0) execve("/sbin/mount",0x7fffffffe6f0,0x7fffffffe710) =3D 0 (0x0) mmap(0x0,131072,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) =3D = 34362019840 (0x80022d000) issetugid() =3D 0 (0x0) openat(AT_FDCWD,"/etc/libmap.conf",O_RDONLY|O_CLOEXEC,00) =3D 3 (0x3) fstat(3,{ mode=3D-rw-r--r-- ,inode=3D647891,size=3D115,blksize=3D4096 }) = =3D 0 (0x0) read(3,"# $FreeBSD: head/libexec/rtld-el"...,115) =3D 115 (0x73) close(3) =3D 0 (0x0) = open("/usr/local/etc/libmap.d",O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC,0= 165) ERR#2 'No such file or directory' openat(AT_FDCWD,"/var/run/ld-elf.so.hints",O_RDONLY|O_CLOEXEC,00) =3D 3 = (0x3) read(3,"Ehnt\^A\0\0\0\M^@\0\0\0Q\0\0\0\0"...,128) =3D 128 (0x80) fstat(3,{ mode=3D-r--r--r-- ,inode=3D846920,size=3D209,blksize=3D4096 }) = =3D 0 (0x0) pread(3,"/lib:/usr/lib:/usr/lib/compat:/u"...,81,0x80) =3D 81 (0x51) close(3) =3D 0 (0x0) openat(AT_FDCWD,"/lib/libutil.so.9",O_RDONLY|O_CLOEXEC|O_VERIFY,00) =3D = 3 (0x3) fstat(3,{ mode=3D-r--r--r-- ,inode=3D830350,size=3D87912,blksize=3D88064 = }) =3D 0 (0x0) mmap(0x0,4096,PROT_READ,MAP_PRIVATE|MAP_PREFAULT_READ,3,0x0) =3D = 34362150912 (0x80024d000) mmap(0x0,94208,PROT_NONE,MAP_PRIVATE|MAP_ANON|MAP_NOCORE,-1,0x0) =3D = 34362155008 (0x80024e000) = mmap(0x80024e000,32768,PROT_READ,MAP_PRIVATE|MAP_FIXED|MAP_NOCORE|MAP_PREF= AULT_READ,3,0x0) =3D 34362155008 (0x80024e000) = mmap(0x800256000,45056,PROT_READ|PROT_EXEC,MAP_PRIVATE|MAP_FIXED|MAP_NOCOR= E|MAP_PREFAULT_READ,3,0x8000) =3D 34362187776 (0x800256000) = mmap(0x800261000,8192,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_PREFA= ULT_READ,3,0x13000) =3D 34362232832 (0x800261000) = mmap(0x800263000,8192,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_ANON,= -1,0x0) =3D 34362241024 (0x800263000) munmap(0x80024d000,4096) =3D 0 (0x0) close(3) =3D 0 (0x0) openat(AT_FDCWD,"/lib/libc.so.7",O_RDONLY|O_CLOEXEC|O_VERIFY,00) =3D 3 = (0x3) fstat(3,{ mode=3D-r--r--r-- ,inode=3D826905,size=3D2063608,blksize=3D13107= 2 }) =3D 0 (0x0) mmap(0x0,4096,PROT_READ,MAP_PRIVATE|MAP_PREFAULT_READ,3,0x0) =3D = 34362150912 (0x80024d000) mmap(0x0,4276224,PROT_NONE,MAP_PRIVATE|MAP_ANON|MAP_NOCORE,-1,0x0) =3D = 34362249216 (0x800265000) = mmap(0x800265000,540672,PROT_READ,MAP_PRIVATE|MAP_FIXED|MAP_NOCORE|MAP_PRE= FAULT_READ,3,0x0) =3D 34362249216 (0x800265000) = mmap(0x8002e9000,1400832,PROT_READ|PROT_EXEC,MAP_PRIVATE|MAP_FIXED|MAP_NOC= ORE|MAP_PREFAULT_READ,3,0x84000) =3D 34362789888 (0x8002e9000) = mmap(0x80043f000,61440,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_PREF= AULT_READ,3,0x1da000) =3D 34364190720 (0x80043f000) = mmap(0x80044e000,2273280,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_FIXED|MAP_AN= ON,-1,0x0) =3D 34364252160 (0x80044e000) munmap(0x80024d000,4096) =3D 0 (0x0) close(3) =3D 0 (0x0) mprotect(0x800262000,4096,PROT_READ) =3D 0 (0x0) mprotect(0x800445000,36864,PROT_READ) =3D 0 (0x0) sysarch(AMD64_SET_FSBASE,0x7fffffffdbf0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) mprotect(0x800445000,36864,PROT_READ|PROT_WRITE) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) mprotect(0x800445000,36864,PROT_READ) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) readlink("/etc/malloc.conf",0x7fffffffd300,1024) ERR#2 'No such file or = directory' issetugid() =3D 0 (0x0) __sysctl(0x7fffffffd2a0,0x2,0x7fffffffd29c,0x7fffffffd290,0x0,0x0) =3D 0 = (0x0) = mmap(0x0,2097152,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(21)= ,-1,0x0) =3D 34368126976 (0x800800000) = mmap(0x0,32768,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 34366525440 (0x800679000) = mmap(0x0,4194304,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(21)= ,-1,0x0) =3D 34370224128 (0x800a00000) = mmap(0x0,4096,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-1= ,0x0) =3D 34362150912 (0x80024d000) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) sigprocmask(SIG_BLOCK,{ = SIGHUP|SIGINT|SIGQUIT|SIGKILL|SIGPIPE|SIGALRM|SIGTERM|SIGURG|SIGSTOP|SIGTS= TP|SIGCONT|SIGCHLD|SIGTTIN|SIGTTOU|SIGIO|SIGXCPU|SIGXFSZ|SIGVTALRM|SIGPROF= |SIGWINCH|SIGINFO|SIGUSR1|SIGUSR2 },{ }) =3D 0 (0x0) mprotect(0x208000,4096,PROT_READ) =3D 0 (0x0) sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 (0x0) lstat("/usr",{ mode=3Ddrwxr-xr-x ,inode=3D22,size=3D16,blksize=3D131072 = }) =3D 0 (0x0) lstat("/usr/obj",{ mode=3Ddrwxr-xr-x ,inode=3D623059,size=3D3,blksize=3D13= 1072 }) =3D 0 (0x0) lstat("/usr/obj/usr",{ mode=3Ddrwxrwxr-x = ,inode=3D648033,size=3D3,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src",{ mode=3Ddrwxrwxr-x = ,inode=3D648034,size=3D4,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7",{ mode=3Ddrwxrwxr-x = ,inode=3D796286,size=3D24,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7/release",{ mode=3Ddrwxrwxr-x = ,inode=3D1001804,size=3D14,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7/release/GENERIC",{ mode=3Ddrwxr-xr-x = ,inode=3D949489,size=3D2,blksize=3D131072 }) =3D 0 (0x0) stat("/usr/obj/usr/src/arm.armv7/release/GENERIC",{ mode=3Ddrwxr-xr-x = ,inode=3D949489,size=3D2,blksize=3D131072 }) =3D 0 (0x0) = mmap(0x0,4096,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-1= ,0x0) =3D 34366558208 (0x800681000) = mmap(0x0,4096,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-1= ,0x0) =3D 34366562304 (0x800682000) = mmap(0x0,12288,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 34366566400 (0x800683000) lstat("/usr",{ mode=3Ddrwxr-xr-x ,inode=3D22,size=3D16,blksize=3D131072 = }) =3D 0 (0x0) lstat("/usr/obj",{ mode=3Ddrwxr-xr-x ,inode=3D623059,size=3D3,blksize=3D13= 1072 }) =3D 0 (0x0) lstat("/usr/obj/usr",{ mode=3Ddrwxrwxr-x = ,inode=3D648033,size=3D3,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src",{ mode=3Ddrwxrwxr-x = ,inode=3D648034,size=3D4,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7",{ mode=3Ddrwxrwxr-x = ,inode=3D796286,size=3D24,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7/release",{ mode=3Ddrwxrwxr-x = ,inode=3D1001804,size=3D14,blksize=3D131072 }) =3D 0 (0x0) lstat("/usr/obj/usr/src/arm.armv7/release/GENERIC",{ mode=3Ddrwxr-xr-x = ,inode=3D949489,size=3D2,blksize=3D131072 }) =3D 0 (0x0) stat("/usr/obj/usr/src/arm.armv7/release/GENERIC",{ mode=3Ddrwxr-xr-x = ,inode=3D949489,size=3D2,blksize=3D131072 }) =3D 0 (0x0) = mmap(0x0,4096,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-1= ,0x0) =3D 34366578688 (0x800686000) = mmap(0x0,12288,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 34366582784 (0x800687000) = mmap(0x0,4096,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-1= ,0x0) =3D 34366595072 (0x80068a000) nmount(0x80068a000,8,0x0) =3D 0 (0x0) getuid() =3D 0 (0x0) = mmap(0x0,20480,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 34366599168 (0x80068b000) = mmap(0x0,20480,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 34366619648 (0x800690000) openat(AT_FDCWD,"/var/run",O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC,00) = =3D 3 (0x3) openat(3,"mountd.pid",O_WRONLY|O_NONBLOCK|O_CREAT|O_CLOEXEC,0600) =3D 4 = (0x4) flock(4,LOCK_EX|LOCK_NB) =3D 0 (0x0) fstatat(3,"mountd.pid",{ mode=3D-rw------- = ,inode=3D949491,size=3D0,blksize=3D131072 },0x0) =3D 0 (0x0) fstat(4,{ mode=3D-rw------- ,inode=3D949491,size=3D0,blksize=3D131072 }) = =3D 0 (0x0) ftruncate(4,0x0) =3D 0 (0x0) fstat(4,{ mode=3D-rw------- ,inode=3D949491,size=3D0,blksize=3D131072 }) = =3D 0 (0x0) cap_rights_limit(3,{ CAP_LOOKUP }) =3D 0 (0x0) cap_rights_limit(4,{ CAP_WRITE,CAP_SEEK_TELL,CAP_FTRUNCATE,CAP_FSTAT }) = =3D 0 (0x0) fstat(4,{ mode=3D-rw------- ,inode=3D949491,size=3D0,blksize=3D131072 }) = =3D 0 (0x0) -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- #568() ERR#78 'Function not = implemented' SIGNAL 12 (SIGSYS) code=3DSI_KERNEL process killed, signal =3D 12 (core dumped)= From owner-freebsd-hackers@freebsd.org Tue May 21 22:36:37 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5812159224E; Tue, 21 May 2019 22:36:37 +0000 (UTC) (envelope-from bsdunix99@gmail.com) Received: from mail-it1-x144.google.com (mail-it1-x144.google.com [IPv6:2607:f8b0:4864:20::144]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0DC9884E04; Tue, 21 May 2019 22:36:36 +0000 (UTC) (envelope-from bsdunix99@gmail.com) Received: by mail-it1-x144.google.com with SMTP id m141so381889ita.3; Tue, 21 May 2019 15:36:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=hpkDpcd/iYdEk/Rd0xCuueP3tBUFZoJRnSx4k7sZrHA=; b=M+Te7c0hVm7Ly+e8BSP5AGxGS3jUXiwQeY5lgAUqpNi8MOWF/Wny5PU54CsyTV87f1 38hgonrxC66B9h0ChVxi3P/HKls4nrLJB5kA5GblXyKNdn+/G19DwRBV60ECMUsC5IGA vfqIPzw3CwU1vtt2Ow0r10vBaV0ytKuQNTW5r4XhZdhg1PLDWAw4yw8AQAh0bVVpYknP H7eWTXLbRU+UySOVdgd52YNbwynB1Al2fUprcnSf+mZUnqRFJlyfh7/IX/0BL6vBH9QM 8lUjo4emCieHY7diMaBjy77iDdby76yGyC0Xxt/BfMG6i7ZgDjmwgr0KJcPzNQAJGjgL 03bw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=hpkDpcd/iYdEk/Rd0xCuueP3tBUFZoJRnSx4k7sZrHA=; b=fZdCqq5A70sV3khXoBeI77g5djHvPwsFz2TdCPFlrWYD4+o3Y2j2aXE5C89AkaBb5s MPWpv+tLjrW5gSiVPujOGN4hzUcbG9KIa6VMXeuDuyBWUZhhSgcbTe2oeorttB3gKF6e vGMeEPO7e317Ft1bIXr44vfN3+U8vh/bQoX5yuDSKpTxTsVHBqANQgmv2a4S+vqDoHe4 ySPjI63Jf05AiR3uWfyT4NToqDMZVdinWrMf2Ex5yN2awOpgCx1Q31pMiuy0WTnlshg/ iWfE66zFoomvLIo4/OxDy2bbSChnVqEloK9E29ob7LxMtMN1L8pFOE+7y4xIx+uH4WwU JjQQ== X-Gm-Message-State: APjAAAW5f08rzlsUvfjXxDqn3WXAJpHZfsVdKyhCJkZwxx5Nct5NcxCz 2ihfrxhc3OE3VnqjfrGDFxVoKj6JrxeAXATazsJxg7ecgsrUGA== X-Google-Smtp-Source: APXvYqwX4XKu6KTVmz2Toin3/cdDWZKs8kmhU3Td9dGMlzW96h3m3aZYEN+2ZnFCN61GWNpxdiPTav6FZNBnoXRYiIo= X-Received: by 2002:a24:f9c3:: with SMTP id l186mr6243640ith.176.1558478195246; Tue, 21 May 2019 15:36:35 -0700 (PDT) MIME-Version: 1.0 From: Alexandru Goia Date: Wed, 22 May 2019 01:36:24 +0300 Message-ID: Subject: newbie question To: freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org X-Rspamd-Queue-Id: 0DC9884E04 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=M+Te7c0h; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of bsdunix99@gmail.com designates 2607:f8b0:4864:20::144 as permitted sender) smtp.mailfrom=bsdunix99@gmail.com X-Spamd-Result: default: False [-4.50 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.70)[-0.700,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE(-0.79)[ip: (1.66), ipnet: 2607:f8b0::/32(-3.27), asn: 15169(-2.27), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[4.4.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2019 22:36:38 -0000 greetings. how can do i get attuned in a logical manner with the *bsd/freebsd kernel source code ? thank you very much ! From owner-freebsd-hackers@freebsd.org Tue May 21 23:40:16 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA24F1593A41; Tue, 21 May 2019 23:40:16 +0000 (UTC) (envelope-from grog@lemis.com) Received: from www.lemis.com (www.lemis.com [208.86.226.86]) by mx1.freebsd.org (Postfix) with ESMTP id 3029F86D42; Tue, 21 May 2019 23:40:14 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (lemis.com [192.109.197.81]) by www.lemis.com (Postfix) with ESMTP id F10741B72837; Tue, 21 May 2019 23:40:07 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id AFB15264D3F; Wed, 22 May 2019 09:40:06 +1000 (AEST) Date: Wed, 22 May 2019 09:40:06 +1000 From: Greg 'groggy' Lehey To: Alexandru Goia Cc: freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org Subject: Re: newbie question Message-ID: <20190521234006.GS16860@eureka.lemis.com> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AXo2lOxbfudqq8ta" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 3029F86D42 X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 208.86.226.86 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-8.70 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; TO_DN_SOME(0.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mx1.lemis.com]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:36236, ipnet:208.86.226.0/24, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; IP_SCORE(-3.71)[ip: (-9.72), ipnet: 208.86.226.0/24(-4.86), asn: 36236(-3.89), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2019 23:40:17 -0000 --AXo2lOxbfudqq8ta Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: > greetings. how can do i get attuned in a logical manner with the > *bsd/freebsd kernel source code ? thank you very much ! Clearly you know how to get it (otherwise https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your friend). To understand it better, I'd suggest reading "The Design and Implementation of the FreeBSD Operating System" by Kirk McKusick and George Neville-Neil (Addison-Wesley). Understanding the code requires some work. People will happily answer detail questions, but you'll be responsible for finding out the overall structure yourself. Greg -- When replying to this message, please copy the original recipients. If you don't, I may ignore the reply or reply to the original recipients. For more information, see http://www.lemis.com/questions.html Sent from my desktop computer. Finger grog@lemis.com for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --AXo2lOxbfudqq8ta Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAlzkjFYACgkQIubykFB6QiOKcgCaAp3P4zhWxqP2OkIUThD78olt bL4An28mc43K/ZWLzPi6YbkkaHVX6LNs =hUDR -----END PGP SIGNATURE----- --AXo2lOxbfudqq8ta-- From owner-freebsd-hackers@freebsd.org Tue May 21 23:41:22 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BCE701593CA7 for ; Tue, 21 May 2019 23:41:22 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 83C5A86FDA for ; Tue, 21 May 2019 23:41:21 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: by mail-io1-xd2a.google.com with SMTP id z4so393258iol.0 for ; Tue, 21 May 2019 16:41:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ratnaling-org.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=q37XdzXJuQjSjZKVQnRVOp6LHjCKDCw8bZTHKKneePc=; b=gWmGVbDnPamIvJTYFbioYXu49NaZkiMHCM7yrTuRw9D4gHhzgmmEKkHv2ODGaZOJnO VWfteWqKBmL3UR6EhiH6At4lmsaR5es0zLvG8GsYAMihMMi365phdbBFN4XipJcgAGQ/ vBH1+m+C7jRdUEh8cUnNsc8h7yXX/JHJe95l3Z92Ir51Ub6Gx9EtZ/iD8mxILJffcOtG ArGBigHro6CLMktPY9j9ivTitqSkTKhx393jt04KHAwux4/BwY4rBozk5j5BmGEaUGt5 iuOLSt7gUhQVqGbKJ4+PMx7bbKMXNdmles2taAR8BzQDDyuMUb4VE08VblIJw2SyoPrV MYYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=q37XdzXJuQjSjZKVQnRVOp6LHjCKDCw8bZTHKKneePc=; b=unN+Qja66N+XDJcy5v/OGG9MDx2onD4/WbHCXT9ZIZ9hmRuteUbNPJF5xK5jVbRfBH jATmOrPGaQSqRxPErRL62Z0aRkQlvYtUmQGh4RzHwo40NhsB5i55vBOOg9DVtIpyPclx GQG1FXBWYXAGJ57OJisywXmqwno5B4TO5gHQWzFyMc9EotQ9Ha/s2+oHu7HaLQ6EI8ku hUhwv3FQHc6sI3opQiaz4z+xUMkInqBkgZ4SDh+CIhpxnDDT5TVYgmp4CgiHbMt81BOP rIBy/RW/IbRheGaQSP0TcJs/S8lmetggEQWDNf8ndE9/KLW6ccPSEWek5nYvPWDRS79o h9MQ== X-Gm-Message-State: APjAAAXsJGqa0LFcX/a4/3WrvcSNyxxQgfkzWp0H+m7nngmyXOIiWqC+ gbEwI+p3/Qno1j1pgJrPU4hnde901hyk93IMVFSjf40m8ds= X-Google-Smtp-Source: APXvYqwv33XUt0Y6PNl36U4FiDIFTcOhxJt/5Z7rN9+g6PDVs3WMVaX6mQvXgKOzE/iXWSvA34mx5vB8WGqNUnpS2EQ= X-Received: by 2002:a6b:ca47:: with SMTP id a68mr13131714iog.227.1558482080440; Tue, 21 May 2019 16:41:20 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Lee Brown Date: Tue, 21 May 2019 16:41:08 -0700 Message-ID: Subject: Re: newbie question To: Alexandru Goia Cc: FreeBSD Hackers , freebsd-questions@freebsd.org X-Rspamd-Queue-Id: 83C5A86FDA X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ratnaling-org.20150623.gappssmtp.com header.s=20150623 header.b=gWmGVbDn; spf=pass (mx1.freebsd.org: domain of leeb@ratnaling.org designates 2607:f8b0:4864:20::d2a as permitted sender) smtp.mailfrom=leeb@ratnaling.org X-Spamd-Result: default: False [-6.46 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[ratnaling-org.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[ratnaling.org]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ratnaling-org.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[ALT3.ASPMX.L.GOOGLE.COM,ASPMX.L.GOOGLE.COM,ALT2.ASPMX.L.GOOGLE.COM,ALT1.ASPMX.L.GOOGLE.COM,ALT4.ASPMX.L.GOOGLE.COM]; RCVD_IN_DNSWL_NONE(0.00)[a.2.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.93)[-0.934,0]; IP_SCORE(-3.01)[ip: (-9.46), ipnet: 2607:f8b0::/32(-3.27), asn: 15169(-2.27), country: US(-0.06)]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2019 23:41:23 -0000 I would suggest you read the latest edition of "The Design and Implementation of the FreeBSD Operating System". I highly recommend it. On Tue, May 21, 2019 at 3:36 PM Alexandru Goia wrote: > greetings. how can do i get attuned in a logical manner with the > *bsd/freebsd kernel source code ? thank you very much ! > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@freebsd.org Wed May 22 00:37:18 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 124D61595A23 for ; Wed, 22 May 2019 00:37:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B87088936F for ; Wed, 22 May 2019 00:37:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 2PtxUicVM1lkNACrGOZ.X6hfXJ1GtVzaU4iwsvCnHwyW8B0enfIalhxLvBi10OC Gg3trixgsQCFCczT2fYvkWXWbtxPD2qztVpn.vcLED816SIG_YC0ClyQ57kYLcuZEPC23qXwe6eu k6yI.xOqQAugvlasq0xS9zS8R95vphFYRyFbUTGMoDXCxAZ5R1u.brrJvi9xbFZ9lj8Az0.qn3Wm tIZP.8UFIUu65pmu6hdRmAxGtEGwYXMZUVlHKJKfzd5ad5CPtvVBtQScYocqdtT9Cs9ARZiihzbu X.yvMA8n3yf8z67m2QqudSCP_zwDhDdTvzalRBdNs.AmWBg2CUaQb7VkYWtO89W0Q5TrWorMoWmF gwmEXVkGgRLU7x8xGcNvsNzYmnopmZtqELmM.F9XtSADsDO3H8BycnhEjUs7aKpaP3PVzMsF8MWh E9oq7RNXecHM2lSlfOsx0HDW6mE1cAczMxkNAW.0D3.l_U_zMGyV99SF0j8UUrjJfQPyuwh.2OcM DWYgb8noYsmId6Q64cFLDHkQ.zb3jHmmEIhxCmMo4S7kSIsIAbniwgVK4S4Im8qaeJ_BaT3yacUx ts.8uktArxmwh4p6m7G2hHDZCK2FVibmHFTcv2YBkR3Ajq10SecdqDLoY9d6uJ61_nOdiYU.PwIn faJI4JIoF1VcQb7igbHfwN4mFnlxLpNzhuyWFhe8y6T_zmAvzGB1kBMa1jaEgdYkUn2tIScabrKp cGdXPTx3GuIyAKqru9ppv5Yc5pn7O18tnTGRQmhaXPesWi6ezN5kiHEwQQQljdTx_.lUjHL6kIW1 tIzrWe9xdr8LADovrDFHF1100Mgn9ed5XuPcSlxM6o3F7iSalWfbHuniXvoekb3GRUO_6uZu7HQD n.OjLys3AYtYcB5DsfaN9BDuzKLkVyepKWHTmAhIoTeAC8zA9U7aFJzqgqZ76lwYTjZogLZviZRG 1neM4jxY0IjbALaCUAeUN70zVJyrRUGXBgj9J239JxOyHKmRcr7vZCRup5eQhf9SWud.SUVWEMqD CCilCu0rweYXvwNBpwhy3KWsJJbPq8jntmqLweZ_.a5W.RrYJSJt0dVdTBgnlhp8TnZiRFDRxTrP 7EPoxm1SMdNrSZWun8_fptN2WdFuUxnQh_jmWzLvODTXnT8mY4WuW06TIKoJS0Y8ufshKCmNljsX nFHv4DgBeFg84Gb4qe9z0_o9MbB4wmIiiZDo84PigLGusnnNReGhWIWISZWc- Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Wed, 22 May 2019 00:37:06 +0000 Received: from c-76-115-7-162.hsd1.or.comcast.net (EHLO [192.168.1.103]) ([76.115.7.162]) by smtp425.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 4c3347dcd29deb12d32ea406e41bc0cc; Wed, 22 May 2019 00:37:04 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: total configured swap exceeds maximum From: Mark Millard In-Reply-To: <20190519174030.0206eb41@gumby.homeunix.com> Date: Tue, 21 May 2019 17:37:03 -0700 Cc: FreeBSD Hackers , Wojciech Puchar Content-Transfer-Encoding: quoted-printable Message-Id: <47795095-3575-4648-93F0-9C9CAFAB1D47@yahoo.com> References: <20190519160033.0b0e47fa@gumby.homeunix.com> <18598E43-CFB1-4C3C-BC46-A4F0DEB569CF@yahoo.com> <20190519174030.0206eb41@gumby.homeunix.com> To: RW X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: B87088936F X-Spamd-Bar: ++ X-Spamd-Result: default: False [2.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FREEMAIL_TO(0.00)[googlemail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-0.28)[-0.285,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.81)[0.809,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.77)[ip: (7.10), ipnet: 98.137.64.0/21(1.00), asn: 36647(0.80), country: US(-0.06)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.42)[0.419,0]; RCVD_IN_DNSWL_NONE(0.00)[146.64.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 00:37:18 -0000 On 2019-May-19, at 09:40, RW via freebsd-hackers wrote: > On Sun, 19 May 2019 08:53:15 -0700 > Mark Millard wrote: >=20 >> On 2019-May-19, at 08:33, Wojciech Puchar wrote: >>=20 >>>>> what should i set kern.maxswzone to ? it is 0 >>>>>=20 >>>>> # sysctl kern.maxswzone >>>>> kern.maxswzone: 0 =20 >>>>=20 >>>> IIRC for amd64 kern.maxswzone=3D0 represents the maximum allowed. =20= >>> so i cannot have more VM than 5*RAM? =20 >>=20 >> There is is a kernel memory tradeoff structure to increase in >> kern.maxswzone being larger as I understand. Quoting "man 8 loader" >> (but the "eight times" is system/architecture specific and will >> likely be different): >>=20 >> kern.maxswzone >> Limits the amount of KVM to be used to hold swap >> metadata, which directly governs the maximum amount of swap the >> system can support, at the rate of approximately 200 >> MB of swap space per 1 MB of metadata. This value is specified >> in bytes of KVA space. If no value is provided, the >> system allocates enough memory to handle an amount of swap that >> corresponds to eight times the amount of physical >> memory present in the system. >=20 > In swap_pager.c >=20 > /* > * Initialize our zone, guessing on the number we need based > * on the number of pages in the system. > */ > n =3D vm_cnt.v_page_count / 2; > if (maxswzone && n > maxswzone / sizeof(struct swblk)) > n =3D maxswzone / sizeof(struct swblk); >=20 > In i386 maxswzone defaults to a specific value and it is possible to > increase the size. In amd64 maxswzone defaults to 0 which give the > highest value of n permitted. The code that you quoted is old in head/ and stable/12/ and stable/11/ (but has not been updated in release/12.0.0/ or in release/11.2.0/ ): /[base]/head/sys/vm/swap_pager.c Revision 341375 - (view) (download) (annotate) - [select for diffs]=20 Modified Sat Dec 1 16:50:12 2018 UTC (5 months, 2 weeks ago) by kib=20 File length: 75712 byte(s)=20 Diff to previous 340637 Allow to create swap zone larger than v_page_count / 2. If user configured the maxswapzone tunable, just take the literal value for the initial zone sizing attempt. Before, it was only possible to reduce the zone by the tunable. While there, correct the message which was not correct when zone creation rounded the size up. Reported by: jmg Reviewed by: markj MFC after: 1 week Sponsored by: The FreeBSD Foundation Differential revision:=09 https://reviews.freebsd.org/D18381 /[base]/stable/12/sys/vm/swap_pager.c Revision 341716 - (view) (download) (annotate) - [select for diffs]=20 Modified Sat Dec 8 00:46:05 2018 UTC (5 months, 1 week ago) by kib=20 File length: 75745 byte(s)=20 Diff to previous 340333 MFC r341375 : Allow to create swap zone larger than v_page_count / 2. /[base]/stable/11/sys/vm/swap_pager.c Revision 341718 - (view) (download) (annotate) - [select for diffs]=20 Modified Sat Dec 8 00:48:10 2018 UTC (5 months, 1 week ago) by kib=20 File length: 73330 byte(s)=20 Diff to previous 335508 MFC r341375 : Allow to create swap zone larger than v_page_count / 2. The new code looks like: /* * Initialize our zone, taking the user's requested size or * estimating the number we need based on the number of pages * in the system. */ n =3D maxswzone !=3D 0 ? maxswzone / sizeof(struct swblk) : vm_cnt.v_page_count / 2; =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-hackers@freebsd.org Wed May 22 04:10:41 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 95FDB159E5B6; Wed, 22 May 2019 04:10:41 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3B5B068288; Wed, 22 May 2019 04:10:40 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id x4M4AcXe082597; Tue, 21 May 2019 21:10:38 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id x4M4AcOZ082596; Tue, 21 May 2019 21:10:38 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> Subject: Re: newbie question In-Reply-To: <20190521234006.GS16860@eureka.lemis.com> To: "Greg 'groggy' Lehey" Date: Tue, 21 May 2019 21:10:38 -0700 (PDT) CC: Alexandru Goia , freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 3B5B068288 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.96 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; IP_SCORE(0.05)[ip: (0.16), ipnet: 69.59.192.0/19(0.08), asn: 13868(0.05), country: US(-0.06)]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.54)[0.539,0]; NEURAL_HAM_LONG(-0.39)[-0.388,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.87)[0.872,0]; MX_GOOD(-0.01)[cached: gndrsh.dnsmgr.net]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 04:10:41 -0000 > On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: > > greetings. how can do i get attuned in a logical manner with the > > *bsd/freebsd kernel source code ? thank you very much ! > > Clearly you know how to get it (otherwise > https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your > friend). To understand it better, I'd suggest reading "The Design and > Implementation of the FreeBSD Operating System" by Kirk McKusick and > George Neville-Neil (Addison-Wesley). > > Understanding the code requires some work. People will happily answer > detail questions, but you'll be responsible for finding out the > overall structure yourself. During a somewhat recent session of working with a not new, but also not seasoned developer, they noted a great deal of confusion when I was reading through and explaining code to them when I would actually read "pcb" on screen as "Process Control Block" when verbalizing it. They could not see what I had just read to them. After a short discussion we realized that my mind was auto translating the short and cryptic variable names into the full and proper names. This became key in my understanding of how all these bits work long long ago and has just become automatic. SO, I encorage you and others new to the code, learn these data structure names, and mentall process them by long name, it could help you to better understand what it is your reading. The BSD sources are very consistent in its use of names and objects, and abbriviates, taking that to your advantage! Anyone any place have a nice list of the TLA to full name? pcb tcb p tp ifa ... > Greg -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-hackers@freebsd.org Wed May 22 05:39:56 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9FFA515A1240; Wed, 22 May 2019 05:39:56 +0000 (UTC) (envelope-from dmytrosichkar@gmail.com) Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 654FB6C7B4; Wed, 22 May 2019 05:39:55 +0000 (UTC) (envelope-from dmytrosichkar@gmail.com) Received: by mail-pg1-x532.google.com with SMTP id e17so571436pgo.9; Tue, 21 May 2019 22:39:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=IxeSVBLLncCrUblXSt+3WwdeWJSiHvVJDc6kZeFQT5Y=; b=NzytnSaAcqMLD9jDAVsNS4d18CL88cWv+JuSL5ra5Idq/6OXOZWsW6vHRCdacIZP8K e+2F5lPg5piugeX6cEKQzXMVNwnFzIm1Lg+5B4J7TQQ4Q/0eh7eAZqziIK2Y+dsxcaN+ rDIbKGih5Ya78WJ5icgV2UbntiLdKMf/QDRlDIbIum75TeZUHbXYVSxHqlTlNsTZociu wosqLneg/TK8msyJd9pJu4zAqgx53ySyxgIOjPuZBHy/KIJiRNKxp4yEo8taQhM0EXw6 gvlbmvDl6tp6kUzmSB6nz8I7ALsOZT97uQNPN0OH9N2TQab7jXRWCtKqy1Z6eEZON9wO 0dUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=IxeSVBLLncCrUblXSt+3WwdeWJSiHvVJDc6kZeFQT5Y=; b=TMePhomGsErCeQkfsyJOjqMinh6hUOMc6CcS3N4wgqItxtvTviZQeVrbcksv1pJdSx anrv5lkpdbCFjsltfc810hvpqGFkCsBnOJl0weFzBPXVpFZ/vkkLDgwKw+TXT/sp450a GEeGxOl92puUbJo0qWTx/U+2lesa119ZHWbiAxx489toprs+OODXgHoChvIf1KVHEGse MJrPdTqN+EGzmVpSZltK33pxdnbtfZvfTmF0fHxM+KsiJOBHcJle5BELQbepO/XItfoW HN192Ixay9FkJ9rDGSpbsz3Oq4v9ds8+BisMysyjzDXNNU5YZMuFjuFsnk6joNg2OQJ3 oWfA== X-Gm-Message-State: APjAAAV7qpzgq3Hzku8x276xFapU6OxsZPTvpEFLCIlSMEvgFg7s+cro F/Ig5mqWK1pvLCjUbFhvaMfFtEk/kiWBECLHaCP2FWkg X-Google-Smtp-Source: APXvYqzZkkytH5avuYn5vQt2HlzUp1IDwNbwT2xIBcEZx6RP23cmwqmdcigoGIb3QI0wPx9NvxZYcbiR/Eo2ovnivfc= X-Received: by 2002:a62:4281:: with SMTP id h1mr94069449pfd.162.1558503594217; Tue, 21 May 2019 22:39:54 -0700 (PDT) MIME-Version: 1.0 References: <20190521234006.GS16860@eureka.lemis.com> <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> In-Reply-To: <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> From: Dima Sichkar Date: Wed, 22 May 2019 08:39:36 +0300 Message-ID: Subject: Re: newbie question To: "Rodney W. Grimes" Cc: "Greg 'groggy' Lehey" , freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org, Alexandru Goia X-Rspamd-Queue-Id: 654FB6C7B4 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=NzytnSaA; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dmytrosichkar@gmail.com designates 2607:f8b0:4864:20::532 as permitted sender) smtp.mailfrom=dmytrosichkar@gmail.com X-Spamd-Result: default: False [-6.92 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-2.94)[ip: (-9.10), ipnet: 2607:f8b0::/32(-3.27), asn: 15169(-2.27), country: US(-0.06)]; NEURAL_HAM_SHORT(-0.97)[-0.967,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 05:39:56 -0000 You could also meditate on a "Grand Map": https://dspinellis.github.io/unix-architecture/arch.pdf It's helping me alot in binding source to some visual anchors. =D1=81=D1=80, 22 =D0=BC=D0=B0=D1=8F 2019 =D0=B3. =D0=B2 07:12, Rodney W. Gr= imes : > > On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: > > > greetings. how can do i get attuned in a logical manner with the > > > *bsd/freebsd kernel source code ? thank you very much ! > > > > Clearly you know how to get it (otherwise > > https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your > > friend). To understand it better, I'd suggest reading "The Design and > > Implementation of the FreeBSD Operating System" by Kirk McKusick and > > George Neville-Neil (Addison-Wesley). > > > > Understanding the code requires some work. People will happily answer > > detail questions, but you'll be responsible for finding out the > > overall structure yourself. > > During a somewhat recent session of working with a not new, > but also not seasoned developer, they noted a great deal of > confusion when I was reading through and explaining code > to them when I would actually read "pcb" on screen as > "Process Control Block" when verbalizing it. They could not > see what I had just read to them. > > After a short discussion we realized that my mind was auto translating > the short and cryptic variable names into the full and proper names. > This became key in my understanding of how all these bits work > long long ago and has just become automatic. SO, I encorage you and > others new to the code, learn these data structure names, and mentall > process them by long name, it could help you to better understand > what it is your reading. > > The BSD sources are very consistent in its use of names and objects, > and abbriviates, taking that to your advantage! > > Anyone any place have a nice list of the TLA to full name? > pcb > tcb > p > tp > ifa > ... > > > Greg > -- > Rod Grimes > rgrimes@freebsd.org > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " > From owner-freebsd-hackers@freebsd.org Wed May 22 07:28:09 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4C56D15A33EB; Wed, 22 May 2019 07:28:09 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: from mail-ed1-f53.google.com (mail-ed1-f53.google.com [209.85.208.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 20FC570714; Wed, 22 May 2019 07:28:08 +0000 (UTC) (envelope-from pratiy0100@gmail.com) Received: by mail-ed1-f53.google.com with SMTP id e24so2332322edq.6; Wed, 22 May 2019 00:28:07 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=gyGmJO3/QIiFML/byJmdBhRfKThsKPSVRR6zsceOq4w=; b=F7tVNmHeUpKjxSQf8uUiFQ/NJgeeEPQIpXKv1ODZ1egVL7ieu1pVj8TGhcZ+lmnAhK 2AZzwguDVQELTmAtURm6U9ntegiBUfye02Sh5+vqsDjB0in2QDiw3cuKV8Yt//XblxDS MWYMxGsjmZtZlk2CLWzPn3hCFm6Jhe8zg1LpjkCI2oyoqtpQfs+eMrSoJEvSM1A5pYCc FRInHmceECo50tzAXi5HDfECq6iFnUpqSi2PGzUecJPF7rhJnWesMYT9SBivhxIaSVk3 OJ0b2gtcVdP2OoWgGppfrUkeTxc2aZFmLt66I2JhkeyFv0q0IvbCqwD5Udq91rZ5aEPS QEvA== X-Gm-Message-State: APjAAAXRz5ya6Evx0i3CQkTR3yU5YKfyAvqTWjiMjP090Uzp4YHEpjfF +qq8BqcgHEBIrTwuhFr5WTJF2FQ0LKE= X-Google-Smtp-Source: APXvYqzbqE6rq4QnY4vF+SWpkcWzoEy4tPR7NaipR0BB5hWw9KPmQqrZI3L0wFKumw+rU8qyKkaTfQ== X-Received: by 2002:a17:906:7d50:: with SMTP id l16mr1858327ejp.84.1558510080623; Wed, 22 May 2019 00:28:00 -0700 (PDT) Received: from mail-ed1-f42.google.com (mail-ed1-f42.google.com. [209.85.208.42]) by smtp.gmail.com with ESMTPSA id f25sm6883925ede.44.2019.05.22.00.28.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 00:28:00 -0700 (PDT) Received: by mail-ed1-f42.google.com with SMTP id f37so2281774edb.13; Wed, 22 May 2019 00:28:00 -0700 (PDT) X-Received: by 2002:a05:6402:78f:: with SMTP id d15mr35611272edy.189.1558510079930; Wed, 22 May 2019 00:27:59 -0700 (PDT) MIME-Version: 1.0 References: <20190521234006.GS16860@eureka.lemis.com> <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> In-Reply-To: <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> From: Pratyush Yadav Date: Wed, 22 May 2019 12:57:23 +0530 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: newbie question To: "Rodney W. Grimes" Cc: Hackers freeBSD , freebsd-questions@freebsd.org, Alexandru Goia Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 20FC570714 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of pratiy0100@gmail.com designates 209.85.208.53 as permitted sender) smtp.mailfrom=pratiy0100@gmail.com X-Spamd-Result: default: False [-5.13 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.96)[-0.957,0]; RCVD_IN_DNSWL_NONE(0.00)[53.208.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.17)[ip: (-5.04), ipnet: 209.85.128.0/17(-3.47), asn: 15169(-2.27), country: US(-0.06)]; FORGED_SENDER(0.30)[pratyush@freebsd.org,pratiy0100@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[pratyush@freebsd.org,pratiy0100@gmail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 07:28:09 -0000 Hi, On Wed, 22 May 2019 at 09:44, Rodney W. Grimes wrote: > > > On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: > > > greetings. how can do i get attuned in a logical manner with the > > > *bsd/freebsd kernel source code ? thank you very much ! > > > > Clearly you know how to get it (otherwise > > https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your > > friend). To understand it better, I'd suggest reading "The Design and > > Implementation of the FreeBSD Operating System" by Kirk McKusick and > > George Neville-Neil (Addison-Wesley). > > > > Understanding the code requires some work. People will happily answer > > detail questions, but you'll be responsible for finding out the > > overall structure yourself. > > During a somewhat recent session of working with a not new, > but also not seasoned developer, they noted a great deal of > confusion when I was reading through and explaining code > to them when I would actually read "pcb" on screen as > "Process Control Block" when verbalizing it. They could not > see what I had just read to them. > > After a short discussion we realized that my mind was auto translating > the short and cryptic variable names into the full and proper names. > This became key in my understanding of how all these bits work > long long ago and has just become automatic. That's actually great insight. After reading your message I noticed I do the same when working. > [snip] Apart from this, I think usually actually fixing some bug or implementing some feature improves my understanding of a codebase and a community. Fixing a bug is a good motivator for understanding a subsystem. -- Regards, Pratyush Yadav From owner-freebsd-hackers@freebsd.org Wed May 22 08:41:22 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A686D15A59C3 for ; Wed, 22 May 2019 08:41:22 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D4E467433A for ; Wed, 22 May 2019 08:41:21 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: by mailman.ysv.freebsd.org (Postfix) id 962E915A59C2; Wed, 22 May 2019 08:41:21 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5664315A59C1 for ; Wed, 22 May 2019 08:41:21 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward100p.mail.yandex.net (forward100p.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:100]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C39A974337 for ; Wed, 22 May 2019 08:41:20 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from mxback7j.mail.yandex.net (mxback7j.mail.yandex.net [IPv6:2a02:6b8:0:1619::110]) by forward100p.mail.yandex.net (Yandex) with ESMTP id 0AE305982170; Wed, 22 May 2019 11:41:09 +0300 (MSK) Received: from smtp3p.mail.yandex.net (smtp3p.mail.yandex.net [2a02:6b8:0:1472:2741:0:8b6:8]) by mxback7j.mail.yandex.net (nwsmtp/Yandex) with ESMTP id FN61fhA5MV-f8iSaRaS; Wed, 22 May 2019 11:41:09 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1558514469; bh=p4ir6iZSGZ6f1li+uBlZmrfxLWoIN1tx83ZVAf7HaD4=; h=In-Reply-To:From:Date:References:To:Subject:Message-ID; b=TFhYxsx2qxoH0uGZtZZOEu+es5q1u3SqU5ytbpmeLrnY+wf21p68mk2xCyd9QqjFV 7dR6I27oLJu88FDGLVYf4cr1oyEMiiAyIknVaIKRNPVS8xpK+38IJLb1PQoC0RDsTE EusbJ1l6JvgxMJVbx7gkxKTIYFS3H41I0lPwbntk= Received: by smtp3p.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id Rp5bcbZv9q-f86Gd2IV; Wed, 22 May 2019 11:41:08 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) Subject: Re: ERR#78 'function not implemented' To: Daniel Braniss , hackers@freebsd.org References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Autocrypt: addr=bu7cher@yandex.ru; prefer-encrypt=mutual; keydata= mQENBEwBF1kBCADB9sXFhBEUy8qQ4X63Y8eBatYMHGEFWN9ypS5lI3RE6qQW2EYbxNk7qUC5 21YIIS1mMFVBEfvR7J9uc7yaYgFCEb6Sce1RSO4ULN2mRKGHP3/Sl0ijZEjWHV91hY1YTHEF ZW/0GYinDf56sYpDDehaBF5wkWIo1+QK5nmj3vl0DIDCMNd7QEiWpyLVwECgLX2eOAXByT8B bCqVhJGcG6iFP7/B9Ll6uX5gb8thM9LM+ibwErDBVDGiOgvfxqidab7fdkh893IBCXa82H9N CNwnEtcgzh+BSKK5BgvPohFMgRwjti37TSxwLu63QejRGbZWSz3OK3jMOoF63tCgn7FvABEB AAG0JUFuZHJleSBWLiBFbHN1a292IDxidTdjaGVyQHlhbmRleC5ydT6JATgEEwECACIFAkwB F1kCGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEAHF6gQQyKF6qmYIAI6ekfm1VA4T vqankI1ISE6ku4jV7UlpIQlEbE7/8n3Zd6teJ+pGOQhN5qk8QE7utdPdbktAzi+x7LIJVzUw 4TywZLXGrkP7VKYkfg6oyCGyzITghefQeJtr2TN4hYCkzPWpylkue8MtmqfZv/6royqwTbN+ +E09FQNvTgRUYJYTeQ1qOsxNRycwvw3dr2rOfuxShbzaHBB1pBIjGrMg8fC5pd65ACH5zuFV A0CoTNGMDrEZSfBkTW604UUHFFXeCoC3dwDZRKOWJ3GmMXns65Ai5YkA63BSHEE1Qle3VBhd cG1w0CB5FBV3pB27UVnf0jEbysrDqW4qN7XMRFSWNAy5AQ0ETAEXWQEIAJ2p6l9LBoqdH/0J PEFDY2t2gTvAuzz+8zs3R03dFuHcNbOwjvWCG0aOmVpAzkRa8egn5JB4sZaFUtKPYJEQ1Iu+ LUBwgvtXf4vWpzC67zs2dDuiW4LamH5p6xkTD61aHR7mCB3bg2TUjrDWn2Jt44cvoYxj3dz4 S49U1rc9ZPgD5axCNv45j72tggWlZvpefThP7xT1OlNTUqye2gAwQravXpZkl5JG4eOqJVIU X316iE3qso0iXRUtO7OseBf0PiVmk+wCahdreHOeOxK5jMhYkPKVn7z1sZiB7W2H2TojbmcK HZC22sz7Z/H36Lhg1+/RCnGzdEcjGc8oFHXHCxUAEQEAAYkBHwQYAQIACQUCTAEXWQIbDAAK CRABxeoEEMihegkYCAC3ivGYNe2taNm/4Nx5GPdzuaAJGKWksV+w9mo7dQvU+NmI2az5w8vw 98OmX7G0OV9snxMW+6cyNqBrVFTu33VVNzz9pnqNCHxGvj5dL5ltP160JV2zw2bUwJBYsgYQ WfyJJIM7l3gv5ZS3DGqaGIm9gOK1ANxfrR5PgPzvI9VxDhlr2juEVMZYAqPLEJe+SSxbwLoz BcFCNdDAyXcaAzXsx/E02YWm1hIWNRxanAe7Vlg7OL+gvLpdtrYCMg28PNqKNyrQ87LQ49O9 50IIZDOtNFeR0FGucjcLPdS9PiEqCoH7/waJxWp6ydJ+g4OYRBYNM0EmMgy1N85JJrV1mi5i Message-ID: <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> Date: Wed, 22 May 2019 11:38:46 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="HjuzTQvE8JHvpXa0FzIIfsYsh38liYaZ6" X-Rspamd-Queue-Id: C39A974337 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.989,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 08:41:22 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --HjuzTQvE8JHvpXa0FzIIfsYsh38liYaZ6 Content-Type: multipart/mixed; boundary="kTwYUejMtxr5xKfKf6Z9AFviHFNPNPrYV"; protected-headers="v1" From: "Andrey V. Elsukov" To: Daniel Braniss , hackers@freebsd.org Message-ID: <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> Subject: Re: ERR#78 'function not implemented' References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> In-Reply-To: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> --kTwYUejMtxr5xKfKf6Z9AFviHFNPNPrYV Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 21.05.2019 19:03, Daniel Braniss wrote: > Hi, > Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I have= been doing it for some time > without any issues, but today I decided to try out release.sh and it fa= iles. > I have run the =E2=80=98bad=E2=80=99 command: > -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- > #568() ERR#78 'Function not i= mplemented' > SIGNAL 12 (SIGSYS) code=3DSI_KERNEL > process killed, signal =3D 12 (core dumped) Hi, Your kernel is too old to be able run this binary. Syscall 568 is funlinkat(2), it was introduced in r345982. https://svnweb.freebsd.org/base?view=3Drevision&revision=3D345982 --=20 WBR, Andrey V. Elsukov --kTwYUejMtxr5xKfKf6Z9AFviHFNPNPrYV-- --HjuzTQvE8JHvpXa0FzIIfsYsh38liYaZ6 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - https://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlzlCpYACgkQAcXqBBDI oXpuAAgAsCHhdMI3IghWcygPYi1fi0bGKP9Yv1CxoZGLgiyz67+A3Eh2xGqnJq9Q TTRkHMy0fQIpv1PoGzNIAzB3CnOFZNj1ifUCZf66fTZuAKmxryndf4OLFXM9Icml xhQYnBaX/duutBhPBkoX/oggmQJw3CjFFyDFr12Ty15T5F36EQGMY+LQqs/jfKiK fA4fxA2IwP88QLjLef5iJSY679ynjrATRZPO1oqFNYIaNlPiYofqkohpbz+20MoF bzSf/9YqdWNh06x/X4HPQVvs4VcHO/8LP6CJnwi4QV+P2in7C8mWx+DTj0CG2v6O pI1Ok/pWb4yUHlqbvQw/se5W19IMnQ== =1bxB -----END PGP SIGNATURE----- --HjuzTQvE8JHvpXa0FzIIfsYsh38liYaZ6-- From owner-freebsd-hackers@freebsd.org Wed May 22 12:57:21 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5CBD015AB7E3 for ; Wed, 22 May 2019 12:57:21 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A154B84705 for ; Wed, 22 May 2019 12:57:20 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: by mailman.ysv.freebsd.org (Postfix) id 5CD3515AB7E2; Wed, 22 May 2019 12:57:20 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A69015AB7E1 for ; Wed, 22 May 2019 12:57:20 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CE85084702 for ; Wed, 22 May 2019 12:57:19 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:References:Message-Id:Content-Transfer-Encoding:Cc:Date:In-Reply-To:From:Subject:Mime-Version:Content-Type; bh=LNvIVo0R3QHFAIIWQU8RM/9maItQwqkB8hIkepItLhQ=; b=o5ofMZhv8/4iDaRRrxZzCohvG2WAyFgQKipW7OW6SFGZxwRCgb4DPU8O0ltNznEgagSU5gPbNEEb8ha9RaT2QlNqccwIUg5cIbCBTdRxuvGYd03qr2zabniY2L5StW3DVM2++SbQv7hQt90U0iJ3T2whYZSG/xf7ZItRRdobXwwsMl74aLvjCj6ltQPZVpm4N+LMaJQ3F3nYHXrA2LFr5Fxki9/NM7ZYkRxUGqUps0tb85OenLu/UBuQX2Pe3puxkfJX5+30bjok6Pm5DrzxSiVH6pInZ6soTc2L6sVOoyDuxmIKuIynPB1hAKFVROwWZ5lkldoH44khnjGNwkeOCw==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hTQnu-0001RW-7Z; Wed, 22 May 2019 15:57:10 +0300 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.8\)) Subject: Re: ERR#78 'function not implemented' From: Daniel Braniss In-Reply-To: <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> Date: Wed, 22 May 2019 15:57:09 +0300 Cc: hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <7C0C64B8-B2A4-4CE8-9A1A-9394A9E1550A@cs.huji.ac.il> References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> To: "Andrey V. Elsukov" X-Mailer: Apple Mail (2.3445.104.8) X-Rspamd-Queue-Id: CE85084702 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.97)[-0.970,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 12:57:21 -0000 > On 22 May 2019, at 11:38, Andrey V. Elsukov wrote: >=20 > On 21.05.2019 19:03, Daniel Braniss wrote: >> Hi, >> Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I = have been doing it for some time >> without any issues, but today I decided to try out release.sh and it = failes. >> I have run the =E2=80=98bad=E2=80=99 command: >=20 >> -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- >> #568() ERR#78 'Function not = implemented' >> SIGNAL 12 (SIGSYS) code=3DSI_KERNEL >> process killed, signal =3D 12 (core dumped) >=20 > Hi, >=20 > Your kernel is too old to be able run this binary. Syscall 568 is > funlinkat(2), it was introduced in r345982. >=20 > https://svnweb.freebsd.org/base?view=3Drevision&revision=3D345982 >=20 hi, thanks, so that raises a new question: Q: to use release.sh one needs to be running the latest current? danny > --=20 > WBR, Andrey V. Elsukov >=20 From owner-freebsd-hackers@freebsd.org Wed May 22 13:16:07 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C511115ABFCC for ; Wed, 22 May 2019 13:16:07 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E0DC785730 for ; Wed, 22 May 2019 13:16:06 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 9C0DC15ABFCB; Wed, 22 May 2019 13:16:06 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 772E315ABFCA for ; Wed, 22 May 2019 13:16:06 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pf1-x441.google.com (mail-pf1-x441.google.com [IPv6:2607:f8b0:4864:20::441]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EA7DB8572F for ; Wed, 22 May 2019 13:16:05 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pf1-x441.google.com with SMTP id y11so1303016pfm.13 for ; Wed, 22 May 2019 06:16:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=w6rQ/6mlJi/gPsM2jM6ow55WkmRz3GFtczmQEgtr7vc=; b=R+4KWnc25cmRzJRr1Kt9lLaI107mMMcWz3FAtSiAwD4D6iqu4UNUZtCI2tHwIvvZPM AS+/E06L8Nw6RKH4d0SkU7kHui0f7yd9bbYF9gQQ0zNrVGlmmDcKmDG09Yca8HWI2Yd3 t8yFZLNx1S4/Qy83ModnBPdd7YDa0N6KH5lS+ALSz8/DDUObmt3r+MwkKfYFVVkc1ajh o+kW9jeRqbcVgqPnONTxw3Af0gjtqTocFa9kmMSUizAq//9vXv0uACDN3QUTLOQTnJZb FYYRUBk5igUUYlKWy9e54bOSO2B+lfJ4+UEkPiXE9TWL201ffulpJGQjVfW3HOlMiHY5 p3Og== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=w6rQ/6mlJi/gPsM2jM6ow55WkmRz3GFtczmQEgtr7vc=; b=QGvTKNywCowV/hB5b8E4WzZMs1TuRcjqzx9caT0VOt3jUf5R7IXi/fU0Qrip2mZcBc XcM21vQgMEP9LM77K4dVzfXZNcUSnwIenhFk5GIm4uSjoNi9HciyOqN/au+StfGsfbPt K1g2JUg7zWwFxELaRWm9rIdyYxKhq2ZFzOyUx0OemTDQBdGiBZOrwTsnbmLyNrFqf6TB C62fHHiA2hNyVMQLgvHoFv+hclAsFu5OJnSiEU6hpt0tJT04lw1DJoU0MDo8leUHBigC aXnHeELs7LRkQggWMQ5iG9DZyGj5pc1npuduljziTiPnOtC0OGRRoVpd3GgrznC6YDIV yo9g== X-Gm-Message-State: APjAAAXJdNVESmU1MKg7VRiSO3Lo0PmrkktVSgj/+hvGAGeeGbQDmbI1 /CoFsNaGbMHBsKiK6uk2T+ICADSCWPs= X-Google-Smtp-Source: APXvYqz+rHHq8iw52r2Zy7F4Qoz6sBW/SgFIUhk8KTvv4JuHNoaaZmyOZPwdmZw0TJayx+rWBAoBtQ== X-Received: by 2002:a62:6456:: with SMTP id y83mr30952528pfb.71.1558530964604; Wed, 22 May 2019 06:16:04 -0700 (PDT) Received: from [192.168.20.22] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id 124sm36576997pfe.124.2019.05.22.06.16.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 06:16:04 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: ERR#78 'function not implemented' From: Enji Cooper X-Mailer: iPhone Mail (16F156) In-Reply-To: <7C0C64B8-B2A4-4CE8-9A1A-9394A9E1550A@cs.huji.ac.il> Date: Wed, 22 May 2019 06:16:03 -0700 Cc: "Andrey V. Elsukov" , hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1419BF6D-9BF3-454B-A9BB-E7CB50D4B540@gmail.com> References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> <7C0C64B8-B2A4-4CE8-9A1A-9394A9E1550A@cs.huji.ac.il> To: Daniel Braniss X-Rspamd-Queue-Id: EA7DB8572F X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.991,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 13:16:08 -0000 > On May 22, 2019, at 05:57, Daniel Braniss wrote: >=20 >> On 22 May 2019, at 11:38, Andrey V. Elsukov wrote: >>=20 >> On 21.05.2019 19:03, Daniel Braniss wrote: >>> Hi, >>> Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I have b= een doing it for some time >>> without any issues, but today I decided to try out release.sh and it fai= les. >>> I have run the =E2=80=98bad=E2=80=99 command: >>=20 >>> -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- >>> #568() ERR#78 'Function not im= plemented' >>> SIGNAL 12 (SIGSYS) code=3DSI_KERNEL >>> process killed, signal =3D 12 (core dumped) >>=20 >> Hi, >>=20 >> Your kernel is too old to be able run this binary. Syscall 568 is >> funlinkat(2), it was introduced in r345982. >>=20 >> https://svnweb.freebsd.org/base?view=3Drevision&revision=3D345982 >>=20 > hi, > thanks, so that raises a new question: > Q: to use release.sh one needs to be running the latest current? In theory, liblegacy and ITOOLS should be taking care of some of this. A bin= ary is being run from the install which should be run from the system. That being said, you should be running a more recent release of 11.x or stab= le/11. Cheers, -Enji= From owner-freebsd-hackers@freebsd.org Wed May 22 13:49:00 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1011F15ACB27 for ; Wed, 22 May 2019 13:49:00 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7571D8684C for ; Wed, 22 May 2019 13:48:59 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 2EDFC15ACB26; Wed, 22 May 2019 13:48:59 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C10015ACB25 for ; Wed, 22 May 2019 13:48:59 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 15DDC8684B for ; Wed, 22 May 2019 13:48:57 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x4MDmfjM056998 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 22 May 2019 16:48:44 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x4MDmfjM056998 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x4MDmfYj056997; Wed, 22 May 2019 16:48:41 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 22 May 2019 16:48:41 +0300 From: Konstantin Belousov To: Enji Cooper Cc: Daniel Braniss , hackers@freebsd.org, "Andrey V. Elsukov" Subject: Re: ERR#78 'function not implemented' Message-ID: <20190522134841.GZ2748@kib.kiev.ua> References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> <7C0C64B8-B2A4-4CE8-9A1A-9394A9E1550A@cs.huji.ac.il> <1419BF6D-9BF3-454B-A9BB-E7CB50D4B540@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1419BF6D-9BF3-454B-A9BB-E7CB50D4B540@gmail.com> User-Agent: Mutt/1.11.4 (2019-03-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 13:49:00 -0000 On Wed, May 22, 2019 at 06:16:03AM -0700, Enji Cooper wrote: > > > On May 22, 2019, at 05:57, Daniel Braniss wrote: > > > >> On 22 May 2019, at 11:38, Andrey V. Elsukov wrote: > >> > >> On 21.05.2019 19:03, Daniel Braniss wrote: > >>> Hi, > >>> Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I have been doing it for some time > >>> without any issues, but today I decided to try out release.sh and it failes. > >>> I have run the ‘bad’ command: > >> > >>> -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- > >>> #568() ERR#78 'Function not implemented' > >>> SIGNAL 12 (SIGSYS) code=SI_KERNEL > >>> process killed, signal = 12 (core dumped) > >> > >> Hi, > >> > >> Your kernel is too old to be able run this binary. Syscall 568 is > >> funlinkat(2), it was introduced in r345982. > >> > >> https://svnweb.freebsd.org/base?view=revision&revision=345982 > >> > > hi, > > thanks, so that raises a new question: > > Q: to use release.sh one needs to be running the latest current? > > In theory, liblegacy and ITOOLS should be taking care of some of this. A binary is being run from the install which should be run from the system. > liblegacy only relevant when your target is the old host system. It cannot help with running binary built on newer system. > That being said, you should be running a more recent release of 11.x or stable/11. No. You cannot run 12 binaries on 11 at all (practically any binary would fail), and you cannot run some HEAD binaries on 12. From owner-freebsd-hackers@freebsd.org Wed May 22 14:59:29 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97C2115ADE10 for ; Wed, 22 May 2019 14:59:29 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 85D6D89417 for ; Wed, 22 May 2019 14:59:28 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: by mailman.ysv.freebsd.org (Postfix) id 45B7E15ADE0F; Wed, 22 May 2019 14:59:28 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2187115ADE0E for ; Wed, 22 May 2019 14:59:28 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9B5B289416 for ; Wed, 22 May 2019 14:59:27 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=References:To:Cc:In-Reply-To:Date:Subject:Mime-Version:Content-Type:Message-Id:From; bh=CQi108H3iGgqgBTXauRQ12Gv3QisEnQvIH3olt5UGIc=; b=14v9kuIo01zQ/j8oj1ZgcDgDeSzeHniCB+NdT/HK70rulDBfx5LCCojEMJ3jujbI+qEpkJSUKGTGJKl+eSI/LkSQ9MFRdtdFf9t8KXToHYJvL/0dOQGjRPVjjr9XqLcad7Xhsjzg3PdBpBt+71+/zQtUMftwm07crX8wOYR8BRiEBfYJWiW4cZeR4dhCY/hkP85KqWjZ+TCZDTqJa1kVIRzAaqmkm6t25TMOTu1vUYTaXiYZAW4eCOnYN0NKxhqF6z04VJq/ozDyF+27SIG+PKdIajK8WVi5ei417ZqRPFD/lmFbU0nZmnVMJNDPpPLgPxXWudC1nM/tP/MyjVcT1A==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hTSi5-0008rs-AH; Wed, 22 May 2019 17:59:17 +0300 From: Daniel Braniss Message-Id: <053B6218-7AEA-4845-B6EA-030E1F9C6FEB@cs.huji.ac.il> Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.8\)) Subject: Re: ERR#78 'function not implemented' Date: Wed, 22 May 2019 17:59:16 +0300 In-Reply-To: <20190522134841.GZ2748@kib.kiev.ua> Cc: Enji Cooper , hackers@freebsd.org, "Andrey V. Elsukov" To: Konstantin Belousov References: <6B0A65C2-5F53-47B3-8159-0AEA3E0C37C4@cs.huji.ac.il> <87ede120-b533-302d-6ffb-82fd735dce21@yandex.ru> <7C0C64B8-B2A4-4CE8-9A1A-9394A9E1550A@cs.huji.ac.il> <1419BF6D-9BF3-454B-A9BB-E7CB50D4B540@gmail.com> <20190522134841.GZ2748@kib.kiev.ua> X-Mailer: Apple Mail (2.3445.104.8) X-Rspamd-Queue-Id: 9B5B289416 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.96 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.96)[-0.965,0] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 14:59:29 -0000 > On 22 May 2019, at 16:48, Konstantin Belousov = wrote: >=20 > On Wed, May 22, 2019 at 06:16:03AM -0700, Enji Cooper wrote: >>=20 >>> On May 22, 2019, at 05:57, Daniel Braniss = wrote: >>>=20 >>>> On 22 May 2019, at 11:38, Andrey V. Elsukov = wrote: >>>>=20 >>>> On 21.05.2019 19:03, Daniel Braniss wrote: >>>>> Hi, >>>>> Im using a freebsd-stable-11.1-STABLE to cross compile for arm, I = have been doing it for some time >>>>> without any issues, but today I decided to try out release.sh and = it failes. >>>>> I have run the =E2=80=98bad=E2=80=99 command: >>>>=20 >>>>> -- UNKNOWN FreeBSD ELF64 SYSCALL 568 -- >>>>> #568() ERR#78 'Function = not implemented' >>>>> SIGNAL 12 (SIGSYS) code=3DSI_KERNEL >>>>> process killed, signal =3D 12 (core dumped) >>>>=20 >>>> Hi, >>>>=20 >>>> Your kernel is too old to be able run this binary. Syscall 568 is >>>> funlinkat(2), it was introduced in r345982. >>>>=20 >>>> https://svnweb.freebsd.org/base?view=3Drevision&revision=3D345982 >>>>=20 >>> hi, >>> thanks, so that raises a new question: >>> Q: to use release.sh one needs to be running the latest current? >>=20 >> In theory, liblegacy and ITOOLS should be taking care of some of = this. A binary is being run from the install which should be run from = the system. >>=20 > liblegacy only relevant when your target is the old host system. It = cannot > help with running binary built on newer system. >=20 >> That being said, you should be running a more recent release of 11.x = or stable/11. > No. >=20 > You cannot run 12 binaries on 11 at all (practically any binary would = fail), > and you cannot run some HEAD binaries on 12. at the moment, my workaround is to change the mounts (so far in 2 = places) to not do a chroot, thus using the system=E2=80=99s mount. (I still have not succeeded in crating an sd image, it just takes too = long :-) Q: why shouldn=E2=80=99t this be the default? and now I run away and hide cheers, danny From owner-freebsd-hackers@freebsd.org Wed May 22 15:19:41 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89FF515AE496; Wed, 22 May 2019 15:19:41 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-xc30.google.com (mail-yw1-xc30.google.com [IPv6:2607:f8b0:4864:20::c30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D4718A47E; Wed, 22 May 2019 15:19:40 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-yw1-xc30.google.com with SMTP id t5so978810ywf.10; Wed, 22 May 2019 08:19:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Du7+YfdsA++Saah3CuC4q2twuDJTQO1oEJCBTEXc4RY=; b=niE/zW7kcahWkfTLUFRWuJCaAF4UnyjQy0RoX9pILUzkRXNRmLm09piBRKXOJsx1Xq w33smkybzOVLmM9EUdmJfhSwJCtGxP9CgHi6LgrF+9JTkSNebT0NVD/L/siQVelFJXFj LSted7gPUUuekxUeNLEcwswyPvfMUAUSWtTdq7IHksIbmw7Y4E0maedIbAU9b76FbWyu o4+49oHNXbLFP0Kl+HKdhOPW370TWv3I2mcHHSKYGcbzf4SGkRJAni8dE6zY01/f0GlF bQ4POVRQw6jsj2GUk7Xc3QPS5OdI1/XRJiBX2xZ4/tTGVXWlFip95P1t97KskVg2AJix 8xnA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=Du7+YfdsA++Saah3CuC4q2twuDJTQO1oEJCBTEXc4RY=; b=qehO3NWXU8mdyWbrzfIEvqzl3M507YiidmwCaS7j6oHUCizr9rw6kVEDQelYzwZAze keTJmUqXo5dltRbfeFp5d9l4NUJzw0cInq/qTgENNdZvEYx++S8PIyscYL254sAd7luE qwbDnbQP7WMEQLFam+9scJhFKR0gEhMQ8POdpdX6rZdXijM+yxDWwsAObxGmWpjC+f2y AectQVsrrEHj72/kdDXHeFzu2naqbFZIOL1HV2x0mN5NRwjOwybsRHT11uf/2zMP/u5Z vWqhITWm6PM1MqwByUdXrFsk9OBSSIJELrb7jIu/0Aa+u+2mn8O0ikzz6rp8dxLhxmub L+ZA== X-Gm-Message-State: APjAAAWaxEAikgha+1PT/VZfE3EIE9MCLHEk57h9chw6XJlrIE69XOWn nk35/jqUT27oXbEWvUC9asco3Nmo2eA= X-Google-Smtp-Source: APXvYqy8/2LyqjMQhe0eMnUF15iKppcYDVdYNRApOUjCB58OsoA6MkkAmrOJ7q3PpHTDqjFwq05HJA== X-Received: by 2002:a81:4987:: with SMTP id w129mr26866977ywa.438.1558538378860; Wed, 22 May 2019 08:19:38 -0700 (PDT) Received: from mavoffice.ixsystems.com ([12.189.233.129]) by smtp.gmail.com with ESMTPSA id v144sm6406295ywv.15.2019.05.22.08.19.38 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 08:19:38 -0700 (PDT) Sender: Alexander Motin Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem To: Mark Johnston , Lev Serebryakov Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> From: Alexander Motin Openpgp: preference=signencrypt Autocrypt: addr=mav@FreeBSD.org; prefer-encrypt=mutual; keydata= xsBNBFOzxAwBCADkPrax0pI2W/ig0CK9nRJJwsHitAGEZ2HZiFEuti+6/4UVxj81yr4ak/4g 9bKUyC7rMEAp/ZHNhd+MFCPAAcHPvtovnfykqE/vuosCS3wlSLloix2iKVLks0CwbLHGAyne 46lTQW74Xl/33c3W1Z6d8jD9gVFT/xaVzZ0U9xdzOmsYAZaAj4ki0tuxO9F7L+ct9grRe7iP g8t9hai7BL4ee3VRwk2JXnKb7UvBiVITKYWKz1jRvZIrjPokgEcCLOSlv7x/1kjuFnj3xWZU 7HSFFT8J93epBbrSSCsYsppIk2fZH41kaaFXsMQfTPH8wkeM6qwrvOh4HiQM08R+9tThABEB AAHNIUFsZXhhbmRlciBNb3RpbiA8bWF2QEZyZWVCU0Qub3JnPsLAlwQTAQoAQQIbAwULCQgH AwUVCgkICwUWAwIBAAIeAQIXgAIZARYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMKuBQkN McyiAAoJEIMYw5VbqyJ/tuUIAOG3ONOSNYqjK4eTZ1TVh9jdUBAhWk5nhDFnODN49Wj0AbYm 7aIqy8O1hnCDSZG5LttjSAo3UfXJZDKQM0BLb0gpRMBnAYqO6tdolLNqAbPGJBnGoPjsh24y 6KcbDaNnis+lD4GwPXwQM+92wZGhCUFElPV9NciZGVS65TNIgk7X+yEjjhD1MSWKKijZ1r9Z zIt4OzUTxxNOvzdlABZS88nNRdJkatOQJPmFdd1mpP6UzTNCiLUo1pIqOEtJgvVVDYq5WHY6 tciWWYdmZG/tIBexJmv2mV2OLVjXR6ZeKmntVH14H72/wRHJuYHQC+r5SVRcWWayrThsY6jZ Yr4+raTOwE0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6Z AXgDtmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8Flv mI/c40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt 3ytU8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZ R1EdEIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm5 9R8AEQEAAcLAZQQYAQoADwUCU7PEDAIbDAUJBaOagAAKCRCDGMOVW6sif7FRB/4k9y/GaGqU fcJiXdQHRAKHCUvbKMFgeEDHOg33qx+POS2Ah85/PXVa2jYBldCZDmYc+zl48aEMd163a7s3 0gJaB7CYElwxlKUk6c+5gwoYIJuJJzSzW0JzSD5ch7RIRxbfxrKdsiHrUW8AeduZWzlK6VaW RmWILgLmxfLdhEVFWxbr99GSeVFZaZwn6tl/8CvBcgYoARvJvl0V5zS1akQfEISYkwL9EfUI W44EOHranL5qUXkedXBYp6fRsooGrIimfwYxaC8FbXhk3FMgMjDMRiVq4POHo1iGeYETsUrL NM6184E25gPVtX2fb3RhM8Xh6BkwCZ6ZYbQ+AcD4F/cKwsB8BBgBCgAmAhsMFiEE6YzzxOac w80OV51VgxjDlVurIn8FAllgwtgFCQ0xzMwACgkQgxjDlVurIn9OqAf9FAcKWS95wTTbraXA qg/+bQyHgjlMtGCgkmfxLsbUGeqiFgmSIuoDrF7q6sYPs6p00CXXZRuuNZt0lX7O95re8mgz gxm5iJisZpdbHMVepYlw/AxT2wCHwxGCEe64Lm+A9vjlOd+3D3/6fSLwZ9WFCE6p6lQZ1CDg 09xe+JKSgC+KDqmn0tzGKyfSCuhRAq3XkZyxL1hxBaDeP0eeKlzoy7jXodf3wVvXXc0cmpza B5McuRHK4EU6jIioHo30YqPM4AjPHGxV2X1N6/Aayungzj9EXNZtKCxs6dsTvjniWa5VkZ9F 4SOdSbxEen1DZRYpeWnd7GVmO86n+5USkKCXPg== Message-ID: <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> Date: Wed, 22 May 2019 11:19:34 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20190520164202.GA2130@spy> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 2D4718A47E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=niE/zW7k; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::c30 as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-6.15 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-2.99)[ip: (-9.36), ipnet: 2607:f8b0::/32(-3.26), asn: 15169(-2.27), country: US(-0.06)]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[0.3.c.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.95)[-0.949,0]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 15:19:41 -0000 On 20.05.2019 12:42, Mark Johnston wrote: > On Mon, May 20, 2019 at 07:05:07PM +0300, Lev Serebryakov wrote: >> >> I'm looking at last commit to >> 'sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c' (r345200) and >> have another question. >> >> Here are such code: >> >> 4960 /* >> 4961 * Kick off asynchronous kmem_reap()'s of all our caches. >> 4962 */ >> 4963 arc_kmem_reap_soon(); >> 4964 >> 4965 /* >> 4966 * Wait at least arc_kmem_cache_reap_retry_ms between >> 4967 * arc_kmem_reap_soon() calls. Without this check it is >> possible to >> 4968 * end up in a situation where we spend lots of time reaping >> 4969 * caches, while we're near arc_c_min. Waiting here also >> gives the >> 4970 * subsequent free memory check a chance of finding that the >> 4971 * asynchronous reap has already freed enough memory, and >> we don't >> 4972 * need to call arc_reduce_target_size(). >> 4973 */ >> 4974 delay((hz * arc_kmem_cache_reap_retry_ms + 999) / 1000); >> 4975 >> >> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, >> this `delay()` looks very wrong. Am I right? Why is it wrong? >> Looks like it should be `#ifdef illumos`. > > See also r338142, which I believe was reverted by the update. My r345200 indeed reverted that value, but I don't see a problem there. When OS need more RAM, pagedaemon will drain UMA caches by itself. I don't see a point in re-draining UMA caches in a tight loop without delay. If caches are not sufficient to sustain one second of workload, then usefulness of such caches is not very clear and shrinking ARC to free some space may be a right move. Also making ZFS drain its caches more active then anything else in a system looks unfair to me. -- Alexander Motin From owner-freebsd-hackers@freebsd.org Wed May 22 15:50:22 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3904E15AF632; Wed, 22 May 2019 15:50:22 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9616B8BF48; Wed, 22 May 2019 15:50:21 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 15441127E1; Wed, 22 May 2019 15:50:21 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id BA68818C29; Wed, 22 May 2019 18:50:16 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem To: Alexander Motin , Mark Johnston Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> From: Lev Serebryakov Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABtCFMZXYgU2VyZWJy eWFrb3YgPGxldkBGcmVlQlNELm9yZz6JAlYEEwEIAEACGwMHCwkIBwMCAQYVCAIJCgsEFgID AQIeAQIXgBYhBPltHKC19DGLZ0szCuqwPFi/3EePBQJb/TeXBQkPBbfGAAoJEOqwPFi/3EeP LtEQANQLS89OCDSnLDZLyCj7sH5GZbTikJp9Or2McqEOpjgtfY/OgqCe7lfo8f71tTN3gL2t VGtNEtsl6CqKeBdm6fqsetCAed2+waJfbXLZWReLRSFQJ/cbof8MB3h/uEw8Zng1ZbyEU0eG rc41Mhk8bTfxjNRjkXDbp0+2xug+eRr2RYhiY2SxH+iy57AbRIu9gkjfL05VztfvsV5dPxt7 +reHf2Vhtu+qCRtCytGQqDvYWGpVZ8U5fHJxFdsJpn66LAe8w+iRGCbppB5TKeHkqWqDb++u sd5ZHzwep/7qcLBeKggi8+a2C3J1J4TpYBwdPgusrGtBPf2EYSTc/0mW5j86g1l8UDN9qXAI FvWbKf22p5SlYUzf5qRLny4ZdDl1mH13lmJV7ZkZGMKnt0IjJ2x0LRgLGhiSm/D4Lh8yc/MX uhj9BB020XbWcMUPpA7S7YaWeIXbnK3NrPU0yk77prFJblfskOwuaxJIwa2mX+cCAQA95As5 2talifo4Kh8OLSvS1gpbMo64LllTzuGbCWuKecH3fpMlZlD7/10z9lBvkSXA7KgadDfN0yHO xGCK8KE9gXXmEVRlbgGDYOJw9FLWHuSZHUvQTkmr4goXrmMIKa9A4BKO3s9vowP4pJ0vp3kz MIBeEwKSvAeZZfgKbIKggKUuQ5gsAqvF360sG3+UuQINBFKbGksBEAC0a9wfjo2P3JyT7Lc+ QlbFVshGbSbazb4ma7QYG5IZZD5vfLBFkePoG6cnrn3WCXp4A43hszAynCwe4eXyAkv4+gPF 3ZSeNE5Wz3zYG+jh2nm2iGCkyaVykfbA+2chor2DKH5tHpuNMBlF+wSJHZKJmlo/sFIktAnV 1NBVg4/cL+9/hIpvl82cl3hYCD7/e7/qRE+w38CpAAzn65FvbODn7xlY3fsJt+cHPBJ4EBM9 KnTwcce+F+72RQMZQEl7vIAwSRmLdgZHN0MFC533l62SVoKjT0eaOOIBrvesmojhWjfwugib Xr+WRF/tGcW77Bxwe2eQLbEVESqWeMORxRxocx7Q7aACoHmf4G4U1Vzx7zUEfNfHjfjZeQVf AURf/MoUelZSW/BmMIfKCg3lRlWAt+Pq2h2UADPVqAZze45beE/c8z8LZsOZiGoRhYL8NSg6 +ziLTdmYLWdtFGAuZhqOtNp5h6tGj21OksBotcaIa5YjbCmmnImIjGlSBkUKvIhq/RXth5b2 gNwaQdu+Yv4AlZVHRsuVywL/skDFL5+We11bDK6MQ5PzvmntRJcgbyoisn1hiV04OV1LpJJM kJn1j8VlBqDQNT/z+BjB0ru/0anv+5uLj7v0ck06rEo4yiXT/ZAcBM76j7V7FaGbkoba6bUU CQ2H5YYBOKpikjCnpwARAQABiQI8BBgBCAAmAhsMFiEE+W0coLX0MYtnSzMK6rA8WL/cR48F Alv9N7IFCQ8Ft+cACgkQ6rA8WL/cR49wpw//W7QrZHKYUWEVHtPLVMlcM1f7MgwnYlIRe/I6 gykwvt87sqxSYu7eHxfX6JZR2M9UYuUYscSR57gxXKu2Uzqaz2KjvEIXJCwCTsuXZjkQ19oL hAPsucw2AcMI6YqPXbZ7hO0Mh8jMeJzD6vDvx3zvunQxGQoZKxr3BvRUyO7NCYbA7N8ccI3E Tmdjj9JTbtue9WaUeGLszFDiITmkASBdsK07y4ylLAJzUGCvYLBU3gx0bBOB2S8SbxHYmQlj ewjovbp+MbT+CoXNxZp+gDRModGyIMdRIotkRiDbgNl0VWIT0SS1GUUlUHKzQ/ZPUvpvk6Gq s/SYBS7rBQNSoXXmJxNW6I6atVNW7JhInC1tkHxBlbpik4FK07J6NHFTx+9ygyCxbxwNA/Le FGkL3kU0VFXR2dNiAVbeueUPF6tU5Bye5ftgpLKOSAbo1g++EKUkc8335/4oYRBMcGEk4xUr NAvzoFPhA2W3KtklruJ9ThrFt9+//NB5ySlVgTwGWMuBJoskEmNOTBv34/UQPUIuE4xSwy6y H+nRQJooiMFo5QCosslJPlwyV63NS9lYXB6n3QWOCP6sFdWACNUCOFv4uk7LQdY9BsCmt2Tk cLuHmoS+fvUesQXnYV2aQi9HciriPIj2gvJ6WjgiaC/PpePil0fzyrfG/JMyHL0qcgmYoj0= Organization: FreeBSD Message-ID: <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> Date: Wed, 22 May 2019 18:50:10 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="BlV7hosPIwYhYCaZHvapg666riVhkmAeN" X-Rspamd-Queue-Id: 9616B8BF48 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.978,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 15:50:22 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --BlV7hosPIwYhYCaZHvapg666riVhkmAeN Content-Type: multipart/mixed; boundary="JQ4hsq8GWofW47oUNQaui45CORKWOjTpL"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: Alexander Motin , Mark Johnston Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Message-ID: <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> In-Reply-To: <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> --JQ4hsq8GWofW47oUNQaui45CORKWOjTpL Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 22.05.2019 18:19, Alexander Motin wrote: >>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So,= >>> this `delay()` looks very wrong. Am I right? >=20 > Why is it wrong? One second pause after synchronous operation to wait it completion? There one more questionable piece of code: 6936 static void 6937 arc_lowmem(void *arg __unused, int howto __unused) 6938 { =2E... 6947 arc_reduce_target_size(to_free); 6948 =09 6949 mutex_enter(&arc_adjust_lock); 6950 arc_adjust_needed =3D B_TRUE; 6951 zthr_wakeup(arc_adjust_zthr); 4587 static void 4588 arc_reduce_target_size(int64_t to_free) 4589 { =2E.. 4612 if (asize > arc_c) { 4613 DTRACE_PROBE2(arc__shrink_adjust, uint64_t, asize, 4614 uint64_t, arc_c); 4615 /* See comment in arc_adjust_cb_check() on why lock+flag */ 4616 mutex_enter(&arc_adjust_lock); 4617 arc_adjust_needed =3D B_TRUE; 4618 mutex_exit(&arc_adjust_lock); 4619 zthr_wakeup(arc_adjust_zthr); 4620 } 4621 } Looks like lock/flag/wakeup sequence (which is now very cheap =E2=80=94 = mutexes are not cheap, and this mutex could become contended in low-memory situation) could be called twice. Looks like `arc_reduce_target_size()` should return boolean value and unconditional signalling in `arc_lowmem()` should become conditional. --=20 // Lev Serebryakov --JQ4hsq8GWofW47oUNQaui45CORKWOjTpL-- --BlV7hosPIwYhYCaZHvapg666riVhkmAeN Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlzlb7JfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R48Euw/8DRFP4xmKsRGd0YSZC8HIxEi2Sk7PvgPe6IH4bOMDyJac85OlNl+ME82J pyLA9smqMktiApB8u0phtI6qciM91fQsmfJiBfEwWCNywXTKp0RsQ6ItimYPLaq4 PLkm8L/ldI5JjJXlGw6lEIJznWsmF4ZwGxjbev3ET+4PNkIJVSySJUG46suVL8SQ noxSpM9FZyYcwAho3NQ+q0MhaBqnYFiTQyK+yKFyNoK6XBbdaSI87VlYjeSmqeao F28qyTCUmOqbqp1vmKEAgqdxjpFGG+fp2/2nn2wqg4AyF61omRST7oSKwByDcBD4 X7z6RcniB4GVaGpGlzCZA48CwsNuYsZiIP1iuBYc876UNFvTJVRn9UuUb2zsMYRS 67Meq84DLWbwm7wACO8CB8RF3DwOQ1d10G0qfKmqzl9hx6sMRnIKKmZIN/HJgpNI 7QZrPpS8VZrYpoW8u0bvIsP9CqpUjFnD1WGyA1HOXeMaDspPlrKH1wF1E9MrpvqT 8xA7OYdKkdAEvia9OszerJz0YLtZTukQxDPPPPigR9twFAr2IKRJ7nzrfojjhVRL p0XPYuBzukhZRs+uecc+Zy+LjnszwcLJclDyE7yk7fvg8EjE1Rl6ux4h8jV7HrXa YRq1cc1hHO2cM3xvdo68IkB/5X4xjkX5C1fEuDZVzubokV6eilw= =wRGm -----END PGP SIGNATURE----- --BlV7hosPIwYhYCaZHvapg666riVhkmAeN-- From owner-freebsd-hackers@freebsd.org Wed May 22 16:07:32 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C32C515B00CE; Wed, 22 May 2019 16:07:32 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yb1-xb29.google.com (mail-yb1-xb29.google.com [IPv6:2607:f8b0:4864:20::b29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 91BA48CD62; Wed, 22 May 2019 16:07:31 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-yb1-xb29.google.com with SMTP id a3so1067585ybr.6; Wed, 22 May 2019 09:07:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=d/oYZi2ewCe/aWOVDsesljddDsXRNafqcPcG1b8qQ0g=; b=uWxXQ2qiSmzURPIOfOlZNM1aP3VJGAidAmjAG9OpNzJoj1Dtxml2SIF9KmWk5sbqbk KG6N+HSRXzRb/oNHCLYZp1n5REfwhaELi49xpzaJfu9msF9rs9YcandK5rLRWl37l6kw dbE/8mH1D62iLhZ6uOticuT7iGU9aV4ik2zn7JxW2E+7GdmGOJZ1InLmKxbCrQyqbtzz rgDGk3pHZyaLCCbhTdC2BqDb2vyVbNmR/RRvIBrFVNhcO58JFvqs7mF2VZkwINgGdaVm 7Iht19Zl2hhh7zz2w0UCC01+klFukfQmc9jYIRdiDd+MoaAHAmRbcllwC0uzmuMisYXN x/5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=d/oYZi2ewCe/aWOVDsesljddDsXRNafqcPcG1b8qQ0g=; b=XamYUAM7ROVoc/ZCBhX3mId4/WmCGJ85E+lkmYxG+sIqXhCfWp5IxP8QN/89/OaCN9 J1d7FhOePM8BnvxoN90jXvZnkmdwtxv7EhnZy9FPhcr56jv42P8O944HJQK5EplMsGJR cP0WrggvoW14zFDf41V5Uzvx+4qQSFBZ7gnH77nFQmOtDNmbKwVN6vlBS6PMJCMjUAGA kYfcXmpphFEObSU3tuOMOrU6YyhhFUDLYpM8X36aS7bYqtIMl/qek4s8/8SipuYlTIHY 57th3Ob1PIz7BQk50B3xecr33jb2439aGl0C6YfF2n1fcsILvRk309Q7ZahBPVQ8R8zK /n1g== X-Gm-Message-State: APjAAAX8K0y7HM8q8nB50EVPv6Tqk86qCy/DtRji/zpDfmfOg0OVYXI8 xQ0v+oIhG/86J+cNZeC0CnucQkL3PoY= X-Google-Smtp-Source: APXvYqxhGfQhFfYs33gUNJw9pt3PaVavnE+SuqznooxPkeQrwKfsyrJtNdmdKBMdcXfz6RJVnI9M7w== X-Received: by 2002:a25:d142:: with SMTP id i63mr4951839ybg.399.1558541250504; Wed, 22 May 2019 09:07:30 -0700 (PDT) Received: from mavoffice.ixsystems.com ([12.189.233.129]) by smtp.gmail.com with ESMTPSA id x5sm6533838ywb.50.2019.05.22.09.07.29 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 09:07:30 -0700 (PDT) Sender: Alexander Motin Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem To: lev@FreeBSD.org, Mark Johnston Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> From: Alexander Motin Openpgp: preference=signencrypt Autocrypt: addr=mav@FreeBSD.org; prefer-encrypt=mutual; keydata= xsBNBFOzxAwBCADkPrax0pI2W/ig0CK9nRJJwsHitAGEZ2HZiFEuti+6/4UVxj81yr4ak/4g 9bKUyC7rMEAp/ZHNhd+MFCPAAcHPvtovnfykqE/vuosCS3wlSLloix2iKVLks0CwbLHGAyne 46lTQW74Xl/33c3W1Z6d8jD9gVFT/xaVzZ0U9xdzOmsYAZaAj4ki0tuxO9F7L+ct9grRe7iP g8t9hai7BL4ee3VRwk2JXnKb7UvBiVITKYWKz1jRvZIrjPokgEcCLOSlv7x/1kjuFnj3xWZU 7HSFFT8J93epBbrSSCsYsppIk2fZH41kaaFXsMQfTPH8wkeM6qwrvOh4HiQM08R+9tThABEB AAHNIUFsZXhhbmRlciBNb3RpbiA8bWF2QEZyZWVCU0Qub3JnPsLAlwQTAQoAQQIbAwULCQgH AwUVCgkICwUWAwIBAAIeAQIXgAIZARYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMKuBQkN McyiAAoJEIMYw5VbqyJ/tuUIAOG3ONOSNYqjK4eTZ1TVh9jdUBAhWk5nhDFnODN49Wj0AbYm 7aIqy8O1hnCDSZG5LttjSAo3UfXJZDKQM0BLb0gpRMBnAYqO6tdolLNqAbPGJBnGoPjsh24y 6KcbDaNnis+lD4GwPXwQM+92wZGhCUFElPV9NciZGVS65TNIgk7X+yEjjhD1MSWKKijZ1r9Z zIt4OzUTxxNOvzdlABZS88nNRdJkatOQJPmFdd1mpP6UzTNCiLUo1pIqOEtJgvVVDYq5WHY6 tciWWYdmZG/tIBexJmv2mV2OLVjXR6ZeKmntVH14H72/wRHJuYHQC+r5SVRcWWayrThsY6jZ Yr4+raTOwE0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6Z AXgDtmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8Flv mI/c40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt 3ytU8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZ R1EdEIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm5 9R8AEQEAAcLAZQQYAQoADwUCU7PEDAIbDAUJBaOagAAKCRCDGMOVW6sif7FRB/4k9y/GaGqU fcJiXdQHRAKHCUvbKMFgeEDHOg33qx+POS2Ah85/PXVa2jYBldCZDmYc+zl48aEMd163a7s3 0gJaB7CYElwxlKUk6c+5gwoYIJuJJzSzW0JzSD5ch7RIRxbfxrKdsiHrUW8AeduZWzlK6VaW RmWILgLmxfLdhEVFWxbr99GSeVFZaZwn6tl/8CvBcgYoARvJvl0V5zS1akQfEISYkwL9EfUI W44EOHranL5qUXkedXBYp6fRsooGrIimfwYxaC8FbXhk3FMgMjDMRiVq4POHo1iGeYETsUrL NM6184E25gPVtX2fb3RhM8Xh6BkwCZ6ZYbQ+AcD4F/cKwsB8BBgBCgAmAhsMFiEE6YzzxOac w80OV51VgxjDlVurIn8FAllgwtgFCQ0xzMwACgkQgxjDlVurIn9OqAf9FAcKWS95wTTbraXA qg/+bQyHgjlMtGCgkmfxLsbUGeqiFgmSIuoDrF7q6sYPs6p00CXXZRuuNZt0lX7O95re8mgz gxm5iJisZpdbHMVepYlw/AxT2wCHwxGCEe64Lm+A9vjlOd+3D3/6fSLwZ9WFCE6p6lQZ1CDg 09xe+JKSgC+KDqmn0tzGKyfSCuhRAq3XkZyxL1hxBaDeP0eeKlzoy7jXodf3wVvXXc0cmpza B5McuRHK4EU6jIioHo30YqPM4AjPHGxV2X1N6/Aayungzj9EXNZtKCxs6dsTvjniWa5VkZ9F 4SOdSbxEen1DZRYpeWnd7GVmO86n+5USkKCXPg== Message-ID: <2a50e192-e672-7c87-178b-afd509a765df@FreeBSD.org> Date: Wed, 22 May 2019 12:07:29 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 91BA48CD62 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=uWxXQ2qi; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::b29 as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-6.07 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-2.97)[ip: (-9.28), ipnet: 2607:f8b0::/32(-3.26), asn: 15169(-2.27), country: US(-0.06)]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[9.2.b.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.89)[-0.888,0]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 16:07:33 -0000 On 22.05.2019 11:50, Lev Serebryakov wrote: > On 22.05.2019 18:19, Alexander Motin wrote: > >>>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, >>>> this `delay()` looks very wrong. Am I right? >> >> Why is it wrong? > One second pause after synchronous operation to wait it completion? No. To rate-throttle them. This gives UMA a second to get back into minimally steady state after we ripped all caches from it. As I have told, we do not want to drain caches constantly in a tight loop, we want more or less steady state. > There one more questionable piece of code: > > 6936 static void > 6937 arc_lowmem(void *arg __unused, int howto __unused) > 6938 { > .... > 6947 arc_reduce_target_size(to_free); > 6948 > 6949 mutex_enter(&arc_adjust_lock); > 6950 arc_adjust_needed = B_TRUE; > 6951 zthr_wakeup(arc_adjust_zthr); > > > 4587 static void > 4588 arc_reduce_target_size(int64_t to_free) > 4589 { > ... > 4612 if (asize > arc_c) { > 4613 DTRACE_PROBE2(arc__shrink_adjust, uint64_t, asize, > 4614 uint64_t, arc_c); > 4615 /* See comment in arc_adjust_cb_check() on why > lock+flag */ > 4616 mutex_enter(&arc_adjust_lock); > 4617 arc_adjust_needed = B_TRUE; > 4618 mutex_exit(&arc_adjust_lock); > 4619 zthr_wakeup(arc_adjust_zthr); > 4620 } > 4621 } > > Looks like lock/flag/wakeup sequence (which is now very cheap — mutexes > are not cheap, and this mutex could become contended in low-memory > situation) could be called twice. > > Looks like `arc_reduce_target_size()` should return boolean value and > unconditional signalling in `arc_lowmem()` should become conditional. I don't think this is not a hot path to bother about it. arc_lowmem() calls should be very rare. -- Alexander Motin From owner-freebsd-hackers@freebsd.org Wed May 22 16:09:04 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F2E2E15B0149; Wed, 22 May 2019 16:09:03 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BA1498CDF8; Wed, 22 May 2019 16:09:02 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1hTTnS-0004CW-60; Wed, 22 May 2019 19:08:54 +0300 Date: Wed, 22 May 2019 19:08:54 +0300 From: Slawa Olhovchenkov To: Lev Serebryakov Cc: Alexander Motin , Mark Johnston , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190522160854.GD47119@zxy.spb.ru> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: BA1498CDF8 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [3.66 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.94)[0.941,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; NEURAL_SPAM_MEDIUM(0.91)[0.910,0]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[zxy.spb.ru]; NEURAL_SPAM_LONG(0.92)[0.918,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 16:09:04 -0000 On Wed, May 22, 2019 at 06:50:10PM +0300, Lev Serebryakov wrote: > On 22.05.2019 18:19, Alexander Motin wrote: > > >>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > >>> this `delay()` looks very wrong. Am I right? > > > > Why is it wrong? > One second pause after synchronous operation to wait it completion? > > There one more questionable piece of code: > > 6936 static void > 6937 arc_lowmem(void *arg __unused, int howto __unused) > 6938 { > .... > 6947 arc_reduce_target_size(to_free); > 6948 > 6949 mutex_enter(&arc_adjust_lock); > 6950 arc_adjust_needed = B_TRUE; > 6951 zthr_wakeup(arc_adjust_zthr); > > > 4587 static void > 4588 arc_reduce_target_size(int64_t to_free) > 4589 { > ... > 4612 if (asize > arc_c) { > 4613 DTRACE_PROBE2(arc__shrink_adjust, uint64_t, asize, > 4614 uint64_t, arc_c); > 4615 /* See comment in arc_adjust_cb_check() on why > lock+flag */ > 4616 mutex_enter(&arc_adjust_lock); > 4617 arc_adjust_needed = B_TRUE; > 4618 mutex_exit(&arc_adjust_lock); > 4619 zthr_wakeup(arc_adjust_zthr); > 4620 } > 4621 } > > Looks like lock/flag/wakeup sequence (which is now very cheap — mutexes > are not cheap, and this mutex could become contended in low-memory > situation) could be called twice. > > Looks like `arc_reduce_target_size()` should return boolean value and > unconditional signalling in `arc_lowmem()` should become conditional. No, for FreeBSD case arc_lowmem() don't be conditional from this condition in this maner and need completly differnt set of ananlys factors and do different... From owner-freebsd-hackers@freebsd.org Wed May 22 16:19:48 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4182D15B0669; Wed, 22 May 2019 16:19:48 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 997258D597; Wed, 22 May 2019 16:19:47 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1hTTxx-0004GA-HN; Wed, 22 May 2019 19:19:45 +0300 Date: Wed, 22 May 2019 19:19:45 +0300 From: Slawa Olhovchenkov To: Alexander Motin Cc: lev@FreeBSD.org, Mark Johnston , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190522161945.GE47119@zxy.spb.ru> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> <2a50e192-e672-7c87-178b-afd509a765df@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <2a50e192-e672-7c87-178b-afd509a765df@FreeBSD.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: 997258D597 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [3.62 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.906,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; NEURAL_SPAM_MEDIUM(0.90)[0.901,0]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[cached: zxy.spb.ru]; NEURAL_SPAM_LONG(0.92)[0.917,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 16:19:48 -0000 On Wed, May 22, 2019 at 12:07:29PM -0400, Alexander Motin wrote: > On 22.05.2019 11:50, Lev Serebryakov wrote: > > On 22.05.2019 18:19, Alexander Motin wrote: > > > >>>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > >>>> this `delay()` looks very wrong. Am I right? > >> > >> Why is it wrong? > > One second pause after synchronous operation to wait it completion? > > No. To rate-throttle them. This gives UMA a second to get back into > minimally steady state after we ripped all caches from it. As I have > told, we do not want to drain caches constantly in a tight loop, we want > more or less steady state. And also (posible) additionaly delay arc_get_data_impl(). This is incorrectly throttling implementation. From owner-freebsd-hackers@freebsd.org Wed May 22 16:49:52 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 08D4315B11A6; Wed, 22 May 2019 16:49:52 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-xc35.google.com (mail-yw1-xc35.google.com [IPv6:2607:f8b0:4864:20::c35]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F3A648EA55; Wed, 22 May 2019 16:49:50 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-yw1-xc35.google.com with SMTP id n76so1116955ywd.1; Wed, 22 May 2019 09:49:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=1fYSSI57UnaVLVFb2M21KmnSc5lRfRNY8i1I2cQphrI=; b=njutdjjmVuvrvOWS7qWEGQ4WBs/RriVREAS4HItRnL2GZnmSx4p2lGfmpPYCq7AX8z 45wjVhc/EgzsAoWZ509vGx58KjY+s/kyNph8YkKnv8YGYaEGT+kvA8M0A5uYbwh6Z5j1 jVDGMCbbd1k8BNmSApcfqVQYUlivoblDqdMIZWrMJQgC4JxezaRMz6i+IwKWzxkp8B+3 59lr2VKk1Ma7BNHMEEQF08+2HYMbv938+EoIhUeLbxpdrBMGLZhkDAfnfNo1qpuasmha AxzZXuUY9I+kaOojSyyuEHxbPw29F9J4UHt6KTekj0gvUHBnNhN42tS1KdlsLCAWBZpa bt1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=1fYSSI57UnaVLVFb2M21KmnSc5lRfRNY8i1I2cQphrI=; b=V6Aj7iXll4joJLb7P2xYX7nqOSX2Frfb7ccbwCGExlQ25UBbapKO9GnwqelHYMaBWo RSoxTx0gUDSTqoQbsc/KSUc3kOdrOTSdL7hKXIBN1ZOki2X+kw5Y3soCHfKKkWS6UwSe e8AwUbdFdbncMAtfNoB/QTk3ZFBdSAGyP2aUfqiIA4egjbF68ux/8jwuU247rf/QOqc3 lMNloz5W/oSW6Br/we5ozEWY8d4UC0Xr/OcloXUMT7tIWEV6XDVAynSpgul5mqSd8pF1 O1LuQt+wbVN1rQmCQW+uq7ZGmo0MiZ3UZHJxo6LsQvt45TvX5j1bWWRWR5PCCSRkhlh9 gmcA== X-Gm-Message-State: APjAAAXeOf0eLYUfeA41tekcVup4P1a6exDPgB2Eyvmm5ZfpFuOLj0za 42GHtQUYFq8gtk6rOeE4UvkyCjYNXPY= X-Google-Smtp-Source: APXvYqxhd9qdA0HDm5apkO3lD+7LErQJYkg/To/jHUawLCX48VGV00ARNtqxBEdkqVJn0gYkcoDnCQ== X-Received: by 2002:a0d:d4cf:: with SMTP id w198mr44346861ywd.24.1558543789848; Wed, 22 May 2019 09:49:49 -0700 (PDT) Received: from mavoffice.ixsystems.com ([12.189.233.129]) by smtp.gmail.com with ESMTPSA id j187sm6361843ywj.32.2019.05.22.09.49.49 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 09:49:49 -0700 (PDT) Sender: Alexander Motin Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem To: Slawa Olhovchenkov Cc: lev@FreeBSD.org, Mark Johnston , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> <2a50e192-e672-7c87-178b-afd509a765df@FreeBSD.org> <20190522161945.GE47119@zxy.spb.ru> From: Alexander Motin Openpgp: preference=signencrypt Autocrypt: addr=mav@FreeBSD.org; prefer-encrypt=mutual; keydata= xsBNBFOzxAwBCADkPrax0pI2W/ig0CK9nRJJwsHitAGEZ2HZiFEuti+6/4UVxj81yr4ak/4g 9bKUyC7rMEAp/ZHNhd+MFCPAAcHPvtovnfykqE/vuosCS3wlSLloix2iKVLks0CwbLHGAyne 46lTQW74Xl/33c3W1Z6d8jD9gVFT/xaVzZ0U9xdzOmsYAZaAj4ki0tuxO9F7L+ct9grRe7iP g8t9hai7BL4ee3VRwk2JXnKb7UvBiVITKYWKz1jRvZIrjPokgEcCLOSlv7x/1kjuFnj3xWZU 7HSFFT8J93epBbrSSCsYsppIk2fZH41kaaFXsMQfTPH8wkeM6qwrvOh4HiQM08R+9tThABEB AAHNIUFsZXhhbmRlciBNb3RpbiA8bWF2QEZyZWVCU0Qub3JnPsLAlwQTAQoAQQIbAwULCQgH AwUVCgkICwUWAwIBAAIeAQIXgAIZARYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMKuBQkN McyiAAoJEIMYw5VbqyJ/tuUIAOG3ONOSNYqjK4eTZ1TVh9jdUBAhWk5nhDFnODN49Wj0AbYm 7aIqy8O1hnCDSZG5LttjSAo3UfXJZDKQM0BLb0gpRMBnAYqO6tdolLNqAbPGJBnGoPjsh24y 6KcbDaNnis+lD4GwPXwQM+92wZGhCUFElPV9NciZGVS65TNIgk7X+yEjjhD1MSWKKijZ1r9Z zIt4OzUTxxNOvzdlABZS88nNRdJkatOQJPmFdd1mpP6UzTNCiLUo1pIqOEtJgvVVDYq5WHY6 tciWWYdmZG/tIBexJmv2mV2OLVjXR6ZeKmntVH14H72/wRHJuYHQC+r5SVRcWWayrThsY6jZ Yr4+raTOwE0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6Z AXgDtmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8Flv mI/c40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt 3ytU8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZ R1EdEIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm5 9R8AEQEAAcLAZQQYAQoADwUCU7PEDAIbDAUJBaOagAAKCRCDGMOVW6sif7FRB/4k9y/GaGqU fcJiXdQHRAKHCUvbKMFgeEDHOg33qx+POS2Ah85/PXVa2jYBldCZDmYc+zl48aEMd163a7s3 0gJaB7CYElwxlKUk6c+5gwoYIJuJJzSzW0JzSD5ch7RIRxbfxrKdsiHrUW8AeduZWzlK6VaW RmWILgLmxfLdhEVFWxbr99GSeVFZaZwn6tl/8CvBcgYoARvJvl0V5zS1akQfEISYkwL9EfUI W44EOHranL5qUXkedXBYp6fRsooGrIimfwYxaC8FbXhk3FMgMjDMRiVq4POHo1iGeYETsUrL NM6184E25gPVtX2fb3RhM8Xh6BkwCZ6ZYbQ+AcD4F/cKwsB8BBgBCgAmAhsMFiEE6YzzxOac w80OV51VgxjDlVurIn8FAllgwtgFCQ0xzMwACgkQgxjDlVurIn9OqAf9FAcKWS95wTTbraXA qg/+bQyHgjlMtGCgkmfxLsbUGeqiFgmSIuoDrF7q6sYPs6p00CXXZRuuNZt0lX7O95re8mgz gxm5iJisZpdbHMVepYlw/AxT2wCHwxGCEe64Lm+A9vjlOd+3D3/6fSLwZ9WFCE6p6lQZ1CDg 09xe+JKSgC+KDqmn0tzGKyfSCuhRAq3XkZyxL1hxBaDeP0eeKlzoy7jXodf3wVvXXc0cmpza B5McuRHK4EU6jIioHo30YqPM4AjPHGxV2X1N6/Aayungzj9EXNZtKCxs6dsTvjniWa5VkZ9F 4SOdSbxEen1DZRYpeWnd7GVmO86n+5USkKCXPg== Message-ID: <5ea6d9bc-4fd3-d8e6-adf4-513b4edc71e3@FreeBSD.org> Date: Wed, 22 May 2019 12:49:48 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20190522161945.GE47119@zxy.spb.ru> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: F3A648EA55 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=njutdjjm; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::c35 as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-6.01 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[5.3.c.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.92)[-0.917,0]; IP_SCORE(-2.88)[ip: (-8.81), ipnet: 2607:f8b0::/32(-3.26), asn: 15169(-2.27), country: US(-0.06)]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 16:49:52 -0000 On 22.05.2019 12:19, Slawa Olhovchenkov wrote: > On Wed, May 22, 2019 at 12:07:29PM -0400, Alexander Motin wrote: > >> On 22.05.2019 11:50, Lev Serebryakov wrote: >>> On 22.05.2019 18:19, Alexander Motin wrote: >>> >>>>>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, >>>>>> this `delay()` looks very wrong. Am I right? >>>> >>>> Why is it wrong? >>> One second pause after synchronous operation to wait it completion? >> >> No. To rate-throttle them. This gives UMA a second to get back into >> minimally steady state after we ripped all caches from it. As I have >> told, we do not want to drain caches constantly in a tight loop, we want >> more or less steady state. > > And also (posible) additionaly delay arc_get_data_impl(). arc_get_data_impl() depends on arc_adjust_zthr, not on arc_reap_zthr, so it should not get blocked by this delay. That was the motivation for the threads splitting in the last rewrite. > This is incorrectly throttling implementation. I am not particularly defending ZFS doing its own reclamation, I'd more trust pagedaemon, but so far I haven't seen any memory pressure issues after I committed this. -- Alexander Motin From owner-freebsd-hackers@freebsd.org Wed May 22 17:38:39 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 645FE15B2E8B; Wed, 22 May 2019 17:38:39 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EDAC790784; Wed, 22 May 2019 17:38:37 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1hTVCF-0004ew-I2; Wed, 22 May 2019 20:38:35 +0300 Date: Wed, 22 May 2019 20:38:35 +0300 From: Slawa Olhovchenkov To: Alexander Motin Cc: lev@FreeBSD.org, Mark Johnston , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: Commit r345200 (new ARC reclamation threads) looks suspicious to me - second potential problem Message-ID: <20190522173835.GB2161@zxy.spb.ru> References: <369cb1e9-f36a-a558-6941-23b9b811825a@FreeBSD.org> <20190520164202.GA2130@spy> <28c7430b-fb7c-6472-5c1b-fa3ff63a9e73@FreeBSD.org> <94d051a3-3427-7a5b-efe7-169cff2265d3@FreeBSD.org> <2a50e192-e672-7c87-178b-afd509a765df@FreeBSD.org> <20190522161945.GE47119@zxy.spb.ru> <5ea6d9bc-4fd3-d8e6-adf4-513b4edc71e3@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5ea6d9bc-4fd3-d8e6-adf4-513b4edc71e3@FreeBSD.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-Rspamd-Queue-Id: EDAC790784 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [3.68 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.95)[0.954,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[zxy.spb.ru]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; NEURAL_SPAM_MEDIUM(0.91)[0.913,0]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[cached: zxy.spb.ru]; NEURAL_SPAM_LONG(0.92)[0.922,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5495, ipnet:195.70.192.0/19, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 May 2019 17:38:39 -0000 On Wed, May 22, 2019 at 12:49:48PM -0400, Alexander Motin wrote: > On 22.05.2019 12:19, Slawa Olhovchenkov wrote: > > On Wed, May 22, 2019 at 12:07:29PM -0400, Alexander Motin wrote: > > > >> On 22.05.2019 11:50, Lev Serebryakov wrote: > >>> On 22.05.2019 18:19, Alexander Motin wrote: > >>> > >>>>>> But looks like `arc_kmem_reap_soon()` is synchronous on FreeBSD! So, > >>>>>> this `delay()` looks very wrong. Am I right? > >>>> > >>>> Why is it wrong? > >>> One second pause after synchronous operation to wait it completion? > >> > >> No. To rate-throttle them. This gives UMA a second to get back into > >> minimally steady state after we ripped all caches from it. As I have > >> told, we do not want to drain caches constantly in a tight loop, we want > >> more or less steady state. > > > > And also (posible) additionaly delay arc_get_data_impl(). > > arc_get_data_impl() depends on arc_adjust_zthr, not on arc_reap_zthr, so > it should not get blocked by this delay. That was the motivation for > the threads splitting in the last rewrite. next case: system under memory pressure, no memory in UMA cache. arc_get_data_impl() see arc_size >= arc_c+overflow (arc_is_overflowing()) and wait arc_adjust_zthr. arc_adjust_zthr in arc_adjust_cb() do arc_adjust() and evict small amount, arc_size still over arc_c (I mean this is posible: arc_c drop by arc_lowmem or arc_szie rised by paralel arc_get_data_impl()), cv_broadcast() don't called. next round is wait work arc_reap_zthr activated by arc_lowmem or timeout: arc_kmem_reap_soon(); dealy(); arc_reduce_target_size() (under memory pressure (arc_c >> arc_shrink_shift) > arc_available_memory() is true) arc_reduce_target_size() re-activate arc_adjust_zthr (asize > arc_c is true). delay() in this path unnecessary and slowly arc_get_data_impl(). > > This is incorrectly throttling implementation. > > I am not particularly defending ZFS doing its own reclamation, I'd more > trust pagedaemon, but so far I haven't seen any memory pressure issues > after I committed this. > > -- > Alexander Motin From owner-freebsd-hackers@freebsd.org Thu May 23 02:50:02 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B2C2159592F; Thu, 23 May 2019 02:50:02 +0000 (UTC) (envelope-from grog@lemis.com) Received: from www.lemis.com (www.lemis.com [208.86.226.86]) by mx1.freebsd.org (Postfix) with ESMTP id CE7E276EA1; Thu, 23 May 2019 02:49:59 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (lemis.com [192.109.197.81]) by www.lemis.com (Postfix) with ESMTP id 8F00D1B72839; Thu, 23 May 2019 02:49:52 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 4E166264D3F; Thu, 23 May 2019 12:49:51 +1000 (AEST) Date: Thu, 23 May 2019 12:49:51 +1000 From: Greg 'groggy' Lehey To: "Rodney W. Grimes" Cc: freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org, Alexandru Goia Subject: Re: newbie question Message-ID: <20190523024951.GA91834@eureka.lemis.com> References: <20190521234006.GS16860@eureka.lemis.com> <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zYM0uCDKw75PZbzx" Content-Disposition: inline In-Reply-To: <201905220410.x4M4AcOZ082596@gndrsh.dnsmgr.net> Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: CE7E276EA1 X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 208.86.226.86 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-8.69 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; TO_DN_SOME(0.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mx1.lemis.com]; NEURAL_HAM_SHORT(-0.97)[-0.966,0]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:36236, ipnet:208.86.226.0/24, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; IP_SCORE(-3.71)[ip: (-9.74), ipnet: 208.86.226.0/24(-4.87), asn: 36236(-3.89), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 May 2019 02:50:02 -0000 --zYM0uCDKw75PZbzx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tuesday, 21 May 2019 at 21:10:38 -0700, Rodney W. Grimes wrote: >> On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: >>> greetings. how can do i get attuned in a logical manner with the >>> *bsd/freebsd kernel source code ? thank you very much ! >> >> Clearly you know how to get it (otherwise >> https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your >> friend). To understand it better, I'd suggest reading "The Design and >> Implementation of the FreeBSD Operating System" by Kirk McKusick and >> George Neville-Neil (Addison-Wesley). >> >> Understanding the code requires some work. People will happily answer >> detail questions, but you'll be responsible for finding out the >> overall structure yourself. > > During a somewhat recent session of working with a not new, > but also not seasoned developer, they noted a great deal of > confusion when I was reading through and explaining code > to them when I would actually read "pcb" on screen as > "Process Control Block" when verbalizing it. They could not > see what I had just read to them. Heh. I ran into something like this decades ago, using an "operating system" that will be nameless. The program to copy files was... IEBCPY. Most people pronounced it "Eye Ee Bee Copy". And some had their card decks returned after hours of queueing to discover that some completion code (13?) saying "NOT FOUND: IEBCOPY". Clearly, we decided, pronouncing names for what they mean is *bad*. =46rom then on I spelt names out, or at least tried to pronounce them the way they're spelt ("Eye Ee Bee Cpy"). It confuse[ds] people, but it avoided some misunderstandings. Greg -- When replying to this message, please copy the original recipients. If you don't, I may ignore the reply or reply to the original recipients. For more information, see http://www.lemis.com/questions.html Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --zYM0uCDKw75PZbzx Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAlzmCk8ACgkQIubykFB6QiO42wCeJkSBbzghOCigyXniDwzbKdm4 mYYAn2bIx9F34J42jqnhNjxPiubKu4vx =IRnC -----END PGP SIGNATURE----- --zYM0uCDKw75PZbzx-- From owner-freebsd-hackers@freebsd.org Thu May 23 05:05:39 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B4C5E1598A69; Thu, 23 May 2019 05:05:39 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4D5A782DF8; Thu, 23 May 2019 05:05:38 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id x4N55Yek088441; Wed, 22 May 2019 22:05:34 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id x4N55YRl088440; Wed, 22 May 2019 22:05:34 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> Subject: Re: newbie question In-Reply-To: <20190523024951.GA91834@eureka.lemis.com> To: "Greg 'groggy' Lehey" Date: Wed, 22 May 2019 22:05:34 -0700 (PDT) CC: "Rodney W. Grimes" , freebsd-hackers@FreeBSD.org, freebsd-questions@FreeBSD.org, Alexandru Goia X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4D5A782DF8 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.97 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.18)[0.185,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: gndrsh.dnsmgr.net]; NEURAL_SPAM_LONG(0.16)[0.155,0]; NEURAL_SPAM_MEDIUM(0.70)[0.696,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.05)[ip: (0.16), ipnet: 69.59.192.0/19(0.08), asn: 13868(0.05), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 May 2019 05:05:40 -0000 > On Tuesday, 21 May 2019 at 21:10:38 -0700, Rodney W. Grimes wrote: > >> On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: > >>> greetings. how can do i get attuned in a logical manner with the > >>> *bsd/freebsd kernel source code ? thank you very much ! > >> > >> Clearly you know how to get it (otherwise > >> https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your > >> friend). To understand it better, I'd suggest reading "The Design and > >> Implementation of the FreeBSD Operating System" by Kirk McKusick and > >> George Neville-Neil (Addison-Wesley). > >> > >> Understanding the code requires some work. People will happily answer > >> detail questions, but you'll be responsible for finding out the > >> overall structure yourself. > > > > During a somewhat recent session of working with a not new, > > but also not seasoned developer, they noted a great deal of > > confusion when I was reading through and explaining code > > to them when I would actually read "pcb" on screen as > > "Process Control Block" when verbalizing it. They could not > > see what I had just read to them. > > Heh. I ran into something like this decades ago, using an "operating > system" that will be nameless. > > The program to copy files was... IEBCPY. Most people pronounced it > "Eye Ee Bee Copy". And some had their card decks returned after hours > of queueing to discover that some completion code (13?) saying "NOT > FOUND: IEBCOPY". I think your copy of OS/360 is borked, or is this one of the names they mangled in MVS? I have a vague memory of JCL that had those types of issues. > Clearly, we decided, pronouncing names for what they mean is *bad*. > From then on I spelt names out, or at least tried to pronounce them > the way they're spelt ("Eye Ee Bee Cpy"). It confuse[ds] people, but > it avoided some misunderstandings. Pronouncing spellings is bad, yes, but that is not what I was doing. I was pronouncing the proper full names, usually as defined either in "The design and implementation book" or in the code comments themselves. I was not saying Pee See Bee for pcb, I was saying process control block. > > Greg -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-hackers@freebsd.org Thu May 23 09:02:05 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43AEA15A32B5; Thu, 23 May 2019 09:02:05 +0000 (UTC) (envelope-from bch@online.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.130]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AF3758A4B6; Thu, 23 May 2019 09:02:03 +0000 (UTC) (envelope-from bch@online.de) Received: from x230.onfire.org ([87.150.247.247]) by mrelayeu.kundenserver.de (mreue011 [212.227.15.167]) with ESMTPSA (Nemesis) id 1MLzSD-1hCLDM3jF3-00Hy1l; Thu, 23 May 2019 11:01:53 +0200 From: Christian Barthel To: Alexandru Goia Cc: freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org Subject: Re: newbie question References: Date: Thu, 23 May 2019 11:01:53 +0200 In-Reply-To: (Alexandru Goia's message of "Wed, 22 May 2019 01:36:24 +0300") Message-ID: <877eahbl32.fsf@x230.onfire.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K1:pFZwSJB7LfcFjmBFp6h/tvj2WD7uxoVyq3Epa4sCJ56JOlXmHH7 o3iJZcqzYvKUqVrds8k3CysgkzjwBBjixzSbLlq7ht9EGI9yMMEoxgs035mRpCyE60YHwQG i4bY7wEJhLcxgta7029nMeTC+OSmjgKtsHHSqILOgAefQSSrjx6AZph/i5Lm+HJPvIyCfuO hQVoRvXZdvqkzWr/ekYhw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:pkDP13vafo8=:ckGqIylJ3nWyMTKv9qG5e7 ghjOGAUJyFkGuw1XHZkgca7E4JarDXW5xohFxBjj/GhvkiwM7oajZDwr9LlEHD/tFi6SnRnlv 6ix3Xc0PyxRQwH19+EmZiCRSKntbGhpbwUllMHOB5FJM0YONmp1Fv7zbFmeHmjjgSAdFiQjmi p6r8nJIw+6Lv82/q9R6U/+y6eKbq3HeLd4d51UQ40nvhWBNWytLIQyq4DAp4hob0tXE2StGPN eJcshHVDj8Od/ModPPOZ+HKqBxLTwxDr1SXDtLK6FM/c7u2bB1RzeHmYXuzidGw5jrSppUTYm fmZwKizF8E22bm/WTuQRAMOfA8BsvzC5ATbi6Ql1ZD9yxAivuTNm6QG1CPErg/tMJCZRi2Z6O Yh7dWfvJEOdNjjsq+zyMbQ4V2H2x2FaHnMCfUGAKAwJoJr97wJ3GNhKyvaeFeYESF+dySCknw j44j+oT47K4v2KsiXaTvnRCBtM6WNCZXO5tGBvOVUsiZwTcPSYhanEKz2cO+K82Kt4iZXGrhm rJrXfapomz2vjqH4HGOMoZAIaQSWZjqV+CWFK85Le4B3TXS9aBQf1wBTQyi0dd3fiA7p70zg6 fUOBOz1ufRsPXufmaRqLSNwC5oLFXd1GZLZflj2KqJI+8OcDq7rNW8jtcSEk/rr24u3dBEdN7 i4P2Zyg807wVINH59O4gdh6rNyeKwgez11JE0IAnrjINW0nJdx/JizzFsBRgNLpOvGjBmOvqZ G2gi7W0tqEA1BDTXNCYdgbgbMGRNY67YJHrTMcLjZbpS7Z6GsNSGQAF1uGY= X-Rspamd-Queue-Id: AF3758A4B6 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of bch@online.de designates 212.227.126.130 as permitted sender) smtp.mailfrom=bch@online.de X-Spamd-Result: default: False [3.32 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[130.126.227.212.rep.mailspike.net : 127.0.0.17]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.126.128/25]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[online.de]; NEURAL_SPAM_MEDIUM(0.97)[0.975,0]; NEURAL_SPAM_SHORT(0.84)[0.840,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mx01.emig.kundenserver.de,mx00.emig.kundenserver.de]; NEURAL_SPAM_LONG(0.94)[0.935,0]; RCVD_IN_DNSWL_NONE(0.00)[130.126.227.212.list.dnswl.org : 127.0.5.0]; IP_SCORE(0.88)[ip: (3.33), ipnet: 212.227.0.0/16(-1.50), asn: 8560(2.59), country: DE(-0.01)]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[247.247.150.87.zen.spamhaus.org : 127.0.0.10] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 May 2019 09:02:05 -0000 Alexandru Goia writes: > greetings. how can do i get attuned in a logical manner with the > *bsd/freebsd kernel source code ? thank you very much ! As others already suggested, there is a very good book on the FreeBSD operating system by M.K. McKusick, G.V. Neville-Neil and R.N.M Watson [1]. At [2], one of the FreeBSD developers (R.N.M. Watson) wrote a public mail where and how to start with the FreeBSD source code (it's from 2005, but I guess the overall "idea" how to start is still valid). I personally found DTrace also a very helpful tool to discover and observe the activity from the kernel (beside other standard tools like ktrace(1) and so on). The Linux kernel community has a "kernel-newbies" mailinglist. I am not aware that something similar exists for FreeBSD but I personally would appreciate that for FreeBSD as well. Anyone aware of something like that? [1] http://www.informit.com/store/design-and-implementation-of-the-freebsd-operating-9780321968975?ranMID=24808 [2] http://www.watson.org/~robert/freebsd/reading/ -- Christian Barthel From owner-freebsd-hackers@freebsd.org Thu May 23 14:36:57 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B725D15AC92C; Thu, 23 May 2019 14:36:57 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.139]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 804E06F400; Thu, 23 May 2019 14:36:56 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id Topvh3xVUo7SQTopxhtCU9; Thu, 23 May 2019 08:36:54 -0600 X-Authority-Analysis: v=2.3 cv=Go88BX9C c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=IkcTkHD0fZMA:10 a=E5NmQfObTbMA:10 a=iKhvJSA4AAAA:8 a=6I5d2MoRAAAA:8 a=YxBL1-UpAAAA:8 a=_ElVKmj7WNYsd84NAmkA:9 a=QEXdDO2ut3YA:10 a=odh9cflL3HIXMm4fY7Wr:22 a=IjZwj45LgO3ly-622nXo:22 a=Ia-lj3WSrqcvXOmTRaiG:22 Received: from android-9b917f0ce39da6e6.esitwifi.local (S0106788a207e2972.gv.shawcable.net [70.66.154.233]) by spqr.komquats.com (Postfix) with ESMTPSA id EB0F58F4; Thu, 23 May 2019 07:36:50 -0700 (PDT) Date: Thu, 23 May 2019 07:36:27 -0700 User-Agent: K-9 Mail for Android In-Reply-To: <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> References: <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: newbie question To: freebsd-hackers@freebsd.org, "Rodney W. Grimes" , Greg 'groggy' Lehey CC: freebsd-hackers@FreeBSD.org, freebsd-questions@FreeBSD.org, Alexandru Goia From: Cy Schubert Message-ID: <9BCEA8E2-DCF6-42A0-8131-4B007C016A01@cschubert.com> X-CMAE-Envelope: MS4wfCmzyvl4c2ks6g4Law7aR9quxda7FcXe8pLWQU/Ndo6ijjLxzu0nBikS0XQ6p3pv9iOh2X6JnKuMklT4Zndm8DX8wBctFBUGPb6NI4esLiEV0wfg1gJQ ArbIbzuXQXz/DdNnxL+8uxPSIJygUZhBvxjDSOZ995cdvzPPhpmzRikZIi02uWSGvlh4WDujmaA70Ck7i8Zc1eUai/HYATS7zNZfxovuc154WOpqJrIAPT97 CtxOyTiyWwArWpkcqV0SfFDs1UPIEXBltiqau1JDdq10HaIyYHJ5Q5jumVWwkKQF4NiPCRMPCG2d8dR/+HnZALxeEFzqkqGkbXHyy3d4H5Y= X-Rspamd-Queue-Id: 804E06F400 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-5.54 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(-2.38)[ip: (-6.05), ipnet: 64.59.128.0/20(-3.25), asn: 6327(-2.50), country: CA(-0.09)]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: spqr.komquats.com]; NEURAL_HAM_SHORT(-0.95)[-0.952,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[139.136.59.64.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.zen.spamhaus.org : 127.0.0.11, 233.154.66.70.zen.spamhaus.org : 127.0.0.11] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 May 2019 14:36:58 -0000 On May 22, 2019 10:05:34 PM PDT, "Rodney W=2E Grimes" wrote: >> On Tuesday, 21 May 2019 at 21:10:38 -0700, Rodney W=2E Grimes wrote: >> >> On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: >> >>> greetings=2E how can do i get attuned in a logical manner with the >> >>> *bsd/freebsd kernel source code ? thank you very much ! >> >> >> >> Clearly you know how to get it (otherwise >> >> https://www=2Efreebsd=2Eorg/doc/en_US=2EISO8859-1/books/handbook/ is >your >> >> friend)=2E To understand it better, I'd suggest reading "The Design >and >> >> Implementation of the FreeBSD Operating System" by Kirk McKusick >and >> >> George Neville-Neil (Addison-Wesley)=2E >> >> >> >> Understanding the code requires some work=2E People will happily >answer >> >> detail questions, but you'll be responsible for finding out the >> >> overall structure yourself=2E >> > >> > During a somewhat recent session of working with a not new, >> > but also not seasoned developer, they noted a great deal of >> > confusion when I was reading through and explaining code >> > to them when I would actually read "pcb" on screen as >> > "Process Control Block" when verbalizing it=2E They could not >> > see what I had just read to them=2E >>=20 >> Heh=2E I ran into something like this decades ago, using an "operating >> system" that will be nameless=2E >>=20 >> The program to copy files was=2E=2E=2E IEBCPY=2E Most people pronounce= d it >> "Eye Ee Bee Copy"=2E And some had their card decks returned after >hours >> of queueing to discover that some completion code (13?) saying "NOT >> FOUND: IEBCOPY"=2E > >I think your copy of OS/360 is borked, or is this one of the names >they mangled in MVS? I have a vague memory of JCL that had those >types of issues=2E > >> Clearly, we decided, pronouncing names for what they mean is *bad*=2E >> From then on I spelt names out, or at least tried to pronounce them >> the way they're spelt ("Eye Ee Bee Cpy")=2E It confuse[ds] people, but >> it avoided some misunderstandings=2E > >Pronouncing spellings is bad, yes, but that is not what I was >doing=2E I was pronouncing the proper full names, usually as >defined either in "The design and implementation book" or in >the code comments themselves=2E > >I was not saying Pee See Bee for pcb, I was saying process >control block=2E > >>=20 >> Greg Yeah, there was no IEBCPY=2E Only IEBCOPY, though many sites wrote their o= wn due to ancient versions of the program were incapable of reblocking data= sets and borking the DSCB (akin to an inode) in the process=2E --=20 Pardon the typos and autocorrect, small keyboard in use=2E Cheers, Cy Schubert FreeBSD UNIX: Web: http://www=2EFreeBSD=2Eorg The need of the many outweighs the greed of the few=2E From owner-freebsd-hackers@freebsd.org Thu May 23 18:02:40 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2383D15B1388; Thu, 23 May 2019 18:02:40 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mout.kundenserver.de (mout.kundenserver.de [217.72.192.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CD23077CD2; Thu, 23 May 2019 18:02:38 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r56.edvax.de ([178.12.37.203]) by mrelayeu.kundenserver.de (mreue109 [212.227.15.183]) with ESMTPA (Nemesis) id 1MV6G0-1h1mfM0ez0-00S6c9; Thu, 23 May 2019 19:36:42 +0200 Date: Thu, 23 May 2019 19:36:40 +0200 From: Polytropon To: "Rodney W. Grimes" Cc: "Greg 'groggy' Lehey" , freebsd-hackers@freebsd.org, freebsd-questions@freebsd.org, Alexandru Goia Subject: Re: newbie question Message-Id: <20190523193640.1209f0a0.freebsd@edvax.de> In-Reply-To: <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> References: <20190523024951.GA91834@eureka.lemis.com> <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> Reply-To: Polytropon Organization: EDVAX X-Mailer: Sylpheed 3.1.1 (GTK+ 2.24.5; i386-portbld-freebsd8.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:1ASdjbrL4oHVxwY+3z6tgw3RrxoMinGA6mzsP9TS7hM5P8BMaeg Ie1Km4f7tcbSNvxhdUcKhs4WIXQMv8jqT2GKJlmtxHyvnvIPoBtOLVEwzZnzzyYC9Ri84tg XMsKEykvc2ZRIsP/zCNOsD4E+jWQsTsuiSRTcB06jwsWJf1zfizx1Lznim0YPOmYRcv2n8k goj4Tul+VWYnkGOm0o6Gw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:P7T4olmtshc=:uHpDCoIL1OsRD4nCmbiTQU +i8f6HvEazifgOWm0QZEUMyZAgcT3waeHInHksj23MggJC1U4SjOjDaNtDN6deeGIALF4ltdl JLDUcNGlUOiBkbfZ0XkElEc5Foh4DQMxI7tRw+leZPWOUDV8Ce95NW4Wy5mNf7/OlJH18WYuK TJux/OvkwtlprjXRmFASRGEZuKgOV+y3SpaBckiR2F9OJwUfd1fP/zaxd8CpyNjhN5WrlYjPr hHIi727UR7JWoAz1KtidggnRln77QaI5LA+FXH8Cq5cBmBWd6o8pGxV7IRMB8/ycojAlwd3dJ rftSUard076dLqIEXMiGmovxq07U/3W6lDCiXlUkKrSpDWBegsmXIGYnf6QKSkcuVB5Tar/Ib 4ii5CdfhOLdkE27Tx831v2nr4utc3PXAOUJGOYWNsAEXM0UfqluDh4eDhfwK5PvbnhrJH5JkJ 8fKZnjBFh08IWYHnWvFOxelraAg1RuCRXlZf6i0aIwV/7qz8JqhLXSEvFxmvr1JtmERyG3/4k BhauXHhuJkE9bl8L1BCfHbt52mHdLiBaT6KQPbx102YezpP4BdqVwXDeNStbEllKtTRe6dfM/ AfjWuaHuoy5XU3MXqVBprLWF2HmMxk9166LWtDgbNiMxQa8Z//Qzrz23J+iEB3Uu8MuTAzAwM 7DyebcP+prxn+RRApMt3j9x2gsccrXYw2PPAINmXz9YfaC9UE+WC4FHpq17KDTPQ0uEzbtIjh YqTszk2PTvTBp6k8nhpcfn5zux/cIRE1wqqB7H/nFYcjC2O8Opa+0prk0lg= X-Rspamd-Queue-Id: CD23077CD2 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [5.62 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[freebsd@edvax.de]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; RCPT_COUNT_FIVE(0.00)[5]; HAS_ORG_HEADER(0.00)[]; MX_GOOD(-0.01)[mx00.schlund.de,mx01.schlund.de]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:8560, ipnet:217.72.192.0/20, country:DE]; MIME_TRACE(0.00)[0:+]; RECEIVED_SPAMHAUS_PBL(0.00)[203.37.12.178.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.94)[0.940,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[edvax.de]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.97)[0.968,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(1.00)[1.000,0]; RCVD_IN_DNSWL_NONE(0.00)[74.192.72.217.list.dnswl.org : 127.0.5.0]; MID_CONTAINS_FROM(1.00)[]; R_SPF_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(0.32)[ip: (-1.11), ipnet: 217.72.192.0/20(0.15), asn: 8560(2.59), country: DE(-0.01)] X-Mailman-Approved-At: Thu, 23 May 2019 18:17:41 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 May 2019 18:02:40 -0000 On Wed, 22 May 2019 22:05:34 -0700 (PDT), Rodney W. Grimes wrote: > Pronouncing spellings is bad, yes, but that is not what I was > doing. I was pronouncing the proper full names, usually as > defined either in "The design and implementation book" or in > the code comments themselves. number inclood esteeday-lib eytsh number inclood esteeday-args eytsh int main, int arg-see, tshar times arg-vee brackets brace print-eff paren two up The number is percent dee backslash en, two up, fourtytwo return exit success brace cee cee minus oh myprog cee and and dot slash myprog Of course it'll sound much worse when read in mixed German ("tschar mal arg-vau Klammern")... ;-) > I was not saying Pee See Bee for pcb, I was saying process > control block. Every time? :-) -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-hackers@freebsd.org Fri May 24 12:56:04 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8A25015AAFC7 for ; Fri, 24 May 2019 12:56:04 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-no.shaw.ca (smtp-out-no.shaw.ca [64.59.134.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7B3628D04D; Fri, 24 May 2019 12:56:03 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id U9jlhyqb6sAGkU9jmhAxKd; Fri, 24 May 2019 06:55:55 -0600 X-Authority-Analysis: v=2.3 cv=WeVylHpX c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=kj9zAlcOel0A:10 a=E5NmQfObTbMA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=P9pur6p6fbwt-xMtvUIA:9 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTPS id 1FCB26E0; Fri, 24 May 2019 05:55:52 -0700 (PDT) Received: from slippy.cwsent.com (localhost [127.0.0.1]) by slippy.cwsent.com (8.15.2/8.15.2) with ESMTP id x4OCtp8c037675; Fri, 24 May 2019 05:55:51 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Received: from slippy (cy@localhost) by slippy.cwsent.com (8.15.2/8.15.2/Submit) with ESMTP id x4OCtpGV037672; Fri, 24 May 2019 05:55:51 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Message-Id: <201905241255.x4OCtpGV037672@slippy.cwsent.com> X-Authentication-Warning: slippy.cwsent.com: cy owned process doing -bs X-Mailer: exmh version 2.8.0 04/21/2012 with nmh-1.7.1 Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: freebsd-hackers@freebsd.org cc: rmacklem@freebsd.org Subject: DTrace instrumentation build error Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 24 May 2019 05:55:51 -0700 X-CMAE-Envelope: MS4wfJ8PTyy9pSaC8V/PsZ8sbANqIu1n+TKL5w/yY+i6zPMkTN4PeUf28uB7gbouLYVJ/87MR+AueskVBfdlPQeGEMELbXhVZ5qRpFT1cJdtmYO8taIlusTB wiaC2+VCcNCp1Z+bqC2hJkvSr1qf19gaE2q8RgZQlAi79iiXYhfgbIY+MQXiMqRQP+SXGp3vkgY2K7bNmTiAmMR3cFf1ggMYukOA4c1p7XcHItauSxlSj8xp X-Rspamd-Queue-Id: 7B3628D04D X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-5.24 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLYTO_EQ_FROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[cached: spqr.komquats.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.98)[-0.985,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_SPF_NA(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.zen.spamhaus.org : 127.0.0.11]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-2.55)[ip: (-6.90), ipnet: 64.59.128.0/20(-3.25), asn: 6327(-2.50), country: CA(-0.09)]; RCVD_IN_DNSWL_LOW(-0.10)[9.134.59.64.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 May 2019 12:56:04 -0000 Hi, I'm helping rmacklem@ with instrumentation of mountd with USDT probes.It builds fine on amd64 however fails on i386 ===> sbin/sconfig (all) ld: error: cannot open /usr/lib32/dtrace/drti.o: No such file or directory dtrace: failed to link script /home/cy/stable12/usr.sbin/mountd/mountd_d t.d: fai led to link mountd_dt.o: ld exited with status 1 --- mountd_dt.o --- *** [mountd_dt.o] Error code 1 make[6]: stopped in /home/cy/stable12/usr.sbin/mountd 1 error make[6]: stopped in /home/cy/stable12/usr.sbin/mountd --- all_subdir_usr.sbin/mountd --- *** [all_subdir_usr.sbin/mountd] Error code 2 A couple of interesting things here: 1. /usr/lib32/dtrace/drti.o doesn't exist in the universe12a and universe12b jails. 2. Why would buildworld (tinderbox in this case) link against an object outside of /usr/obj? I can look at this tonight to cobble up a patch for review to our build infrastructure to address #1 tonight. -- Cheers, Cy Schubert FreeBSD UNIX: Web: http://www.FreeBSD.org The need of the many outweighs the greed of the few. From owner-freebsd-hackers@freebsd.org Fri May 24 14:56:55 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB07C15AD958 for ; Fri, 24 May 2019 14:56:55 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-it1-x144.google.com (mail-it1-x144.google.com [IPv6:2607:f8b0:4864:20::144]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 349F46A4D2; Fri, 24 May 2019 14:56:54 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-it1-x144.google.com with SMTP id i63so14224874ita.3; Fri, 24 May 2019 07:56:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=9lJpYgKna2qnxPr4pBhKi8+4huZyhxkK0RhcAESCVLI=; b=GQ0uJvQDMcxwX2AW4FO5a1BrrU4igrlaifpBx8Xsc6EZixinORBC+cING8Qgz3GwRm kOHMDstJUQatu0InQdZgWq67RMoouSKuCuFITHMEMWs65FftQ/pitSP/qTdt8s2aXFJM 688PtbRvLZGRS4m2k0JOjTUCKJeic3M3HOAnDkVq+RAeTqxuacWCI1YybhpkfEkca9p2 7fUDg0BCTkgQhfN/K51Domz44X4mq6yHPbXzQ1Yd2TQMRDrVbYWQY2fOOQFl/v02Jizn GKyxIAgCDWiojuzvsULdlNXXb5BviYN2Ti3u/bZ36IkQJmVaKqGYv6LOPVBwgD/3FX8V WAcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=9lJpYgKna2qnxPr4pBhKi8+4huZyhxkK0RhcAESCVLI=; b=fLRGSpyVpNkt5BmMXswOGzLTl9TzA8LC5Ij8Lqxd42ka5BYpkrmlHEQOza9I7EIDbp itUBD2WvJkQYq3AmZ/1l7GhCxm53j2JmnMI039UpdgoIHZxhxyoPZlVrsLJWA4cUV//h lF6bOlfVoztmTkirThc1yJKEsa1Mg7Ex0bqawwP3TE9Xfc5f7syJzyNl0LccC1KVRnUk eVeD2638oB6H+p1cYNyHgt2Wr7vN3vwGN0Z/BJ/aMtupcliTJemGGsWGHIwNP5GAG4g6 D1n6cP96SZj8qI14zC02ZDnymGH+ChmkbNN8lZXrvfsm74/UZLtetESUHnRtpYsmxVj1 WaQQ== X-Gm-Message-State: APjAAAU11lQ9bdYx6rxS28wKtG6MZ6NbdoxcfqxEwyRb0hggVTyar1HB ne+hF2q0KaDvtotelACRIcB3uM7z X-Google-Smtp-Source: APXvYqzf9q5t36Bq/cr1Kynf8ZZGIRMadtIBVAB/ZiOkJyIqtd/PvQ2zrkDEWJEeEaZNcHiTSRJ2/Q== X-Received: by 2002:a24:2442:: with SMTP id f63mr16887136ita.8.1558709813538; Fri, 24 May 2019 07:56:53 -0700 (PDT) Received: from raichu (toroon0560w-lp140-01-69-159-36-31.dsl.bell.ca. [69.159.36.31]) by smtp.gmail.com with ESMTPSA id h11sm962050ioq.5.2019.05.24.07.56.52 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 24 May 2019 07:56:52 -0700 (PDT) Sender: Mark Johnston Date: Fri, 24 May 2019 10:56:50 -0400 From: Mark Johnston To: Cy Schubert Cc: freebsd-hackers@freebsd.org, rmacklem@freebsd.org Subject: Re: DTrace instrumentation build error Message-ID: <20190524145650.GB72269@raichu> References: <201905241255.x4OCtpGV037672@slippy.cwsent.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201905241255.x4OCtpGV037672@slippy.cwsent.com> User-Agent: Mutt/1.11.4 (2019-03-13) X-Rspamd-Queue-Id: 349F46A4D2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=GQ0uJvQD; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::144 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-3.40 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[4.4.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.92)[-0.916,0]; IP_SCORE(-0.78)[ip: (1.76), ipnet: 2607:f8b0::/32(-3.29), asn: 15169(-2.29), country: US(-0.06)]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 May 2019 14:56:56 -0000 On Fri, May 24, 2019 at 05:55:51AM -0700, Cy Schubert wrote: > Hi, > > I'm helping rmacklem@ with instrumentation of mountd with USDT > probes.It builds fine on amd64 however fails on i386 > > ===> sbin/sconfig (all) > ld: error: cannot open /usr/lib32/dtrace/drti.o: No such file or > directory > dtrace: failed to link script /home/cy/stable12/usr.sbin/mountd/mountd_d > t.d: fai > led to link mountd_dt.o: ld exited with status 1 > --- mountd_dt.o --- > *** [mountd_dt.o] Error code 1 > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > 1 error > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > --- all_subdir_usr.sbin/mountd --- > *** [all_subdir_usr.sbin/mountd] Error code 2 > > A couple of interesting things here: > > 1. /usr/lib32/dtrace/drti.o doesn't exist in the universe12a and > universe12b jails. /usr/lib32 is entirely missing in those jails. > 2. Why would buildworld (tinderbox in this case) link against an object > outside of /usr/obj? It is simply dtrace(1)'s default behaviour. I believe this patch is sufficient to fix the problem for both native and 32-bit compat builds. I think it is a bit too hacky though: we should probably only add -x libdir during a world build. A standalone make -C usr.sbin/mountd should use the host drti.o. What's the right predicate for that? diff --git a/share/mk/bsd.dep.mk b/share/mk/bsd.dep.mk index 5d0aac91f1b4..ce008fdba324 100644 --- a/share/mk/bsd.dep.mk +++ b/share/mk/bsd.dep.mk @@ -147,6 +147,9 @@ OBJS_DEPEND_GUESS.${_YC:R}.o+= ${_YC} # DTrace probe definitions .if ${SRCS:M*.d} CFLAGS+= -I${.OBJDIR} +.if exists(${OBJTOP}/cddl/lib/drti/drti.o) +DTRACEFLAGS+= -x libdir=${OBJTOP}/cddl/lib/drti +.endif .endif .for _DSRC in ${SRCS:M*.d:N*/*} .for _D in ${_DSRC:R} From owner-freebsd-hackers@freebsd.org Fri May 24 17:43:40 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4CAB015B133B for ; Fri, 24 May 2019 17:43:40 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lj1-f175.google.com (mail-lj1-f175.google.com [209.85.208.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BD6170F61; Fri, 24 May 2019 17:43:39 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lj1-f175.google.com with SMTP id a10so9389498ljf.6; Fri, 24 May 2019 10:43:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=YzBa+D3AkTY/1tTmZ9SQaM36dfD/XUcfCLomXRlrjQA=; b=poo6DBTF1dZXHosMBQj7UAsarvkbUu7G/3AdHIHfSEv07FLi59++vEg2OaW+ysW0nm sSNXBy06+PFvHjmTMFcxXNBi4RlMzrGgjuHERtt3pXu/ztrYx3Cjg4Lz+yM9AF5H+7Kq D6loSqZaNkHwK70FjV6/peBlRgiwRL614WzZDNT4wOB8iF3QUKoqmSATsxQZ4xk0l7u1 9tcslDmXTzAWuqaHJqjSAesy3kHfEz453YXKqfLGkgcxxBkRI6n7bhPtOgVZ33E1wd0P c4Qo0MkIzBmzhBnyl8v2iMvdx6nAwO516y665Ls0VZVKIaUSZESxezYC5u+0c9YO0v4l CdpA== X-Gm-Message-State: APjAAAWbJsEGPGN/Hi0Et48D0MvprBE6oX2aCC6pYzvSOBthVfhnFXjq jczHAduxi7J4S2mWMExaNcIazqwj X-Google-Smtp-Source: APXvYqxzn+klaPdnnu9ESsL2dy2jQ/GNPaNTZazAp2bdsIKhuxtFFX43VE+4Qgw+RG52H2YLyRjACQ== X-Received: by 2002:a2e:85d1:: with SMTP id h17mr37377172ljj.1.1558719812092; Fri, 24 May 2019 10:43:32 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id i12sm719530lfo.67.2019.05.24.10.43.30 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 May 2019 10:43:31 -0700 (PDT) Subject: completely broken IICBUS_IVAR_NOSTOP [Was: Custom I2C and RTC chip drivers: where is iccbus_get_nostop() defined?] From: Andriy Gapon To: Ian Lepore , FreeBSD Hackers , Konstantin Belousov References: <1521383420.99081.87.camel@freebsd.org> <0b0dee4b-e958-e25c-72d9-1ca296495802@FreeBSD.org> Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABzR5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz7CwZQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryM7BTQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAcLBfAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: Date: Fri, 24 May 2019 20:43:29 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <0b0dee4b-e958-e25c-72d9-1ca296495802@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4BD6170F61 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of agapon@gmail.com designates 209.85.208.175 as permitted sender) smtp.mailfrom=agapon@gmail.com X-Spamd-Result: default: False [-4.12 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-1.26)[ip: (-0.55), ipnet: 209.85.128.0/17(-3.42), asn: 15169(-2.29), country: US(-0.06)]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.85)[-0.846,0]; RCVD_IN_DNSWL_NONE(0.00)[175.208.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; SUBJECT_HAS_QUESTION(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 May 2019 17:43:40 -0000 A lot of time has passed but the problem is still there. The "nostop" thing is completely broken. I have recently thought about this issue a little bit again and now I think that IVARs are not suitable for nostop property. Simply put, there is no bus (in the "newbus" sense) where such an IVAR could be configured for a child. I see two possible solutions. 1. Make "nostop" a property of an iicbus instance. We can keep the current getter and setter, but they won't be IVAR accessors any more. Also, target devices for the calls to the functions would need to be adjusted. 2. Since this property hasn't found a wider use and remains specific to the intel drm driver, we could just subclass iicbb and put the quirk into the subclassed driver. On 23/03/2018 11:56, Andriy Gapon wrote: > On 18/03/2018 16:30, Ian Lepore wrote: >> Now for the bad news:  don't use it.  It doesn't work.  It's 100% a bug >> in the code that maybe kinda-sorta seemed to work for whoever added it, >> because accidentally the right garbage was on the stack in the local >> nostop var.  The generic transfer code doesn't check that the accessor >> failed so it ends up using stack garbage for nostop.  The reason >> there's g'teed to be no such ivar is because the code is asking the >> wrong device, and it doesn't even have a handle to the right child >> device to get the info it wants. > > > Oh, indeed. > I think that there never was an intention to make "nostop" a property of an i2c > slave, a child of an iicbus device. I think that instead it was supposed to be > a property of the iicbus's parent device, an actual i2c adapter driver. > I guess that the reason that "nostop" became an ivar in iicbus was an incorrect > understanding of how a "bit-banger" device (something implementing iicbb_if), > iicbb device and iicbus device are connected. I think that I was among the > reviewers and I probably had a bit of confusion back then. > > > It seems that the only place where iicbus_get_nostop() is used is > iicbus_transfer_gen(). iicbus_transfer_gen is used in several i2c drivers as an > iicbus_transfer method. it's also used in iicbb, thinly wrapped by > iicbb_transfer(). > So, iicbus_get_nostop() actually translates to a call to BUS_READ_IVAR(parent, > device, 1, &v) where I already substituted one for IICBUS_IVAR_NOSTOP. > Here we can see that while the accessor functions lok quite nice they get > expanded to generic calls without much context. So, whether that > BUS_READ_IVAR() call succeeds and what value it gets depends on whether the > parent bus defines an ivar with a value of 1 and what value that ivar might have > for the driver device. Many buses define at least a couple of ivars. > So, a return value of iicbus_get_nostop() could be consistent for a particular > driver while still being arbitrary. But it can be a piece of stack garbage too, > just as you said. > > The only place where iicbus_set_nostop() is used is intel_iicbb_attach(). > In that case the ivar is "set" on a wrong device at all (the bit-banger, not iicbb). > > > This definitely needs to be fixed / reworked. > Perhaps nostop should become a new interface in iicbus_if and iicbb_if... > -- Andriy Gapon From owner-freebsd-hackers@freebsd.org Sat May 25 05:01:17 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9FE41598E4E for ; Sat, 25 May 2019 05:01:16 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-no.shaw.ca (smtp-out-no.shaw.ca [64.59.134.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CD6348E97E; Sat, 25 May 2019 05:01:15 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id UOnvh6eAzsAGkUOnwhDedK; Fri, 24 May 2019 23:01:13 -0600 X-Authority-Analysis: v=2.3 cv=WeVylHpX c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=kj9zAlcOel0A:10 a=E5NmQfObTbMA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=s36clbOmzjy2MfsT8kEA:9 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTPS id 727681048; Fri, 24 May 2019 22:01:10 -0700 (PDT) Received: from slippy.cwsent.com (localhost [127.0.0.1]) by slippy.cwsent.com (8.15.2/8.15.2) with ESMTP id x4P51AJU015829; Fri, 24 May 2019 22:01:10 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Received: from slippy (cy@localhost) by slippy.cwsent.com (8.15.2/8.15.2/Submit) with ESMTP id x4P51A1A015826; Fri, 24 May 2019 22:01:10 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Message-Id: <201905250501.x4P51A1A015826@slippy.cwsent.com> X-Authentication-Warning: slippy.cwsent.com: cy owned process doing -bs X-Mailer: exmh version 2.8.0 04/21/2012 with nmh-1.7.1 Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: freebsd-hackers@freebsd.org cc: rmacklem@freebsd.org Subject: Re: DTrace instrumentation build error In-Reply-To: Message from Cy Schubert of "Fri, 24 May 2019 05:55:51 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 24 May 2019 22:01:10 -0700 X-CMAE-Envelope: MS4wfKTxnQlVoMCVZfnCWGWh+Gk4fmJV8GDMuT1MT/wedI7yjEESpz7EITyrIteg9qXM4m3JCljHkA5L+AIruqjjnmYkVvH5+gzJ/n6mc98Bl46ReJd8CjwY HxD7TCwr5J8wfQi9P6sjrSo1AQgd7pqzVgzST4Oi377t9Dt+sYroHsJcIWP3vBQkpGTnIKNU3ACF0uGduYI5YHnzCLCbf3eQXqr4NoLKoUPgFAyEgJWyx1MW X-Rspamd-Queue-Id: CD6348E97E X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-5.21 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLYTO_EQ_FROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[cached: spqr.komquats.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.96)[-0.958,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-2.54)[ip: (-6.86), ipnet: 64.59.128.0/20(-3.25), asn: 6327(-2.50), country: CA(-0.09)]; RCVD_IN_DNSWL_LOW(-0.10)[9.134.59.64.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 05:01:17 -0000 Cy Schubert writes: > Hi, > > I'm helping rmacklem@ with instrumentation of mountd with USDT > probes.It builds fine on amd64 however fails on i386 > > ===> sbin/sconfig (all) > ld: error: cannot open /usr/lib32/dtrace/drti.o: No such file or > directory > dtrace: failed to link script /home/cy/stable12/usr.sbin/mountd/mountd_d > t.d: fai > led to link mountd_dt.o: ld exited with status 1 > --- mountd_dt.o --- > *** [mountd_dt.o] Error code 1 > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > 1 error > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > --- all_subdir_usr.sbin/mountd --- > *** [all_subdir_usr.sbin/mountd] Error code 2 > > A couple of interesting things here: I found a bit of time to investigate this tonight. > > 1. /usr/lib32/dtrace/drti.o doesn't exist in the universe12a and > universe12b jails. > > 2. Why would buildworld (tinderbox in this case) link against an object > outside of /usr/obj? > > I can look at this tonight to cobble up a patch for review to our build > infrastructure to address #1 tonight. Speaking of #2, we can add additional link paths to dtrace(1) using -L. However it probably makes sense for dtrace(1) to support --sysroot as other toolchain tools do. -- Cheers, Cy Schubert FreeBSD UNIX: Web: http://www.FreeBSD.org The need of the many outweighs the greed of the few. From owner-freebsd-hackers@freebsd.org Sat May 25 05:22:31 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9FAAC159F3D3; Sat, 25 May 2019 05:22:31 +0000 (UTC) (envelope-from grog@lemis.com) Received: from www.lemis.com (www.lemis.com [208.86.226.86]) by mx1.freebsd.org (Postfix) with ESMTP id B51A08FBAA; Sat, 25 May 2019 05:22:30 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (lemis.com [192.109.197.81]) by www.lemis.com (Postfix) with ESMTP id 0CA731B72839; Sat, 25 May 2019 05:22:29 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id C4BB8264D3F; Sat, 25 May 2019 15:22:27 +1000 (AEST) Date: Sat, 25 May 2019 15:22:27 +1000 From: Greg 'groggy' Lehey To: "Rodney W. Grimes" Cc: freebsd-hackers@FreeBSD.org, freebsd-questions@FreeBSD.org, Alexandru Goia Subject: Re: newbie question Message-ID: <20190525052227.GC46943@eureka.lemis.com> References: <20190523024951.GA91834@eureka.lemis.com> <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mvpLiMfbWzRoNl4x" Content-Disposition: inline In-Reply-To: <201905230505.x4N55YRl088440@gndrsh.dnsmgr.net> Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: B51A08FBAA X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 208.86.226.86 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-8.70 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; TO_DN_SOME(0.00)[]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx1.lemis.com]; NEURAL_HAM_SHORT(-0.97)[-0.967,0]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:36236, ipnet:208.86.226.0/24, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; IP_SCORE(-3.72)[ip: (-9.77), ipnet: 208.86.226.0/24(-4.89), asn: 36236(-3.88), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 05:22:31 -0000 --mvpLiMfbWzRoNl4x Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 22 May 2019 at 22:05:34 -0700, Rodney W. Grimes wrote: >> On Tuesday, 21 May 2019 at 21:10:38 -0700, Rodney W. Grimes wrote: >>>> On Wednesday, 22 May 2019 at 1:36:24 +0300, Alexandru Goia wrote: >>>>> greetings. how can do i get attuned in a logical manner with the >>>>> *bsd/freebsd kernel source code ? thank you very much ! >>>> >>>> Clearly you know how to get it (otherwise >>>> https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ is your >>>> friend). To understand it better, I'd suggest reading "The Design and >>>> Implementation of the FreeBSD Operating System" by Kirk McKusick and >>>> George Neville-Neil (Addison-Wesley). >>>> >>>> Understanding the code requires some work. People will happily answer >>>> detail questions, but you'll be responsible for finding out the >>>> overall structure yourself. >>> >>> During a somewhat recent session of working with a not new, >>> but also not seasoned developer, they noted a great deal of >>> confusion when I was reading through and explaining code >>> to them when I would actually read "pcb" on screen as >>> "Process Control Block" when verbalizing it. They could not >>> see what I had just read to them. >> >> Heh. I ran into something like this decades ago, using an "operating >> system" that will be nameless. >> >> The program to copy files was... IEBCPY. Most people pronounced it >> "Eye Ee Bee Copy". And some had their card decks returned after hours >> of queueing to discover that some completion code (13?) saying "NOT >> FOUND: IEBCOPY". > > I think your copy of OS/360 is borked, or is this one of the names > they mangled in MVS? I have a vague memory of JCL that had those > types of issues. Yes, this was MVS. I'm pretty sure that they didn't deliberately make things worse than they were. >> Clearly, we decided, pronouncing names for what they mean is *bad*. >> From then on I spelt names out, or at least tried to pronounce them >> the way they're spelt ("Eye Ee Bee Cpy"). It confuse[ds] people, but >> it avoided some misunderstandings. > > Pronouncing spellings is bad, yes, but that is not what I was > doing. I was pronouncing the proper full names, usually as > defined either in "The design and implementation book" or in > the code comments themselves. Yes, but the approach is similar. -- When replying to this message, please copy the original recipients. If you don't, I may ignore the reply or reply to the original recipients. For more information, see http://www.lemis.com/questions.html Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --mvpLiMfbWzRoNl4x Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAlzo0RMACgkQIubykFB6QiOklQCcC47sGiSU5Plrl06RZOetml2K xZ0AoJzEbIol0XfC+2dHwkILcHkjv4Vl =BVkL -----END PGP SIGNATURE----- --mvpLiMfbWzRoNl4x-- From owner-freebsd-hackers@freebsd.org Sat May 25 19:42:51 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5319515B498D for ; Sat, 25 May 2019 19:42:51 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell1.rawbw.com (shell1.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 2B52E869B7 for ; Sat, 25 May 2019 19:42:44 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from yv.noip.me (c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236]) (authenticated bits=0) by shell1.rawbw.com (8.15.1/8.15.1) with ESMTPSA id x4PJgUjW071099 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Sat, 25 May 2019 12:42:38 -0700 (PDT) (envelope-from yuri@rawbw.com) X-Authentication-Warning: shell1.rawbw.com: Host c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236] claimed to be yv.noip.me To: Freebsd hackers list From: Yuri Subject: What is the portable 128-bit floating point type? Message-ID: Date: Sat, 25 May 2019 12:42:26 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 2B52E869B7 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of yuri@rawbw.com designates 198.144.192.42 as permitted sender) smtp.mailfrom=yuri@rawbw.com X-Spamd-Result: default: False [-4.95 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:198.144.192.32/27]; HAS_XAW(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[mx.rawbw.net]; NEURAL_HAM_SHORT(-0.95)[-0.951,0]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[236.169.180.67.zen.spamhaus.org : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:7961, ipnet:198.144.192.0/19, country:US]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[rawbw.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[42.192.144.198.list.dnswl.org : 127.0.10.0]; IP_SCORE(-2.79)[ip: (-5.59), ipnet: 198.144.192.0/19(-4.62), asn: 7961(-3.69), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 19:42:51 -0000 'long double' is 12 bytes on i386 and 16 bytes on amd64. There is a gcc-specific  __float128 type: https://stackoverflow.com/questions/13516476/long-double-gcc-specific-and-float128 Yuri From owner-freebsd-hackers@freebsd.org Sat May 25 20:04:48 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB7D915B514B for ; Sat, 25 May 2019 20:04:47 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F23978748A for ; Sat, 25 May 2019 20:04:46 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x4PK4c52004137 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 25 May 2019 23:04:41 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x4PK4c52004137 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x4PK4cS7004136; Sat, 25 May 2019 23:04:38 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 25 May 2019 23:04:38 +0300 From: Konstantin Belousov To: Yuri Cc: Freebsd hackers list Subject: Re: What is the portable 128-bit floating point type? Message-ID: <20190525200437.GV2748@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.11.4 (2019-03-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 20:04:48 -0000 On Sat, May 25, 2019 at 12:42:26PM -0700, Yuri wrote: > 'long double' is 12 bytes on i386 and 16 bytes on amd64. > > There is a gcc-specific  __float128 type: > https://stackoverflow.com/questions/13516476/long-double-gcc-specific-and-float128 > Neither i386 nor amd64 have hardware-supported 128 bit floating point type. long double is defined by both i386 and amd64 Unix ABI as 80 bits (10 bytes) representation as defined by IEEEE FP standard and supported by x87 FPU (not-SSE). The difference in size is due to the different natural alignment between 32 and 64 bit ISA. The x86_64 psABI has interesting note that Android (non-Unix) ABI defines 128bit representation for long double. Operations on it must be implemented in software. From owner-freebsd-hackers@freebsd.org Sat May 25 20:50:28 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4DAA215B5E1A for ; Sat, 25 May 2019 20:50:28 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell1.rawbw.com (shell1.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id CF8FD88A1A for ; Sat, 25 May 2019 20:50:27 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from yv.noip.me (c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236]) (authenticated bits=0) by shell1.rawbw.com (8.15.1/8.15.1) with ESMTPSA id x4PKoPbo082191 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Sat, 25 May 2019 13:50:26 -0700 (PDT) (envelope-from yuri@rawbw.com) X-Authentication-Warning: shell1.rawbw.com: Host c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236] claimed to be yv.noip.me Subject: Re: What is the portable 128-bit floating point type? To: Konstantin Belousov Cc: Freebsd hackers list References: <20190525200437.GV2748@kib.kiev.ua> From: Yuri Message-ID: Date: Sat, 25 May 2019 13:50:24 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <20190525200437.GV2748@kib.kiev.ua> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: CF8FD88A1A X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-7.00 / 15.00]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.996,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 20:50:28 -0000 On 2019-05-25 13:04, Konstantin Belousov wrote: > Neither i386 nor amd64 have hardware-supported 128 bit floating point > type. long double is defined by both i386 and amd64 Unix ABI as 80 bits > (10 bytes) representation as defined by IEEEE FP standard and supported > by x87 FPU (not-SSE). The difference in size is due to the different > natural alignment between 32 and 64 bit ISA. So it looks like there is no true quad-precision float available. Based on this conversation https://github.com/bluescarni/mppp/issues/186 FreeBSD used to support __float128. Why was it removed? Yuri From owner-freebsd-hackers@freebsd.org Sat May 25 21:03:20 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7F55715B6535 for ; Sat, 25 May 2019 21:03:20 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 943C6896F4 for ; Sat, 25 May 2019 21:03:19 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x4PL3CIg030847 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 26 May 2019 00:03:15 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x4PL3CIg030847 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x4PL3C8s030846; Sun, 26 May 2019 00:03:12 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 26 May 2019 00:03:11 +0300 From: Konstantin Belousov To: Yuri Cc: Freebsd hackers list Subject: Re: What is the portable 128-bit floating point type? Message-ID: <20190525210311.GW2748@kib.kiev.ua> References: <20190525200437.GV2748@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.4 (2019-03-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 21:03:20 -0000 On Sat, May 25, 2019 at 01:50:24PM -0700, Yuri wrote: > On 2019-05-25 13:04, Konstantin Belousov wrote: > > Neither i386 nor amd64 have hardware-supported 128 bit floating point > > type. long double is defined by both i386 and amd64 Unix ABI as 80 bits > > (10 bytes) representation as defined by IEEEE FP standard and supported > > by x87 FPU (not-SSE). The difference in size is due to the different > > natural alignment between 32 and 64 bit ISA. > > > So it looks like there is no true quad-precision float available. > > > Based on this conversation https://github.com/bluescarni/mppp/issues/186 > FreeBSD used to support __float128. Why was it removed? No idea, it seems to be clang-specific. gcc 8.3 does accept the type. On the other hand, I have no idea if any support is required from libgcc (probably it is), and we almost certainly do not have it in the base library. From owner-freebsd-hackers@freebsd.org Sat May 25 21:31:02 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 483CE15B6C12 for ; Sat, 25 May 2019 21:31:02 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DA2F48A00C; Sat, 25 May 2019 21:31:01 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 686D415988; Sat, 25 May 2019 21:31:01 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from [IPv6:2001:470:7a58::d4d0:df7c:8e17:8c8f] (unknown [IPv6:2001:470:7a58:0:d4d0:df7c:8e17:8c8f]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id D053C3D856; Sat, 25 May 2019 23:30:58 +0200 (CEST) From: Dimitry Andric Message-Id: <3E0ACABC-D17B-45AD-9810-06ADA52F597A@FreeBSD.org> Content-Type: multipart/signed; boundary="Apple-Mail=_76C08A40-D0CB-4F7E-8593-DEE4D48C7C96"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: What is the portable 128-bit floating point type? Date: Sat, 25 May 2019 23:30:58 +0200 In-Reply-To: <20190525210311.GW2748@kib.kiev.ua> Cc: Yuri , Freebsd hackers list To: Konstantin Belousov References: <20190525200437.GV2748@kib.kiev.ua> <20190525210311.GW2748@kib.kiev.ua> X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: DA2F48A00C X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-1.00)[-0.995,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 21:31:02 -0000 --Apple-Mail=_76C08A40-D0CB-4F7E-8593-DEE4D48C7C96 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii On 25 May 2019, at 23:03, Konstantin Belousov wrote: > > On Sat, May 25, 2019 at 01:50:24PM -0700, Yuri wrote: >> On 2019-05-25 13:04, Konstantin Belousov wrote: >>> Neither i386 nor amd64 have hardware-supported 128 bit floating point >>> type. long double is defined by both i386 and amd64 Unix ABI as 80 bits >>> (10 bytes) representation as defined by IEEEE FP standard and supported >>> by x87 FPU (not-SSE). The difference in size is due to the different >>> natural alignment between 32 and 64 bit ISA. >> >> >> So it looks like there is no true quad-precision float available. >> >> >> Based on this conversation https://github.com/bluescarni/mppp/issues/186 >> FreeBSD used to support __float128. Why was it removed? > No idea, it seems to be clang-specific. gcc 8.3 does accept the type. Gcc appears to support __float128 since ~2007, roughly from gcc 4.3 onwards: https://gcc.gnu.org/onlinedocs/gcc-4.3.6/gcc/Floating-Types.html There it says "__float128 is supported on x86_64 and ia64 targets", but in the most recent version: https://gcc.gnu.org/onlinedocs/gcc/Floating-Types.html it says "__float128 is available on i386, x86_64, IA-64, and hppa HP-UX, as well as on PowerPC GNU/Linux targets that enable the vector scalar (VSX) instruction set". Of course it is also dependent on libgcc, if the hardware does not have native support for this float width. Clang modeled its support on gcc's example, and similarly the library support is in compiler-rt, at least for x86_64 and some other architectures. But from clang's OSTargets.h file, it looks like 128 bit float support is never set to enabled for FreeBSD. > On the other hand, I have no idea if any support is required from > libgcc (probably it is), and we almost certainly do not have it in > the base library. In libcompiler_rt, it's only enabled for aarch64 and riscv: # # 128-bit quad precision long double support, # only used on some architectures. # .if ${MACHINE_CPUARCH} == "aarch64" || ${MACHINE_CPUARCH} == "riscv" SRCF+= addtf3 SRCF+= comparetf2 SRCF+= divtf3 SRCF+= extenddftf2 SRCF+= extendsftf2 SRCF+= fixtfdi SRCF+= fixtfsi SRCF+= fixtfti SRCF+= fixunstfdi SRCF+= fixunstfsi SRCF+= fixunstfti SRCF+= floatunsitf SRCF+= multf3 SRCF+= subtf3 SRCF+= trunctfdf2 SRCF+= trunctfsf2 .endif -Dimitry --Apple-Mail=_76C08A40-D0CB-4F7E-8593-DEE4D48C7C96 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCXOm0EgAKCRCwXqMKLiCW o4a1AJ9HVVGYB4jFtcx7dFBQEacl1MEFVACfV2kgGQgBotHOCDHsvhCZEiwBDcs= =zsnN -----END PGP SIGNATURE----- --Apple-Mail=_76C08A40-D0CB-4F7E-8593-DEE4D48C7C96-- From owner-freebsd-hackers@freebsd.org Sat May 25 21:43:01 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9051315B7120 for ; Sat, 25 May 2019 21:43:01 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CBCA8A95E; Sat, 25 May 2019 21:43:00 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id UeRGhRecIGusjUeRIh5y17; Sat, 25 May 2019 15:42:53 -0600 X-Authority-Analysis: v=2.3 cv=fOdHIqSe c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=kj9zAlcOel0A:10 a=E5NmQfObTbMA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=Gn0eYT8Q2L8r4I93X6cA:9 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTPS id 08FF21C44; Sat, 25 May 2019 14:42:49 -0700 (PDT) Received: from slippy.cwsent.com (localhost [127.0.0.1]) by slippy.cwsent.com (8.15.2/8.15.2) with ESMTP id x4PLgm8c098652; Sat, 25 May 2019 14:42:48 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Received: from slippy (cy@localhost) by slippy.cwsent.com (8.15.2/8.15.2/Submit) with ESMTP id x4PLgmEo098646; Sat, 25 May 2019 14:42:48 -0700 (PDT) (envelope-from Cy.Schubert@cschubert.com) Message-Id: <201905252142.x4PLgmEo098646@slippy.cwsent.com> X-Authentication-Warning: slippy.cwsent.com: cy owned process doing -bs X-Mailer: exmh version 2.8.0 04/21/2012 with nmh-1.7.1 Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: Mark Johnston cc: Cy Schubert , freebsd-hackers@freebsd.org, rmacklem@freebsd.org Subject: Re: DTrace instrumentation build error In-Reply-To: Message from Mark Johnston of "Fri, 24 May 2019 10:56:50 -0400." <20190524145650.GB72269@raichu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 25 May 2019 14:42:48 -0700 X-CMAE-Envelope: MS4wfM+pcMs46qkW3bvf99wp+o2i7jgcYDkNiKJIdtvVDUqSNZUfoci+EaoaAvhxrptmLYlh9JTpKkHEAgMtuaRpnu+OpPlzDn81s3BXvQefx1QDwCTiOuDe O+ZdpZKA3VVJp8v2e45t0CzxQalmnaPqrbHPIzLzSgWBOYbmxGFme80FOL327ECPTkaayyCvNtrc8yTwWf5kIU/Vn4IS8tUl97BqA9vbIEQwkO5fESez5eMe 77OyHj/b5CldT/NRFUROIw== X-Rspamd-Queue-Id: 4CBCA8A95E X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-5.09 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.zen.spamhaus.org : 127.0.0.11]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; TO_DN_SOME(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: spqr.komquats.com]; NEURAL_HAM_SHORT(-0.93)[-0.930,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_SPF_NA(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[138.136.59.64.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-2.45)[ip: (-6.43), ipnet: 64.59.128.0/20(-3.25), asn: 6327(-2.50), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 21:43:01 -0000 In message <20190524145650.GB72269@raichu>, Mark Johnston writes: > On Fri, May 24, 2019 at 05:55:51AM -0700, Cy Schubert wrote: > > Hi, > > > > I'm helping rmacklem@ with instrumentation of mountd with USDT > > probes.It builds fine on amd64 however fails on i386 > > > > ===> sbin/sconfig (all) > > ld: error: cannot open /usr/lib32/dtrace/drti.o: No such file or > > directory > > dtrace: failed to link script /home/cy/stable12/usr.sbin/mountd/mountd_d > > t.d: fai > > led to link mountd_dt.o: ld exited with status 1 > > --- mountd_dt.o --- > > *** [mountd_dt.o] Error code 1 > > > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > > 1 error > > > > make[6]: stopped in /home/cy/stable12/usr.sbin/mountd > > --- all_subdir_usr.sbin/mountd --- > > *** [all_subdir_usr.sbin/mountd] Error code 2 > > > > A couple of interesting things here: > > > > 1. /usr/lib32/dtrace/drti.o doesn't exist in the universe12a and > > universe12b jails. > > /usr/lib32 is entirely missing in those jails. > > > 2. Why would buildworld (tinderbox in this case) link against an object > > outside of /usr/obj? > > It is simply dtrace(1)'s default behaviour. I believe this patch is > sufficient to fix the problem for both native and 32-bit compat builds. > I think it is a bit too hacky though: we should probably only add > -x libdir during a world build. A standalone make -C usr.sbin/mountd > should use the host drti.o. What's the right predicate for that? > > diff --git a/share/mk/bsd.dep.mk b/share/mk/bsd.dep.mk > index 5d0aac91f1b4..ce008fdba324 100644 > --- a/share/mk/bsd.dep.mk > +++ b/share/mk/bsd.dep.mk > @@ -147,6 +147,9 @@ OBJS_DEPEND_GUESS.${_YC:R}.o+= ${_YC} > # DTrace probe definitions > .if ${SRCS:M*.d} > CFLAGS+= -I${.OBJDIR} > +.if exists(${OBJTOP}/cddl/lib/drti/drti.o) > +DTRACEFLAGS+= -x libdir=${OBJTOP}/cddl/lib/drti > +.endif > .endif > .for _DSRC in ${SRCS:M*.d:N*/*} > .for _D in ${_DSRC:R} Thanks Mark. I'll run another tinderbox with this. Wouldn't -L also work? incdir will also need updating. My initial thoughts were to add a -R option implementing --sysroot. -- Cheers, Cy Schubert FreeBSD UNIX: Web: http://www.FreeBSD.org The need of the many outweighs the greed of the few. From owner-freebsd-hackers@freebsd.org Sat May 25 22:54:07 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D47F15B89E2 for ; Sat, 25 May 2019 22:54:07 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EB45A8DD7D for ; Sat, 25 May 2019 22:54:05 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id x4PMrwwn056509 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 25 May 2019 15:53:58 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id x4PMrv0v056508; Sat, 25 May 2019 15:53:57 -0700 (PDT) (envelope-from sgk) Date: Sat, 25 May 2019 15:53:57 -0700 From: Steve Kargl To: Yuri Cc: Konstantin Belousov , Freebsd hackers list Subject: Re: What is the portable 128-bit floating point type? Message-ID: <20190525225357.GA56490@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20190525200437.GV2748@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: EB45A8DD7D X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [0.23 / 15.00]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[troutmask.apl.washington.edu]; NEURAL_HAM_SHORT(-0.60)[-0.599,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.86)[-0.857,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.01)[0.007,0]; IP_SCORE(-0.01)[ip: (0.08), ipnet: 128.95.0.0/16(0.07), asn: 73(-0.14), country: US(-0.06)]; R_SPF_NA(0.00)[]; FREEMAIL_CC(0.00)[gmail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 22:54:07 -0000 On Sat, May 25, 2019 at 01:50:24PM -0700, Yuri wrote: > On 2019-05-25 13:04, Konstantin Belousov wrote: > > Neither i386 nor amd64 have hardware-supported 128 bit floating point > > type. long double is defined by both i386 and amd64 Unix ABI as 80 bits > > (10 bytes) representation as defined by IEEEE FP standard and supported > > by x87 FPU (not-SSE). The difference in size is due to the different > > natural alignment between 32 and 64 bit ISA. > > So it looks like there is no true quad-precision float available. > > Based on this conversation https://github.com/bluescarni/mppp/issues/186 > FreeBSD used to support __float128. Why was it removed? > gcc version 5 or 6 and up comes with libquadmath. It is a software implementation of IEEE 128-bit floating point math. You need sparc64 to have a 128-bit hardware support. -- Steve From owner-freebsd-hackers@freebsd.org Sat May 25 23:13:13 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6547715B91A1 for ; Sat, 25 May 2019 23:13:13 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BBB448EADE for ; Sat, 25 May 2019 23:13:12 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id x4PNDAKH056599 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 25 May 2019 16:13:10 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id x4PNDAmY056598; Sat, 25 May 2019 16:13:10 -0700 (PDT) (envelope-from sgk) Date: Sat, 25 May 2019 16:13:10 -0700 From: Steve Kargl To: Konstantin Belousov Cc: Yuri , Freebsd hackers list Subject: Re: What is the portable 128-bit floating point type? Message-ID: <20190525231310.GB56490@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20190525200437.GV2748@kib.kiev.ua> <20190525210311.GW2748@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190525210311.GW2748@kib.kiev.ua> User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: BBB448EADE X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.986,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 23:13:13 -0000 On Sun, May 26, 2019 at 12:03:11AM +0300, Konstantin Belousov wrote: > On Sat, May 25, 2019 at 01:50:24PM -0700, Yuri wrote: > > On 2019-05-25 13:04, Konstantin Belousov wrote: > > > Neither i386 nor amd64 have hardware-supported 128 bit floating point > > > type. long double is defined by both i386 and amd64 Unix ABI as 80 bits > > > (10 bytes) representation as defined by IEEEE FP standard and supported > > > by x87 FPU (not-SSE). The difference in size is due to the different > > > natural alignment between 32 and 64 bit ISA. > > > > > > So it looks like there is no true quad-precision float available. > > > > > > Based on this conversation https://github.com/bluescarni/mppp/issues/186 > > FreeBSD used to support __float128. Why was it removed? > No idea, it seems to be clang-specific. gcc 8.3 does accept the type. > On the other hand, I have no idea if any support is required from > libgcc (probably it is), and we almost certainly do not have it in > the base library. This is part of the problem with gfortran finding the wrong libgcc_s.so. -- Steve From owner-freebsd-hackers@freebsd.org Sat May 25 23:26:40 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F5AF15B954C for ; Sat, 25 May 2019 23:26:40 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7264F8F000 for ; Sat, 25 May 2019 23:26:38 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id x4PNQaXT056708 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 25 May 2019 16:26:36 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id x4PNQaNP056707; Sat, 25 May 2019 16:26:36 -0700 (PDT) (envelope-from sgk) Date: Sat, 25 May 2019 16:26:36 -0700 From: Steve Kargl To: Yuri Cc: Konstantin Belousov , Freebsd hackers list Subject: Re: What is the portable 128-bit floating point type? Message-ID: <20190525232636.GA56698@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20190525200437.GV2748@kib.kiev.ua> <20190525225357.GA56490@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190525225357.GA56490@troutmask.apl.washington.edu> User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 7264F8F000 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [0.26 / 15.00]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; NEURAL_HAM_SHORT(-0.47)[-0.471,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.66)[-0.662,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-0.29)[-0.291,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-0.01)[ip: (0.07), ipnet: 128.95.0.0/16(0.07), asn: 73(-0.14), country: US(-0.06)]; R_SPF_NA(0.00)[]; FREEMAIL_CC(0.00)[gmail.com] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 May 2019 23:26:40 -0000 On Sat, May 25, 2019 at 03:53:57PM -0700, Steve Kargl wrote: > On Sat, May 25, 2019 at 01:50:24PM -0700, Yuri wrote: > > On 2019-05-25 13:04, Konstantin Belousov wrote: > > > Neither i386 nor amd64 have hardware-supported 128 bit floating point > > > type. long double is defined by both i386 and amd64 Unix ABI as 80 bits > > > (10 bytes) representation as defined by IEEEE FP standard and supported > > > by x87 FPU (not-SSE). The difference in size is due to the different > > > natural alignment between 32 and 64 bit ISA. > > > > So it looks like there is no true quad-precision float available. > > > > Based on this conversation https://github.com/bluescarni/mppp/issues/186 > > FreeBSD used to support __float128. Why was it removed? > > > > gcc version 5 or 6 and up comes with libquadmath. It is > a software implementation of IEEE 128-bit floating point > math. You need sparc64 to have a 128-bit hardware support. > BTW, using gfortran8 one finds i386 FreeBSD % gfortran8 -o z prec.f90 && ./z Type DD BD emin emax 32-bit FP: 6 24 -125 128 64-bit FP: 15 53 -1021 1024 80-bit FP: 15 53 -16381 16384 128-bit FP: 33 113 -16381 16384 x86_64 FreeBSD Type DD BD emin emax 32-bit FP: 6 24 -125 128 64-bit FP: 15 53 -1021 1024 80-bit FP: 18 64 -16381 16384 128-bit FP: 33 113 -16381 16384 DD = decimal digits BD = binaray digits All types are radix-2. -- Steve