From nobody Sat Mar 25 20:41:16 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PkWFr1t7Pz41hJg for ; Sat, 25 Mar 2023 20:41:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-22.consmr.mail.gq1.yahoo.com (sonic301-22.consmr.mail.gq1.yahoo.com [98.137.64.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PkWFq6Krtz3qZ4 for ; Sat, 25 Mar 2023 20:41:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679776893; bh=uEH1zw6LRuVjmd+gt0EkDjjGDuwAIRcYbZr9NR+e8HM=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=qDVocR48XPCveQVLxDoVpXYaKYWyNCEj0d5PFh/x/716jEoxH0OZNG/EYJP8Ow3XfCs4TvLepvLJMd17ZlfE1zxt5iIo2fWxGTtVUzLCCaSROgDmDIRgG/RiKmffrRQxbMxbs0J70jrbUjMQt0/XfRX7Z2dEFhLPO3QNnSyaIGLniKjo6waCGGCvM/mHECuAK+KENZbN4lwpFy1VelUamr7UPqWNXAPs3TaPsF2q035abKivwfWFT3y/ufbfAq3duj/QnDOuWn1B7xkRFBXXflrynmXQxxpjJajsBCKtwUQeo2KH3FMrWU/Jge8bVtj7BOK4MsDCan6vhedkZAQ+0w== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679776893; bh=yTKGpJl/0mvkD9LC5CCfwNk6CkM1BRc8quk/C5pLEzm=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=AjaGJsFEHgj/T70oLvVMYiEkmKwMSlM55bTdsYx6qQfQudMYdLKtzgw3YKD+J5gzpTOlfRlp+aFdTejfIpiLScUPQNI7tREcWXM3OlC6WOg0cS+TY56lBss17kKj9caVS0Vm05ljxy2w6wabR4mEgSeZKN1FH56DwgX7zNN9dyvDlIHs/c5KkCRJTSqJelyzhKon/ya02+YJLmmtlnEEkRiSrM4V9JuSgvG3bgpUrcS+6p7euQht5lm3C/DWvsr2blx95iUjQHHpL8ItJq4rsVYVu6zlmTZrl2Lc7CTiGEKVvI7asbJhiRmRz7t5nUO+jAZIbVzUO5+zBnaM2PzwNw== X-YMail-OSG: 9k22ctsVM1nBxhI7aoe.HTdxaK8.dvtlPPos28P6O_btScsG52c0fvm0BJDfGsJ 74ePMgm_bpj1eKc6I7NHTwqXsY0hcjqu21cdIb2DcFMH.1IJo7nuht938DNMq_km_sxlkBMBkFf_ Lt6Z6IBRXkXwDzbzIhhdePp5cpqp1SIeiPLI5KI1WuqB4iG79UytjEuIAHHViYK6cZi_ykvhEJTE Nao2jb6EjrwM1UO9Y3A7OAaS5vTyd3tv0OEjREmyzbovCNPSDillDds7cgqjp31tz3R6jUQQqk4l 2wEhfDYvjVo3HzZWyMrWtNv3D.RCgBs_.EBPHi0ET0Fl2LnEe13pizKH8cHdbZoiVxsd_3hp31Nf 92mZ._pUvetFzsXX9RpEYuK0dNaNvIG2nxf4Svs8a3k_zbbieV_xsbgsbqq4SYyfoBPGTucgy0B0 v_HhXJIxPO1QFHwEvbvMy1eN7ipr4AhPBD75fl6HcfMvPahQLXdbnRcdZx9y6dsJaNKYRsNa8Sh8 PUjgSpJL8mUqmwmNFMRCsQ5yWZhltMT0KF1PNiQ1WtvoRYOTU6.6Bc8efs9IdvqbH6wUMNjAzRTo pLTRuyIHmgP0Twy6R52UHratsJW0EBPFk0hFKu0Aw6BgG6rVfAtnaT19xIIuhUbRBekfrFFqmNH. lpOEkbdPFnOafJJIWU9tZKefGyNMXlXnWudnnDvUoI9Dc5r.TqIsZwMZvZg3dd6KTgNTxXw_lHRP MrckpHqkJgNdqFgvpTlQFSBqDrBWNXD8wkK1u2xiDW8OfaDYyaJdyJRNsEHjzKHdSmz23zenLlu7 aJmOMd.fnbcJhw6dPH.fALNRLJjnTnSKHg6_s6OcAs3Z7zUnT2bl7VdoVbEFp_L6hnCryFCYegP3 tl.D940P9pLNvcBdLsZrbnJGmhzESgwrI7BYDkvc4dggBi6MvjEv40xEMiv9nKSy735cSY6pykN_ 7adCFhi3NxSaYvRl_xp00BV3MAkt80UYiLzY77SMh2tWig3jerpWol156seFL.4Lxcjzwkqx2aoO 1dJNvjjAjOg8PZFKRsYP6GHiU1YEpfhr3zuTuu2ShEqkQVqeg3PIwDyZ7ZewzJnwwKsqKY.avhxb uh35aW9IBBMTJ9u_TNhpopKUamWywCKQfewg3XXRqEiKeRoA8LV5vGhQcMiHpNhWI8e6a7a89xBi MEuGb3u9roxmluEnJHevofXneiW_jhhLRz.kCE2JnbQ9FSZoTaYdw.ltEO78z1soayroTdNQK9xl b3TBGimoG3ndg0IapaPs_WQzc8TRMvopJjdjDT137MJNV7BnYzg3h59aZ3XbCXLxiLeauPBymsU2 hozwJphC9VqrHx5aRB_yMq.YfMRtPdUNLtrENyNaWbOG4CjvKQqSN10DEdlVnEBCWwqCtNY51hja bWm9JybpFQaqTEJEsQd0ikUXwHRJIOvCjgF5NSzck7kg7PbG3Vq5v.cGGgzEUwxWSmM4wQ.KeHUL i2MCtuTv6TbWbXNsbbPr4dLKbjy1yJJb8NrnyWZ6keKOBvM_pg_009Jqgvjd7_vhlbf4b18lYLlv yTd9uVQVPoQUyfBdWQvtf.eyGGRV8rDexhQnxmwXvRAoLsqD1bBfgl_RwLzPQbROKIzycSz0AR_. FI5HmzTubwWtB8ocYxyCQyhZucUUsii1AkWN_hVHOTbnn6hucGNBUsjSMHFFgi4RwBrLBZXAeMtr YdkEUhiWGylcJ5epNC8XJoHp6pg._mTC3.NhrGVutZMB.QDsWZnaJRrWKNmkW4UAIbAvoC4jyC_f Yd369SGr9kpX9QCnOVo6NEqYsvvIYSxrxeJKsBugIx7JegY6yWIkvHq5aM0LeX7ZAgHz5g7E4MbX neMAwXzR97EP9zqZ9X7BbqqmY1XsENeP6bRpW72vuQXGPb6NjkCPb_BwBB53RSoOwrNuooBuKR4t Dht0IQ64I.b6pUjzE9CBVhoK9uKOlRbJ3GmQn2_zGkcEMKZdvEBqZ9p46IvF3_wAzRWx.FeSJViE vFUcfA_lEk1Y6W_QVE_cwySU5I8eZMWnMfqSnx8kb7SJgSjZK2dszOXiWcSydzj.yuvTRYfprjBW _ib25Jo5a3ayHj1o1N.5geBTABjEz7KGTdzoWsit6clR5IHnUJcIU2oXuoPfU2g89gsabRMbB9ys eOglfVwMSjyHIMIvboweJ2hj53fySifPjHiMlIbfggNmhyU.5.BWaRhGx7lF92_HbYm5dItULkkK ywbFuOorETFcZelqjxeHQg8drX_ea2xtAqaiK1D8Fp4mNrFRmJtqyAPqK._frKcAOnQwuyuycdIg Exg-- X-Sonic-MF: X-Sonic-ID: 81d9cae1-b872-4745-95ca-ef6023ee7d82 Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Sat, 25 Mar 2023 20:41:33 +0000 Received: by hermes--production-ne1-759c9b8c64-f7wvp (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID fd861c660fd6ae1e34f6a95bba34e908; Sat, 25 Mar 2023 20:41:28 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Periodic rant about SCHED_ULE From: Mark Millard In-Reply-To: Date: Sat, 25 Mar 2023 13:41:16 -0700 Cc: FreeBSD Hackers Content-Transfer-Encoding: quoted-printable Message-Id: References: <5AF26266-5B4C-4A7F-8784-4C6308B6C5CA.ref@yahoo.com> <5AF26266-5B4C-4A7F-8784-4C6308B6C5CA@yahoo.com> To: Peter X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PkWFq6Krtz3qZ4 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 25, 2023, at 11:58, Peter wrote: > On Sat, Mar 25, 2023 at 11:14:11AM -0700, Mark Millard wrote: >=20 > ! Why did PID 10675 change to 19028? >=20 > Because it went into some NFS share, and it would still be there if I > hadn't restartet it a bit differently. >=20 > ! When I tried that tar line, I get lots of output to stderr: > !=20 > ! # tar cvf - / | cpuset -l 13 gzip -9 > /dev/null > ! tar: Removing leading '/' from member names > ! a . > ! a root > ! a wrkdirs > ! a bin > ! a usr > ! . . . > !=20 > ! Was that an intentional part of the test? >=20 > Yes. So you can see what it is currently feeding to gzip (small or > big files - or some NFS share, where the operation becomes pointless). >=20 > ! # tar cvf - / 2>/dev/null | cpuset -l 13 gzip -9 2>&1 > /dev/null I should have had at the the order >/dev/null 2>&1 Sorry. > !=20 > ! At which point I get the likes of: > !=20 > ! 17129 root 1 68 0 14192Ki 3628Ki RUN 13 0:20 = 3.95% gzip -9 > ! 17128 root 1 20 0 58300Ki 13880Ki pipdwt 18 0:00 = 0.27% tar cvf - / (bsdtar) > ! 17097 root 1 133 0 13364Ki 3060Ki CPU13 13 8:05 = 95.93% sh -c while true; do :; done > !=20 > ! up front. >=20 > Ah. So? To me this doesn't look good. If both jobs are runnable, they > should each get ~50%. >=20 > ! For reference, I also see the likes of the following from > ! "gstat -spod" (it is a root on ZFS context with PCIe Optane media): >=20 > So we might assume that indeed both jobs are runable, and the only > significant difference is that one does system calls while the other > doesn't. >=20 > The point of this all is: identify the malfunction with the most > simple usecase. (And for me here is a malfunction.) > And then, obviousely, fix it. I tried the following that still involves pipe-io but avoids file system I/O (so: simplifying even more): cat /dev/random | cpuset -l 13 gzip -9 >/dev/null 2>&1 mixed with: cpuset -l 13 sh -c "while true; do :; done" & So far what I've observed is just the likes of: 17736 root 1 112 0 13364Ki 3048Ki RUN 13 2:03 = 53.15% sh -c while true; do :; done 17735 root 1 111 0 14192Ki 3676Ki CPU13 13 2:20 = 46.84% gzip -9 17734 root 1 23 0 12704Ki 2364Ki pipewr 24 0:14 = 4.81% cat /dev/random Simplifying this much seems to get a different result. Pipe I/O of itself does not appear to lead to the behavior you are worried about. Trying cat /dev/zero instead ends up similar: 17778 root 1 111 0 14192Ki 3672Ki CPU13 13 0:20 = 51.11% gzip -9 17777 root 1 24 0 12704Ki 2364Ki pipewr 30 0:02 = 5.77% cat /dev/zero 17736 root 1 112 0 13364Ki 3048Ki RUN 13 6:36 = 48.89% sh -c while true; do :; done It seems that, compared to using tar and a file system, there is some significant difference in context that leads to the behavioral difference. It would probably be of interest to know what the distinction(s) are in order to have a clue how to interpret the results. =3D=3D=3D Mark Millard marklmi at yahoo.com