From nobody Wed Oct 18 00:53:05 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9C5H3zkzz4xGXk for ; Wed, 18 Oct 2023 00:53:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9C5G4JgYz4P9m for ; Wed, 18 Oct 2023 00:53:22 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=cihNTLmQ; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1697590400; bh=YFVII6JtEL94ZJ4v+Jh2h3YZ22mkv1fOQdJhcHnYHNk=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=cihNTLmQSYbgeI4Z+Vdp9PrB2vDQDUl6rVCdZPNNedOd7CUOBbc1qAS9aL8c7dLAEzYDX149Jek+bPiMlC6NLl79tMpMgEU+HmrK4akiRcRSCRkxvcCqrspqU6xNzo170JpjH+RH6e6FtiAV0mtvfWG3QJscv4bjdWK9RzCcLgfiWcpt13Rn30IVgnLNqEV/nY7FiRBY9YvO2+hR7K79eXlk/MoaNsGbHG8OXEpAmL4olBuFR59vLa2N8QETvCCORX+ytfbebs4NfR9Qd0Zzt+lk3h95+IBlf83wKKhixVEplKBIMslIHA8ZrLAL/k91SbBo1jXuw10H9sjjf7wIeA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1697590400; bh=90X3dkvBfLiPuCkw1fb4jRQgFgMsjilFDaXE/0xyldI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=BKh6m6vfEmFQyRyu9q74h/WChVUbaQwn3NS1g+294NZAEv3YCj8SUp55yTVt5A4Ak9HtU8SGTTYPRs2tLHJWT/WZTVHslbWkXspp9HzZHPFxqY1GWO2LfU+Uvh3vcSLexWR406FBfI28VTy6UNBFlP0kd0ROHIfxhAg4f28QNpeyoaQBVdYkaUVAPTyttYcvkd7TaBnYRUBH/tWMXDBFovuL1KakVqMPDjDKsPEPEFODmAvPOPMt8WTqTMUbWdrvwUjjLXDqxKuifpXEkuJAeqz1CMN2OZShwr+6xylzdA+l6Y7wng8w+ERSOe1a0fssdK9MD8bZEvb2q/AUmO0JAg== X-YMail-OSG: mUaznNcVM1llQLqo7vcTUgXwc1.8P5zy.ASHQiFvKY88vsCTqrW8kPyhvf_jI6y lvhPxfhkzezimq4TKlALDQ7Io92gH28NyxjNNi7k5kPCq9.9WwTCOacZIQROo6rHvaAJMxp77MVk OGX9QvoEF2RHXjOkFZOM71SsBHK0hjA5G515KMOuLpC1XghQzjdL23HKtv2d9RCHifgNdvaJu4I9 rWvPrYtpISpD8NHvZdAFEloLT24xNZvUXAsLTgWVeWcxi35_V9Bep5zx3xCL0JKb0AvqALq83lpO d9EqU4q9pmK6YNudESuTgSaWS_tAul1nR8nxa3Fqm0O.3uI7zI6Ybq5I72UTXMhTGedzkJulSXFX IDSfOBwkqWTxJ9.1m1U.m_bsctafMLWEpy4B23_I9Eva6A_B2Gfuwn1IpKfOoXwpOOIuGGm6VaFb tHeTe4HeXvItf23CIWie94fpfoK0NKJlj6IRwfHVawM3X_QOOCTaTHs5HzZFsJaapNI9FDsfJDWp ttLkQDABrDuPLcGWgP5moJSY7mS2C.1stI0xSPyTzYhSs6hd6UpzOOlEKudP2b3iSsJySj5IWA9p jHr.giVzbyTW_9yi5sf1EF2V.5uGhugVMPJWttMsKTswqX46XCFv2YQ_TWnrXbHTgErxV0Tr.2G8 cIGbtg44FEBeuPWfMUQSMHYCC8eliE9pysQqf69QN8jqS2XQtHr39GfnUJ2OHfOtzg2uKBlkw8L8 Keto4at1v04sPfSglXIX.tm9VPCBKCHSP3IBOlLWQ3rbOoq.Lvms3TH2eL61YhzwHb_Ub4elSXej 02hMGdzMH_Z0smsnauPA1a0a0duCNgdGvK0JcwLYzd_Mh0RP8y2rRpL.Fy8HFMgQp7ObdMoQ91k9 sRu_fj3VSvYEmvE_E7FC839zJScbp.D_mk.NeHT_pbp4B7dYVLuKdOCN2ig9.OvdVt.LMS.4yUC9 SyXyE1laMaj4sW07651mQAjLE8KZ9gZA49DeyeY_pD.W110L5SmPBzt2s_YfYn3LifxYoxYI5aiQ 5Dr9czeD1op2xwBojGy2myvZ8Igc3tEPaOuSSmoKpu05Z9lnVC8EwpfAmX4JCAuZQZAW.2KmxU8C gzt3dmr3O3eWcII.BS0iAWyiR9MfC.otSjdR8U5VG58eL9H2DvSCi2aMQYcw5.ZRXZEj8aAo5L.W n9cZV5k9xvf7By2Ks2GYPtaW_JtJHxsUeBsQhVz5nkt8vbz8M8EQLsdAYJm7rGTcA0r0jSciYcDE bWBJG1HvPSWAuyw9qHTiZDpuu_lQmMRI8c38RT8FxdAfSz.lTfF5VHBwK2WH_JHbzXVkMlgIr3D4 L2._dV2jdtpdW38w5PqrNmlS.nF7a_lxmELfQgAsoIV3fb93Axm8rD7bs4Qz_4wGPsTIcaONgg0F lMV6ylL5EgOboTOhNEH_aPePpNrFMDw8BQljyHms4ZD1TKgcE5Tbw_r_C2tTow_BCjwJF3FMjJpK QWJnDlPtHpkHvwzq6pALcwRonYaq972QwZb7lAh1FadoonGi9UItguGrxsSoO2gtVCvkZyw_RDkc 0PmdV67hpcvg9fVEEfBoHCKhAivxvTql4IIAtWb8eBFZ_OK89sWpOKszsVcoCb1GofCmLdaDiJst o56tdECBDHWlNQkj6YoEpkssLMZ5COqQI9njJ1Ig_.FV4qNBzae7STe0hB71oTGck2lZihSAvOnH JZKt7CaqobZejY2LGMs1RBN8lrCqxdkyorqnVKa_S0j0xiDTcxct1MnVS3ruxmFFchkR0V3bu620 It_EXBJEtr1DGki6RROVCy80vRvT6tRjcbwNZyj4ovpuw7CrG4RKCSbYhZVBvlo96nsIJlU4Jv2U lNLbjSmwmu6bSMzBy3kO1mlYKXIKVYjJo.ChmxPO4q12ROk0OZBu8rjsn9oXwgHFKUui4u.57oWv xDihqoF5mtD4p5H.29mxjdpgvdWloqpkRxS5NmSGEGsz0fMZmGCVg._JYo38NfVPUAtFfM4So29A J54eciduH.P0hCzLOPfp6gHTWTNgJEsMK4EayV0WyJ6xCrwaz9iYQny_CrKHDeU1No8NgNYT.zJ_ FTEfQGN34vlBCa1VQOw9YW6HKqlTXAQzfEOVFF8omukrm61_2pLp5XIfdytYHLmBDoEL4mQa93Xh YsGOTNja33xacWw8Bgqfvk.MbfJEF3JQz_w.kamgUe6YNRulq3e.7aRBRlKJL.Se00mLOGfC0v8_ .lrD73d9UXRv8FcjrFTF0IWFbslyUF9RhYKqCvILbOOXBJvH95omR4J2t9GxK2M4iHnaU X-Sonic-MF: X-Sonic-ID: c2f7ae28-a5d3-487b-959e-ead06720eaf9 Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Wed, 18 Oct 2023 00:53:20 +0000 Received: by hermes--production-bf1-fc478f446-6zcwx (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f0f90c592286e91adde02ecd7065b87c; Wed, 18 Oct 2023 00:53:17 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.100.2.1.4\)) Subject: RE: freebsd-update 12.3 to 14.0RC1 takes 12-24 hours (block cloning regression) Message-Id: <6E0A0529-5694-47CC-8103-9C6CA1F698F4@yahoo.com> Date: Tue, 17 Oct 2023 17:53:05 -0700 To: Kevin Bowling , Current FreeBSD , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3774.100.2.1.4) References: <6E0A0529-5694-47CC-8103-9C6CA1F698F4.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.83:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S9C5G4JgYz4P9m Kevin Bowling wrote on Date: Tue, 17 Oct 2023 16:40:37 UTC : > I have two systems with a zpool 2x2 mirror on 7.2k RPM disks. One > system also has a flash SLOG. > > The flash SLOG system took around 12 hours to complete freebsd-update > from 13.2 to 14.0-RC1. The system without the SLOG took nearly 24 > hours. This was the result of ~50k patches, and ~10k files from > freebsd-update and a very pathological 'install' command performance. > > 'ps auxww | grep install': > root 52225 0.0 0.0 12852 2504 0 D+ 20:55 0:00.00 > install -S -o 0 -g 0 -m 0644 > b6850914127c27fe192a41387f5cec04a1d927e6605ff09e8fd88dcd74fdec9d > ///usr/src/sys/netgraph/ng_vlan.h > root 68042 0.0 0.0 13580 3648 0 I+ 02:24 0:01.14 > /bin/sh /usr/sbin/freebsd-update install root 69946 > 0.0 0.0 13580 3632 0 S+ 02:24 0:15.65 /bin/sh > /usr/sbin/freebsd-update install > > 'control+t on freebsd-update': > > load: 0.16 cmd: install 97128 [tx->tx_sync_done_cv] 0.67r 0.00u 0.00s > 0% 2440k > mi_switch+0xc2 _cv_wait+0x113 txg_wait_synced_impl+0xb9 > txg_wait_synced+0xb dmu_offset_next+0x77 zfs_holey+0x137 zfs_fre > ebsd_ioctl+0x4f vn_generic_copy_file_range+0x64b > kern_copy_file_range+0x327 sys_copy_file_range+0x78 > amd64_syscall+0x10c > fast_syscall_common+0xf8 > > I spoke with mjg about this and because my pools do not have block > cloning enabled, copy_file_range turns into a massive pessimization in > 'install'. Block cloning is new. So the past is sort of like Block cloning not being enabled now. This leads me to wonder: prior to block cloning existing, what would analogous times have been like instead of 12 hrs and 24 hrs? (Not that analogous would be easy to identify in history or test now.) Depending on the results, my next question might have been: "What happened for block cloning being disabled now to make it worse than before block cloning existed?" > He suggested a workaround of 'sysctl > vfs.zfs.dmu_offset_next_sync=0' but we should probably sort this out > for 14.0-RELEASE. === Mark Millard marklmi at yahoo.com