From nobody Tue Apr 4 05:22:57 2023 X-Original-To: dev-commits-src-main@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PrGPS49ZRz43wm6; Tue, 4 Apr 2023 05:23:08 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pf1-x434.google.com (mail-pf1-x434.google.com [IPv6:2607:f8b0:4864:20::434]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PrGPS2GtZz4Nl9; Tue, 4 Apr 2023 05:23:08 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pf1-x434.google.com with SMTP id u20so20640487pfk.12; Mon, 03 Apr 2023 22:23:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680585787; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=i2HgyVtSeHIwtywy6uE626ziDg6r9d5i/b9HI1+RnXM=; b=QkUidFLUPiY+mqN1YYCFuLTcWTTxcZbFo9+55a0qEQLAyIL5r+GgdgdYE8p5G5qsN3 RP4PxD9wsvi4mj4W0OTrR5ZJtR9+R3UCbCJvtzXr5H7ydxZ+yopiWyP6eEY0EB/M9zut 9Ns+IcgSEAPKwwQkln78NxG8COH2WU8o2lmmkY2WtU5a9J495kMRKRuSwyC1u65yrDE2 X503h8zxc4rsZZqK4aNYUh98KcMkb7RzsrJLko6OSnIb0hMvSIvYwMhq6nTDhMhJnNMR Dv2HPvHzh2Ctw8Q47BNaICXhCHAIQkV2VSmO6nm4UArn7yVBV5au9sRPYGjShBBgAJj9 KCfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680585787; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=i2HgyVtSeHIwtywy6uE626ziDg6r9d5i/b9HI1+RnXM=; b=0XLKZRsUWHV3246GywiPwvf1ULFLw8iCF/EugnGKT/qJ6Iogd5mSYq0iQX8U4c8WFY S8rITT55spLZVAS+raC5e3gmlGt9EbqUDEyOHA2JKZDIqnMoDMsgqdkkVsMZ5Eo7KX/N JPWpeItK7IBWp4e6yo6Lqk9qvCdtpyxZXcxUgoum4/p4484Z4E/9EMxPHbRKgqMhjXGd 7vEzmlcdIFaU2J050PA1+N0vr1W72c9uxKWajxxkEuUfcBiwQjskxENjTmE6zPIWNTZ/ AEuFfvrFGE1mPTNRkWZBkuW9oAJHY+sEXIUpiME6pioRJLWXof3ynLxTdBXa3wIeo+eH HdNQ== X-Gm-Message-State: AAQBX9eu95CgUXYWqfBnAVZ1A01voljIe5kO7qSP+0VgWBlHp29eVyiT g2Bf7wUdfzObd0gQpYrIHRpauYqOjlHuwJ2dDz+V2yy8aA== X-Google-Smtp-Source: AKy350bMmNNjo+hW9Fc68Z/r77E8+Vs9pBa+1vn6DcWQvceATQWuAsJmlSXyVEkkRmeRrebcTldX+8VYo3JKugGK7PY= X-Received: by 2002:a63:d20:0:b0:4fb:9bb1:46fa with SMTP id c32-20020a630d20000000b004fb9bb146famr330322pgl.0.1680585787016; Mon, 03 Apr 2023 22:23:07 -0700 (PDT) List-Id: Commit messages for the main branch of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-main List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-main@freebsd.org X-BeenThere: dev-commits-src-main@freebsd.org MIME-Version: 1.0 References: <202304031513.333FD6qw014903@gitrepo.freebsd.org> <20230404040010.5D073224@slippy.cwsent.com> <20230404050740.6C25E2AA@slippy.cwsent.com> In-Reply-To: <20230404050740.6C25E2AA@slippy.cwsent.com> From: Rick Macklem Date: Mon, 3 Apr 2023 22:22:57 -0700 Message-ID: Subject: Re: git: 2a58b312b62f - main - zfs: merge openzfs/zfs@431083f75 To: Cy Schubert Cc: Martin Matuska , src-committers@freebsd.org, dev-commits-src-all@freebsd.org, dev-commits-src-main@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4PrGPS2GtZz4Nl9 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mon, Apr 3, 2023 at 10:07=E2=80=AFPM Cy Schubert wrote: > > In message om> > , Rick Macklem writes: > > On Mon, Apr 3, 2023 at 9:00=3DE2=3D80=3DAFPM Cy Schubert > om> wrote: > > > > > > In message <202304031513.333FD6qw014903@gitrepo.freebsd.org>, Martin > > > Matuska wr > > > ites: > > > > The branch main has been updated by mm: > > > > > > > > URL: https://cgit.FreeBSD.org/src/commit/?id=3D3D2a58b312b62f908ec9= 2311d1=3D > > bd8536db > > > > aeb8e55b > > > > > > > > commit 2a58b312b62f908ec92311d1bd8536dbaeb8e55b > > > > Merge: b98fbf3781df 431083f75bdd > > > > Author: Martin Matuska > > > > AuthorDate: 2023-04-03 14:49:30 +0000 > > > > Commit: Martin Matuska > > > > CommitDate: 2023-04-03 14:49:30 +0000 > > > > > > > > zfs: merge openzfs/zfs@431083f75 > > > > > > > > Notable upstream pull request merges: > > > > #12194 Fix short-lived txg caused by autotrim > > > > #13368 ZFS_IOC_COUNT_FILLED does unnecessary txg_wait_synced(= ) > > > > #13392 Implementation of block cloning for ZFS > > > > #13741 SHA2 reworking and API for iterating over multiple imp= leme=3D > > ntatio > > > > ns > > > > #14282 Sync thread should avoid holding the spa config write = lock > > > > when possible > > > > #14283 txg_sync should handle write errors in ZIL > > > > #14359 More adaptive ARC eviction > > > > #14469 Fix NULL pointer dereference in zio_ready() > > > > #14479 zfs redact fails when dnodesize=3D3Dauto > > > > #14496 improve error message of zfs redact > > > > #14500 Skip memory allocation when compressing holes > > > > #14501 FreeBSD: don't verify recycled vnode for zfs control d= irec=3D > > tory > > > > #14502 partially revert PR 14304 (eee9362a7) > > > > #14509 Fix per-jail zfs.mount_snapshot setting > > > > #14514 Fix data race between zil_commit() and zil_suspend() > > > > #14516 System-wide speculative prefetch limit > > > > #14517 Use rw_tryupgrade() in dmu_bonus_hold_by_dnode() > > > > #14519 Do not hold spa_config in ZIL while blocked on IO > > > > #14523 Move dmu_buf_rele() after dsl_dataset_sync_done() > > > > #14524 Ignore too large stack in case of dsl_deadlist_merge > > > > #14526 Use .section .rodata instead of .rodata on FreeBSD > > > > #14528 ICP: AES-GCM: Refactor gcm_clear_ctx() > > > > #14529 ICP: AES-GCM: Unify gcm_init_ctx() and gmac_init_ctx() > > > > #14532 Handle unexpected errors in zil_lwb_commit() without A= SSER=3D > > T() > > > > #14544 icp: Prevent compilers from optimizing away memset() > > > > in gcm_clear_ctx() > > > > #14546 Revert zfeature_active() to static > > > > #14556 Remove bad kmem_free() oversight from previous zfsdev_= stat=3D > > e_list > > > > patch > > > > #14563 Optimize the is_l2cacheable functions > > > > #14565 FreeBSD: zfs_znode_alloc: lock the vnode earlier > > > > #14566 FreeBSD: fix false assert in cache_vop_rmdir when repl= ayin=3D > > g ZIL > > > > #14567 spl: Add cmn_err_once() to log a message only on the f= irst=3D > > call > > > > #14568 Fix incremental receive silently failing for recursive= sen=3D > > ds > > > > #14569 Restore ASMABI and other Unify work > > > > #14576 Fix detection of IBM Power8 machines (ISA 2.07) > > > > #14577 Better handling for future crypto parameters > > > > #14600 zcommon: Refactor FPU state handling in fletcher4 > > > > #14603 Fix prefetching of indirect blocks while destroying > > > > #14633 Fixes in persistent error log > > > > #14639 FreeBSD: Remove extra arc_reduce_target_size() call > > > > #14641 Additional limits on hole reporting > > > > #14649 Drop lying to the compiler in the fletcher4 code > > > > #14652 panic loop when removing slog device > > > > #14653 Update vdev state for spare vdev > > > > #14655 Fix cloning into already dirty dbufs > > > > #14678 Revert "Do not hold spa_config in ZIL while blocked on= IO" > > > > > > > > Obtained from: OpenZFS > > > > OpenZFS commit: 431083f75bdd3efaee992bdd672625ec7240d252 > > > > > > Another problem related to copy_file_range() is the following example= . > > > > > > slippy$ df -h build/make/Makefile . > > > Filesystem Size Used Avail Capacity Mounted on > > > t/wrkdir/amd64 52G 53M 52G 0% /export/wrkdir/amd64 > > > t/wrkdir/amd64 52G 53M 52G 0% /export/wrkdir/amd64 > > > slippy$ cp build/make/Makefile . > > > cp: build/make/Makefile: Cross-device link > > > slippy$ > > > > > > And, > > > > > > slippy$ cp y4menc.h foobar > > > cp: y4menc.h: Cross-device link > > > slippy$ > > > > > > But the following works because /tmp is mfs and /var/tmp is ufs. > > > > > > slippy$ cp y4menc.h /tmp > > > slippy$ > > > slippy$ cp y4menc.h /var/tmp > > > slippy$ > > > > > > Copying files from one zpool to a dataset in another zpool also works= as > > > does copying files from different datasets on the same zpool. Only co= pyin=3D > > g > > > files from/to the same dataset results in cross device link. > > > > > zfs_copy_file_range() will only be called if the source and destination > > both exist on the same mount point. (I'm guessing that's what you mean > > by "same dataset".) > > Correct. > > The long term solution to the problem (for users) would be to enable > block_cloning. One can test this by testing, checkpoint the pool, enable > block_cloning, problem goes away, export and import the pool with > --rewind-to-checkpoint to look at the regression again. > > As to why we see a Cross-device link, > > dtrace: script './dtrace.d' matched 1 probe > CPU ID FUNCTION:NAME > 3 26104 vn_copy_file_range:return int64_t 0x12 > > 0x12 =3D=3D EXDEV. > > As to why, zfs_clone_range() is called unconditionally at > zfs/zfs_vnops_os.c:6292. If the feature is not enabled zfs_clone_range() > sets the return code to EXDEV at line 1083 of zfs_vnops.c. Therefore > block_cloning MUST be enabled. > > To reiterate, the long term solution would be to enable block_cloning. Fo= r > those who either wish or need to defer enabling of block_cloning, because > the zpool is occasionally imported by older versions of freebsd requiring > write acess, or other reason. > If there is a way to test to see if block cloning is enabled at the beginni= ng of zfs_copy_file_range(), it should just call vn_generic_copy_file_range() if it is not enabled (or something like that). rick > > -- > Cheers, > Cy Schubert > FreeBSD UNIX: Web: https://FreeBSD.org > NTP: Web: https://nwtime.org > > e^(i*pi)+1=3D0 > > >