From nobody Sat Dec 4 06:26:38 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BCC3218AF36D for ; Sat, 4 Dec 2021 06:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J5fq42vMcz4Vct for ; Sat, 4 Dec 2021 06:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 39FB41F7A7 for ; Sat, 4 Dec 2021 06:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B46QekH042875 for ; Sat, 4 Dec 2021 06:26:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B46QeOt042873 for fs@FreeBSD.org; Sat, 4 Dec 2021 06:26:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246201] fsck: Does not honour /etc/fstab "failok" option (mount does) Date: Sat, 04 Dec 2021 06:26:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: easy, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638599200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ad1jSvIQG1XTjuBNt9wnhcYO9zG9BnLf45EVkai3vk8=; b=pvqeb2tdrxWQxDbEr43O0+PSmdKtKqA5PgZtDm/x9EbDm/jVX/tfgnpP/rBNYeyoBO7pFS lyjInSY+DN7fA2i02Kal6eI09MsVzB6xODYHNh67kgBILSAanHqEjOs2ScCxqkSKNJUISs /irD6c7dPScXS4LXOf8UmQxxSmG6JWPkqyRC/kSh80jN/RMjG7eg3IJGEq5f5L9eU8UJib Pysky03dXRmM5FUVXOJSDWDVPlH2Bq3hTUTg3/uYB8H9JfI3rwwSJQHnoIygB9SrZ0wleX eboENb3SDU7LdxnJOTDOdE/upFoysvxkaaatriIpIshogAmepPXxXGIQxvbC4Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638599200; a=rsa-sha256; cv=none; b=CGbeXGnmzKLr21jCcqwT61V+ZxZDTSETlYTQXi3gMaLnXDXMSeahIkGOO8ucKTKBAzh77C sIfakmeK7/hgv5HO8tPON2BNkyGYXAB13HbVPjaSh5s/YHfkKSC0w4oezOyc879G7gi+3L obByxqyVQJoVlv163xx5JfTWXVascJ+pgmXEt2WS7DSbf/y1RWIXzAF2G56vuIlnua4l+e 9zFkqnSA6+1bPmDydDFPCbVWk0mywsB9YBomP8RhBOPoCf6+0ptF54D3UOpUdlLko03JCT xlujntn+c88NGgQJSWj/wQlC5djKOS6PbkNRBGPluF6KmJBWeq+VHxTRnUOMMg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246201 --- Comment #3 from Kirk McKusick --- (In reply to Robert Clausecker from comment #2) You are right, I do have an fsck_ffs-centric view of fsck :-) It should be handled in fsck. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 5 21:00:35 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9C57D18C08A0 for ; Sun, 5 Dec 2021 21:00:38 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J6f9111CCz3HKS for ; Sun, 5 Dec 2021 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 04DEF1EDC4 for ; Sun, 5 Dec 2021 21:00:36 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B5L0ZPe015059 for ; Sun, 5 Dec 2021 21:00:35 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B5L0ZD8015058 for fs@FreeBSD.org; Sun, 5 Dec 2021 21:00:35 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202112052100.1B5L0ZD8015058@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 5 Dec 2021 21:00:35 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16387380353.933Fa7bF.13704" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638738037; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=cC5hvrRFtJx/+2lI49zCTQM9PKqDVGapPijql8tU9OE=; b=HjjWtM9FWPXeAaCXoKi9o/14H1gG3XaBzWG1xDqhEfhCuMq39GwKGCZesfQUFzb8BvbB2q FTC0Wox/qX8FoPe2d0GyNwZGbIXBLWegGmjS2BgM02lWt3n/EtTFnkiE04EyK2SpMDKYFC CD/d+OkZXPuOgbsGQqnh29CcO3lBNGkhDyWUM6lMeT9Zpc/CiE/ktK9tl+bghC1bD07I1L hhlK5Crwe8GjhFRt/NkR2KglNylFdXDAZGuB2ppecP7Crr7fft6MdSy3K9a70WW5Zs/LQP HoW3VZgKTyQ9E8sOWY8dxk8dz/NujPMySaZUZQj5qVPvq+JCyG9A72+jOq4VsQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638738037; a=rsa-sha256; cv=none; b=oe99+iKxg9bFZGld5o8bx3avsNP9D1IN/UOvOvcnvUoZLp7mCqcwHolQBAyKYb1Noa7R34 dVQlcJJm4PWJPXGbk0+w0Ilc0dq3UtDOfho7+zSSnmxwkF7blULt8PeIMpsGeZZ8QUEGFd epsiaXxqeMgTgDElayF2AsjiTwsXJWCxU85zyFjPOjJ3rgfmSm9JKT6g92yM7Ln7ThGD2s AAQpUhYnBzTuRSp+/1IpU33NIOknIQZOlQ2+O2tOmQN7OG7/iw1XPjISs0U8lReM5GpnkP zSp3aKc+xF71bQJYbcHsKqGQcvhDUGBslRiSWZDcv5Mff3S/UUaFDliU9MV8sQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: Y --16387380353.933Fa7bF.13704 Date: Sun, 5 Dec 2021 21:00:35 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16387380353.933Fa7bF.13704-- From nobody Mon Dec 6 05:57:24 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E7ECE18B0F93 for ; Mon, 6 Dec 2021 05:57:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J6t4N5XRQz3ltn for ; Mon, 6 Dec 2021 05:57:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9A723261B4 for ; Mon, 6 Dec 2021 05:57:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B65vOCF006855 for ; Mon, 6 Dec 2021 05:57:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B65vOnm006854 for fs@FreeBSD.org; Mon, 6 Dec 2021 05:57:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 258022] [FUSEFS] Inode attributes are cached unnecessarily/for too long Date: Mon, 06 Dec 2021 05:57:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: asomers@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_file_loc bug_status assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638770244; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ve2mKEaFYnG1oJ0M8mfyqAYnlmcahccK6DXwj+XB3IU=; b=K2KFqhlKcQkIHbJK7vLOyg8+ilMRCxF20BtJf4/+6OunQXuUdbJHuqAd3KP0eTQfEVbunN EHBrPNYp2sxwZdVZpc8yAlroZmj5Z+PcwN8SDxSZceYC/lli6DDkh3u/rCahpjPalV6aQD OzoQBLDejtkkHB88W9V7uFSdOfahX3fHiMN7HGPw5z/qSL147JW3wBYOdU7L3X4Oo/6kCn 13ywMBJD8oI/2fep7n6jgxXLNJX9ARd9b3+SnWgxUpSKCy3qLrFy5u97sJLKpRsYFhQzTa 3p3sx8TLW78BHlcOEP6Q8vqfs9yaXlESzFr2ObUleQj/KieCS4AcuM2w62Jp0g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638770244; a=rsa-sha256; cv=none; b=tve48Ju4/HLEl26D3Ubd9Rw+1dP+ptlkSuvq4ptzDA9bPjTCLTtJA8z3QtsQdu9rr8M2ji vLV4OnsozDtDY3v9ve5Ihwu7TM/Pd1E0w/vkB/+8EEitkPhcB40fQTgGzEPxZG9x50Bsir +NZ+9Ze/dWzoZJD6BbZ2pxgeSRwHf7PU0sWxz6WgDEb2QS44Hp5XzZqPtnWcyCIfB0eOMh 51DycLDB+Bmur0n9QYdCMYIjTUaTi7wqR4frcrQP0x/ghHcNMCthNzDKaEIQPnIgB1nXd8 u0DNtJSIecVqY6V19Sa+ayoM30Azs1LmJiN+FwsIfdBarOochfw7tSQJftgWPQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D258022 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |https://reviews.freebsd.org | |/D33283 Status|New |In Progress Assignee|fs@FreeBSD.org |asomers@FreeBSD.org --- Comment #4 from Alan Somers --- Patch in review. Note that this bug actually didn't have anything to do wi= th inode attributes. The file type isn't considered an attribute, because it = must remain the same throughout a file's lifetime. So the entry cache is more relevant than the attribute cache. But as it turns out, the best way to ha= ndle this situation is the same regardless of whether the entry cache has expire= d or not. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 6 17:44:17 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 78BB818C90CF for ; Mon, 6 Dec 2021 17:44:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J79m11SlZz3pHk for ; Mon, 6 Dec 2021 17:44:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1279C7DF6 for ; Mon, 6 Dec 2021 17:44:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B6HiHRI091853 for ; Mon, 6 Dec 2021 17:44:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B6HiHqg091852 for fs@FreeBSD.org; Mon, 6 Dec 2021 17:44:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227008] [ZFS] zfs add -n misses l2arc changes Date: Mon, 06 Dec 2021 17:44:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638812657; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LKz2lBvtGXViKrSpLhHhJdYCNKMp+hB3IeIzRsxeXw0=; b=nPULc626f14NuCeTDuxD4Lh7WnxIw9fME4ap0uJG8NW1M3dhYFLQ/zUFqXvUNvGfG/sc81 Ln9wZcUHNvJX3B485IH0fQElf0H3Fm+DJCLKqxzzTxUpw3e8L8FuiJgaYeEe7QYX930Lpz jiRq/sIad1f6c58ci4t1hhPISZ5l36fu5n43yFA9j0zlVBK4BNoxZykq8ANJ4YJfnWGB3s DIhNVTaMSDi6Q38X6IveobBcrmAKgOtuJrg62o9/oIOYdmrOP5mzCImeMT1D/1qSg86dn+ 2KAKmMblDTZGHmpkeyZMRFlzbPY3nJrKqQ3MdSPF1qzyjF19X5BoySyl1wRQPQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638812657; a=rsa-sha256; cv=none; b=gIjd5DNuNs2/0QMZPXnwZrFu8NOsH89Euvn7KVViRzoQvk0i8/AMXvYWDRe7DbAlwTlNqk tUVp+Rrp4cMxqeUHdp9nKgzTiyPUDhPZ5EcxYazvSNTl353au+cCiW6ip2UYU9ne/YJpiJ LTpwZe1jDwCJAbOSEAtc1AA6QPw9rPmFG0P/b23K3CvJPbnMFjBE6NFdqQQQuZ27grEFcO 5BZWb6gFzPwSjSW0cSP7I2kNkTTrcHcifUDWQXf9Emx7Rs55AYZRuuvf+gh+ED/NYvhZvP yahJ9haW72oQ4i2xd9E/VcJh53e4TcpoAMvBLmaDocHmhM4wgR1mwnmCNt73eQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227008 Allan Jude changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed CC| |allanjude@FreeBSD.org Resolution|--- |Overcome By Events --- Comment #1 from Allan Jude --- This was fixed upstream in https://github.com/openzfs/zfs/commit/c24fa4b19a1b117945f3235e014f926fe93b0= c5a So it is fixed in 13.0 and later. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 7 05:09:00 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E805318CA00F for ; Tue, 7 Dec 2021 05:09:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J7Sy441kdz56FY for ; Tue, 7 Dec 2021 05:09:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 66E3619977 for ; Tue, 7 Dec 2021 05:09:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B7590We065310 for ; Tue, 7 Dec 2021 05:09:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B7590Xp065309 for fs@FreeBSD.org; Tue, 7 Dec 2021 05:09:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256936] Buggy filesystem detected - message wrongly triggered by FUSE filesystems Date: Tue, 07 Dec 2021 05:09:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638853740; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=L8cZfXbx+Xy4FaRKe1l4cF9fh5NirxzSH15frB4r4wU=; b=QCfscS0+A5xByVLDl3CZ3TkfiJzBmBFFAAQHR73f/X3KInyPHC6pibNJfvlj8zFrfal/G6 jGAx9DNboQ/ZJTco75N3OmzDjBwTt7xZ0Mi7/pnPjenwRHpiWZibhCl+kX+WdZBadFidjG BpV3egZBMKafmWTSMcMM3LmJ/2/zVrpaQ88ivtFKvu8Ja2sQDhqdOfVeo1D0DwOxCHVMNl ROYSOeAx58xaeFyd9Gn2Y434MSnpz2EhAxwixyzetH5Axad0xGdmleOJpSg5Hk8taKrfyS gvBCz0h0ZLhFTBisticKTl0j7pTbcwkH14yE9qMNZfdzKdl6ttAqmMrRMKOo1g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638853740; a=rsa-sha256; cv=none; b=RVvcTBEcQamOWtZGuVqoYqCnTH3G7QWfzPjZGakI54lRVrTE7roagSP09fiCQP52GxigUg nv+5gX3e562PwVEI57kyK1PAbgeKVbUVNX04gcZvEcyhrR6wKfFypqsCs4mkLPRYVoa53a iX1LifS9mGbX1MVc/XctjKSBwZZb1t/oFF3XoKnZ7vMFvzD+65VGcBMardYsQwQaiQMHqf vcB0NiFwH+LhLsmp1cB164JW9mH0MO0o4vRmfnrvOhuEYPTFE+vNnuLwKv+PMDxFGDcB94 EyU9rv/4gfpB1ayJYh5nZY/MqdYBXnkq1NaIEuTyOcb//YKblo0rgjgwhHQQDA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256936 --- Comment #19 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D94b01af1e5953131d0ca2875e6a0cc882= 047540a commit 94b01af1e5953131d0ca2875e6a0cc882047540a Author: Alan Somers AuthorDate: 2021-10-03 16:59:04 +0000 Commit: Alan Somers CommitDate: 2021-12-07 05:04:44 +0000 fusefs: quiet some cache-related warnings If the FUSE server does something that would make our cache incoherent, we should print a warning to the user. However, we previously warned in some situations when we shouldn't, such as if the file's size changed on the server _after_ our own attribute cache had expired. This change suppresses the warning in cases like that. It also moves the warning logic to a single place within the code. PR: 256936 Reported by: Agata Tested by: Agata , jSML4ThWwBID69YC@protonmail.com (cherry picked from commit 5d94aaacb5180798b2f698e33937f068386004eb) sys/fs/fuse/fuse_internal.c | 74 +++++++++++++++++++++++++++++++----------= ---- sys/fs/fuse/fuse_internal.h | 3 +- sys/fs/fuse/fuse_io.c | 4 +-- sys/fs/fuse/fuse_node.c | 19 ++++++++++-- sys/fs/fuse/fuse_node.h | 2 +- sys/fs/fuse/fuse_vfsops.c | 40 +----------------------- sys/fs/fuse/fuse_vnops.c | 41 ++----------------------- 7 files changed, 76 insertions(+), 107 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 7 06:31:28 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 503B318D7DE3 for ; Tue, 7 Dec 2021 06:31:42 +0000 (UTC) (envelope-from luoqi.chen@gmail.com) Received: from mail-lf1-x136.google.com (mail-lf1-x136.google.com [IPv6:2a00:1450:4864:20::136]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J7VnT2s5xz3JRs for ; Tue, 7 Dec 2021 06:31:41 +0000 (UTC) (envelope-from luoqi.chen@gmail.com) Received: by mail-lf1-x136.google.com with SMTP id b40so31069224lfv.10 for ; Mon, 06 Dec 2021 22:31:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=WMUNQxV/a+XEWpGzHdreKNVwH56ckc7gR0S8y0lCf0g=; b=k2eoopFjhDWGyfiIMuSIHo933Y5tclJMcrOso+Vrfn4jGO9TXPjt8sGFxocI4V/Lx3 rM7J7fWa+riUX+ZaXHbTaeglHEKzlrCoKP1RrpR5Tg9FAnrlFYw12p6vVp5syRDBy+x5 q9fOpHXhWujbGQzFsnCLKbi4Ixz+YtayKkXt8O+stUCnUmmYYcKx6nmvqtyDjxe2a25O s657Zd3V8b5885ZPhjfQlCvsxt8bJANMaxdxXQ4rYoSR/lvn1Rc38d+mHZife+uCPzzx iBScz5bM/RFkYZXp3CBPj8SHb+C8WlF8vuqZ/gzWERNpajJ4CxFfYMvrZzK+A7RrebO3 pp5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=WMUNQxV/a+XEWpGzHdreKNVwH56ckc7gR0S8y0lCf0g=; b=Jpp6T3nFzVwiCw2PhI2zZf8lhoyxto80BgdGY45vYkkOshzI7Gjuj/mJicOSRsSpxh nCk3ZytXAPpVBmszjQVoj1HiwfR5+suZXxaSxtA84inqfH+Kj0huH9O29GwxTEkHCvQg 9Ia6fMw5SRh/4fpijc8VcwRlzArRegQ43719ycO0ApayoMr86MkoQU8BZwxUacTIpcOz iKhOZVzd75iEKr6okYhydAs1AMBKqV5sfh+4bli8xrOwOqubHgDLVSVOIHXljfXWSKWr +sfkJQs2/OJxRmWuw8nRmbdhNUgdzANVmfpzFgDry9VEOOzpwTFdSnb+PIeawEAFCWjJ yxNQ== X-Gm-Message-State: AOAM532UcpQdugk8s/sYTalpC+3iBPrLiLAFZyCjxnyOXBaeRqp0TSUj h881pMnpQCD+q8ie4Gbz40Ts/34ML6uMesbNKUgeqcox3cVk8g== X-Google-Smtp-Source: ABdhPJy2mN/VprThR/SxyEI7xOApLSr6/QnO/I05GgEjQPjwnNYtt10kAcYGiNJYn0NJze2izWCPjpOctNf5nga6RLo= X-Received: by 2002:a05:6512:1506:: with SMTP id bq6mr40320637lfb.444.1638858699861; Mon, 06 Dec 2021 22:31:39 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Luoqi Chen Date: Mon, 6 Dec 2021 22:31:28 -0800 Message-ID: Subject: nullfs traversing mount points (with working code) To: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000a46f6105d2888661" X-Rspamd-Queue-Id: 4J7VnT2s5xz3JRs X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=k2eoopFj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of luoqichen@gmail.com designates 2a00:1450:4864:20::136 as permitted sender) smtp.mailfrom=luoqichen@gmail.com X-Spamd-Result: default: False [-3.44 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.44)[-0.438]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::136:from]; NEURAL_HAM_SHORT(-1.00)[-0.999]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: Y --000000000000a46f6105d2888661 Content-Type: text/plain; charset="UTF-8" Hi, Recently I had the need to access nfs automounts (for example /net) from within jails, I searched everywhere but couldn't find any suitable solution. It seems we still don't support mount point traversal in nullfs, even though many people have asked for it. I had no choice so I spent a bit of time adding the support myself, which worked satisfactorily for my own purpose. I wonder if anyone's interested in taking the code, polishing it and eventually checking it in. The patch against 13.0-RELENG is at https://people.freebsd.org/~luoqi/nullxmnt.diff Best -luoqi --000000000000a46f6105d2888661-- From nobody Tue Dec 7 13:59:33 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EA7C318E1F2C for ; Tue, 7 Dec 2021 13:59:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J7hkF5JyWz3Fsw for ; Tue, 7 Dec 2021 13:59:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 93839208F8 for ; Tue, 7 Dec 2021 13:59:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B7DxX6A043468 for ; Tue, 7 Dec 2021 13:59:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B7DxXwO043467 for fs@FreeBSD.org; Tue, 7 Dec 2021 13:59:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256936] [fusefs] Buggy filesystem detected - message wrongly triggered by FUSE filesystems Date: Tue, 07 Dec 2021 13:59:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12+ X-Bugzilla-Changed-Fields: flagtypes.name short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638885573; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CQsj+x4mwrlR/5A+pnXCWbG2cl7VQ84mauoj/KwU3OQ=; b=SF1GQ+ooBTpua+RfNMakXm9Z67vV36HeyaGmbr2zGQpjxE5XOxg/WSXAnyrrq7IuGvXF2t qFhybtFSAO+v4xCfgTnxVz2Y8A+9rI5xD91glYt62CsjCuGiJ5ewvpDUKHKyAKKwmPrVma iQOMyu1C97HSKVysz5GFl5ltwMmZg+tUjsBEoHEkfIH6A8Mb5P0T1UkhCh/x9vhyeyPw0r 6fuCrYv35WEvoFyt7+R6G/Ugj1ruIUAUVUFXP0MpLCVaeaJeix68Xwyi7EBKUOWY3Q752u F+41Pb4nnyU0kxZBJRGdx8658DyZp9L/Msd0CaL93oarsyhruPNbgvzWZXLLTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638885573; a=rsa-sha256; cv=none; b=GLXW9dUKJQq/2SVoiFaXMAeHIPgnOKvNK2SU22rHPVra/cRS/vzi/cjScTlmy09bZNyQqd 8uE8fznC2mwoDqYnPiQ3vxCCUsOD0MD3rp2hfBNSj4sxmFSDZse5+dm0n3PZO8PunDR/1m K0FcpOQfJZ8/o0zC31fA5miL3/iuTLU5IsiKyzSLgFSvGpfc2Rp7dV4UylUMIhQeRzlRsC 4HKUHbMcsvQTeKembFk15QxxMJg/tFpbhiV1T53R0go/Je2B41e67yg/lrpV1rAzg1QITI g1GV6X8MXpMPCcaJwb4vNln2ybsaAcNCSA49KVbN3OcYIjkBW7KSPBeHZPg08Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256936 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |mfc-stable13+, | |mfc-stable12+ Summary|Buggy filesystem detected - |[fusefs] Buggy filesystem |message wrongly triggered |detected - message wrongly |by FUSE filesystems |triggered by FUSE | |filesystems --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 7 13:59:43 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5E8E518E201C for ; Tue, 7 Dec 2021 13:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J7hkR1LlCz3FtF for ; Tue, 7 Dec 2021 13:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0EA1820D5F for ; Tue, 7 Dec 2021 13:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B7DxhV0043509 for ; Tue, 7 Dec 2021 13:59:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B7DxhD3043508 for fs@FreeBSD.org; Tue, 7 Dec 2021 13:59:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256936] [fusefs] Buggy filesystem detected - message wrongly triggered by FUSE filesystems Date: Tue, 07 Dec 2021 13:59:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: asomers@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12+ X-Bugzilla-Changed-Fields: assigned_to resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638885583; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qQbF8BIzYTTd61kB/5Y2Tu8zCtwlpn5TEdxYM6n1WzQ=; b=Gan+4acZlj2R+r0LT34ed2ESZwmzZJwykh55H8SB6EvpvVaAZJEEajqUhHi5Atd9VUlpEM D2nvEufgvY7W9j1zmynJJKDg7+CiOXFKMsCqr+tE0EPMNlaFdds4a3ESkNtKX1wDep9K5V ZajCvPyusNZ+0ekx5NNa6OdqNuV0+jrhdZHc0pSIq6qNqOXhiQ/F0KNkxKR6n/dN6jvdHM Il3/HOjG8cBAVljK5qL4LnqaxD5zeb6O0t+Wu3Ul2Qb6fbnsWEiBL3OioD2tfkAPlHf5bx 3JI7fO1wArdRUj1xnHF+BK3BJLWtm5xJpJS/2ACfHMHzRQHWx3hgmkqvpZJIYA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638885583; a=rsa-sha256; cv=none; b=HdInA4F0TYgM4F0TeG3a/7Wo06MDfOegmst7rOxm2Y0LN5WJP8IYNmPlzfu8pNPZQrUrBX zNcbKPRJBeTx84hdVUnwrSeDClIQt6yRnnlaDmVU2hE6romwdzukH8LkYww7UCLWI7bKZn napHBp5uC65dXYtkP1C+t8PFwCIdCp8l4CG3wiGO0bp2kovkV5CfukzW2vtPPpLVe2I6Sm //QvZjJTcXtB2vHp7ht0q6UD+Ao3xpfMPK2LatVcKeb7+mKdnajE3pacRlE/DOhTFYLnU3 X7OOPI0Uh3TlTGJsK+6pRaPjg43QLcpyYJwZn8Di4EVZwalFXQYV6wLk+l0BUA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256936 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |asomers@FreeBSD.org Resolution|--- |FIXED Status|New |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 8 20:22:44 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BF39218D9980 for ; Wed, 8 Dec 2021 20:22:52 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4J8TB35nnlz3j8p for ; Wed, 8 Dec 2021 20:22:51 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 1B8KMiVK018062 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 8 Dec 2021 22:22:47 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 1B8KMiVK018062 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 1B8KMi3c018061; Wed, 8 Dec 2021 22:22:44 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 8 Dec 2021 22:22:44 +0200 From: Konstantin Belousov To: Luoqi Chen Cc: freebsd-fs Subject: Re: nullfs traversing mount points (with working code) Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.5 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on tom.home X-Rspamd-Queue-Id: 4J8TB35nnlz3j8p X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-0.96 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.960]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(1.00)[0.998]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-ThisMailContainsUnwantedMimeParts: N On Mon, Dec 06, 2021 at 10:31:28PM -0800, Luoqi Chen wrote: > Hi, > > Recently I had the need to access nfs automounts (for example /net) from > within jails, I searched everywhere but couldn't find any suitable > solution. It seems we still don't support mount point traversal in nullfs, > even though many people have asked for it. I had no choice so I spent a bit > of time adding the support myself, which worked satisfactorily for my own > purpose. I wonder if anyone's interested in taking the code, polishing it > and eventually checking it in. The patch against 13.0-RELENG is at > https://people.freebsd.org/~luoqi/nullxmnt.diff Let's put a note about wanting this feature aside. It is not just polishing, the code is mostly wrong. >From a very quick look, it breaks a lot of VFS expectations from a filesystem. For instance, nullfs inherits some behavior flags from the lower fs, which is no longer true with your patch, like mnt_kern_flags initialization in nullfs_mount(). A look at the update to the null_lookup() indicates that you are busying some filesystem while owning some other vnode lock. I suspect that after this update, null_lookup() might call VOP_LOOKUP() for dotdot on rootvp for some mountpoint. At this point I stopped looking. From nobody Thu Dec 9 12:15:17 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F1E5618E03FA for ; Thu, 9 Dec 2021 12:15:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J8tK13W8tz4T6t for ; Thu, 9 Dec 2021 12:15:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5346626833 for ; Thu, 9 Dec 2021 12:15:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1B9CFH0w058307 for ; Thu, 9 Dec 2021 12:15:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1B9CFH9Z058306 for fs@FreeBSD.org; Thu, 9 Dec 2021 12:15:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257890] Storage controller lockup on zfs scrub [smartpqi][zfs] Date: Thu, 09 Dec 2021 12:15:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: nbe@renzel.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639052117; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IONdDd//TcYDZ2JnmLsxa87OkMYZtlAaFE9WSu6hmak=; b=rgQxQ4lWfxmD8HC1Pg/BGTgWciFn7RAm50kpg6v2wpmmku2mp9AFBsuJdRg282X6CXJcve WaH1JlENlnWLEM1k6Ut/0uslsGD3Dwjjd5tmfFgE8HKeTQUBIj/BFqCuYZQCy/Squm53yA 2B+fGAzM9N59xEiXcKuiWFNDM1Y9KWyU7OCO1hUv2WQGpbNZ7vCUglXy02IUpsLZJSQD0m NKc4xIBJgz/1SbYr3cIDszr3GqXue9CypilGmBu/Sk0rXVh4amfbH7QndCS+LRtovupZAr H/9EOk9ZjQZWgaxWd0Cpy18aarHDso2LbpgssxqGgE1xBcackI40bwPGuDbo0Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639052117; a=rsa-sha256; cv=none; b=j3+XqI/Rw5Iwe5x+fmVnTjKXya/GjdkpNVUWFUP8A+KkI7Cn+6ojP/HkzVsw6H/Gp5Nd9E 2kxdqxULBD8aPWnyASfo/B9EVXj5784kS+OGPX3dZguMaQnBe7/4bIZIqj4Y9TB4aTGHDy VNu3vRED3O7tIWsWtG1+B1VODYD8OI4icWGNtLVcR8UGHFXL07Z1N//mpZYFWx43dOxzrY iSp9qm35mw3zw3Q8PZFrT4b7FgZEb4uTVZe16eo3a75axNskwvtGZYmUCzjT/ZdMiTtRWp X5RIZVmqnIravYhU+CC8osz2jLtF+s6ytZpOdLAa+6CR8IIV6zDj5S4xkyDm3g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257890 Nils Beyer changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nbe@renzel.net --- Comment #5 from Nils Beyer --- Hi, any updates on this? I'm using three Adaptec 1100-4i HBAs each connected to= a seperate SuperMicro BPN-SAS3-216EL1 backplane for a total of 72 bays. My zpool is created with 67 SSDs in a simple "RAID0"-config: zpool create atime=3Doff mountpoint=3Dnone test da0 [..] da66 and each time I realiably can lockup a random controller by creating enough load using: dd if=3D/dev/zero of=3D/mnt/test.dat bs=3D100M and after a time of five minutes a parallel zpool scrub test with following kernel messages: [...heartbeat...] controller is offline [...take_ctrl-offline...] Controller FW is not runniung. Lockup cod= e =3D 1403a The Adaptec HBA shows after reboot: 1719-Slot 10 A controller failure event occurred prior to this powe= r-up Previous lock up code=3D0001403A POST Messages Ended. Press any key to continue. I even tried only one Adaptec 1100 HBA and the three backplanes as a cascad= e; but the controller locks up using this config as well... TIA and BR, Nils --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 12 21:00:14 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7C93A18EB1FB for ; Sun, 12 Dec 2021 21:00:16 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JBxqM2fvRz4fpT for ; Sun, 12 Dec 2021 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CD8BF27D35 for ; Sun, 12 Dec 2021 21:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BCL0Ecw075483 for ; Sun, 12 Dec 2021 21:00:14 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BCL0E9F075482 for fs@FreeBSD.org; Sun, 12 Dec 2021 21:00:14 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202112122100.1BCL0E9F075482@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 12 Dec 2021 21:00:14 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16393428147.ACbcFb5.74548" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639342815; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jU8I7M3pWIeAw1QFzPOInDh/mzjM7GRbLgvhlTj3a80=; b=fL1LPRfWvUrBjWxbHLSErhEzTQSWYR00pav9xkAhXr4tsWIrEXwUXjNZVaBX1f604gnH5k VH3l5CWW3eiVgrNUU9Y0b0vZd6QZf6jvAUY/ixYH3/HjvvanfBXEJEvVR7NUKfgIHc9PbG Iqp8LSkuFYFVM9V8NNC2Enq2YQD3wFF8tTIkdOJycvtE/eO9JHnOzx7hdSoKmnPRykfUqs P/S5hYyjeAMvMAHOHajbydXbToa26Jq8i7H5TdGR04MENrNffiQctL/XI0OydnHbWOEjON I1Yqfpi6Y2A17MIjCZX+Ok4IvlyZ8rw8LT9EhO4mQwy3ItPpkm1JoYdewy6Ppw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639342815; a=rsa-sha256; cv=none; b=JCet2cdd3edRHBP/RUoo8UBT77vatEnL/gPt6muZSqRdcicJIcWZsGozWHlBRxueglygzk PgN7XJFnwuR48hF9MAzIJ4NzEjmrHCLNmovPpZcACxcjfhpCNIgbsxdBjofu6ObFTPLCmi b/zwWMNdIq6E+Y4yDfAwK2muFHiG2jDIXtea/eEu2V+3QSr9U0iFFg5cIFANmwCmwRhZbN tsKtPx79mIRUn5AUWssA/lW13tN6F/Hol3dGYc+OK67kI5pqpOO4291JtcnSXT4pINRYtT P9pc9Kyc8PkMkWAGXFHAWu74YD+WlPdnHlgcw5taeb0GnP0w80M0gaDCYKl60Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: Y --16393428147.ACbcFb5.74548 Date: Sun, 12 Dec 2021 21:00:14 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16393428147.ACbcFb5.74548-- From nobody Tue Dec 14 00:35:05 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 775FB18EE5D1 for ; Tue, 14 Dec 2021 00:35:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JCfXn11Rkz4l3D for ; Tue, 14 Dec 2021 00:35:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 035B71E797 for ; Tue, 14 Dec 2021 00:35:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BE0Z47C074593 for ; Tue, 14 Dec 2021 00:35:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BE0Z4Tq074592 for fs@FreeBSD.org; Tue, 14 Dec 2021 00:35:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246201] fsck: Does not honour /etc/fstab "failok" option (mount does) Date: Tue, 14 Dec 2021 00:35:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: easy, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639442105; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JIKWKMIoO9uSh6dAcrmBmn2B/XkzWesZpyes7TRpkTI=; b=e4TO7h+h5g04R96sp0Lu6UCkVPX3npy2/OGbgKy2WUpUziklkmj2b3DtApU9IC2EtTCnWD zLv7c8ooUCEaLrp5xDAZUaDoiiQDLktRdgSH7SkYS+8J7Zsk2yTuFgyywTAHmz05uh+7u0 3hJ2oeCfdKdqPQRD+/bENxdPrhb5RRXLxyo5NwEWK+ayMVnezcKpXdBJeE5Ig+YltQJBxt vtcgZPFMOpFDvyFoGBJ2zePs6YpQfGsYJfuRcV4+DHB0b2ZniGQvY85WWgJu1Hg/QTLgs1 Yci1ykYmceTPNDCFTmm1IYjv5+m7qdP4bCxGN8uM5wUuPpOt26eKljqluBdmwQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639442105; a=rsa-sha256; cv=none; b=vC1Ieg7Hh4qMVnXjxo2xFwj6af6n0STMAdmKQU8By2WT4hSrpxTaXv5/ZAMI8uGLtmHyR5 p/UUiJYt/l2oipGwkfMQaqhmLJU5c5g4h9F9hh/yVFDfX6BPwYuiyy7SIU7azF1ZXvKLUo Wrb1aSDh6hIHpf+LdEqDLe8/BNMa8mPNaOStgf6X7TtO2lpuHYRxS2xIsAcXuT/8kOp3az OMx8uH7JMfNUl6XiGKKxdEFKGd7ZIhk/4fKer4UIZzUo6sH1E8h3bOuy+saySGn/x43ygs G15bSiC39OKg8eSvOt/8eY5xgpQoDwLuNaN3DkcktppHMGubVk4cGiKRIbpqog== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246201 --- Comment #4 from Kirk McKusick --- Proposed fix is in https://reviews.freebsd.org/D33424 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 16 00:54:21 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7408F18D7E66 for ; Thu, 16 Dec 2021 00:54:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JDtt65jQWz3M4t for ; Thu, 16 Dec 2021 00:54:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A0A4626371 for ; Thu, 16 Dec 2021 00:54:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BG0sMDN064501 for ; Thu, 16 Dec 2021 00:54:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BG0sMTC064500 for fs@FreeBSD.org; Thu, 16 Dec 2021 00:54:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246201] fsck: Does not honour /etc/fstab "failok" option (mount does) Date: Thu, 16 Dec 2021 00:54:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: easy, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639616063; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uVWRcUszDwcBEIenizNVJz70MVQ52KSxVHbtV3VUPuw=; b=kgTVDfGFfwg6xy2cMWGUdn0deTRU7uRFO90U6Ow+peAB7rBGjG7Mu8Dgdeze6if1BcC0w8 yaMsY11YlB/lQMxA61It8vgbkNWFlgzYRbFqw1RuafqC/la/wcuuy9ncs9SQkPM8f78aqM w5eZGtFx6izlq5P/G5AywbLeiBNC12Qp3iurMPadD23gSXIOsAqSZLGtTzsl4lvNHOMF/g VfRcQ2DY3WDfO+1dRmTcMnOqBajKWBzs4GCag4A7figYaQUilIdEUgQQwgxbo0fVJ93N2x 5vaQXHGl2qiV3UgSEkVqgxnBwsIP2QL2gx8ODA3EzYDGU2B4ETANPasAGLrn5g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639616063; a=rsa-sha256; cv=none; b=uqFeCPDBM46fsEBiSGpsHdfrAWaE1rcx9W1r+/gt8EsZj7nXkd9LdOJtDJG/fOYe85DAxf UDGP05nSSa1Oy5WWYkFchsnzu2F5TQ3LRFA27eHYdOOftGMuebs1bZn36yB8+G1sjrCT4f xLb4Z4YufLtNBGg1JshBv0mCpEM8Sb34GkvGVTWuITheSa+j1M6SL5n9L6cJWp26OF/g0E QZBwc9nGIVVuBlGU0+1gqVGx97zBNhPXkuv4UJZA+JIhLONDtFCA5BaUSf0ByHLg0IXbLX BQjsYpu+ZMG649FGDztbQdv9b38rUOtYZAWPbpJrI2ytb/JErBJQiOgzxnA91A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246201 --- Comment #5 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dc72372c693b36058b58a525981e833515= ce8e441 commit c72372c693b36058b58a525981e833515ce8e441 Author: Kirk McKusick AuthorDate: 2021-12-16 00:51:55 +0000 Commit: Kirk McKusick CommitDate: 2021-12-16 00:53:46 +0000 Update fsck(8) to ignore failures from a check program for a filesystem when the fstab(5) entry for the filesystem has the "failok" attribute. Reviewed by: kib PR: 246201 MFC after: 2 weeks Sponsored by: Netflix Differential Revision: https://reviews.freebsd.org/D33424 sbin/fsck/fsck.c | 3 +++ sbin/fsck/fsutil.c | 39 +++++++++++++++++++++++++++++++++++++++ sbin/fsck/fsutil.h | 7 +++---- sbin/fsck/preen.c | 24 +++++++++++++++--------- 4 files changed, 60 insertions(+), 13 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 16 01:36:37 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5E1D218E49A8 for ; Thu, 16 Dec 2021 01:36:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JDvps6s9sz3mHt for ; Thu, 16 Dec 2021 01:36:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B51E326C53 for ; Thu, 16 Dec 2021 01:36:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BG1abjl086817 for ; Thu, 16 Dec 2021 01:36:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BG1ab2u086816 for fs@FreeBSD.org; Thu, 16 Dec 2021 01:36:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260453] ZFS truncated write to O_APPEND file from mmap'ed memory Date: Thu, 16 Dec 2021 01:36:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639618598; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e8Da6zXzNp9vxwcFlXsxbbQlWqtbNBofHkj9K1rWfD0=; b=fzUVnPUQlCriVIprC/6edyutmcbnGxCEqtJd1V9qjfOcydNHF40iFyRYN32cI+GWxNbe4z 9ZlPRrOXWjTGj4jsQS2YZkOeV3tXtckcPKbcofWkK+RSlkGIaFiTkooiWsT12TGlVrIfFq 5tvIhFYpNngwJWmm/AJCRJSaTZ2/alyQB49K5iZh2DDpLjzfUo7WgWhBxeCk3p0IBqTQ4u Fd8W3wI80KqwnGcTe+OUAlHm9oIr0AjPo6duQLCeJldZ4N2H/7y0ysmn+aNvoEFlZdCJtv +Ld7ShJ1BQSxfkuwkgm2yxEGsXH/dmYAh+2JtSfyUHThIOTEZZ/YvsCXVCRo1g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639618598; a=rsa-sha256; cv=none; b=UfA1GzeZeesgP43cu7OKSNdweDVTu7lzREBx60rRRGeM0RxjWRgnMZaG3ZB0ojPiybGEK9 ZbtmhrjCkxLd6LS5czTXpUhgfC6VOOP8hQlr9arQfej65UFOue39Q9+ENtrTsMwHD1f3iy SCmLMPzy9sKuHqQ5GsgZz+jejKO0ZxYD7+vn4oyYGHa6a7OWOBV1dcdKZlpfF0yt0BZCvZ QkPlNxgHDhIvg6+sssYRq03FyWR1sQLQckFtN2icNYxQ8bs7pPGZYtsE1pG20pxvNKv6Lz M3VuqsH1xZdasRe8ydqRCakijqQJT1JDTKkIgh5CkaABn+laqWPPgs1Ks2FhSw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260453 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 16 04:44:52 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C126918F1567 for ; Thu, 16 Dec 2021 04:44:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JF0044Ly0z4s12 for ; Thu, 16 Dec 2021 04:44:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 755DE29C21 for ; Thu, 16 Dec 2021 04:44:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BG4iqKi096817 for ; Thu, 16 Dec 2021 04:44:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BG4iqtT096816 for fs@FreeBSD.org; Thu, 16 Dec 2021 04:44:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260453] ZFS truncated write to O_APPEND file from mmap'ed memory Date: Thu, 16 Dec 2021 04:44:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: Rincebrain@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639629892; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cCwAPCzJqa3DnxiGsGpk38W/U9pXEzSR1GPOf1i/6+c=; b=U8uneSpoC5MFBDAfo/3LsE2BswsKzGPmcxGbKN3asu6ZYSah9lkpQ0HNlD2RLWnUrBS+7a PTfVGLno0izB85fQaJqVP9qf2K9ajtiEEWaEsP4wjLM6XKYIWou/ONym4NqeX44REyRPN6 hUw7G62nzrULrBKt0tKriHbLK6cNKXmQyZmvsEys6WKXtboyal3tm4shtBiMF5NSYbB3v2 bEANC+lZ/c3kkSN/eQfB0eQQ6ztP5XhpINQT7xS6/WoxGEauEEMotJuGSE20i/HZF7pZ4i htkFs5ISmTD3pbkM7mWk98+WE7vRCfs9EbeRzwBEbLfkNROB+36kRpwRDRJqCg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639629892; a=rsa-sha256; cv=none; b=mgCXIbEelnAn3Yu3vlDPaJk1Nqn310+DdwHXBn02lm2u49ONjz+fmbAyXZIROP9bn/MSQo 06GBLOXj6DQioXy8HaasVk6vk5EnQl85paiIhcRT836L9MvPpRY/7Z1PfUjMrMFZtsRb6S J/uJbx5A24QGvj2EJ3haW/szGTOTwqJEyj3GyeeKDKwph5iAPoqik/LbuESJT+OpLVJL1D eqdgugGb82O70lEtthu1Ep0+fJa5yk3RJTTCRpi7aSMGG4sxBrzLwHK2td9QY+MnxjZWsx GPxuDxaeQrg/WU03/lRd/SEqx2BM0XRseru3M9kVF67/jRjE3Gd32evK4iSgKQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260453 Rich Ercolani changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |Rincebrain@gmail.com --- Comment #2 from Rich Ercolani --- This reminds me of the bug https://github.com/openzfs/zfs/commit/c23803be84cb5cc9d98186221f4106a9962df= c45 and its predecessor commit https://github.com/openzfs/zfs/commit/de198f2d9507b6dcf3d0d8f037ba339402087= 33e were intended to fix. Obviously, this isn't SEEK_DATA/SEEK_HOLE, and in that case, you wound up w= ith correctly sized files with zeroes for the last $WHATEVER. But I still thoug= ht I'd mention it in case the logic changes there might help. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 16 07:40:21 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8225D18F27FD for ; Thu, 16 Dec 2021 07:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JF3tY2cmrz3hqr for ; Thu, 16 Dec 2021 07:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 36D682BF69 for ; Thu, 16 Dec 2021 07:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BG7eLGI000413 for ; Thu, 16 Dec 2021 07:40:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BG7eL1v000412 for fs@FreeBSD.org; Thu, 16 Dec 2021 07:40:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260453] ZFS truncated write to O_APPEND file from mmap'ed memory Date: Thu, 16 Dec 2021 07:40:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639640421; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lmkaYaqtfxziEZ9NORC3GQKx22Gp0ut03zMH6IcIDOE=; b=N7FiuIu1MUVXUzoGgDb2beGqKR/p8nJKOe6Gxj+uptwxYbzud0BgsRRw1u1S/ILXzGmtTi agcuQjIYZKncizPzD444YdI3Je3bUMsFTcdM2LFyMfO/w3l4tEqTXa/WH8FhdraMgrCgZd S7/cTKWLH0B3d1oRAe7Dv9AjcnvbPZz1BoG6Yi3tJrJKUcaifDJPqNTozcTrRe3EbZZM/8 8lm22BhdHwkFuPtWahIP0y0uGFa/o4Z6QJNeSXunAGGa5gOJkoayMeZNIUNPoKWaRHisIH rGL7pkra7gWVp8n7PjzG88bc/0k6tm+9zMRzDPsU31+72Dgm6VV35t5KBZoGIg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639640421; a=rsa-sha256; cv=none; b=DoJYDhKl36w/vKaqPXZkidk40Z2l4zkOXz2W83ZcZO/q9q7d4qP0FMOkaSARFyTtJ9dlMu UJtuKmP0xLFbvzRT5SxIOZqSG42tpukefqpcPJU5RSguBMTWr+u6aKxUunuKPqqGMWHHxS TRbzdTvAEyEgxyPvmTUFq98+bfUC4FOW4nBrIyZfQ5YoRAKp1UDI9Mlla4DVg8uySLhRZ3 n+fxlgXJn49S6M2O6VpwYlXBEnG1Xq6end3s+s7o7V7H6/PMIWjK5rmn+ruNnifYItis++ zAztSHzpcC21RSoWOmV+8gjSK2wSNC63LG1KrmbU46EmTjdca/Q83BQRYJpEfw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260453 --- Comment #3 from Andriy Gapon --- Note that in the "old" FreeBSD ZFS (e.g., in stable/12) there wasn't a break after an error from dmu_write_uio_dbuf() and there was some FreeBSD specific code to handle / tolerate EFAULT. In the new OpenZFS that logic is gone. There is some Linux specific code for EFAULT, but for FreeBSD there seems t= o be nothing. FWIW, I think that tools/regression/fsx should / could have caught this kin= d of an issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 16 16:07:48 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 85B3318E04CD for ; Thu, 16 Dec 2021 16:07:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JFH842hR5z3hw8 for ; Thu, 16 Dec 2021 16:07:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3D47E31C4 for ; Thu, 16 Dec 2021 16:07:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BGG7mNq003074 for ; Thu, 16 Dec 2021 16:07:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BGG7mBn003073 for fs@FreeBSD.org; Thu, 16 Dec 2021 16:07:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260453] ZFS truncated write to O_APPEND file from mmap'ed memory Date: Thu, 16 Dec 2021 16:07:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639670868; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cQPEp65iuid8DwupQUionS5bf/lLTnagockjDqlma4c=; b=NgU9DUiYq+kFFip4Yzntnr/SOcFwZnbWifuAPB47kQxQOvYIWC92goytZ1Ei6V+1FFFwGc DwB1j7yZ7JxaTgTwq7UbbVagpN+8p+bMASMM2XbsOz7jtu52QPkaGLoHQOYKp+btG6Y2rn yF9OJAR3rztn65HIJvr+N/KR5w2ncrHdzcorXDOW8lo8e2qOuKlY7Bp73jBRYdb6k++0cf yXT/kswtHD61gfvt2bwVeysK0SHLiuXiycbpDls39rbzGi43vBh93iHg7s+xBVpap1eVL7 1c36cdkM6FLJzvXmquisfsWpBfapEWSZvu9pmr2oMEdhtydZzWOjqmnkYtQGJw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639670868; a=rsa-sha256; cv=none; b=sUf7exG0kJE3DK3qlsLVmpCJOq6MuqJM/2GEZYRI0X9yJ8wJlKLpky300u8kEReWmLSJ5D if1SXq8hcqmcQpxHUJ/CDG8YIQivhBJE7bzg7VIF3xdj8F557OqGFmvEAcZ17UtBRGjrnM f2svaN89RgmIZXq5d8a9mp26QTPIgzHK+6Gvq+zGM1ApzdT99PF7XTYyeH3ux4huljRoO8 RMElVUy9Ma6h1nbhhi05Wkb9uyRS21rXCcPZ2RvGvZgXAKISPhdwsfuVLpXTyYtVqDCzCd L8R92/f+RViiL4Hhpvo33cJAZi78qIXEp39URSYLjNJVOaDEGBTYfk/aNT9+ZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260453 Ed Maste changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |emaste@freebsd.org --- Comment #4 from Ed Maste --- "Old" ZFS reference: https://cgit.freebsd.org/src/tree/sys/cddl/contrib/opensolaris/uts/common/f= s/zfs/zfs_vnops.c?h=3Dstable/12#n1236 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 18 01:47:36 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4F82118FEC13 for ; Sat, 18 Dec 2021 01:47:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JG7yc07qFz4rXd for ; Sat, 18 Dec 2021 01:47:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D63A326D8C for ; Sat, 18 Dec 2021 01:47:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BI1lZxZ065355 for ; Sat, 18 Dec 2021 01:47:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BI1lZsi065354 for fs@FreeBSD.org; Sat, 18 Dec 2021 01:47:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Sat, 18 Dec 2021 01:47:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639792056; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PD/4y5jITWTfxktTfuh5YwGX06IB6kj2Xg4gwOeLjJc=; b=yBTvy0Znz5KBDh+kObpqkTrgj37HhSwYR6wARU987tATRqRIQ4zV8zF4eAsPwU5te2uvs6 +RbqNoCTIjU9tZdrkPm8ZCqt2/g8duXa8ih6J2Mq50DmOjWZQ58VrIrZBchXaBrqINz58W cttFztl5sUAKKlBDrpeAjBepwxM6+6esW7lfMRG2gm5lamjqtOjDX6Kwc835GawjiiMMm9 OAl3Sn8935xMSnAQ3AETMAK2zUr4r5ofz2SjHGKMgqDgZyyLOkVlupaOE7Kzd7qmAGSpyy 5ZJXU88WABnhmC1FQOB14lgOslsOzBmJETjaQKQYskes/rfnTMHgPf3A2Lo27A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639792056; a=rsa-sha256; cv=none; b=yXbl/DBlKv7b31Yfkohg+g0q1XxCfJ65Lj5dE+jE3NgYAwXjzNPmPo7aXPcVbfbBd2wWJf FqfvZjayAix/n1nXxw8UumBK/3R3kPlH0IXWxN1zQhw8baUi+bF6d96WJ8ScRirqrVOZSV 1u4iEnmZ+rjZBa4zZ0mEF6rb9WcFpu9qygP5extH2CSY9fE7NTQt7aPoq6Ke4LxStrpZ7I leamtckgTwy1zh8Vn1JnBleHTr2eozcPf3+H91KcUV0jg/QSxV3FauYKOlV02vG3kP+ghr l0PumhCXhuyBSFpbNTev0uQ+NwYbLatkYJlU4NJZmOJX75rD/oahBynqyJIvXg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 18 10:15:53 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 093871906C1B for ; Sat, 18 Dec 2021 10:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JGMF55J1xz4hG3 for ; Sat, 18 Dec 2021 10:15:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 92CFE5BA1 for ; Sat, 18 Dec 2021 10:15:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BIAFrPp059868 for ; Sat, 18 Dec 2021 10:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BIAFrHE059867 for fs@FreeBSD.org; Sat, 18 Dec 2021 10:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Sat, 18 Dec 2021 10:15:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639822553; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KOsoY//CzbCsv5dyEqN9EM2cGFheIqK71P0On57lkMU=; b=RMWO6fl4vWUqi3jmnGsATDH67eU2S7xb/Y4wXjwZL10Dmq9SYxgzOLZUvwKbdBRj8JIV0V lzpvEeFXVXNbQ+l2H6egxjoMErOgQCGDhSRGd4BXTGlxPTdEksMT2KIJ8n5bah8dq1ODkL kc7814cvxCtEcHC3Nx4nvlSMbjISFyu87EB0FFWJB2JIiVOnXNLcTUjpu0zR8T7i9z/A4n hMbTgDkJr+FTllb1BcMQXKvbQLUUDaeDVVByLL+0u5kq7O0jGR2deYNyywj+LWi4x+eayF Rqw8BKjgvCrbDVZX44LmKnfMBVMHRFo3MnIGsWUIkzKmcTEOJjLr0tTYWKRerw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639822553; a=rsa-sha256; cv=none; b=lbWJj4vLuPdD1JwsEa8EHVzeICDK5mkiOkashxS86HX18gEBv3mc8wOsoTTOCDDZaVfTSj XNi1P7W7azqL9OTvMRuBHdlxPd5ruETKYtWBr54V1twsHKl/Ye3rVQ8SBv7LrxT2qJLV9Z zEVgvPou6TBxe/TMVJDrreKb5V4nEjtMHVQ/ZzmpAeuCjnOuHFPoNtUBp1XvxJyCOAFRom gIYKlqX2V9TCpak529DyLXjDK5DKUOgNsPd9PS3UUDebFBE7NwSg689TA3fjNJnUNc8J6T b0VNPbChCxXlM9eQWTInSEYb3ZSFB+7fG0jy+qEfixJ2ERNACphLG2DrE87aNg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #2 from Andriy Gapon --- (In reply to Yonas Yanfa from comment #1) I am confused what .zfs/snapshot has to do with the problem. Can it still be reproduced if you drop all steps involving .zfs and snapdir? Also, are fish and pwgen requirements as well? Can the problem still be reproduced if you use a different shell and differ= ent means of putting some data into a file (e.g., echo or dd if=3D/dev/random) ? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 18 20:59:50 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 36A8818F06DB for ; Sat, 18 Dec 2021 20:59:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JGdX5677Jz3h0N for ; Sat, 18 Dec 2021 20:59:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AF1CD160E5 for ; Sat, 18 Dec 2021 20:59:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BIKxndE021160 for ; Sat, 18 Dec 2021 20:59:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BIKxntD021159 for fs@FreeBSD.org; Sat, 18 Dec 2021 20:59:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Sat, 18 Dec 2021 20:59:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yonas.yanfa@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639861189; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7lKBSlXO1e2qTXQiRwmOgQIAxba+L5wPqEzQ51l93g4=; b=dJuikBgc6biMycf4o7SahFiaNQlxZpoOx8eGvAxFOwTUYI9Pq6qukshwFOeKNIrW+l2hzW K4eOWx8a3o+9c3oEyxvEM2FN9tfcJ+N+cyc6eD5lZ0D+yrYaPkLkR8hiGFO4Jj1WlwFXwU JH4T+TxBvu7sn2I87baX9hDXj+zNF4vsFMbVANZ7Pb92FtXvE1/QfahUcvfReeIRgp2nS1 k7LWcIrBmIeq3u1DS+SZYRIYEmyOzeWHii4BZjC2UVjCezoifGirPnwi98BNxgp8ljqrCb GVJicdnKYRHI1vtvpswx3Su/SoPOQnLM5aKhSnLmBvXcV9DhOD+1s8Aoe7wGYQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639861189; a=rsa-sha256; cv=none; b=doCTQKyn22bPdv2urhc1beQdmmIG5F5eX0AB2CGk8IIKEeuPj48tbCWZaTOzphDnTBx3A/ U1UmRHIW+hkDMIbhp69WabnZUJfltewVzK8sq/+VK5Bzm12PfV5A/eGX7gzOduHq4IuxYK w8B3rrsaPXoZK7fBo9nXKyU7I6XkuwpfEJeRr2VG/0voKGelqUQTLmmMBaJptktH+lYGPl LoCDquypGru2b9ULz1bDjgiYsyJ/wGbOXHSCSKhn05qqGXemiVQjZSQiO5mBUU6LE/RH53 oSaHvVML911m+kbFouDwDxbgmWwLWpCAmNTZOaCp68Qazyd1UfUhMm9wmxyF9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #3 from Yonas Yanfa --- (In reply to Andriy Gapon from comment #2) > Can it still be reproduced if you drop all steps involving .zfs and snapd= ir? Yes. > Also, are fish and pwgen requirements as well? No, I just used them to fill up the file. > Can the problem still be reproduced if you use a different shell and diff= erent means of putting some data into a file (e.g., echo or dd if=3D/dev/ra= ndom) ? Yes. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 19 21:00:36 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9F44C18F5787 for ; Sun, 19 Dec 2021 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JHFVY2zwMz4ldd for ; Sun, 19 Dec 2021 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5EFFC13FE for ; Sun, 19 Dec 2021 21:00:36 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BJL0a82045160 for ; Sun, 19 Dec 2021 21:00:36 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BJL0a2A045159 for fs@FreeBSD.org; Sun, 19 Dec 2021 21:00:36 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202112192100.1BJL0a2A045159@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 19 Dec 2021 21:00:36 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16399476362.aB7be4.43452" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639947639; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=lcd7SeVbd2WTSndMxyZbfHqePyNW1pKTIIlSo6fP/Eo=; b=P3ovdvdG6RDs3aEbKNb5WGNAWYGrSJlJ1c6q/fH5ekJ2b5f+kycru3INbmVk99nvuLqA0Y yZ+vgu7zLbjxja8F+X8BAJa4OubpgDhPaoPGH0Mk6IJStmhVVHofUtERLvUNVy4ol/tbFC AN9XyH27pOhmt++m1Q4X3o8Nq1LUEheJiRH695dI3CpF+0CX/EWuNPq6wtpvH/X4hE1exY 0XIIWqfP25+t9BLdYDkHzblbVnxuP8DiD38zaVwUf5NtjRRjQyWyMwgi+65fCQG+UQKRD3 G+d+psi0ZYFdGO/CvsBuaLKwaIUOKS76n+xUc74nVJnt2SSzsB0Wz7ouZnzSHw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639947639; a=rsa-sha256; cv=none; b=D74Yi+SsZd0rIZHoFFY2ryQfqRhuOSsp5PB3kcb7DiMn43nq+9/Aqo6NA5Gq3UTcM7MRvc XJQrcwf+27QKbw+bNrWQ75pGILjkusx/am+K1etSKLgke0JlTBFPCFcOzYv56CQMOhyX0F NO+b4NN3ch5kq2JgNPBJCtxn5UBRBEyfnM2BSwItD951Knz2xI0pFe5l/LlTz+hjiiUScn WUxzfF+TNxXI9Tl/TwHOVV4UHskOPPqKtzmgqJxuIrt//taqBQDd5jtkm26K1BMRZOVcia M5ouc7qTtmQRrKUfq1aEGYrckc08WCrYB3Y4Jowv24MlG2BhDWfk53yoIQ/n7w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16399476362.aB7be4.43452 Date: Sun, 19 Dec 2021 21:00:36 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16399476362.aB7be4.43452 Date: Sun, 19 Dec 2021 21:00:36 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16399476362.aB7be4.43452-- From nobody Mon Dec 20 08:03:52 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6458118F9C84 for ; Mon, 20 Dec 2021 08:03:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JHXCr0ksYz3NkB for ; Mon, 20 Dec 2021 08:03:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EE257127C4 for ; Mon, 20 Dec 2021 08:03:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BK83pdh024607 for ; Mon, 20 Dec 2021 08:03:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BK83pFh024605 for fs@FreeBSD.org; Mon, 20 Dec 2021 08:03:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Mon, 20 Dec 2021 08:03:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639987432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Aqb0qIokQT1kBv9Dnu40toUBHnrvgXUR3DFbSY+rTKE=; b=kM5yc1L0cCQ/JutOIIAZKnZzr43F8NhePosQMvIILY6aDDx4CnrdJGAcrGcLjf74kFopTO uTj9RegDgAVDubzZHAu9X9k4uFEra8lRZ9eEfrILcUN0t9Eyj+9WbQgJFAJUKvSqtGZ6le lKhWn1ll+UeDxLgTClMDo/NKMAz1OXRbQnPr3bu385Ny7mz4XzrIUPtMhMEXpA2DlWRlwJ MVR0aix2gZK2aTyyEoNWJrV1y3wDIiH14YEy0Oy2W06YHk443QD4krxcEVAQQdGTwpiYub f3Tc8qTIM88udxr4ed/5Jsre/dpBX2q01lTu4FLabJeZf3vJAFCm0EyLcX5STQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639987432; a=rsa-sha256; cv=none; b=P0SClDXR/BdSXdQ/0d7lqtqYSi2iToHe3yU6gKGD76uzIBAwyXfRO2QG6lzS4uAOLjmX/n AwqqOmvfvarHDtZg7yjqtobmGLktwzEyBMKkQoV60QfOapfJQ6Ye6i8NSC+/5wYKmqtLC/ /y/8r/keCbrULFo6pF/PIH9ncTpeT834Vyv8++FrnGqMGaziRpWCa6GXr0tC4mlUbo1/2A ZvelkOmphYBczKd5uJ5MRQB1YrwL/Vbn9K6RdgQyg0rniBuEpg9UQ5UhYoWemjQGcvWVjn ZtUaYS9ovCJYPOtHUXxgo4lxfy8DpGGPo0BYAlG006ujfwtugIGLKEnFQ/Vxxg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #4 from Andriy Gapon --- (In reply to Yonas Yanfa from comment #3) Can you write a minimal test case that reproduces the problem using only ba= se tools? Thank you. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 20 17:12:52 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CC3AC18F6968 for ; Mon, 20 Dec 2021 17:12:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JHmPJ32jVz3w2v for ; Mon, 20 Dec 2021 17:12:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 496C31A1AC for ; Mon, 20 Dec 2021 17:12:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BKHCqRQ019010 for ; Mon, 20 Dec 2021 17:12:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BKHCqZx019009 for fs@FreeBSD.org; Mon, 20 Dec 2021 17:12:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Mon, 20 Dec 2021 17:12:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yonas.yanfa@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640020372; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=D5+08BK7eGc0sgvYzdEuhjZ5VevMGkE7f04luErwf0c=; b=Xz24t7pBZGguhZ7EvHIYUw9qr3N+Y+lXjDAcIvMG9xAdcCg8Hyl8PVppAFCZuewfjtkrxl r+bUIbvpy5VrnkfMCFdkX2IBQCXEvmJ8fPCO7FSivXEPCUe4uB6LjylJCukA7FbNKsvHWE SLfTcBQkUcYv1QKQAdoXokeBepQ5fOIxtNQwLEL4h0LudAqcwekUJj95/co3rTgXL0IbRU VeBxC8XJmVs4SEAyCVQN3npNtkHtgVt+iND1yIRrw903d1jM49SefTFLzsRBpv0N9qzuip aRU80GD684c3w+KXMwjNfGK8YmVAZCoUj+Fs97f7B45XRXLobEatakl7dp22fQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640020372; a=rsa-sha256; cv=none; b=sQnMBhBH33eG68FjEKqngiSh/0wnYjchcWO2IQRhMUSpt/Dw4j3evfr4hGXovK51cMub+l Cd4uk9bac19LywBhmlQ2E8e47wLCGg9i2SL10YjeuumKXvAqbl3DrtDEZ7I1yYD9dHYfP7 z+DlNatR6hkvU0ah4mAMmeszpj94o5zmWKxN104JNtTwMyqAN2OVOMFaXfy72/CZEIoF37 x6KnjVUrfkfc3Qq9RIdCL4161XWQE03rdcUAfIUbRyiTse8HV5LkHaO6EXb5VtOQ+eoS9C 8CEb2owKhq0eLTnSkpR+K/Weh/B0UhcrotC3s6mdGXpVUrIST2s+Wk2HGtnYIw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #5 from Yonas Yanfa --- (In reply to Andriy Gapon from comment #4) For some reason, this test passes successfully on zroot, but not on my seco= nd pool called 'backups': $ zfs create zroot/test $ echo 'some content' | tee /zroot/test/blah $ zfs set snapdir=3Dvisible zroot/test $ zfs snapshot zroot/test@now $ find /zroot/test/.zfs/ $ find /zroot/test/.zfs/snapshot/now/blah $ cat /zroot/test/.zfs/snapshot/now/blah $ truncate -s0 /zroot/test/blah $ zfs rollback zroot/test@now $ if [ -s /zroot/test/blah ] ; then echo 'Test passed successfully.'; else = echo 'Test failed.' ; fi Here's a diff between the two pools list of properties: --- k.backups 2021-12-20 11:59:48.707273000 -0500 +++ k.zroot 2021-12-20 11:46:29.929758000 -0500 @@ -1,15 +1,15 @@ NAME PROPERTY VALUE SOURCE type filesystem - -creation Wed Dec 15 17:39 2021 - -used 1.43M - -available 9.20G - -referenced 260K - -compressratio 1.15x - +creation Wed Dec 15 16:56 2021 - +used 977M - +available 6.31G - +referenced 96K - +compressratio 1.90x - mounted yes - quota none default reservation none default recordsize 128K default -mountpoint /backups default +mountpoint /zroot local sharenfs off default checksum on default compression lz4 local @@ -35,12 +35,12 @@ sharesmb off default refquota none default refreservation none default -guid 1789944234026602685 - +guid 3029096334883593733 - primarycache all default secondarycache all default usedbysnapshots 0B - -usedbydataset 260K - -usedbychildren 1.17M - +usedbydataset 96K - +usedbychildren 977M - usedbyrefreservation 0B - logbias latency default objsetid 54 - @@ -48,10 +48,10 @@ mlslabel none default sync standard default dnodesize legacy default -refcompressratio 1.70x - -written 260K - -logicalused 606K - -logicalreferenced 198K - +refcompressratio 1.00x - +written 96K - +logicalused 1.70G - +logicalreferenced 42.5K - volmode default default filesystem_limit none default snapshot_limit none default Output of `zfs list`: backups 1.44M 9.20G 260K /backups backups/nfs 192K 9.20G 96K /backups/nfs backups/nfs/new-documents 96K 9.20G 96K /backups/nfs/new-documen= ts zroot 1.01G 6.26G 104K /zroot zroot/ROOT 1024M 6.26G 96K none zroot/ROOT/default 1024M 6.26G 1024M / zroot/test 500K 6.26G 500K /zroot/test zroot/tmp 128K 6.26G 128K /tmp zroot/usr 1.83M 6.26G 96K /usr zroot/usr/home 1.55M 6.26G 1.55M /usr/home zroot/usr/ports 96K 6.26G 96K /usr/ports zroot/usr/src 96K 6.26G 96K /usr/src zroot/var 884K 6.26G 96K /var zroot/var/audit 96K 6.26G 96K /var/audit zroot/var/crash 96K 6.26G 96K /var/crash zroot/var/log 396K 6.26G 396K /var/log zroot/var/mail 104K 6.26G 104K /var/mail zroot/var/tmp 96K 6.26G 96K /var/tmp --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 20 17:14:44 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D9B8318F6FA6 for ; Mon, 20 Dec 2021 17:14:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JHmRS57vcz4QpF for ; Mon, 20 Dec 2021 17:14:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8DBCC1A1AD for ; Mon, 20 Dec 2021 17:14:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BKHEiVU019349 for ; Mon, 20 Dec 2021 17:14:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BKHEiAu019348 for fs@FreeBSD.org; Mon, 20 Dec 2021 17:14:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Mon, 20 Dec 2021 17:14:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yonas.yanfa@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640020484; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BVoS3hww2azw9ahKldXVqz0zXGK4On+mZ6tYZz7Jvv4=; b=VosuKx5/Da7w361OzkimD2N5GsY/aWDSEOEbxPC3WtPXV2xDbp3E56hJ6O4gR7ZzzqlI/0 qTa9NSoWzhqEatPJwoD6FQ6ylrCms4hb1UnXe4GSFOMedMKgwaE3MGaNYexX9an18gnTAU N1IcZRE1tXOUQZAKlJ0G/u7y0+z/E/wNpRpMak771HdclL8whevBA8FnFBz8uEA720riiJ +mDpwhM+czLcI5yDks7M1QY2KR731cAhiUOv2FKbHaoG36eZHGKP3yRCMMYJ3B5bZYh7Or uW+1EDmRjX9oxM9fVrq3r0OkE9WhD5afaHSL4Fe+VnTZGw7AzLXbNPlsf4xCdQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640020484; a=rsa-sha256; cv=none; b=A3lsCFy/C2AxQ8n4uo4Otf8fMf0vpE6YDpdqzQzefRVJGy3w1vtZ6ldfK4QePic4QrLXWH 0RP134xg6RH+Hau9G2JBCyTh3lJNUroTXHfZvGq7MhMpLXTzzhX1Rlht2VBdVaktT50LYZ gHB9MRtl10lyIDSJmSGSaZz+2SRUI6ZepGEZgJNSY/ypAMkyJeTtv58xGkl5/zSbR8qpzf p3azBQa8wMdVAicBPyOVn6GbpXQCjQrBNrPwywZ0U/MJi6mKHWq+wqgJcDyGXpcF6m07fY t49K6E5QOu4gt6nbZ44y9dIMUFak6QImlxei4oLoCJsEF2XdZ6g51qFzLPB8vA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #6 from Yonas Yanfa --- (In reply to Andriy Gapon from comment #4) The output of `zpool status`: pool: backups state: ONLINE config: NAME STATE READ WRITE CKSUM backups ONLINE 0 0= =20=20=20=20 0 mirror-0 ONLINE 0 0 = 0 gpt/64b3c83c-5df7-11ec-9706-838da0b6ea4e ONLINE 0 0 = 0 gpt/6d565c34-5df7-11ec-9706-838da0b6ea4e ONLINE 0 0 = 0 errors: No known data errors pool: zroot state: ONLINE config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 vtbd0p3 ONLINE 0 0 0 errors: No known data errors --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 20 19:38:56 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E95C718F0B3E for ; Mon, 20 Dec 2021 19:39:07 +0000 (UTC) (envelope-from sysadmin.lists@mailfence.com) Received: from wilbur.contactoffice.com (wilbur.contactoffice.com [212.3.242.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JHqf30B8Pz4k7K for ; Mon, 20 Dec 2021 19:39:06 +0000 (UTC) (envelope-from sysadmin.lists@mailfence.com) Received: from ichabod.co-bxl (ichabod.co-bxl [10.2.0.36]) by wilbur.contactoffice.com (Postfix) with ESMTP id 3FA778A6 for ; Mon, 20 Dec 2021 20:38:58 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1640029138; s=20210208-e7xh; d=mailfence.com; i=sysadmin.lists@mailfence.com; h=Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:From; l=331; bh=B+VUdLwRYOHNVm8qD68NyoN4oGQHV5qTxiGX2fkC6QA=; b=MqA0zp7GkNa993Wbb1f+puC20pVHSqtTXrNt9BdsApjA89Zz3OJ6ld95tL8e+eko h1HNURVnvym5+cHixviZVL2jgzYmkhcA41WJlgCqC9UgcjOoLcmmBn0TiWo71HScI3G Kon4OGdETqf8p3vNboH1+NW6ubCNcGhnDYWpuIYeWLR/rvvYRaSscMyjbhZp9X3O7mg Fw6FgHgLdc25IakqaJG4t13EnPAbOaOvTsbqIEqTQ8QBrbtOTtwDu7zxxh6sjG9xinA pmcjrX/N3nZMI5r6dlVlJKKhhy7qzmlNr+/GxUlewMNYKspT+PDcnHo2ki6+b57oE42 /gO1yWJWrA== Date: Mon, 20 Dec 2021 20:38:56 +0100 (CET) Message-ID: <375610556.45408.1640029136036@ichabod.co-bxl> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Subject: Move File on Disk From: Sysadmin Lists To: Freebsd Fs X-Mailer: ContactOffice Mail X-ContactOffice-Account: com:312482426 X-Rspamd-Queue-Id: 4JHqf30B8Pz4k7K X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=fail ("body hash did not verify") header.d=mailfence.com header.s=20210208-e7xh header.b=MqA0zp7G; dmarc=pass (policy=quarantine) header.from=mailfence.com; spf=pass (mx1.freebsd.org: domain of sysadmin.lists@mailfence.com designates 212.3.242.68 as permitted sender) smtp.mailfrom=sysadmin.lists@mailfence.com X-Spamd-Result: default: False [-1.78 / 15.00]; ARC_NA(0.00)[]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[212.3.242.68:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.3.242.64/26]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_MEDIUM(0.21)[0.208]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[mailfence.com:-]; DMARC_POLICY_ALLOW(0.00)[mailfence.com,quarantine]; NEURAL_HAM_SHORT(-0.10)[-0.100]; R_DKIM_REJECT(0.00)[mailfence.com:s=20210208-e7xh]; DMARC_POLICY_ALLOW_WITH_FAILURES(-0.50)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:10753, ipnet:212.3.242.64/26, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_LOW(-0.10)[212.3.242.68:from] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N Is there a tool for relocating a file on disk? Say I have: b - a - But want them on disk as: a - b - I'm using a program that requires the two files be in specific order on the USB drive. Is there some combination of using inode numbers and dd, perhaps? -- Sent with https://mailfence.com Secure and private email From nobody Tue Dec 21 06:13:27 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BDCFC18EE8BA for ; Tue, 21 Dec 2021 06:13:41 +0000 (UTC) (envelope-from Alexander@leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JJ5kD5mNGz3J2B for ; Tue, 21 Dec 2021 06:13:40 +0000 (UTC) (envelope-from Alexander@leidinger.net) Received: from outgoing.leidinger.net (p5b165022.dip0.t-ipconnect.de [91.22.80.34]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "outgoing.leidinger.net", Issuer "R3" (verified OK)) by mailgate.Leidinger.net (Postfix) with ESMTPSA id 712166A6 for ; Tue, 21 Dec 2021 07:13:31 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1640067211; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=Ng6Bc710K2atfR1UrxL1W6eJkki21ecv39mFSX8wgTQ=; b=rpcD/FAvyVMnKoq6JUsFMgUSVOP81ROoIeQHerd2La5YsDPGVufdDPb+wjd4zvNPqSNRZ5 LV5CpcRFaV7coBkVQ4rnaZBa9cxVTfTJIcsEpBlwhzwtRxjcluoDwXuaJjQom35jA5kYvz w88So9DRYv9BA9hmL6ShpI9SJ1rDLUh1gOu915OKsTUwCQIj/BNbRtRYGYn+5CY5sH0DwN wlvnTzC1ZtRE9A2OZXOp0ORkJegsaPXBOgpwkvviT+KEFcFBxkpefLGcFTL27OdHi4Dyyk EmLzTd3hI7ofzjDqOrjAw95miAL9luwVxOjmSEW3Or+EvUyIBufk7L24+lg8VA== Received: from webmail.leidinger.net (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (Client did not present a certificate) by outgoing.leidinger.net (Postfix) with ESMTPS id 73F6563BC for ; Tue, 21 Dec 2021 07:13:28 +0100 (CET) Date: Tue, 21 Dec 2021 07:13:27 +0100 Message-ID: <20211221071327.Horde.mw_mfnUryNIU84kwjRpP3aL@webmail.leidinger.net> To: fs@freebsd.org Subject: Where do we have the boot-safe zfs-features documented? Accept-Language: de,en Content-Type: text/plain; charset=utf-8; format=flowed; DelSp=Yes List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Disposition: inline X-Rspamd-Queue-Id: 4JJ5kD5mNGz3J2B X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b="rpcD/FAv"; dmarc=pass (policy=quarantine) header.from=leidinger.net; spf=pass (mx1.freebsd.org: domain of Alexander@leidinger.net designates 2a00:1828:2000:313::1:5 as permitted sender) smtp.mailfrom=Alexander@leidinger.net X-Spamd-Result: default: False [-0.06 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; NEURAL_SPAM_MEDIUM(0.36)[0.361]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; NEURAL_SPAM_LONG(0.45)[0.450]; NEURAL_HAM_SHORT(-0.87)[-0.868]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[91.22.80.34:received] Reply-To: Alexander@leidinger.net From: Alexander Leidinger via fs X-Original-From: Alexander Leidinger X-ThisMailContainsUnwantedMimeParts: N Hi, I remember to have read somewhere which zfs-features are safe to use on a boot-pool, but I can't seem to find this anymore. Where do we have this documented (or where is the code which checks this? Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF From nobody Tue Dec 21 22:38:45 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C248F18F53D5 for ; Tue, 21 Dec 2021 22:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JJWZs4S1nz3PVX for ; Tue, 21 Dec 2021 22:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7593E1253A for ; Tue, 21 Dec 2021 22:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BLMcjYL058717 for ; Tue, 21 Dec 2021 22:38:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BLMcjD4058716 for fs@FreeBSD.org; Tue, 21 Dec 2021 22:38:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 122172] [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, fine on amd6 Date: Tue, 21 Dec 2021 22:38:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 6.3-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640126325; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HMULc6RGbOkyBoZy9b9OBatqJ/037E9OPQBZew+w0O0=; b=io07SVU47dSx25V0Yau1ZzyrDrMiszgpxjXBi+8hwjRijLN/DYqFJmlLUyDpM2usArYhF8 m94ar0vyWg8uv9j03PJS0AOHhAuYRHlIHPhUvcF74zSZiSSyTvJiEwa8DIcLMUtf2QkuDS OJ/j7pgbxwDpukeDp8rO7s2BHI9LL9+lT45gwSaxVdK0FqTbmQHf5g0XgktMHpCn1HMQAj 8OdAElBsLAWmKd8/l+O9Pgjbpn2v/ExU/t0JUES4AZxS2QBkwr4FeBSkHXun7TxxDp7qMW Of4SqKA8u1kq4+D0uh+X1WT4CRQmrkvXBuG+vNLWVfdDzT+l+5MGC5sHD2zgCQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640126325; a=rsa-sha256; cv=none; b=AZUmAWQxzLsN5sxaCkdvD05EThw5EffucBUB3JFpDAEKzL484ub/wZbADp9DBqJpbg+gcn U9ZsiMqPB2zYhInuS/xNpojiSqR05DSQEjyEoCs5HtAFThuDz6klrOR52pKXa5bblEM157 N+gOu4QLH73z18Oj5dVgpuLbCUIEZCZ71VHGPIiIAyBJgbeFrcbVMU/rPXuz1xCtTg1U64 IS5MoRUHMRaSl4M3OWsXVxkSIe3uxVM5nAWpp9V7BPUrgNkWTQONB7QQ9OkbjsGSCu5ACf Mrnju3xx2Mmd2L99PhNZ+pAGuedzWkLJi/RQ97YXAiQkaynZh9V1qGUeKgs2hA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D122172 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events CC| |rew@FreeBSD.org Status|Open |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 24 22:35:13 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C93821908A1B for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JLMMP3tmMz3vlb for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 679B2449B for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BOMZD7Z033232 for ; Fri, 24 Dec 2021 22:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BOMZDDN033231 for fs@FreeBSD.org; Fri, 24 Dec 2021 22:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: maintainer-feedback requested: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Fri, 24 Dec 2021 22:35:13 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640385313; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wI35zm3fjLagtHTk+nSQohnNunV02mQ9K9i4c+O+GKs=; b=iSA4mneGWgXBMi9O8+9l7+qU9l3U5UEOdq4NtnpBZ0v/1q1wwyIgx4ti/exrOzFk7RllgA zywVDSEcZ07Z+Xopv7WN9kqDPW00WTw02OK4gwY/ewj1hH0eD3vR+PZ32AKBflZ72yYRP6 Q965hUvq9QR57LdRh9M5mJ3x4wclipv/3q4chYwWRvbPSD4ajIlng0Rt/OYFEerFcGrDGU Qnib8PQoiLwoD84dxyTJW8INWecYolHGkoeb0CGbpetg4ZPx5NlL4v2YhZS1Z/VnKhetqA VQ0MqzmvILHGA7Yic3Tpp9yqJ4g5OSsDg9BYRY2tx81vEYCSLf9MCCSKUfaiUg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640385313; a=rsa-sha256; cv=none; b=ur6CZDQTCKtFQ8NRsZgeYlFKbdwWwdc7cyWaxwEiLWKkIArZLUNchrcjCfpntQCsUvxGo4 Ys3sfgtcJkN0KFvJsag0/bJNzw7HnQvjMaRsL0iRckOup/LkBiYAMCKk21htagCr4teyj5 g9m+YgeG+xH01NeyvNjq39Y7mSaFq1QonFVuvhTACZ54RG09HsztNsyWYKq5p3XMIqPZJQ 9SVmnZP/gwY1WeoNH6tHRYYJZsNmu1z+aovfkZAuRjSMViLyL0fZWOlFO7gOz/Wd+NYX1y NhcQpaBhw9/YkgpQv8qK6cKWOfqw2vnxe/3+KyUlctxKSTQ724Y8BViVo1PoGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N Kubilay Kocak has asked freebsd-fs (Nobody) for maintainer-feedback: Bug 260664: ZFS/NFS: Intermittent hangs and crashes after a period of time = in: nfscl_hasexpired || dbuf_write_done || zio_execute https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #1 from Kubilay Kocak --- @Reporter Please include additional information: - /var/run/dmesg.boot (as an attachment) - pciconf -lv output (as an attachment) From nobody Fri Dec 24 22:35:13 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F002D1908A28 for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JLMMP5hMSz3vxT for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A5176442A for ; Fri, 24 Dec 2021 22:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BOMZDIN033244 for ; Fri, 24 Dec 2021 22:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BOMZD0T033243 for fs@FreeBSD.org; Fri, 24 Dec 2021 22:35:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Fri, 24 Dec 2021 22:35:13 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: flagtypes.name cc assigned_to short_desc bug_status keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640385313; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gHbrc/JIFRLnwe3HknNhUmibXkHpyJraR5s4sN8xGBM=; b=u0Xm48viCOi1HehyDw4XAKXep85JAD0VeqlX1IGFecXlXBIqfN6CAFx+R4IGSaG7MWvonh tJeY4rbvOfQFDjE4PqP5YKnWdqj+pmRgHWAwfXWqCMzQdhPjpYcnxVC8U0R2dmXTyRGLHV jgV10vMGSBICEwPhCedF6Oa8+a3ViSUC/luv6ObGh59EFxxltUf1t6vrLiFYr60pIBtu1J N+G9DYP4t/iFXafDYtEE7eiWEpFDze5uuLSEJPDuUxiyF3J5oZacAtEZ7Zc62shzKws3ea Jk6hGyaOudcMI33RIWamqI4dF2FuGUhVgS28YwcLFKKSPhxMpVtrr+2cBKllRg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640385313; a=rsa-sha256; cv=none; b=dYs5a1I63h/CJAkMEVF6tUDIUu/62ivYXb7p1d9/7OaCHRdkocNLXAOjPKIX2OIi5iFdf2 gxYRJrgE4jA+I1GMvJUg02h+O3Qm2JPnhJe2s12J5MOam4pTAH/FqmqIPT4XKB3LO0jKS2 Omj3d9oFQI/DxAl62Eozp/AXT/2HKUeNkDr62JDPsape34bjJn7f1dokiXgz1e3wdEGds7 WsItQZod6XGM7/uOM2QC0jELHyg79X1njPufLq83OM7o38bGY1/8Gd1aKDRWKU0vJHdmBY 8LXl+hbhILyn27wEAfxKJoa+4oUe4SVzBqspMyPh5BDWEv5HzlvJCyhPyxXlqg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |maintainer-feedback?(fs@Fre | |eBSD.org), | |maintainer-feedback?(rmackl | |em@FreeBSD.org) CC| |fs@FreeBSD.org, | |rmacklem@FreeBSD.org Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Summary|FreeBSD randomly freeze or |ZFS/NFS: Intermittent hangs |crash with nfs mount after |and crashes after a period |some days or a month. |of time in: | |nfscl_hasexpired || | |dbuf_write_done || | |zio_execute Status|New |Open Keywords| |crash, needs-qa --- Comment #1 from Kubilay Kocak --- @Reporter Please include additional information: - /var/run/dmesg.boot (as an attachment) - pciconf -lv output (as an attachment) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Dec 25 00:27:24 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 296AC18F2CC0 for ; Sat, 25 Dec 2021 00:27:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JLPrr6VCbz4bYT for ; Sat, 25 Dec 2021 00:27:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BC14058A6 for ; Sat, 25 Dec 2021 00:27:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BP0ROmJ092076 for ; Sat, 25 Dec 2021 00:27:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BP0ROK9092075 for fs@FreeBSD.org; Sat, 25 Dec 2021 00:27:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Sat, 25 Dec 2021 00:27:24 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640392044; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lMAnpGMDXT4WZO8ui42Xzm3ch928EN+Sx2SdQh5E4xs=; b=QIu4cPysQOmlL7ssluLeB/lsjKKsMAc8SiAg28Q4YGGIh6+PO3QW4SQLh4fegcAaDD54E7 T7KuCgronFdQ5h0Q/KMd96L87zX24qUDyyxGCXBeSD4p2cuuGqkMKvBd1avZdWSSnLiEZ2 AXQmYMprnQZ9vkCkEV5XJ1oDmvpzkt3cgMmYA+Zx+Bry/Tr01XWdL7PZKrH+BbJw9QNiHA w1j3vq5GFt0xXlpbUEgWSohCMgYQvpNNpZLkH42R2lkUylJ7pR2/RGP7annCq50AnN0ypE VMXf71rBFRgLK1dmhIKkOV36XvTAF3FQqKT/wJ+EGWEcux8A1mt9+VR84VhFqg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640392044; a=rsa-sha256; cv=none; b=dwpAjXxuX7MbsukEewV0+xkPgTTASJEXIi8tN0orNW9HE9KXUiGLkTWjt6s6+2Rs+qiI5j zJ0oEL5ChbyZcdpTQT0Kp3KKdt/YY8zBDHwaPtyQWSk9nMDKLsozz1B+d4hDokpWiAPscE ulrTlUsVpwGHbXVCcI/jOTAdQvFsMvbtvxoWWBm80VoB7EyhgowJd4j+fxusg2FKLT8S4G /BcmlszAhfUX9EaSxewGXH4pdHFOHwcdqUH5YtmV3aTTg6e0it/8nMFhB4Skh5S4m6dfQ9 T8D9vjBMpjYlnZk6RGM0Dy3Ald3l5CJTLYSlfbJ89OQWWK8zNDihdGwuMZcXHQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #2 from Rick Macklem --- I'll make a few random comments. 1 - Since the crashes occur at different places, I agree with you that it might be a hardware problem. It would be nice if you could set up another machine with exactly the same software/usage and see if it crashes as well. 2 - You should never use "intr" nor "soft" on NFSv4 mounts. This is mentioned in the BUGS section at the end of "man mount_nfs". To get rid of a hung NFS mount, use "umount -N . (It can take a couple of minutes, but normally succeeds. Note that any file writing that was in progress when you do this will get lost.) 3 - If you can still log in and do these when "hung", capture the output of: # ps axHl # procstat -a -kk # netstat -a # ping 4 - nfscl_hasexpired() only gets called when the NFS client does not get a response from the server for minutes and then gets a NFSERR_EXPIRED reply from the server. You did not mention what NFS server you are using. If it is a FreeBSD 13.0 server, then see PR#256280. If you get the output from #3, please post it here. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Dec 26 21:01:41 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D2C92190DE8F for ; Sun, 26 Dec 2021 21:01:43 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMYBZ1Vpzz4YRP for ; Sun, 26 Dec 2021 21:01:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DE4DD11A8D for ; Sun, 26 Dec 2021 21:01:41 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BQL1fY0022949 for ; Sun, 26 Dec 2021 21:01:41 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BQL1f0G022948 for fs@FreeBSD.org; Sun, 26 Dec 2021 21:01:41 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202112262101.1BQL1f0G022948@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 26 Dec 2021 21:01:41 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16405525014.351aD2AF6.18344" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640552503; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Ob5WfejxcxAArSTyNVXJl438ThRHZatG0wf6dX8jUhM=; b=YyJrCUdEXdp/abITmywYwhBFv9D3mEwybTm8NPNzWMGXFb/T15m0tHDzNakglD0ruJDpvO DqQnHtSNEasznHYzX2tfJYT4e6Sblanb5Vq4Uj2lvZhQwJWbXkEbU55V1oV2zUN68bFkDU BFidwEegsSYMjo5WtUrpiuVRPkzLA9Un3f85I0C9Dq6QfaJx5Zo0yWSPCpqtK1MdLreXFQ l6zHDbVz4nazlYgxjz1wCOT7QjWEqKzpZbP/er0pasQRPAiTTwGsISEv7ZZ6PC0GsLW2x0 2bO2lKplvyxtsr9FSwkrB3S1HLJQIwZb9+sFIZ93LJGNNEVb1cmUn6IBX+JJng== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640552503; a=rsa-sha256; cv=none; b=HKHsQ1jSKb+m/LRxdqx+0GHftxjKOFCenfJnHclwxrsJKGR1QXyog2UhoyBwaZq3ROx0wq sY5Jx9sBkIej8Y3o2szVM+1IrGPto4XHjeZWRpXlIf5+2Q5Ns8bgJYrSOTf41WD22WaSI+ 8/aupYAEFgkiR0C1xwGv7YGbgpnodIYtIiz0x7xrGWF6GILQjLsp5B5OlPLbM71ossnNXU zO8MP0O7aqvcbNxL4n9FmhXJp8DyjMAIREcY1jyqt/BaYU6M7IjdoNVWVEbIBqoojh0VP/ p460QxJGcrPtSgEOPA8A+I/LABiN3bmPuAYae/TR2xTixUrv4DXbJHEscZhoOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16405525014.351aD2AF6.18344 Date: Sun, 26 Dec 2021 21:01:41 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16405525014.351aD2AF6.18344 Date: Sun, 26 Dec 2021 21:01:41 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16405525014.351aD2AF6.18344-- From nobody Mon Dec 27 02:04:44 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6E981191A45D for ; Mon, 27 Dec 2021 02:04:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMgwJ20yPz3DVq for ; Mon, 27 Dec 2021 02:04:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 24DDA15ADD for ; Mon, 27 Dec 2021 02:04:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR24m2e082285 for ; Mon, 27 Dec 2021 02:04:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR24mwE082281 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:04:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:04:44 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640570688; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ApgcE7BJHoUKqKP8gvdqf5tgr1mij5RWO7cqhaG6f1M=; b=Cuck0z+MS/HE3PxPDbx3IP2mGPO2Vae4cdTp3IvEaQj/wXuHy6msaw1xc682QrUcEO3wd6 RWa+77GaMh9TOne7ezKpU37jR4fo8ykMoPbRU8nUaQ7g51SCyPsHAg7ljxxUHf2NnNUi8n QrCAaICjBg+KCk+0doBLIoeddJVmOPGGZiRtnEsm+3T5ATh61J3BGcBztB24Q3HMkVuGn7 HEkStlgeIAv7w+o6PUEya7/EERdPZxlNBoIBvLawUKORBBBaYpE5d4NvWHF2sb90bF7fcv PGm9QUCyPYsRoHxtukhoTlwj5N1P7XCyMy+PRIfxDXoxLrvNx434sxkX1KS8RQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640570688; a=rsa-sha256; cv=none; b=dhcR8VuaOrmqouymz8/t7bhmggFLdVk0uBZxy8QVDFIUy0z9/acYB8v5JUgLLlgqvL33RL jXoJXgZpxfRxGMjX3FNVG6UWd5bOpExYDn8QuPQFvUroGdYFsg0xL5GBwXT04g+NKDrUPb 6s2RMQVk9q7o9V+YTXfbwm2gKA7roZzGo4p93t269vtt2LOe3bXvat1zLejdrxdQ3TQYbK yDoRDT9WaJVwf7WC/bpwjWzPYvfirLZisMJiZdHZjxV2CDIAVruR1Ihw5eBVAmBkLnzgmo sm8MZ1EJwcOrWyqmoRQcV4h+i+FfrW397Eb3zQEz22cSbA6gy+mRkc6z3bfKXA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #3 from Pader --- Created attachment 230434 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230434&action= =3Dedit dmesg.boot file --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon Dec 27 02:06:36 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CEFC4191B371 for ; Mon, 27 Dec 2021 02:06:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMgyR43Dgz3F8d for ; Mon, 27 Dec 2021 02:06:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6AFC715BA4 for ; Mon, 27 Dec 2021 02:06:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR26dkt083544 for ; Mon, 27 Dec 2021 02:06:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR26dom083542 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:06:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:06:36 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640570799; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6nm3smDMlwV75Y9qYvx4HxJ9b5d4cZUfSe/rY0eB9nM=; b=Y9nLmVBmDFvVNM8EYuDZ4g+59gTHRwgXQ+R+2U6oyVjy4ipi4gDfRORmjkGMJP00yDbWmV cnjn3WGRyGMazMgYEVn0qOO8riKePWZ+s2sgKDb++hylckVAGQA5X8kZbNK9F+RTclPzN0 vwGuEs87p9O5McvZGNB5BbOChlniATTxrYC6CcQbTqC4lzv4Y/SXS0dZZJSqSb4xM5v2IX GQ61pFeJ3cnLAfuYyciQXtrMiYt0yM2pBSABj6ovO6Aa1QO9XSSD1K+tbhs1aZM+6hG5WA 8lTmKnqGJCeMmid3Npmryer5sCZHhAwW+9i+AZ1xnrPQ31dAG8jQ2iRpSXOVwQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640570799; a=rsa-sha256; cv=none; b=uRlXRZ6IX0R+bNuInZ2mBNFzRZdfQcAaTaxdKWdsYTKjurmRasIFt6GRujb4sWQE9HDC5L PVpIfnoht9QwGHUFQGduc/nT0rgTs8nOujIdcdUjM7vb7+vQYeYqFzNYXCdthz6yWO7LuD Lb8YrMPGnMyKg6TSgOtfdBVOirUkv434MP+JHvfdjbt9rrBwpqLDe9btc2n93YSlSdmJ6A Nq/iGtj6a75uB/OuZfAfv0YpvgeQdD+cETbSR5ZNVPbABVZlr83EaCGiS06X9AUrl2kGcC 3blVGJYSecI1VGE2B4JTIaIoQrbiwSoD1yz8SFLwlE+ZeOEkZhXlasWWRlJLwg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #4 from Pader --- Created attachment 230435 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230435&action= =3Dedit pciconf output --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon Dec 27 02:13:39 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7042B191EF7B for ; Mon, 27 Dec 2021 02:26:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMhNq1hTPz3Jp8 for ; Mon, 27 Dec 2021 02:26:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 17CAA15C7E for ; Mon, 27 Dec 2021 02:26:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR2Q2v1096104 for ; Mon, 27 Dec 2021 02:26:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR2De0E089641 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:13:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:13:39 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640571963; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0bMRyVr+Bv4Ln9Y5cR5ps5eUPS9sYsnmMSkip+R0bgs=; b=ag3SrHmTb1q59axe3ttYxA1g2mQ/QzhRqlKqwDhS7i+MNiJBLjsynKj4e2r19ADqYHGl5u k/P8jqjxYAhvpSzoNz53Wj051skYz1MtdL8mkjJ7JFx3s902n3/WtFzDzVvjvthqtTl3cn cEXJwmqg3HN8kWUtvygXUg4p4GzkRrUD2WJWAvNohaxJE4Aqk72Xhzp7K7eyVpSO1DDtTy nna/qp1xLpwUUdwbxdseWvAArcUQDT34OSq90hV56zEn33S4s9BinySMvFG6LmvsYNJKz6 WfrRKJom9DqOFHSI3ofmeJXmrT8YK1rAJfwRgVijupEfFn2kzDbKscaLEGUM3g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640571963; a=rsa-sha256; cv=none; b=mt+QnCNnGHRT1+GpQDqYg5f+3hPgPSpcYsvwKyNTbUIPrE4o+Hgg1QpZMQQQnTHf2KXpjo KU0GxDb6cVq7iao3kpeGCL1nGLVIw9eBANYc+7Y8Oan4HBgTDhZNTqDG+e4vL12bIAW7Yg L1XfMlZO2uHiGFAJwT+wuG9dhFFhw1YTO3ar0wScWhUtPleux48kwJBOifpYFTHepRMIeR /M3eDfyCs1ce+WbNfQKeHDY1scx3jtOVDMhMIYeQ2xQkh7p4PZsANQR4ePUA869btAD0Ao A1Y/aui3qWVOixV753KEAx315UjAYws3HnCCpT8nhsP4a4LjY4Kju4j6vdjSNA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #5 from Pader --- (In reply to Kubilay Kocak from comment #1) Thank, I have add the attachments of those two files. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 02:34:43 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1ACD719010DA for ; Mon, 27 Dec 2021 02:34:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMhZr5Gmwz3Kwk for ; Mon, 27 Dec 2021 02:34:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 950C015E48 for ; Mon, 27 Dec 2021 02:34:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR2YiGi000511 for ; Mon, 27 Dec 2021 02:34:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR2YiZJ000509 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:34:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:34:43 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640572484; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OyL6Q94WYytVrssMzOQfEOkQEZgg1vAssVQLFPAsLmE=; b=wQa91DXF+TuHYi/zZcPkY7MuPfG/s9Uyyq/tNZvzx8pr/IKLF3LrMeToHfpaNUPuZKGlmb bCZNlZfhq2ZVqG/3CMWwbrL9y38mREXMo0vyqdPTP61GsmC8+fhA8xV27kCXPpE4/AGXTl DtDe6+//lZjA5rnSY2iMA2o5ZphuISHLxArz3bUjRTcZvL3u4uNyaE1y4yJ+29bUwDW3Ev pWdpxj+fLD4Im7Q4goKP7QoS+VUKxZeCYuD3uo3W0yXN6xUZ5eguc1hafAGlMHBu8HlhcV Z5mtF7uEafSIq+b1y0yN4H8N3JAa6y4K26Ke3oGDDey469TCaqTwEkeSSUjgHw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640572484; a=rsa-sha256; cv=none; b=Xoasma3YpBYWIPJ3fBN3Y16cY718oamgoxRsfh3JKPGIlhD9UCiFo6qixbs20wyXwEfNOb mvKC5GLv18pjPFLtHQzuPO1GTGc4DYi7KX8gLJ/TSLxTPWMHa/+zo2JomDnU6ha3XgKmGl z+kVLvgJxoqnaZaZurD1ej/i9S0FiRktuES8fQyU5I56xQOMrUGjkrJs9tmexnFA94Pz+i BRDjd2suKeaJMdOb4dC9ZUwGjljYFMdXOEgHmjxWQJ2ixRk7in7YxJSGP/7fPTYCMfjXov xpacxzj/z9m1ayZ70s/ufDX9zWhJOwYpacDCaGd7mFA7p0vM24yFbsxGcvgNcg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #6 from Pader --- (In reply to Rick Macklem from comment #2) NFS Server is two linux servers, one is an old serve running almost 10 year= s, another is a new server we set recently. I think the NFS servers are normal because of there is about 6 linux servers mount these NFS servers and running same program, and they did not freeze or crash. It just so happened that the system crashed today, I will add some output f= ile attachments as you said. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 02:48:45 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 70EE61912430 for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMl3J24RCz3lJh for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 27FFF17B5F for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR4Q3Zq059625 for ; Mon, 27 Dec 2021 04:26:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR2movo007735 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:48:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:48:45 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640579164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8z1UvTG4qwCzTSLSRi9plzm+gU5hGYK0Jg3p2EQQGQ4=; b=MZVa9/4ofoGDxpYGx6wekJn+ho431EcpUzjZWTV0lYzx62vC1LCZs1A5AG41Ep0FZgJEiv iI3SgGpt2LhYpk0yVoaMUAZuDoRwZO5s4JMWMoNfsSpnwjXBeuwe59Y2WRHXOtFgViFWZo sgdF3MtIa9UTGG1gI3PIsGskIg2AWk2Fh+WZ2iE/mt4BZE+0amo5ZphcsjqEn5SeWIyJ0F PxdYZdtBs2bxuof1fHulBPNlctHVoZcW+3FfMJHlRSDqW9IoXwq+k183YOUNZh1BRKq5tT RvzEcqDJyX9+TFTC8jrv2XCnUnqAh/F6kCIIE8ypu4txXMKYDVL64/oiqltyzw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640579164; a=rsa-sha256; cv=none; b=LzUCejNAarKP/jaXT68J2BKOHQ2R6iMABd1nUlNWFdB7rUa/QfsRU6h56MGpyCMWDX8xCx MXwXzvLLzTb3aAhmv5i3ehjuQ+m7hi7OPxdpurb5DOc0iRjCuW3I6SR1YqJC9J0QsiTNjC 2G9VPnUf8dqABshVnWzFsQ1tVIhF55kWLMAvCxb9U1Lhp6rjBa1hFI/++1vULfbfNvbx9B P5eeehyR1pMd4XOHUxpQDxL+DbPGbo4slqz1AcHGDPIvvdBjU/mFRd+dcKcOa7aOz4aKKK 24wFxolFD1WGMvxtzpwn+xcbpq7jFb2kpzQB7l+UKv2zvcRmfN80ZvGO2xJHkw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #7 from Pader --- Created attachment 230436 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230436&action= =3Dedit ps axHl --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 02:51:04 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D032719125A4 for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMl3J4gLQz3lGd for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 817F017B61 for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR4Q3Zu059625 for ; Mon, 27 Dec 2021 04:26:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR2p8HC008214 for fs@FreeBSD.org; Mon, 27 Dec 2021 02:51:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 02:51:04 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640579164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gEwU8hxwJwAxb9nzA98n5ctNkz+P7A+clmTyAdH8Ab0=; b=ehYKuy5JbmStRA7BQ5ZbWKc1vhHQNbM1HiRzwxdXtPq9sCo3z7zweYTGaCrep62hyUreVr 3D2gG5GDGI8YwJkR4R+EwYCRd8y0Wi9aA4PGOK84gcUqcXy5dRFnjE7UjLwjlvSOFUwTPi EVEbAH6TMknAtx8jFNKRxMnPzzApUZYHkXCaOYkxqbqSGtflozLo8mmQ3Pz6xpKTNyKgL4 mCDVjcQ7k0QdDPPXWPMHOXzdHr+zlU31j7fn0GtGf+nK3nXQLoB1Mgh0MPwW8h6pwX7TmT M6tn7EU/j7ErnqBDFn0s48H84824ZlWNq5F20TgiXtgkmMJEg5g4LHlkjqTOWg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640579164; a=rsa-sha256; cv=none; b=S528e6ODmAQFfxJDCiANrPowLFGmHIJgX/gak28tZ3bkrqpEcIaUdqTC+oWOiDqK0IAXWH GHd5jfU+rChokOXysMXvDV7WEPjUWIE/E0Neq27oZibGxaNwWiM5GrRUq8dPrESUiTdgIk g6sS9ho+UNechlx/S29lSZ/YgmT/ElIneZBIOK387Cr/28V4cIIh+7strWqy92+cRxRBpr 4oPuHLGOjPskx4iZTbE+OOh2QYNio1T5ldwR0V+IwYrexMKm5wpZ8WT/R9aOlap9xj0JE/ zIj0g0q+7Jy3sCtapNWPjcmzzrwHUwRPc+r9Dt3r4bFui+TEbk9acuX9vBsTgA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #8 from Pader --- Created attachment 230437 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230437&action= =3Dedit procstat -a -kk --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 03:33:12 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9D36D191249E for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JMl3J3L0hz3lLs for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5379D17B60 for ; Mon, 27 Dec 2021 04:26:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BR4Q3Zs059625 for ; Mon, 27 Dec 2021 04:26:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BR3XF3H031421 for fs@FreeBSD.org; Mon, 27 Dec 2021 03:33:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 03:33:12 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640579164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=u/bc/iRzfBS7Sn9417Wpda6E1un2nN8G5nrSDQJdn7E=; b=ROOTU1A35qGv2D5BynbXjfUiO14ojTmu5VETKgPBh+zxLEcyYmYottlnZEQKIcGyyboICp nhUimYRygOZpZnT07sZVZ+sGwHbnWLxXV+SmOt2wtOIpj1ipMTdlI14fx6DllZZkFbfPP5 N7uZaU6eI11fHnM2PNzJ388qol/uWHCFamHyfykj9nF1W/oFliBo+bYA5W3L1w6b7kVma5 Dy3x55fVo+6Pr0LpAED2coRSscuJwdyL7eZuIpR07dRKIoV2wxLu7yobZLhDc/pB2mJTwp xhWUsPWLpRFaaP6EQFZxmI/RHT5XQCqXiPKZFMqeUpgmqqAWd8kvuEKgApGYjw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640579164; a=rsa-sha256; cv=none; b=Is611sbaXuObMkQbVQxX5atmCHL00XNr45qkJRDbbzZ2YhGTd5+cDgLpX3nsZpSSjslAuz 88WS034p0I8L1cTk/pS1+UUTgChu39b5J+Cfvb+BOyfo+thmyQLwLuM2JECxJorbFtPw3p /2CS7rphZ+W1oOn2IAJVMHwiK0+yAkwVuQamwIthC7wVtt31nGraZ49khaOEzDMkhWb03N svd+izOE7LUUyty/hABTxD53k1Jw8IRNS2fW4U6oBaXPYuKDQj6YYSMct+DfjZgXEGR7N+ jR5munLLd3wYdXIDPU+Ng/HJeWt+Jwyrc/+l67/QcRLkhifWgkuPIKomXzAZnA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #9 from Pader --- Created attachment 230438 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230438&action= =3Dedit netstat -a --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 15:57:07 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F353F191E359 for ; Mon, 27 Dec 2021 15:57:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JN2Ng59Brz4njr for ; Mon, 27 Dec 2021 15:57:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8E36520CA5 for ; Mon, 27 Dec 2021 15:57:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BRFv7se027825 for ; Mon, 27 Dec 2021 15:57:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BRFv7Y7027824 for fs@FreeBSD.org; Mon, 27 Dec 2021 15:57:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 15:57:07 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640620627; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kLoXaIXBpGqFhJ9WySPpHp2LgpDUE8qAR2WEbnUgdd0=; b=x/CIq+U3BR8Pw6vK0Xf4xRF/LHiA/D1k7YggDzsxgkFOnzzIIM9WxW75VUqVzYRlltevLs Pyx5eSVaAIKyEH/qgJ9RO+LDEz76AK7z+gduO9ewtKInAsFtZbo1B4DgK0xxXewMmj5dGa ILvcaWa9dQ/IDqG5OUCPd/6knuHUoFPcDr0fHrOd+Oo3N4cLRbec4VTFoRzg8+bhTWo81m DhmD77/IdbjOdgiwoZLibsIkiVftjhOE1QyBfS9gezgE8NaHGowu8rBAA4/u0s21ncxYU9 aoHaCjlQUb3L0ndKDsAM/mPXCO1VinyhqEyEa7M/DUC9Fnf3qQeaHNtqOk9mew== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640620627; a=rsa-sha256; cv=none; b=BfIjVzVnGQ/kZiry23VD9aOx1O6LmfitvxEQbyH9A4Y9upShmLj1H0MiQqKRKvu5mtybCG WZsEswyTXAyd+JS+9yVDEyUcQDCF7U1GwM8SSBQ30bR631j2gLfMNkk28pE3XLtI0M7uoO Sn6XMlyQtzblRuOpUsjt685Nr1tfW+6RgDPxN0dTERixISfnuDNmdJFaBNS7C6uKUjiYe1 CKgUrDAMSsPKr5K91HpdKvO/LiVFYO7yjqsLVV0x3hzOqiz+cB3peF9CoARf2jOnxballw /bqM7fY9hTnHMRiE4KIdj3QaNbWW5oAqS4OpvESn4wdnf907iwnLiJcD99oPrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #10 from Rick Macklem --- Would it be possible for you to upgrade your kernel from the sources for stable/13? There is a patch in stable/13 that fixed a problem where open/create would defer to an exclusive lock request and cause a deadlock. It is commit 701eb03cc0dc in stable/13, but I do not know if it will apply to 13.0 kernel sources cleanly? I thought this could only occur when delegations were being issued by the server and, since you are not running nfscbd(8), delegations should never be issued to the client, even for non-FreeBSD servers. You never mentioned what NFS server you are using. If it is a FreeBSD one, make sure delegations are not enabled. The sysctl vfs.nfsd.enable_delegations should be set to 0 on the server. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 27 17:20:04 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4467B190FF4A for ; Mon, 27 Dec 2021 17:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JN4DQ0l9Yz3J8g for ; Mon, 27 Dec 2021 17:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EC95621E11 for ; Mon, 27 Dec 2021 17:20:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BRHK5HF072319 for ; Mon, 27 Dec 2021 17:20:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BRHK58J072317 for fs@FreeBSD.org; Mon, 27 Dec 2021 17:20:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 27 Dec 2021 17:20:04 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640625606; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iyx6qsiTa9CmmsZnGo+cUg8mzYNJacEtLgoUrvbuUJo=; b=LiBfmm90Hy4M0WG0ZTySvheWsmsR/nVHdGx1nSo+eRRu/OO7jgtEQv6VkHA9dl/WQ54KoH HRz1cx/s8EiMMHHRCZnSEVcFn9dJUlHdwRastK4Mkac5h11vhUym4JeOXchKY4zIINFh6n TLMxlpD6plkJ7sAk/HSaICF9QBG19u12f3fJDEDnAcw/MfHAqSRTCx62IJUfcikszlH/cI RJRII55LM5Sog1BnO4E4kRgoOLthUuoFaS8CTA4sPh3/lHH7Jzxgr8LJ3bU6sJ0dZ8Xh79 Pe3Nntzdmp6LxNsQ9fcWJeAEmTXpcBQGqOK9xtukEwNGK1dLqqXIs7E4Dy3vgQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640625606; a=rsa-sha256; cv=none; b=ukwfOpq8jOuMVRS6qLnIOnp/nMcAuSNOE0k+fkWiMuCdmjWeByUS29ZNBbCzM4csoInaMK Vc0xyM+2VTYOMqjXpJHaqv8VON1CAV/TyNlYaNbPVmCvEIQu/gW5JEujRAuRCPWmeU2m/4 HwyjTOenmt4yg9oE4/d7+rvp9YBLmM2sk9LNkyqR9toz4VUReeCbkobn3sJKicozmI4h7F 9soTk50GVuwYl4X0jIC0bmEi6iTjriCBMVM3VB/8ahM6fcWXeoDefHsIAM9S/4Tn8DLTDG H4Mxr0e4e2kGl+1CcghUF/5bn3QuN06GRSoUjSMGQxKEfsSVfxMbEnDqb3QAng== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #11 from Rick Macklem --- Ok, it does look like the commit in stable/13 would fix this hang. It happens because read calls nfscl_hasexpired(), which tries to acquire the exclusive lock (similar to delegation return cases). However, calling nfscl_hasexpired() should *almost never* happen. It happens when the client has been partitioned from the NFSv4 server for at least a minute. For the FreeBSD NFSv4 server (which is what is called a courteous server), the expired only happens when a conflicting open/lock request is done by another client or when open/lock resources become exhausted. When recovery from "expired" is done, all byte range locks are lost, so getting the client/server into this state is to be avoiding if at all possible. If your NFSv4 server is a Linux one, expired will happen when the client is network partitioned from the server for over 60sec. In other words, I think you have some sort of network connectivity problem to the NFS server. As an alternative to upgrading to stable/13, you could switch to using NFSv3 mounts to avoid the hang. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Dec 28 04:33:18 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8D0DD191BD97 for ; Tue, 28 Dec 2021 04:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JNM9C2sQLz4bpC for ; Tue, 28 Dec 2021 04:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 44471318C for ; Tue, 28 Dec 2021 04:33:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BS4XJZx037304 for ; Tue, 28 Dec 2021 04:33:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BS4XJkV037303 for fs@FreeBSD.org; Tue, 28 Dec 2021 04:33:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Tue, 28 Dec 2021 04:33:18 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640665999; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Y4Yd23OOFG8ykCqdqyrZtVZhkusLKGbJvXcfjbw7MA4=; b=FCn5Z3Gqi76B+lqAHpdJkp5qL8iFJQiib70zmsGo+RpvOhv22EopCgnj0xdq0Ucu8I1jsR LmmtK2Opk/F5sWvSSuYmBYvPgdlqyTa2NRiwBfZQhiDKrxogoXPVP1HUfEpvLVzK6E24fF TWMlyWge4j0GksZV7h4rN2L7joCQsOrZgW9KO89TOVO6HKYfh0cxcEpv5rIsWv1zwjgtJH 7Rt1Qu+zw+PVz5eN7BO5bCx3BiWQQ0p6pEVcfkdoVGwhZxB4+zNLYAzgH/vw2GbQFpvDv3 pCShlpIzDiGR7Bla1zIGjcggLsj+J0Vx9mru5VDNgq015Gu7e2IY4x4OnJxVKg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640665999; a=rsa-sha256; cv=none; b=UWMrJN7Dg9/L0nWlIFv26k20GDxfaRO9854NG4w9ch6XmbxPy7fG4SrxEjWH6kQz2NB5FS cNcuXMD416oDIGmXcHn8hWoGR1LpqyfnU1A97rPVpJMtYe4f/wK8yzLB/s8sl/RHJ98nmG AaseM4Oyjoam8QcfPWxw30h+CTDAct7RfCzTknwFAgzxiJpC424iTlzGz9j6hjOPrUpPz9 s4t7ViwK5ifJ043ZNW2mTPdlAPAah9FQE2YbxO+zOg5wV4QJtSmJQ0qV/hENkQIWR7Dx7l QQMLBUgUyhZ7PRa9G3JbyXfGKX9axW8ORgKb8ps3dpFFL3yVXRoyF1TnrjfZAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #12 from Rick Macklem --- Oh, and try disabling TSO. It's often broken for various net drivers/chips. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Dec 28 07:47:35 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5B01E19115DC for ; Tue, 28 Dec 2021 07:47:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JNRTM1FMdz4sYg for ; Tue, 28 Dec 2021 07:47:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0857657F4 for ; Tue, 28 Dec 2021 07:47:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BS7lYBP037184 for ; Tue, 28 Dec 2021 07:47:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BS7lYaS037183 for fs@FreeBSD.org; Tue, 28 Dec 2021 07:47:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Tue, 28 Dec 2021 07:47:35 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640677655; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0KVTJIW6pMigpFBSkvM9EMupu+Fr3HyXTFWL7qcn68w=; b=M0FaHcjYdZtiVt3tyAqvosarIK1bOn/MKQkLsHK4gC7koLUxQqbS55JmH4O6kqd5+yeGtT 6qTCSQKApR6c9bdxPWVrgtX6pPR44Y2TtZKqqiGYn9WpL7P5EL5ZTP4+mmcZexeisD6+KC bvO4lIdN4yNDLqvLKYgV/j/Z9veRC3Rb+gOufF6At4pVWvajT6/2lVn5ljVe/WFVXDc22V +jE0rjFePO+cYAjhkPg7QjspiVzyZ1rA144BX2UX7kCpNOrA5/r1aSjDL8/TJpLuNAhyV0 rz2ciufU32d+6EklwCEEbMZNysCOEtHDi61YQfO7MwzbxG7Ca/pvve/wJqhsVg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640677655; a=rsa-sha256; cv=none; b=xlmgL2sNgPY/mUnXa5WqOUImQZMtHr+eRAvdj3iF/m16T21u4WxY2r4ZzjNDxb6rVdquS2 DMSNHRRri6DEsmpmShvnRg1S027536p3nE9v/QmTtT+YL/b7naMKUmoQbWOCumwP2n4+MN 5NLSUhzEb82rHFJPd1RgOl/t9E+trSr6LPDuDNHcEEdq5FiAdAj3sU7rgNJ9l7ixePP/y1 weIJhd/nwhfYMRdRVx1YtGTaziik1TwD5By6sRBsz6uAure3e2JGMlk2PF/Z8tCPTdwKbo NUia3JmFv4ATNfZ0NeqnXv5xB2kKLbpzrArMPkN+BEU9LXg9kGn7hdnsL1OtNg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #13 from Pader --- (In reply to Rick Macklem from comment #11) Thank you, I 'm now trying mount nfs as nfsv3. One of server mount as nfsv3 is ok. Another one report: RPCPROG_NFS: RPC: Program not registered Do showmount to that server: showmount -e 192.168.1.2 RPC: Program not registered showmount: can't do exports rpc However, this nfs is not strongly dependent, so I don't need to mount it for now, continue to observe for a while. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Dec 28 11:43:23 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BAAC71917D7D for ; Tue, 28 Dec 2021 11:43:26 +0000 (UTC) (envelope-from longwitz@incore.de) Received: from dss.incore.de (dss.incore.de [195.145.1.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JNXjT3n6Pz3mLW for ; Tue, 28 Dec 2021 11:43:25 +0000 (UTC) (envelope-from longwitz@incore.de) Received: from inetmail.dmz (inetmail.dmz [10.3.0.3]) by dss.incore.de (Postfix) with ESMTP id A52186BC53B for ; Tue, 28 Dec 2021 12:43:24 +0100 (CET) X-Virus-Scanned: amavisd-new at incore.de Received: from dss.incore.de ([10.3.0.3]) by inetmail.dmz (inetmail.dmz [10.3.0.3]) (amavisd-new, port 10024) with LMTP id 4WG6t9xPipvR for ; Tue, 28 Dec 2021 12:43:23 +0100 (CET) Received: from mail.local.incore (fwintern.dmz [10.0.0.253]) by dss.incore.de (Postfix) with ESMTP id E68B76BC52F for ; Tue, 28 Dec 2021 12:43:23 +0100 (CET) Received: from mail.incore (localhost [127.0.0.1]) by mail.local.incore (Postfix) with ESMTP id E00041CA for ; Tue, 28 Dec 2021 12:43:23 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=incore.de; h= content-transfer-encoding:content-type:content-type:subject :subject:mime-version:user-agent:from:from:date:date:message-id :received:received; s=dkim; t=1640691803; bh=u/MbbVEMsFxZa3ZBDRi 1vQdr1bo3xNRed1RE2k12HFU=; b=LzYd2aF2N7mofJ4crZlqHzkYHlObwrby7a2 WZscwoA5EA72R26ciP2WyW5ddBmvMtM+55f1xWCF3XklY6TfqnRYOx9Ob08OcT+l te3xgSZ/dnjZYpk8kzwIcqvLHpnCZAx1gLFNKXeBE23d/d5RNeDibEITNmYGpi8p lqK93J/0= Received: from mail.local.incore ([127.0.0.1]) by mail.incore (mail.incore [127.0.0.1]) (amavisd-new, port 10024) with LMTP id PXk63C_SS3wd for ; Tue, 28 Dec 2021 12:43:23 +0100 (CET) Received: from bsdmhs.longwitz (unknown [192.168.99.6]) by mail.local.incore (Postfix) with ESMTP id A0C101C7 for ; Tue, 28 Dec 2021 12:43:23 +0100 (CET) Message-ID: <61CAF85B.3010700@incore.de> Date: Tue, 28 Dec 2021 12:43:23 +0100 From: Andreas Longwitz User-Agent: Thunderbird 2.0.0.19 (X11/20090113) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Unnecessary WARNING when a snapshot of a gjournaled filesystem is mounted Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4JNXjT3n6Pz3mLW X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=incore.de header.s=dkim header.b=LzYd2aF2; dmarc=none; spf=pass (mx1.freebsd.org: domain of longwitz@incore.de designates 195.145.1.138 as permitted sender) smtp.mailfrom=longwitz@incore.de X-Spamd-Result: default: False [2.45 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.995]; R_DKIM_ALLOW(-0.20)[incore.de:s=dkim]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.145.1.138:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_NA(0.00)[incore.de]; NEURAL_SPAM_SHORT(0.95)[0.948]; DKIM_TRACE(0.00)[incore.de:+]; FORGED_MUA_THUNDERBIRD_MSGID(4.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3320, ipnet:195.145.0.0/16, country:DE]; RCVD_COUNT_SEVEN(0.00)[7]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N When I mount on a FreeBSD V12 server a snapshot living on /dev/md0 of a gjournaled filesystem with mount -r /dev/md0 /mnt/var the kernel gives the following WARNING: dsssrvt3 kernel: WARNING: /mnt/var: GJOURNAL flag on fs but no gjournal provider below Of course the kernel is right, /dev/md0 is never a gjournal provider. I think this warning is unnecassary and a little bit confusing when mounting a snapshot. With the patch --- ffs_vfsops.c.1st 2020-11-17 06:48:00.000000000 +0100 +++ ffs_vfsops.c 2021-12-21 11:38:15.000000000 +0100 @@ -875,9 +875,10 @@ mp->mnt_flag |= MNT_GJOURNAL; MNT_IUNLOCK(mp); } else { - printf("WARNING: %s: GJOURNAL flag on fs " - "but no gjournal provider below\n", - mp->mnt_stat.f_mntonname); + if ((mp->mnt_flag & MNT_RDONLY) == 0) + printf("WARNING: %s: GJOURNAL flag on fs " + "but no gjournal provider below\n", + mp->mnt_stat.f_mntonname); free(mp->mnt_gjprovider, M_UFSMNT); mp->mnt_gjprovider = NULL; } the WARNING is gone. Because I was not able to write a simple request for the condition "mount a snapshot" I have used the condition "mount read only". I would like to know if this can be done better. Andreas From nobody Tue Dec 28 15:30:50 2021 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 18AA3191606E for ; Tue, 28 Dec 2021 15:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JNdlt6HB3z4hYL for ; Tue, 28 Dec 2021 15:30:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B78DC13F4A for ; Tue, 28 Dec 2021 15:30:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BSFUoCv087080 for ; Tue, 28 Dec 2021 15:30:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BSFUovV087072 for fs@FreeBSD.org; Tue, 28 Dec 2021 15:30:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Tue, 28 Dec 2021 15:30:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640705450; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FYygnFcHF08UrnnEcb1yfH2Ekvc20DmOMq7EjNxEpj8=; b=FZMAz+XJNElXQCm2+BbEidckXeSlsbbRB9fq/ll+ZBKyaI2Sazgos86eMgqPi/CijNwjn4 tE2z8IIxfF1hr1p274vbLzL04GSooIJgonvZ2q4h8/Oij3Ml676MwT0rDyRcVvNsxic5Su 5Qvr5OlUHl05L6oS++5U7txiwDqzAHfvJu28eCjF7t+syXsnpqYMB1pHkSbuw+714eJTFq qU/EgPv5l4CsvJuEvoISLbNyElLs51OFUHsTqXX09/zisfT88obxB9woekwZfoPbMGjKn2 +9tvVud2a5YlGYP1XFaQaYBOxsz/1hBgAIrwnGrDjK+RGWnxRKFe7QE6uuTl3g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640705450; a=rsa-sha256; cv=none; b=l42nm4gEifi5srpU8kXqbnuEO4USshmxX+KVykXpShJE6gR67QyYbWBn75oNs4xSzyej2Y sQ90eFr7zS22x3XCJuWpOsdRfmcHaO+yYanuvPhVh5ppkP/QbWKZpe0/RUEyou+8RDS/6U DVdFIgoEE/6RZktG9F4IU8gCJjZRoFreiwxlVub0l/qcbrYuEZG946NJKkiRgDHTrysbbz XsWMnkbK59jjsdcdpE1LciN6QDvaxc0Bu0wYPJX0gAoQxKzOxtbd2Q/H7EOOyuzQw6tWlr A76F6YDPgMgQKbIISJGLsRJ+p7BWd1UqVCuc8/mNGKTJdB3HVs3FKI1P2hdXQg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #14 from Rick Macklem --- If you are going to do an NFSv3 mount, the NFS server must be configured for that. I can't comment further, since I do not know what kind of NFS server you are using. For the client, rpcbind must be running for NFSv3 mounts. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Jan 1 02:08:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4A5F6192E8D2 for ; Sat, 1 Jan 2022 02:08:59 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from relay.wiredblade.com (relay.wiredblade.com [168.235.95.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JQlmn6rDWz3jHw; Sat, 1 Jan 2022 02:08:57 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from mail.distal.com (pool-108-48-165-176.washdc.fios.verizon.net [108.48.165.176]) by relay.wiredblade.com with ESMTPSA (version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256) ; Sat, 1 Jan 2022 02:08:50 +0000 Received: from smtpclient.apple ( [2001:470:e24c:200:a13c:6237:493b:8199]) by tristain.distal.com (OpenSMTPD) with ESMTPSA id f388a0dd (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 31 Dec 2021 21:08:48 -0500 (EST) From: Chris Ross Message-Id: <3B7FAFF1-9EA3-42C7-B7C7-82B3239A39C6@distal.com> Content-Type: multipart/alternative; boundary="Apple-Mail=_4D3D1A12-CC9E-4A62-81D6-BD16492034CC" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.40.0.1.81\)) Subject: Re: swap_pager: cannot allocate bio Date: Fri, 31 Dec 2021 21:08:48 -0500 In-Reply-To: <8DA407FF-0895-4ED6-8495-86F00556DD7F@distal.com> Cc: Andriy Gapon , freebsd-fs To: Mark Johnston References: <4E5511DF-B163-4928-9CC3-22755683999E@distal.com> <19A3AAF6-149B-4A3C-8C27-4CFF22382014@distal.com> <6DA63618-F0E9-48EC-AB57-3C3C102BC0C0@distal.com> <35c14795-3b1c-9315-8e9b-a8dfad575a04@FreeBSD.org> <471B80F4-B8F4-4D5A-9DEB-3F1E00F42A68@distal.com> <8DA407FF-0895-4ED6-8495-86F00556DD7F@distal.com> X-Mailer: Apple Mail (2.3693.40.0.1.81) X-Rspamd-Queue-Id: 4JQlmn6rDWz3jHw X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of cross@distal.com designates 168.235.95.80 as permitted sender) smtp.mailfrom=cross@distal.com X-Spamd-Result: default: False [-0.40 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+a:relay.dynu.com]; DMARC_NA(0.00)[distal.com]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-0.60)[-0.600]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3842, ipnet:168.235.92.0/22, country:US]; TAGGED_FROM(0.00)[freebsd]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[108.48.165.176:received] X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_4D3D1A12-CC9E-4A62-81D6-BD16492034CC Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Nov 25, 2021, at 00:18, Chris Ross = wrote: >>> On Nov 20, 2021, at 13:23, Mark Johnston > wrote: >>>=20 >>> Here is a patch which tries to address the proximate cause of the >>> problem. =20 >=20 > The system is still cooking along, running the job that previously was > causing it to get stuck after 48ish hours. It=E2=80=99s been running = more than > 80 hours now, so a definite improvement. >=20 > zfs-stats reports things as stable, 80% cache hit ratio, 64GB max arc, > ~85% of that currently as =E2=80=9Cadaptive target=E2=80=9D. If = there=E2=80=99s anything you > would like to get from the system, data-wise, let me know. Happy to > share, and help get this fix, or a different better fix if needed, = into the > tree. Hello all. Just was curious if anyone had a different solution for the problem I was seeing, or if not, if the patch from Mark that I manually applied can be integrated to the tree for current, and MFR=E2=80=99d to = 13. Thank you. Please update me as to the current status of this issue, so I don=E2=80=99t update and lose functionality at some later point. = :-) - Chris= --Apple-Mail=_4D3D1A12-CC9E-4A62-81D6-BD16492034CC Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8

On Nov 25, 2021, at 00:18, Chris Ross <cross+freebsd@distal.com> wrote:
On Nov 20, 2021, at 13:23, Mark Johnston = <markj@freebsd.org> wrote:

Here is a patch which tries to = address the proximate cause of the
problem.  
<= /div>


The system is still cooking along, = running the job that previously was
causing it to = get stuck after 48ish hours.  It=E2=80=99s been running more = than
80 hours now, so a definite = improvement.

zfs-stats reports things as stable, 80% cache hit ratio, 64GB = max arc,
~85% of that currently as =E2=80=9Cadaptive = target=E2=80=9D.  If there=E2=80=99s anything you
would like to get from the system, data-wise, let me know. =  Happy to
share, and help get this fix, or a = different better fix if needed, into the
tree.

Hello all.  Just was curious if anyone had a = different solution for the
problem I was seeing, or if not, if = the patch from Mark that I manually
applied can be integrated = to the tree for current, and MFR=E2=80=99d to 13.

Thank you.  Please update me as to the = current status of this issue,
so I don=E2=80=99t update and = lose functionality at some later point.  :-)

              =    - Chris
= --Apple-Mail=_4D3D1A12-CC9E-4A62-81D6-BD16492034CC-- From nobody Sun Jan 2 13:34:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 669BD1923068 for ; Sun, 2 Jan 2022 13:34:22 +0000 (UTC) (envelope-from arungnair@gmail.com) Received: from mail-pj1-x1029.google.com (mail-pj1-x1029.google.com [IPv6:2607:f8b0:4864:20::1029]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JRfx93sznz4mVX for ; Sun, 2 Jan 2022 13:34:21 +0000 (UTC) (envelope-from arungnair@gmail.com) Received: by mail-pj1-x1029.google.com with SMTP id iy13so26927597pjb.5 for ; Sun, 02 Jan 2022 05:34:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=IP1giVPEq4YZTmZAD11vXyHMw/RGTUNMwJlt9nJfjhw=; b=bzUE43z2Jn2AIkvhjoXCrBXN0HW2kTQ6+l3HVRtRzzCxEEfTd1BMK37t/i2kxE+3lh eC/9uTFDfD8YQ3aHFi+/ZE03WEWCJUgBOFmKeQ34Gxq1xJMfT6DJEI9uA703x9EPcLnY 9T1GEqlRM373AqqQIi4x+M1ouCjIZmKZUxrdf7i1uTLJyp1+1otHvsyvRH9d9fFrocDc KzqKzV3Q2Lwl+oKB9J3Ei+2OrNuVfkz+ntZQIMsahum/Hom50LFGSsTJI3EAy4YboxLb /9WEEqaYWe/b+1/qAXLteX7oXfuRPY2Cm8AffksVV146fArYlx3bfs0OcpUlTMdCsEbo 5WWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=IP1giVPEq4YZTmZAD11vXyHMw/RGTUNMwJlt9nJfjhw=; b=HtfmKjQJ/NEnhB2UpZGSDe98k5NkhxuzSwSY7eZWpN2yDrzQPfSHZmGWVfnfIMR3Au EqYhLTMqEPZp7OpsmvLr+CvERULbfN6qOAkflPH86hWcD9SqXiFJhhpp2e5c2aU9Be+f sM2vFYJ9EOe4IzY9+6t/JeQjv/Cv6HCZJJpG9vNkKm9y91NikeIYxbBWeWPaSXrjykHk 0+xEhp7sUnunIC3ss3z4nPEqCm5JkkNbbWz6OvP1HLrDGD/mzmIXiFTa5tBUSy3hH0FV wAOyvF9URnRs+zNbsjecoDuJNUosOAW0oDJBcSSuQho0K6yM6kSOcgOCrE82g9QotFmu cMog== X-Gm-Message-State: AOAM533YlpMBDiXm6LtqXTXkelZszqBLq15OQIyfF/QYXso6+8F9Hjgi Til29C/wuc29CYrJAQczngawGXDN0yb4jRcR7t3bnS95 X-Google-Smtp-Source: ABdhPJzwr5F2GvLw4xbaHs39yra4SeuXwYcrAKTxt8nrlDJoYH1gF9qOxIe6QwMoAydTjbizwOUCpWg3WD2UXyzcnv8= X-Received: by 2002:a17:90a:f192:: with SMTP id bv18mr50950930pjb.110.1641130460503; Sun, 02 Jan 2022 05:34:20 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Arun G Nair Date: Sun, 2 Jan 2022 19:04:09 +0530 Message-ID: Subject: unsubscribe To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="00000000000020e17d05d49976a0" X-Rspamd-Queue-Id: 4JRfx93sznz4mVX X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=bzUE43z2; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of arungnair@gmail.com designates 2607:f8b0:4864:20::1029 as permitted sender) smtp.mailfrom=arungnair@gmail.com X-Spamd-Result: default: False [-2.03 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1029:from]; NEURAL_HAM_SHORT(-1.00)[-0.995]; NEURAL_SPAM_LONG(0.97)[0.967]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000020e17d05d49976a0 Content-Type: text/plain; charset="UTF-8" -- Regards, Arun G Nair --00000000000020e17d05d49976a0 Content-Type: text/html; charset="UTF-8"


--
Regards,
Arun G Nair
--00000000000020e17d05d49976a0-- From nobody Sun Jan 2 14:20:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 84FCD192C8D3 for ; Sun, 2 Jan 2022 14:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JRgz02Gnpz4sQt for ; Sun, 2 Jan 2022 14:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2F26813855 for ; Sun, 2 Jan 2022 14:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 202EL0Q1031765 for ; Sun, 2 Jan 2022 14:21:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 202EL0Wc031764 for fs@FreeBSD.org; Sun, 2 Jan 2022 14:21:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256205] ZFS: data corruption with SEEK_HOLE/SEEK_DATA on dirty files written through nullfs(5) Date: Sun, 02 Jan 2022 14:20:57 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: phil@krylov.eu X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641133260; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tTjIVcF00qw94vol2v+sbhrHkYlZvZFnqC+fMBJ9RZQ=; b=yi7457U/Wy78AB2SQAXlqUNycKa9qnzYLrxn26YcC3pRRS3OrC2Qlt+d5o5SncDYyQ9UeZ +3IwjRt7VTv6LjLvK9eASMUSP977ZJ59J8dAI9GnIGr9SYScXbc2aeUYtFVQ1Ney7YX/kX 0e8TMrydnAFweZlEUaIiLINjx35dsf+Uxt0DW4wr9zGRwcVWGGWOwBftxT90aH1jeYwSEX KcbE/mm7CQN55JL7QRJGY76uxSpHBJy8sk6mpq63rXMxIUOlioYQhGlNVI7TESDVQOC2rZ gq5GUHNklEygSyoYZHP+tnaAa7z+yvZyew0nv35VeAG29m9N4dBQ88Pxv4LiQg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641133260; a=rsa-sha256; cv=none; b=cgTpf9IJtzyyB4GwmlFIKN2EXj2wq8zdQNL+DkVbMHW1f5Apaeezi8VbjUR6Sq4CjwLjFu oh7eXob3ATJc1XtyeDeNmRJj137YAXv6II796QOFZ0JcZM5dom+Y5iiqiOBEcj9OrotAkU H/LbYiVCQnrou6044+kWY+9fA6UHKqT8WnLL+li+Gjk/kJkUUY51MffTuBXvBdMBSqnzJY MuyyG4HUOrjp+E3hCwURcJd+bSaIetbqhFlVr2z1gK7MVVbzMfWedJV6fFNvMxuURRadv5 2gaQZouBM/a9vQmesVy58qhxkQOr9qHA/q8fDmmwF8MsHyqgbSe7QTPS0HFqKw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256205 Phil Krylov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |phil@krylov.eu --- Comment #29 from Phil Krylov --- The ZFS fix for the bug has been released in OpenZFS 2.1.2 and 2.0.7 releas= es. OpenZFS HEAD has been merged to 13.0-STABLE. It is still not evident to me = how we laymen should proceed with securing our 13.0-RELEASE installations. Shou= ld we wait for releng/13.0 to merge OpenZFS 2.0.7? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jan 2 21:00:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E9342191A75D for ; Sun, 2 Jan 2022 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JRrqt6lxxz3D3t for ; Sun, 2 Jan 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BCDF2189E8 for ; Sun, 2 Jan 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 202L0Qt2033496 for ; Sun, 2 Jan 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 202L0Qvo033495 for fs@FreeBSD.org; Sun, 2 Jan 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202201022100.202L0Qvo033495@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 2 Jan 2022 21:00:26 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16411572263.12DDCd643.32244" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641157227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=45lEqwKB3P+Qk8JFVeMjIAMMiACX41ey2UXQ9Cj2bUg=; b=Ir8CFvGdudSIy3HWIOXyhwtHbZIkXrUOes/Vc0fZMqInW/pseAG1qmvknCc7QoDWkVmwAs ZBVvBLz6z2IkjA5Ls1B+y0Vp0oR10RNNWE6e68JStLJWMoV+/BIUYaKvkBtPzbZuZHqDqd aeHIE2dFDsKbsiRAnT+SqJRLKegq7jWGsPc9tLtiXiwSjZrLQg3+bKSxJbM1W/U+cesOG4 NrgG1MILo5aM9o74GLAsVweaMkUEK+kRoEtNOU5Gu90aP+jcBxAJIw92aBzcbx13T04Tg4 ozkpsJHOjNTbo5xNWBSmRASP1YNLnfrMO3Ta1joW2GgSaoeNCoSMk6VLQQNLcg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641157227; a=rsa-sha256; cv=none; b=c5FkjAc9O8qTIWisyAeLJPtit6VVAw2QwPl5YGWXQukj4vVpwRr/wRAvgfY3uUi9uU09ue BP7KMEVLl6ZRSdZWkO/w0Wy7Wp2Novlh7WkP7QYHfhIWrCpQqgeqMPpqGRq4BdKaESchBC z+ozn6fX2/tAPuO317n6fkDY5Eiq08F9vxkJfmL0QoeqeDJdmSvQXFzj0/YiIztDKOX8dw lVEkr6w1XbkywawD2ky7O2qyzFUbVPBj/kmLbYURUMKTdNAGPZuKIYEmK6jjxBjTPzyUqb Ej+PWTkZZL9F+S/FlzUVBkDXyer6uuhhxZ9eZgqpLbkIvcPhzubQ8AeLOhzqCA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16411572263.12DDCd643.32244 Date: Sun, 2 Jan 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16411572263.12DDCd643.32244 Date: Sun, 2 Jan 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16411572263.12DDCd643.32244-- From nobody Sun Jan 2 22:20:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9066719307D5 for ; Sun, 2 Jan 2022 22:20:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JRtcD1crtz3nGh for ; Sun, 2 Jan 2022 22:20:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EB14F1A127 for ; Sun, 2 Jan 2022 22:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 202MKR7n078387 for ; Sun, 2 Jan 2022 22:20:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 202MKRjF078386 for fs@FreeBSD.org; Sun, 2 Jan 2022 22:20:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246201] fsck: Does not honour /etc/fstab "failok" option (mount does) Date: Sun, 02 Jan 2022 22:20:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: easy, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641162028; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+pLylZQpzALcBW6qu79cnwfSR/1YE/DTlwnxr4JZwpE=; b=d2LaScd51s+z6E3WcM47zkvinOm8Hk3CWFHeTxa6IpuRgglqNPw/dS7eBxnRR40xIf9XJF UkI4ve1H0QonSVZjUNcckT7ZES2/sp0+DxYqShJ9IWjeWOTX+QoH5K8HpSwy8dDalXBFsP lMDihMYE41Nysj0m8SkYCZlWBx44p4kckZyhj7osjfDSAKlqNM6LvlpJtJTcQjNpZoRUXG rmCF1j9OqQh30sNcHCESVh0oKb1+rkAFIEyRGJA+13oc7tlLIS/8y+DO2qFZLAXXmD/c1o mJtcVWo7RHx0lYg92gxNozXmxmHhKlard7hWFTncFE2nrqUn9R978Z/umBi/cg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641162028; a=rsa-sha256; cv=none; b=gsxl30J7vyK1oqAjIbkfuFBERk9b/wXHm9ig8kMpVWleMxTGugTBS+0Ikld073vl0Dsebe KII7Eufz8dl1xr3qRTtdd2GgfwtPmKqRwecbT21cvLcwKVMZ7GJXbs3K453Ig2H+KfX56g Nfv9oLD0+2scSheSV/zrlBgLpa+nJWqjks8+g/FTeXlAGfDh15AkU65RsrTbbkQ1FfhrB1 mJY49bv+q1t9dZ/egvdAaI4KO+nSpYjdSRYIvanyZ27KHnQ7aV5dAyRLbwMjc3x9VHw2Au 6Qn+xr6Mh1MBs0lDSKHGkhwgrbyL2c5YAfDu4cUz4/91AzsDNk5kR6tdOnTUJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246201 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dfe7121ec5b8b1c98c2933902be7aef185= 0030154 commit fe7121ec5b8b1c98c2933902be7aef1850030154 Author: Kirk McKusick AuthorDate: 2021-12-16 00:51:55 +0000 Commit: Kirk McKusick CommitDate: 2022-01-02 22:12:14 +0000 Update fsck(8) to ignore failures from a check program for a filesystem when the fstab(5) entry for the filesystem has the "failok" attribute. PR: 246201 Sponsored by: Netflix Differential Revision: https://reviews.freebsd.org/D33424 (cherry picked from commit c72372c693b36058b58a525981e833515ce8e441) sbin/fsck/fsck.c | 3 +++ sbin/fsck/fsutil.c | 39 +++++++++++++++++++++++++++++++++++++++ sbin/fsck/fsutil.h | 7 +++---- sbin/fsck/preen.c | 24 +++++++++++++++--------- 4 files changed, 60 insertions(+), 13 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jan 2 23:54:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 14B00191B23B for ; Sun, 2 Jan 2022 23:54:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JRwj36FXKz4Vgb for ; Sun, 2 Jan 2022 23:54:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B7B711B4A2 for ; Sun, 2 Jan 2022 23:54:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 202Nslt7025718 for ; Sun, 2 Jan 2022 23:54:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 202NslO3025717 for fs@FreeBSD.org; Sun, 2 Jan 2022 23:54:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Sun, 02 Jan 2022 23:54:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641167687; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BSl6cIJg4wehuSzLr4euhPPVDWSSVLGVm+humr/wZVU=; b=Wwa31wLTzfPc4D2A3NNfC1qtCF2+mjsRMdXZn0K38DwVs4lvP+VnGrEICGXYIF/PYelgtF Rm/nDGBmsSvxBTnjAwLftL2rNr2BjS6151v4iIt/fK7l/ITr2lUqtyieVZhuKx5XfDtW5m 3lObkIRJv3/fbtxxA8KIoKbm1C08u+UsvPfsNTuUTeoJqhpT6hFxEQTbNpDwsimu2y9ftD buuOJRh1ITcLSrijw6WU3BQXb4MQFNg+/nYvYIWVK0oOwK8AmGueXuaLxt2VlTv+wgZZVr H/0AJnOO1T9nKw8QqBf04I9MlfdLrrL/ao3ro/PQFNB6roFuHXMmDbxLwk+IAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641167687; a=rsa-sha256; cv=none; b=P/Dro03nPyZ2I+FhMyhet5MsqsX64NfgBuOjPdkNOfs9y4K6whqeYPrjxD99+NQRAPVFPr 3A8Ik+eyJt7tWXTAiCYaZxwRKzF6JrDyS9xlFPbtlXWOJ0YZQleYMKf5BydyuwJfXsEag3 8f0q/C62PhrDYU3cn0uhLQbd/jkHXW3pBh+wKvmDehH89IuSZAgjGPVQn/gIx31gIFsXmR jOu+cDr4DveJxOnD+8QN/fAwWpGIilGeBTskKT1JZqomnwGxCTc+FZ//XoWVCoaW1INErC CdDhDI8pzFEDqWuVYVyVV3maJCkZ7oCboqMy0UJcAWsQ0Tja9jARq0/Ac0voEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |rmacklem@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 3 03:46:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 41FCE192BCA2 for ; Mon, 3 Jan 2022 03:46:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JS1rK0Dcfz3Lf1 for ; Mon, 3 Jan 2022 03:46:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CD2361E461 for ; Mon, 3 Jan 2022 03:46:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2033kOfK052044 for ; Mon, 3 Jan 2022 03:46:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2033kOuw052043 for fs@FreeBSD.org; Mon, 3 Jan 2022 03:46:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251342] fs/unionfs: VOP_UNSET_TEXT without VOP_SET_TEXT leads to panic Date: Mon, 03 Jan 2022 03:46:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641181585; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JYyP0pqvqHDPxqbCVyiA6HNcBa6zdEj+z5YnSm44v+c=; b=HzhRdJUCKlz/xUVDyQNmHc0quzg1VKpvwA2MLOQAkV58MwCtL/HVS792tOgVzbe0NrMobv 6ZR6PbpV5M0eLZ35HeKrQoMhEssAvUAHe9EdvgfSS71nJ10/ghB5PmTa6nCH3XtDFsucnu R4EaiKMFIT4tm0Mj93cXWfZ4lLZqfjaDTr8GIlLArS3ApXnjTbB1RwXdIAdGrg4tQqwKTS hxH0Z4lz5ZUJburN2Nu8hP/wUmEnMisCTfrm72/71+eV/2+UW9H6j0o2/oUEnIlwG7HsHR T5z+Y9XmRlX1zG0ELa6NxwKLhMG4uD7v42NoTOnf0Z5bKq3ZKyVWY8RgXKq5iw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641181585; a=rsa-sha256; cv=none; b=aNwE+H7EF/x3FNpiIDW3Ns3Tdglw+QilztG267XKEcpI+Ro7NJ1v9lCvBtFvUexypvb8Fi m7kjs1gzN7bMMwTrcpLXgIhka4AMft3Wb4uyUj96zJlBoatmDEu7e4ReQQxAnFa8B3JZGL rc/wHxtbCpn0JER6Jcj63Ojx9bNm/AKcqfSCfrreTko7PXA6Tg5Mwc7D75YCbTHIYPqi4X Kt1F4Gwj/dycJrD7w1ZyxEiIis/L1rj+QhOKjdL0+o+gIoHMm3waHiOzALOxAj1qZDRFRD eSVsRzonIpwT3euQ9n6xgN6Owc1QtpGt9EQF4UzNPQEPF2EQ+H2xqZdwIue/bg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251342 --- Comment #1 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D9e891d43f586e91541bd61fb12550de29= 6d76fd9 commit 9e891d43f586e91541bd61fb12550de296d76fd9 Author: Jason A. Harmening AuthorDate: 2021-12-21 23:51:51 +0000 Commit: Jason A. Harmening CommitDate: 2022-01-03 03:52:58 +0000 unionfs: implement VOP_SET_TEXT/VOP_UNSET_TEXT The implementation simply passes the text ref to the appropriate underlying vnode. Without this, the default [un]set_text implementation will only manage the text ref on the unionfs vnode, causing it to be out of sync with the underlying filesystems and potentially allowing corruption of executable file contents. On INVARIANTS kernels, it also readily produces a panic on process termination because the VM object representing the executable mapping is backed by the underlying vnode, not the unionfs vnode. PR: 251342 Reviewed by: kib Differential Revision: https://reviews.freebsd.org/D33611 sys/fs/unionfs/union_vnops.c | 34 ++++++++++++++++++++++++++++++++++ 1 file changed, 34 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 3 04:03:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C0A4F192EA1D for ; Mon, 3 Jan 2022 04:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JS2CS3mXlz3N5Z for ; Mon, 3 Jan 2022 04:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 628E61EC85 for ; Mon, 3 Jan 2022 04:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 203430R4061194 for ; Mon, 3 Jan 2022 04:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 203430Jg061193 for fs@FreeBSD.org; Mon, 3 Jan 2022 04:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Mon, 03 Jan 2022 04:03:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641182580; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tZJEK5RcDmh6KOjpyjkkvxqovXWVfX+F/UU5TfHBpu8=; b=Y2laTnbyz84IcUF+5DRQqkM2RBU6FQAsizFzXDWG69ul5vaE9KGQViLpktAY+9Lvdq/IWE ubxjA3w+977H4NmMuBrPWFNzUeeuqIN7LXerE2+tu0rVN3lrRD092LQQpBqVl+iRQQfY1i P2qQuCgxhdAMoatGapNacL0Es5BCMdUYcslF6CLMjsKTf3ycpYYT6Ax5DsiNa8Vhme4dkC OAUVtaTlHatkj0QkEQqg/t46Q4OwOz8wOB1G+EJux0sBwUHrzRr3JvD+QsZxYbV0Ahj/od p09dF9pz3AkpO8HFZbqvGYrARTz3PHPPnUu/V33IqNIR4RKCidaghI9WmPC2uQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641182580; a=rsa-sha256; cv=none; b=NEsmSKGrN0NF4/RzAobRMeVQmTZuNJ+iNpS1R/GUJommGreD2tsJ5Tb6vZM83bGGxlwqlX eacFy+W/EsH/3u4OHkJHh2HyGVJ9Ruyfr/W1vFfpvC8KqjFbeDroAfwnYG0JqaLTCrNDpi k5pQ66U9I8gapepvCW+IXAeNWbavJXlH0RR7OxKKVTpZuA8n4pPIhng+ztALA6BigJNHNY k1wj0VjSn72DwrgRMbZugyM5187Dtf1kGcnK+odN10cVhrs1cyyTu9PNRGOKPztWdvfI6k APxXuDQfHFN3nFuqRwKMyI8AP+xT3CB2WJWh2gw1fUVISdTR0ontgPQeo6Eq8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #1 from Rick Macklem --- Hmm. There is a hack that allows certain NFSv4 operations to be done on file systems that are not exported. This was done so that the tree (which, unlike NFSv3 can be multiple file systems) could be traversed to get to the exported file systems. (Lookup is allowed. I can't remember if Readdir is also allowed.) Try doing something like writing to a file in /mnt and see if that is allowed. Also, try making /mnt the root in the V4: line on /etc/exports and see how that works? (If you haven't looked, vfs_export() is only called after VFS_MOUNT() returns 0 in vfs_domount_update(), so the kernel exports should not be on /mnt.) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 3 17:06:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4AB861933E6D for ; Mon, 3 Jan 2022 17:06:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JSMbQ08gWz4kCX for ; Mon, 3 Jan 2022 17:06:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D6AA2D7F for ; Mon, 3 Jan 2022 17:06:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 203H6Pxd009168 for ; Mon, 3 Jan 2022 17:06:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 203H6POA009167 for fs@FreeBSD.org; Mon, 3 Jan 2022 17:06:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Mon, 03 Jan 2022 17:06:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641229586; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Dk/WDOxfLCgh4tqZaJa6M+j2urWbCuxBoDKT/CSlQl8=; b=Q/y293bg67xdKpDRRBz7glG2xMjs4RdD49GXhm2Mhl3t5u+Jba2GedVpjCDPdmTKynlpf/ W1BiOTPe8WKO3uhbg1IEIF1Qy3Dia1jAss6DtAIveFTkLQ24YwtnvI57ZRXlY3GEGIF6jr OKPbTiXEdYJJZkbIOfG/6Ge7ZD+qTEorwePhraoaVONqb/OQ4ejHGFU5HfL4P06hffF1Wo 8A/qqe88CVSMiPhPs/4dvK23gDc3Gl1dLrsNWQf8pu8konugNQ7KL1j7qhAaDAsUTLvfjf EfEt/0L0JycF4vrHM1KE5TNGxAoZO5I5DwuvABcrVpePSPbJvaKA0mCPmv+PzA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641229586; a=rsa-sha256; cv=none; b=tl9HrRucUSg5G6n/oBbyGeWg4Cb0Yn9Wqadc0f5TvEDk7qlSi/fGS6WsMJSAECQtCTfiED HQx5HIAaN5JGGSLX6hT+4yqHuftjfgB4NqJYRIV/qtv75Ml10Cg4iTu92iMQh0kEbyGW8Z 97mXhKOlGNdv6/fOF1AuYX03U6VX5zcnDQcs51byyFhKx2YXsXk4ynyN7MQWzYmtc1FImA UfJ+NZELGZ88k3zgn2W+vRO7I0DIl2NVOypD6iO+7xbcvdnOyEmn7OHJEzIdy60tK3gooe 88NmVUaL57/SlYzWyt24AVh884Di32GbYFmfIbnlJgVZYNi2zXrirgfPuu6KQg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #2 from Alan Somers --- Yes, I can write via NFS to the file system in /mnt, even though it isn't supposed to be exported. I can also do that even if the V4: line is set to /mnt. However, if I try to mount a file system that's under the V4 root but isn't configured in /etc/exports at all, for example /var/tmp, then the client in= deed can't browse it. df works, but ls does not. So I don't think there's a general "nfsv4 exports everything" bug, just a specific bug for file systems that fial VFS_MOUNT. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 3 21:35:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 873971925BFD for ; Mon, 3 Jan 2022 21:35:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JSTZQ1hmPz3wN0 for ; Mon, 3 Jan 2022 21:35:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1A3804F13 for ; Mon, 3 Jan 2022 21:35:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 203LZw8S065757 for ; Mon, 3 Jan 2022 21:35:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 203LZwos065755 for fs@FreeBSD.org; Mon, 3 Jan 2022 21:35:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Mon, 03 Jan 2022 21:35:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641245758; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LkPrPzbGgOxine+unN0JKdpH0qjhvJe+jiWDSpfUBp4=; b=u2iZo+3cD+nmyi2Fd/mSvQWGyVrJWFPbwa7tNmgTyH+Plx5AdpvAJIaip3v4Dg/YCVKmPl DyOXswaHjUrq7cuNQ8VRTGo/l0hwtkotMMCCufh+3Gl/n+JIAADcxq+uquUwPq8P8fVPyo nR3lLnBchsqLudDd4YXYzUfGAdUd7zBWhDuV94Kq+2eISES+XZf5lntlxV7+rOrPFhZ8qD pS/sv0TjLW7fuRbqNn7e9cYckDGrOofiLeL5MEQUPu2GVMD4ZTZ4AZQDTGlNqJ91tgGdmz o3TQ3pztz6qc2Ku19kPYMJIhog1ncCXIJyAxJpWTssm+xiDznng0g/FIzTcgEw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641245758; a=rsa-sha256; cv=none; b=h3y0zcG1F80Y033ppBS/ylGdiSkgqauUE+1FjVyn8u5MMUMw50ZwZtBD1MuYRBxDUbKxWz V3BLD3oQdYN0Z1CXLvhZ8HucegHX4BhBhHdfBidTUTxDddUwnWrvUgOBrvb58+24jQ++bg LxJQApowBfE0pS0CJjSK1a+qgnVGpAKEHB0xYwPQoiDWmu8y9/OSBPy6C7AKS1ltYrwyBL +2F6usYGRnE6ngGoETq3p/oHM03Ut8V36L0neRy1cU1oFfGQfGaBtqn5tGjBJrB1EW+QMs af/3dexx9invmmuD8hA2X1je7YkYCk3v69Y56zqBNzS3PXN/5HtzHiix4wfg/Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #3 from Rick Macklem --- Maybe there's a bug? When I look at vfs_domount_update(), it doesn't look like it will call vfs_export() when VFS_MOUNT() returns an error and file systems aren't exported unless vfs_export() has been called. Are you sure that your VFS_MOUNT() is returning an error when options "update,export" have been passed in? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 3 23:30:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 52D57193B274 for ; Mon, 3 Jan 2022 23:30:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JSX6M4yvMz4fbK for ; Mon, 3 Jan 2022 23:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 261CB6687 for ; Mon, 3 Jan 2022 23:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 203NUJll031506 for ; Mon, 3 Jan 2022 23:30:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 203NUI1l031505 for fs@FreeBSD.org; Mon, 3 Jan 2022 23:30:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Mon, 03 Jan 2022 23:30:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641252620; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gi2tsLUVpL4fSlN+aS9qgn3Gp3Y8Eta4Pa2gaZFwXcw=; b=RvoH3srGpYNuZG9VjCWUqtOMZ6Dd4f7TwpVY+JXOfy/uzyilaVU6gwuxbBik4E3st5AXW3 OmuB+QIugXr6zZgqsks38tZdSSSBnFXWWlpH24T/ZsV/ecb2w0l8AcMTtET3a8Ajl8P2Qv JEn14ssgfZY8Yfhv1AOxRCb9rDCUUP6+jNOrXS/ElTIP8N9crSL+vCcGUiXQvOXz6boHEj 5fdYpF9B6vcq8Mh6svA0NkBY+6D36gKilCawKxkEVoNnI9+1RpGs/2eL/NVCUKL/d9Im7D kNtNS/lClQ6QfdQGIVnbDly3xhL6IXKyQIk0UqHTlPuH9wRxz5tNXK0X2Wqb9A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641252620; a=rsa-sha256; cv=none; b=TjC56YjJidaVfHWjw0pOFKWVD+RYQlPIMmI/jGtj/CtYTh9Zle8vA+mpkouH0I7u3rn0xN X5SI30oQaxqLw0SLpQ6mqGkIx4HbUXUeV7JP4TFEkJHQXnTduPHsckGq/Xlux//cv7ZKZ0 faYQtNEcbokWrWInb1HASiUVrrtRUTc6CDjbbOsWIkdmxXbSwF48kBiTPcY9/D6D1FkHmR BkwDPSBDm5+d1xvs9RyBRL37tM9kCHgQWhXevMasxtUqQi1plMACMMpl6YeMyy51XC9zeC A1qCyY5xChCJvL25ig56L8dJcCrc68ASdjXsFH8KhieCd9yVo96Rm3y2X/SRng== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #4 from Alan Somers --- Yes I'm sure. Here's what dtrace shows when I do "service mountd onereload= ".=20 It shows that VFS_MOUNT gets called five times. The first time it succeeds because MNT_EXPORTED isn't set. The next four attempts return EINVAL. 2 67221 fuse_vfsop_mount:entry mntflag=3D0x10000 dataflags=3D0= x11054 2 67222 fuse_vfsop_mount:return return 0 0 67221 fuse_vfsop_mount:entry mntflag=3D0x10100 dataflags=3D0= x11054 0 78882 vfsops:mount_err cannot export a file system wit= hout FUSE_NO_OPENDIR_SUPPORT 0 67222 fuse_vfsop_mount:return return 22 0 67221 fuse_vfsop_mount:entry mntflag=3D0x10100 dataflags=3D0= x11054 0 78882 vfsops:mount_err cannot export a file system wit= hout FUSE_NO_OPENDIR_SUPPORT 0 67222 fuse_vfsop_mount:return return 22 0 67221 fuse_vfsop_mount:entry mntflag=3D0x10100 dataflags=3D0= x11054 0 78882 vfsops:mount_err cannot export a file system wit= hout FUSE_NO_OPENDIR_SUPPORT 0 67222 fuse_vfsop_mount:return return 22 0 67221 fuse_vfsop_mount:entry mntflag=3D0x10100 dataflags=3D0= x11054 0 78882 vfsops:mount_err cannot export a file system wit= hout FUSE_NO_OPENDIR_SUPPORT 0 67222 fuse_vfsop_mount:return return 22 And here is /etc/exports: /mnt -alldirs -maproot=3Droot 192.168.0.4 V4: / -sec=3Dsys -network 192.168.0.0/24 /mnt -maproot=3Droot -network 192.168.0.0/24 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jan 4 23:38:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0808C1937DE6 for ; Tue, 4 Jan 2022 23:38:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JT8FJ5T8Rz3KyN for ; Tue, 4 Jan 2022 23:38:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 97B3021BF2 for ; Tue, 4 Jan 2022 23:38:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 204NcSvo087330 for ; Tue, 4 Jan 2022 23:38:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 204NcSY9087329 for fs@FreeBSD.org; Tue, 4 Jan 2022 23:38:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Tue, 04 Jan 2022 23:38:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641339508; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=F/QY6YvDjYj2Divh7kKCKnc2pYx1rqtcnW1D1dFbkN0=; b=WPdCZIM0J92FSA7pMaPPf3WclkD83IdKAA4z2YMlKsDXZD405CquO54vR+hOrhpkTm1yy3 FP/Ju5qCzPTrFg6uU7CylpDFjzunImsnRXk3w65pPOJIOw3LIwLMLhMNEDskBz0kI9PvZF fSpyB/ZV1zCqupl9ByEkkAKYEyK6d6bX/dl0xgz3EsbmX/8Q4ukTskc8EdrUmDDkvSSC9G R3fRqKLi0YalHE6aAopYrpe7LoNz/clJcu+ImvwwXQFwxOklI3kvABWb517RvkFUEgZdOU Rh4XVoVbQS7Flinom1QnJzG0OjAcWkCCn/QQBPOG5DWrDyaRI0msts8c3vMJxg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641339508; a=rsa-sha256; cv=none; b=msmCIWAh8RNLh0yETgLsKhvjbF+NSrUYVjjhU2rXqnvcY7kb+H28+OERQMxVoEIu/cEIgb T5oldgiK67w3R142JZeJb+Kcx2UDeUN11yvTxVEClxSyeleQsqNsCzbyYOzdOvlks3KCVG 8SqiMBnfK6siTL6KSfmPBUug0tJkhCtrRrWqFWnKCJmSg5Porj58CoTkJddJs6VeOF/LQR xZ6CbMeWKGhXasEFs15sUEaDC55Oz9TysizXnpBWVs3hBlmapsduxjhY+Jw4Uam5YSHoBi S6FX2xKQ3no6ObE7Q4a9J+d5L5DMl1+0/T9ezvV9pTpIxFo6RHb11noNRE0Qbg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #5 from Rick Macklem --- Take a look at usr.sbin/mountd/mountd.c, around line#3205-3264. If I read it correctly, a return from nmount(2) of EINVAL indicates "this is not a mount point". The loop then moves up a directory level and tries again. I have a hunch that what you did was export the underlying/parent file system and you were looking at "/mnt" in this parent file system. Short answer, try EPERM instead of EINVAL. Another issue is that nmount(2) is also used by mountd.c to delete exports, and that will fail too, if you have VFS_MOUNT() return a failure for that case. --> Might not matter if it has never been exported. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jan 4 23:57:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 30896193B9DE for ; Tue, 4 Jan 2022 23:57:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JT8gM5Mgpz3N38 for ; Tue, 4 Jan 2022 23:57:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9771C21FEC for ; Tue, 4 Jan 2022 23:57:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 204NvZWh098255 for ; Tue, 4 Jan 2022 23:57:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 204NvZWL098254 for fs@FreeBSD.org; Tue, 4 Jan 2022 23:57:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Tue, 04 Jan 2022 23:57:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641340655; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v6cls5ehwLrgxIqDx6zezPJSOOzX8cq0BS0dNTWYnuU=; b=YGIAWbsvTkebjgwbcilx8rZXHj22GPrWJRBk9kgogFI8vA9UPXtqWeXjOSOYVBOuXtT192 QIEycbKCIrrv7VUBzrLFdJlcu3qoyfkRUU6hGHODNEaaX0kG+L+GLeIkWlB5jcUhbL5cox WPa1UkW696lL4ZBFhPwU7RogvxFe8WknM6hE0gGgH5gQIn5bahtNWPvoMVkOvUO0yC4A4W x/SI3FrHYCGc9nQUl1Mr6xzlcsKNOUssEbtKoDKPQoXXlPOGq+AjSt23IfTBeC/8lDp9fp /OMUEx46sPnmYZLanzgZm1XXtgIgBPC+CacMVup8iid3yqiOqrtjM6Q4/foxyA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641340655; a=rsa-sha256; cv=none; b=S+PSk/b+DXUp6IV58z8LPvSWVqYMBtDoUsH4VUYd8yZAPkARCsgZKz8bm2ro/teytH3Dao 5OlxAskYub8rCRyQVhQuG1rBr1tj4kZyFafAZiAik5uPmJmOBVA7fMIzv31xj3ywp3aVGW 2rbXb5yyB8jI8941IllzXz8r8H4n/BJZ2l7xkd7SNNse3fm0l8b8N/WE5LSoOroqlaegKb 1hSDQQRjo0ncCOUBJuDgJ8WOFybr47zNx37sCrg7BxMNjJv6QGcMnxR6m6KB7dM4KHSYDu WAsrZhBIQ6Qfg4m206EWxRRqfpRg49tNLEiSJi9iLDoBF7P6GnsAk+d3Qxw/jQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #6 from Alan Somers --- (In reply to Rick Macklem from comment #5) No, that didn't make a difference. Returning EPERM rather than EINVAL, my client can still mount the file system and write to it. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 5 00:34:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BC240192671C for ; Wed, 5 Jan 2022 00:34:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JT9V23nstz3l2W for ; Wed, 5 Jan 2022 00:34:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5F08122AD0 for ; Wed, 5 Jan 2022 00:34:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2050YYuG021872 for ; Wed, 5 Jan 2022 00:34:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2050YYQx021871 for fs@FreeBSD.org; Wed, 5 Jan 2022 00:34:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Wed, 05 Jan 2022 00:34:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641342874; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zKFdjLMHSMJErJCX+xeuKHFmVcuG/pZvAdzTqaUXQjI=; b=HvTvKutUzdVrsDcqwUiWc74OuxrG0J9TFGwBaVilw0u1RfOfGX55jalhGr6u2i3NrpwoXr 3KUIVXcO4JH/VJzAhtle0SmnwksVLSTc++THTnaCxyP4REDedGlOC0YphFr2vaLO2EdkSE MmyL7DDYlWvdY7C1x5LsvSP2y+2tLEemPCPSW4yJ5vLVJuUSD7wlX/HhXqTCCglqzN2yDz KvhBGq9TehObZntsQaut7DJk21hmK7/8qn64BTw6sfKynGwysgFhgClF3FpHYo8XHKkKFt cDa0LfEgXgEKg3r/NG2jfFLMiHMA4JHglXQSrP5bNQNDsy5x/K0pqHt7HgNesw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641342874; a=rsa-sha256; cv=none; b=JtA4ToNMdo2U01tj0L8royuKQA4JYFTbEfoxOwmlPV6+n+MbzrEs3vR4oMG5L3lFuKS5yw DEL8sqviuJki7VB5zFpia20+BNlPK/AJ+l/Xxy/geiQ9n0MbVXRz1rZye6miFpuCqeVuLi CCrJUtOO++OSOueUhviX8WUhpG5VNKOCpmLPpcnLViJA2wtj18TZBXLj3HGIyOe59tiW8a /N3RjA8n5j9aTOKnYw3lfcWWXpYHkxjJMTkJp4OUtIqZrvkFHv8QEOEZ30M8mIco/hGi0g rvxD+NKXgeSj7UI3V89+liIFlVw9qhmI8TvnakMC3leo1BocZF5Yv4JnRq987Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #7 from Rick Macklem --- Then, if I were you, I'd add a bunch of syslog() calls to the loop in mountd.c and see what it is doing. You will need to find an error return (if there is one) that tells mountd to stop looping and fail, from what I can see. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 5 20:47:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A5F351942359 for ; Wed, 5 Jan 2022 20:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JThPy0bjYz4txS for ; Wed, 5 Jan 2022 20:47:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D7F30132AE for ; Wed, 5 Jan 2022 20:47:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 205Klnfo072893 for ; Wed, 5 Jan 2022 20:47:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 205KlnMM072892 for fs@FreeBSD.org; Wed, 5 Jan 2022 20:47:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Wed, 05 Jan 2022 20:47:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641415670; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RugnHg0NC/JLgr5QfIQ5FrcIJ3nujXyi+Vc+j7aeEkE=; b=h9TyJ6n5h4XLq3mwdO2S4p8LhvNpjtl27rtN+Zu5X8HU0IE9xCyD8reQDPv/arfQj1XtQw ap84f7v7Qwz6bD3xt0BW5ChpOye68JSzAiMlitgsacb5RBhSdom0y5CHfW1o0lJ7wleVDo nqytTIDXy+QJrmFDJuImcC8AOOMZik5sGMAxmUH+A1U+R/X7i2+yaawHbmb+sQMevr92SE lbkX5Cq+d+fDnKuZTAL43kZxqDcUaH2xS8Lvzt1qTUkRoRG6vIi4yo/UkXx8XV2h6B0zTv eHj7AaJWCVGzbdzNu1VYxebxY3yNmWlVuNfvyhcs5atJRJHVnZFvA7kMxpAJ5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641415670; a=rsa-sha256; cv=none; b=Px98P1xEfc43ZAZF6BqBjnQwVHhLrhU8grgX0iRQKjAkKJAuNO6lhGyg+TVubfsaoIKK5i 5hJ80nmhFzUVhUx+zIENhYJHgXB42rO9Ucps8x5fW5e13n2pYcO/F5HEqRbCFAZ1YDN/7J VRGrVnE6qiz3wiPtFs84Dy9nwyJM/PdOV8+OnB9+JL7oarNt0pdeELG0JzKPlVhuVuv8GJ N59KBzzBoxuabjn19xLwDTmpf42AhnW1P08qFA8iYqIYbIjCVRTG77nEUk5ROUNwZYpYT4 L0w2ZTGUT3Vzo5DC6SWTnKBir6PsBRjDRNPzRNWU402pdgITNg8i/uqFv4zzgA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #8 from Rick Macklem --- Wouldn't fuse's VOP_VPTOFH() return EOPNOTSUPP when it cannot be exported? --> That should cause any acesses to the file system to fail. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 8 17:40:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C2EBB193D6F0 for ; Sat, 8 Jan 2022 17:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JWS6m4Lplz3FPr for ; Sat, 8 Jan 2022 17:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7628E22F91 for ; Sat, 8 Jan 2022 17:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 208Hem7p063544 for ; Sat, 8 Jan 2022 17:40:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 208HemMa063543 for fs@FreeBSD.org; Sat, 8 Jan 2022 17:40:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Sat, 08 Jan 2022 17:40:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641663648; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vLIAvmlPcZhrRY0U2n174wRW6OFxRMau/pI6EhN/2s0=; b=wsCTDq4RMz+FBwNu00Q/XJ+tcJzAs2jYpiHc4oqNskJ9PLsWj+kmsCsna1Um2FRbMEcxU6 tFsNHtWDIXHMNZh9L84KRTs6C+eyd4O1VYKhulFOssPaXMpAfsbx6+M2ZKHzOgH5AIDCH+ wLzBhGHyBFF3OAS+aqYzgTUXZLYRr9hqBAfjxVG+GN3AdfXV3uT01uY5RIDIPvfBuX+lgb dCwTwFDk4Lxxgw54ZQ8q8ESp+RuXPoWgLHI7hgIJ0426GCEn6WI0cVxRo9CUHqPkWIsJWp An9jIH9lFaQBL94UnGuH+skYHzardbx5QovEIrFVlpBukD1WCKcxKoLyh+XqNw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641663648; a=rsa-sha256; cv=none; b=IPVlWuEUhTRkSClnkN4xp7UD1M3Z5zR8tisVfXKM5sYFxlvsVM50/I78OGRrBP23drKXUC v3FIhq6E7UM8erxRFFUpUDLUwHJEiSEg9NLWoRBLTxNu9NiWJ65b+58Vhr9RAv4JeoMNgh pV8ZJzzb3T3wShYzGcOPRgABVZJwSEYmJDFERhgAjpXKKUg4AG2int2wFyG6EITtwK65Yn LDj1W1pLT8FjCU8MA3bStXbNDhbkSYT6HPIUp10zXmPtWGMDznv7z94QNjjiLs7+UiXkCQ 9Efqkl2fmLs9j+TiPkmQDl8f+k6EHp1raJZkgv/JYq8oNSEq+3E+41zT8WilbQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #9 from Alan Somers --- So it turns out that I can't use VFS_MOUNT the way I thought. The MNT_EXPO= RTED flag does not get set during that call if because the user wants to export = the file system. Rather, it is set if the file system is _already_ exported. = The sequence goes like this: 1) mountd calls nmount with MNT_EXPORTED to export the file system 2) vfs_domount_update calls VFS_MOUNT with the MNT_EXPORTED bit masked out 3) vfs_domount_update calls vfs_export, which actually sets MNT_EXPORTED in= the struct mount. 4) At some later date, if the user removes the file system from /etc/export= s, mountd will call nmount with MNT_EXPORTED unset. 5) vfs_domount_update calls VFS_MOUNT, which sees MNT_EXPORTED set, and ret= urns an error 6) As a result, the file system does not get unexported I guess for now I can't do anything smart in VFS_MOUNT. Instead, I'll just have to return errors from VOP_VPTOFH. As an enhancement, it would be nice= if the file system could set some flag that would cause vfs_export to fail. T= hat would produce a more useful error message than just returning errors from VOP_VPTOFH . --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 8 21:50:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C01A41931F37 for ; Sat, 8 Jan 2022 21:50:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JWYg64NN4z4ZVT for ; Sat, 8 Jan 2022 21:50:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 776C7260FB for ; Sat, 8 Jan 2022 21:50:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 208LogX1089505 for ; Sat, 8 Jan 2022 21:50:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 208LogQV089504 for fs@FreeBSD.org; Sat, 8 Jan 2022 21:50:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Sat, 08 Jan 2022 21:50:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641678642; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qae9aauwzS9xpFRYq2iaNLktsAixuKXdDuji34ZS9JM=; b=fb8m7AG4HL+E5zSdMnrE7H0oklvVXvCo2nJrq1geuzkwWlWo+ZWXvddDOKolW//FPL39K3 VbBfp7aBmF7lhJKn2egGv8ZoH5vws+246i8o3QK3p3w4Oc+IASzHi4XEes1SOM58Y20c0A hoh+W3ieCNiY4NGmiNRyjk2feuQZAs/YinonzJXaQ421TH0abPI9Wp/BM+owhzRlIH6BZu Vcqb3h8/zRbRHL7TJ42YMhLCNFJi/IjqMoTTf+cqR15Mix48JdhvSEqHPmahKEGh8u1Tdd l+9Vqi6ZKN/xreOegScsK2SXFENRZFlbuhZKhXapFjnY474FweJw3kGbomyK0Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641678642; a=rsa-sha256; cv=none; b=mnmCjav7ASj43eXmW+pim5/pH44/7KCjlV/co5f/DlfcpxH8v3tKvMghDAhe9wVgi86J2Z bHF4KkVBJze7JiHrv3zTNy+E0TOR2P3f7RyiQzNfXC9WAZRirL/oh95kwJNbcDYBjoUtKS HzUPVQzrMj3B3Va3G4D2AnzCtRhZxQAK1VA1/NDpROxo+0FjqU3SXyvPXpATcM5vX+mU+0 CWMmpcm8FFx/wugTLnYeF/tcb6tVGbfsrrRDibBlq88ae8R0Ba4rrmKrKxMYFrmn9XfKFk sNplqmyMhH8rYCW9WBXfG1aOmkmPDOjwIBQ53OuK8nG9ck/Erf7AwDhATYZrEg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 --- Comment #10 from Alan Somers --- Closing this bug, because VOP_MOUNT is unable to express "unexportable".=20 Instead, doing it in VOP_VPTOFH works. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 8 21:50:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A0BE6193203B for ; Sat, 8 Jan 2022 21:50:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JWYgJ3GDvz4Zdp for ; Sat, 8 Jan 2022 21:50:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 50B4126070 for ; Sat, 8 Jan 2022 21:50:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 208LoqpU089560 for ; Sat, 8 Jan 2022 21:50:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 208LoqEp089559 for fs@FreeBSD.org; Sat, 8 Jan 2022 21:50:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260894] Nonexportable file systems are usable over NFSv4 Date: Sat, 08 Jan 2022 21:50:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641678652; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vkn68DGfOMsffXY2B3VoNITM2Jn+kLiEd4dmwWNwTDw=; b=Rrqv4Ie1cDWHMa8kSVi9Ru4s2zK0Xogj/mMKDtQef/wGxnG4QpgNDrWonbGGKtLMdRisc4 p8PIFE2HuSp7kaXhBwVKd2qDZti8L//q6ErFpSF4Lmpc4ROau3fkR56RoULxNoHzXQK/EW FkZp2hnQP61VUAc7yh6IbO4PSB4HFLaIrDvKU2fY6T1f37k1Kz3h3NkJcG3NjSnoB0Eu6q V5iMRGk3ilP7sE+eSFOJ9bZVNcn9o5SWKpBkAmt88MfmlCmWDRZJertZnibWHKNIRKRmZt emAbBa15XPvZcDGZ/tlMVjS1aCDDhkjQvhWxp4vNA9VuLmtvl6RAYalrCWY8FA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641678652; a=rsa-sha256; cv=none; b=SiSRTAIZ83ZaBhE/tO78egaF4DGN2hIvMvZ4wM3DHf6znLxjOoxgcbhideMHq/i4asOTR3 Mt+5nXbvdYpjPAhVfuARqv5uC5OtuXVdBjFdcT7f8JK6hydJ4V80vVfkt3vnj2TzU+/jpZ JrnVig7LOkZGZ2NOMe0I21XYZTh58Dl3MJiPXAWz9+4sCCZc2c9g6j2//foxWgMCIS8sDg y/yh1zrOKybV26lOwkVHwPjjOoTm9U5IsVm/427TSJ0bUObP7x76PNJoQ5FausBmgqhJTg Q6nFJEMdzAEq1oc0Yug1mSFsV4DBo1M1OLN1TMO5Ls/j4oeJz0xiBH6iNoLdrQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260894 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Works As Intended --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 8 22:06:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 955AE1936EB6 for ; Sat, 8 Jan 2022 22:06:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JWZ1p2GWQz4d5C for ; Sat, 8 Jan 2022 22:06:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2A46626960 for ; Sat, 8 Jan 2022 22:06:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 208M6sbZ099321 for ; Sat, 8 Jan 2022 22:06:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 208M6swF099320 for fs@FreeBSD.org; Sat, 8 Jan 2022 22:06:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246201] fsck: Does not honour /etc/fstab "failok" option (mount does) Date: Sat, 08 Jan 2022 22:06:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: easy, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641679614; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dhUwloZCmlResDQXnm51LhKSTLcLi9sxClm3BVcjw84=; b=gc0K8SVNsb8gVbnJEfvY4EmgTSJ6It5cMx4cGITux+deU8p8geunJ3EecSygQ03vTfS7kn pyLcflBlm7Pd2GlYXGgBAa/NoDsO76/MoSl0dXy1sNRKSC9ctKF3t8GwlE/eMocdkoB5qu OcMd58ChPvRQtxjPnM5yPZ3XJRO4TwzRzBDeXu/xjUzKnOrWUAq81rXn0UvsSOfznHPJ6I wq4/t+BRIgUS94vBagBXX33oI16EWGsy4U9sBYyQFKylqQ/Uhp245d1A0YxZntOKXeNqze pdmPQJRMUDd/nElg7zhGfO7TxF9Lfq0ce4hjT8Jo6dAqNojpMTvKiRccd7DDbg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641679614; a=rsa-sha256; cv=none; b=NLchefvTvuOcOuOo2/sx1G2pXX4Ce6JPey/zsXeUr6OXo5/eMSdmINrLxfzdS5B+JtlcL/ 4cAp2663aG5PMwFSYzNO2hp6ukJtTdMVQ7U85G6S8e7rtcRDwUWjld1OuJNKMHokGVxfmx pukkS6M8/tNjYywoZPzvXoc0ylY8um7IjbV4whGzwJDI0UJuV5WtnUxtmYS5owkYjZeoPi 2/c2GDCZhw9OPeehpIkcUy+p5HAXN02DieboclMIeqdm1fTwIH4S33QxKlCOzlbcIfIwG7 rEPMbkdwl5ljt4lpriVF+he/bTb5Ymig7GyZLQhIyAVWgQ3ADl9CIqPfEf0DRg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246201 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #7 from Kirk McKusick --- The fix has been MFC'ed to 13-STABLE. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jan 9 21:00:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8187F193557B for ; Sun, 9 Jan 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JX8WG1Hzkz3w76 for ; Sun, 9 Jan 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F0C5A18AFC for ; Sun, 9 Jan 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 209L0vZm043377 for ; Sun, 9 Jan 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 209L0vBl043376 for fs@FreeBSD.org; Sun, 9 Jan 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202201092100.209L0vBl043376@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 9 Jan 2022 21:00:57 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16417620576.57CCF.40544" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641762058; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ckH4JeZPj78y7i4s5XObHLJvBEu+GUhXLaRGxhRlde4=; b=JxQzBPhFwN61SWs3NDeh4KycpXXCsVKDaRrVvdWY3PaDZ71ijRVvXuS854Ci8Lpv6SpTLa h/9qn5yQFSQ/iMfSgmRyQAHcdpr9iDa9BnMhcAwhTIJptGqOztm7f9x3GZvB7d3rNMaoXR CKHFBN2UAq61TO+GDLNFbIIRq47PUKukSj6jU1YlG7Bxt2nRaJm61JT/HVP3rhnLzoHvvG vCDFzCYZz4p3RpKB8ewVhzvIjnJwe+MZx0whOX/1SEVl0pU2HThiOAY3W3H9Lli7oqN+cL WziW4+kPOLV+CZvf/6i2y78PZXsNJ8GdvRqHava6n5F7Nw+BZzLYWeSybsdytQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641762058; a=rsa-sha256; cv=none; b=S12XOCEZsC6UtpCLNZEodfRZc2JOE50mNP/a2fT7WXrO6toohUEFRMdW2H85mhnaaYGbB8 gR8/V+Y11orXBczKJxyptMHPSOB5/q34y342e8rocgfYoaBSHveEpbUY7UFWVzGygaBe2L w2Fuo8xohxAzZ8UdXF/Z374yhuR9fnv6TXnhbV20sPQuzbUIPqwwg1xR6K0x/nOSSOg4no IXb4IMj0/33up8ACexURkldq+qKXN/MNpO8HZ6zo2hj7wLXtBzNeOTfW30AF+4PW0Pbaub a1sC7riXu3m8dKx9cNupWe0O4NfDImXWHWQhZ0f4dAVwWsbV2uUToff7OxtI4g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16417620576.57CCF.40544 Date: Sun, 9 Jan 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16417620576.57CCF.40544 Date: Sun, 9 Jan 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16417620576.57CCF.40544-- From nobody Sun Jan 9 22:58:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6CCED195589F for ; Sun, 9 Jan 2022 22:58:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JXC6d4SDfz4pdP for ; Sun, 9 Jan 2022 22:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7436B1A94F for ; Sun, 9 Jan 2022 22:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 209MwHgY007984 for ; Sun, 9 Jan 2022 22:58:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 209MwHLe007983 for fs@FreeBSD.org; Sun, 9 Jan 2022 22:58:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 197141] External UFS Formatted USB Drive confuses ZFS Boot Loader Date: Sun, 09 Jan 2022 22:58:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641769097; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=u3c9iM2dv7zcGLyhPYXhGTN0XUWUAi1F2/9zvIEMLVU=; b=HDUPRrv+8nzxiJg8YuMpy5e3syiR8bP+xB0m7G8dEt0XDIoyrDeN9wlupN/shYPfzaXdYO 7E8gRKxIcL+uI/MHsLPDcGUmhJqecgY/qEAtsVzGGIjvwURYWMDfebY1q9257hZl2RCK0M lvDmtZBTPLtEqjVlF6cgCw5HK0zZcObpE66B5ML8B9qpn9KunM5CGbjfZzNZv8xc8SjQ02 l7X7ZVhTQpuaNpKHiuGasHh+2wUXi6/ne0HVxuBRWql63H6y/r1gfblPs6DX6yfK8Ey0iv hDvsAQbhDeBSgA8yTTcgwjOpB1xm4zTBzRVO1BwPkDZ7ztRKhNV5F9B/LqXAfw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641769097; a=rsa-sha256; cv=none; b=HhZH9ISvxfDoqO6yqPO66fr3UZ4dHi//SqTi+1711EeyPW0XrsGdaiUpbokA28oIhQ6xDN N5sAXw25gdoM3VSOW4oQ1c1eRhP69Th3JNo7/8V15Eh3hBo7IsCanDZ414OW/7qH1mqfTP jndjxZ4A9UL3sxjE8i86BpL6Oje+0n9RLNUNgPhWTyZjuR4fgkVLz2LzIWuwh8HVQGxNXM VOjp/rZqX3VSN+xqqOJAeWfPMGSCqWqstRyuW3OBpbf1sDDWLqEjydZpeVKXmf0Eh8djJa QmMQye31OlZOyavqfT5TpVqpv2BuPhZ5+jXYZjXvJbPfQaUy/6FSAiOCe4nv2Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D197141 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@gmail.com --- Comment #1 from Graham Perrin --- Some time has passed =E2=80=A6 (In reply to sdb from comment #0) Reproducible with a supported release? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 10 23:08:55 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9022F1947BDC for ; Mon, 10 Jan 2022 23:09:06 +0000 (UTC) (envelope-from longwitz@incore.de) Received: from dss.incore.de (dss.incore.de [195.145.1.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JXqJd1zn3z4s1h for ; Mon, 10 Jan 2022 23:09:05 +0000 (UTC) (envelope-from longwitz@incore.de) Received: from inetmail.dmz (inetmail.dmz [10.3.0.3]) by dss.incore.de (Postfix) with ESMTP id 966D46BC53B for ; Tue, 11 Jan 2022 00:08:57 +0100 (CET) X-Virus-Scanned: amavisd-new at incore.de Received: from dss.incore.de ([10.3.0.3]) by inetmail.dmz (inetmail.dmz [10.3.0.3]) (amavisd-new, port 10024) with LMTP id VMnszZr_c_iL for ; Tue, 11 Jan 2022 00:08:56 +0100 (CET) Received: from mail.local.incore (fwintern.dmz [10.0.0.253]) by dss.incore.de (Postfix) with ESMTP id 96EB06BC472 for ; Tue, 11 Jan 2022 00:08:56 +0100 (CET) Received: from mail.incore (localhost [127.0.0.1]) by mail.local.incore (Postfix) with ESMTP id 916A114A32 for ; Tue, 11 Jan 2022 00:08:56 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=incore.de; h= content-transfer-encoding:content-type:content-type:subject :subject:mime-version:user-agent:from:from:date:date:message-id :received:received; s=dkim; t=1641856136; bh=OvFrr6S6Qqxy3+eJpAf zfdK0gmVOBpC2qNCHvuumBic=; b=BbchVs9qtxETquR/hFfdUm9CkJ8Kgw/8Mo7 n8C6c/RmtOm25vlvqZK4chbgYRQ0T3WO4RFsY9xPjvEssc2nLZnk0pwu/u54d7hq ijtyRsIQJj6GPKKSxeU+KpRJeeiOFdWRj4RJf9ejSuRbxKxW+SCSQGnNZqIR3MRD mXr/aIFM= Received: from mail.local.incore ([127.0.0.1]) by mail.incore (mail.incore [127.0.0.1]) (amavisd-new, port 10024) with LMTP id ddy3FRtPixk7 for ; Tue, 11 Jan 2022 00:08:56 +0100 (CET) Received: from bsdmhs.longwitz (unknown [192.168.99.6]) by mail.local.incore (Postfix) with ESMTP id 4D0B814A31 for ; Tue, 11 Jan 2022 00:08:56 +0100 (CET) Message-ID: <61DCBC87.3040705@incore.de> Date: Tue, 11 Jan 2022 00:08:55 +0100 From: Andreas Longwitz User-Agent: Thunderbird 2.0.0.19 (X11/20090113) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: getfacl truncates user and group names on ufs filesystems with POSIX acls Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4JXqJd1zn3z4s1h X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=incore.de header.s=dkim header.b=BbchVs9q; dmarc=none; spf=pass (mx1.freebsd.org: domain of longwitz@incore.de designates 195.145.1.138 as permitted sender) smtp.mailfrom=longwitz@incore.de X-Spamd-Result: default: False [0.61 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.915]; R_DKIM_ALLOW(-0.20)[incore.de:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.145.1.138]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_NA(0.00)[incore.de]; DKIM_TRACE(0.00)[incore.de:+]; FORGED_MUA_THUNDERBIRD_MSGID(4.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.977]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3320, ipnet:195.145.0.0/16, country:DE]; RCVD_COUNT_SEVEN(0.00)[7]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On a FreeBSD V12 server I ran a samba4 server with AD functionality. On /var I use an ufs filesystem with POSIX acls, because the provisioning step of samba4 needs this for data stored in the "sysvol" (directory /var/db/samba4/sysvol). The file /etc/nsswitch includes the necessary winbind entries: group: files winbind hosts: files dns networks: files passwd: files winbind shells: files services: files protocols: files rpc: files This setup works fine with one exception: I could not backup and restore the sysvol data with bacula. The reason for this problem is the fact: samba needs group names with more than 32 (MAXLOGNAME - 1) bytes and stores these names with the help of acls. Bacula has the same program logic to read acls as getfacl(1), so I can show the truncation problem direct: -> wbinfo -g | grep policy ADMYDOMAIN\group policy creator owners -> getfacl /var/db/samba4/sysvol/ad.mydomain/Policies | grep policy group:ADMYDOMAIN\group policy creator :rwx The following patch for libc solves the problem for me: --- posix1e/acl_to_text.c.orig 2017-11-25 18:12:48.000000000 +0100 +++ posix1e/acl_to_text.c 2022-01-10 19:04:05.551305000 +0100 @@ -44,6 +44,9 @@ #include "acl_support.h" +#undef MAXLOGNAME +#define MAXLOGNAME 257 /* max login name length (incl. NUL) */ + /* * acl_to_text - generate a text form of an acl * spec says nothing about output ordering, so leave in acl order The length problem exists only for POSIX acls not for nfsv4acls. It also can be demonstrated without the help of samba4/winbind: echo "longestgroupnameeverintheworldandtheuniverse:*:3333:" >> /etc/group cd /var/tmp echo "ACL Test" > acltest setfacl -m g:longestgroupnameeverintheworldandtheuniverse:rwx acltest getfacl acltest With the winbind entries in /etc/nsswitch.conf I see some messages "... not found, and no fallback provided" on console (in single user mode) or in debug.log (in multi user mode before /etc/rc.d/ldconfig is running, also from static linked programs. Some examples of programs using e.g. getpwnam() and endpwent(): dhclient[540]: NSSWITCH(_nsdispatch): winbind, passwd, endpwent, not found, and no fallback provided pflogd[694]: NSSWITCH(_nsdispatch): winbind, passwd, endpwent, not found, and no fallback provided unbound: NSSWITCH(_nsdispatch): winbind, group, setgrent, not found, and no fallback provided install: NSSWITCH(_nsdispatch): winbind, passwd, setpwent, not found, and no fallback provided These messages should only be logged, when _NSS_DEBUG is defined for libc. The situation looks similar to the message with comment "This gets pretty annoying .." in the same sourcefile. Therefore I use the patch --- nsdispatch.c.orig 2019-05-14 09:42:45.000000000 +0200 +++ nsdispatch.c 2019-11-15 11:58:16.000000000 +0100 @@ -734,10 +734,13 @@ (void *)srclist[i].name, ap); va_end(ap); st->fallback_depth = saved_depth; - } else + } else { +#ifdef _NSS_DEBUG nss_log(LOG_DEBUG, "%s, %s, %s, not found, " "and no fallback provided", srclist[i].name, database, method_name); +#endif + } } } Andreas From nobody Tue Jan 11 17:11:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D55AD1945F23 for ; Tue, 11 Jan 2022 17:11:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYHKH52lPz3mmr for ; Tue, 11 Jan 2022 17:11:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8E0B01CCD4 for ; Tue, 11 Jan 2022 17:11:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20BHBF05044546 for ; Tue, 11 Jan 2022 17:11:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20BHBF6D044545 for fs@FreeBSD.org; Tue, 11 Jan 2022 17:11:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255979] fsck bad inode number 2 (256) to nextinode Date: Tue, 11 Jan 2022 17:11:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641921075; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ut7iXIN2ZKDaMGM9uaPBKo3Q1/4HBqwe6kWGVwnOw0Y=; b=gPUwVzgjhjPTDRg090YFGPNXFjEMAls4pqReAxpto1NJtqpVMZRnbuethLHQFNDhevMeHx SNm3nWN7VH18571vL8wY82mbRoO83EYaDlie5ygFxD+MDgjCcfcHc2wbwQv031wVml0Wxc 1ZZALNMRN5X2z+McILkHIer82erCPzJ4sK8Yxpj1dxm1oe5Pi6/G1uhPnFnWXc2zRIyHK5 DVxnq4zcReWJcJaK1hPlURaG5BVN1DYHVteBQ4McBF4+cFz68SMuDYhbFuGD+YbVqgxq4E hkHrFjNOTWZ8tt3pR7V4rNQE+kCuaQwJTmqP41pp3zaAWN1orgeAbaNwlYhT4w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641921075; a=rsa-sha256; cv=none; b=SQFgvjAdgRe5Yp0hSk8c/NngzXwAIlVxA6H6yD2XaO+YnVQSHd5GotiKFaYki/4sH5P3bm wnDi9lqhHgmDm2s4YTj5CV7Sfsqs5CJfnfbZVMMm1MKA0ABacPxRv4yzjnbatdkgOgP+ag ArRDWXxIWtAtj5pdsIC3VYX9DobUtHlGUbuoUWai+k61+vhA2qPaVwVSAWjyDk8T+DDtQN cSuGzNSMfgKE70Vf58UTEeJFYdqUEI0VD6wK4a8JIhcqjT/1os0S0ZNRHhUJHFRBSucMSh dUkZaJAYXr0H8o//RnyNFNjdGzRVW7ZuMMQs2YwK4EEPN8nEHb24oybaMJT94A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255979 --- Comment #31 from Ed Maste --- (In reply to Ed Maste from comment #30) Unfortunately this was not released in 2021. It will now be FreeBSD-EN-22:01.fsck_ffs --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jan 11 18:15:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4A829193FB5E for ; Tue, 11 Jan 2022 18:15:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYJlS5rQKz4Rbq for ; Tue, 11 Jan 2022 18:15:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 22A611DBE4 for ; Tue, 11 Jan 2022 18:15:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20BIFWTM081785 for ; Tue, 11 Jan 2022 18:15:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20BIFW1Y081784 for fs@FreeBSD.org; Tue, 11 Jan 2022 18:15:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255979] fsck bad inode number 2 (256) to nextinode Date: Tue, 11 Jan 2022 18:15:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641924933; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bLIfkp66S+r+CdtJBdKB1otkD1o6BiNFhoxyf2AZL8g=; b=DeXX0IJFFSGImJJ5Gekbp+eJ+VcR6iJW6nDXzzKhM/3QoIuQ3l0MEfUf2oHOJ2L32gIulk /3WCZO4KxBrA0HqP7ykJViY6fpxBh/Ez/4Sg18mTkh+GWgdbd+3YzESHlUlkwcPdbDvp2S q56Yf7Nhp1sPMYBKSE1f5OyODUJWHPlNqTliKDma47YD13nMMxnQMrcLRXDFduu6JM38ya 1R8BE8xRLQZDmOeggaDeYsDdTRGCwPfmYMf4XLUYgUoRnLSXWexKhfpufaK7+Xa9whH8aW trosJz7GYOh9VAQXihlKSGpR4D37ep9dPTnzkcmDJEmF6dmW873ZXfQ8HyfJ/A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641924933; a=rsa-sha256; cv=none; b=KMyaL/X4TAzkSAZ/Lh9bDh7LS5uINcd6aAP3e1CzpLgFI+Wcu7REm2KT3cjT6Qgk7lFEuk U5km4lzG7bnSrVTQ3Q4QcUSh0bFprXLck7VBkHoAezw0oT4uzOvr6EyPWY1Apl+VqQpRdf cFO3ZxykJr2efdEgBWMco/mFO2ZmjHDEufCVZt+L782CzBJhLNxR8in3hG5XPtaeWQy8iB PlcCTcvKPyAdDzm8hKHUEhOTika4ANkPdYn4wmxa/2EZl4WrvMgw/EPjyIJiyLKGLFrNRm OxPJlz9ms55H478FWV42o0yhAKj9cDfXL3uXafkZ9ne4VJdskDZ4amnKoIrMVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255979 --- Comment #32 from commit-hook@FreeBSD.org --- A commit in branch releng/13.0 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D3286a8dc83829bf183284290dd59f82ba= 389a066 commit 3286a8dc83829bf183284290dd59f82ba389a066 Author: Kirk McKusick AuthorDate: 2021-03-24 23:50:24 +0000 Commit: Ed Maste CommitDate: 2022-01-10 14:51:48 +0000 fsck_ffs: fix bad inode number errors Fix fsck_ffs Pass 1b error exit "bad inode number 2 to nextinode". (cherry picked from commit bc444e2ec6e6cc9d96d35ab7ce3c02c0da952fad) (cherry picked from commit fab7c18ce3229d53b732fdfdbb6e9a1a1c72739a) Fix fsck_ffs Pass 1b error exit "bad inode number 256 to nextinode". (cherry picked from commit fe815b88b553667c40353c46b58f9779efa3570e) PR: 255979 Sponsored by: Netflix (cherry picked from commit e198c1dc8f6faaa85bd20990d15e3bcb9d081873) Approved by: so Errata: FreeBSD-EN-22:01.fsck_ffs sbin/fsck_ffs/pass1b.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 10:02:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 99C18195E24B for ; Wed, 12 Jan 2022 10:02:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYjlc2Rpqz4rBV for ; Wed, 12 Jan 2022 10:02:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 34AC8267A for ; Wed, 12 Jan 2022 10:02:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CA24md082353 for ; Wed, 12 Jan 2022 10:02:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CA24ZP082352 for fs@FreeBSD.org; Wed, 12 Jan 2022 10:02:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 10:02:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641981724; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=4dSjcmHiovgTkBSQhSJt/swoGfKIPm33aZVZIcYOFzw=; b=Yot9UKsZKxXxEL3kQi7GiJ/KK3bO5nosCOqVr7J2r/oi9kljMQAnsprFrfggaxCzo7n04i fn8tYV9jVnk57bdV5FKGrsVLYiTJPXsw7VRxOQf4N0d6R1zj15Pomhyxg5EdGDt2JQhc/s 9+bCrKOKJ+cGso4oz6WNW7X1IATp/ZLXC+LodhESg1S0XKn/nbpEGoccrKO3lT0YIZ4D/c LsnYde2zbATTV5bZN5lZR507MNWTbfSn7ZFPBPwYjx33CikgCH+xSA/g4sVXCqIXey3tc0 mZTWQGXHsdx8umXYqXoK0d4V8BjA3Qs4RSKTM8BFLiEAtQcELH04rmRDrmAVMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641981724; a=rsa-sha256; cv=none; b=MQ3ZnyZ3gP5hlq27bhmTdlEDM5ggR1NuZOcG5HroUb6hw5Wv96zDCFllhSvj2nv1iQDS/2 lW2/FqisMGfOmpWtX7FVGt11otQApdpC5F65/MGPXTwe7VKBOWbo6x9ZV1gF6PnAkq4+4d hk71BFUt/anwSE5qSBJ2FzHBF8bs4T7a52IlOYg0LxLzk5BHxZRg9MQuM0fMXcL8IuUlba lVmEugTHwlaS7R1YNyYF+B5B3zGkTzp+0Zpbp+mZbb1ioQdyPa9NNSrAMEmuW8pQe5H4at eI1tm6k/BEfkXmHOeeny4R6PS4yg7vSY256UxxvbFOA/a4DzniktuM1uV5uznw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 Bug ID: 261142 Summary: Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Product: Base System Version: CURRENT Hardware: Any OS: Any Status: New Severity: Affects Many People Priority: --- Component: kern Assignee: fs@FreeBSD.org Reporter: manu@freebsd.org While working on upgrade for pkgbase I've tried to upgrade a freshly instal= led FreeBSD 13.0 to CURRENT. Steps I did : - Install a fresh FreeBSD 13.0 on the machine No customization except for unselecting kernel-dbg and src so it installed quickly ZFS root on the nvme drive, stripe mode. - Install the FreeBSD-kernel-generic package from a 14.0 repo - Boot the machine and it fails to find the zpool with "failed with error 6" message. Even if it's pkgbase I assume that compiling a kernel by hand and try booti= ng it would cause the same issue. I've tried to also upgrade loader.efi on the ESP in case a newer one was ne= eded but it didn't fixed the problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 10:09:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 475C4195FAA2 for ; Wed, 12 Jan 2022 10:09:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYjwb6jKSz4sdP for ; Wed, 12 Jan 2022 10:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C2AD92857 for ; Wed, 12 Jan 2022 10:09:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CA9pt1085022 for ; Wed, 12 Jan 2022 10:09:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CA9pt0085021 for fs@FreeBSD.org; Wed, 12 Jan 2022 10:09:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 10:09:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641982192; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jp2Rfy8ZTiBNFyJmg+GoeUQziqWfQEjqo8o0biYAGlg=; b=Q8C9PN+FdCu/zcnCeHfyGFDE4GzCP4S0a4+oQj3iK1iMF5nS0fHpCB0cogTa3QaEADYy6X vZGorbtwzYL9NOBrcuRnioISTKIaNMh4uw61fy+zMolNh4gKgLg/v/GMTe3XuPuAv95sKm O3hbU2cCW6inK2NNC707/NEo806TABs5/XPETzDMCb8N1e95riPXXjsFFP0NHQZtOKJfnp kr7b4loLHFFBmu0HRqirzSSc/D1XrjSawrtkjBlWD6GzgTMEg9X3+jA7whWhSXzgqEL8LE Gr2H+QLeSajXTd0enKEckywsotM59Hq11VV1+h3TNQ5o627cRBs8OyDgibA6DQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641982192; a=rsa-sha256; cv=none; b=g79iwP9VOYeb7GyUPUl++zThXAdRMuuGf1zSjzIXdErfr7nYS7AVwsVwWS8LwDIUxSYCvm Em1kz6fKoEjyu3KgWBOosxwKMsLhvMGwQCEk0hOWkEj05Cf+FxOV+ftHseTD3w60R69bXj HoF1Ytb86yWaCeQoHc2zPugtmE3h0nhWr3b7jpCgz3jrSwnslL/ZzDHp3TqI3E3EHmYYIp LkXIssMD1plYqxJrtaMEAVHyFae3mdAS971u9nI59oz3WhK89Yv5Cxpb+AgESkhhcljGIn bvmINZ6l3uif7unTerV5Kb/JxVOmpZ+1CIwG52VePmfZE/KT/wOkNIoysOLL0Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 --- Comment #1 from Emmanuel Vadot --- Just tested with UFS root and it works. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 10:40:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 31C8E1966DD0 for ; Wed, 12 Jan 2022 10:40:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYkcB6SJ7z3CrM for ; Wed, 12 Jan 2022 10:40:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BE508378D for ; Wed, 12 Jan 2022 10:40:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CAegx8003679 for ; Wed, 12 Jan 2022 10:40:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CAegIt003678 for fs@FreeBSD.org; Wed, 12 Jan 2022 10:40:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 10:40:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641984042; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SvYQBCaxQYhEVTNqcRwI3ysf36e7jP/4FTdJnLmoFf0=; b=ft1B5tAv2qFgkMXVIQeRC4DHFEz66AXrCVHS8b37vadmsvA4ZXgj1PYbUVvgDOqgBFpt7H 59gIRd475ZYqnEbU0nTRTPCENOI8e3CceRlSDFKIbyGQy/c7ZtUfD9NgjomGvIoBCMZcfw bgV+cfXMVeRWFMKucVg3iaLLNEjIiJIVpjb82c8Ilf27cDQDi8z42hEa2uUdzBBCaYrw8/ zhhelyiCBpxFD3WExJ0X9enz5MEytaFOIeFok+6LXwoXSUhlspWpDHRx03unUmY/t4q3tQ USQA3ObhKgI9fMqO0t06bCptjKcbVM5RlS/YCZVYucxFwIm2JdrF22v7Dk0cew== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641984042; a=rsa-sha256; cv=none; b=Wmq3C7hbq0Amjg7jsZPlBlg356goK4QQ1ORIE7Cjos387RP7lidi2zkZ7vjYmusj2O1WBh c0sq81kRjZ0YR/NXnl06OqB/LM+E6ZmysmplAGNTJQhPR3e6f96HvvHN4qLwEeE8qNJEa1 DVw+Zc2P8qKNwQh9FUICwdcG29BjDM/W7D9WLyZmsHY2n25iKwHYQx+IhGqxQPm9OiqxGI wRhZaBWLxGiCAdSJxmQ2VuGs02h9By4FdG3x/HD0Wude6MbTUMsN+WdbcU/iHo9w7B3etN tRINHyTRljYa3SZmwiDs+Ur3ZKfU6iBHNz/duFE8SlueOSrydAds/9Uvo8x4mg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 --- Comment #2 from Emmanuel Vadot --- Tested to upgrade to 13-STABLE as I had an old-ish pkgbase set from decembe= r 11 (stable/13-155748c1e) and it worked. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 10:44:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 638611940114 for ; Wed, 12 Jan 2022 10:44:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYkhm0dZSz3F03 for ; Wed, 12 Jan 2022 10:44:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EA44937E4 for ; Wed, 12 Jan 2022 10:44:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CAidLH006921 for ; Wed, 12 Jan 2022 10:44:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CAid7W006920 for fs@FreeBSD.org; Wed, 12 Jan 2022 10:44:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 10:44:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641984280; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JQjYeLFCJps5duifzzjQLmkmdDqlPInG91gAEqwaTac=; b=KqaIXNv5dM5fcAGi8YpsbeHikq0CljOk7T2jbf9Q3ixCVmxznmd3ICygEbfhwOGmeY84hZ 49y5v4eVbkza/42BXt1/uXP1yXe1OmrjLYrFhp/tsGqBYPc0FvNNO2N9FbIqadfonZjVow T9+fjfo3Zsv8ECSjxJLxJu1mCQR1Umntf+Oa3VLenws6B4QW2Kn1vLl22b91cw3/9Kysi8 1UxxaWVlahAic9PZRWJI/KzlHo1X9EteabJqXz6fn5wz2khRmxjttyNROwq0/pcnxNtfYZ ODZ93FlvVcYHBIkXX3gWagYNvvR0fQpVm7M6qUpwMewsSfc6wdPZ2JJMCsmgjQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641984280; a=rsa-sha256; cv=none; b=tCiYjRTUyHgTyopc893OpeCJ8P5RcgUcVQ7UCNRlUvQ3v9971iQ/p2B3lHq5N3Yu9s4XeU CY0RTlvvKi1F45pC2N1K1XuwGUToyUN/i7vi51mtIraQB+fcLONFO56fLl57UxRkOSWHJe Ma/xOFx9OyInR4Sotvpa7y0zwXhf005zSaHLguXNSCg7ggEwaddM2I1uXoTTXj1wNuuYnL EMveVmwbeh2RUh0T387WdmizvB7pYrgv1nrRxHR6vCWzUf6A5BtWpKC2tBV+EK7slAPAfs TdT1Q9Y1Sm7r9r1jrBz0wDijwJL8mSCKANrFBEowGDnxESbG59PQUeiB2SEnbw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 --- Comment #3 from Emmanuel Vadot --- Created attachment 230945 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230945&action= =3Dedit verbose boot --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 10:59:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3385419452A9 for ; Wed, 12 Jan 2022 10:59:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYl2N6Ncxz3J5H for ; Wed, 12 Jan 2022 10:59:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B779539EF for ; Wed, 12 Jan 2022 10:59:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CAxu09012726 for ; Wed, 12 Jan 2022 10:59:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CAxu1T012725 for fs@FreeBSD.org; Wed, 12 Jan 2022 10:59:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 10:59:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641985196; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HFFoG0GaRX9BK2+UZpWtwp7A6egvvJ1Z+tYQr/2StM8=; b=KSTNLTgnwWwrMS86cC1fBqvNcCcrv0tL0jX10idPPZBmEg2u/Hd0mn6qqdNquVKaX2NdJm i9grjJwtoEKYL4/NEky/HJE5N/GeG3nzQrJaDVmwhb4+VjHxlJGwQe4FiUpRpth63FnS4h Lt1go9jf9KyotNihgXKWz8c3FEFqbWWAcyFTQxYXUedkXpoMuOuS/jYuGw9JKcMYbgDVfh ATexywArC7c+w2/UlgOsuqunRCfp2Vy2j0wvgs8T13BqzcNpOnJ3j7VBFgGOZOHgICBNIr dSuvzQtKX4zDY0nZUKITLEpqXyxUDAVKyIPsqi9dL1PEtAn14XzQeD1OfDlc3A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641985196; a=rsa-sha256; cv=none; b=NEyYtEPbH5VSptphlAJqhEPQmvJmGhTnJybsX3E3HGQUagLru4ojIAHh4dm/zXJZmcOClU YiwNWFjVlyQ+nBFMT/kPT5qEOqZbAELIBsJ6XKrAAeIEnpBFBhSfQOFALCXJpIWtBwo/nz bl2iPHgGYLe+4UFIu52deEanVAz5CS1D6+jQKhOCUgbs+CdVbrM1eXAkxSPQIBcDvG8Puj NHeU54LT0nTCn6xlJTyOrcJBRVMF3buVYkcKfh+QcSY6F+xAk77aHejmnasivFbDvrUNkX a6AyE64XkbBwlvUZk/o/4F0shNdDT2ny0R/GoGCnvpUsTpbgDIxEtTVY+q0x/Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 --- Comment #4 from Emmanuel Vadot --- Booting a kernel from https://cgit.freebsd.org/src/commit/?h=3Dstable/13&id=3Dfcf4b06a5e6a0891f89= 4ffee42a62ad72968eafa also doesn't work. Could it be https://cgit.freebsd.org/src/commit/?id=3D3aa1cabca37db4ef3da06e92af1768878= 3ccb00c ? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 11:01:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 58C391945E31 for ; Wed, 12 Jan 2022 11:01:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYl4X4nZ7z3KMF for ; Wed, 12 Jan 2022 11:01:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 785A93847 for ; Wed, 12 Jan 2022 11:01:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CB1mSi014482 for ; Wed, 12 Jan 2022 11:01:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CB1mxh014481 for fs@FreeBSD.org; Wed, 12 Jan 2022 11:01:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Wed, 12 Jan 2022 11:01:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641985308; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tUgXwow+aKszAA+MHqFK9vi6cE6sNwEakIrFGAY3u/w=; b=eN70HT7nC9wIe/CLBGMDN3FK+pjVdSuTdH4Hx3XlTPtBfOOwDWuyK4mnlQVbJnZKL4p3Rx qhwGEg2865Cs/IIuJjjVpyIlJTw0wbATBXi0OFIWBBMxQYXXmWog973rzfzUXzG+AQTQRU JYK5hk8lsgxUHin/E+bgoh/x63DyZiwJeyo2WdFj2MqE2n2JuuuxXM+IPFCcBUUWVjRZYD xvSMJ9cCLfcF1ahPHM0kriDh6tw1OLqOqKIB6xMjEN3jo3J1s3TelVKB6i/S6AnF6fJCwJ c91uB6lMnut9mYevebnQkbw/k8vyNNYhr5pGZo0mSQxColjtIjoT+BQjHoU/Mw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641985308; a=rsa-sha256; cv=none; b=Fp8WAkWrBancPwl3tRFVRQ26hft3nrQ14thfzIFkSys5f7u2ln/Daadgd4XCmiyBMslRI0 0FU0xGj+jGQyBfjAigcSWtDYES430iMpbEHhaYpd+HrmJIdTq/AwG4WpBGx/a874wlNQtp vgRH8ZCQAMmGb6FFEA0N8E2VuWc5LWvO1DsmWLT15qHOxESbIjKWpVbJHaTwqOqCdb373a YspnwbvjnDPG5Evuxznacut1gzlOa1gdhphcj7V/n8CO7ZjYKLA4PIIxFiCwNcuIYjayMX f/saIpwqQLtAZyzoH9Bzr8qOdDIiGrQV/uxswISArgxk7zY4QNBn+wrJvVmyxg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 --- Comment #5 from Emmanuel Vadot --- Created attachment 230946 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230946&action= =3Dedit verbose boot 13-STABLE --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 12 14:27:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9AA2E195C1D3 for ; Wed, 12 Jan 2022 14:27:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JYqdz2hFsz4g4S for ; Wed, 12 Jan 2022 14:27:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3CAE867D9 for ; Wed, 12 Jan 2022 14:27:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20CERZfx046715 for ; Wed, 12 Jan 2022 14:27:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20CERZT6046714 for fs@FreeBSD.org; Wed, 12 Jan 2022 14:27:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260453] ZFS truncated write to O_APPEND file from mmap'ed memory Date: Wed, 12 Jan 2022 14:27:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: markj@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1641997655; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OXhNyK8bGp4FpVWncbNJ7trkKD+GK9e3rF/C2HuwjUg=; b=Q/5Ar35HycYr3TRiWrg3+3AD62lgH6GfjVRes5c1Z3FjlIN8qxjpll8/FJk4c3LMxq3qu3 +1SdtiPK5NxUrNeuRI8jp5TT6HMft7c9/q5UYwlQ+4SUY6xocgEiPPtKlLrJixsq+zmw4Q XkvTWO3TCL86ZHN0lWz6tmXVN7Gn8wZ0PsIOMAT3M4usCz1t0YAkvasY+2lS7PqXSFp9C4 akQL3fA3cR/R4UFxCCQwgCwiAhAbc/7i9Ys3azd+HbMnfFWhV9xJprbqfjpNWpyvxMSFgP tX62/g+mTtahwJaRYgpLCSmq3eFLI5PXwd39Z2MfGCSGW7aIh/C3MOn75qmNyQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1641997655; a=rsa-sha256; cv=none; b=DRfMY92JxUNN+YMR0QWM/rij00KsV1KaimxGwo+9BocC9jqRL4r237Iuyfyk0CJuNohdTd E1m8i3DBgRhCLZ+uBNcv7JxB3ItB0LeFnzGJGaFgwIfPeilstk/Qs2ZfLfcq5Sdxj7NlTc KxVcJCoZki1WvhCweHJE+Bz2X8Z1V8P8QGomdx+k3QNJt4qHzmewWH63OKK/n2Ghj67Xdq +1KA6ZuJW+oA6EcpnIsknA9blPQjAKArmujKt8K2OUR3F/j/FtSEwRy9YvFsW5JYYkx5xo mabIP+hXlNrMrLkQrPRecrKEjWdHlzkzaFkLcxOqNkI3EmBnlZo6ircY3sVfMQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260453 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |markj@FreeBSD.org --- Comment #5 from Mark Johnston --- https://github.com/openzfs/zfs/pull/12964 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:29:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7EA091958BD3 for ; Thu, 13 Jan 2022 10:29:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLJK1t2Hz3KqH for ; Thu, 13 Jan 2022 10:29:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 20C601EC29 for ; Thu, 13 Jan 2022 10:29:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DAT5LA097386 for ; Thu, 13 Jan 2022 10:29:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DAT5P0097385 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:29:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 10:29:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642069745; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=xEEIL1zupcZ4fT3awx+Ry4O4qb7BGFT5pm6hlsJ9Kp4=; b=uJp8kW7sIjJw8IA+o8mmHFswPIDdMOAdB5BpKcJGrDebIknrEN39tr2wbwiH1EfKwqrNqW tfwXBCQEhf4NTkUVBKG4QiIb/l5FXgEarwH7qlg/ivtCNaKi0GdUou0V9xWY5cT353ioos oBfR02/Z7gDhrdrz4yxYiARysDNFEXHzzExtW17cDsjuxdfjNKk6wOVIDaOmQ6FphTNXYB pvCk9YK3LSGS8sgfkY39z3YKI2tQkCsgpS/f4aQYFvgwZtYDR/cE0L0prnPmNLODgxaSfO F91roBaUkuIllIhGaYzQXhvPAUdUN7GDS9+uPrtZyaTLfS7ZggfaiZafd5N99Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642069745; a=rsa-sha256; cv=none; b=w6lgHpazPDXOEce6r2Gt7slyHkCFHdaz7yj21ROVfZrZnzT7V3G5dHpc3Gzeq1LD7HSLoU OoVqch+XVE77HIJVJFDhmBev7p7p7XtSzhK2lnhKtSTBcbi6Lt3HQ5M93TKyF/2jJi6JXP cqBzz9TQzpejxR+USEjVBXD5tGhDnJo8zX/KroszIhHsdaclPh7iqcJ4HAmh0j1pHoWRSD 8CnArzAXZHHC0AEt7Z7S4eoVETOAFhTBFUl/pgHqKpw0X4GbEDmkqLS5KvDOv3nw2uE782 17QltatvR56UBZTS0k4XqiTkE8mDg3KW4Onskc/aV+SBYLDDrSRC+ihAr6hoYQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 Bug ID: 261171 Summary: ZFS SYSINIT not called in correct order ? Product: Base System Version: CURRENT Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: fs@FreeBSD.org Reporter: manu@freebsd.org I have this problem from time to time where when a SYSINIT is added sometim= es the new order of SYSINIT cause zfs to not init properly and so I can't mountroot. The added SYSINIT/COUNTER doesn't matter and it's not always the case when = some SYSINIT are added. After booting a failed kernel and set the root to some ufs filesystem just a call to zpool list is enough to panic the kernel. I'm open to any ideas for solving this problem that come and goes on this particular laptop. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:29:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 198B21958D6C for ; Thu, 13 Jan 2022 10:29:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLJc5Vztz3L9B for ; Thu, 13 Jan 2022 10:29:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9562E1ED2B for ; Thu, 13 Jan 2022 10:29:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DATKoJ097436 for ; Thu, 13 Jan 2022 10:29:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DATKuZ097435 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:29:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 10:29:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642069760; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0Zm79a/MZGowQG36vwmX6yIMK0hEPJwQWfL14ZMzBQg=; b=RBkIsUogQTOEA0fJaKnI3TrUYspdB7jxKOskWOyyea76u6wqSMUTM7DJucFlEgOGkCbkLU XZHn26ldGOVl64MmrhrqLFFoc0mXTr4n1EWUvi1VTWdDfADTLFaNsllOzfuCm7mzBTGKs7 om3VAMtSD5Yddn8T6+nqZlefHq9zpCR6ldAMrkdZO1tQ6b6Pl/xNbySlglw6RPf+31gfm8 ttXzCjFQ0if5VzxABu4X9As8M5Ubv0mLAf9LhT1uVPN5OZ0XtviPDLE9PFIkWK90sed0HK gFT3kAbNNTbgG0RUPQGZLt7tGpwZaAMEKO3a4srpPGldXnqNKPVWHCCE/1x2mA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642069760; a=rsa-sha256; cv=none; b=FxY/sXOT79RM+/YRU2k7yM9z7tu7cRlCdDDjfA3uaon08JLoaE7ZUmybmG2teEg/SjNbo7 PMVLLIR8D+WQPsBQ3HyIl/15Xi8gayaAxUfVcKhgAgl5VcsGRQpXcg/gc6mYx63TdrxsxH 3fpwpS/z9bDsiPNhuMqJbViiQTNd72fCio7zraB21IJYdlOqadTJGZ3bdK//fARB4l8sz/ OC5teJAld6A2G9471HTqwhuMK3XzLjVPZ1o7sHkjgov7AilYfWmP19Xs109AK2hHyudWub sVA3OQ7nlUtNOt6Mx+VkBy0eCVK9O9G6mVEisyhn/+1UoZlAxjxFqJzZv/oINQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 --- Comment #1 from Emmanuel Vadot --- Created attachment 230980 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230980&action= =3Dedit dmesg when working --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:29:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D266C1959186 for ; Thu, 13 Jan 2022 10:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLJw1zb4z3LPX for ; Thu, 13 Jan 2022 10:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1250F1ECBB for ; Thu, 13 Jan 2022 10:29:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DATZPa097468 for ; Thu, 13 Jan 2022 10:29:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DATZMo097467 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:29:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 10:29:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642069776; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=53S+p8Sqe7UJ78T2hiv29j6wnlrQ2mtK48Wbpmt7zb4=; b=mtxnbKn7hrReGQz+K2CdLIm5M7hUk+qag6mZESbrUd3LsdQl96uZa4nqqDvRnJF6sn9PZt UAtIeHqVI4drmWtaXUlnEhS8RSiLYbMfX/DMer+TNnbnVgdmQtc3yAaPBuzkAI2/ZyC9p/ bOh6ZCcuSQ91Sn5wuLFJF7ctLrmpJ/6/sx7iZlZGpZH/fV675avNMwtTdqUkDe/ox0BLTP D1y/buu0sdhxxk0/MgDQ5ho7mwwsCTE1x9Ssa8P7zwE8eABofQkfLBvxem0iNH2IQmupgm Z7U2UWMeGdw/4Wvveyy7xufjO25V+0lLTcMjPPxlRFhpRi0UqjIoH8JIQvpUxw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642069776; a=rsa-sha256; cv=none; b=UTkIj7hHFYOiwA+Esd+kEhGV8xvlhvGQWYoBGOs27g9EXH+2MngLWp5XK9gIVzEJ4esSYy mZ2Z1A/KYf4GqhVgId6iap9/TT1QKTQgl6fuwxaafSBDmXOcnjlOO4ds0Far9Xib940u8Z e7DY2LDGYkDNFT6dwLO66YbU2xU1XhqoBzOrrT01TC4Lv9/6yHJkn4cpWJ54HX5dWzJklF nIfDNhNlxuM8xhkQ2oHuy+q1LaYCaGRw36J6Z0X55j0nFNtosgZ47dvdU1xTyaB3vYrvfO oyMd/Hi+SILAj3FbLmp23lIDYcNuTf3HGMmGYuoYLKnXejb/xLfD++DnZ6FZJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 --- Comment #2 from Emmanuel Vadot --- Created attachment 230981 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230981&action= =3Dedit dmesg when not working --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:29:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 952091959160 for ; Thu, 13 Jan 2022 10:29:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLKH3n6bz3LkJ for ; Thu, 13 Jan 2022 10:29:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 34C0C1ED2C for ; Thu, 13 Jan 2022 10:29:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DATtO8097521 for ; Thu, 13 Jan 2022 10:29:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DATtVL097520 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:29:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 10:29:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642069795; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hOEZeKYUzb0AMeaGaEauIx00PKsuttLXPlNbgio9ApQ=; b=CS0LB0dzPpVndXpdzDrB75rSYh5lasJXAvwH8Av2QGU/vdVfUM2uVaefz33SuKz8Ua4z3P uPB69LmFGCLMFHGB015PISp3Dc3VwC6jXOqR2r/bkU/W7ug0s5L27gh2EU8d7stx2RXwIm DLCPiRbfbevO53XTww9pDcqNXXu+75RfmRDK857i3WoOKYfQSLf5svwE67e8760UO01usq vDhoz0Ho2Ka44c4DWoiLaENIOsKNUv3xCinfcJw5iKFA7b0Z/aDxQ7pdEMtFe4IXjMg1vF 53LGDezPkcI4wFEMxais1PbhzBAhmvNByvTuiXjB4PNkWTWambFvpexeFbZ+8Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642069795; a=rsa-sha256; cv=none; b=AYO8J88+8Z6e4NTvM06dQTOW2KMHWJ/VWZSLTVdXHbSeTi6YQEqHDVKmulYqm5bsdnlyiC 9mIlT0OcnZekWSaUwWpvlhb/4k6aRYEesgo9s/WEuIcTqbyYMEPae6o4gBS+B4ivKyyNk/ j1F2+4wxOHxhHigkUZKfupuTv4BO1LpceGJskVCHDKsL/eyRCHF/EsoWV1P9tX4ba5TqI3 thTH42UqKFEuOjdiccnWdY1Q18rk7/HEeISbQFbuHzF2+6E7S7ktWA7cucmyHakjyLZd02 /pNxfvw8oDKKk5T+qscrKCkWd012OCKMrxOIhI7kApAEUBojH1TV82aUzEexLQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 --- Comment #3 from Emmanuel Vadot --- Created attachment 230982 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D230982&action= =3Dedit panic when zpool list --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:30:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 95DF919599EC for ; Thu, 13 Jan 2022 10:30:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLL33Xl3z3M7t for ; Thu, 13 Jan 2022 10:30:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 540031ECBD for ; Thu, 13 Jan 2022 10:30:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DAUZRN097701 for ; Thu, 13 Jan 2022 10:30:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DAUZL7097700 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:30:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261142] Booting a CURRENT kernel on a FreeBSD 13.0 created zpool doesn't work Date: Thu, 13 Jan 2022 10:30:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642069835; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IN9W1Tuk76U7WBhLn+I2VlG4mAPsiWDR1f0E8qZmx1c=; b=orRty9GWdwKGUFz370Da33jYxGOb1Gv0Fzd4T7scqbIll9Mp3dvgrp4jvCmE4l6IUORbee lduNl9ejuVJ0ePOrH7uxl7jp8PLxvZjj1YtX1Crc5fTo+ta/tSY7aDgzMqvCOq0/Yk8Eko rqBTA0sNNML0jLBDqrtskcfkwHRjmj1i2TBsxkLKWSduZi9wV0uYmmKG6IGsqJBb6kIakt x7Nh/MzXV4UTjn+s/WX3cqf3fzdqDpSWm97w2zh6i28kMYaM1tr/lV/t9VGKagrOEpNuFE MULLsW6cGT3utgBujmtR/rQwVEd3tKiSlHmqWXYCmsYdoG3NQWxaX/mS0CKfOg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642069835; a=rsa-sha256; cv=none; b=V9Z9oAtvM3DL+uBWUOUkdw2vvOlRmL0tqRLjc1fGe7f8Ww53GSDsmgOLKT+FV8sHGRpULs 7yEa7qlOcujTQWFeITtQRjQmFBttQT6paRYOMnCgl2dOpbcjzMG71xKYgcfBYv667HUbeB cI31Yp9iXsg/F3ub/lvhrer8UD38ZdhMvgUsCL5enduxvjHf7OvyBlAtJIuD39LXFMIJe8 RwHHasdS5h5CwGFEhs3Xh4zB7GJIacex0bDbNOR70LbUfb8cPrTt129/sEVU1dfb1c9fiP BuPfmrzvhxo7i0cTwLLRzDSKKuWpVNjAg7JXBDfF2EhhhyrWvAPPhhVNdfqzag== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261142 Emmanuel Vadot changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Not A Bug Status|New |Closed --- Comment #6 from Emmanuel Vadot --- Opened a new bug #261171 I remembered that I had this problem some time ago so a new bug will be more clear. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 10:40:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1D69F195F706 for ; Thu, 13 Jan 2022 10:40:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZLY65ktKz3RGf for ; Thu, 13 Jan 2022 10:40:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A60FF1ECE7 for ; Thu, 13 Jan 2022 10:40:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DAeAbO003649 for ; Thu, 13 Jan 2022 10:40:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DAeArc003648 for fs@FreeBSD.org; Thu, 13 Jan 2022 10:40:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 10:40:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642070410; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aIScu7Y6FOCyY6Vy1R0cKGUfdDjbPrMfNMq3GMY1dZI=; b=CM+YY49nr2HXlosEpeTDQT5TlLpL/peEbbpjP9+xoE3XmEOL08CAP0CfWDaq4TCWb37LJ6 W9f4WWhNNH7YeRvPUu09ONIHA/TY3v+Jen6J12PArg+OA7S59eJLGnMO7Xx5nVXqlqzDRQ hc1gpEed7/wK7sqsaKUlHgTURS7pLl02BWIbvDK3MocF4bS8NyiMBmKJbnpvrA87tRFLj+ 0fo0cSc1aaiPZ0eVmPqRocW/bIbshhPWOHT2h8vWMTDRLeNn8nSGSK6pBsLQ3bYbLBLd0j ssHGwojNq/PjuL2xAJaRG6YRMg0KlxQ6wTUNL4qC9THwO7Ea0IxigzXkzbIUCg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642070410; a=rsa-sha256; cv=none; b=TYlnNDqK1VxLwQ1/72ktad1+1usXXxIXah8PkIpouSIZFs4co54oX6oC6kmkmb0AlFRWew zI2M1zgAUqVsiME1G3vp7WmjXO4iJOcTccdRYB5EjufBoOtzFHV+lTWxSo/L0vY5XKrDWT RwnjxqOUeyfC06Fjg7OImyw8JsLscNfDaoPV4mVHOtCdAPFbwbUb7XEAHQrkqLhZIvnYOw 9vZPFwiPn3zGsWmDomZHXZktBKyFdnwv13Mg+As7qo4QCxsRDjNun5IXOOxOYUg4CYnj5Z pHfDTHu8WvKb5/VDhR5xu0TDueOF2yRppbmNJLxhyJKBDT+klZcLOzUow1qpJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 --- Comment #4 from Emmanuel Vadot --- Uploaded the vmcore here : https://people.freebsd.org/~manu/zfs_crash.vmcor= e.0 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 21:00:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3355D194A7C8 for ; Thu, 13 Jan 2022 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZcK65HFfz3QmM for ; Thu, 13 Jan 2022 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 037432757B for ; Thu, 13 Jan 2022 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DL0fCT018224 for ; Thu, 13 Jan 2022 21:00:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DL0fp1018223 for fs@FreeBSD.org; Thu, 13 Jan 2022 21:00:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 21:00:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642107643; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DXQm3Y6+HV9fsyhoX3Lxg+N+5o/19KmbLnWXD5puTpM=; b=oP0AweYG9HILNs9ia6tU9tHpky8kBKS3tWu/KImuCeFrf7tdrvAbCbH1aHhrjHGLxul9D8 mK4U8RkPZhb4zbUXCQJZuD4PLPdyyEv/tbLiHVv8e61vqWWdjavoQABUKTeCOTvzuujSHH /JIkW3qjN9HdEuU1f7REV61HSQjpDUE4nWSTUMRbMKjmt2CWKR4r3X2c+TRzJIW4Htftde X9VkX+KKWypLF3RzjA9qj5GLAcDGcIlumqg1ZTr/FxFArE8olO3fHN2AQRpkrQQdsE3Cgz MFx92Y8h5J3wLLyEWqWZPc+JKVdpIYaKwOOR7nPsBcEjmtz8MCvf0XelwcNhTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642107643; a=rsa-sha256; cv=none; b=w40703uOvH6kcxauDYpvLW8EN+IWVGnY0lCqm9sj7EhzuTrxWq+onDLsJEK/mAyGsxTz1i GdYCa2z5CCZdizL+9lFJA8gYNbhLOqHQcSBYppApjMfCo8uO1o+xRX8PnCXYoVmt9Gk2Lt kiX/JwwgPenBx5ksP+CKr5gdIelHep537+/MCT2ZantmDZrAkKR4hY83e7MxUSQ5wEId8D OiF8LDHGzgjG2XL9V6R0gc+hRcOzvSokFo93QAECH4XMkBmEYqRu/Vn3jMWrkDWO4I4l0/ BsdJfP17wslo6AKTKlelFPOt4WAaJaZ/FHqyH+BxC+HEzUbIdCnarRBPKCtq7Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@gmail.com --- Comment #5 from Graham Perrin --- (In reply to Emmanuel Vadot from comment #1) geom part show da0 geom part show -l da0 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 13 21:04:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 20A36194B22A for ; Thu, 13 Jan 2022 21:04:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZcP71Pz3z3h2j for ; Thu, 13 Jan 2022 21:04:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 11B26270BA for ; Thu, 13 Jan 2022 21:04:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20DL4Brj023296 for ; Thu, 13 Jan 2022 21:04:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20DL4BR7023295 for fs@FreeBSD.org; Thu, 13 Jan 2022 21:04:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Thu, 13 Jan 2022 21:04:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642107851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gnFCOyMREV+9HyklmSmARF/r2V54+zd23Q90hJk8MPE=; b=QQrz1m0cny4013S9+P6RkqnUWxBvRzmWjXvP6GvoKhAd3i1rzBMF+SBiN7R1a3O+93From 1Oc0FlgIkJdHk3zWCKYvNKwLkgmKsByjAorFT3x3AKlMOXG5C751F0bFyaX0DXOo0cvvob Q/yu+qzEK+GRVymT27V+DbO9cEcDIHwON2wL1xIqCLlgdDknLEjMtaABkaDdrO5EGiiB2J b9+xucSCk9bokPX6LmSBmIXvrl5mJrpdexLj4xCXzfSzlbM2hMbUTm9mfvXyUbsmPB1Pxp AW2AnQJzZkde8AI2svNi6VjO1/OWkKINGUrV6aac3tOl/puFIzXlvJW9qT5XjA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642107851; a=rsa-sha256; cv=none; b=VtZIG84gH3Besy2bbeqajBxGk0v6QOavwcIxfYmh7LE2kjPDfYMFQ7SCClvWdEmzlEx28x RId2lP+7PvPOJCJapDk79jCZ2GLfLmCf+bM7n6LU90x2+Hp3eUh74uy83EK7aIFxn6EbqT BkfKCXdCZQKkrTfz3IqjS9w2XaZilJx6QeN2chuof8iG5p5THh7n5yV2Cm5c7v7tEhMIy2 SWbGnQ9oUXZlOYEhqcmYwjFOiNL1RkYxnP2ItFZNbZ0owLtREPRC2ag6oww2THSvogKdt9 stKYFNizltfkqIL9JR/W1XNY7iysKbXQp2r0L41ccIgzuP7rXoY2nvcQrtL8DQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #6 from Warner Losh --- So is this a 'ZFS's dependencies are weak and fragile so additions to SYSIN= IT causes problems?' or is this 'ZFS's dependencies are right, things just get called out of order for reasons unknown?' --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 14 10:56:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F3EA21967B2B for ; Fri, 14 Jan 2022 10:56:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JZys05nM6z4khK for ; Fri, 14 Jan 2022 10:56:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A1B8912997 for ; Fri, 14 Jan 2022 10:56:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20EAu4G7039872 for ; Fri, 14 Jan 2022 10:56:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20EAu4eE039871 for fs@FreeBSD.org; Fri, 14 Jan 2022 10:56:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261171] ZFS SYSINIT not called in correct order ? Date: Fri, 14 Jan 2022 10:56:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642157764; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5t81vJ0jTv1aY11xEaIJgmHNrppyJBmUeU8eSmbFkI8=; b=Auu5fANqWg2uamH/Q2rcYh4zZJqb+vZR0xkitNFHD0Xp6sMpsoPVgsZR5fBKFrRJh68aX0 PK0hNw1BuEZeVCAsiqvkYuP2QB1RTKkiQVgV2a2qZmvGqae9zHnYuGvr1MhsLAqVLTgbIQ dJRyNchAnr0js1wRkTFKjsTGrZ2NHec1Gv5RG5ZWtgwtdJWd1jj2S+RvOI8Miqw7CAqs0W EJR38HhbOLO8PTWBlG7qdSHFusH8RFy+WzW6t/MUOZpLP/pT30og1CIWtr6WBAe7AXyrKT glVAeUyCs+5PJIKVuT31NjPU0l+j6pLxBwYf9dJGmjXt6HcJTipVXc1J9CY0RQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642157764; a=rsa-sha256; cv=none; b=BPWb1mck8qmDaIgnY9QZLa3XTb461zPdjZgbfsDj0+9A1452tScPllpK6OW2k2eqV+ZEBW omN5noAza8FKITfkyvTBN0Hj2+PRRfX3ZaTRlNs1jQgK9S97aq7+GqD8ZAsxmdY6yWuYlT jSZ4mdJMSewbB/lUgV0Hs9xRFtPuq4xhf2vybr5Dcgf+x19IzgkM9O8ANf/DNcMn7OZhwK 8CMOtiGZtke4WlSLVDVRAKaGcBHywaZ7drn3YfPwrwYmp5EbbCLPKpk7PQ5NTdbO0v1bom HOTDRHC9dZSRfoDD9KGoz/WKnwfgCJqWcmKt7hW3CNmc/fGSk4G5PI9fxiQKcA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261171 --- Comment #7 from Emmanuel Vadot --- (In reply to Warner Losh from comment #6) I have no idea ... --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jan 16 21:00:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 22D9A1954CD8 for ; Sun, 16 Jan 2022 21:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JcSB30rlzz3pWl for ; Sun, 16 Jan 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 62AFC21684 for ; Sun, 16 Jan 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20GL0weU041543 for ; Sun, 16 Jan 2022 21:00:58 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20GL0wnU041542 for fs@FreeBSD.org; Sun, 16 Jan 2022 21:00:58 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202201162100.20GL0wnU041542@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 16 Jan 2022 21:00:58 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16423668581.02B5.39460" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642366859; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=fNaWkbOF+X3pGLbJKnkmPVPktr8YYbRvGlO1V9N/p1A=; b=EhAH1RiOIN9CT7qOeEgiG+hnOmkmSxEUEsLL/5keb4spTGbYKQ/xrucNKh0swEaDSsaBIM Qs2ZimleZ9klebz3KDMwrqhuxXm24GBduI+H6ype6PdQxoWXbya3wnjIOPX6VKtCXYL7+J iu9VnWvEdldexZxhw/8tDodIRsIlcmGgFrKa7cRcPNRhW+kGEElFJS+YEZ3qJGjKMh5Jhc BkMhO2f4mcFrRIDwd9Ao1u+T4XiIfZFQO0mGgWJjaueB2Qh0QoRwgIMZL/G6eic0POZhMO vc8kjohlZbIa/YUzB1PxtOjgmYsSXwnIFMY/7iRvEpGWeGR2J73UXlmY/bgT2Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642366859; a=rsa-sha256; cv=none; b=A4M4A/Gov5clqFnCAXcfmOz/LWjuIZJpaaGgDqg7yaIqZ3PdnrLQ9cAZHpK3SryXS1TIYQ 2cctusqwWlzSnbliKoHNFwy97xYkLTGruuZC9rkBUcp0sKpt8EkdFADczYUzBKHwPxPf0U p7rDu3ovbYysLKzrfLEgIk0jnio/Apf7OGRF3SZTxHpPayTVXrIMcK3I7C8u7oso35fFvY 0Ht1dRzssVcm/V1bEag9KD7FTy+Vm2H8FBUBsEKMWCTpU1VHW7JhMYIfJX9S6l0iriHQWD jVHX3LNCeUcvvVNehlibWseq2auxoaKskEAUr0hQQPEjSNzsQygnUpFFszXYSQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16423668581.02B5.39460 Date: Sun, 16 Jan 2022 21:00:58 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16423668581.02B5.39460 Date: Sun, 16 Jan 2022 21:00:58 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16423668581.02B5.39460-- From nobody Tue Jan 18 13:56:46 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A6134196DCF7 for ; Tue, 18 Jan 2022 13:56:58 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: from mail-yb1-xb2a.google.com (mail-yb1-xb2a.google.com [IPv6:2607:f8b0:4864:20::b2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdVgt0yB2z4SL6 for ; Tue, 18 Jan 2022 13:56:58 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: by mail-yb1-xb2a.google.com with SMTP id m6so55993050ybc.9 for ; Tue, 18 Jan 2022 05:56:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivoire.fr; s=google; h=mime-version:from:date:message-id:subject:to; bh=ygul6xIBR0tm0UDsGPzMfmmivvDzj4S0CU84ReNpE/I=; b=m34Sjlkvh53bJcdNOIr9vADH9rTCXid39m1Xf6wZdW1ylFJ0N7mlwqhNphRUPYM/q6 DUdy8Dc1tcYDF/CsmsSTgvb6NSN8+Nvu5b590/mxUTq4dZQX2oHt6rZk0HY0uZ7qUdkL 0m6IxJ4PPMCfUKnlEOfsuc2IsFQ1YsB1DRYbhHCowwx6GVkb8Eb4sigQTuGoNTTXKD65 AKMaY7TgkAMg0Rat1lIbNmQo2UEIUSsxNEzx7zYkN1LDSjPrrwiUwpOc6izllXmR5bYp larAAasAezm1hnkC4eNf7Q+cEaPjsZAwo+SYKx/5Hc/e3tsSJ0VKrYxikTu0Vo8FVgM5 xMew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=ygul6xIBR0tm0UDsGPzMfmmivvDzj4S0CU84ReNpE/I=; b=IoaZUYeSrG6p0OSedxo9/2qEj5lKT6OP6N4K6sHxogDCoHTiQEvaACKeflEY9hz5Vt IA45T/aoVnse92zEUu1WTo0VCqstT0EQOjVL1rfXSunUraqTybz+TqcM5/vEYkl1beAY o94O8l7IvAGz4fG2IdWv0ap5cynjSIQuxRpc6yqveZ/3cwLkN44HaCd1nPh0nJsQeiaX zk9dgHsD017SNFbWp5VHhtmQLcsB4dO/FBczmTa+p8NlUFBALXr0syG/04DeHxIRZo50 C8dBbjhNRQyWyWsR5LQxZ9RECxGoBBVYB8DCzrLyJG4hcD4oIbe793FHaUH3A9l8zYQz lhiQ== X-Gm-Message-State: AOAM532rpdE/ydT72yD32kazIwTgd0LQgLDLzkwt3KbT1BxmGzc4v8Xs T1nrQ6PhiiLWehpH0RYwWfqCsTXWpLyb2LimyEys2CFP/DLx7g== X-Google-Smtp-Source: ABdhPJz38wJhR1Z5jQzIHsb6xyuEEQG6CnUmOlXzKNteJ6xKrmqs4jFGzm8z/5NBw0UELL0rtxItsi8ktT5UzDNDwmw= X-Received: by 2002:a5b:b52:: with SMTP id b18mr5976556ybr.296.1642514217074; Tue, 18 Jan 2022 05:56:57 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Florent Rivoire Date: Tue, 18 Jan 2022 14:56:46 +0100 Message-ID: Subject: [zfs] recordsize: unexpected increase of disk usage when increasing it To: freebsd-fs@freebsd.org Content-Type: multipart/mixed; boundary="00000000000072d31d05d5dba4a4" X-Rspamd-Queue-Id: 4JdVgt0yB2z4SL6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rivoire.fr header.s=google header.b=m34Sjlkv; dmarc=none; spf=pass (mx1.freebsd.org: domain of florent@rivoire.fr designates 2607:f8b0:4864:20::b2a as permitted sender) smtp.mailfrom=florent@rivoire.fr X-Spamd-Result: default: False [-2.18 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[rivoire.fr:s=google]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.67)[-0.671]; DMARC_NA(0.00)[rivoire.fr]; DKIM_TRACE(0.00)[rivoire.fr:+]; NEURAL_HAM_SHORT(-0.01)[-0.010]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2a:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~,3:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --00000000000072d31d05d5dba4a4 Content-Type: text/plain; charset="UTF-8" TLDR: I rsync-ed the same data twice: once with 128K recordsize and once with 1M, and the allocated size on disk is ~3% bigger with 1M. Why not smaller ? Hello, I would like some help to understand how the disk usage evolves when I change the recordsize. I've read several articles/presentations/forums about recordsize in ZFS, and if I try to summarize, I mainly understood that: - recordsize is the "maximum" size of "objects" (so "logical blocks") that zfs will create for both -data & metadata, then each object is compressed and allocated to one vdev, splitted into smaller (ashift size) "physical" blocks and written on disks - increasing recordsize is usually good when storing large files that are not modified, because it limits the nb of metadata objects (block-pointers), which has a positive effect on performance - decreasing recordsize is useful for "databases-like" workloads (ie: small random writes inside existing objects), because it avoids write amplification (read-modify-write a large object for a small update) Today, I'm trying to observe the effect of increasing recordsize for *my* data (because I'm also considering defining special_small_blocks & using SSDs as "special", but not tested nor discussed here, just recordsize). So, I'm doing some benchmarks on my "documents" dataset (details in "notes" below), but the results are really strange to me. When I rsync the same data to a freshly-recreated zpool: A) with recordsize=128K : 226G allocated on disk B) with recordsize=1M : 232G allocated on disk => bigger than 128K ?!? I would clearly expect the other way around, because bigger recordsize generates less metadata so smaller disk usage, and there shouldn't be any overhead because 1M is just a maximum and not a forced size to allocate for every object. I don't mind the increased usage (I can live with a few GB more), but I would like to understand why it happens. I tried to give all the details of my tests below. Did I do something wrong ? Can you explain the increase ? Thanks ! =============================================== A) 128K ========== # zpool destroy bench # zpool create -o ashift=12 bench /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench [...] sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 bytes/sec total size is 240,982,439,038 speedup is 1.00 # zfs get recordsize bench NAME PROPERTY VALUE SOURCE bench recordsize 128K default # zpool list -v bench NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT bench 2.72T 226G 2.50T - - 0% 8% 1.00x ONLINE - gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T - - 0% 8.10% - ONLINE # zfs list bench NAME USED AVAIL REFER MOUNTPOINT bench 226G 2.41T 226G /bench # zfs get all bench |egrep "(used|referenced|written)" bench used 226G - bench referenced 226G - bench usedbysnapshots 0B - bench usedbydataset 226G - bench usedbychildren 1.80M - bench usedbyrefreservation 0B - bench written 226G - bench logicalused 226G - bench logicalreferenced 226G - # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb =============================================== B) 1M ========== # zpool destroy bench # zpool create -o ashift=12 bench /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 # zfs set recordsize=1M bench # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench [...] sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 bytes/sec total size is 240,982,439,038 speedup is 1.00 # zfs get recordsize bench NAME PROPERTY VALUE SOURCE bench recordsize 1M local # zpool list -v bench NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT bench 2.72T 232G 2.49T - - 0% 8% 1.00x ONLINE - gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T - - 0% 8.32% - ONLINE # zfs list bench NAME USED AVAIL REFER MOUNTPOINT bench 232G 2.41T 232G /bench # zfs get all bench |egrep "(used|referenced|written)" bench used 232G - bench referenced 232G - bench usedbysnapshots 0B - bench usedbydataset 232G - bench usedbychildren 1.96M - bench usedbyrefreservation 0B - bench written 232G - bench logicalused 232G - bench logicalreferenced 232G - # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb =============================================== Notes: ========== - the source dataset contains ~50% of pictures (raw files and jpg), and also some music, various archived documents, zip, videos - no change on the source dataset while testing (cf size logged by resync) - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and same results - probably not important here, but: /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset on another zpool that I never tweaked except ashit=12 (because using the same model of Red 3TB) # zfs --version zfs-2.0.6-1 zfs-kmod-v2021120100-zfs_a8c7652 # uname -a FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 75566f060d4(HEAD) TRUENAS amd64 --00000000000072d31d05d5dba4a4 Content-Type: application/octet-stream; name="zpool-bench-rcd1M.zdb" Content-Disposition: attachment; filename="zpool-bench-rcd1M.zdb" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: f_kyk6h5v80 ClRyYXZlcnNpbmcgYWxsIGJsb2NrcyAuLi4KCgoJYnAgY291bnQ6ICAgICAgICAgICAgICAgIDI1 NjAwOAoJZ2FuZ2VkIGNvdW50OiAgICAgICAgICAgICAgICAgMAoJYnAgbG9naWNhbDogICAgICAg IDI0OTMxNDg0MTYwMCAgICAgIGF2ZzogOTczODU1CglicCBwaHlzaWNhbDogICAgICAgMjQ4ODY1 Njc0MjQwICAgICAgYXZnOiA5NzIxMDEgICAgIGNvbXByZXNzaW9uOiAgIDEuMDAKCWJwIGFsbG9j YXRlZDogICAgICAyNDg5NDM5NTU5NjggICAgICBhdmc6IDk3MjQwNiAgICAgY29tcHJlc3Npb246 ICAgMS4wMAoJYnAgZGVkdXBlZDogICAgICAgICAgICAgICAgICAgMCAgICByZWY+MTogICAgICAw ICAgZGVkdXBsaWNhdGlvbjogICAxLjAwCglOb3JtYWwgY2xhc3M6ICAgICAgMjQ1NTEzMTM4MTc2 ICAgICB1c2VkOiAgOC4yMSUKCglhZGRpdGlvbmFsLCBub24tcG9pbnRlciBicHMgb2YgdHlwZSAw OiAgICAgICAgMTY5CgkgbnVtYmVyIG9mIChjb21wcmVzc2VkKSBieXRlczogIG51bWJlciBvZiBi cHMKCQkJIDI4OiAgICAgIDggKioqKioqKioKCQkJIDI5OiAgICAgIDMgKioqCgkJCSAzMDogICAg ICAwIAoJCQkgMzE6ICAgICAgMCAKCQkJIDMyOiAgICAgIDEgKgoJCQkgMzM6ICAgICAgMCAKCQkJ IDM0OiAgICAgIDAgCgkJCSAzNTogICAgICAwIAoJCQkgMzY6ICAgICAgMCAKCQkJIDM3OiAgICAg IDAgCgkJCSAzODogICAgICAwIAoJCQkgMzk6ICAgICAgMCAKCQkJIDQwOiAgICAgIDIgKioKCQkJ IDQxOiAgICAgIDIgKioKCQkJIDQyOiAgICAgIDAgCgkJCSA0MzogICAgICAwIAoJCQkgNDQ6ICAg ICAgMCAKCQkJIDQ1OiAgICAgIDEgKgoJCQkgNDY6ICAgICAgMCAKCQkJIDQ3OiAgICAgIDAgCgkJ CSA0ODogICAgICAxICoKCQkJIDQ5OiAgICAgIDEgKgoJCQkgNTA6ICAgICAgMSAqCgkJCSA1MTog ICAgICAwIAoJCQkgNTI6ICAgICAgMCAKCQkJIDUzOiAgICAgIDEgKgoJCQkgNTQ6ICAgICAgOCAq KioqKioqKgoJCQkgNTU6ICAgICAxMiAqKioqKioqKioqKioKCQkJIDU2OiAgICAgIDAgCgkJCSA1 NzogICAgICAyICoqCgkJCSA1ODogICAgICAwIAoJCQkgNTk6ICAgICAgMCAKCQkJIDYwOiAgICAg IDAgCgkJCSA2MTogICAgICAwIAoJCQkgNjI6ICAgICAgNCAqKioqCgkJCSA2MzogICAgICAwIAoJ CQkgNjQ6ICAgICAgNCAqKioqCgkJCSA2NTogICAgICAwIAoJCQkgNjY6ICAgICAgMyAqKioKCQkJ IDY3OiAgICAgIDIgKioKCQkJIDY4OiAgICAgIDAgCgkJCSA2OTogICAgICAxICoKCQkJIDcwOiAg ICAgIDAgCgkJCSA3MTogICAgICAwIAoJCQkgNzI6ICAgICAgMyAqKioKCQkJIDczOiAgICAgMzMg KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqCgkJCSA3NDogICAgICA3ICoqKioqKioK CQkJIDc1OiAgICAgIDIgKioKCQkJIDc2OiAgICAgIDUgKioqKioKCQkJIDc3OiAgICAgIDMgKioq CgkJCSA3ODogICAgICAxICoKCQkJIDc5OiAgICAgIDEgKgoJCQkgODA6ICAgICAgMiAqKgoJCQkg ODE6ICAgICAgMSAqCgkJCSA4MjogICAgICAzICoqKgoJCQkgODM6ICAgICAgMSAqCgkJCSA4NDog ICAgICAxICoKCQkJIDg1OiAgICAgIDAgCgkJCSA4NjogICAgICAzICoqKgoJCQkgODc6ICAgICAg MiAqKgoJCQkgODg6ICAgICAgMSAqCgkJCSA4OTogICAgICAzICoqKgoJCQkgOTA6ICAgICAgMiAq KgoJCQkgOTE6ICAgICAgMSAqCgkJCSA5MjogICAgICAyICoqCgkJCSA5MzogICAgICAwIAoJCQkg OTQ6ICAgICAgMSAqCgkJCSA5NTogICAgICAyICoqCgkJCSA5NjogICAgICAxICoKCQkJIDk3OiAg ICAgIDAgCgkJCSA5ODogICAgICA3ICoqKioqKioKCQkJIDk5OiAgICAgIDMgKioqCgkJCTEwMDog ICAgICAxICoKCQkJMTAxOiAgICAgIDEgKgoJCQkxMDI6ICAgICAgMiAqKgoJCQkxMDM6ICAgICAg MSAqCgkJCTEwNDogICAgICAyICoqCgkJCTEwNTogICAgICAxICoKCQkJMTA2OiAgICAgIDQgKioq KgoJCQkxMDc6ICAgICAgMiAqKgoJCQkxMDg6ICAgICAgMiAqKgoJCQkxMDk6ICAgICAgMCAKCQkJ MTEwOiAgICAgIDIgKioKCQkJMTExOiAgICAgIDIgKioKCQkJMTEyOiAgICAgIDEgKgoJRGl0dG9l ZCBibG9ja3Mgb24gc2FtZSB2ZGV2OiAxNjMzMAoKQmxvY2tzCUxTSVpFCVBTSVpFCUFTSVpFCSAg YXZnCSBjb21wCSVUb3RhbAlUeXBlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg LQkgICAgIC0JdW5hbGxvY2F0ZWQKICAgICAyCSAgMzJLCSAgIDhLCSAgMjRLCSAgMTJLCSA0LjAw CSAgMC4wMAlvYmplY3QgZGlyZWN0b3J5CiAgICAgMQkgIDUxMgkgIDUxMgkgIDEySwkgIDEySwkg MS4wMAkgIDAuMDAJb2JqZWN0IGFycmF5CiAgICAgMQkgIDE2SwkgICA0SwkgIDEySwkgIDEySwkg NC4wMAkgIDAuMDAJcGFja2VkIG52bGlzdAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgICAtCXBhY2tlZCBudmxpc3Qgc2l6ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgIC0JICAgICAtCWJwb2JqCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgLQkgICAgIC0JYnBvYmogaGVhZGVyCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgLQkgICAgIC0JU1BBIHNwYWNlIG1hcCBoZWFkZXIKICAgMTA4CTEzLjVNCSA0NzZLCTEuMzlN CTEzLjJLCTI5LjA0CSAgMC4wMAlTUEEgc3BhY2UgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAg LQkgICAgLQkgICAgLQkgICAgIC0JWklMIGludGVudCBsb2cKICAgICAxCSAxMjhLCSAgIDRLCSAg IDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDUgRE1VIGRub2RlCiAgICAgMQkgMTI4SwkgICA0 SwkgICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEw0IERNVSBkbm9kZQogICAgIDEJIDEyOEsJ ICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMMyBETVUgZG5vZGUKICAgICAxCSAx MjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDIgRE1VIGRub2RlCiAgICAg MgkgMjU2SwkgIDM2SwkgIDc2SwkgIDM4SwkgNy4xMQkgIDAuMDAJICAgIEwxIERNVSBkbm9kZQog ICA2MjgJOS44MU0JMi40N00JNS4wN00JOC4yN0sJIDMuOTcJICAwLjAwCSAgICBMMCBETVUgZG5v ZGUKICAgNjM0CTEwLjZNCTIuNTJNCTUuMThNCTguMzZLCSA0LjE5CSAgMC4wMAlETVUgZG5vZGUK ICAgICAyCSAgIDhLCSAgIDhLCSAgMjBLCSAgMTBLCSAxLjAwCSAgMC4wMAlETVUgb2Jqc2V0CiAg ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRpcmVjdG9yeQog ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXJlY3Rvcnkg Y2hpbGQgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNM IGRhdGFzZXQgc25hcCBtYXAKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg ICAgLQlEU0wgcHJvcHMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg LQlEU0wgZGF0YXNldAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt CVpGUyB6bm9kZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpG UyBWMCBBQ0wKICAgIDYzCTEuOTdNCSAyNTJLCSA1MDRLCSAgIDhLCSA4LjAwCSAgMC4wMAkgICAg TDIgWkZTIHBsYWluIGZpbGUKIDE0LjNLCSA0NThNCTU5LjZNCSAxMTlNCTguMzJLCSA3LjY5CSAg MC4wNQkgICAgTDEgWkZTIHBsYWluIGZpbGUKICAyMzRLCSAyMzJHCSAyMzJHCSAyMzJHCTEwMTRL CSAxLjAwCSA5OS45NAkgICAgTDAgWkZTIHBsYWluIGZpbGUKICAyNDhLCSAyMzJHCSAyMzJHCSAy MzJHCSA5NTZLCSAxLjAwCSA5OS45OQlaRlMgcGxhaW4gZmlsZQogICAxMjcJMy45N00JIDUwOEsJ MTAxNksJICAgOEsJIDguMDAJICAwLjAwCSAgICBMMSBaRlMgZGlyZWN0b3J5CiAgIDg2NAk1LjIx TQkyLjAzTQk1LjkyTQk3LjAySwkgMi41NwkgIDAuMDAJICAgIEwwIFpGUyBkaXJlY3RvcnkKICAg OTkxCTkuMThNCTIuNTJNCTYuOTFNCTcuMTRLCSAzLjY0CSAgMC4wMAlaRlMgZGlyZWN0b3J5CiAg ICAgMQkgICAxSwkgICAxSwkgICA4SwkgICA4SwkgMS4wMAkgIDAuMDAJWkZTIG1hc3RlciBub2Rl CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JWkZTIGRlbGV0ZSBx dWV1ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXp2b2wgb2Jq ZWN0CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JenZvbCBwcm9w CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jb3RoZXIgdWludDhb XQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIHVpbnQ2 NFtdCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jb3RoZXIgWkFQ CiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JcGVyc2lzdGVudCBl cnJvciBsb2cKICAgICAxCSAxMjhLCSAgIDRLCSAgMTJLCSAgMTJLCTMyLjAwCSAgMC4wMAlTUEEg aGlzdG9yeQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVNQQSBo aXN0b3J5IG9mZnNldHMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg LQlQb29sIHByb3BlcnRpZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg ICAgLQlEU0wgcGVybWlzc2lvbnMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt CSAgICAgLQlaRlMgQUNMCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg IC0JWkZTIFNZU0FDTAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt CUZVSUQgdGFibGUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlG VUlEIHRhYmxlIHNpemUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg LQlEU0wgZGF0YXNldCBuZXh0IGNsb25lcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgICAtCXNjYW4gd29yayBxdWV1ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg IC0JICAgIC0JICAgICAtCVpGUyB1c2VyL2dyb3VwL3Byb2plY3QgdXNlZAogICAgIC0JICAgIC0J ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpGUyB1c2VyL2dyb3VwL3Byb2plY3QgcXVv dGEKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlzbmFwc2hvdCBy ZWZjb3VudCB0YWdzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0J RERUIFpBUCBhbGdvcml0aG0KICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg ICAgLQlERFQgc3RhdGlzdGljcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgICAtCVN5c3RlbSBhdHRyaWJ1dGVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgLQkgICAgIC0JU0EgbWFzdGVyIG5vZGUKICAgICAxCTEuNTBLCTEuNTBLCSAgIDhLCSAgIDhL CSAxLjAwCSAgMC4wMAlTQSBhdHRyIHJlZ2lzdHJhdGlvbgogICAgIDIJICAzMksJICAgOEsJICAx NksJICAgOEsJIDQuMDAJICAwLjAwCVNBIGF0dHIgbGF5b3V0cwogICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgIC0JICAgIC0JICAgICAtCXNjYW4gdHJhbnNsYXRpb25zCiAgICAgLQkgICAgLQkg ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVkdXBsaWNhdGVkIGJsb2NrCiAgICAgLQkg ICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRlYWRsaXN0IG1hcAogICAg IC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkZWFkbGlzdCBtYXAg aGRyCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JRFNMIGRpciBj bG9uZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlicG9iaiBz dWJvYmoKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlkZWZlcnJl ZCBmcmVlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVkdXAg ZGl0dG8KICAgIDExCSAxNzBLCSAgMjVLCSAxMDhLCTkuODJLCSA2LjgyCSAgMC4wMAlvdGhlcgog ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNSBUb3RhbAog ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNCBUb3RhbAog ICAgIDEJIDEyOEsJICAgNEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMMyBUb3RhbAog ICAgNjQJMi4wOU0JIDI1NksJIDUxMksJICAgOEsJIDguMzgJICAwLjAwCSAgICBMMiBUb3RhbAog MTQuNEsJIDQ2Mk0JNjAuMU0JIDEyME0JOC4zMksJIDcuNjkJICAwLjA1CSAgICBMMSBUb3RhbAog IDIzNksJIDIzMkcJIDIzMkcJIDIzMkcJMTAwOEsJIDEuMDAJIDk5Ljk1CSAgICBMMCBUb3RhbAog IDI1MEsJIDIzMkcJIDIzMkcJIDIzMkcJIDk1MEsJIDEuMDAJMTAwLjAwCVRvdGFsCgpCbG9jayBT aXplIEhpc3RvZ3JhbQoKICBibG9jayAgIHBzaXplICAgICAgICAgICAgICAgIGxzaXplICAgICAg ICAgICAgICAgIGFzaXplCiAgIHNpemUgICBDb3VudCAgIFNpemUgICBDdW0uICBDb3VudCAgIFNp emUgICBDdW0uICBDb3VudCAgIFNpemUgICBDdW0uCiAgICA1MTI6ICAgIDEzOSAgNjkuNUsgIDY5 LjVLICAgIDEzOSAgNjkuNUsgIDY5LjVLICAgICAgMCAgICAgIDAgICAgICAwCiAgICAgMUs6ICAg IDI1MSAgIDMwMUsgICAzNzBLICAgIDI1MSAgIDMwMUsgICAzNzBLICAgICAgMCAgICAgIDAgICAg ICAwCiAgICAgMks6ICAgIDE2NCAgIDQzMksgICA4MDJLICAgIDE2NCAgIDQzMksgICA4MDJLICAg ICAgMCAgICAgIDAgICAgICAwCiAgICAgNEs6ICAxNS4zSyAgNjEuM00gIDYyLjFNICAgIDE1MiAg IDg2MksgIDEuNjJNICAgIDE4MyAgIDczMksgICA3MzJLCiAgICAgOEs6ICAgIDQ1OCAgNC44Mk0g IDY2LjlNICAgIDEwOSAgMS4xNE0gIDIuNzdNICAxNS43SyAgIDEyNk0gICAxMjdNCiAgICAxNks6 ICAgICA2NCAgMS40MU0gIDY4LjRNICAgIDk1NSAgMTUuM00gIDE4LjFNICAgIDQ0OSAgOS4zOE0g ICAxMzdNCiAgICAzMks6ICAgICA5MSAgNC4xN00gIDcyLjVNICAxNC42SyAgIDQ2OE0gICA0ODZN ICAgIDEwMCAgNC40OE0gICAxNDFNCiAgICA2NEs6ICAgIDI0OCAgMjUuMU0gIDk3LjZNICAgIDI0 OCAgMjUuMU0gICA1MTFNICAgIDIzNSAgMjMuNU0gICAxNjVNCiAgIDEyOEs6ICAgIDU4MCAgIDEw N00gICAyMDVNICAgIDY5NiAgIDEyMk0gICA2MzNNICAgIDU4MyAgIDEwN00gICAyNzFNCiAgIDI1 Nks6ICAxLjA0SyAgIDM4Mk0gICA1ODdNICAxLjA0SyAgIDM4Mk0gIDEwMTVNICAxLjA0SyAgIDM4 MU0gICA2NTNNCiAgIDUxMks6ICAxLjQySyAgMS4wNUcgIDEuNjJHICAxLjQySyAgMS4wNUcgIDIu MDRHICAxLjQzSyAgMS4wNkcgIDEuNjlHCiAgICAgMU06ICAgMjMwSyAgIDIzMEcgICAyMzJHICAg MjMwSyAgIDIzMEcgICAyMzJHICAgMjMwSyAgIDIzMEcgICAyMzJHCiAgICAgMk06ICAgICAgMCAg ICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCiAg ICAgNE06ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAg ICAgIDAgICAyMzJHCiAgICAgOE06ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAg ICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCiAgICAxNk06ICAgICAgMCAgICAgIDAgICAyMzJH ICAgICAgMCAgICAgIDAgICAyMzJHICAgICAgMCAgICAgIDAgICAyMzJHCgogICAgICAgICAgICAg ICAgICAgICAgICAgICAgY2FwYWNpdHkgICBvcGVyYXRpb25zICAgYmFuZHdpZHRoICAtLS0tIGVy cm9ycyAtLS0tCmRlc2NyaXB0aW9uICAgICAgICAgICAgICAgIHVzZWQgYXZhaWwgIHJlYWQgd3Jp dGUgIHJlYWQgd3JpdGUgIHJlYWQgd3JpdGUgY2tzdW0KYmVuY2ggICAgICAgICAgICAgICAgICAg ICAgMjI5RyAyLjUwVCAgIDI1MSAgICAgMCAxMS43TSAgICAgMCAgICAgMCAgICAgMCAgICAgMAog IC9kZXYvZ3B0aWQvM2MwZjVjYmMtYjBjZS0xMWVhLWFiOTEtYzhjYmI4Y2MzYWQ0ICAgICAgICAg ICAgICAgICAgICAgICAgICAyMjlHIDIuNTBUICAgMjUxICAgICAwIDExLjdNICAgICAwICAgICAw ICAgICAwICAgICAwCg== --00000000000072d31d05d5dba4a4 Content-Type: application/octet-stream; name="zpool-bench-rcd128K.zdb" Content-Disposition: attachment; filename="zpool-bench-rcd128K.zdb" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: f_kyk6h5vu1 ClRyYXZlcnNpbmcgYWxsIGJsb2NrcyAuLi4KCgoJYnAgY291bnQ6ICAgICAgICAgICAgICAgMTg2 OTk2NQoJZ2FuZ2VkIGNvdW50OiAgICAgICAgICAgICAgICAgMAoJYnAgbG9naWNhbDogICAgICAg IDI0Mjg0NDI3MjY0MCAgICAgIGF2ZzogMTI5ODY1CglicCBwaHlzaWNhbDogICAgICAgMjQyMjgw MzU1MzI4ICAgICAgYXZnOiAxMjk1NjQgICAgIGNvbXByZXNzaW9uOiAgIDEuMDAKCWJwIGFsbG9j YXRlZDogICAgICAyNDI0MjAwMjMyOTYgICAgICBhdmc6IDEyOTYzOCAgICAgY29tcHJlc3Npb246 ICAgMS4wMAoJYnAgZGVkdXBlZDogICAgICAgICAgICAgICAgICAgMCAgICByZWY+MTogICAgICAw ICAgZGVkdXBsaWNhdGlvbjogICAxLjAwCglOb3JtYWwgY2xhc3M6ICAgICAgMjM1NDYzMTcyMDk2 ICAgICB1c2VkOiAgNy44OCUKCglhZGRpdGlvbmFsLCBub24tcG9pbnRlciBicHMgb2YgdHlwZSAw OiAgICAgICAgMTcwCgkgbnVtYmVyIG9mIChjb21wcmVzc2VkKSBieXRlczogIG51bWJlciBvZiBi cHMKCQkJIDI4OiAgICAgMTAgKioqKioqKioqKgoJCQkgMjk6ICAgICAgMiAqKgoJCQkgMzA6ICAg ICAgMCAKCQkJIDMxOiAgICAgIDAgCgkJCSAzMjogICAgICAxICoKCQkJIDMzOiAgICAgIDAgCgkJ CSAzNDogICAgICAwIAoJCQkgMzU6ICAgICAgMCAKCQkJIDM2OiAgICAgIDAgCgkJCSAzNzogICAg ICAwIAoJCQkgMzg6ICAgICAgMCAKCQkJIDM5OiAgICAgIDAgCgkJCSA0MDogICAgICAzICoqKgoJ CQkgNDE6ICAgICAgMSAqCgkJCSA0MjogICAgICAwIAoJCQkgNDM6ICAgICAgMCAKCQkJIDQ0OiAg ICAgIDAgCgkJCSA0NTogICAgICAxICoKCQkJIDQ2OiAgICAgIDAgCgkJCSA0NzogICAgICAwIAoJ CQkgNDg6ICAgICAgMSAqCgkJCSA0OTogICAgICAwIAoJCQkgNTA6ICAgICAgMSAqCgkJCSA1MTog ICAgICAwIAoJCQkgNTI6ICAgICAgMCAKCQkJIDUzOiAgICAgIDAgCgkJCSA1NDogICAgIDE4ICoq KioqKioqKioqKioqKioqKgoJCQkgNTU6ICAgICAgMyAqKioKCQkJIDU2OiAgICAgIDAgCgkJCSA1 NzogICAgICAyICoqCgkJCSA1ODogICAgICAwIAoJCQkgNTk6ICAgICAgMCAKCQkJIDYwOiAgICAg IDAgCgkJCSA2MTogICAgICAxICoKCQkJIDYyOiAgICAgIDMgKioqCgkJCSA2MzogICAgICAwIAoJ CQkgNjQ6ICAgICAgMyAqKioKCQkJIDY1OiAgICAgIDIgKioKCQkJIDY2OiAgICAgIDEgKgoJCQkg Njc6ICAgICAgMyAqKioKCQkJIDY4OiAgICAgIDAgCgkJCSA2OTogICAgICAxICoKCQkJIDcwOiAg ICAgIDAgCgkJCSA3MTogICAgICAwIAoJCQkgNzI6ICAgICAgMSAqCgkJCSA3MzogICAgIDM1ICoq KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqCgkJCSA3NDogICAgICA4ICoqKioqKioq CgkJCSA3NTogICAgICA0ICoqKioKCQkJIDc2OiAgICAgIDIgKioKCQkJIDc3OiAgICAgIDIgKioK CQkJIDc4OiAgICAgIDMgKioqCgkJCSA3OTogICAgICAxICoKCQkJIDgwOiAgICAgIDMgKioqCgkJ CSA4MTogICAgICAwIAoJCQkgODI6ICAgICAgMiAqKgoJCQkgODM6ICAgICAgMSAqCgkJCSA4NDog ICAgICAwIAoJCQkgODU6ICAgICAgMiAqKgoJCQkgODY6ICAgICAgMiAqKgoJCQkgODc6ICAgICAg NCAqKioqCgkJCSA4ODogICAgICAxICoKCQkJIDg5OiAgICAgIDAgCgkJCSA5MDogICAgICAxICoK CQkJIDkxOiAgICAgIDIgKioKCQkJIDkyOiAgICAgIDIgKioKCQkJIDkzOiAgICAgIDEgKgoJCQkg OTQ6ICAgICAgMSAqCgkJCSA5NTogICAgICAzICoqKgoJCQkgOTY6ICAgICAgMSAqCgkJCSA5Nzog ICAgICAxICoKCQkJIDk4OiAgICAgIDggKioqKioqKioKCQkJIDk5OiAgICAgIDEgKgoJCQkxMDA6 ICAgICAgMiAqKgoJCQkxMDE6ICAgICAgMSAqCgkJCTEwMjogICAgICAxICoKCQkJMTAzOiAgICAg IDIgKioKCQkJMTA0OiAgICAgIDAgCgkJCTEwNTogICAgICAyICoqCgkJCTEwNjogICAgICAyICoq CgkJCTEwNzogICAgICA1ICoqKioqCgkJCTEwODogICAgICAzICoqKgoJCQkxMDk6ICAgICAgMCAK CQkJMTEwOiAgICAgIDEgKgoJCQkxMTE6ICAgICAgMSAqCgkJCTExMjogICAgICAxICoKCURpdHRv ZWQgYmxvY2tzIG9uIHNhbWUgdmRldjogMjE4OTEKCkJsb2NrcwlMU0laRQlQU0laRQlBU0laRQkg IGF2ZwkgY29tcAklVG90YWwJVHlwZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg IC0JICAgICAtCXVuYWxsb2NhdGVkCiAgICAgMgkgIDMySwkgICA4SwkgIDI0SwkgIDEySwkgNC4w MAkgIDAuMDAJb2JqZWN0IGRpcmVjdG9yeQogICAgIDEJICA1MTIJICA1MTIJICAxMksJICAxMksJ IDEuMDAJICAwLjAwCW9iamVjdCBhcnJheQogICAgIDEJICAxNksJICAgNEsJICAxMksJICAxMksJ IDQuMDAJICAwLjAwCXBhY2tlZCBudmxpc3QKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt CSAgICAtCSAgICAgLQlwYWNrZWQgbnZsaXN0IHNpemUKICAgICAtCSAgICAtCSAgICAtCSAgICAt CSAgICAtCSAgICAtCSAgICAgLQlicG9iagogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgICAtCWJwb2JqIGhlYWRlcgogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgICAtCVNQQSBzcGFjZSBtYXAgaGVhZGVyCiAgIDEwMgkxMi44TQkgNDUySwkxLjMy TQkxMy4zSwkyOC44OAkgIDAuMDAJU1BBIHNwYWNlIG1hcAogICAgIC0JICAgIC0JICAgIC0JICAg IC0JICAgIC0JICAgIC0JICAgICAtCVpJTCBpbnRlbnQgbG9nCiAgICAgMQkgMTI4SwkgICA0Swkg ICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEw1IERNVSBkbm9kZQogICAgIDEJIDEyOEsJICAg NEsJICAgOEsJICAgOEsJMzIuMDAJICAwLjAwCSAgICBMNCBETVUgZG5vZGUKICAgICAxCSAxMjhL CSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDMgRE1VIGRub2RlCiAgICAgMQkg MTI4SwkgICA0SwkgICA4SwkgICA4SwkzMi4wMAkgIDAuMDAJICAgIEwyIERNVSBkbm9kZQogICAg IDIJIDI1NksJICAzNksJICA3NksJICAzOEsJIDcuMTEJICAwLjAwCSAgICBMMSBETVUgZG5vZGUK ICAgNjIxCTkuNzBNCTIuNDVNCTQuOTlNCTguMjNLCSAzLjk3CSAgMC4wMAkgICAgTDAgRE1VIGRu b2RlCiAgIDYyNwkxMC41TQkyLjUwTQk1LjEwTQk4LjMzSwkgNC4xOQkgIDAuMDAJRE1VIGRub2Rl CiAgICAgMgkgICA4SwkgICA4SwkgIDIwSwkgIDEwSwkgMS4wMAkgIDAuMDAJRE1VIG9ianNldAog ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXJlY3RvcnkK ICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlEU0wgZGlyZWN0b3J5 IGNoaWxkIG1hcAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURT TCBkYXRhc2V0IHNuYXAgbWFwCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgIC0JRFNMIHByb3BzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg IC0JRFNMIGRhdGFzZXQKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg LQlaRlMgem5vZGUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQla RlMgVjAgQUNMCiAgIDI2Ngk4LjMxTQkxLjA2TQkyLjEyTQk4LjE4SwkgNy44MgkgIDAuMDAJICAg IEwyIFpGUyBwbGFpbiBmaWxlCiAxOS42SwkgNjI2TQkgMTIzTQkgMjQ1TQkxMi41SwkgNS4xMAkg IDAuMTEJICAgIEwxIFpGUyBwbGFpbiBmaWxlCiAxLjc2TQkgMjI2RwkgMjI2RwkgMjI2RwkgMTI4 SwkgMS4wMAkgOTkuODkJICAgIEwwIFpGUyBwbGFpbiBmaWxlCiAxLjc4TQkgMjI2RwkgMjI2Rwkg MjI2RwkgMTI3SwkgMS4wMAkgOTkuOTkJWkZTIHBsYWluIGZpbGUKICAgMTI3CTMuOTdNCSA1MDhL CTEwMTZLCSAgIDhLCSA4LjAwCSAgMC4wMAkgICAgTDEgWkZTIGRpcmVjdG9yeQogICA4NjQJNS4y MU0JMi4wMk0JNS45MU0JNy4wMUsJIDIuNTgJICAwLjAwCSAgICBMMCBaRlMgZGlyZWN0b3J5CiAg IDk5MQk5LjE4TQkyLjUyTQk2LjkxTQk3LjE0SwkgMy42NAkgIDAuMDAJWkZTIGRpcmVjdG9yeQog ICAgIDEJICAgMUsJICAgMUsJICAgOEsJICAgOEsJIDEuMDAJICAwLjAwCVpGUyBtYXN0ZXIgbm9k ZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCVpGUyBkZWxldGUg cXVldWUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQl6dm9sIG9i amVjdAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXp2b2wgcHJv cAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIHVpbnQ4 W10KICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlvdGhlciB1aW50 NjRbXQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCW90aGVyIFpB UAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCXBlcnNpc3RlbnQg ZXJyb3IgbG9nCiAgICAgMQkgMTI4SwkgICA0SwkgIDEySwkgIDEySwkzMi4wMAkgIDAuMDAJU1BB IGhpc3RvcnkKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlTUEEg aGlzdG9yeSBvZmZzZXRzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg IC0JUG9vbCBwcm9wZXJ0aWVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgIC0JRFNMIHBlcm1pc3Npb25zCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg LQkgICAgIC0JWkZTIEFDTAogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAg ICAtCVpGUyBTWVNBQ0wKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAg LQlGVUlEIHRhYmxlCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0J RlVJRCB0YWJsZSBzaXplCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAg IC0JRFNMIGRhdGFzZXQgbmV4dCBjbG9uZXMKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt CSAgICAtCSAgICAgLQlzY2FuIHdvcmsgcXVldWUKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAg ICAtCSAgICAtCSAgICAgLQlaRlMgdXNlci9ncm91cC9wcm9qZWN0IHVzZWQKICAgICAtCSAgICAt CSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlaRlMgdXNlci9ncm91cC9wcm9qZWN0IHF1 b3RhCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0Jc25hcHNob3Qg cmVmY291bnQgdGFncwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAt CUREVCBaQVAgYWxnb3JpdGhtCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkg ICAgIC0JRERUIHN0YXRpc3RpY3MKICAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAt CSAgICAgLQlTeXN0ZW0gYXR0cmlidXRlcwogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0J ICAgIC0JICAgICAtCVNBIG1hc3RlciBub2RlCiAgICAgMQkxLjUwSwkxLjUwSwkgICA4SwkgICA4 SwkgMS4wMAkgIDAuMDAJU0EgYXR0ciByZWdpc3RyYXRpb24KICAgICAyCSAgMzJLCSAgIDhLCSAg MTZLCSAgIDhLCSA0LjAwCSAgMC4wMAlTQSBhdHRyIGxheW91dHMKICAgICAtCSAgICAtCSAgICAt CSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlzY2FuIHRyYW5zbGF0aW9ucwogICAgIC0JICAgIC0J ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCWRlZHVwbGljYXRlZCBibG9jawogICAgIC0J ICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkZWFkbGlzdCBtYXAKICAg ICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAtCSAgICAgLQlEU0wgZGVhZGxpc3QgbWFw IGhkcgogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCURTTCBkaXIg Y2xvbmVzCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JYnBvYmog c3Vib2JqCiAgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgLQkgICAgIC0JZGVmZXJy ZWQgZnJlZQogICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgIC0JICAgICAtCWRlZHVw IGRpdHRvCiAgICAxMQkgMTcwSwkyNC41SwkgIDk2Swk4LjczSwkgNi45NgkgIDAuMDAJb3RoZXIK ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDUgVG90YWwK ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDQgVG90YWwK ICAgICAxCSAxMjhLCSAgIDRLCSAgIDhLCSAgIDhLCTMyLjAwCSAgMC4wMAkgICAgTDMgVG90YWwK ICAgMjY3CTguNDRNCTEuMDdNCTIuMTNNCTguMThLCSA3LjkxCSAgMC4wMAkgICAgTDIgVG90YWwK IDE5LjdLCSA2MzBNCSAxMjNNCSAyNDdNCTEyLjVLCSA1LjExCSAgMC4xMQkgICAgTDEgVG90YWwK IDEuNzZNCSAyMjZHCSAyMjZHCSAyMjZHCSAxMjhLCSAxLjAwCSA5OS44OQkgICAgTDAgVG90YWwK IDEuNzhNCSAyMjZHCSAyMjZHCSAyMjZHCSAxMjdLCSAxLjAwCTEwMC4wMAlUb3RhbAoKQmxvY2sg U2l6ZSBIaXN0b2dyYW0KCiAgYmxvY2sgICBwc2l6ZSAgICAgICAgICAgICAgICBsc2l6ZSAgICAg ICAgICAgICAgICBhc2l6ZQogICBzaXplICAgQ291bnQgICBTaXplICAgQ3VtLiAgQ291bnQgICBT aXplICAgQ3VtLiAgQ291bnQgICBTaXplICAgQ3VtLgogICAgNTEyOiAgICAxMzggICAgNjlLICAg IDY5SyAgICAxMzggICAgNjlLICAgIDY5SyAgICAgIDAgICAgICAwICAgICAgMAogICAgIDFLOiAg ICAyNTEgICAzMDFLICAgMzcwSyAgICAyNTEgICAzMDFLICAgMzcwSyAgICAgIDAgICAgICAwICAg ICAgMAogICAgIDJLOiAgICAxNjQgICA0MzJLICAgODAySyAgICAxNjQgICA0MzJLICAgODAySyAg ICAgIDAgICAgICAwICAgICAgMAogICAgIDRLOiAgMTQuMEsgIDU2LjFNICA1Ni44TSAgICAxNTIg ICA4NjJLICAxLjYyTSAgICAxODMgICA3MzJLICAgNzMySwogICAgIDhLOiAgNy4yMEsgIDc0LjBN ICAgMTMxTSAgICAxMDkgIDEuMTRNICAyLjc3TSAgMTQuNEsgICAxMTZNICAgMTE3TQogICAgMTZL OiAgICAgNjMgIDEuNDBNICAgMTMyTSAgICA5NDggIDE1LjJNICAxOC4wTSAgNy4xOUsgICAxNDhN ICAgMjY0TQogICAgMzJLOiAgICAgOTEgIDQuMTdNICAgMTM2TSAgMjAuMEsgICA2NDJNICAgNjYw TSAgICAxMDAgIDQuNDZNICAgMjY5TQogICAgNjRLOiAgICAyNDggIDI1LjFNICAgMTYyTSAgICAy NDggIDI1LjFNICAgNjg2TSAgICAyMzUgIDIzLjVNICAgMjkyTQogICAxMjhLOiAgMS43Nk0gICAy MjVHICAgMjI2RyAgMS43Nk0gICAyMjVHICAgMjI2RyAgMS43Nk0gICAyMjVHICAgMjI2RwogICAy NTZLOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAg ICAwICAgMjI2RwogICA1MTJLOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAg MjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgIDFNOiAgICAgIDAgICAgICAwICAgMjI2RyAg ICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgIDJNOiAgICAgIDAg ICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2Rwog ICAgIDRNOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAg ICAgICAwICAgMjI2RwogICAgIDhNOiAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAw ICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwogICAgMTZNOiAgICAgIDAgICAgICAwICAgMjI2 RyAgICAgIDAgICAgICAwICAgMjI2RyAgICAgIDAgICAgICAwICAgMjI2RwoKICAgICAgICAgICAg ICAgICAgICAgICAgICAgIGNhcGFjaXR5ICAgb3BlcmF0aW9ucyAgIGJhbmR3aWR0aCAgLS0tLSBl cnJvcnMgLS0tLQpkZXNjcmlwdGlvbiAgICAgICAgICAgICAgICB1c2VkIGF2YWlsICByZWFkIHdy aXRlICByZWFkIHdyaXRlICByZWFkIHdyaXRlIGNrc3VtCmJlbmNoICAgICAgICAgICAgICAgICAg ICAgIDIxOUcgMi41MFQgICAzMzAgICAgIDAgOC45MU0gICAgIDAgICAgIDAgICAgIDAgICAgIDAK ICAvZGV2L2dwdGlkLzNjMGY1Y2JjLWIwY2UtMTFlYS1hYjkxLWM4Y2JiOGNjM2FkNCAgICAgICAg ICAgICAgICAgICAgICAgICAgMjE5RyAyLjUwVCAgIDMzMCAgICAgMCA4LjkxTSAgICAgMCAgICAg MCAgICAgMCAgICAgMAo= --00000000000072d31d05d5dba4a4-- From nobody Tue Jan 18 14:12:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1FB691977164 for ; Tue, 18 Jan 2022 14:13:01 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x92a.google.com (mail-ua1-x92a.google.com [IPv6:2607:f8b0:4864:20::92a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdW2N1xNbz4Yyf for ; Tue, 18 Jan 2022 14:13:00 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x92a.google.com with SMTP id 2so12100437uax.10 for ; Tue, 18 Jan 2022 06:13:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=4dAVwuHogkY5EYr5/ZA/bu3BKoyeGGujBYB1rGPWgMc=; b=mQGhEEHsqNx1+IRLu+KpGCtouYDhbfovCKVhSgC6FYylTJREborD5nMm6u/cg6nzLQ +KhwvHNBccUuhVnp92BIgCdHmJvBMz+pHpP0JUQPzH4bYGyNbVplSBdRwchLAw9AE/kQ eFt0Y+X9uOa+NOqInYfGfhWFS7tdVrfCfHrblet3JbibZnrrSigcKJbrd5vVEfZzCZA1 cfkf+E+WeSMpZlibh15hW0oZM0to+r0pHWIpvRkRDZW7Cq6IQCFau0xC9EDwKL3Vc5YC /7EaDIIuJBv2jW9EokgeChG0OP2WQMJxHCf4lTvptycSk4sDhkd9KAE3bktkCauRz9/v 44zA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=4dAVwuHogkY5EYr5/ZA/bu3BKoyeGGujBYB1rGPWgMc=; b=sELTQwq1dlDZHJHlWkqcSeUSW5/XIrVAivQo5xa4P9wjz0+zweTB2c95E8bGljTZjx 8PecSorpFWJyrqFsK42pkaCAPU5zKvRuCLV2AB2kZ/SN5Rr58A9phISPWplIFux+mFbv g4sjVHJ/pxPN7BlJ33wdL52QadO/YiFO3/SmolhzjdkgFDgD5SV/9mCi8N/GJiCqLLAk Sl/0Wrc3uvwuK6EPo8+7NlcSqYLfrNvNVqWkgP/sxA4bMmKhzm0BzZ90q+FQhrf4RRHe FdNqM9+atTx1tbNBYQ7mcNcFlqeKl4++wx5t3wvVfEB7LhQfQcgrQ2ZxHCIx0AxtX46z x8yw== X-Gm-Message-State: AOAM532IZrCkZPmR6zeeKqpkBH/0MBO5L5DntEtEahALp/eX2UBt5lb8 3qr3PZCJqcqeOeN471nmekx1sF4WTuERlNraSYWqGtFd X-Google-Smtp-Source: ABdhPJy9Lcfkr+rN1gAPyd6soHLWsBsRDyoxwJSkFhtsfMMVWuViy9HPX5tyHRKW6Yt8hi3r6fvaJ/kzQ+rYOjFp8uc= X-Received: by 2002:a1f:c18c:: with SMTP id r134mr1270267vkf.6.1642515179745; Tue, 18 Jan 2022 06:12:59 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Tue, 18 Jan 2022 09:12:50 -0500 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Florent Rivoire Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000d3b3f605d5dbdd98" X-Rspamd-Queue-Id: 4JdW2N1xNbz4Yyf X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=mQGhEEHs; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::92a as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::92a:from]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000d3b3f605d5dbdd98 Content-Type: text/plain; charset="UTF-8" Compression would have made your life better here, and possibly also made it clearer what's going on. All records in a file are going to be the same size pre-compression - so if you set the recordsize to 1M and save a 131.1M file, it's going to take up 132M on disk before compression/raidz overhead/whatnot. Usually compression saves you from the tail padding actually requiring allocation on disk, which is one reason I encourage everyone to at least use lz4 (or, if you absolutely cannot for some reason, I guess zle should also work for this one case...) But I would say it's probably the sum of last record padding across the whole dataset, if you don't have compression on. - Rich On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire wrote: > TLDR: I rsync-ed the same data twice: once with 128K recordsize and > once with 1M, and the allocated size on disk is ~3% bigger with 1M. > Why not smaller ? > > > Hello, > > I would like some help to understand how the disk usage evolves when I > change the recordsize. > > I've read several articles/presentations/forums about recordsize in > ZFS, and if I try to summarize, I mainly understood that: > - recordsize is the "maximum" size of "objects" (so "logical blocks") > that zfs will create for both -data & metadata, then each object is > compressed and allocated to one vdev, splitted into smaller (ashift > size) "physical" blocks and written on disks > - increasing recordsize is usually good when storing large files that > are not modified, because it limits the nb of metadata objects > (block-pointers), which has a positive effect on performance > - decreasing recordsize is useful for "databases-like" workloads (ie: > small random writes inside existing objects), because it avoids write > amplification (read-modify-write a large object for a small update) > > Today, I'm trying to observe the effect of increasing recordsize for > *my* data (because I'm also considering defining special_small_blocks > & using SSDs as "special", but not tested nor discussed here, just > recordsize). > So, I'm doing some benchmarks on my "documents" dataset (details in > "notes" below), but the results are really strange to me. > > When I rsync the same data to a freshly-recreated zpool: > A) with recordsize=128K : 226G allocated on disk > B) with recordsize=1M : 232G allocated on disk => bigger than 128K ?!? > > I would clearly expect the other way around, because bigger recordsize > generates less metadata so smaller disk usage, and there shouldn't be > any overhead because 1M is just a maximum and not a forced size to > allocate for every object. > I don't mind the increased usage (I can live with a few GB more), but > I would like to understand why it happens. > > I tried to give all the details of my tests below. > Did I do something wrong ? Can you explain the increase ? > > Thanks ! > > > > =============================================== > A) 128K > ========== > > # zpool destroy bench > # zpool create -o ashift=12 bench > /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > > # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > [...] > sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 bytes/sec > total size is 240,982,439,038 speedup is 1.00 > > # zfs get recordsize bench > NAME PROPERTY VALUE SOURCE > bench recordsize 128K default > > # zpool list -v bench > NAME SIZE ALLOC FREE > CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > bench 2.72T 226G 2.50T > - - 0% 8% 1.00x ONLINE - > gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T > - - 0% 8.10% - ONLINE > > # zfs list bench > NAME USED AVAIL REFER MOUNTPOINT > bench 226G 2.41T 226G /bench > > # zfs get all bench |egrep "(used|referenced|written)" > bench used 226G - > bench referenced 226G - > bench usedbysnapshots 0B - > bench usedbydataset 226G - > bench usedbychildren 1.80M - > bench usedbyrefreservation 0B - > bench written 226G - > bench logicalused 226G - > bench logicalreferenced 226G - > > # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb > > > > =============================================== > B) 1M > ========== > > # zpool destroy bench > # zpool create -o ashift=12 bench > /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > # zfs set recordsize=1M bench > > # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > [...] > sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 bytes/sec > total size is 240,982,439,038 speedup is 1.00 > > # zfs get recordsize bench > NAME PROPERTY VALUE SOURCE > bench recordsize 1M local > > # zpool list -v bench > NAME SIZE ALLOC FREE > CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > bench 2.72T 232G 2.49T > - - 0% 8% 1.00x ONLINE - > gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T > - - 0% 8.32% - ONLINE > > # zfs list bench > NAME USED AVAIL REFER MOUNTPOINT > bench 232G 2.41T 232G /bench > > # zfs get all bench |egrep "(used|referenced|written)" > bench used 232G - > bench referenced 232G - > bench usedbysnapshots 0B - > bench usedbydataset 232G - > bench usedbychildren 1.96M - > bench usedbyrefreservation 0B - > bench written 232G - > bench logicalused 232G - > bench logicalreferenced 232G - > > # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb > > > > =============================================== > Notes: > ========== > > - the source dataset contains ~50% of pictures (raw files and jpg), > and also some music, various archived documents, zip, videos > - no change on the source dataset while testing (cf size logged by resync) > - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and > same results > - probably not important here, but: > /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR > (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset > on another zpool that I never tweaked except ashit=12 (because using > the same model of Red 3TB) > > # zfs --version > zfs-2.0.6-1 > zfs-kmod-v2021120100-zfs_a8c7652 > > # uname -a > FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 > 75566f060d4(HEAD) TRUENAS amd64 > --000000000000d3b3f605d5dbdd98 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Compression would have made your life better here, and pos= sibly also made it clearer what's going on.

All reco= rds in a file are going to be the same size pre-compression - so if you set= the recordsize to 1M and save a 131.1M file, it's going to take up 132= M on disk before compression/raidz overhead/whatnot.

Usually compression saves you from the tail padding actually requiring a= llocation on disk, which is one reason I encourage everyone to at least use= lz4 (or, if you absolutely cannot for some reason, I guess zle should also= work for this one case...)

But I would say it'= ;s probably the sum of last record padding across the whole dataset, if you= don't have compression on.

- Rich
=
On Tue= , Jan 18, 2022 at 8:57 AM Florent Rivoire <florent@rivoire.fr> wrote:
TLDR: I rsync-ed the same data twice: once with = 128K recordsize and
once with 1M, and the allocated size on disk is ~3% bigger with 1M.
Why not smaller ?


Hello,

I would like some help to understand how the disk usage evolves when I
change the recordsize.

I've read several articles/presentations/forums about recordsize in
ZFS, and if I try to summarize, I mainly understood that:
- recordsize is the "maximum" size of "objects" (so &qu= ot;logical blocks")
that zfs will create for both=C2=A0 -data & metadata, then each object = is
compressed and allocated to one vdev, splitted into smaller (ashift
size) "physical" blocks and written on disks
- increasing recordsize is usually good when storing large files that
are not modified, because it limits the nb of metadata objects
(block-pointers), which has a positive effect on performance
- decreasing recordsize is useful for "databases-like" workloads = (ie:
small random writes inside existing objects), because it avoids write
amplification (read-modify-write a large object for a small update)

Today, I'm trying to observe the effect of increasing recordsize for *my* data (because I'm also considering defining special_small_blocks & using SSDs as "special", but not tested nor discussed here,= just
recordsize).
So, I'm doing some benchmarks on my "documents" dataset (deta= ils in
"notes" below), but the results are really strange to me.

When I rsync the same data to a freshly-recreated zpool:
A) with recordsize=3D128K : 226G allocated on disk
B) with recordsize=3D1M : 232G allocated on disk =3D> bigger than 128K ?= !?

I would clearly expect the other way around, because bigger recordsize
generates less metadata so smaller disk usage, and there shouldn't be any overhead because 1M is just a maximum and not a forced size to
allocate for every object.
I don't mind the increased usage (I can live with a few GB more), but I would like to understand why it happens.

I tried to give all the details of my tests below.
Did I do something wrong ? Can you explain the increase ?

Thanks !



=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
A) 128K
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

# zpool destroy bench
# zpool create -o ashift=3D12 bench
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4

# rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench
[...]
sent 241,042,476,154 bytes=C2=A0 received 353,838 bytes=C2=A0 81,806,492.45= bytes/sec
total size is 240,982,439,038=C2=A0 speedup is 1.00

# zfs get recordsize bench
NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0 SOURCE
bench=C2=A0 recordsize=C2=A0 128K=C2=A0 =C2=A0 =C2=A0default

# zpool list -v bench
NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP=C2=A0 DEDUP=C2=A0 = =C2=A0 HEALTH=C2=A0 ALTROOT
bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A02.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
=C2=A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2= =A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0 -
=C2=A0 gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2=A0 2.72T=C2=A0 =C2=A02= 26G=C2=A0 2.50T
=C2=A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 8.1= 0%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE

# zfs list bench
NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REFER=C2=A0 MOUNTPOIN= T
bench=C2=A0 =C2=A0226G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 226G=C2=A0 /bench
# zfs get all bench |egrep "(used|referenced|written)"
bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 226G=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.80M=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02= 26G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-

# zdb -Lbbbs bench > zpool-bench-rcd128K.zdb



=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
B) 1M
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

# zpool destroy bench
# zpool create -o ashift=3D12 bench
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
# zfs set recordsize=3D1M bench

# rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench
[...]
sent 241,042,476,154 bytes=C2=A0 received 353,830 bytes=C2=A0 80,173,899.88= bytes/sec
total size is 240,982,439,038=C2=A0 speedup is 1.00

# zfs get recordsize bench
NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0 SOURCE
bench=C2=A0 recordsize=C2=A0 1M=C2=A0 =C2=A0 =C2=A0 =C2=A0local

# zpool list -v bench
NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP=C2=A0 DEDUP=C2=A0 = =C2=A0 HEALTH=C2=A0 ALTROOT
bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A02.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
=C2=A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2= =A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0 -
=C2=A0 gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2=A0 2.72T=C2=A0 =C2=A02= 32G=C2=A0 2.49T
=C2=A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 8.3= 2%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE

# zfs list bench
NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REFER=C2=A0 MOUNTPOIN= T
bench=C2=A0 =C2=A0232G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 232G=C2=A0 /bench
# zfs get all bench |egrep "(used|referenced|written)"
bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 232G=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.96M=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02= 32G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-

# zdb -Lbbbs bench > zpool-bench-rcd1M.zdb



=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Notes:
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

- the source dataset contains ~50% of pictures (raw files and jpg),
and also some music, various archived documents, zip, videos
- no change on the source dataset while testing (cf size logged by resync)<= br> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and
same results
- probably not important here, but:
/dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR
(WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset
on another zpool that I never tweaked except ashit=3D12 (because using
the same model of Red 3TB)

# zfs --version
zfs-2.0.6-1
zfs-kmod-v2021120100-zfs_a8c7652

# uname -a
FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11
75566f060d4(HEAD) TRUENAS=C2=A0 amd64
--000000000000d3b3f605d5dbdd98-- From nobody Tue Jan 18 14:23:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7D4E51957422 for ; Tue, 18 Jan 2022 14:23:44 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: from mail-yb1-xb2f.google.com (mail-yb1-xb2f.google.com [IPv6:2607:f8b0:4864:20::b2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdWGl3MWpz4f4v for ; Tue, 18 Jan 2022 14:23:43 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: by mail-yb1-xb2f.google.com with SMTP id m1so37697093ybo.5 for ; Tue, 18 Jan 2022 06:23:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivoire.fr; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9WjPYCdIKK4A4bmj7nEcdycyccTqHeSAx1j8faz638A=; b=mhYuuDBIE5B6DWMTcKrCemjuqevWPanBI6YxEtKIA/almXw79WYc+GP3ExXh2SJkoV 9Jfhr2P7AHaysPZiMzE6amDOSTOXfgWPc5lO31p8SXAZFSckncP/0+uBtPjaBdR6PKfJ a9YIDHWhifNTC4faQN8udvIM9cOjxenmooDP7oTCMZLWaFA5laoRadrBH68d//+feblO JlO359xSXn6RdhkFN1wpchpo68Q4AN68FUpqxod38qvpA6VURC1c2X3xqoW7z8LYUmId VKCKOA7qhvYptQAQCznSlmMBk5F7zrVT/Ifg8lnfaiwnvwL4ZTNChrGpL0vEGiDp4Dxx CbGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9WjPYCdIKK4A4bmj7nEcdycyccTqHeSAx1j8faz638A=; b=u3UPdbfm2YHDJa18CIawosjmnYBZ2hTtE7BB0/8Wo9jF9LruvHGG2Ek6VO64AqE+/G wX5e+KW44Pr4f3FUFzCWlERyFxOeUwMdD+K3iWDefutzKoguwdHp0W41bdH8L2iiF5pQ QAgP7+oj6jSq2+n+EwHgMeJiL7A0JUFjDW4f1JeEoBavTAAJU70A6L1m77KjlP6lQO6b +yiUnlmFLPo8nHh8HV4ME096EsdyfOM8Hguhm2zT+3YajnD4i9NvR/ymTwPc+bm1fZZO 5IgAzM+Ab7oZCtoEv5rwyI9aJguNqk7VeghLo0F/95mtPK0Z4iqP8huEH2VtvtEWKdyH 6M2w== X-Gm-Message-State: AOAM531iN5XYNENBoYPcbZnVdR4476McRB8Yy3htn6kG89B5EdVjs2wR vG5Q6fQb4W3Uf81eGQHMsMHjeM/xND33GBZDjuByGJ5tjo0apg== X-Google-Smtp-Source: ABdhPJxR1TdZBvh+w4J+Vcm+GLBKnc5prDLtk0Kzh/BHvmJhjo7azSGUk1lW7oUu7zXNzC3RbTr3S89CUMObSUfRa1U= X-Received: by 2002:a05:6902:1021:: with SMTP id x1mr36949157ybt.137.1642515822961; Tue, 18 Jan 2022 06:23:42 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Florent Rivoire Date: Tue, 18 Jan 2022 15:23:32 +0100 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Rich Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4JdWGl3MWpz4f4v X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rivoire.fr header.s=google header.b=mhYuuDBI; dmarc=none; spf=pass (mx1.freebsd.org: domain of florent@rivoire.fr designates 2607:f8b0:4864:20::b2f as permitted sender) smtp.mailfrom=florent@rivoire.fr X-Spamd-Result: default: False [-2.70 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.76)[-0.765]; R_DKIM_ALLOW(-0.20)[rivoire.fr:s=google]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-0.43)[-0.433]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[rivoire.fr]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[rivoire.fr:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2f:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Tue, Jan 18, 2022 at 3:13 PM Rich wrote: > Compression would have made your life better here, and possibly also made it clearer what's going on. I didn't think at all about compression (which I know exists and usually has very positive impact) during my tests... and it's indeed disabled in my tests (I'm only seeing it now): # zfs get compression bench NAME PROPERTY VALUE SOURCE bench compression off default I'm going to re-do my tests with lz4 everywhere, and I'll post results here. Thanks Rich ! From nobody Tue Jan 18 14:23:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1C2B61957C12 for ; Tue, 18 Jan 2022 14:24:05 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f54.google.com (mail-ot1-f54.google.com [209.85.210.54]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdWH75B1lz4fHR for ; Tue, 18 Jan 2022 14:24:03 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f54.google.com with SMTP id a12-20020a0568301dcc00b005919e149b4cso24371999otj.8 for ; Tue, 18 Jan 2022 06:24:03 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ebZbLU6Kp6OHmt1pCxN7/NtQdH2J++duw7sDgoK728Y=; b=t257c7XdyypcRXsKGlVFQDywPIL489xyqjeFjazb3bvIjukY5DtQ2PrI6ZPCgdT3X1 8tYXz/W33mJrPNEoRtlrIDgu77P7CPx+Pi0sXLqRICiA+ysdGXFCaJBR804qIJ9rp3wg OC2JaXBD5jtCPwHVjJ8rf5BIJnh7KJzhSJPvNLiM4WTSs9RybnAgSgDeOQNf3DFduJbX nfKPARo+VFkiKKLOgPqzlBYG7Av7lxVIlkxunjCYzHN7+2/5VXXm8ij7g7xfzaOAIhh9 jN3GkCOfauGmoqJC0//3WDU7v2FwO900ovhC9LLbdzPV54sGFeIDqDIO57LAvsH/YqN3 a8ww== X-Gm-Message-State: AOAM531BsoNzO9h5fgU/U5ACo+al+XSqSXq/Gg4O/qcKdtJHBWP+plJF toP18P0XyXHOeZh3GkHoCTeSnG7qxNQI7x6+Dfk= X-Google-Smtp-Source: ABdhPJwAkPYOEpObU8w/wm271sOtukaCJaoXLC4XTvMF3F3CWQCIglDfu4Qpw1rFx0JBLoyJdh77Q8kfo/+CnoIgFnE= X-Received: by 2002:a05:6830:60a:: with SMTP id w10mr17419892oti.111.1642515837114; Tue, 18 Jan 2022 06:23:57 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 18 Jan 2022 07:23:45 -0700 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Rich Cc: Florent Rivoire , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4JdWH75B1lz4fHR X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.54 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [0.93 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.54:from]; NEURAL_SPAM_MEDIUM(0.93)[0.932]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_SPAM_LONG(1.00)[1.000]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.54:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: > > Compression would have made your life better here, and possibly also made it clearer what's going on. > > All records in a file are going to be the same size pre-compression - so if you set the recordsize to 1M and save a 131.1M file, it's going to take up 132M on disk before compression/raidz overhead/whatnot. Not true. ZFS will trim the file's tails even without compression enabled. > > Usually compression saves you from the tail padding actually requiring allocation on disk, which is one reason I encourage everyone to at least use lz4 (or, if you absolutely cannot for some reason, I guess zle should also work for this one case...) > > But I would say it's probably the sum of last record padding across the whole dataset, if you don't have compression on. > > - Rich > > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire wrote: >> >> TLDR: I rsync-ed the same data twice: once with 128K recordsize and >> once with 1M, and the allocated size on disk is ~3% bigger with 1M. >> Why not smaller ? >> >> >> Hello, >> >> I would like some help to understand how the disk usage evolves when I >> change the recordsize. >> >> I've read several articles/presentations/forums about recordsize in >> ZFS, and if I try to summarize, I mainly understood that: >> - recordsize is the "maximum" size of "objects" (so "logical blocks") >> that zfs will create for both -data & metadata, then each object is >> compressed and allocated to one vdev, splitted into smaller (ashift >> size) "physical" blocks and written on disks >> - increasing recordsize is usually good when storing large files that >> are not modified, because it limits the nb of metadata objects >> (block-pointers), which has a positive effect on performance >> - decreasing recordsize is useful for "databases-like" workloads (ie: >> small random writes inside existing objects), because it avoids write >> amplification (read-modify-write a large object for a small update) >> >> Today, I'm trying to observe the effect of increasing recordsize for >> *my* data (because I'm also considering defining special_small_blocks >> & using SSDs as "special", but not tested nor discussed here, just >> recordsize). >> So, I'm doing some benchmarks on my "documents" dataset (details in >> "notes" below), but the results are really strange to me. >> >> When I rsync the same data to a freshly-recreated zpool: >> A) with recordsize=128K : 226G allocated on disk >> B) with recordsize=1M : 232G allocated on disk => bigger than 128K ?!? >> >> I would clearly expect the other way around, because bigger recordsize >> generates less metadata so smaller disk usage, and there shouldn't be >> any overhead because 1M is just a maximum and not a forced size to >> allocate for every object. A common misconception. The 1M recordsize applies to every newly created object, and every object must use the same size for all of its records (except possibly the last one). But objects created before you changed the recsize will retain their old recsize, file tails have a flexible recsize. >> I don't mind the increased usage (I can live with a few GB more), but >> I would like to understand why it happens. You might be seeing the effects of sparsity. ZFS is smart enough not to store file holes (and if any kind of compression is enabled, it will find long runs of zeroes and turn them into holes). If your data contains any holes that are >= 128 kB but < 1MB, then they can be stored as holes with a 128 kB recsize but must be stored as long runs of zeros with a 1MB recsize. However, I would suggest that you don't bother. With a 128kB recsize, ZFS has something like a 1000:1 ratio of data:metadata. In other words, increasing your recsize can save you at most 0.1% of disk space. Basically, it doesn't matter. What it _does_ matter for is the tradeoff between write amplification and RAM usage. 1000:1 is comparable to the disk:ram of many computers. And performance is more sensitive to metadata access times than data access times. So increasing your recsize can help you keep a greater fraction of your metadata in ARC. OTOH, as you remarked increasing your recsize will also increase write amplification. So to summarize: * Adjust compression settings to save disk space. * Adjust recsize to save RAM. -Alan >> >> I tried to give all the details of my tests below. >> Did I do something wrong ? Can you explain the increase ? >> >> Thanks ! >> >> >> >> =============================================== >> A) 128K >> ========== >> >> # zpool destroy bench >> # zpool create -o ashift=12 bench >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> [...] >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 bytes/sec >> total size is 240,982,439,038 speedup is 1.00 >> >> # zfs get recordsize bench >> NAME PROPERTY VALUE SOURCE >> bench recordsize 128K default >> >> # zpool list -v bench >> NAME SIZE ALLOC FREE >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> bench 2.72T 226G 2.50T >> - - 0% 8% 1.00x ONLINE - >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T >> - - 0% 8.10% - ONLINE >> >> # zfs list bench >> NAME USED AVAIL REFER MOUNTPOINT >> bench 226G 2.41T 226G /bench >> >> # zfs get all bench |egrep "(used|referenced|written)" >> bench used 226G - >> bench referenced 226G - >> bench usedbysnapshots 0B - >> bench usedbydataset 226G - >> bench usedbychildren 1.80M - >> bench usedbyrefreservation 0B - >> bench written 226G - >> bench logicalused 226G - >> bench logicalreferenced 226G - >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb >> >> >> >> =============================================== >> B) 1M >> ========== >> >> # zpool destroy bench >> # zpool create -o ashift=12 bench >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> # zfs set recordsize=1M bench >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> [...] >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 bytes/sec >> total size is 240,982,439,038 speedup is 1.00 >> >> # zfs get recordsize bench >> NAME PROPERTY VALUE SOURCE >> bench recordsize 1M local >> >> # zpool list -v bench >> NAME SIZE ALLOC FREE >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> bench 2.72T 232G 2.49T >> - - 0% 8% 1.00x ONLINE - >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T >> - - 0% 8.32% - ONLINE >> >> # zfs list bench >> NAME USED AVAIL REFER MOUNTPOINT >> bench 232G 2.41T 232G /bench >> >> # zfs get all bench |egrep "(used|referenced|written)" >> bench used 232G - >> bench referenced 232G - >> bench usedbysnapshots 0B - >> bench usedbydataset 232G - >> bench usedbychildren 1.96M - >> bench usedbyrefreservation 0B - >> bench written 232G - >> bench logicalused 232G - >> bench logicalreferenced 232G - >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb >> >> >> >> =============================================== >> Notes: >> ========== >> >> - the source dataset contains ~50% of pictures (raw files and jpg), >> and also some music, various archived documents, zip, videos >> - no change on the source dataset while testing (cf size logged by resync) >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and >> same results >> - probably not important here, but: >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset >> on another zpool that I never tweaked except ashit=12 (because using >> the same model of Red 3TB) >> >> # zfs --version >> zfs-2.0.6-1 >> zfs-kmod-v2021120100-zfs_a8c7652 >> >> # uname -a >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 >> 75566f060d4(HEAD) TRUENAS amd64 From nobody Tue Jan 18 14:29:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B9FC8195A784 for ; Tue, 18 Jan 2022 14:30:05 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x935.google.com (mail-ua1-x935.google.com [IPv6:2607:f8b0:4864:20::935]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdWQ46b5Fz4h1F; Tue, 18 Jan 2022 14:30:04 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x935.google.com with SMTP id x33so36971836uad.12; Tue, 18 Jan 2022 06:30:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zfTxVRw40nL/03eq9LoGY1BACyMnyaqH2uzIf9qwluI=; b=bvmwSqSqs5q7jH9d8fJzPhi1ufMubr0CZaMGSwJEDtZ12+ifTixcxhdQXPCixeodCk 1/SSuzJOITV2ni/KjObmA+aAbPUuti8kdP1B0fdfGwgnVR2Jrts9ZagyrdDkiEpKh+63 tmMf9F1OiqD7cHy9E8p+XndYEOFfI0sBXyMQdB48GCIEbfUTXE8aenn18U4/O4NbeNLa RdkXPXC3Oiqgff7Oh99kiZcTWgFPZ18HuijoKCzbBVrfR2xG4HPBAQ3Jw1kX2rCTvA7V 3P/SPC6nFCQk8nhg7+zka/64nBjP6XuR7NtFZgWxe570XKj27B2DUUXBqpd7OUVXbbY4 oI1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zfTxVRw40nL/03eq9LoGY1BACyMnyaqH2uzIf9qwluI=; b=y/8dxYYw+5jmLoVX14zlgt1/OVW15/qwpgHLi7zEssmmsAQcpsXlO4QESgsjNaD7gU RPaFHCCBqUtvdaHHRP7tuCsGRbZGkTzBsqUc8EGn/rwWzXmr1RbrF79FCisJaj7TZkGi 8QLpFGgKV0QnvSY2kzwjS3ZkuYGQ+m5GfGOAiV8Endzk/AukYwr/7ujHabpz9X08Lxzv JpdRXKpZlzYkYhyNqVxdF7n6rnpZLxl1V/Tle5R46KsUM3Yi+L7cicrtDGVB8jpHttSC mWc1gMFC7ljhrvY1GM1s+989VOhD/rQCPv124NxQ34pSaJrExRdYJ4pw47GK5P1nARNi LYuQ== X-Gm-Message-State: AOAM530CKAMx3ZMROSUZlZMk9tnl3DK1R+xmbLenj4lbjy8Ma+mpObU1 IbLEWWhSe4GDhOBJSRyO2HI6O6LWNTR08Ad2GvNjE+OwnE0= X-Google-Smtp-Source: ABdhPJxN6v4G/NjiVfQuvr2Xuw+NBzQCSQO3e7JMors3LhLio+fpgOpG6gfMICpZtE8eM/OdoprrEcV8CtXU2D/EnNk= X-Received: by 2002:a05:6102:3a74:: with SMTP id bf20mr5272479vsb.31.1642516202763; Tue, 18 Jan 2022 06:30:02 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Tue, 18 Jan 2022 09:29:54 -0500 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Alan Somers Cc: Florent Rivoire , freebsd-fs Content-Type: multipart/alternative; boundary="000000000000cdb85605d5dc1a76" X-Rspamd-Queue-Id: 4JdWQ46b5Fz4h1F X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=bvmwSqSq; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::935 as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::935:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000cdb85605d5dc1a76 Content-Type: text/plain; charset="UTF-8" Really? I didn't know it would still trim the tails on files with compression off. ... size 1179648 parent 34 links 1 pflags 40800000004 Indirect blocks: 0 L1 DVA[0]=<3:c02b96c000:1000> DVA[1]=<3:c810733000:1000> [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique double size=20000L/1000P birth=35675472L/35675472P fill=2 cksum=5cfba24b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 0 L0 DVA[0]=<2:a0827db4000:100000> [L0 ZFS plain file] skein uncompressed unencrypted LE contiguous unique single size=100000L/100000P birth=35675472L/35675472P fill=1 cksum=95b06edf60e5f54c:af6f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360 100000 L0 DVA[0]=<2:a0827eb4000:100000> [L0 ZFS plain file] skein uncompressed unencrypted LE contiguous unique single size=100000L/100000P birth=35675472L/35675472P fill=1 cksum=62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 It seems not? - Rich On Tue, Jan 18, 2022 at 9:23 AM Alan Somers wrote: > On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: > > > > Compression would have made your life better here, and possibly also > made it clearer what's going on. > > > > All records in a file are going to be the same size pre-compression - so > if you set the recordsize to 1M and save a 131.1M file, it's going to take > up 132M on disk before compression/raidz overhead/whatnot. > > Not true. ZFS will trim the file's tails even without compression enabled. > > > > > Usually compression saves you from the tail padding actually requiring > allocation on disk, which is one reason I encourage everyone to at least > use lz4 (or, if you absolutely cannot for some reason, I guess zle should > also work for this one case...) > > > > But I would say it's probably the sum of last record padding across the > whole dataset, if you don't have compression on. > > > > - Rich > > > > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire > wrote: > >> > >> TLDR: I rsync-ed the same data twice: once with 128K recordsize and > >> once with 1M, and the allocated size on disk is ~3% bigger with 1M. > >> Why not smaller ? > >> > >> > >> Hello, > >> > >> I would like some help to understand how the disk usage evolves when I > >> change the recordsize. > >> > >> I've read several articles/presentations/forums about recordsize in > >> ZFS, and if I try to summarize, I mainly understood that: > >> - recordsize is the "maximum" size of "objects" (so "logical blocks") > >> that zfs will create for both -data & metadata, then each object is > >> compressed and allocated to one vdev, splitted into smaller (ashift > >> size) "physical" blocks and written on disks > >> - increasing recordsize is usually good when storing large files that > >> are not modified, because it limits the nb of metadata objects > >> (block-pointers), which has a positive effect on performance > >> - decreasing recordsize is useful for "databases-like" workloads (ie: > >> small random writes inside existing objects), because it avoids write > >> amplification (read-modify-write a large object for a small update) > >> > >> Today, I'm trying to observe the effect of increasing recordsize for > >> *my* data (because I'm also considering defining special_small_blocks > >> & using SSDs as "special", but not tested nor discussed here, just > >> recordsize). > >> So, I'm doing some benchmarks on my "documents" dataset (details in > >> "notes" below), but the results are really strange to me. > >> > >> When I rsync the same data to a freshly-recreated zpool: > >> A) with recordsize=128K : 226G allocated on disk > >> B) with recordsize=1M : 232G allocated on disk => bigger than 128K ?!? > >> > >> I would clearly expect the other way around, because bigger recordsize > >> generates less metadata so smaller disk usage, and there shouldn't be > >> any overhead because 1M is just a maximum and not a forced size to > >> allocate for every object. > > A common misconception. The 1M recordsize applies to every newly > created object, and every object must use the same size for all of its > records (except possibly the last one). But objects created before > you changed the recsize will retain their old recsize, file tails have > a flexible recsize. > > >> I don't mind the increased usage (I can live with a few GB more), but > >> I would like to understand why it happens. > > You might be seeing the effects of sparsity. ZFS is smart enough not > to store file holes (and if any kind of compression is enabled, it > will find long runs of zeroes and turn them into holes). If your data > contains any holes that are >= 128 kB but < 1MB, then they can be > stored as holes with a 128 kB recsize but must be stored as long runs > of zeros with a 1MB recsize. > > However, I would suggest that you don't bother. With a 128kB recsize, > ZFS has something like a 1000:1 ratio of data:metadata. In other > words, increasing your recsize can save you at most 0.1% of disk > space. Basically, it doesn't matter. What it _does_ matter for is > the tradeoff between write amplification and RAM usage. 1000:1 is > comparable to the disk:ram of many computers. And performance is more > sensitive to metadata access times than data access times. So > increasing your recsize can help you keep a greater fraction of your > metadata in ARC. OTOH, as you remarked increasing your recsize will > also increase write amplification. > > So to summarize: > * Adjust compression settings to save disk space. > * Adjust recsize to save RAM. > > -Alan > > >> > >> I tried to give all the details of my tests below. > >> Did I do something wrong ? Can you explain the increase ? > >> > >> Thanks ! > >> > >> > >> > >> =============================================== > >> A) 128K > >> ========== > >> > >> # zpool destroy bench > >> # zpool create -o ashift=12 bench > >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> > >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> [...] > >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 > bytes/sec > >> total size is 240,982,439,038 speedup is 1.00 > >> > >> # zfs get recordsize bench > >> NAME PROPERTY VALUE SOURCE > >> bench recordsize 128K default > >> > >> # zpool list -v bench > >> NAME SIZE ALLOC FREE > >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> bench 2.72T 226G 2.50T > >> - - 0% 8% 1.00x ONLINE - > >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T > >> - - 0% 8.10% - ONLINE > >> > >> # zfs list bench > >> NAME USED AVAIL REFER MOUNTPOINT > >> bench 226G 2.41T 226G /bench > >> > >> # zfs get all bench |egrep "(used|referenced|written)" > >> bench used 226G - > >> bench referenced 226G - > >> bench usedbysnapshots 0B - > >> bench usedbydataset 226G - > >> bench usedbychildren 1.80M - > >> bench usedbyrefreservation 0B - > >> bench written 226G - > >> bench logicalused 226G - > >> bench logicalreferenced 226G - > >> > >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb > >> > >> > >> > >> =============================================== > >> B) 1M > >> ========== > >> > >> # zpool destroy bench > >> # zpool create -o ashift=12 bench > >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> # zfs set recordsize=1M bench > >> > >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> [...] > >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 > bytes/sec > >> total size is 240,982,439,038 speedup is 1.00 > >> > >> # zfs get recordsize bench > >> NAME PROPERTY VALUE SOURCE > >> bench recordsize 1M local > >> > >> # zpool list -v bench > >> NAME SIZE ALLOC FREE > >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> bench 2.72T 232G 2.49T > >> - - 0% 8% 1.00x ONLINE - > >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T > >> - - 0% 8.32% - ONLINE > >> > >> # zfs list bench > >> NAME USED AVAIL REFER MOUNTPOINT > >> bench 232G 2.41T 232G /bench > >> > >> # zfs get all bench |egrep "(used|referenced|written)" > >> bench used 232G - > >> bench referenced 232G - > >> bench usedbysnapshots 0B - > >> bench usedbydataset 232G - > >> bench usedbychildren 1.96M - > >> bench usedbyrefreservation 0B - > >> bench written 232G - > >> bench logicalused 232G - > >> bench logicalreferenced 232G - > >> > >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb > >> > >> > >> > >> =============================================== > >> Notes: > >> ========== > >> > >> - the source dataset contains ~50% of pictures (raw files and jpg), > >> and also some music, various archived documents, zip, videos > >> - no change on the source dataset while testing (cf size logged by > resync) > >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and > >> same results > >> - probably not important here, but: > >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR > >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset > >> on another zpool that I never tweaked except ashit=12 (because using > >> the same model of Red 3TB) > >> > >> # zfs --version > >> zfs-2.0.6-1 > >> zfs-kmod-v2021120100-zfs_a8c7652 > >> > >> # uname -a > >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 > >> 75566f060d4(HEAD) TRUENAS amd64 > --000000000000cdb85605d5dc1a76 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Really? I didn't know it would still trim the tails on= files with compression off.

...

=C2=A0 =C2=A0 =C2=A0 =C2=A0 size =C2=A0 =C2=A01179648
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 parent =C2=A034
=C2=A0 =C2=A0 =C2=A0 =C2=A0 links =C2=A0 1=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 pflags =C2=A040800000004
Indirect blocks= :
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 L1 =C2=A0DVA[= 0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c810733000:1000> [L1 ZFS p= lain file] skein lz4 unencrypted LE contiguous unique double size=3D20000L/= 1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba24b351a09aa:8bd9dfe= f87c5b625:906ed5c3252943db:bed77ce51ad540d4
=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0L0 DVA[0]=3D<2:a0827db4000:100000>= [L0 ZFS plain file] skein uncompressed unencrypted LE contiguous unique si= ngle size=3D100000L/100000P birth=3D35675472L/35675472P fill=3D1 cksum=3D95= b06edf60e5f54c:af6f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360
=C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 100000 =C2=A0L0 DVA[0]=3D<2:a0827eb4000:100= 000> [L0 ZFS plain file] skein uncompressed unencrypted LE contiguous un= ique single size=3D100000L/100000P birth=3D35675472L/35675472P fill=3D1 cks= um=3D62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3

It seems not?

- Rich


On Tue, Jan 18, 2022 at 9:23 AM Alan Somers <asomers@freebsd.org> wrote:
On Tue, Jan 18, 2022 at = 7:13 AM Rich <= rincebrain@gmail.com> wrote:
>
> Compression would have made your life better here, and possibly also m= ade it clearer what's going on.
>
> All records in a file are going to be the same size pre-compression - = so if you set the recordsize to 1M and save a 131.1M file, it's going t= o take up 132M on disk before compression/raidz overhead/whatnot.

Not true.=C2=A0 ZFS will trim the file's tails even without compression= enabled.

>
> Usually compression saves you from the tail padding actually requiring= allocation on disk, which is one reason I encourage everyone to at least u= se lz4 (or, if you absolutely cannot for some reason, I guess zle should al= so work for this one case...)
>
> But I would say it's probably the sum of last record padding acros= s the whole dataset, if you don't have compression on.
>
> - Rich
>
> On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire <florent@rivoire.fr> wrote:
>>
>> TLDR: I rsync-ed the same data twice: once with 128K recordsize an= d
>> once with 1M, and the allocated size on disk is ~3% bigger with 1M= .
>> Why not smaller ?
>>
>>
>> Hello,
>>
>> I would like some help to understand how the disk usage evolves wh= en I
>> change the recordsize.
>>
>> I've read several articles/presentations/forums about recordsi= ze in
>> ZFS, and if I try to summarize, I mainly understood that:
>> - recordsize is the "maximum" size of "objects"= ; (so "logical blocks")
>> that zfs will create for both=C2=A0 -data & metadata, then eac= h object is
>> compressed and allocated to one vdev, splitted into smaller (ashif= t
>> size) "physical" blocks and written on disks
>> - increasing recordsize is usually good when storing large files t= hat
>> are not modified, because it limits the nb of metadata objects
>> (block-pointers), which has a positive effect on performance
>> - decreasing recordsize is useful for "databases-like" w= orkloads (ie:
>> small random writes inside existing objects), because it avoids wr= ite
>> amplification (read-modify-write a large object for a small update= )
>>
>> Today, I'm trying to observe the effect of increasing recordsi= ze for
>> *my* data (because I'm also considering defining special_small= _blocks
>> & using SSDs as "special", but not tested nor discus= sed here, just
>> recordsize).
>> So, I'm doing some benchmarks on my "documents" data= set (details in
>> "notes" below), but the results are really strange to me= .
>>
>> When I rsync the same data to a freshly-recreated zpool:
>> A) with recordsize=3D128K : 226G allocated on disk
>> B) with recordsize=3D1M : 232G allocated on disk =3D> bigger th= an 128K ?!?
>>
>> I would clearly expect the other way around, because bigger record= size
>> generates less metadata so smaller disk usage, and there shouldn&#= 39;t be
>> any overhead because 1M is just a maximum and not a forced size to=
>> allocate for every object.

A common misconception.=C2=A0 The 1M recordsize applies to every newly
created object, and every object must use the same size for all of its
records (except possibly the last one).=C2=A0 But objects created before you changed the recsize will retain their old recsize, file tails have
a flexible recsize.

>> I don't mind the increased usage (I can live with a few GB mor= e), but
>> I would like to understand why it happens.

You might be seeing the effects of sparsity.=C2=A0 ZFS is smart enough not<= br> to store file holes (and if any kind of compression is enabled, it
will find long runs of zeroes and turn them into holes).=C2=A0 If your data=
contains any holes that are >=3D 128 kB but < 1MB, then they can be stored as holes with a 128 kB recsize but must be stored as long runs
of zeros with a 1MB recsize.

However, I would suggest that you don't bother.=C2=A0 With a 128kB recs= ize,
ZFS has something like a 1000:1 ratio of data:metadata.=C2=A0 In other
words, increasing your recsize can save you at most 0.1% of disk
space.=C2=A0 Basically, it doesn't matter.=C2=A0 What it _does_ matter = for is
the tradeoff between write amplification and RAM usage.=C2=A0 1000:1 is
comparable to the disk:ram of many computers.=C2=A0 And performance is more=
sensitive to metadata access times than data access times.=C2=A0 So
increasing your recsize can help you keep a greater fraction of your
metadata in ARC.=C2=A0 OTOH, as you remarked increasing your recsize will also increase write amplification.

So to summarize:
* Adjust compression settings to save disk space.
* Adjust recsize to save RAM.

-Alan

>>
>> I tried to give all the details of my tests below.
>> Did I do something wrong ? Can you explain the increase ?
>>
>> Thanks !
>>
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> A) 128K
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> # zpool destroy bench
>> # zpool create -o ashift=3D12 bench
>> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
>>
>> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /benc= h
>> [...]
>> sent 241,042,476,154 bytes=C2=A0 received 353,838 bytes=C2=A0 81,8= 06,492.45 bytes/sec
>> total size is 240,982,439,038=C2=A0 speedup is 1.00
>>
>> # zfs get recordsize bench
>> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0 SOURCE >> bench=C2=A0 recordsize=C2=A0 128K=C2=A0 =C2=A0 =C2=A0default
>>
>> # zpool list -v bench
>> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP=C2=A0 DED= UP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A02.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2= =A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0 -
>>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2=A0 2.72T= =C2=A0 =C2=A0226G=C2=A0 2.50T
>>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2= =A00%=C2=A0 8.10%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE
>>
>> # zfs list bench
>> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REFER=C2=A0 = MOUNTPOINT
>> bench=C2=A0 =C2=A0226G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 226G=C2=A0 = /bench
>>
>> # zfs get all bench |egrep "(used|referenced|written)" >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
>> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 22= 6G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.80M=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
>> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A022= 6G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>>
>> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb
>>
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> B) 1M
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> # zpool destroy bench
>> # zpool create -o ashift=3D12 bench
>> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
>> # zfs set recordsize=3D1M bench
>>
>> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /benc= h
>> [...]
>> sent 241,042,476,154 bytes=C2=A0 received 353,830 bytes=C2=A0 80,1= 73,899.88 bytes/sec
>> total size is 240,982,439,038=C2=A0 speedup is 1.00
>>
>> # zfs get recordsize bench
>> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0 SOURCE >> bench=C2=A0 recordsize=C2=A0 1M=C2=A0 =C2=A0 =C2=A0 =C2=A0local >>
>> # zpool list -v bench
>> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP=C2=A0 DED= UP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A02.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2= =A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0 -
>>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2=A0 2.72T= =C2=A0 =C2=A0232G=C2=A0 2.49T
>>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2= =A00%=C2=A0 8.32%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE
>>
>> # zfs list bench
>> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REFER=C2=A0 = MOUNTPOINT
>> bench=C2=A0 =C2=A0232G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 232G=C2=A0 = /bench
>>
>> # zfs get all bench |egrep "(used|referenced|written)" >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
>> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 23= 2G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.96M=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
>> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A023= 2G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>>
>> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb
>>
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> Notes:
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> - the source dataset contains ~50% of pictures (raw files and jpg)= ,
>> and also some music, various archived documents, zip, videos
>> - no change on the source dataset while testing (cf size logged by= resync)
>> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), = and
>> same results
>> - probably not important here, but:
>> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize datas= et
>> on another zpool that I never tweaked except ashit=3D12 (because u= sing
>> the same model of Red 3TB)
>>
>> # zfs --version
>> zfs-2.0.6-1
>> zfs-kmod-v2021120100-zfs_a8c7652
>>
>> # uname -a
>> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11
>> 75566f060d4(HEAD) TRUENAS=C2=A0 amd64
--000000000000cdb85605d5dc1a76-- From nobody Tue Jan 18 14:47:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7DFDF1968509 for ; Tue, 18 Jan 2022 14:47:59 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oo1-f52.google.com (mail-oo1-f52.google.com [209.85.161.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdWpk3fDDz4pVc for ; Tue, 18 Jan 2022 14:47:58 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oo1-f52.google.com with SMTP id x21-20020a4a2a55000000b002ddf492c201so5780907oox.6 for ; Tue, 18 Jan 2022 06:47:58 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=EIVf1X+nHESC5rj6ILCSQG74CjJ4/E62pDSWxvdJU90=; b=1JNf7UWTUT5w5sxnLP1chjaktpUZAhkXIoUqHxtijyvd3+nkf3u5xMmvz/sUR7OQgo FNWxZGO6rugvpaAOm3UcTPSLv2FXKvdM1Xleph9yqMJmI/mb2X9nRzt61RCIXPA3Ze7E vZHlZTgyPaVA18pZv31q3/W663dSMrzEZmUyJmD5fE1GU4O4uNVqTWSxRy2cig9T68L6 G5EI2eOlXGBDScJA+chs60PAj+hQ2pucb6ShwS2RuJJLIrLOTn7VbCQhaStfA7GZtnes ClZQPyvzVDlrpI9XNq20KL7S+OOcGLk/7ydGI58QgcEcVlKU+6Q1oiUVpO1HokeXg5aF 6UGA== X-Gm-Message-State: AOAM5316eDHrB/9bJkuOJDQdXOP/jOb0MeXjgfCl7pi7Y9wyyoLBi1ig 2TxhAW63WYe+5bjaRzU8yj2eAqxrPXYc04vePuI= X-Google-Smtp-Source: ABdhPJxLI1TJBoruAeWEb8xcNdvLji0jujRjTRLJIX3pxEz6J3rL5dIC3CrjUCwsjPHe+n18QdC5fsbth9ERphclAxE= X-Received: by 2002:a4a:8891:: with SMTP id j17mr18629164ooa.16.1642517271883; Tue, 18 Jan 2022 06:47:51 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 18 Jan 2022 07:47:40 -0700 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Rich Cc: Florent Rivoire , freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4JdWpk3fDDz4pVc X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.161.52 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [0.92 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RWL_MAILSPIKE_GOOD(0.00)[209.85.161.52:from]; NEURAL_SPAM_MEDIUM(0.92)[0.921]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_SPAM_LONG(1.00)[0.998]; RCVD_IN_DNSWL_NONE(0.00)[209.85.161.52:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Yeah, it does. Just check "du -sh ". zdb there is showing you the logical size of the record, but it isn't showing how many disk blocks are actually allocated. On Tue, Jan 18, 2022 at 7:30 AM Rich wrote: > > Really? I didn't know it would still trim the tails on files with compres= sion off. > > ... > > size 1179648 > parent 34 > links 1 > pflags 40800000004 > Indirect blocks: > 0 L1 DVA[0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c810733000:= 1000> [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique double= size=3D20000L/1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba24b3= 51a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 > 0 L0 DVA[0]=3D<2:a0827db4000:100000> [L0 ZFS plain file] = skein uncompressed unencrypted LE contiguous unique single size=3D100000L/1= 00000P birth=3D35675472L/35675472P fill=3D1 cksum=3D95b06edf60e5f54c:af6f69= 50775d0863:8fc28b0783fcd9d3:2e44676e48a59360 > 100000 L0 DVA[0]=3D<2:a0827eb4000:100000> [L0 ZFS plain file] = skein uncompressed unencrypted LE contiguous unique single size=3D100000L/1= 00000P birth=3D35675472L/35675472P fill=3D1 cksum=3D62a1f05769528648:8197c8= a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 > > It seems not? > > - Rich > > > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers wrote: >> >> On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: >> > >> > Compression would have made your life better here, and possibly also m= ade it clearer what's going on. >> > >> > All records in a file are going to be the same size pre-compression - = so if you set the recordsize to 1M and save a 131.1M file, it's going to ta= ke up 132M on disk before compression/raidz overhead/whatnot. >> >> Not true. ZFS will trim the file's tails even without compression enabl= ed. >> >> > >> > Usually compression saves you from the tail padding actually requiring= allocation on disk, which is one reason I encourage everyone to at least u= se lz4 (or, if you absolutely cannot for some reason, I guess zle should al= so work for this one case...) >> > >> > But I would say it's probably the sum of last record padding across th= e whole dataset, if you don't have compression on. >> > >> > - Rich >> > >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire w= rote: >> >> >> >> TLDR: I rsync-ed the same data twice: once with 128K recordsize and >> >> once with 1M, and the allocated size on disk is ~3% bigger with 1M. >> >> Why not smaller ? >> >> >> >> >> >> Hello, >> >> >> >> I would like some help to understand how the disk usage evolves when = I >> >> change the recordsize. >> >> >> >> I've read several articles/presentations/forums about recordsize in >> >> ZFS, and if I try to summarize, I mainly understood that: >> >> - recordsize is the "maximum" size of "objects" (so "logical blocks") >> >> that zfs will create for both -data & metadata, then each object is >> >> compressed and allocated to one vdev, splitted into smaller (ashift >> >> size) "physical" blocks and written on disks >> >> - increasing recordsize is usually good when storing large files that >> >> are not modified, because it limits the nb of metadata objects >> >> (block-pointers), which has a positive effect on performance >> >> - decreasing recordsize is useful for "databases-like" workloads (ie: >> >> small random writes inside existing objects), because it avoids write >> >> amplification (read-modify-write a large object for a small update) >> >> >> >> Today, I'm trying to observe the effect of increasing recordsize for >> >> *my* data (because I'm also considering defining special_small_blocks >> >> & using SSDs as "special", but not tested nor discussed here, just >> >> recordsize). >> >> So, I'm doing some benchmarks on my "documents" dataset (details in >> >> "notes" below), but the results are really strange to me. >> >> >> >> When I rsync the same data to a freshly-recreated zpool: >> >> A) with recordsize=3D128K : 226G allocated on disk >> >> B) with recordsize=3D1M : 232G allocated on disk =3D> bigger than 128= K ?!? >> >> >> >> I would clearly expect the other way around, because bigger recordsiz= e >> >> generates less metadata so smaller disk usage, and there shouldn't be >> >> any overhead because 1M is just a maximum and not a forced size to >> >> allocate for every object. >> >> A common misconception. The 1M recordsize applies to every newly >> created object, and every object must use the same size for all of its >> records (except possibly the last one). But objects created before >> you changed the recsize will retain their old recsize, file tails have >> a flexible recsize. >> >> >> I don't mind the increased usage (I can live with a few GB more), but >> >> I would like to understand why it happens. >> >> You might be seeing the effects of sparsity. ZFS is smart enough not >> to store file holes (and if any kind of compression is enabled, it >> will find long runs of zeroes and turn them into holes). If your data >> contains any holes that are >=3D 128 kB but < 1MB, then they can be >> stored as holes with a 128 kB recsize but must be stored as long runs >> of zeros with a 1MB recsize. >> >> However, I would suggest that you don't bother. With a 128kB recsize, >> ZFS has something like a 1000:1 ratio of data:metadata. In other >> words, increasing your recsize can save you at most 0.1% of disk >> space. Basically, it doesn't matter. What it _does_ matter for is >> the tradeoff between write amplification and RAM usage. 1000:1 is >> comparable to the disk:ram of many computers. And performance is more >> sensitive to metadata access times than data access times. So >> increasing your recsize can help you keep a greater fraction of your >> metadata in ARC. OTOH, as you remarked increasing your recsize will >> also increase write amplification. >> >> So to summarize: >> * Adjust compression settings to save disk space. >> * Adjust recsize to save RAM. >> >> -Alan >> >> >> >> >> I tried to give all the details of my tests below. >> >> Did I do something wrong ? Can you explain the increase ? >> >> >> >> Thanks ! >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> A) 128K >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> # zpool destroy bench >> >> # zpool create -o ashift=3D12 bench >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> >> [...] >> >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 byt= es/sec >> >> total size is 240,982,439,038 speedup is 1.00 >> >> >> >> # zfs get recordsize bench >> >> NAME PROPERTY VALUE SOURCE >> >> bench recordsize 128K default >> >> >> >> # zpool list -v bench >> >> NAME SIZE ALLOC FREE >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> >> bench 2.72T 226G 2.50T >> >> - - 0% 8% 1.00x ONLINE - >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T >> >> - - 0% 8.10% - ONLINE >> >> >> >> # zfs list bench >> >> NAME USED AVAIL REFER MOUNTPOINT >> >> bench 226G 2.41T 226G /bench >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" >> >> bench used 226G - >> >> bench referenced 226G - >> >> bench usedbysnapshots 0B - >> >> bench usedbydataset 226G - >> >> bench usedbychildren 1.80M - >> >> bench usedbyrefreservation 0B - >> >> bench written 226G - >> >> bench logicalused 226G - >> >> bench logicalreferenced 226G - >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> B) 1M >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> # zpool destroy bench >> >> # zpool create -o ashift=3D12 bench >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> >> # zfs set recordsize=3D1M bench >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> >> [...] >> >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 byt= es/sec >> >> total size is 240,982,439,038 speedup is 1.00 >> >> >> >> # zfs get recordsize bench >> >> NAME PROPERTY VALUE SOURCE >> >> bench recordsize 1M local >> >> >> >> # zpool list -v bench >> >> NAME SIZE ALLOC FREE >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> >> bench 2.72T 232G 2.49T >> >> - - 0% 8% 1.00x ONLINE - >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T >> >> - - 0% 8.32% - ONLINE >> >> >> >> # zfs list bench >> >> NAME USED AVAIL REFER MOUNTPOINT >> >> bench 232G 2.41T 232G /bench >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" >> >> bench used 232G - >> >> bench referenced 232G - >> >> bench usedbysnapshots 0B - >> >> bench usedbydataset 232G - >> >> bench usedbychildren 1.96M - >> >> bench usedbyrefreservation 0B - >> >> bench written 232G - >> >> bench logicalused 232G - >> >> bench logicalreferenced 232G - >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> Notes: >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> - the source dataset contains ~50% of pictures (raw files and jpg), >> >> and also some music, various archived documents, zip, videos >> >> - no change on the source dataset while testing (cf size logged by re= sync) >> >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and >> >> same results >> >> - probably not important here, but: >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset >> >> on another zpool that I never tweaked except ashit=3D12 (because usin= g >> >> the same model of Red 3TB) >> >> >> >> # zfs --version >> >> zfs-2.0.6-1 >> >> zfs-kmod-v2021120100-zfs_a8c7652 >> >> >> >> # uname -a >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 >> >> 75566f060d4(HEAD) TRUENAS amd64 From nobody Tue Jan 18 14:51:37 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D6C071969DED for ; Tue, 18 Jan 2022 14:51:47 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x932.google.com (mail-ua1-x932.google.com [IPv6:2607:f8b0:4864:20::932]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdWv70cdNz4qZs; Tue, 18 Jan 2022 14:51:47 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x932.google.com with SMTP id y4so37227281uad.1; Tue, 18 Jan 2022 06:51:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=gJTKL/DTxFqQwkifL89KpGBYEhgNoBFwKYbccBzfjTg=; b=Vj4M+5P37PAXAnXjsPa//xjPOZ/TCctB5y9X9g5fo/aHO5qyddYRvBTNHLqT8YKW1E 6bqCOXoAm5M0E3m5c0rFwuuxkLRorllzVdiR5jlIpJo3KmQq+Z5KSJDAhLN2uKSj37nR 1/3TrsV5Ho2alOD0PLLTn0RjsgN/UxQko+T7BaPdb0i+yj3EoOtzRrvckErrbLN1ekJE 1i0Xzk5QKo3k9NyQeN4T+vWY1dZwGjxPpgSGPGFhOC0Z2uJerCq667IUXL45TYZlbpmd k1GNA/f6Z6/OrdNHlm/4ZAvqa7pBaT5VRDTbQS9Cx9QFLI1sM8DeLAIlM3ITCbeFJLSb QKuA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=gJTKL/DTxFqQwkifL89KpGBYEhgNoBFwKYbccBzfjTg=; b=eujwEAOS1wBia5bIDVTu/qTt+7ouUsyK6TMDjbJ9mF16PAZqEGbcJ4SPdNONUi/dNg C46427F0G+2pgwuFj0WaX+UI+1ewjSlOe0T+mAFU64sA1YLKLZFtgKxUyBio9K6Ga4bm 6I0vKwNgGIozFYKLZ8JWhzkWGmDioLdMz+4J35jeUDLO2Xt7uUzELCkWAvO+4s0Cl1aP cVUAMyaWl4tvN0Zk8E4Oa6BlwITVV/rN7Vzyd87GLvxhqte78EwqYHWk8HjIO4P+JCXF Ee+fWK0ocGKQM/wr60ruUFGtO/g07vZ8WMykKUd5bp0UaESccee+u1IWX0sga+U2Pkiq RJaA== X-Gm-Message-State: AOAM532wWRWujOlRGG2gE2ZWakBuG0soGfaH2o2u1NjDpEwagRWckqTZ XLoPefUg8XOf6TlQDIa22ht2vi/qFvz5L8EMUdfpt7CHRDw= X-Google-Smtp-Source: ABdhPJyHBU56p6KdJ3Y6rBsZlpkUKYAOCpgQfacgYcKiSj+Q5PYYWwNvvY8y50lHf2gH4bkejlg90W3IdXzpd9oDx2Q= X-Received: by 2002:ab0:710d:: with SMTP id x13mr1583233uan.111.1642517506461; Tue, 18 Jan 2022 06:51:46 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Tue, 18 Jan 2022 09:51:37 -0500 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Alan Somers Cc: Florent Rivoire , freebsd-fs Content-Type: multipart/alternative; boundary="00000000000082918105d5dc68dc" X-Rspamd-Queue-Id: 4JdWv70cdNz4qZs X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Vj4M+5P3; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::932 as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-3.96 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::932:from]; NEURAL_HAM_SHORT(-0.96)[-0.955]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000082918105d5dc68dc Content-Type: text/plain; charset="UTF-8" 2.1M /workspace/test1M/1 - Rich On Tue, Jan 18, 2022 at 9:47 AM Alan Somers wrote: > Yeah, it does. Just check "du -sh ". zdb there is showing > you the logical size of the record, but it isn't showing how many disk > blocks are actually allocated. > > On Tue, Jan 18, 2022 at 7:30 AM Rich wrote: > > > > Really? I didn't know it would still trim the tails on files with > compression off. > > > > ... > > > > size 1179648 > > parent 34 > > links 1 > > pflags 40800000004 > > Indirect blocks: > > 0 L1 DVA[0]=<3:c02b96c000:1000> > DVA[1]=<3:c810733000:1000> [L1 ZFS plain file] skein lz4 unencrypted LE > contiguous unique double size=20000L/1000P birth=35675472L/35675472P fill=2 > cksum=5cfba24b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 > > 0 L0 DVA[0]=<2:a0827db4000:100000> [L0 ZFS plain file] > skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=95b06edf60e5f54c:af6f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360 > > 100000 L0 DVA[0]=<2:a0827eb4000:100000> [L0 ZFS plain file] > skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 > > > > It seems not? > > > > - Rich > > > > > > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers wrote: > >> > >> On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: > >> > > >> > Compression would have made your life better here, and possibly also > made it clearer what's going on. > >> > > >> > All records in a file are going to be the same size pre-compression - > so if you set the recordsize to 1M and save a 131.1M file, it's going to > take up 132M on disk before compression/raidz overhead/whatnot. > >> > >> Not true. ZFS will trim the file's tails even without compression > enabled. > >> > >> > > >> > Usually compression saves you from the tail padding actually > requiring allocation on disk, which is one reason I encourage everyone to > at least use lz4 (or, if you absolutely cannot for some reason, I guess zle > should also work for this one case...) > >> > > >> > But I would say it's probably the sum of last record padding across > the whole dataset, if you don't have compression on. > >> > > >> > - Rich > >> > > >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire > wrote: > >> >> > >> >> TLDR: I rsync-ed the same data twice: once with 128K recordsize and > >> >> once with 1M, and the allocated size on disk is ~3% bigger with 1M. > >> >> Why not smaller ? > >> >> > >> >> > >> >> Hello, > >> >> > >> >> I would like some help to understand how the disk usage evolves when > I > >> >> change the recordsize. > >> >> > >> >> I've read several articles/presentations/forums about recordsize in > >> >> ZFS, and if I try to summarize, I mainly understood that: > >> >> - recordsize is the "maximum" size of "objects" (so "logical blocks") > >> >> that zfs will create for both -data & metadata, then each object is > >> >> compressed and allocated to one vdev, splitted into smaller (ashift > >> >> size) "physical" blocks and written on disks > >> >> - increasing recordsize is usually good when storing large files that > >> >> are not modified, because it limits the nb of metadata objects > >> >> (block-pointers), which has a positive effect on performance > >> >> - decreasing recordsize is useful for "databases-like" workloads (ie: > >> >> small random writes inside existing objects), because it avoids write > >> >> amplification (read-modify-write a large object for a small update) > >> >> > >> >> Today, I'm trying to observe the effect of increasing recordsize for > >> >> *my* data (because I'm also considering defining special_small_blocks > >> >> & using SSDs as "special", but not tested nor discussed here, just > >> >> recordsize). > >> >> So, I'm doing some benchmarks on my "documents" dataset (details in > >> >> "notes" below), but the results are really strange to me. > >> >> > >> >> When I rsync the same data to a freshly-recreated zpool: > >> >> A) with recordsize=128K : 226G allocated on disk > >> >> B) with recordsize=1M : 232G allocated on disk => bigger than 128K > ?!? > >> >> > >> >> I would clearly expect the other way around, because bigger > recordsize > >> >> generates less metadata so smaller disk usage, and there shouldn't be > >> >> any overhead because 1M is just a maximum and not a forced size to > >> >> allocate for every object. > >> > >> A common misconception. The 1M recordsize applies to every newly > >> created object, and every object must use the same size for all of its > >> records (except possibly the last one). But objects created before > >> you changed the recsize will retain their old recsize, file tails have > >> a flexible recsize. > >> > >> >> I don't mind the increased usage (I can live with a few GB more), but > >> >> I would like to understand why it happens. > >> > >> You might be seeing the effects of sparsity. ZFS is smart enough not > >> to store file holes (and if any kind of compression is enabled, it > >> will find long runs of zeroes and turn them into holes). If your data > >> contains any holes that are >= 128 kB but < 1MB, then they can be > >> stored as holes with a 128 kB recsize but must be stored as long runs > >> of zeros with a 1MB recsize. > >> > >> However, I would suggest that you don't bother. With a 128kB recsize, > >> ZFS has something like a 1000:1 ratio of data:metadata. In other > >> words, increasing your recsize can save you at most 0.1% of disk > >> space. Basically, it doesn't matter. What it _does_ matter for is > >> the tradeoff between write amplification and RAM usage. 1000:1 is > >> comparable to the disk:ram of many computers. And performance is more > >> sensitive to metadata access times than data access times. So > >> increasing your recsize can help you keep a greater fraction of your > >> metadata in ARC. OTOH, as you remarked increasing your recsize will > >> also increase write amplification. > >> > >> So to summarize: > >> * Adjust compression settings to save disk space. > >> * Adjust recsize to save RAM. > >> > >> -Alan > >> > >> >> > >> >> I tried to give all the details of my tests below. > >> >> Did I do something wrong ? Can you explain the increase ? > >> >> > >> >> Thanks ! > >> >> > >> >> > >> >> > >> >> =============================================== > >> >> A) 128K > >> >> ========== > >> >> > >> >> # zpool destroy bench > >> >> # zpool create -o ashift=12 bench > >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> > >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> [...] > >> >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 > bytes/sec > >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> > >> >> # zfs get recordsize bench > >> >> NAME PROPERTY VALUE SOURCE > >> >> bench recordsize 128K default > >> >> > >> >> # zpool list -v bench > >> >> NAME SIZE ALLOC FREE > >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> bench 2.72T 226G 2.50T > >> >> - - 0% 8% 1.00x ONLINE - > >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T > >> >> - - 0% 8.10% - ONLINE > >> >> > >> >> # zfs list bench > >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> bench 226G 2.41T 226G /bench > >> >> > >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> bench used 226G - > >> >> bench referenced 226G - > >> >> bench usedbysnapshots 0B - > >> >> bench usedbydataset 226G - > >> >> bench usedbychildren 1.80M - > >> >> bench usedbyrefreservation 0B - > >> >> bench written 226G - > >> >> bench logicalused 226G - > >> >> bench logicalreferenced 226G - > >> >> > >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb > >> >> > >> >> > >> >> > >> >> =============================================== > >> >> B) 1M > >> >> ========== > >> >> > >> >> # zpool destroy bench > >> >> # zpool create -o ashift=12 bench > >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> # zfs set recordsize=1M bench > >> >> > >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> [...] > >> >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 > bytes/sec > >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> > >> >> # zfs get recordsize bench > >> >> NAME PROPERTY VALUE SOURCE > >> >> bench recordsize 1M local > >> >> > >> >> # zpool list -v bench > >> >> NAME SIZE ALLOC FREE > >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> bench 2.72T 232G 2.49T > >> >> - - 0% 8% 1.00x ONLINE - > >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T > >> >> - - 0% 8.32% - ONLINE > >> >> > >> >> # zfs list bench > >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> bench 232G 2.41T 232G /bench > >> >> > >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> bench used 232G - > >> >> bench referenced 232G - > >> >> bench usedbysnapshots 0B - > >> >> bench usedbydataset 232G - > >> >> bench usedbychildren 1.96M - > >> >> bench usedbyrefreservation 0B - > >> >> bench written 232G - > >> >> bench logicalused 232G - > >> >> bench logicalreferenced 232G - > >> >> > >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb > >> >> > >> >> > >> >> > >> >> =============================================== > >> >> Notes: > >> >> ========== > >> >> > >> >> - the source dataset contains ~50% of pictures (raw files and jpg), > >> >> and also some music, various archived documents, zip, videos > >> >> - no change on the source dataset while testing (cf size logged by > resync) > >> >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), and > >> >> same results > >> >> - probably not important here, but: > >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR > >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize dataset > >> >> on another zpool that I never tweaked except ashit=12 (because using > >> >> the same model of Red 3TB) > >> >> > >> >> # zfs --version > >> >> zfs-2.0.6-1 > >> >> zfs-kmod-v2021120100-zfs_a8c7652 > >> >> > >> >> # uname -a > >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 > >> >> 75566f060d4(HEAD) TRUENAS amd64 > --00000000000082918105d5dc68dc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
2.1M =C2=A0 =C2=A0/workspace/test1M/1

- Rich

On Tue, Jan 18, 2022 at 9:47 AM Alan Somers <asomers@freebsd.org> wrote:
Yeah, it does.=C2=A0 Just ch= eck "du -sh <FILENAME>".=C2=A0 zdb there is showing
you the logical size of the record, but it isn't showing how many disk<= br> blocks are actually allocated.

On Tue, Jan 18, 2022 at 7:30 AM Rich <rincebrain@gmail.com> wrote:
>
> Really? I didn't know it would still trim the tails on files with = compression off.
>
> ...
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0size=C2=A0 =C2=A0 1179648
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0parent=C2=A0 34
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0links=C2=A0 =C2=A01
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pflags=C2=A0 40800000004
> Indirect blocks:
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 L1=C2=A0 DVA[= 0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c810733000:1000> [L1 ZFS p= lain file] skein lz4 unencrypted LE contiguous unique double size=3D20000L/= 1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba24b351a09aa:8bd9dfe= f87c5b625:906ed5c3252943db:bed77ce51ad540d4
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0=C2=A0 L0 DVA[= 0]=3D<2:a0827db4000:100000> [L0 ZFS plain file] skein uncompressed un= encrypted LE contiguous unique single size=3D100000L/100000P birth=3D356754= 72L/35675472P fill=3D1 cksum=3D95b06edf60e5f54c:af6f6950775d0863:8fc28b0783= fcd9d3:2e44676e48a59360
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0100000=C2=A0 L0 DVA[0]=3D<2= :a0827eb4000:100000> [L0 ZFS plain file] skein uncompressed unencrypted = LE contiguous unique single size=3D100000L/100000P birth=3D35675472L/356754= 72P fill=3D1 cksum=3D62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390= bddc4314cd4c3
>
> It seems not?
>
> - Rich
>
>
> On Tue, Jan 18, 2022 at 9:23 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Tue, Jan 18, 2022 at 7:13 AM Rich <rincebrain@gmail.com> wrote:
>> >
>> > Compression would have made your life better here, and possib= ly also made it clearer what's going on.
>> >
>> > All records in a file are going to be the same size pre-compr= ession - so if you set the recordsize to 1M and save a 131.1M file, it'= s going to take up 132M on disk before compression/raidz overhead/whatnot.<= br> >>
>> Not true.=C2=A0 ZFS will trim the file's tails even without co= mpression enabled.
>>
>> >
>> > Usually compression saves you from the tail padding actually = requiring allocation on disk, which is one reason I encourage everyone to a= t least use lz4 (or, if you absolutely cannot for some reason, I guess zle = should also work for this one case...)
>> >
>> > But I would say it's probably the sum of last record padd= ing across the whole dataset, if you don't have compression on.
>> >
>> > - Rich
>> >
>> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire <florent@rivoire.fr>= wrote:
>> >>
>> >> TLDR: I rsync-ed the same data twice: once with 128K reco= rdsize and
>> >> once with 1M, and the allocated size on disk is ~3% bigge= r with 1M.
>> >> Why not smaller ?
>> >>
>> >>
>> >> Hello,
>> >>
>> >> I would like some help to understand how the disk usage e= volves when I
>> >> change the recordsize.
>> >>
>> >> I've read several articles/presentations/forums about= recordsize in
>> >> ZFS, and if I try to summarize, I mainly understood that:=
>> >> - recordsize is the "maximum" size of "obj= ects" (so "logical blocks")
>> >> that zfs will create for both=C2=A0 -data & metadata,= then each object is
>> >> compressed and allocated to one vdev, splitted into small= er (ashift
>> >> size) "physical" blocks and written on disks >> >> - increasing recordsize is usually good when storing larg= e files that
>> >> are not modified, because it limits the nb of metadata ob= jects
>> >> (block-pointers), which has a positive effect on performa= nce
>> >> - decreasing recordsize is useful for "databases-lik= e" workloads (ie:
>> >> small random writes inside existing objects), because it = avoids write
>> >> amplification (read-modify-write a large object for a sma= ll update)
>> >>
>> >> Today, I'm trying to observe the effect of increasing= recordsize for
>> >> *my* data (because I'm also considering defining spec= ial_small_blocks
>> >> & using SSDs as "special", but not tested n= or discussed here, just
>> >> recordsize).
>> >> So, I'm doing some benchmarks on my "documents&q= uot; dataset (details in
>> >> "notes" below), but the results are really stra= nge to me.
>> >>
>> >> When I rsync the same data to a freshly-recreated zpool:<= br> >> >> A) with recordsize=3D128K : 226G allocated on disk
>> >> B) with recordsize=3D1M : 232G allocated on disk =3D> = bigger than 128K ?!?
>> >>
>> >> I would clearly expect the other way around, because bigg= er recordsize
>> >> generates less metadata so smaller disk usage, and there = shouldn't be
>> >> any overhead because 1M is just a maximum and not a force= d size to
>> >> allocate for every object.
>>
>> A common misconception.=C2=A0 The 1M recordsize applies to every n= ewly
>> created object, and every object must use the same size for all of= its
>> records (except possibly the last one).=C2=A0 But objects created = before
>> you changed the recsize will retain their old recsize, file tails = have
>> a flexible recsize.
>>
>> >> I don't mind the increased usage (I can live with a f= ew GB more), but
>> >> I would like to understand why it happens.
>>
>> You might be seeing the effects of sparsity.=C2=A0 ZFS is smart en= ough not
>> to store file holes (and if any kind of compression is enabled, it=
>> will find long runs of zeroes and turn them into holes).=C2=A0 If = your data
>> contains any holes that are >=3D 128 kB but < 1MB, then they= can be
>> stored as holes with a 128 kB recsize but must be stored as long r= uns
>> of zeros with a 1MB recsize.
>>
>> However, I would suggest that you don't bother.=C2=A0 With a 1= 28kB recsize,
>> ZFS has something like a 1000:1 ratio of data:metadata.=C2=A0 In o= ther
>> words, increasing your recsize can save you at most 0.1% of disk >> space.=C2=A0 Basically, it doesn't matter.=C2=A0 What it _does= _ matter for is
>> the tradeoff between write amplification and RAM usage.=C2=A0 1000= :1 is
>> comparable to the disk:ram of many computers.=C2=A0 And performanc= e is more
>> sensitive to metadata access times than data access times.=C2=A0 S= o
>> increasing your recsize can help you keep a greater fraction of yo= ur
>> metadata in ARC.=C2=A0 OTOH, as you remarked increasing your recsi= ze will
>> also increase write amplification.
>>
>> So to summarize:
>> * Adjust compression settings to save disk space.
>> * Adjust recsize to save RAM.
>>
>> -Alan
>>
>> >>
>> >> I tried to give all the details of my tests below.
>> >> Did I do something wrong ? Can you explain the increase ?=
>> >>
>> >> Thanks !
>> >>
>> >>
>> >>
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
>> >> A) 128K
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >>
>> >> # zpool destroy bench
>> >> # zpool create -o ashift=3D12 bench
>> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
>> >>
>> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-flore= nt/ /bench
>> >> [...]
>> >> sent 241,042,476,154 bytes=C2=A0 received 353,838 bytes= =C2=A0 81,806,492.45 bytes/sec
>> >> total size is 240,982,439,038=C2=A0 speedup is 1.00
>> >>
>> >> # zfs get recordsize bench
>> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0= SOURCE
>> >> bench=C2=A0 recordsize=C2=A0 128K=C2=A0 =C2=A0 =C2=A0defa= ult
>> >>
>> >> # zpool list -v bench
>> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP= =C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 = =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0= -
>> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2= =A0 2.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 = =C2=A0 =C2=A00%=C2=A0 8.10%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE
>> >>
>> >> # zfs list bench
>> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REF= ER=C2=A0 MOUNTPOINT
>> >> bench=C2=A0 =C2=A0226G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 22= 6G=C2=A0 /bench
>> >>
>> >> # zfs get all bench |egrep "(used|referenced|written= )"
>> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
>> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.8= 0M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
>> >> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
>> >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0226G=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >>
>> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb
>> >>
>> >>
>> >>
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
>> >> B) 1M
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >>
>> >> # zpool destroy bench
>> >> # zpool create -o ashift=3D12 bench
>> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4
>> >> # zfs set recordsize=3D1M bench
>> >>
>> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-flore= nt/ /bench
>> >> [...]
>> >> sent 241,042,476,154 bytes=C2=A0 received 353,830 bytes= =C2=A0 80,173,899.88 bytes/sec
>> >> total size is 240,982,439,038=C2=A0 speedup is 1.00
>> >>
>> >> # zfs get recordsize bench
>> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0= SOURCE
>> >> bench=C2=A0 recordsize=C2=A0 1M=C2=A0 =C2=A0 =C2=A0 =C2= =A0local
>> >>
>> >> # zpool list -v bench
>> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 =C2=A0 CAP= =C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 = =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLINE=C2=A0= -
>> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4=C2= =A0 2.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 = =C2=A0 =C2=A00%=C2=A0 8.32%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLINE
>> >>
>> >> # zfs list bench
>> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 =C2=A0REF= ER=C2=A0 MOUNTPOINT
>> >> bench=C2=A0 =C2=A0232G=C2=A0 2.41T=C2=A0 =C2=A0 =C2=A0 23= 2G=C2=A0 /bench
>> >>
>> >> # zfs get all bench |egrep "(used|referenced|written= )"
>> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
>> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 1.9= 6M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
>> >> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
>> >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A0232G=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >>
>> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb
>> >>
>> >>
>> >>
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
>> >> Notes:
>> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >>
>> >> - the source dataset contains ~50% of pictures (raw files= and jpg),
>> >> and also some music, various archived documents, zip, vid= eos
>> >> - no change on the source dataset while testing (cf size = logged by resync)
>> >> - I repeated the tests twice (128K, then 1M, then 128K, t= hen 1M), and
>> >> same results
>> >> - probably not important here, but:
>> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red = 3TB CMR
>> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-records= ize dataset
>> >> on another zpool that I never tweaked except ashit=3D12 (= because using
>> >> the same model of Red 3TB)
>> >>
>> >> # zfs --version
>> >> zfs-2.0.6-1
>> >> zfs-kmod-v2021120100-zfs_a8c7652
>> >>
>> >> # uname -a
>> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p= 11
>> >> 75566f060d4(HEAD) TRUENAS=C2=A0 amd64
--00000000000082918105d5dc68dc-- From nobody Tue Jan 18 15:00:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2DC06196E8C5 for ; Tue, 18 Jan 2022 15:00:26 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f46.google.com (mail-ot1-f46.google.com [209.85.210.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdX552znWz4t3t for ; Tue, 18 Jan 2022 15:00:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f46.google.com with SMTP id 60-20020a9d0142000000b0059103eb18d4so24505677otu.2 for ; Tue, 18 Jan 2022 07:00:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=qHFMk/fv80u00cyb89XeyyZxh6WMLGkGGKE5Rs0JIAw=; b=j37nXbCipoyTF+EnaIxoVGoLR7turuTL5xycDvSWfNNKay3RJpuaGC0jaLFZmCUQM0 tOVsxU83Sf9YZXkWPtc+IqhKFCpqoKioH2i4ZpPoT2BZvIwGa3e8Zn62KYmbM5KdPxez WltmX55eKlOrZKsYegrwPZRJ4BB/wpU8PbAOcalLmWZe2YwkzGZlHmGDa7prCQxz+771 z52GebeRE/TraMNS/Sr7hJuhmX3hFNZjlckISn98ufrsgBht8t89RnFvDFv/TnOBPtGi O1sS/hlLk/0tHFO6QaPURbi8QtnF1O4E8p6WvcnA30pvnXhGkhBXrS9B/vJVJ4ADZAEu C2Vg== X-Gm-Message-State: AOAM5322DaYPpnxpSFjUfggc4LVpcJShOSdwPYdQaT4c9aPG/oQW39X7 qmGnTZ4xmnew5X+Ou8fv63pmGK48YEOxoW5riPw= X-Google-Smtp-Source: ABdhPJzwtpHcWvCY8BWnMGQps2vpPI+JM/BMeetuMV8otIPRXmgmFu6EZF1LIONhar4vbiWZpcFb+YlF2gnHiCHU3Hs= X-Received: by 2002:a05:6830:1389:: with SMTP id d9mr15998638otq.114.1642518019128; Tue, 18 Jan 2022 07:00:19 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 18 Jan 2022 08:00:08 -0700 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Rich Cc: Florent Rivoire , freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4JdX552znWz4t3t X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.46 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [0.92 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.46:from]; NEURAL_SPAM_MEDIUM(0.92)[0.922]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_SPAM_LONG(1.00)[0.998]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.46:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N That's not what I get. Is your pool formatted using a very old version or something? somers@fbsd-head /u/h/somers [1]> dd if=3D/dev/random bs=3D1179648 of=3D/testpool/food/t/richfile count=3D1 1+0 records in 1+0 records out 1179648 bytes transferred in 0.003782 secs (311906705 bytes/sec) somers@fbsd-head /u/h/somers> du -sh /testpool/food/t/richfile 1.1M /testpool/food/t/richfile On Tue, Jan 18, 2022 at 7:51 AM Rich wrote: > > 2.1M /workspace/test1M/1 > > - Rich > > On Tue, Jan 18, 2022 at 9:47 AM Alan Somers wrote: >> >> Yeah, it does. Just check "du -sh ". zdb there is showing >> you the logical size of the record, but it isn't showing how many disk >> blocks are actually allocated. >> >> On Tue, Jan 18, 2022 at 7:30 AM Rich wrote: >> > >> > Really? I didn't know it would still trim the tails on files with comp= ression off. >> > >> > ... >> > >> > size 1179648 >> > parent 34 >> > links 1 >> > pflags 40800000004 >> > Indirect blocks: >> > 0 L1 DVA[0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c8107330= 00:1000> [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique dou= ble size=3D20000L/1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba2= 4b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 >> > 0 L0 DVA[0]=3D<2:a0827db4000:100000> [L0 ZFS plain fil= e] skein uncompressed unencrypted LE contiguous unique single size=3D100000= L/100000P birth=3D35675472L/35675472P fill=3D1 cksum=3D95b06edf60e5f54c:af6= f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360 >> > 100000 L0 DVA[0]=3D<2:a0827eb4000:100000> [L0 ZFS plain fil= e] skein uncompressed unencrypted LE contiguous unique single size=3D100000= L/100000P birth=3D35675472L/35675472P fill=3D1 cksum=3D62a1f05769528648:819= 7c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 >> > >> > It seems not? >> > >> > - Rich >> > >> > >> > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers wrot= e: >> >> >> >> On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: >> >> > >> >> > Compression would have made your life better here, and possibly als= o made it clearer what's going on. >> >> > >> >> > All records in a file are going to be the same size pre-compression= - so if you set the recordsize to 1M and save a 131.1M file, it's going to= take up 132M on disk before compression/raidz overhead/whatnot. >> >> >> >> Not true. ZFS will trim the file's tails even without compression en= abled. >> >> >> >> > >> >> > Usually compression saves you from the tail padding actually requir= ing allocation on disk, which is one reason I encourage everyone to at leas= t use lz4 (or, if you absolutely cannot for some reason, I guess zle should= also work for this one case...) >> >> > >> >> > But I would say it's probably the sum of last record padding across= the whole dataset, if you don't have compression on. >> >> > >> >> > - Rich >> >> > >> >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire wrote: >> >> >> >> >> >> TLDR: I rsync-ed the same data twice: once with 128K recordsize an= d >> >> >> once with 1M, and the allocated size on disk is ~3% bigger with 1M= . >> >> >> Why not smaller ? >> >> >> >> >> >> >> >> >> Hello, >> >> >> >> >> >> I would like some help to understand how the disk usage evolves wh= en I >> >> >> change the recordsize. >> >> >> >> >> >> I've read several articles/presentations/forums about recordsize i= n >> >> >> ZFS, and if I try to summarize, I mainly understood that: >> >> >> - recordsize is the "maximum" size of "objects" (so "logical block= s") >> >> >> that zfs will create for both -data & metadata, then each object = is >> >> >> compressed and allocated to one vdev, splitted into smaller (ashif= t >> >> >> size) "physical" blocks and written on disks >> >> >> - increasing recordsize is usually good when storing large files t= hat >> >> >> are not modified, because it limits the nb of metadata objects >> >> >> (block-pointers), which has a positive effect on performance >> >> >> - decreasing recordsize is useful for "databases-like" workloads (= ie: >> >> >> small random writes inside existing objects), because it avoids wr= ite >> >> >> amplification (read-modify-write a large object for a small update= ) >> >> >> >> >> >> Today, I'm trying to observe the effect of increasing recordsize f= or >> >> >> *my* data (because I'm also considering defining special_small_blo= cks >> >> >> & using SSDs as "special", but not tested nor discussed here, just >> >> >> recordsize). >> >> >> So, I'm doing some benchmarks on my "documents" dataset (details i= n >> >> >> "notes" below), but the results are really strange to me. >> >> >> >> >> >> When I rsync the same data to a freshly-recreated zpool: >> >> >> A) with recordsize=3D128K : 226G allocated on disk >> >> >> B) with recordsize=3D1M : 232G allocated on disk =3D> bigger than = 128K ?!? >> >> >> >> >> >> I would clearly expect the other way around, because bigger record= size >> >> >> generates less metadata so smaller disk usage, and there shouldn't= be >> >> >> any overhead because 1M is just a maximum and not a forced size to >> >> >> allocate for every object. >> >> >> >> A common misconception. The 1M recordsize applies to every newly >> >> created object, and every object must use the same size for all of it= s >> >> records (except possibly the last one). But objects created before >> >> you changed the recsize will retain their old recsize, file tails hav= e >> >> a flexible recsize. >> >> >> >> >> I don't mind the increased usage (I can live with a few GB more), = but >> >> >> I would like to understand why it happens. >> >> >> >> You might be seeing the effects of sparsity. ZFS is smart enough not >> >> to store file holes (and if any kind of compression is enabled, it >> >> will find long runs of zeroes and turn them into holes). If your dat= a >> >> contains any holes that are >=3D 128 kB but < 1MB, then they can be >> >> stored as holes with a 128 kB recsize but must be stored as long runs >> >> of zeros with a 1MB recsize. >> >> >> >> However, I would suggest that you don't bother. With a 128kB recsize= , >> >> ZFS has something like a 1000:1 ratio of data:metadata. In other >> >> words, increasing your recsize can save you at most 0.1% of disk >> >> space. Basically, it doesn't matter. What it _does_ matter for is >> >> the tradeoff between write amplification and RAM usage. 1000:1 is >> >> comparable to the disk:ram of many computers. And performance is mor= e >> >> sensitive to metadata access times than data access times. So >> >> increasing your recsize can help you keep a greater fraction of your >> >> metadata in ARC. OTOH, as you remarked increasing your recsize will >> >> also increase write amplification. >> >> >> >> So to summarize: >> >> * Adjust compression settings to save disk space. >> >> * Adjust recsize to save RAM. >> >> >> >> -Alan >> >> >> >> >> >> >> >> I tried to give all the details of my tests below. >> >> >> Did I do something wrong ? Can you explain the increase ? >> >> >> >> >> >> Thanks ! >> >> >> >> >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> A) 128K >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> >> >> # zpool destroy bench >> >> >> # zpool create -o ashift=3D12 bench >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> >> >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> >> >> [...] >> >> >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 = bytes/sec >> >> >> total size is 240,982,439,038 speedup is 1.00 >> >> >> >> >> >> # zfs get recordsize bench >> >> >> NAME PROPERTY VALUE SOURCE >> >> >> bench recordsize 128K default >> >> >> >> >> >> # zpool list -v bench >> >> >> NAME SIZE ALLOC FREE >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> >> >> bench 2.72T 226G 2.50T >> >> >> - - 0% 8% 1.00x ONLINE - >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T >> >> >> - - 0% 8.10% - ONLINE >> >> >> >> >> >> # zfs list bench >> >> >> NAME USED AVAIL REFER MOUNTPOINT >> >> >> bench 226G 2.41T 226G /bench >> >> >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" >> >> >> bench used 226G - >> >> >> bench referenced 226G - >> >> >> bench usedbysnapshots 0B - >> >> >> bench usedbydataset 226G - >> >> >> bench usedbychildren 1.80M - >> >> >> bench usedbyrefreservation 0B - >> >> >> bench written 226G - >> >> >> bench logicalused 226G - >> >> >> bench logicalreferenced 226G - >> >> >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb >> >> >> >> >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> B) 1M >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> >> >> # zpool destroy bench >> >> >> # zpool create -o ashift=3D12 bench >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 >> >> >> # zfs set recordsize=3D1M bench >> >> >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench >> >> >> [...] >> >> >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 = bytes/sec >> >> >> total size is 240,982,439,038 speedup is 1.00 >> >> >> >> >> >> # zfs get recordsize bench >> >> >> NAME PROPERTY VALUE SOURCE >> >> >> bench recordsize 1M local >> >> >> >> >> >> # zpool list -v bench >> >> >> NAME SIZE ALLOC FREE >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >> >> >> bench 2.72T 232G 2.49T >> >> >> - - 0% 8% 1.00x ONLINE - >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T >> >> >> - - 0% 8.32% - ONLINE >> >> >> >> >> >> # zfs list bench >> >> >> NAME USED AVAIL REFER MOUNTPOINT >> >> >> bench 232G 2.41T 232G /bench >> >> >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" >> >> >> bench used 232G - >> >> >> bench referenced 232G - >> >> >> bench usedbysnapshots 0B - >> >> >> bench usedbydataset 232G - >> >> >> bench usedbychildren 1.96M - >> >> >> bench usedbyrefreservation 0B - >> >> >> bench written 232G - >> >> >> bench logicalused 232G - >> >> >> bench logicalreferenced 232G - >> >> >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb >> >> >> >> >> >> >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> Notes: >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> >> >> - the source dataset contains ~50% of pictures (raw files and jpg)= , >> >> >> and also some music, various archived documents, zip, videos >> >> >> - no change on the source dataset while testing (cf size logged by= resync) >> >> >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), = and >> >> >> same results >> >> >> - probably not important here, but: >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR >> >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize datas= et >> >> >> on another zpool that I never tweaked except ashit=3D12 (because u= sing >> >> >> the same model of Red 3TB) >> >> >> >> >> >> # zfs --version >> >> >> zfs-2.0.6-1 >> >> >> zfs-kmod-v2021120100-zfs_a8c7652 >> >> >> >> >> >> # uname -a >> >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 >> >> >> 75566f060d4(HEAD) TRUENAS amd64 From nobody Tue Jan 18 15:07:25 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 634991953C5B for ; Tue, 18 Jan 2022 15:07:36 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x92a.google.com (mail-ua1-x92a.google.com [IPv6:2607:f8b0:4864:20::92a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdXFM5mp5z3CTq; Tue, 18 Jan 2022 15:07:35 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x92a.google.com with SMTP id m90so37369646uam.2; Tue, 18 Jan 2022 07:07:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=MD+7/nUPTBqd2fl3JnUX5vhPxINtKL/0cbasprkRb14=; b=eEt9/JGVBFiNB0IEXdffjVdYe430Zy61l1MOaAw+3urBfiNPzTB22no62dyxas0OQf VI5egyxkbakPuUbduUc1+F+ZUkKeL6EQl+hcIvii5V9mmyWaAYO+HYybqgPQ+A2WdTRq bEY2bSOjCbYBaXCUxgj63QcvLruNGawtt+Y8h0DbfxiF7b5ktPWWGW8U3rK3KiJ0GIwZ RmdJoNVzUT09Z0lyYRywiLSkBKyMuQEODjSX+QQhQwvfC60f2nlyZHLepIIoWWD7wkOn p9df6reFYr3xpTkhyl8hEnuzs4XtsaRyw0MIkKKcG3uAsFXwxpwQGFsFF6qIGLLw4x1l Y0kQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=MD+7/nUPTBqd2fl3JnUX5vhPxINtKL/0cbasprkRb14=; b=OwDx/QfofJ3QpATYgHVnds7WyP+I08BOeuKstC6CSgNkHjLBL7KUTpUQNwDD3HnGAk 0Rk9xmGfZuBH/OeCBlUB5nqFjZ8zgBClyMMOQ2q/D/WuGj+EMgAvG7a+uPiYe7vpqdkr kL+8wNI4wE3ivMwB7LJjrarYKgdWUkQfMPUlN60dusl39oxcvyO426kwcf4DKr1bvHrx HvuSkabM0hH7Hc3J7gS7GMsIp0n4IdTx0oLM9PMn2kiFY2rcMHlPI4qVlq5PZaYADhZh BbgsYueoFOU/Nj3JzTlrvvbotTLcwIelLRO2hqzeKbgMMUgzRvyKmRXWF9fsuz48XE45 efWw== X-Gm-Message-State: AOAM5333XA7D6Iv3Ll7vf1FKac6WABQS336jBcCBEL/504FEYtY3aZ/R NvanubHRXrALjRnhpnOp/GFyqdEiTDiWCq/3NZqHLMUxM5o= X-Google-Smtp-Source: ABdhPJy8nlCLSCohe0L9/2RCSwcFgAbmE1NJ3GIr/mKra3XzmQZxjmVzy8G1CEqEhLcmQTFjzRyfbz9S8iGSge3Im00= X-Received: by 2002:a1f:c18c:: with SMTP id r134mr1469815vkf.6.1642518454332; Tue, 18 Jan 2022 07:07:34 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Tue, 18 Jan 2022 10:07:25 -0500 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Alan Somers Cc: Florent Rivoire , freebsd-fs Content-Type: multipart/alternative; boundary="00000000000001f4cb05d5dca1eb" X-Rspamd-Queue-Id: 4JdXFM5mp5z3CTq X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="eEt9/JGV"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::92a as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-3.98 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::92a:from]; NEURAL_HAM_SHORT(-0.98)[-0.982]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000001f4cb05d5dca1eb Content-Type: text/plain; charset="UTF-8" Nope. I just retried it on my FBSD 13-RELEASE VM, too: # uname -a FreeBSD fbsd13rel 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #0: Tue Aug 24 07:33:27 UTC 2021 root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 # zpool version zfs-2.1.99-683_ga967e54c2 zfs-kmod-2.1.99-683_ga967e54c2 # zpool get all | grep 'feature@' | grep disabled buildpool feature@edonr disabled local # dd if=/dev/urandom of=/buildpool/testme/2 bs=1179648 count=1 1+0 records in 1+0 records out 1179648 bytes transferred in 0.009827 secs (120041885 bytes/sec) # du -sh /buildpool/testme/2 2.0M /buildpool/testme/2 # zfs get all buildpool/testme | grep -v default NAME PROPERTY VALUE SOURCE buildpool/testme type filesystem - buildpool/testme creation Tue Jan 18 4:46 2022 - buildpool/testme used 4.03M - buildpool/testme available 277G - buildpool/testme referenced 4.03M - buildpool/testme compressratio 1.00x - buildpool/testme mounted yes - buildpool/testme recordsize 1M local buildpool/testme compression off local buildpool/testme atime off inherited from buildpool buildpool/testme createtxg 15030 - buildpool/testme version 5 - buildpool/testme utf8only off - buildpool/testme normalization none - buildpool/testme casesensitivity sensitive - buildpool/testme guid 11057815587819738755 - buildpool/testme usedbysnapshots 0B - buildpool/testme usedbydataset 4.03M - buildpool/testme usedbychildren 0B - buildpool/testme usedbyrefreservation 0B - buildpool/testme objsetid 280 - buildpool/testme refcompressratio 1.00x - buildpool/testme written 4.03M - buildpool/testme logicalused 4.01M - buildpool/testme logicalreferenced 4.01M - What version are you running? - Rich On Tue, Jan 18, 2022 at 10:00 AM Alan Somers wrote: > That's not what I get. Is your pool formatted using a very old > version or something? > > somers@fbsd-head /u/h/somers [1]> > dd if=/dev/random bs=1179648 of=/testpool/food/t/richfile count=1 > 1+0 records in > 1+0 records out > 1179648 bytes transferred in 0.003782 secs (311906705 bytes/sec) > somers@fbsd-head /u/h/somers> du -sh /testpool/food/t/richfile > 1.1M /testpool/food/t/richfile > > On Tue, Jan 18, 2022 at 7:51 AM Rich wrote: > > > > 2.1M /workspace/test1M/1 > > > > - Rich > > > > On Tue, Jan 18, 2022 at 9:47 AM Alan Somers wrote: > >> > >> Yeah, it does. Just check "du -sh ". zdb there is showing > >> you the logical size of the record, but it isn't showing how many disk > >> blocks are actually allocated. > >> > >> On Tue, Jan 18, 2022 at 7:30 AM Rich wrote: > >> > > >> > Really? I didn't know it would still trim the tails on files with > compression off. > >> > > >> > ... > >> > > >> > size 1179648 > >> > parent 34 > >> > links 1 > >> > pflags 40800000004 > >> > Indirect blocks: > >> > 0 L1 DVA[0]=<3:c02b96c000:1000> > DVA[1]=<3:c810733000:1000> [L1 ZFS plain file] skein lz4 unencrypted LE > contiguous unique double size=20000L/1000P birth=35675472L/35675472P fill=2 > cksum=5cfba24b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 > >> > 0 L0 DVA[0]=<2:a0827db4000:100000> [L0 ZFS plain > file] skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=95b06edf60e5f54c:af6f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360 > >> > 100000 L0 DVA[0]=<2:a0827eb4000:100000> [L0 ZFS plain > file] skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 > >> > > >> > It seems not? > >> > > >> > - Rich > >> > > >> > > >> > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers > wrote: > >> >> > >> >> On Tue, Jan 18, 2022 at 7:13 AM Rich wrote: > >> >> > > >> >> > Compression would have made your life better here, and possibly > also made it clearer what's going on. > >> >> > > >> >> > All records in a file are going to be the same size > pre-compression - so if you set the recordsize to 1M and save a 131.1M > file, it's going to take up 132M on disk before compression/raidz > overhead/whatnot. > >> >> > >> >> Not true. ZFS will trim the file's tails even without compression > enabled. > >> >> > >> >> > > >> >> > Usually compression saves you from the tail padding actually > requiring allocation on disk, which is one reason I encourage everyone to > at least use lz4 (or, if you absolutely cannot for some reason, I guess zle > should also work for this one case...) > >> >> > > >> >> > But I would say it's probably the sum of last record padding > across the whole dataset, if you don't have compression on. > >> >> > > >> >> > - Rich > >> >> > > >> >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire < > florent@rivoire.fr> wrote: > >> >> >> > >> >> >> TLDR: I rsync-ed the same data twice: once with 128K recordsize > and > >> >> >> once with 1M, and the allocated size on disk is ~3% bigger with > 1M. > >> >> >> Why not smaller ? > >> >> >> > >> >> >> > >> >> >> Hello, > >> >> >> > >> >> >> I would like some help to understand how the disk usage evolves > when I > >> >> >> change the recordsize. > >> >> >> > >> >> >> I've read several articles/presentations/forums about recordsize > in > >> >> >> ZFS, and if I try to summarize, I mainly understood that: > >> >> >> - recordsize is the "maximum" size of "objects" (so "logical > blocks") > >> >> >> that zfs will create for both -data & metadata, then each object > is > >> >> >> compressed and allocated to one vdev, splitted into smaller > (ashift > >> >> >> size) "physical" blocks and written on disks > >> >> >> - increasing recordsize is usually good when storing large files > that > >> >> >> are not modified, because it limits the nb of metadata objects > >> >> >> (block-pointers), which has a positive effect on performance > >> >> >> - decreasing recordsize is useful for "databases-like" workloads > (ie: > >> >> >> small random writes inside existing objects), because it avoids > write > >> >> >> amplification (read-modify-write a large object for a small > update) > >> >> >> > >> >> >> Today, I'm trying to observe the effect of increasing recordsize > for > >> >> >> *my* data (because I'm also considering defining > special_small_blocks > >> >> >> & using SSDs as "special", but not tested nor discussed here, just > >> >> >> recordsize). > >> >> >> So, I'm doing some benchmarks on my "documents" dataset (details > in > >> >> >> "notes" below), but the results are really strange to me. > >> >> >> > >> >> >> When I rsync the same data to a freshly-recreated zpool: > >> >> >> A) with recordsize=128K : 226G allocated on disk > >> >> >> B) with recordsize=1M : 232G allocated on disk => bigger than > 128K ?!? > >> >> >> > >> >> >> I would clearly expect the other way around, because bigger > recordsize > >> >> >> generates less metadata so smaller disk usage, and there > shouldn't be > >> >> >> any overhead because 1M is just a maximum and not a forced size to > >> >> >> allocate for every object. > >> >> > >> >> A common misconception. The 1M recordsize applies to every newly > >> >> created object, and every object must use the same size for all of > its > >> >> records (except possibly the last one). But objects created before > >> >> you changed the recsize will retain their old recsize, file tails > have > >> >> a flexible recsize. > >> >> > >> >> >> I don't mind the increased usage (I can live with a few GB more), > but > >> >> >> I would like to understand why it happens. > >> >> > >> >> You might be seeing the effects of sparsity. ZFS is smart enough not > >> >> to store file holes (and if any kind of compression is enabled, it > >> >> will find long runs of zeroes and turn them into holes). If your > data > >> >> contains any holes that are >= 128 kB but < 1MB, then they can be > >> >> stored as holes with a 128 kB recsize but must be stored as long runs > >> >> of zeros with a 1MB recsize. > >> >> > >> >> However, I would suggest that you don't bother. With a 128kB > recsize, > >> >> ZFS has something like a 1000:1 ratio of data:metadata. In other > >> >> words, increasing your recsize can save you at most 0.1% of disk > >> >> space. Basically, it doesn't matter. What it _does_ matter for is > >> >> the tradeoff between write amplification and RAM usage. 1000:1 is > >> >> comparable to the disk:ram of many computers. And performance is > more > >> >> sensitive to metadata access times than data access times. So > >> >> increasing your recsize can help you keep a greater fraction of your > >> >> metadata in ARC. OTOH, as you remarked increasing your recsize will > >> >> also increase write amplification. > >> >> > >> >> So to summarize: > >> >> * Adjust compression settings to save disk space. > >> >> * Adjust recsize to save RAM. > >> >> > >> >> -Alan > >> >> > >> >> >> > >> >> >> I tried to give all the details of my tests below. > >> >> >> Did I do something wrong ? Can you explain the increase ? > >> >> >> > >> >> >> Thanks ! > >> >> >> > >> >> >> > >> >> >> > >> >> >> =============================================== > >> >> >> A) 128K > >> >> >> ========== > >> >> >> > >> >> >> # zpool destroy bench > >> >> >> # zpool create -o ashift=12 bench > >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> >> > >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> >> [...] > >> >> >> sent 241,042,476,154 bytes received 353,838 bytes 81,806,492.45 > bytes/sec > >> >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> >> > >> >> >> # zfs get recordsize bench > >> >> >> NAME PROPERTY VALUE SOURCE > >> >> >> bench recordsize 128K default > >> >> >> > >> >> >> # zpool list -v bench > >> >> >> NAME SIZE ALLOC FREE > >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> >> bench 2.72T 226G 2.50T > >> >> >> - - 0% 8% 1.00x ONLINE - > >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G 2.50T > >> >> >> - - 0% 8.10% - ONLINE > >> >> >> > >> >> >> # zfs list bench > >> >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> >> bench 226G 2.41T 226G /bench > >> >> >> > >> >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> >> bench used 226G - > >> >> >> bench referenced 226G - > >> >> >> bench usedbysnapshots 0B - > >> >> >> bench usedbydataset 226G - > >> >> >> bench usedbychildren 1.80M - > >> >> >> bench usedbyrefreservation 0B - > >> >> >> bench written 226G - > >> >> >> bench logicalused 226G - > >> >> >> bench logicalreferenced 226G - > >> >> >> > >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb > >> >> >> > >> >> >> > >> >> >> > >> >> >> =============================================== > >> >> >> B) 1M > >> >> >> ========== > >> >> >> > >> >> >> # zpool destroy bench > >> >> >> # zpool create -o ashift=12 bench > >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> >> # zfs set recordsize=1M bench > >> >> >> > >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> >> [...] > >> >> >> sent 241,042,476,154 bytes received 353,830 bytes 80,173,899.88 > bytes/sec > >> >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> >> > >> >> >> # zfs get recordsize bench > >> >> >> NAME PROPERTY VALUE SOURCE > >> >> >> bench recordsize 1M local > >> >> >> > >> >> >> # zpool list -v bench > >> >> >> NAME SIZE ALLOC FREE > >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> >> bench 2.72T 232G 2.49T > >> >> >> - - 0% 8% 1.00x ONLINE - > >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G 2.49T > >> >> >> - - 0% 8.32% - ONLINE > >> >> >> > >> >> >> # zfs list bench > >> >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> >> bench 232G 2.41T 232G /bench > >> >> >> > >> >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> >> bench used 232G - > >> >> >> bench referenced 232G - > >> >> >> bench usedbysnapshots 0B - > >> >> >> bench usedbydataset 232G - > >> >> >> bench usedbychildren 1.96M - > >> >> >> bench usedbyrefreservation 0B - > >> >> >> bench written 232G - > >> >> >> bench logicalused 232G - > >> >> >> bench logicalreferenced 232G - > >> >> >> > >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb > >> >> >> > >> >> >> > >> >> >> > >> >> >> =============================================== > >> >> >> Notes: > >> >> >> ========== > >> >> >> > >> >> >> - the source dataset contains ~50% of pictures (raw files and > jpg), > >> >> >> and also some music, various archived documents, zip, videos > >> >> >> - no change on the source dataset while testing (cf size logged > by resync) > >> >> >> - I repeated the tests twice (128K, then 1M, then 128K, then 1M), > and > >> >> >> same results > >> >> >> - probably not important here, but: > >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB CMR > >> >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize > dataset > >> >> >> on another zpool that I never tweaked except ashit=12 (because > using > >> >> >> the same model of Red 3TB) > >> >> >> > >> >> >> # zfs --version > >> >> >> zfs-2.0.6-1 > >> >> >> zfs-kmod-v2021120100-zfs_a8c7652 > >> >> >> > >> >> >> # uname -a > >> >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 > >> >> >> 75566f060d4(HEAD) TRUENAS amd64 > --00000000000001f4cb05d5dca1eb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Nope. I just retried it on my FBSD 13-RELEASE VM, too:# uname -a
FreeBSD fbsd13rel 13.0-RELEASE-p4 FreeBSD 13.0-RELEAS= E-p4 #0: Tue Aug 24 07:33:27 UTC 2021 =C2=A0 =C2=A0 root@amd64-builder.daem= onology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC =C2=A0amd64
# = zpool version
zfs-2.1.99-683_ga967e54c2
zfs-kmod-2.1.99-683_ga= 967e54c2
# zpool get all | grep 'feature@' | grep dis= abled
buildpool=C2=A0 feature@edonr =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0disabled =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 local
# dd if=3D/de= v/urandom of=3D/buildpool/testme/2 bs=3D1179648 count=3D1
1+0 records = in
1+0 records out
1179648 bytes transferred in 0.009827 secs (120041= 885 bytes/sec)
# du -sh /buildpool/testme/2
2.0M =C2=A0 =C2=A0/buildp= ool/testme/2
# zfs get all buildpool/testme | grep -v default
= NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0PROPERTY =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0VALUE =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0SOURCE
buildpool/testme =C2=A0type =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0filesystem =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
buildpool/testme =C2=A0creation =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tue Jan 18 =C2=A04:46 2022 =C2= =A0-
buildpool/testme =C2=A0used =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A04.03M =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
buildpool/testme =C2=A0available =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 277G =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 -
buildpool/testme =C2=A0referenced =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A04.03M =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
buildpool/testme =C2=A0compressratio =C2=A0 =C2=A0 =C2=A0= =C2=A0 1.00x =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
buildpool/testme =C2=A0mounted =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 yes =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
buildpool/testme =C2=A0recordsize =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A01M =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 local
buildpool/testme =C2=A0compression =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 off =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0local
buildpool/testme =C2=A0atime =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 off =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inherited from buildpool
buildpool= /testme =C2=A0createtxg =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 15030 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buildpool/t= estme =C2=A0version =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 5 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-<= br>buildpool/testme =C2=A0utf8only =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0off =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
buildpool/testme =C2=A0normalization =C2=A0 =C2=A0 =C2=A0 = =C2=A0 none =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = -
buildpool/testme =C2=A0casesensitivity =C2=A0 =C2=A0 =C2=A0 sensitive = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buildpool/testme =C2= =A0guid =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A011057= 815587819738755 =C2=A0 -
buildpool/testme =C2=A0usedbysnapshots =C2=A0 = =C2=A0 =C2=A0 0B =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 -
buildpool/testme =C2=A0usedbydataset =C2=A0 =C2=A0 =C2= =A0 =C2=A0 4.03M =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
buildpool/testme =C2=A0usedbychildren =C2=A0 =C2=A0 =C2=A0 =C2= =A00B =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= -
buildpool/testme =C2=A0usedbyrefreservation =C2=A00B =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
buildpool/test= me =C2=A0objsetid =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0280 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buil= dpool/testme =C2=A0refcompressratio =C2=A0 =C2=A0 =C2=A01.00x =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buildpool/testme =C2= =A0written =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 4.03M =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buildpool/testm= e =C2=A0logicalused =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 4.01M =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
buildpool/testme =C2= =A0logicalreferenced =C2=A0 =C2=A0 4.01M =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0-

What version are= you running?

- Rich

On Tue, Jan 18, 2022 at = 10:00 AM Alan Somers <asomers@fre= ebsd.org> wrote:
That's not what I get.=C2=A0 Is your pool formatted using a ver= y old
version or something?

somers@fbsd-head /u/h/somers [1]>
dd if=3D/dev/random bs=3D1179648 of=3D/testpool/food/t/richfile count=3D1 1+0 records in
1+0 records out
1179648 bytes transferred in 0.003782 secs (311906705 bytes/sec)
somers@fbsd-head /u/h/somers> du -sh=C2=A0 /testpool/food/t/richfile
1.1M=C2=A0 =C2=A0 /testpool/food/t/richfile

On Tue, Jan 18, 2022 at 7:51 AM Rich <rincebrain@gmail.com> wrote:
>
> 2.1M=C2=A0 =C2=A0 /workspace/test1M/1
>
> - Rich
>
> On Tue, Jan 18, 2022 at 9:47 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> Yeah, it does.=C2=A0 Just check "du -sh <FILENAME>"= ;.=C2=A0 zdb there is showing
>> you the logical size of the record, but it isn't showing how m= any disk
>> blocks are actually allocated.
>>
>> On Tue, Jan 18, 2022 at 7:30 AM Rich <rincebrain@gmail.com> wrote:
>> >
>> > Really? I didn't know it would still trim the tails on fi= les with compression off.
>> >
>> > ...
>> >
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0size=C2=A0 =C2=A0 1179648 >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0parent=C2=A0 34
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0links=C2=A0 =C2=A01
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pflags=C2=A0 40800000004
>> > Indirect blocks:
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 L1= =C2=A0 DVA[0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c810733000:1000>= ; [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique double siz= e=3D20000L/1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba24b351a0= 9aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0=C2= =A0 L0 DVA[0]=3D<2:a0827db4000:100000> [L0 ZFS plain file] skein unco= mpressed unencrypted LE contiguous unique single size=3D100000L/100000P bir= th=3D35675472L/35675472P fill=3D1 cksum=3D95b06edf60e5f54c:af6f6950775d0863= :8fc28b0783fcd9d3:2e44676e48a59360
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0100000=C2=A0 L0 DVA[0= ]=3D<2:a0827eb4000:100000> [L0 ZFS plain file] skein uncompressed une= ncrypted LE contiguous unique single size=3D100000L/100000P birth=3D3567547= 2L/35675472P fill=3D1 cksum=3D62a1f05769528648:8197c8a05ca9f1fb:a750c690124= dd2e0:390bddc4314cd4c3
>> >
>> > It seems not?
>> >
>> > - Rich
>> >
>> >
>> > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers <asomers@freebsd.org> wro= te:
>> >>
>> >> On Tue, Jan 18, 2022 at 7:13 AM Rich <rincebrain@gmail.com> wrot= e:
>> >> >
>> >> > Compression would have made your life better here, a= nd possibly also made it clearer what's going on.
>> >> >
>> >> > All records in a file are going to be the same size = pre-compression - so if you set the recordsize to 1M and save a 131.1M file= , it's going to take up 132M on disk before compression/raidz overhead/= whatnot.
>> >>
>> >> Not true.=C2=A0 ZFS will trim the file's tails even w= ithout compression enabled.
>> >>
>> >> >
>> >> > Usually compression saves you from the tail padding = actually requiring allocation on disk, which is one reason I encourage ever= yone to at least use lz4 (or, if you absolutely cannot for some reason, I g= uess zle should also work for this one case...)
>> >> >
>> >> > But I would say it's probably the sum of last re= cord padding across the whole dataset, if you don't have compression on= .
>> >> >
>> >> > - Rich
>> >> >
>> >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire <= florent@rivoire.fr<= /a>> wrote:
>> >> >>
>> >> >> TLDR: I rsync-ed the same data twice: once with = 128K recordsize and
>> >> >> once with 1M, and the allocated size on disk is = ~3% bigger with 1M.
>> >> >> Why not smaller ?
>> >> >>
>> >> >>
>> >> >> Hello,
>> >> >>
>> >> >> I would like some help to understand how the dis= k usage evolves when I
>> >> >> change the recordsize.
>> >> >>
>> >> >> I've read several articles/presentations/for= ums about recordsize in
>> >> >> ZFS, and if I try to summarize, I mainly underst= ood that:
>> >> >> - recordsize is the "maximum" size of = "objects" (so "logical blocks")
>> >> >> that zfs will create for both=C2=A0 -data & = metadata, then each object is
>> >> >> compressed and allocated to one vdev, splitted i= nto smaller (ashift
>> >> >> size) "physical" blocks and written on= disks
>> >> >> - increasing recordsize is usually good when sto= ring large files that
>> >> >> are not modified, because it limits the nb of me= tadata objects
>> >> >> (block-pointers), which has a positive effect on= performance
>> >> >> - decreasing recordsize is useful for "data= bases-like" workloads (ie:
>> >> >> small random writes inside existing objects), be= cause it avoids write
>> >> >> amplification (read-modify-write a large object = for a small update)
>> >> >>
>> >> >> Today, I'm trying to observe the effect of i= ncreasing recordsize for
>> >> >> *my* data (because I'm also considering defi= ning special_small_blocks
>> >> >> & using SSDs as "special", but not= tested nor discussed here, just
>> >> >> recordsize).
>> >> >> So, I'm doing some benchmarks on my "do= cuments" dataset (details in
>> >> >> "notes" below), but the results are re= ally strange to me.
>> >> >>
>> >> >> When I rsync the same data to a freshly-recreate= d zpool:
>> >> >> A) with recordsize=3D128K : 226G allocated on di= sk
>> >> >> B) with recordsize=3D1M : 232G allocated on disk= =3D> bigger than 128K ?!?
>> >> >>
>> >> >> I would clearly expect the other way around, bec= ause bigger recordsize
>> >> >> generates less metadata so smaller disk usage, a= nd there shouldn't be
>> >> >> any overhead because 1M is just a maximum and no= t a forced size to
>> >> >> allocate for every object.
>> >>
>> >> A common misconception.=C2=A0 The 1M recordsize applies t= o every newly
>> >> created object, and every object must use the same size f= or all of its
>> >> records (except possibly the last one).=C2=A0 But objects= created before
>> >> you changed the recsize will retain their old recsize, fi= le tails have
>> >> a flexible recsize.
>> >>
>> >> >> I don't mind the increased usage (I can live= with a few GB more), but
>> >> >> I would like to understand why it happens.
>> >>
>> >> You might be seeing the effects of sparsity.=C2=A0 ZFS is= smart enough not
>> >> to store file holes (and if any kind of compression is en= abled, it
>> >> will find long runs of zeroes and turn them into holes).= =C2=A0 If your data
>> >> contains any holes that are >=3D 128 kB but < 1MB, = then they can be
>> >> stored as holes with a 128 kB recsize but must be stored = as long runs
>> >> of zeros with a 1MB recsize.
>> >>
>> >> However, I would suggest that you don't bother.=C2=A0= With a 128kB recsize,
>> >> ZFS has something like a 1000:1 ratio of data:metadata.= =C2=A0 In other
>> >> words, increasing your recsize can save you at most 0.1% = of disk
>> >> space.=C2=A0 Basically, it doesn't matter.=C2=A0 What= it _does_ matter for is
>> >> the tradeoff between write amplification and RAM usage.= =C2=A0 1000:1 is
>> >> comparable to the disk:ram of many computers.=C2=A0 And p= erformance is more
>> >> sensitive to metadata access times than data access times= .=C2=A0 So
>> >> increasing your recsize can help you keep a greater fract= ion of your
>> >> metadata in ARC.=C2=A0 OTOH, as you remarked increasing y= our recsize will
>> >> also increase write amplification.
>> >>
>> >> So to summarize:
>> >> * Adjust compression settings to save disk space.
>> >> * Adjust recsize to save RAM.
>> >>
>> >> -Alan
>> >>
>> >> >>
>> >> >> I tried to give all the details of my tests belo= w.
>> >> >> Did I do something wrong ? Can you explain the i= ncrease ?
>> >> >>
>> >> >> Thanks !
>> >> >>
>> >> >>
>> >> >>
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D
>> >> >> A) 128K
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >>
>> >> >> # zpool destroy bench
>> >> >> # zpool create -o ashift=3D12 bench
>> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4<= br> >> >> >>
>> >> >> # rsync -av --exclude '.zfs' /mnt/tank/d= ocs-florent/ /bench
>> >> >> [...]
>> >> >> sent 241,042,476,154 bytes=C2=A0 received 353,83= 8 bytes=C2=A0 81,806,492.45 bytes/sec
>> >> >> total size is 240,982,439,038=C2=A0 speedup is 1= .00
>> >> >>
>> >> >> # zfs get recordsize bench
>> >> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2= =A0 =C2=A0 SOURCE
>> >> >> bench=C2=A0 recordsize=C2=A0 128K=C2=A0 =C2=A0 = =C2=A0default
>> >> >>
>> >> >> # zpool list -v bench
>> >> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> >> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 = =C2=A0 CAP=C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-= =C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLIN= E=C2=A0 -
>> >> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8= cc3ad4=C2=A0 2.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-= =C2=A0 =C2=A0 =C2=A00%=C2=A0 8.10%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLIN= E
>> >> >>
>> >> >> # zfs list bench
>> >> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 = =C2=A0REFER=C2=A0 MOUNTPOINT
>> >> >> bench=C2=A0 =C2=A0226G=C2=A0 2.41T=C2=A0 =C2=A0 = =C2=A0 226G=C2=A0 /bench
>> >> >>
>> >> >> # zfs get all bench |egrep "(used|reference= d|written)"
>> >> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 = =C2=A00B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> >> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 = =C2=A0 1.80M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = -
>> >> >> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2= =A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> >>
>> >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb<= br> >> >> >>
>> >> >>
>> >> >>
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D
>> >> >> B) 1M
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >>
>> >> >> # zpool destroy bench
>> >> >> # zpool create -o ashift=3D12 bench
>> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4<= br> >> >> >> # zfs set recordsize=3D1M bench
>> >> >>
>> >> >> # rsync -av --exclude '.zfs' /mnt/tank/d= ocs-florent/ /bench
>> >> >> [...]
>> >> >> sent 241,042,476,154 bytes=C2=A0 received 353,83= 0 bytes=C2=A0 80,173,899.88 bytes/sec
>> >> >> total size is 240,982,439,038=C2=A0 speedup is 1= .00
>> >> >>
>> >> >> # zfs get recordsize bench
>> >> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 VALUE=C2= =A0 =C2=A0 SOURCE
>> >> >> bench=C2=A0 recordsize=C2=A0 1M=C2=A0 =C2=A0 =C2= =A0 =C2=A0local
>> >> >>
>> >> >> # zpool list -v bench
>> >> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0FREE
>> >> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG=C2=A0 = =C2=A0 CAP=C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-= =C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 =C2=A0 ONLIN= E=C2=A0 -
>> >> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8= cc3ad4=C2=A0 2.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-= =C2=A0 =C2=A0 =C2=A00%=C2=A0 8.32%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 =C2=A0 ONLIN= E
>> >> >>
>> >> >> # zfs list bench
>> >> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2=A0 =C2=A0 = =C2=A0REFER=C2=A0 MOUNTPOINT
>> >> >> bench=C2=A0 =C2=A0232G=C2=A0 2.41T=C2=A0 =C2=A0 = =C2=A0 232G=C2=A0 /bench
>> >> >>
>> >> >> # zfs get all bench |egrep "(used|reference= d|written)"
>> >> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 = =C2=A00B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> >> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 = =C2=A0 1.96M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = -
>> >> >> bench=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0-
>> >> >> bench=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2= =A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> >>
>> >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb >> >> >>
>> >> >>
>> >> >>
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D
>> >> >> Notes:
>> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >>
>> >> >> - the source dataset contains ~50% of pictures (= raw files and jpg),
>> >> >> and also some music, various archived documents,= zip, videos
>> >> >> - no change on the source dataset while testing = (cf size logged by resync)
>> >> >> - I repeated the tests twice (128K, then 1M, the= n 128K, then 1M), and
>> >> >> same results
>> >> >> - probably not important here, but:
>> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 = is a Red 3TB CMR
>> >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128= K-recordsize dataset
>> >> >> on another zpool that I never tweaked except ash= it=3D12 (because using
>> >> >> the same model of Red 3TB)
>> >> >>
>> >> >> # zfs --version
>> >> >> zfs-2.0.6-1
>> >> >> zfs-kmod-v2021120100-zfs_a8c7652
>> >> >>
>> >> >> # uname -a
>> >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-= RELEASE-p11
>> >> >> 75566f060d4(HEAD) TRUENAS=C2=A0 amd64
--00000000000001f4cb05d5dca1eb-- From nobody Tue Jan 18 15:33:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E5F4A1965601 for ; Tue, 18 Jan 2022 15:33:12 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x92b.google.com (mail-ua1-x92b.google.com [IPv6:2607:f8b0:4864:20::92b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdXpw2jVWz3Q7S; Tue, 18 Jan 2022 15:33:12 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x92b.google.com with SMTP id c36so37371806uae.13; Tue, 18 Jan 2022 07:33:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=PNrhQyahErxAcdaKh7341aBxAU81dyA/cG0XU6SSNO8=; b=jYtMsjrFCZK2RfK0RFrrEWn3TJaDdF0LS+SG2hH4gMze6s4uI3bKaxQ9wXXZHRNUq5 V5tnBuksMCfzMnpleOa185RSlnYtEp/Flsw4xdryXgYlqljNxieUWjqu1vu7Y2EAikkT web37yBxDbtj3Ptfzyve05dv14TFGMQWn6r+TaxT4OnBO3y1cT6cjx4kxmVw0TwCbqsg fMSZliIzEEIU1xhza08icP+u/j/SInKV0CWexjWNpSe2I52gF2NlY1e7vx1RqTgr2b1c MNGBWgTEHw21A9AyqIsSmPyqKkw0qWxXWB+29dxTeW166hXkZm4fovZplrhfXB+mq1aY 3hmQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=PNrhQyahErxAcdaKh7341aBxAU81dyA/cG0XU6SSNO8=; b=6bWm9qyMYBtL8rEJ8QQMPK/Kwyk4bxYNKKnjaEI0zXFb8p3EfzW+ZdcWlpagE9++t9 zHQdyE2U8V6Y1QjemohgL4nodCLmVv91167KJI9nT33347UgnhB0A0TYjuKtT9pkk4FX IXu5LgTU7IqAPMngKUiadP+uSWFEktm8f4aD5PO1nW6VgQDxOFrO1xj+l7pfPEFmPu/E +5tH3XcFGCD39+ulWeDIWwZsYtAlKHp1gyXXjCqui/gbQMThHEbFnUWvh2aYjY86JcSR tSDkAZYA6TVSwbE2iVB2vMxmVxYwTPXUjvg0/gIw3eQYQdx7Mg3r3J+P2cFET+7o57MJ HvjA== X-Gm-Message-State: AOAM532xL0806Vx5uSiGghgRjRreoKiaChFZgupZN1mkDXqt9SOHmAsH GLIc9cG4rFcyRHLJblQZ83rrBUcVQ1sP3itmp50= X-Google-Smtp-Source: ABdhPJyniVx8Tb19aJJ1AQwg7RQ2vQkrYMiQFMb06DYoSKLtu3/1wO4Av5/5mzMgdG4qiQ0iNs79yI3wLIF0R4a8LK0= X-Received: by 2002:ab0:d97:: with SMTP id i23mr9905744uak.79.1642519991757; Tue, 18 Jan 2022 07:33:11 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Tue, 18 Jan 2022 10:33:03 -0500 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: alan somers Cc: Alan Somers , Florent Rivoire , freebsd-fs Content-Type: multipart/alternative; boundary="000000000000a5311a05d5dcfcb3" X-Rspamd-Queue-Id: 4JdXpw2jVWz3Q7S X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=jYtMsjrF; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::92b as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::92b:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000a5311a05d5dcfcb3 Content-Type: text/plain; charset="UTF-8" Yeah, that's consistent with my understanding of the behavior - one record gets packed, as soon as you hit recordsize all subsequent records are (logically, at least) recordsize, and then compression saves you, or doesn't. - Rich On Tue, Jan 18, 2022 at 10:29 AM alan somers wrote: > I think the difference is in whether the file is < 1 record or >= 1 > record. It looks like the first record is variably-sized but after > that it's like you say, with compression off it rounds up. > > On Tue, Jan 18, 2022 at 8:07 AM Rich wrote: > > > > Nope. I just retried it on my FBSD 13-RELEASE VM, too: > > # uname -a > > FreeBSD fbsd13rel 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #0: Tue Aug 24 > 07:33:27 UTC 2021 root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC > amd64 > > # zpool version > > zfs-2.1.99-683_ga967e54c2 > > zfs-kmod-2.1.99-683_ga967e54c2 > > # zpool get all | grep 'feature@' | grep disabled > > buildpool feature@edonr disabled > local > > # dd if=/dev/urandom of=/buildpool/testme/2 bs=1179648 count=1 > > 1+0 records in > > 1+0 records out > > 1179648 bytes transferred in 0.009827 secs (120041885 bytes/sec) > > # du -sh /buildpool/testme/2 > > 2.0M /buildpool/testme/2 > > # zfs get all buildpool/testme | grep -v default > > NAME PROPERTY VALUE SOURCE > > buildpool/testme type filesystem - > > buildpool/testme creation Tue Jan 18 4:46 2022 - > > buildpool/testme used 4.03M - > > buildpool/testme available 277G - > > buildpool/testme referenced 4.03M - > > buildpool/testme compressratio 1.00x - > > buildpool/testme mounted yes - > > buildpool/testme recordsize 1M local > > buildpool/testme compression off local > > buildpool/testme atime off inherited > from buildpool > > buildpool/testme createtxg 15030 - > > buildpool/testme version 5 - > > buildpool/testme utf8only off - > > buildpool/testme normalization none - > > buildpool/testme casesensitivity sensitive - > > buildpool/testme guid 11057815587819738755 - > > buildpool/testme usedbysnapshots 0B - > > buildpool/testme usedbydataset 4.03M - > > buildpool/testme usedbychildren 0B - > > buildpool/testme usedbyrefreservation 0B - > > buildpool/testme objsetid 280 - > > buildpool/testme refcompressratio 1.00x - > > buildpool/testme written 4.03M - > > buildpool/testme logicalused 4.01M - > > buildpool/testme logicalreferenced 4.01M - > > > > What version are you running? > > > > - Rich > > > > On Tue, Jan 18, 2022 at 10:00 AM Alan Somers > wrote: > >> > >> That's not what I get. Is your pool formatted using a very old > >> version or something? > >> > >> somers@fbsd-head /u/h/somers [1]> > >> dd if=/dev/random bs=1179648 of=/testpool/food/t/richfile count=1 > >> 1+0 records in > >> 1+0 records out > >> 1179648 bytes transferred in 0.003782 secs (311906705 bytes/sec) > >> somers@fbsd-head /u/h/somers> du -sh /testpool/food/t/richfile > >> 1.1M /testpool/food/t/richfile > >> > >> On Tue, Jan 18, 2022 at 7:51 AM Rich wrote: > >> > > >> > 2.1M /workspace/test1M/1 > >> > > >> > - Rich > >> > > >> > On Tue, Jan 18, 2022 at 9:47 AM Alan Somers > wrote: > >> >> > >> >> Yeah, it does. Just check "du -sh ". zdb there is showing > >> >> you the logical size of the record, but it isn't showing how many > disk > >> >> blocks are actually allocated. > >> >> > >> >> On Tue, Jan 18, 2022 at 7:30 AM Rich wrote: > >> >> > > >> >> > Really? I didn't know it would still trim the tails on files with > compression off. > >> >> > > >> >> > ... > >> >> > > >> >> > size 1179648 > >> >> > parent 34 > >> >> > links 1 > >> >> > pflags 40800000004 > >> >> > Indirect blocks: > >> >> > 0 L1 DVA[0]=<3:c02b96c000:1000> > DVA[1]=<3:c810733000:1000> [L1 ZFS plain file] skein lz4 unencrypted LE > contiguous unique double size=20000L/1000P birth=35675472L/35675472P fill=2 > cksum=5cfba24b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4 > >> >> > 0 L0 DVA[0]=<2:a0827db4000:100000> [L0 ZFS plain > file] skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=95b06edf60e5f54c:af6f6950775d0863:8fc28b0783fcd9d3:2e44676e48a59360 > >> >> > 100000 L0 DVA[0]=<2:a0827eb4000:100000> [L0 ZFS plain > file] skein uncompressed unencrypted LE contiguous unique single > size=100000L/100000P birth=35675472L/35675472P fill=1 > cksum=62a1f05769528648:8197c8a05ca9f1fb:a750c690124dd2e0:390bddc4314cd4c3 > >> >> > > >> >> > It seems not? > >> >> > > >> >> > - Rich > >> >> > > >> >> > > >> >> > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers > wrote: > >> >> >> > >> >> >> On Tue, Jan 18, 2022 at 7:13 AM Rich > wrote: > >> >> >> > > >> >> >> > Compression would have made your life better here, and possibly > also made it clearer what's going on. > >> >> >> > > >> >> >> > All records in a file are going to be the same size > pre-compression - so if you set the recordsize to 1M and save a 131.1M > file, it's going to take up 132M on disk before compression/raidz > overhead/whatnot. > >> >> >> > >> >> >> Not true. ZFS will trim the file's tails even without > compression enabled. > >> >> >> > >> >> >> > > >> >> >> > Usually compression saves you from the tail padding actually > requiring allocation on disk, which is one reason I encourage everyone to > at least use lz4 (or, if you absolutely cannot for some reason, I guess zle > should also work for this one case...) > >> >> >> > > >> >> >> > But I would say it's probably the sum of last record padding > across the whole dataset, if you don't have compression on. > >> >> >> > > >> >> >> > - Rich > >> >> >> > > >> >> >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Rivoire < > florent@rivoire.fr> wrote: > >> >> >> >> > >> >> >> >> TLDR: I rsync-ed the same data twice: once with 128K > recordsize and > >> >> >> >> once with 1M, and the allocated size on disk is ~3% bigger > with 1M. > >> >> >> >> Why not smaller ? > >> >> >> >> > >> >> >> >> > >> >> >> >> Hello, > >> >> >> >> > >> >> >> >> I would like some help to understand how the disk usage > evolves when I > >> >> >> >> change the recordsize. > >> >> >> >> > >> >> >> >> I've read several articles/presentations/forums about > recordsize in > >> >> >> >> ZFS, and if I try to summarize, I mainly understood that: > >> >> >> >> - recordsize is the "maximum" size of "objects" (so "logical > blocks") > >> >> >> >> that zfs will create for both -data & metadata, then each > object is > >> >> >> >> compressed and allocated to one vdev, splitted into smaller > (ashift > >> >> >> >> size) "physical" blocks and written on disks > >> >> >> >> - increasing recordsize is usually good when storing large > files that > >> >> >> >> are not modified, because it limits the nb of metadata objects > >> >> >> >> (block-pointers), which has a positive effect on performance > >> >> >> >> - decreasing recordsize is useful for "databases-like" > workloads (ie: > >> >> >> >> small random writes inside existing objects), because it > avoids write > >> >> >> >> amplification (read-modify-write a large object for a small > update) > >> >> >> >> > >> >> >> >> Today, I'm trying to observe the effect of increasing > recordsize for > >> >> >> >> *my* data (because I'm also considering defining > special_small_blocks > >> >> >> >> & using SSDs as "special", but not tested nor discussed here, > just > >> >> >> >> recordsize). > >> >> >> >> So, I'm doing some benchmarks on my "documents" dataset > (details in > >> >> >> >> "notes" below), but the results are really strange to me. > >> >> >> >> > >> >> >> >> When I rsync the same data to a freshly-recreated zpool: > >> >> >> >> A) with recordsize=128K : 226G allocated on disk > >> >> >> >> B) with recordsize=1M : 232G allocated on disk => bigger than > 128K ?!? > >> >> >> >> > >> >> >> >> I would clearly expect the other way around, because bigger > recordsize > >> >> >> >> generates less metadata so smaller disk usage, and there > shouldn't be > >> >> >> >> any overhead because 1M is just a maximum and not a forced > size to > >> >> >> >> allocate for every object. > >> >> >> > >> >> >> A common misconception. The 1M recordsize applies to every newly > >> >> >> created object, and every object must use the same size for all > of its > >> >> >> records (except possibly the last one). But objects created > before > >> >> >> you changed the recsize will retain their old recsize, file tails > have > >> >> >> a flexible recsize. > >> >> >> > >> >> >> >> I don't mind the increased usage (I can live with a few GB > more), but > >> >> >> >> I would like to understand why it happens. > >> >> >> > >> >> >> You might be seeing the effects of sparsity. ZFS is smart enough > not > >> >> >> to store file holes (and if any kind of compression is enabled, it > >> >> >> will find long runs of zeroes and turn them into holes). If your > data > >> >> >> contains any holes that are >= 128 kB but < 1MB, then they can be > >> >> >> stored as holes with a 128 kB recsize but must be stored as long > runs > >> >> >> of zeros with a 1MB recsize. > >> >> >> > >> >> >> However, I would suggest that you don't bother. With a 128kB > recsize, > >> >> >> ZFS has something like a 1000:1 ratio of data:metadata. In other > >> >> >> words, increasing your recsize can save you at most 0.1% of disk > >> >> >> space. Basically, it doesn't matter. What it _does_ matter for > is > >> >> >> the tradeoff between write amplification and RAM usage. 1000:1 is > >> >> >> comparable to the disk:ram of many computers. And performance is > more > >> >> >> sensitive to metadata access times than data access times. So > >> >> >> increasing your recsize can help you keep a greater fraction of > your > >> >> >> metadata in ARC. OTOH, as you remarked increasing your recsize > will > >> >> >> also increase write amplification. > >> >> >> > >> >> >> So to summarize: > >> >> >> * Adjust compression settings to save disk space. > >> >> >> * Adjust recsize to save RAM. > >> >> >> > >> >> >> -Alan > >> >> >> > >> >> >> >> > >> >> >> >> I tried to give all the details of my tests below. > >> >> >> >> Did I do something wrong ? Can you explain the increase ? > >> >> >> >> > >> >> >> >> Thanks ! > >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> =============================================== > >> >> >> >> A) 128K > >> >> >> >> ========== > >> >> >> >> > >> >> >> >> # zpool destroy bench > >> >> >> >> # zpool create -o ashift=12 bench > >> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> >> >> > >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> >> >> [...] > >> >> >> >> sent 241,042,476,154 bytes received 353,838 bytes > 81,806,492.45 bytes/sec > >> >> >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> >> >> > >> >> >> >> # zfs get recordsize bench > >> >> >> >> NAME PROPERTY VALUE SOURCE > >> >> >> >> bench recordsize 128K default > >> >> >> >> > >> >> >> >> # zpool list -v bench > >> >> >> >> NAME SIZE ALLOC > FREE > >> >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> >> >> bench 2.72T 226G > 2.50T > >> >> >> >> - - 0% 8% 1.00x ONLINE - > >> >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 226G > 2.50T > >> >> >> >> - - 0% 8.10% - ONLINE > >> >> >> >> > >> >> >> >> # zfs list bench > >> >> >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> >> >> bench 226G 2.41T 226G /bench > >> >> >> >> > >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> >> >> bench used 226G - > >> >> >> >> bench referenced 226G - > >> >> >> >> bench usedbysnapshots 0B - > >> >> >> >> bench usedbydataset 226G - > >> >> >> >> bench usedbychildren 1.80M - > >> >> >> >> bench usedbyrefreservation 0B - > >> >> >> >> bench written 226G - > >> >> >> >> bench logicalused 226G - > >> >> >> >> bench logicalreferenced 226G - > >> >> >> >> > >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd128K.zdb > >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> =============================================== > >> >> >> >> B) 1M > >> >> >> >> ========== > >> >> >> >> > >> >> >> >> # zpool destroy bench > >> >> >> >> # zpool create -o ashift=12 bench > >> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 > >> >> >> >> # zfs set recordsize=1M bench > >> >> >> >> > >> >> >> >> # rsync -av --exclude '.zfs' /mnt/tank/docs-florent/ /bench > >> >> >> >> [...] > >> >> >> >> sent 241,042,476,154 bytes received 353,830 bytes > 80,173,899.88 bytes/sec > >> >> >> >> total size is 240,982,439,038 speedup is 1.00 > >> >> >> >> > >> >> >> >> # zfs get recordsize bench > >> >> >> >> NAME PROPERTY VALUE SOURCE > >> >> >> >> bench recordsize 1M local > >> >> >> >> > >> >> >> >> # zpool list -v bench > >> >> >> >> NAME SIZE ALLOC > FREE > >> >> >> >> CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > >> >> >> >> bench 2.72T 232G > 2.49T > >> >> >> >> - - 0% 8% 1.00x ONLINE - > >> >> >> >> gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 2.72T 232G > 2.49T > >> >> >> >> - - 0% 8.32% - ONLINE > >> >> >> >> > >> >> >> >> # zfs list bench > >> >> >> >> NAME USED AVAIL REFER MOUNTPOINT > >> >> >> >> bench 232G 2.41T 232G /bench > >> >> >> >> > >> >> >> >> # zfs get all bench |egrep "(used|referenced|written)" > >> >> >> >> bench used 232G - > >> >> >> >> bench referenced 232G - > >> >> >> >> bench usedbysnapshots 0B - > >> >> >> >> bench usedbydataset 232G - > >> >> >> >> bench usedbychildren 1.96M - > >> >> >> >> bench usedbyrefreservation 0B - > >> >> >> >> bench written 232G - > >> >> >> >> bench logicalused 232G - > >> >> >> >> bench logicalreferenced 232G - > >> >> >> >> > >> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd1M.zdb > >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> =============================================== > >> >> >> >> Notes: > >> >> >> >> ========== > >> >> >> >> > >> >> >> >> - the source dataset contains ~50% of pictures (raw files and > jpg), > >> >> >> >> and also some music, various archived documents, zip, videos > >> >> >> >> - no change on the source dataset while testing (cf size > logged by resync) > >> >> >> >> - I repeated the tests twice (128K, then 1M, then 128K, then > 1M), and > >> >> >> >> same results > >> >> >> >> - probably not important here, but: > >> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cbb8cc3ad4 is a Red 3TB > CMR > >> >> >> >> (WD30EFRX), and /mnt/tank/docs-florent/ is a 128K-recordsize > dataset > >> >> >> >> on another zpool that I never tweaked except ashit=12 (because > using > >> >> >> >> the same model of Red 3TB) > >> >> >> >> > >> >> >> >> # zfs --version > >> >> >> >> zfs-2.0.6-1 > >> >> >> >> zfs-kmod-v2021120100-zfs_a8c7652 > >> >> >> >> > >> >> >> >> # uname -a > >> >> >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 FreeBSD 12.2-RELEASE-p11 > >> >> >> >> 75566f060d4(HEAD) TRUENAS amd64 > --000000000000a5311a05d5dcfcb3 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Yeah, that's consistent with my understanding of the b= ehavior - one record gets packed, as soon as you hit recordsize all subsequ= ent records are (logically, at least) recordsize, and then compression save= s you, or doesn't.

- Rich

On Tue, Jan 18, 2022= at 10:29 AM alan somers <asomers@g= mail.com> wrote:
I think the difference is in whether the file is < 1 record or &= gt;=3D 1
record.=C2=A0 It looks like the first record is variably-sized but after that it's like you say, with compression off it rounds up.

On Tue, Jan 18, 2022 at 8:07 AM Rich <rincebrain@gmail.com> wrote:
>
> Nope. I just retried it on my FBSD 13-RELEASE VM, too:
> # uname -a
> FreeBSD fbsd13rel 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #0: Tue Aug = 24 07:33:27 UTC 2021=C2=A0 =C2=A0 =C2=A0root@amd64-builder.daemonology.net:= /usr/obj/usr/src/amd64.amd64/sys/GENERIC=C2=A0 amd64
> # zpool version
> zfs-2.1.99-683_ga967e54c2
> zfs-kmod-2.1.99-683_ga967e54c2
> # zpool get all | grep 'feature@' | grep disabled
> buildpool=C2=A0 feature@edonr=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 disabled=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0local
> # dd if=3D/dev/urandom of=3D/buildpool/testme/2 bs=3D1179648 count=3D1=
> 1+0 records in
> 1+0 records out
> 1179648 bytes transferred in 0.009827 secs (120041885 bytes/sec)
> # du -sh /buildpool/testme/2
> 2.0M=C2=A0 =C2=A0 /buildpool/testme/2
> # zfs get all buildpool/testme | grep -v default
> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 PROPERTY=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 VALUE=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 SOURCE
> buildpool/testme=C2=A0 type=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 filesystem=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
> buildpool/testme=C2=A0 creation=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 Tue Jan 18=C2=A0 4:46 2022=C2=A0 -
> buildpool/testme=C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 4.03M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 available=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0277G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
> buildpool/testme=C2=A0 referenced=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 4.03M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = -
> buildpool/testme=C2=A0 compressratio=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= 1.00x=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 mounted=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0yes=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 recordsize=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 1M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0local
> buildpool/testme=C2=A0 compression=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0off=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 local
> buildpool/testme=C2=A0 atime=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0off=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 inherited from buildpool
> buildpool/testme=C2=A0 createtxg=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A015030=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 -
> buildpool/testme=C2=A0 version=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A05=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 utf8only=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 off=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 -
> buildpool/testme=C2=A0 normalization=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= none=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-<= br> > buildpool/testme=C2=A0 casesensitivity=C2=A0 =C2=A0 =C2=A0 =C2=A0sensi= tive=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 guid=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 11057815587819738755=C2=A0 =C2=A0-
> buildpool/testme=C2=A0 usedbysnapshots=C2=A0 =C2=A0 =C2=A0 =C2=A00B=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-<= br> > buildpool/testme=C2=A0 usedbydataset=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= 4.03M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 usedbychildren=C2=A0 =C2=A0 =C2=A0 =C2=A0 0B=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-<= br> > buildpool/testme=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
> buildpool/testme=C2=A0 objsetid=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 280=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 -
> buildpool/testme=C2=A0 refcompressratio=C2=A0 =C2=A0 =C2=A0 1.00x=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
> buildpool/testme=C2=A0 written=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A04.03M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 -
> buildpool/testme=C2=A0 logicalused=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A04.01M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -=
> buildpool/testme=C2=A0 logicalreferenced=C2=A0 =C2=A0 =C2=A04.01M=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -
>
> What version are you running?
>
> - Rich
>
> On Tue, Jan 18, 2022 at 10:00 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> That's not what I get.=C2=A0 Is your pool formatted using a ve= ry old
>> version or something?
>>
>> somers@fbsd-head /u/h/somers [1]>
>> dd if=3D/dev/random bs=3D1179648 of=3D/testpool/food/t/richfile co= unt=3D1
>> 1+0 records in
>> 1+0 records out
>> 1179648 bytes transferred in 0.003782 secs (311906705 bytes/sec) >> somers@fbsd-head /u/h/somers> du -sh=C2=A0 /testpool/food/t/ric= hfile
>> 1.1M=C2=A0 =C2=A0 /testpool/food/t/richfile
>>
>> On Tue, Jan 18, 2022 at 7:51 AM Rich <rincebrain@gmail.com> wrote:
>> >
>> > 2.1M=C2=A0 =C2=A0 /workspace/test1M/1
>> >
>> > - Rich
>> >
>> > On Tue, Jan 18, 2022 at 9:47 AM Alan Somers <asomers@freebsd.org> wro= te:
>> >>
>> >> Yeah, it does.=C2=A0 Just check "du -sh <FILENAME= >".=C2=A0 zdb there is showing
>> >> you the logical size of the record, but it isn't show= ing how many disk
>> >> blocks are actually allocated.
>> >>
>> >> On Tue, Jan 18, 2022 at 7:30 AM Rich <rincebrain@gmail.com> wrot= e:
>> >> >
>> >> > Really? I didn't know it would still trim the ta= ils on files with compression off.
>> >> >
>> >> > ...
>> >> >
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0size=C2=A0 =C2=A0 1= 179648
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0parent=C2=A0 34
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0links=C2=A0 =C2=A01=
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pflags=C2=A0 408000= 00004
>> >> > Indirect blocks:
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 0 L1=C2=A0 DVA[0]=3D<3:c02b96c000:1000> DVA[1]=3D<3:c810733000= :1000> [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique do= uble size=3D20000L/1000P birth=3D35675472L/35675472P fill=3D2 cksum=3D5cfba= 24b351a09aa:8bd9dfef87c5b625:906ed5c3252943db:bed77ce51ad540d4
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 0=C2=A0 L0 DVA[0]=3D<2:a0827db4000:100000> [L0 ZFS plain file] sk= ein uncompressed unencrypted LE contiguous unique single size=3D100000L/100= 000P birth=3D35675472L/35675472P fill=3D1 cksum=3D95b06edf60e5f54c:af6f6950= 775d0863:8fc28b0783fcd9d3:2e44676e48a59360
>> >> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0100000=C2=A0= L0 DVA[0]=3D<2:a0827eb4000:100000> [L0 ZFS plain file] skein uncompr= essed unencrypted LE contiguous unique single size=3D100000L/100000P birth= =3D35675472L/35675472P fill=3D1 cksum=3D62a1f05769528648:8197c8a05ca9f1fb:a= 750c690124dd2e0:390bddc4314cd4c3
>> >> >
>> >> > It seems not?
>> >> >
>> >> > - Rich
>> >> >
>> >> >
>> >> > On Tue, Jan 18, 2022 at 9:23 AM Alan Somers <asomers@freebsd.org> wrote:
>> >> >>
>> >> >> On Tue, Jan 18, 2022 at 7:13 AM Rich <rincebrain@gmail.com= > wrote:
>> >> >> >
>> >> >> > Compression would have made your life bette= r here, and possibly also made it clearer what's going on.
>> >> >> >
>> >> >> > All records in a file are going to be the s= ame size pre-compression - so if you set the recordsize to 1M and save a 13= 1.1M file, it's going to take up 132M on disk before compression/raidz = overhead/whatnot.
>> >> >>
>> >> >> Not true.=C2=A0 ZFS will trim the file's tai= ls even without compression enabled.
>> >> >>
>> >> >> >
>> >> >> > Usually compression saves you from the tail= padding actually requiring allocation on disk, which is one reason I encou= rage everyone to at least use lz4 (or, if you absolutely cannot for some re= ason, I guess zle should also work for this one case...)
>> >> >> >
>> >> >> > But I would say it's probably the sum o= f last record padding across the whole dataset, if you don't have compr= ession on.
>> >> >> >
>> >> >> > - Rich
>> >> >> >
>> >> >> > On Tue, Jan 18, 2022 at 8:57 AM Florent Riv= oire <florent@ri= voire.fr> wrote:
>> >> >> >>
>> >> >> >> TLDR: I rsync-ed the same data twice: o= nce with 128K recordsize and
>> >> >> >> once with 1M, and the allocated size on= disk is ~3% bigger with 1M.
>> >> >> >> Why not smaller ?
>> >> >> >>
>> >> >> >>
>> >> >> >> Hello,
>> >> >> >>
>> >> >> >> I would like some help to understand ho= w the disk usage evolves when I
>> >> >> >> change the recordsize.
>> >> >> >>
>> >> >> >> I've read several articles/presenta= tions/forums about recordsize in
>> >> >> >> ZFS, and if I try to summarize, I mainl= y understood that:
>> >> >> >> - recordsize is the "maximum"= size of "objects" (so "logical blocks")
>> >> >> >> that zfs will create for both=C2=A0 -da= ta & metadata, then each object is
>> >> >> >> compressed and allocated to one vdev, s= plitted into smaller (ashift
>> >> >> >> size) "physical" blocks and w= ritten on disks
>> >> >> >> - increasing recordsize is usually good= when storing large files that
>> >> >> >> are not modified, because it limits the= nb of metadata objects
>> >> >> >> (block-pointers), which has a positive = effect on performance
>> >> >> >> - decreasing recordsize is useful for &= quot;databases-like" workloads (ie:
>> >> >> >> small random writes inside existing obj= ects), because it avoids write
>> >> >> >> amplification (read-modify-write a larg= e object for a small update)
>> >> >> >>
>> >> >> >> Today, I'm trying to observe the ef= fect of increasing recordsize for
>> >> >> >> *my* data (because I'm also conside= ring defining special_small_blocks
>> >> >> >> & using SSDs as "special"= , but not tested nor discussed here, just
>> >> >> >> recordsize).
>> >> >> >> So, I'm doing some benchmarks on my= "documents" dataset (details in
>> >> >> >> "notes" below), but the resul= ts are really strange to me.
>> >> >> >>
>> >> >> >> When I rsync the same data to a freshly= -recreated zpool:
>> >> >> >> A) with recordsize=3D128K : 226G alloca= ted on disk
>> >> >> >> B) with recordsize=3D1M : 232G allocate= d on disk =3D> bigger than 128K ?!?
>> >> >> >>
>> >> >> >> I would clearly expect the other way ar= ound, because bigger recordsize
>> >> >> >> generates less metadata so smaller disk= usage, and there shouldn't be
>> >> >> >> any overhead because 1M is just a maxim= um and not a forced size to
>> >> >> >> allocate for every object.
>> >> >>
>> >> >> A common misconception.=C2=A0 The 1M recordsize = applies to every newly
>> >> >> created object, and every object must use the sa= me size for all of its
>> >> >> records (except possibly the last one).=C2=A0 Bu= t objects created before
>> >> >> you changed the recsize will retain their old re= csize, file tails have
>> >> >> a flexible recsize.
>> >> >>
>> >> >> >> I don't mind the increased usage (I= can live with a few GB more), but
>> >> >> >> I would like to understand why it happe= ns.
>> >> >>
>> >> >> You might be seeing the effects of sparsity.=C2= =A0 ZFS is smart enough not
>> >> >> to store file holes (and if any kind of compress= ion is enabled, it
>> >> >> will find long runs of zeroes and turn them into= holes).=C2=A0 If your data
>> >> >> contains any holes that are >=3D 128 kB but &= lt; 1MB, then they can be
>> >> >> stored as holes with a 128 kB recsize but must b= e stored as long runs
>> >> >> of zeros with a 1MB recsize.
>> >> >>
>> >> >> However, I would suggest that you don't both= er.=C2=A0 With a 128kB recsize,
>> >> >> ZFS has something like a 1000:1 ratio of data:me= tadata.=C2=A0 In other
>> >> >> words, increasing your recsize can save you at m= ost 0.1% of disk
>> >> >> space.=C2=A0 Basically, it doesn't matter.= =C2=A0 What it _does_ matter for is
>> >> >> the tradeoff between write amplification and RAM= usage.=C2=A0 1000:1 is
>> >> >> comparable to the disk:ram of many computers.=C2= =A0 And performance is more
>> >> >> sensitive to metadata access times than data acc= ess times.=C2=A0 So
>> >> >> increasing your recsize can help you keep a grea= ter fraction of your
>> >> >> metadata in ARC.=C2=A0 OTOH, as you remarked inc= reasing your recsize will
>> >> >> also increase write amplification.
>> >> >>
>> >> >> So to summarize:
>> >> >> * Adjust compression settings to save disk space= .
>> >> >> * Adjust recsize to save RAM.
>> >> >>
>> >> >> -Alan
>> >> >>
>> >> >> >>
>> >> >> >> I tried to give all the details of my t= ests below.
>> >> >> >> Did I do something wrong ? Can you expl= ain the increase ?
>> >> >> >>
>> >> >> >> Thanks !
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >> A) 128K
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >>
>> >> >> >> # zpool destroy bench
>> >> >> >> # zpool create -o ashift=3D12 bench
>> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cb= b8cc3ad4
>> >> >> >>
>> >> >> >> # rsync -av --exclude '.zfs' /m= nt/tank/docs-florent/ /bench
>> >> >> >> [...]
>> >> >> >> sent 241,042,476,154 bytes=C2=A0 receiv= ed 353,838 bytes=C2=A0 81,806,492.45 bytes/sec
>> >> >> >> total size is 240,982,439,038=C2=A0 spe= edup is 1.00
>> >> >> >>
>> >> >> >> # zfs get recordsize bench
>> >> >> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 = VALUE=C2=A0 =C2=A0 SOURCE
>> >> >> >> bench=C2=A0 recordsize=C2=A0 128K=C2=A0= =C2=A0 =C2=A0default
>> >> >> >>
>> >> >> >> # zpool list -v bench
>> >> >> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0F= REE
>> >> >> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG= =C2=A0 =C2=A0 CAP=C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> >> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0226G=C2=A0 2.50T >> >> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 = =C2=A0 ONLINE=C2=A0 -
>> >> >> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab= 91-c8cbb8cc3ad4=C2=A0 2.72T=C2=A0 =C2=A0226G=C2=A0 2.50T
>> >> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 8.10%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 = =C2=A0 ONLINE
>> >> >> >>
>> >> >> >> # zfs list bench
>> >> >> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2= =A0 =C2=A0 =C2=A0REFER=C2=A0 MOUNTPOINT
>> >> >> >> bench=C2=A0 =C2=A0226G=C2=A0 2.41T=C2= =A0 =C2=A0 =C2=A0 226G=C2=A0 /bench
>> >> >> >>
>> >> >> >> # zfs get all bench |egrep "(used|= referenced|written)"
>> >> >> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2= =A0 =C2=A0 =C2=A00B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0= =C2=A0 =C2=A0 1.80M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 -
>> >> >> >> bench=C2=A0 usedbyrefreservation=C2=A0 = 0B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> >> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 logicalreferenced=C2=A0 =C2= =A0 =C2=A0226G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> >> >> >>
>> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd= 128K.zdb
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >> B) 1M
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >>
>> >> >> >> # zpool destroy bench
>> >> >> >> # zpool create -o ashift=3D12 bench
>> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cb= b8cc3ad4
>> >> >> >> # zfs set recordsize=3D1M bench
>> >> >> >>
>> >> >> >> # rsync -av --exclude '.zfs' /m= nt/tank/docs-florent/ /bench
>> >> >> >> [...]
>> >> >> >> sent 241,042,476,154 bytes=C2=A0 receiv= ed 353,830 bytes=C2=A0 80,173,899.88 bytes/sec
>> >> >> >> total size is 240,982,439,038=C2=A0 spe= edup is 1.00
>> >> >> >>
>> >> >> >> # zfs get recordsize bench
>> >> >> >> NAME=C2=A0 =C2=A0PROPERTY=C2=A0 =C2=A0 = VALUE=C2=A0 =C2=A0 SOURCE
>> >> >> >> bench=C2=A0 recordsize=C2=A0 1M=C2=A0 = =C2=A0 =C2=A0 =C2=A0local
>> >> >> >>
>> >> >> >> # zpool list -v bench
>> >> >> >> NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE=C2=A0 ALLOC=C2=A0 =C2=A0F= REE
>> >> >> >> CKPOINT=C2=A0 EXPANDSZ=C2=A0 =C2=A0FRAG= =C2=A0 =C2=A0 CAP=C2=A0 DEDUP=C2=A0 =C2=A0 HEALTH=C2=A0 ALTROOT
>> >> >> >> bench=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02.72T=C2=A0 =C2=A0232G=C2=A0 2.49T >> >> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 =C2=A0 =C2=A08%=C2=A0 1.00x=C2=A0 = =C2=A0 ONLINE=C2=A0 -
>> >> >> >>=C2=A0 =C2=A0gptid/3c0f5cbc-b0ce-11ea-ab= 91-c8cbb8cc3ad4=C2=A0 2.72T=C2=A0 =C2=A0232G=C2=A0 2.49T
>> >> >> >>=C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A00%=C2=A0 8.32%=C2=A0 =C2=A0 =C2=A0 -=C2=A0 = =C2=A0 ONLINE
>> >> >> >>
>> >> >> >> # zfs list bench
>> >> >> >> NAME=C2=A0 =C2=A0 USED=C2=A0 AVAIL=C2= =A0 =C2=A0 =C2=A0REFER=C2=A0 MOUNTPOINT
>> >> >> >> bench=C2=A0 =C2=A0232G=C2=A0 2.41T=C2= =A0 =C2=A0 =C2=A0 232G=C2=A0 /bench
>> >> >> >>
>> >> >> >> # zfs get all bench |egrep "(used|= referenced|written)"
>> >> >> >> bench=C2=A0 used=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 referenced=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbysnapshots=C2=A0 =C2= =A0 =C2=A0 =C2=A00B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbydataset=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 usedbychildren=C2=A0 =C2=A0= =C2=A0 =C2=A0 1.96M=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 -
>> >> >> >> bench=C2=A0 usedbyrefreservation=C2=A0 = 0B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0-
>> >> >> >> bench=C2=A0 written=C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 logicalused=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0-
>> >> >> >> bench=C2=A0 logicalreferenced=C2=A0 =C2= =A0 =C2=A0232G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0-
>> >> >> >>
>> >> >> >> # zdb -Lbbbs bench > zpool-bench-rcd= 1M.zdb
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >> Notes:
>> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> >> >> >>
>> >> >> >> - the source dataset contains ~50% of p= ictures (raw files and jpg),
>> >> >> >> and also some music, various archived d= ocuments, zip, videos
>> >> >> >> - no change on the source dataset while= testing (cf size logged by resync)
>> >> >> >> - I repeated the tests twice (128K, the= n 1M, then 128K, then 1M), and
>> >> >> >> same results
>> >> >> >> - probably not important here, but:
>> >> >> >> /dev/gptid/3c0f5cbc-b0ce-11ea-ab91-c8cb= b8cc3ad4 is a Red 3TB CMR
>> >> >> >> (WD30EFRX), and /mnt/tank/docs-florent/= is a 128K-recordsize dataset
>> >> >> >> on another zpool that I never tweaked e= xcept ashit=3D12 (because using
>> >> >> >> the same model of Red 3TB)
>> >> >> >>
>> >> >> >> # zfs --version
>> >> >> >> zfs-2.0.6-1
>> >> >> >> zfs-kmod-v2021120100-zfs_a8c7652
>> >> >> >>
>> >> >> >> # uname -a
>> >> >> >> FreeBSD xxxxxxxxx 12.2-RELEASE-p11 Free= BSD 12.2-RELEASE-p11
>> >> >> >> 75566f060d4(HEAD) TRUENAS=C2=A0 amd64
--000000000000a5311a05d5dcfcb3-- From nobody Tue Jan 18 16:07:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 29BBC1955713 for ; Tue, 18 Jan 2022 16:08:01 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: from mail-yb1-xb2d.google.com (mail-yb1-xb2d.google.com [IPv6:2607:f8b0:4864:20::b2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdYb42Py0z4RY7 for ; Tue, 18 Jan 2022 16:08:00 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: by mail-yb1-xb2d.google.com with SMTP id g81so57378698ybg.10 for ; Tue, 18 Jan 2022 08:08:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivoire.fr; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=naUV5oBg52bgYCAF6KokXASrXnJuwOpf78huXhBTHCU=; b=hDIUkunJrb78+bWwiYSyxZgZedcz/JsRHLgTgRlnFvGdPhy1LAlapHoOr761h0vxvE noGkQRIQ5pyqM6sMINj/4Ynw+Zy72gbIPzTQQAp+QHR+BpItNBkFhzwHinnlFOSyBZwR Bpo6pWGsyi9+uGvv2/HelJb2+C5dgiTO7cpk3B+s2had67uv7ykzvbl2hdw0NN/VXBCg SuiHtR9t4JHvE4byVsEE+Mk0zs83lWXR/407ZMjxdwpqu2V8V09YDQ+7jhtZeA8kZj2C jpDKh6owfrc3yg6P4ZO5lBuV0Bj5XyjS86bDj0HHU+Sdp7udcCQ8Q/sgt/bbDxxwsIyc Zn/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=naUV5oBg52bgYCAF6KokXASrXnJuwOpf78huXhBTHCU=; b=ZWO7odwez4kBF22HH0tCrS/9m2QPOEh8xLKmyITu5efBAuNtg8fMOb40GWjf9ZT0tN shLhFTYG5zQKVyeDNubhA44lymwhMQkdbSyy9ol+ThWqt+so2v0kcuTnYkNS4rWmELhL eZAAQ6RUXi/wNBN72v3ibQmwsUxNmzX2/CoUUYYDzKxQ0Rm/ZAdsM92Nn4rVYxlo2SZ9 BCvesS9dA6FAd1xlTBouG6fFp8rQdvuAD/go+B0v2M+4ujf/gbalO54nRIr4grvk1i0b //GwnVyd4og8imKL6VJR/MgZ97QPWxqpreoG/1iv/IXXEoUwCixIMM5ofZFBPunguDOw fskg== X-Gm-Message-State: AOAM531ebeV1ktnVAoxZ0+1upR+dPNHXoxeFaL7zWuWqRnPJf3Dsw4Om EkmjvhNG+9ikNMcVsaljuhfbQL/U9knP4HRPQEn9ag== X-Google-Smtp-Source: ABdhPJyvPILTIkrpK7RjJoQyesKQ56I0UJdU1IxYunBb+jkCDswIjXSieTVkXhqaLJ0SrONPSLVXmKJh+n/Un7VQINg= X-Received: by 2002:a05:6902:1027:: with SMTP id x7mr34607724ybt.427.1642522079464; Tue, 18 Jan 2022 08:07:59 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Florent Rivoire Date: Tue, 18 Jan 2022 17:07:48 +0100 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Alan Somers Cc: Rich , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4JdYb42Py0z4RY7 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rivoire.fr header.s=google header.b=hDIUkunJ; dmarc=none; spf=pass (mx1.freebsd.org: domain of florent@rivoire.fr designates 2607:f8b0:4864:20::b2d as permitted sender) smtp.mailfrom=florent@rivoire.fr X-Spamd-Result: default: False [-3.49 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[rivoire.fr:s=google]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[rivoire.fr]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[rivoire.fr:+]; NEURAL_HAM_SHORT(-0.99)[-0.992]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2d:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Tue, Jan 18, 2022 at 3:23 PM Alan Somers wrote: > However, I would suggest that you don't bother. With a 128kB recsize, > ZFS has something like a 1000:1 ratio of data:metadata. In other > words, increasing your recsize can save you at most 0.1% of disk > space. Basically, it doesn't matter. What it _does_ matter for is > the tradeoff between write amplification and RAM usage. 1000:1 is > comparable to the disk:ram of many computers. And performance is more > sensitive to metadata access times than data access times. So > increasing your recsize can help you keep a greater fraction of your > metadata in ARC. OTOH, as you remarked increasing your recsize will > also increase write amplification. In the attached zdb files (for 128K recordsize), we can see that the "L0 ZFS plain file" objects are using 99.89% in my test zpool. So the ratio in my case is exactly 1000:1 like you said. I had that rule-of-thumb in mind, but thanks for reminding me ! As quickly mentioned in my first email, the context is that I'm considering using a mirror of SSDs as "special devices" for a new zpool which will still be mainly made of magnetic HDDs (raidz2 of 5x3TB). And to really take advantage of those SSDs, I'm probably going to set special_small_blocks at a value > 0. Of course, I don't want to put all data on SSDs, so I need to keep "special_small_blocks" strictly below "recordsize", so that ZFS splits objects into 2 groups: the "small"=>special-vdev, vs the "rest"=>main-vdevs. So basically, I see two kind of solutions: 1) keep default recordsize (128K), and define a fairly small special_small_blocks (64K, or 32K) 2) increase recordsize (probably to 1M) and be able to define special_small_blocks higher (maybe: 128K, 256K or 512K, I'm testing) I'm leaning towards the 2nd option, because : - it allows a higher percentage of data into the SSD (solution 1 is only storing ~0.1% of data on SSDs, vs solution 2 with 512K small_blocks is ~0.3%, and my SSD will have 3% of HDD's vdev capacity) - the "high" recordsize of 1M looks good for my use-cases (files usually between MBs, and 100's of MBs, written sequentially, and never overwritten, so no risk of write amplification on this dataset) So, my goal is not to optimize disk usage (indeed: 0.1% is nothing), but to optimize read/write performance at a small cost (using small SSDs as special). And also, it's more to do some tech experiments on ZFS (because it's fun, I'm learning and it's my home-nas) than for a real need :) -- Florent From nobody Tue Jan 18 16:51:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2BF7619521D6 for ; Tue, 18 Jan 2022 16:51:55 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdZYl05h0z4l2X; Tue, 18 Jan 2022 16:51:55 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642524715; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=VyxaVoZ+Om1tR+ra5OGiHvXOOcuNK7QfhjONwEpyWOk=; b=NRwBkY9bW7NU4zolTgtarV887oGDT/bFkSTpoxhQ0gPK1N/aLXIvZWGV+beputxd0NzqUx Vm5M1hMwYRZIDxNHJ+LDmRE2CS+DpUDXhih6KV++9wUrFleTN5D94WXUvn6B0Nbuxyxa2q XAmtbCCGl7RnqQAU/YoNFWHbmbbULMzcMYAYdV7vvBWCKuYHlM2cFSTuaVUEYjDb34Jxts UrCl0nvoNeoVsSRnlMdxL4tzwo7TFFbKpLJ7dWuPlG/Jt34XJ8uNKjjzwVatyPEHplsfy9 eAakLkHk33GLU2t80u5yUJuG7DJciC63ebIPeA1dRDpAGbppqe85eeuumIluZw== Received: from [IPV6:2003:cd:5f13:2400:7e:3a19:e7c9:e2e1] (p200300cd5f132400007e3a19e7c9e2e1.dip0.t-ipconnect.de [IPv6:2003:cd:5f13:2400:7e:3a19:e7c9:e2e1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 3EBE729518; Tue, 18 Jan 2022 16:51:54 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: Date: Tue, 18 Jan 2022 17:51:49 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it Content-Language: en-US To: Florent Rivoire Cc: Rich , freebsd-fs , Alan Somers References: From: Stefan Esser In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------E05brz3x5OqYb0hq0WY09h7h" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642524715; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=VyxaVoZ+Om1tR+ra5OGiHvXOOcuNK7QfhjONwEpyWOk=; b=TuiW5JfjfQXyzeueoUfHDBCgHrNph+zwEQTM7M1kZsE9ouDxZz5A31l/KhNoWBXBVj8JnZ en3oXi4W4UbK+66POb53SdtRYH2G7mAnOMEljrzJ3IqGFi4d3d/bKNd7ZRj94K0MouaKT8 fzGuZOAKYIyorw37jVdOLnMLAfQ3qQUqpj4y534/SHkLbmYWhdeFF1qzF29WkLocJ6S5DF tlQ1OBL8FUgItelitI35tvpMtDTcmHLpq4vKacU+hITxVOnc1XPMuOvT/9/1s51wm8ZVF5 k4OeSWzRTHYkGDApWFZ1na+FapOYSpuCT3MahkZC9f5JRSdRBoE/1Y6PL7T4jA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642524715; a=rsa-sha256; cv=none; b=asP2ArMvYhckUMoljPVQvq/ioZB5Fot8si31afAqtC3JpquxMlNaNw3VcfPpG1lQ8LpDQJ VXvadO2DErAqFTby73WFJn18GEIikXN/Xbik+xMGWcPhPeZI20eiVI0Edkjgv7laxUWJPc vFPG9ZTBYyDnXiyIemaJRH4YRnwiU1dthhLBLzPeIk2nq8koQziJAlRO7mXrXpfFvJcCZY 0Oi4p/6Xjr6IEUZWQWHxlhOvOvN0QHfhpyhLwe909sGccLa2s2RxNA+Pm90blL0o8GNf44 fJvLoyqmBkjF/8yWFpYKl+15LEvwocMGQ1YR0UcrdjP0n/rX9OVivv7tKueirA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------E05brz3x5OqYb0hq0WY09h7h Content-Type: multipart/mixed; boundary="------------zQpsYyDXtdhILUIXo9qcTpjX"; protected-headers="v1" From: Stefan Esser To: Florent Rivoire Cc: Rich , freebsd-fs , Alan Somers Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it References: In-Reply-To: --------------zQpsYyDXtdhILUIXo9qcTpjX Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 18.01.22 um 17:07 schrieb Florent Rivoire: > On Tue, Jan 18, 2022 at 3:23 PM Alan Somers wrote= : >> However, I would suggest that you don't bother. With a 128kB recsize,= >> ZFS has something like a 1000:1 ratio of data:metadata. In other >> words, increasing your recsize can save you at most 0.1% of disk >> space. Basically, it doesn't matter. What it _does_ matter for is >> the tradeoff between write amplification and RAM usage. 1000:1 is >> comparable to the disk:ram of many computers. And performance is more= >> sensitive to metadata access times than data access times. So >> increasing your recsize can help you keep a greater fraction of your >> metadata in ARC. OTOH, as you remarked increasing your recsize will >> also increase write amplification. >=20 > In the attached zdb files (for 128K recordsize), we can see that the > "L0 ZFS plain file" objects are using 99.89% in my test zpool. So the > ratio in my case is exactly 1000:1 like you said. > I had that rule-of-thumb in mind, but thanks for reminding me ! >=20 > As quickly mentioned in my first email, the context is that I'm > considering using a mirror of SSDs as "special devices" for a new > zpool which will still be mainly made of magnetic HDDs (raidz2 of > 5x3TB). Why don't you use the SSDs as L2ARC and let the system place often used data and meta-data in that cache? I'm using 1/2 TB of a 1 TB SSD as L2ARC for a pool of comparable size, and with the persistence offered by OpenZFS it is already filled with relevant data when the system boots. With zstd-2 compression I get a compression ratio of typically 2 to 3 for my data, which makes the SSD effectively hold more than 1 TB, since the L2ARC stores compressed blocks. (BTW: The L2ARC meta-data is kept in the ARC, therefore too big an L2ARC can reduce the amount of RAM available for other data in the ARC and for programs more than it helps ...) After 1,5 years, smartcl reports 14 TB written, which is a small fraction of the specified write resilience of my SSD (less than 3%). In my work-loads I see an ARC efficiency of about 98,5% and a L2ARC efficiency of 80%, resulting in 1/5 of 1.5% =3D 0.3% of disk reads actually being served by the rotating disks. Regards, STefan --------------zQpsYyDXtdhILUIXo9qcTpjX-- --------------E05brz3x5OqYb0hq0WY09h7h Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmHm8CUFAwAAAAAACgkQR+u171r99UQR 7wf+Mz5+XiTE/GvC5UPPD9EZW7YmYQLeoSHBZ5mbBi+r1Je8n+nPler6eZbHvuD86YfI41FzVALP 2lRyXDZFb/CymamDbVAiZaFAWpQNoXho/2l1dzZOwT3zvYbO5VYuNvXZlqvGRYmR71DfSdp7HnZA 89si23od13P+eE+NdCj66CLR9KzXX0+J/EbgwGE4tHSrwRYj9y6AOjmZo/F93AdGo1TTHbAGyAc0 +lPGNbTreXfyxN+Mc7+GAqWn7G1qemOH1dAGn7k1FyRjXa7BLtIhs1TszmzAkATNI5w2ZJiTSU7S NRvpmNQp3CYc6Rz7xdjfWtTle4/imog+B/r3sUvsmQ== =+381 -----END PGP SIGNATURE----- --------------E05brz3x5OqYb0hq0WY09h7h-- From nobody Tue Jan 18 20:29:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0CCC4196D6FA for ; Tue, 18 Jan 2022 20:29:58 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x734.google.com (mail-qk1-x734.google.com [IPv6:2607:f8b0:4864:20::734]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdgPK1hGcz3FZH; Tue, 18 Jan 2022 20:29:57 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qk1-x734.google.com with SMTP id a21so444207qkn.0; Tue, 18 Jan 2022 12:29:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=v/DJvhhcWDGgFO2mkHGNR3IdmGj6qBtBuN4V0G/ZTFE=; b=NFVp5AZ/D5NrizbznI2zrF5E1Ncd9KkdufG093g9+BC6lUyas1AwFQQNVF6Y/58jc/ Tbk4kmEtk2VHH6Fp/3khg7QS7nl6YLx3x/fnadepwtj828w0WV05y78Rgttf3EXruxA7 v/wiwcH36nzWgvngRz/BTj/2OZUK7xzYWfXJhPEa9CXYsURX3De7jVqyL68UUvTBJbrS IPU9K/Dbm/KwDbcmUcFmn+pg15HExg1etC4/Y3ymJ8Nb6Zn2kWPtQKxilxG4Il+uADXs COB7HZyUQt1+Ek3bj3lvcN4RixUsK5afTIUx3eTN1amRVYU3XqT0ljUAMIbFVglS91uL 4y0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=v/DJvhhcWDGgFO2mkHGNR3IdmGj6qBtBuN4V0G/ZTFE=; b=X6BLCn6pYgogFgUMYTEKOjcSdaxNF5kWrsHCY4MZdRu6XkNwwneTb4keqpe8bbUs8L fE8xlaV9184+e+sNblzxPOE75ZtCsEKfsIT6KFt9BeLVZtCyCbdjrXGP+NPBUUrbUEkK MCtnyGK2Zz4ylIEghYC54SNYMpO/K8c8MH3rIbMvTcpzfdGgnbv76t0CSNgMZv5m5mIb MvJa1mdf+cfNzW9OZs4/fc7VaCfTSNRM0YUNtT1Rodnt63rOXjLclfusMiJ7oKSHJkSs lvpQzDwPcX4yConQJ2utBb7p6YUAXcruSYmYekpcMXeVJTakbUPXNHTfOCRx8kYJw+Fo CaHA== X-Gm-Message-State: AOAM532LyKR2b9HXEQIhazul5mQffeQC5qEHTyGhwOU1GUp7CWwZIvXI YmjysSvMIckEW+wcyoaucyv5BpZVZnI= X-Google-Smtp-Source: ABdhPJz1lOgyo4o4HPzHs8amavRhR8o4RLiEwJbKFLJvVjH61LxCHiK/nFbNLI2S7vz6zB4m0ihppA== X-Received: by 2002:a05:620a:424c:: with SMTP id w12mr19583873qko.563.1642537791611; Tue, 18 Jan 2022 12:29:51 -0800 (PST) Received: from nuc (198-84-189-58.cpe.teksavvy.com. [198.84.189.58]) by smtp.gmail.com with ESMTPSA id t2sm7886265qtx.10.2022.01.18.12.29.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 18 Jan 2022 12:29:50 -0800 (PST) Date: Tue, 18 Jan 2022 15:29:48 -0500 From: Mark Johnston To: Chris Ross Cc: Andriy Gapon , freebsd-fs Subject: Re: swap_pager: cannot allocate bio Message-ID: References: <6DA63618-F0E9-48EC-AB57-3C3C102BC0C0@distal.com> <35c14795-3b1c-9315-8e9b-a8dfad575a04@FreeBSD.org> <471B80F4-B8F4-4D5A-9DEB-3F1E00F42A68@distal.com> <8DA407FF-0895-4ED6-8495-86F00556DD7F@distal.com> <3B7FAFF1-9EA3-42C7-B7C7-82B3239A39C6@distal.com> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <3B7FAFF1-9EA3-42C7-B7C7-82B3239A39C6@distal.com> X-Rspamd-Queue-Id: 4JdgPK1hGcz3FZH X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="NFVp5AZ/"; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::734 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-0.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[freebsd]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::734:from]; MLMMJ_DEST(0.00)[freebsd-fs]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, Dec 31, 2021 at 09:08:48PM -0500, Chris Ross wrote: > > > > On Nov 25, 2021, at 00:18, Chris Ross wrote: > >>> On Nov 20, 2021, at 13:23, Mark Johnston > wrote: > >>> > >>> Here is a patch which tries to address the proximate cause of the > >>> problem. > > > > > The system is still cooking along, running the job that previously was > > causing it to get stuck after 48ish hours. It’s been running more than > > 80 hours now, so a definite improvement. > > > > zfs-stats reports things as stable, 80% cache hit ratio, 64GB max arc, > > ~85% of that currently as “adaptive target”. If there’s anything you > > would like to get from the system, data-wise, let me know. Happy to > > share, and help get this fix, or a different better fix if needed, into the > > tree. > > Hello all. Just was curious if anyone had a different solution for the > problem I was seeing, or if not, if the patch from Mark that I manually > applied can be integrated to the tree for current, and MFR’d to 13. > > Thank you. Please update me as to the current status of this issue, > so I don’t update and lose functionality at some later point. :-) Sorry for the delay. I submitted a pull request to openzfs which fixes the problem in a different way: https://github.com/openzfs/zfs/pull/12985#pullrequestreview-855857099 I expect it will be merged in some form soon, and merged into FreeBSD within the next several weeks. I still see some problems around low memory handling on NUMA systems when the ARC consumes most of RAM, but these aren't particularly related to the deadlock. More specifically, under severe memory pressure the page daemon will shrink UMA caches asynchronously, but the pages freed this way are not counted as frees by the page daemon, which may thus conclude that it's not making progress and trigger an OOM kill. Further exacerbating the problem is that the ARC's grow_retry constant was changed from 60s to 5s by default with the OpenZFS, which is smaller than the default lowmem period (10s). This makes it easy for the page daemon to fall behind its target, causing the integral term of its PID controller to grow quite large. The page daemon then goes into overdrive even though the instantaneous magnitude of the domain's page shortage is quite small. From nobody Wed Jan 19 08:44:34 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 582B0197126A for ; Wed, 19 Jan 2022 08:44:52 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: from mail-yb1-xb2a.google.com (mail-yb1-xb2a.google.com [IPv6:2607:f8b0:4864:20::b2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JdzjH5D4Qz4vf0 for ; Wed, 19 Jan 2022 08:44:51 +0000 (UTC) (envelope-from florent@rivoire.fr) Received: by mail-yb1-xb2a.google.com with SMTP id m1so5242954ybo.5 for ; Wed, 19 Jan 2022 00:44:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivoire.fr; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=RC7DXZ4m1b7MbXlFekh1/fKP9fKF8XU+YA9nGbKhpL8=; b=TppGPqqdg4TaHXGai5QZ5v9bOCcumVHmlApxGr5qDLow5ewHZ7LEvaP5CWJYACRz5/ mDzuHTAAZDndkRBkTpnHqw7jJyAgSo7IKTiivROt25+SnxmP2Uq/S/TRYtnMoz6cwxIz 3Ao8GQwWqFJWJfagPzyca5AvLNw6Gn7HkIG7RSpMpUAQ9LhFqPz+kmMUQEmL0Erq4g0J +XgDjI9eQ5q6Fme0i5NB5enHEZyQ1Sd75/X/FJFWZzwMVJlaEsyZKnD3P5HrWeCx4x1+ 9/vI+NL0T/LBMEKE+gFF/GRkJO2wH/+UcOFWnjqJc/9vlr3bw+9vnJ0QVayKSG9u+GdB xR1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=RC7DXZ4m1b7MbXlFekh1/fKP9fKF8XU+YA9nGbKhpL8=; b=UHt3h0eAbvuvjYVAciMi/rQjvpkVVIYkrQtqwveXzzkvcRZpMJawivAGyDgSdMIvEh HrXW5gl8rPoqpveefB6/PIcRiAmx91SnR9mWUTj/Qltq+m/8iMTvTKIgSSCcdFYwaAJ9 zMQTbiteCFcimBFuAt56Biq7Jd+zJdP1RhZS4eunZimwTEcZaBDvhmC/i9M7+3KsksHu CvgsITJZ0qfwEc5VrvGRzXOFLTTzH7+Tto3AY+qrZ7+X5kwadfVebb4flLbeLjPzAyG6 mbneOLu5zdoiwiMhPwinCLB2NVM8/IJSqYi4rDBZOXE5/rJMCmIUqnAS0us4ARxBEVzC l9+g== X-Gm-Message-State: AOAM531t5t7rIPMtyjkkBBBaBYPlqF/v0FtyYOV1TdZiDN84ELbooGv/ uJdaAX6yDxwiYujVtmO/HiHij0PhWxBu5MrSJgkHL33f8HokVg== X-Google-Smtp-Source: ABdhPJxQ7JcaBDndLERVN2mg8dBXPgCXhLPiHrDjHc3slN5PJi1QRHb/QIkBKQqQoVq6dUPELMFbDf70PUcswMC8lHQ= X-Received: by 2002:a25:d608:: with SMTP id n8mr9988683ybg.591.1642581885068; Wed, 19 Jan 2022 00:44:45 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Florent Rivoire Date: Wed, 19 Jan 2022 09:44:34 +0100 Message-ID: Subject: Re: [zfs] recordsize: unexpected increase of disk usage when increasing it To: Rich Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4JdzjH5D4Qz4vf0 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rivoire.fr header.s=google header.b=TppGPqqd; dmarc=none; spf=pass (mx1.freebsd.org: domain of florent@rivoire.fr designates 2607:f8b0:4864:20::b2a as permitted sender) smtp.mailfrom=florent@rivoire.fr X-Spamd-Result: default: False [-0.10 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[rivoire.fr:s=google]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[rivoire.fr]; NEURAL_SPAM_MEDIUM(0.40)[0.404]; NEURAL_SPAM_SHORT(1.00)[1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[rivoire.fr:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2a:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Tue, Jan 18, 2022 at 3:23 PM Florent Rivoire wrote: > I didn't think at all about compression (which I know exists and > usually has very positive impact) during my tests... > and it's indeed disabled in my tests (I'm only seeing it now): I did my tests again: exactly the same procedure as my initial email, just adding `-O compression=lz4` in zpool create. And now, the allocated size of disks (shown by zpool list) is the same in both cases (128K & 1M recordsize): 224G. So, good news :) Note: we can still see a difference in the "logicalused": 226G vs 232G (those are the allocated sizes that I had with no compression): recordsize 128K: ----------------------- # zfs get all bench |egrep "(used|referenced|written)" bench used 224G - bench referenced 224G - bench usedbysnapshots 0B - bench usedbydataset 224G - bench usedbychildren 1.83M - bench usedbyrefreservation 0B - bench written 224G - bench logicalused 226G - bench logicalreferenced 226G - recordsize 1M: ----------------------- # zfs get all bench |egrep "(used|referenced|written)" bench used 224G - bench referenced 224G - bench usedbysnapshots 0B - bench usedbydataset 224G - bench usedbychildren 1.88M - bench usedbyrefreservation 0B - bench written 224G - bench logicalused 232G - bench logicalreferenced 232G - -- Florent From nobody Fri Jan 21 04:43:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9BC2D1970172 for ; Fri, 21 Jan 2022 04:43:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jg6G52Xwpz4kpZ for ; Fri, 21 Jan 2022 04:43:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3775B15998 for ; Fri, 21 Jan 2022 04:43:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20L4hfBu068928 for ; Fri, 21 Jan 2022 04:43:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20L4hfJD068927 for fs@FreeBSD.org; Fri, 21 Jan 2022 04:43:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 220604] Kernel panic when deleting ZFS snapshot Date: Fri, 21 Jan 2022 04:43:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: heppner.mark@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642740221; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=USYnERfMn92v1/rJlnc2EeNKf5zkTl1FEcwZbHB+9s8=; b=vPuzHGlP/IFoRrUD86bF8+ONtG1+00IAPwleAXa4W/hi2sIdn5QRCjwzShXVahMSCPS6rI VmYbEyDFAQdTpS7futqsSP3Pvee3XKGZLX4uA0Rb9PVzGsCW+sq7gNcTwXLMGDskErhMGn wOBfoYXYBgay/PjapDhL0GUwxm0RULHL70n/Srl6wVUGpsf/KpWw0p4p/tpXRZWou4N++Z qBiGbSMTSvmHvSMrRW8xaAfUobZ2+SgSVAXcVPjtKOgpmTHUlObrTrTn/lfjarhwUeJUpY marQd+619HBQGLsLhmZEEkuNwiINkDJsdk8Uwvl/804SDFsAtSJROS+WFzrZZg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642740221; a=rsa-sha256; cv=none; b=AKe5+A5B9OLCELUvNu7OMl4IL5DmO7QeUJKCnK80bCqR7ovQN+7th7xxiKIeYzxUUzL4Xm pXVl/5XdT2Wr2vaBrx4+9XpMwRPJ3JgHrO96KfjiYRsT4N/7/d7fzvtHclTkMne1Zoi7Q/ jfekGJ6y3ES4Iqq17V56MWwwdgXgzcFkQpRztDiu+9G5w033cbk77f6q9P1ieuakOg/O7k u3BT6Sr7hvIBeGQjCfVzRwbI/lD2j7tWTEdyX9qtwSaUKW7yO/l9tzD4hQflj5Sxljl7uw OmmEpPrRDAVr2ORrmhTUgLHwnZ6VXMPYqcUBO7Cg8uy4KIS2FsG40FFDDRQ32g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D220604 heppner.mark@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 21 08:23:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AE868196BDF3 for ; Fri, 21 Jan 2022 08:23:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JgC821nlGz3h5g for ; Fri, 21 Jan 2022 08:23:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0BB2D18A6A for ; Fri, 21 Jan 2022 08:23:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20L8NjYG095450 for ; Fri, 21 Jan 2022 08:23:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20L8NjMM095449 for fs@FreeBSD.org; Fri, 21 Jan 2022 08:23:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Fri, 21 Jan 2022 08:23:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642753426; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JFACKgHHcm0zZhL75JQR9tb9z6s95mimeFYlKGpxYtA=; b=B2LbsXoeAzz69VqaC5jY3BNabOkf8MY+mjAhQVAgk3bRsa9JConu7RrFAHn+bUle7zdQE+ 02oYoIZAEvlVZdx7mpO4AuxbaWkX5m3X0XFZjOrDsRzs62BM7EbKYCj/Fm4htrZWgbVzIr e2yMX/wWbGKZugTn/m0AUxJqTX0U9W23wKvLcslRj+4RSSfY9GUya5bNGA+GAY5rRfzbr7 c9rp5c1h6SsJqtD1/ki/JXqnboR4SONKA7A8iYYRqF0c47U1hZbWCGC2E/kA3UyiJr7oSl MZmlMDLDiwgwAvKK0HPdG/5LNOQMEASOXZ3az4ZgEEdksC3W36TRUQBuSxvh+A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642753426; a=rsa-sha256; cv=none; b=UEwr1jN7PO2aW8Yl2UCvSIC8i4AETBoK1IiIclcxw2DafUcbR5J5gsBSUEwgeXiC/a+Msu W0H2CHvOFp6Nf50fMuNibuTeIu/lJQazH3WbWvZK2nA/lddSgyX/x9QR9Ci+TUAAFaolcP FA9wpj0ap82Os/fruCeGZiUKH/T/3bW7p3wQ8esbTW+nGwYm0bxq2NYxDCh/mzq0N3qaPh 9MQkygLiSGajk+wEf9idgj+Ihud1F4gZHa1ger7mPPWYrp8dPm70d9GACQdy0DygWgHeCO eli3fLBmkGx3qPi/hZ4/IlFQb+/z4ykeyWD/sARCyYlmhEap+Pthv3qYOeyRqg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 zmey20000@yahoo.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |zmey20000@yahoo.com --- Comment #4 from zmey20000@yahoo.com --- If nobody is on the case, I can provide a solution for review in a few days. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 21 13:58:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 56B541964324 for ; Fri, 21 Jan 2022 13:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JgLZ111L7z3LKP for ; Fri, 21 Jan 2022 13:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F2B581D097 for ; Fri, 21 Jan 2022 13:58:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20LDwGFi074281 for ; Fri, 21 Jan 2022 13:58:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20LDwG9X074280 for fs@FreeBSD.org; Fri, 21 Jan 2022 13:58:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Fri, 21 Jan 2022 13:58:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642773497; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=z4CMLW62wfqPCNYtPj1EMJn9pJdtCBt7/e6fw4TRkIw=; b=NEtuJWhLDR/YI0WzTCHcdkcsTku3Rm+6gNyV8NwZaN3grmnI6oRjuBXvJxfbVlufEgwFsX g8hsj5/o4Pvpng+evKqfVIjt5D3lkXZnYhWCQ7/PUSUHDqhYGgyRwcZP50VS83sdZX90F7 99udgU80DeSER6OPAnVhyQrXRAjrWVwFrIvqevs7eZUFQCJp8/f/4NFdA5lDcRHnUaRK46 QpwY6zEDo92ssewPLiuBWjK+zdqzEWBc0Ytihxa8RMk9RqXLAibdduAGMD/Bl34fnct6BA XlJPhXdWkP1hTrRz3QgXSzb+hFAdR3Koc1/OxU1E/tJgMIsn80wbp3hc9hhSpQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642773497; a=rsa-sha256; cv=none; b=pC8XVm34XHkaRcusgf6UjLDnl7tL+6uDhYycCUrN2ODnQUOmuEm6zyO79aWAVG/6y/rbDb r2tIc9LUYhaI6MJG2T2UFM99Xkf0+p6dk+7j8FzH2ePcfSdWXV01i2FxI5zdDrbDa34kPa F85uwE1bgbEpkzSAlTuGS/U9qcJ9n9K1GAUfF0Usrjbqsve8xql/u+YC47J2+ksYbZmytz FPiUTcodIb2UnFlShsrkb+D1OMhgh1PoKjYKGP5lJSLjh2VuHoXlBd5YcWsZ6/srSAW1eH QivM1LqGxNcSkeJvDpUwX/8IGkZqtywq69RzQwd1SShx7lAskktBwSo2/k6rhA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #5 from zmey20000@yahoo.com --- Created attachment 231211 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D231211&action= =3Dedit ZFS: support booting from gzip-compressed volume Unfortunately, I'm not a committer, so here is a diff of the patch I made a= nd tested in the UEFI environment. Also, here is a link to the Pull request in Github, if you prefer it: https://github.com/mezantrop/freebsd-src/commit/36e08c053273e0b4d8f0bbee5cd= 53450c3e80ea2 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 22 16:00:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 548EF19752D7 for ; Sat, 22 Jan 2022 16:00:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jh1Dh0Xm0z4hfs for ; Sat, 22 Jan 2022 16:00:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D7C47121BC for ; Sat, 22 Jan 2022 16:00:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20MG0ZLa001939 for ; Sat, 22 Jan 2022 16:00:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20MG0ZBR001938 for fs@FreeBSD.org; Sat, 22 Jan 2022 16:00:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207535] LOR in UFS on FreeBSD 10.3-BETA3 @ sys_fsync Date: Sat, 22 Jan 2022 16:00:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-BETA2 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642867236; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZCk1eczeWpnqKoidko5ZPqtwWd8JHBcWe6k+tpBR4Nc=; b=TbeqxKKwPhUXcm7jKcY2/kkmbmhKqXo0f0kyT3NZtzOjCdrR9WP6ODU/3SXRRhhnQBRO+S AFOMOJ1vqfwqJKFqbUKfyrylg8XRXm6N5ZoUWWh1wlxWmR6O5CW5KuIUJ/+3IDK6uOqg9+ WtoM8471SoJFAxubiSmNJ3mMtxY2fbx9ZlszNXiYanBNFtGgcWQ4xGblX/rYIsSpMP2j4I nQ2bqfTkrETVUstW139QVX5wCRuo8FxtKPSI2xIHzdX7WiVBwCtpi4lQoieMDo/onPfL+O 1pySR6YzgTfYriv4kVVDNmYD5SPJMfYuSrjZlGB9h9J3rCeX4RZVfHRhJWfCLw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642867236; a=rsa-sha256; cv=none; b=oBFO3PV7yej3FWhKCrNehppLFZV5QRYxsewH4JKl2UzoocLg0ONlUK1lbqdUAgPUzaYIcJ DuyMScrfm8u1LPWrXOP0eP13azwmAD9mCHUlcb+8U+Cl9ulEXtRi5elKbFWWgGSdIg6Gmq V8tLxsjlmgRZwp2QTz02HA47/CeiwGW2zK+IsMWLj0S+DYsi73Ef1qyaJR8eeQ/bmyOea5 RKGHirvHg1aRzWDkFNfPo3bFFxIlbuooo0Ca3CT79DP8HqZYnMkMQSPq6yTE3nySQKPYi/ F/9ktsi3Yl1nonz6qfGuz/b8cf2q6gJnEuMyQIAbmOoJKHZniP876HXwkPmTMA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207535 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rew@FreeBSD.org Resolution|--- |Overcome By Events Status|New |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 22 16:01:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 222431976CF9 for ; Sat, 22 Jan 2022 16:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jh1G06KNrz4jsK for ; Sat, 22 Jan 2022 16:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9A10A122BA for ; Sat, 22 Jan 2022 16:01:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20MG1iIx002953 for ; Sat, 22 Jan 2022 16:01:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20MG1iLk002952 for fs@FreeBSD.org; Sat, 22 Jan 2022 16:01:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207533] LOR in UFS on FreeBSD 10.3-BETA3 @ sys_openat Date: Sat, 22 Jan 2022 16:01:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-BETA2 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642867305; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=H5wUckWAvRq8sLmVRZWgZVp0JtbnnULi9r0F59vhdnQ=; b=RNafGzldT/c5EjPK1mf3iDEW6/rYWp+b5tAy0/TjSN6kGGNcSTBODSj5MO2RJZG1c7auxs gIJWzwEGL1A9eTkWO8RbVdRyuRi57xQnUFR8qt9FltBfXKVUe8nwGIttEZl3MznZO9FjNu suAS1COP4AEZqTca2B8FM5N+t56fzmlRos4INEuL5u5myNs8MdFGgNhFx3ZhShhyMvrrZ+ n/eKgVj5kBV9vR3zIVlOwVV5S8b8oTEdcY/OmaN2HDRLo3fBT2OhTJA9sA7GSrk2cNGZ8h 5pizud5vceRmfDw0GCCxnvzzukJbvbHUXQF7Ew1cMHcaBNwQyrEq62Oij0ztkA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642867305; a=rsa-sha256; cv=none; b=KY+cQdn4Te60SOWnG7PROc3dPpZ3FuvieQpunZbZTevCAkT3qtxjXxvWCvhkbPU0t4sE1k 9OMVqNIUYtsi1+GS61yjdQb+DqPb0hgT4ALz5Q/refquoteNUMehkLmW5M3LwObDuAqGjU egeGuW2vpzo2B6csu/D5wI3lEoQcsIeF3I/WrsO4PCPGDx8cR0D+Bot9np7YgVw7lnlOy2 qbPpNNN3sj2HbIOYuClcKbJ+Zo6vKJomXtnbTC66Eiw8AEUnvEmKAPkmDhtk6WnPNVEl97 GKWqrRrkKWjIvaF+YiyK/13fIS0wk3tHGqKO7wrhiAOyHWbIbO3JJSe2FX616A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207533 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Overcome By Events CC| |rew@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jan 22 16:02:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 63445197823F for ; Sat, 22 Jan 2022 16:02:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jh1HC02M6z4kjD for ; Sat, 22 Jan 2022 16:02:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CDC5712177 for ; Sat, 22 Jan 2022 16:02:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20MG2kFG006859 for ; Sat, 22 Jan 2022 16:02:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20MG2kuA006858 for fs@FreeBSD.org; Sat, 22 Jan 2022 16:02:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 201118] A crash when I/O-ing a UFS USB drive and appearing as going through ZFS (which is on the HD /) Date: Sat, 22 Jan 2022 16:02:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642867367; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZqECVEI1u9gBDfsmiP1UeaG5GLfTOUiGxTtykkfjd5c=; b=SD6jmLcNP0BHHvPVnHSyCq66U6cNJpQxicitIhiMwxA/gptSmyBfqsosbQPhg81K7jb1bm /AuzDupsrhAv/tTMlIez9kAaivJqKRSC6diVpgQmj7nIr6s1iwUoXSdqlCrAbW2ALMV96W Pcif1PmUu0H0n2M5ix/42+W24/4mzH4/tek0IV41mxjgCMLVUdd6TH6DRB5mMcYhwY4dwv ur/MNPKJoFigE8miFHfTOsm1zu83pOxYWXmNz5J47sokS25qy7rwtVn3VelayDXVr/SSVJ nfXgy8n/0tMqzOMYjt1ReVLnIvnF4UEOOKJzNAl1zsoMYNh56QmT+c+KZyjqlg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642867367; a=rsa-sha256; cv=none; b=rdA3d7XvfbXzCbRbTXDTp5YzASpWMiHlbo5MjkXz5qUQvgiHIWJorjAUf5rFSs7yimYxbD Gkxyz5bzB65nEKkTDPxHU0EQNU+AAmSVXp0YpAhhEV5J3sA8D1a53ri6qbRYtH1RJtZfq3 W/pjF48O5cM5gICTKMvkcw+FSVdGWQfZF7sIT7WiVHUYeVx+A2UjqR/y648T3RVNFBYb4T A1f/AAYsYJ6RAa1P5LY9P1YLm9hHBGxDrekc+y60iZUCxVaJtquWt6j9GB1QMf5tu2x2zk a90Z1uR4FUl3g7uPRDpcDgVxa+H3L/3H+y+g91rykQJEBEVuKjQhgjjxjBmLHw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D201118 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rew@FreeBSD.org Status|New |Closed Resolution|--- |Overcome By Events --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jan 23 21:00:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A1B0F197533D for ; Sun, 23 Jan 2022 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jhlqt0cFZz3mrL for ; Sun, 23 Jan 2022 21:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3A63A158B for ; Sun, 23 Jan 2022 21:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20NL096C026785 for ; Sun, 23 Jan 2022 21:00:09 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20NL09IY026784 for fs@FreeBSD.org; Sun, 23 Jan 2022 21:00:09 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202201232100.20NL09IY026784@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 23 Jan 2022 21:00:09 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16429716091.c7EA82A5D.25946" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642971610; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Pav5k1reZISUsfqu9sNyInFzt6k+GLZ1Qo2VN8Dy8qM=; b=P57OQC6qxGhPoPRY+37cfAcPGL50a4Fz9EjDYWmFQmQS1R0cWdK3t0CPXoypiHx+aPsGOK YdXBDMjzr3VW69coVv3j+oh8MeLfs0YcZQ/H0nny/fy5rsHS9xWggi+t6EuiQfLjUdGPLe duM3T+EvfclpYZmUAzcXzOn3Dqj8B/maTj6NFgaPGh2I7yM1i8geaiEUnTlNzgJFH5wdpr BaE5vfujzlt6NIt27iaetH5aj0xwI9MTjuBchNuDKh9WaKk8u9K57GQ/wOWfASCFwy1t9o d5CHeGPu/bI0GT6tT1+ajWpGGHHWBJXe5cg/iH4mhbCj6ZdpSwa09AtJiO7giw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642971610; a=rsa-sha256; cv=none; b=GpExxLlxweRVr71Uz4FKxY85iLlSnbxjZ7xS2Jx8yHYTec3UiydBBpzxmwGr4a0Y07KQiy E/pRJgPsgqcUH4Dy7+G62CkNgwFWl4H403yscoBEZIeaRXQybJytsxrvtbHHzxRxsJmiQ2 Q35mcwy4A6zdnTuvB4zixjfkOIVhc1mdk8dPBpeiWCmmLBZ0wuBxYCBJV0GU3gUSkKyxb4 1tN7rET2VIgbeFYjqPKvx0p3e/38a3oi2Um5reMKhLbNQ7VOuCqpLnxi1ItX6qY24fmmW+ gHtr7nwytEGPx49r5xtWzgmO4GYfaPrYY3DajyzJNGkRTaxAZy5NR4BUFz70Cg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16429716091.c7EA82A5D.25946 Date: Sun, 23 Jan 2022 21:00:09 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16429716091.c7EA82A5D.25946 Date: Sun, 23 Jan 2022 21:00:09 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16429716091.c7EA82A5D.25946-- From nobody Mon Jan 24 07:29:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 11B0E19850B9 for ; Mon, 24 Jan 2022 07:29:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jj1nW5cvLz3Qpc for ; Mon, 24 Jan 2022 07:29:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A14B212034 for ; Mon, 24 Jan 2022 07:29:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20O7T3AT069369 for ; Mon, 24 Jan 2022 07:29:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20O7T3SS069368 for fs@FreeBSD.org; Mon, 24 Jan 2022 07:29:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Mon, 24 Jan 2022 07:29:04 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643009343; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vjZAJZ//rWEE7s5MFUrVVGP+4BJp65wXms79jOjt7Xc=; b=TFGW47ncFkDfGhQDqNTlLIffWK4H99mALKbnfLCAR+FxWezc3BLJw214DuHJEmtuaA8BG7 UocOX0zkrgb5aRiLkeI+aXQvOgwdbCmQGlPZqtvcYXSKLhYoBzKkZNpQ2tjHEvqqztegG7 NNIR+yR4VrysVisqfvcEyMRN8BSFl/Q5fhsj0/MGWvtw7B0lGwQGcywdcfjlWW5QZwrsSq 9KgnpWWjMhBKczLQB+Qd2yt3U1gM2ndAhgaaXS+wNmbfT/fnUak3375wXhjnXPUntAugne eOaMTFjnMTa7KLzyfExq8Z0qapYy9rK7NHOT1OoBd4KjQlplslkPUf4NWwRPkA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643009343; a=rsa-sha256; cv=none; b=cYPkU7hq4iIzRX+fs++OnzK97pCc8D7lHjJASnHtL/LRivISfuzOE0XhqbItMXMJzUCLz2 8zzdaoa4JUJ5E3RXVwXO+dGhtNhYP1KyKljGDV7hoM8M5u8E3RqyCjEVERsG4qnNm+eAjA j6iBdUV5zviBMvgRSULAdj6+glVrbAruQRCTHLjIQtMlGxGGODInba0V1XXRfkTW+l5YEl U+X4glXJchPTwf1tAgpguI1Z6iZ7IKk+vTP+KzCoiVhaXhhmVCFzJD+jaT8S8TB2dWFQHm ZQ81D/LFUbV4kirJyLgwA7zaax38wR8xk2gW59EyqxzBY4LIkwqXJRqN4TfXMA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #15 from Pader --- (In reply to Rick Macklem from comment #10) It's been 28 days ago after I switch to NFSv3, everything's normal. Server is very stable. I think that is the problem. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Jan 26 15:17:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 146DF197ECDD for ; Wed, 26 Jan 2022 15:17:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JkS4b41Qgz4kwl for ; Wed, 26 Jan 2022 15:17:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5CA701F6D1 for ; Wed, 26 Jan 2022 15:17:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20QFH3A0086640 for ; Wed, 26 Jan 2022 15:17:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20QFH3ND086639 for fs@FreeBSD.org; Wed, 26 Jan 2022 15:17:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Wed, 26 Jan 2022 15:17:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: nvass@gmx.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643210223; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=diz1vT1yDWGjmO/orGEoX98E7WR5rQTQC9KMiKxT/U8=; b=FzNITKerHtiFm/PZ0XueoTAaYscox7VGYZBLaQJMQPzvzmMVImvVkQftim2EBOmTkuv6qO sYptHSIiaSzUwnn/AWzn/ozDooODtfSzAg1f73Sj6MkhOw6tWVB6B7u3NLaTvpFYZj9TYA kPJ/scWyDdIcMsipvRxoOEBCq5axLNajDQ4ND/QuwHMGJnbHnbqo1QbZF53jVfngD4kwFk iMt9f8rbYi4EjETR9fTBCb9Sjoujg+YKJjcVNFGS7+i+4w5tWKsiWcjUaGmBAFOZJEmHOG ZKVQuqafurEb7j9J9K0LEvloLESdh95d5QAqdt1JvbfadmILsiqJr54ijSXHnw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643210223; a=rsa-sha256; cv=none; b=MLV/v1vXMDAdVc2IuqzjGxfmwzNGPy3A9yhIyDib/XDLwEsjapdtYpJovdPPTeSQ20DMTI z4Lt2+sUqBGoCYLWyH4v7PzjW8mfB9cb3n1QoPPEEWbE1ejYXhhRQjsM6FHG6Z56IbUppl Sox43ElkjUe6dfsw0X+xIlW4QkwWEv2PqnXJobflbXMxhoB7D0qzj7fp5dgUZJbeNUMS6u Q+ewulXuLcOCmvxmYbDpiExY/4ujoZJGH3Qmvih9k+Oe8fBOMhWyFaqkx/FbHX75wBeVYQ 4Yag81Zx9jQxMKeiFaR4kXGCscsjcT+uACc+qlZOPSPUf7NNYsIyollHyBJslg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 nvass@gmx.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nvass@gmx.com --- Comment #1 from nvass@gmx.com --- Created attachment 231357 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D231357&action= =3Dedit Disabling BIO_FLUSH fixes the panic A quick fix in the attached patch is to disable BIO_FLUSH handling. A more proper fix would be to create a BIO_FLUSH handler. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 26 15:20:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E7AB1197F7FC for ; Wed, 26 Jan 2022 15:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JkS8G4ky2z4ltP for ; Wed, 26 Jan 2022 15:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 834C41F45A for ; Wed, 26 Jan 2022 15:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20QFKEGK087164 for ; Wed, 26 Jan 2022 15:20:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20QFKEA5087163 for fs@FreeBSD.org; Wed, 26 Jan 2022 15:20:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Wed, 26 Jan 2022 15:20:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: nvass@gmx.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_severity Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643210414; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uIu6VgPgyGg5jYujmNWQih9Tyg0U7VIIHdUuqEcoLK0=; b=qBKx2EtO3hM+pr2BMGsKRzhRuv/ddF5VyYvD63K47jk+LvMmefgqh5QOFJXg1dkavEPjsQ klocnhXjL1j+u5yLe4/h7qLcQeIy/lnQmk37ywaFH+uyv4uhhCcxn6mTinBaB8kydbCJmJ RrDuww5YqXywd+Mhec6EXULjK9LkilYMVFB2XW4Ji0CsG0qYlUlpaeR87UR85pW1YqF5TQ VOU0mMp/rvfGKLgL80pkx9Tc93EM13u23J7j0INKH42WljL4nyjkSr+lIbYUBgeURVOhy1 yxzTL/vGe/JcDjG8GksE3IVbFAhBtkQF5z0GT1vzB2NXSqcD/GONJUqmeom1iQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643210414; a=rsa-sha256; cv=none; b=YG0twkpQ8Jk4CXznBPhRaa3xMw9B74s8lINC7DhVLSui3NDB/JKHjGE07wV8/SuiWHHKPJ uglhUhlmxdn14OYQZXVRGgabRsQhacY4fcYhdYj3NrHOnQJChOXfInVgb/H4UwEroNZG3c Q8GqDAvIUrKmg2SFVYa5Qh6Ljl7CdvMlz/hwJdqduySbFnOYyZ0WTltW8sibBlyJ2IyVoc v7EupcXtWwoYZl5AxR4HaTL+OKNAoNnTslPjgHYPtbKQOAX1T96XxwJMScSAyDgjJZxJZw gw21m+d4953UNlWsTaIOvwUdu0e2tdG0sPOJnopacLCtZgKYJafaRdZIi8CUAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 nvass@gmx.com changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Affects Only Me |Affects Some People --- Comment #2 from nvass@gmx.com --- This should be assigned to geom@ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jan 26 16:00:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3AB241970C4A for ; Wed, 26 Jan 2022 16:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JkT2M5Dj1z3Hjw for ; Wed, 26 Jan 2022 16:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6AD312028F for ; Wed, 26 Jan 2022 16:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20QG0BfT007086 for ; Wed, 26 Jan 2022 16:00:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20QG0Bx9007085 for fs@FreeBSD.org; Wed, 26 Jan 2022 16:00:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Wed, 26 Jan 2022 16:00:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643212811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PCW1QL+xXhDoKpuWAjenuNc7ItozQFkGQpQa1fa0ISk=; b=H3tv7VYfuHjYn4TEuNthabPksgHw+SKlf3QXd/jWL0dGq4P6U36nFvzwmeuItPE06Mm0d9 GaRhrYA8dHlWI32+2dkAbGHPe7G91+UpyIyskRobmce9ry06lBR1lnjg0kPXDmzL9KvPLu GL+IIyHKrI/CVO1nugQEA83FWk/ZfJfLBB0SiHs2aggPUADlmSPWr8XV1iT9g27VVIYl57 e+c7NoC47UTEup90wXHhnob/lwRm7T/FH0GA0PEIDGTIuSOj1FtgtU9SEFgPqb8+OEAvl1 mMo2p8yzlak6THkA6mnp0xmMokEaurtBzZsh++RgEQuKu9+3OMZYFWF6PAeY4Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643212811; a=rsa-sha256; cv=none; b=Wdg0dIUjwhHvrBqHV5Xyhw3nykPKi9f0k5n6M01oma9J/Mifm5hH1MPZrzbzIdcfVGs/Ts H0V2sIpg6BQ9jeZxnUQ6A434hRT1G2KP+rMQVyQ5meBM2zyNqZvdqwP/MWJUbEnWhX0kKx BiA5QTOLBLNuc45kvHdygaX+WETtd9SthZaw6pFoH6aPQIMfbfndsKeY8j7qBtitDCE8bv Lp/UfPPGS0bb7/Yi5m281+OxN9tXQ5QpfBYqOj7rLAYhAmIdA39C2V2um+pganHMebjXJ4 sFIRYEDZgdRceLw+uFuUXsQN9FCA4aoBZDl9zlCOgmQmBeah/FgP3hRp2fMVAw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |markj@FreeBSD.org --- Comment #3 from Mark Johnston --- Created attachment 231358 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D231358&action= =3Dedit proposed patch The problem really appears to be that shsec erroneously allocates a buffer = for BIO_FLUSH commands that get sent to child providers. It should only be doi= ng this for reads and writes, so the attached patch is sufficient, I believe. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 27 13:48:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B401B1976CEC for ; Thu, 27 Jan 2022 13:48:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jl2463Bwdz3D04 for ; Thu, 27 Jan 2022 13:48:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4E91F17E41 for ; Thu, 27 Jan 2022 13:48:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20RDmckA022156 for ; Thu, 27 Jan 2022 13:48:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20RDmcrF022155 for fs@FreeBSD.org; Thu, 27 Jan 2022 13:48:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Thu, 27 Jan 2022 13:48:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: nvass@gmx.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643291318; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UIOQAVheqd006URkdzdHA/Mwn3EHeO7wA89Mg8TuKEk=; b=Fd6zcS7SvmRjhViYYGxLmHkyeDh5uI+7R1QV4lXV5lHZ0zIY/3If4l8UgmPdZp/nzGMPib T2sIxLzfhN33zKThbiIJj1SiiphvYxFv1dMDumss5PfaFeqfJGEuPYyQAMA3+LhgR9JKcw KMQatFIYzkMAC2Z467WVRlr1kK6Bi4u1GoADag1gxcnXiGOXFTOcij+Tp1ZoArVOOA4FoV 5YAPy/iqSk8diXZahFFlD1scSrTYkmoXpjrJzyyAlcVIJj9vh6S8Uxr2D3TjCCJxBR+jv8 t8F/hYj+PjFuCbLRvnQR9sUl//R9GWDCQ005Z3XjBygt0hLf7m8x28bDt9Ehyg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643291318; a=rsa-sha256; cv=none; b=CGW+/hkw+1AtnXRbrRAsbbZiBDkMOXiVZMZ19qgzBKJMXJmioegpisYWY5K67iwVo18uRr k3bHfMInK9M0/xOeq5wsp6KbgyRxrGTM+XP4lBDqYNZmwXVDJN33M1Jn2uY/V000l1riDp x3vziHKJUiuEo+xQeYcnGGWOy9OdjZRfQrfKIE+UPqGrPmg0MrpOZghm7Gy5t1eT0kIN6Q eKuMH4a3OTbfBgPTacHT4MUzs0oPzwUSAneIUPnq4fgdd1boZlurBYRoIOX1FXsmAVOeXU 9PwWKnOszWts5LAv+n8fo90MPrBS6Iwn71RQCMIsqhQ9FcuCvvm4J6gjdUmExg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 --- Comment #4 from nvass@gmx.com --- Hi Mark, Thank you for the analysis and the patch. I've tested it and it works fine. Please, commit it. It'd be nice to MFC too Thanks, Nikos --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 27 15:15:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C9975198841A for ; Thu, 27 Jan 2022 15:15:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jl40R688Cz4dqm for ; Thu, 27 Jan 2022 15:15:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5F6FB1904C for ; Thu, 27 Jan 2022 15:15:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20RFFZq2070140 for ; Thu, 27 Jan 2022 15:15:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20RFFZVV070139 for fs@FreeBSD.org; Thu, 27 Jan 2022 15:15:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Thu, 27 Jan 2022 15:15:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643296536; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aTW3qQPpvnZIsTGJLH6Z3fiaXvInXvO39qRKr+Mn4+o=; b=E89nPuTSxHQVJm+nVHC2AfkGeqMv9V3MDsn5ckyZKEFJAAngkvB/Mven8xQVxzEJnS2E4a 7lk+RPTy/mUhhrrr28DneocVg+ObYw89GxDywjYmmXkhXFSHahloNxv8fkVLLSMKLMHyBb gfj038OCdtCPcgBof47l34yz0BcDGWsPZaR2RavmfkSp/720c6/+RE81iophc8fpQPmlOA HCEyrXnNBMn03rcHgwCmDQiG20/Jc50rKCDzAMcuqqmryNmiIDBqvMO/3Kk1YUalx5TMYj rpVNDD098NURhRHdsiQRONZgYCciGDl3s0e3kNTDBRCp7Y44GhB9/pnvmvQZpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643296536; a=rsa-sha256; cv=none; b=J1SsZlafDyyKZC7hpBIXwgNaJ8mGQRJaXTAUoreawbBDpWY9YWuikc6YhZMFfCHz35v6ru vikpiWLRmDLBfmo5xl1nuR7pfVV4I8ZpXe0teTcnSjv1ZiAdDSS3+XuwO49V8p9fErXOzf InstCH9mMDyUSYDE3s4qzVxVXDemhlioXmBEp6Bq7nGxN2jqekFY4bE3C+e+xrhX6tfpPw PuWq5Dk4Gz+rH6j64VrvKy6Y8dhXwMlHU1VwBZYqJgFGBf6CLu69JPF1Np93n5ekgEmH2A I/LizAyDa+h6jLXf7lACE3QLEpVTb86PKR8k2wtifMo/XpFBGemhh8c8LjOmIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 --- Comment #5 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Da2dfffb98917a57bfacb155b9d7d423c3= e8ff792 commit a2dfffb98917a57bfacb155b9d7d423c3e8ff792 Author: Mark Johnston AuthorDate: 2022-01-27 14:53:02 +0000 Commit: Mark Johnston CommitDate: 2022-01-27 14:56:07 +0000 shsec: Allocate data blocks only for BIO_READ/WRITE requests In particular, there is no need to allocate a data block when passing BIO_FLUSH requests to child providers, and g_io_request() asserts that bp->bio_data =3D=3D NULL for such requests. PR: 255131 Reported and tested by: nvass@gmx.com MFC after: 2 weeks Sponsored by: The FreeBSD Foundation sys/geom/shsec/g_shsec.c | 34 +++++++++++++++++++--------------- 1 file changed, 19 insertions(+), 15 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jan 27 15:33:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2AA7B19743C0 for ; Thu, 27 Jan 2022 15:33:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jl4PL6Sjwz4nZc for ; Thu, 27 Jan 2022 15:33:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BE31218D74 for ; Thu, 27 Jan 2022 15:33:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20RFXg6L078945 for ; Thu, 27 Jan 2022 15:33:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20RFXgId078944 for fs@FreeBSD.org; Thu, 27 Jan 2022 15:33:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255131] kernel panic using zfs on shsec Date: Thu, 27 Jan 2022 15:33:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: markj@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643297622; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xSioFKZEoxh41VKlNfcN/+nEmTOTrhLm6j2lJYXAam8=; b=dIRMu/v+91F3v3wwNhDwckd+l4e4Ocd6E8BFtLx8q+KkE2jKjzDlD5HnXODFXjEO59POjp TKPHTLPER/ETS9x1RGW0jDm2PndzJghTR62PS2Y8UPDPOxliSzBdLlkwSA3MWBmlEQNoM1 LXEjWlWCYTY2kuhIIovjQztlwqIIMLBWKzwyHzM7OmfbCZYNRn8AFpCBMM+xEWlhJeSU83 v2IYApwvur7HbQ2WyLkotMNQ9CIb8JIU8JbDnjgzhDcY/atJ7yFSl7mdUMKH/qYn1Qd3Em Xf+zmUf7Sf6xIhU6c8kgY1V+LVdCFrXHUjfEiDcvt0gn86GVP12sp6cRQlAkuQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643297622; a=rsa-sha256; cv=none; b=mbjcmK4bphD4KxRR0CjskVVXGUtPlMbGhofSrEXT1MQy4w3gvlL5aeFOFgwzs4SiW63511 WSxpTLn14jYgClB9R/824wc3PZAgcqw0SzjS2UAvXa6pLC9MV9VEXXuPFsvKr7470fXtww as7Ft5o/JWJIcar/CKEAuCH0613mdIK+cHPHdgir5l1+C6VeiVs/FbipnbdqSXTJLzfgU9 0bHbUwXNToEgu0mz9vF22ZYR2zTrfUrGmLElu5Ljb+DJ4kPQiLNRwy6OWBCGK+lEJyrmRM WfujtRt63F2XXnVodIWaIevpcW0QoDQU8dtGSJaTBEmCWEa/THz+gu2MchC+kA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255131 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |markj@FreeBSD.org Status|New |In Progress --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 28 03:51:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 38DB71977B92 for ; Fri, 28 Jan 2022 03:51:03 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlNm569Hdz4T0R for ; Fri, 28 Jan 2022 03:51:01 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.16.1/8.15.2) with ESMTP id 20S3p0IV067288; Fri, 28 Jan 2022 03:51:00 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.16.1/8.16.1/Submit) id 20S3p0nA067287; Thu, 27 Jan 2022 19:51:00 -0800 (PST) (envelope-from david) Date: Thu, 27 Jan 2022 19:51:00 -0800 From: David Wolfskill To: fs@freebsd.org Subject: ZFS: How may I get rid of a zpool that has no extant devices? Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="E0enTm4dVGv22fDc" Content-Disposition: inline X-Rspamd-Queue-Id: 4JlNm569Hdz4T0R X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org X-Spamd-Result: default: False [-4.23 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[david]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[catwhisker.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_HAM_SHORT(-0.83)[-0.827]; MLMMJ_DEST(0.00)[fs]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --E0enTm4dVGv22fDc Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable TL;DR: I had created a "zroot" zpool in an attempt to get a new machine booting from ZFS. I gave up on that (for reasons that aren't important for this discussion), sliced and partitioned the first drive (ada0), then madea raidz1 pool of the remaining 5 drives; the zpool is called "tank" (which is mostly a poudriere scratchpad). Now "tank" seems fine, but "zroot" shows up as (allegedly) "importable" but UNAVAIL; anything I try to do with it generates some form of "no such pool" whine. How may I make "zroot" disappear? root@freetest:/boot # zfs list NAME USED AVAIL REFER MOUNTPOINT tank 30.6G 3.57T 12.6G /tank tank/poudriere 17.8G 3.57T 17.8G /tank/poudriere root@freetest:/boot # zpool status pool: tank state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 ada1 ONLINE 0 0 0 ada2 ONLINE 0 0 0 ada3 ONLINE 0 0 0 ada4 ONLINE 0 0 0 ada5 ONLINE 0 0 0 errors: No known data errors root@freetest:/boot # zpool import pool: zroot id: 16397883415809375312 state: UNAVAIL status: One or more devices are missing from the system. action: The pool cannot be imported. Attach the missing devices and try again. see: http://illumos.org/msg/ZFS-8000-3C config: zroot UNAVAIL insufficient replicas raidz1-0 UNAVAIL insufficient replicas 6484790396862720571 UNAVAIL cannot open 14408271149544307738 UNAVAIL cannot open 2973420537959971822 UNAVAIL cannot open 17206168682675537956 UNAVAIL cannot open 16237056652067533889 UNAVAIL cannot open root@freetest:/boot # zpool destroy zroot=20 cannot open 'zroot': no such pool I am willing to back up tank, destroy the whole mess, and restore it; the machine is still in its 'shakedown" phase, and is destined to become my new build machine (so it should spend most of its time powered off). That said, if there's a (sane) way to clean this up without the backup/ restore, I'd appreciate knowing about it. Thanks! Peace, david --=20 David H. Wolfskill david@catwhisker.org Republican Senators had two chances to hold Donald Trump accountable for his malfeasance in office during his term -- and utterly failed. See https://www.catwhisker.org/~david/publickey.gpg for my public key. --E0enTm4dVGv22fDc Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSr0Kzv+UJRY3wfOii0+6PfV4Ix1AUCYfNoJF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0QUJE MEFDRUZGOTQyNTE2MzdDMUYzQTI4QjRGQkEzREY1NzgyMzFENAAKCRC0+6PfV4Ix 1JC7AQDFs9cdK3TYGAsqUFIG5/YV0Xe4xO9U7Xwct1MYTNYydgD+I3qc/fP3/mo8 KsN8jYgKsbd6mlA92XBa7DqapjMvNAw= =/8UO -----END PGP SIGNATURE----- --E0enTm4dVGv22fDc-- From nobody Fri Jan 28 07:58:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9DD12197D3C5 for ; Fri, 28 Jan 2022 07:59:04 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlVGJ3yZHz3QlT; Fri, 28 Jan 2022 07:59:04 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643356744; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n1JOzhlKyWkr8ge0eVnEErnrw8GgZMES89meLuiY4rM=; b=RWDWs6YEEy+p2hZBPw899yO2cwfZ1AUORdpvAIUSOsgQHslAz8dBvpen53hVDEF3nsRP8Q +AwiLjG6raWG/LWGQrW5kUnO73J47Mqt/gntVY9+/n1+MuYjBtYDHwpr5yFBJqNw9nD8QR tsADy/etxrxog/PqsdmCsjMLNGGH41OfGYkUI5u6DDmnyz7P5z1PBhBwU0jG7WliIqW0T/ ezrrTMGs1yKuioCRRk8Z90U1nZLQsvSwvFuxgRaCnwko8iXStWncLH0uNmuATwlcT+QYYB VSTHmsUpGg7RMaEWtJ1M+B9BzozybhRyJeolM4Ei+vtuSK6vteya/VIdbeMWDQ== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 0C695B664; Fri, 28 Jan 2022 07:59:03 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <7c687172-2d07-eb23-a163-658e2a37fc0a@FreeBSD.org> Date: Fri, 28 Jan 2022 09:58:59 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.0 Subject: Re: ZFS: How may I get rid of a zpool that has no extant devices? Content-Language: en-US To: David Wolfskill , fs@freebsd.org References: From: Andriy Gapon In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643356744; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n1JOzhlKyWkr8ge0eVnEErnrw8GgZMES89meLuiY4rM=; b=Nukb5/yhHYrvmRGgHcK9xI0ke+6qup36TH8zl9hgEuVZr86wCPOLD6Pwjt6dbQOko+mYNr 6zgrncjSuSQQcKI0a43MoVyt9U32S9bTSCgspBrOp6JYqvoxRMitiADNQ8wD79IuoiPhTl 1Rwcl+QgX7d4rihnxOd99jbSL55xeJR1qAe7YuBsc9BSa2SvIyJ1Y+AUj/+vDYV3SKgpv8 JXYafINilWrLS2LvhierRkMQ4UaNnB3HKvKE/sTP1xyEiPky6URTkbE4//AmbPlj6OaBf/ eTydY38B9z5zo/SM5/8XHmBtL1j26Sf+tluYaxVkacnPUhSF92ydsmMEQq2+Bg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643356744; a=rsa-sha256; cv=none; b=qx4nqapx4ZgbGLulrvtlkQyWjSIcmvtK4DQPqoxqXN1Q9jG9BBUVpdiyA8EPbNGOQZdOD3 6vJNRhxVXhabxuDsF085iiM8aazU3T/TSDfXXFfu7K2ICqC8vqn53bSn2qz31t4uOYbvKs wQbUQCcScx76WNgS1nBX925Wu84Wk57Z63ahQL8sjjU6e4kk2EUfxX+PzDoQDnuKWrwq6K ae8o+IDwxdwSD+rXlWfKcUcLCd3SsiB6vaiWcyOseyPsgBtqngaen9zBRpC1/Ani2HOPF1 R1iLzG1xHa/8AhietwKF8SBoFM7cshgNdo8fDkmDL3xQRzkAph8JOz2JcqEK0Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 28/01/2022 05:51, David Wolfskill wrote: > TL;DR: I had created a "zroot" zpool in an attempt to get a new machine > booting from ZFS. I gave up on that (for reasons that aren't important > for this discussion), sliced and partitioned the first drive (ada0), > then madea raidz1 pool of the remaining 5 drives; the zpool is called > "tank" (which is mostly a poudriere scratchpad). > > Now "tank" seems fine, but "zroot" shows up as (allegedly) "importable" > but UNAVAIL; anything I try to do with it generates some form of > "no such pool" whine. > > How may I make "zroot" disappear? There are two possibilities, either that pool is in zpool.cache or it is in some stale pool label(s) on disks. Depending on the case, the solution would be different. For the zpool.cache case, you can simply remove the file and then regenerate. The other case is more complex. In the past I dealt with it with a careful use of dd. > root@freetest:/boot # zfs list > NAME USED AVAIL REFER MOUNTPOINT > tank 30.6G 3.57T 12.6G /tank > tank/poudriere 17.8G 3.57T 17.8G /tank/poudriere > root@freetest:/boot # zpool status > pool: tank > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > raidz1-0 ONLINE 0 0 0 > ada1 ONLINE 0 0 0 > ada2 ONLINE 0 0 0 > ada3 ONLINE 0 0 0 > ada4 ONLINE 0 0 0 > ada5 ONLINE 0 0 0 > > errors: No known data errors > root@freetest:/boot # zpool import > pool: zroot > id: 16397883415809375312 > state: UNAVAIL > status: One or more devices are missing from the system. > action: The pool cannot be imported. Attach the missing > devices and try again. > see: http://illumos.org/msg/ZFS-8000-3C > config: > > zroot UNAVAIL insufficient replicas > raidz1-0 UNAVAIL insufficient replicas > 6484790396862720571 UNAVAIL cannot open > 14408271149544307738 UNAVAIL cannot open > 2973420537959971822 UNAVAIL cannot open > 17206168682675537956 UNAVAIL cannot open > 16237056652067533889 UNAVAIL cannot open > root@freetest:/boot # zpool destroy zroot > cannot open 'zroot': no such pool > > I am willing to back up tank, destroy the whole mess, and restore it; > the machine is still in its 'shakedown" phase, and is destined to become > my new build machine (so it should spend most of its time powered off). > > That said, if there's a (sane) way to clean this up without the backup/ > restore, I'd appreciate knowing about it. > > Thanks! > > Peace, > david -- Andriy Gapon From nobody Fri Jan 28 17:06:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 41C4C19789B2 for ; Fri, 28 Jan 2022 17:07:18 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlkQs49bBz3qh1 for ; Fri, 28 Jan 2022 17:07:17 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-io1-xd2a.google.com with SMTP id h7so8538050iof.3 for ; Fri, 28 Jan 2022 09:07:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=YUfNYBCdzzHMgxbSVLsPeS/qh8sgM3y0S73bGHDffEQ=; b=WruzV+zuH0009R+SqOr84TvdbWtTYnbvvpZejn9yA5nSFkmaF0BWL/fRmX9eE7kf5U zr0kRz4LDI0MamRCyr/779a34ebRprYAlDhr6ECx7t5ml1q2aWfrM4QEzoLX3PQau21S ZytVBnEDmujSwDoXiVJKEQBr5cNTHT/LBEvMoszjnIjDw+9oXehKjyebyhCA0VMimfFV hPrWi/owBl/dso9KPObXS45T6mrSyGZfcxmyKFHU7IZF9NcX4kc36ke1E2/WdVpn6P1D +bv/O/U5S7AF4NPNzlFSjEKUmyVKNS5ewuMPv96SSHWmW9DMLmi0XtjQd4dxdedAPEsy sKXw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=YUfNYBCdzzHMgxbSVLsPeS/qh8sgM3y0S73bGHDffEQ=; b=dqwKw25X0jGFujrjmRBNfFtFEc8ATlDqOWb1eBaLcAqN4uJ7F6NfFZIyMbV8BbE/lq E1NkGHN16O8g/aA4NrlF8kv3CnwaH5m6+9lbiExBqSqUYV+lmc17/oFUZ4tARAq6bb0X giHH6cAyF4Sw3F+6dZXXvc9WKyQoLxy5gIw2YRZ1+RNqdCHPGObJGzGcgvQxafE69LbE w5grsbSEVLwztJI92DsGWrGvqcPZLZbd3anhI9zttBaRXuWW4laEDyluHE0Me5WPXZkT HnIwN9jWyHv1aMI3odRFUZyQdU18pdcYGZ12XSOYDUg3IfqEjszV45f55QyUbWDfmvmf OyPA== X-Gm-Message-State: AOAM531MSRPk50OLq1FMjsBpLSsTgwLT7s73e40jhpdN4Nf3MsmhINna bWwOJaTPuRN5cEjcf8jTfpcNMog264X99Y2oUTi5SR3T X-Google-Smtp-Source: ABdhPJzSGerOMaMTuTXK23Zg7pErG7C/TkB1t+KCsHKQEtfWtU5nT6nsIGtmZc7dX1nKIU4FWGSzvrTFHYUvKaXZzo8= X-Received: by 2002:a05:6638:94a:: with SMTP id f10mr5311714jad.280.1643389630832; Fri, 28 Jan 2022 09:07:10 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Freddie Cash Date: Fri, 28 Jan 2022 09:06:59 -0800 Message-ID: Subject: Re: ZFS: How may I get rid of a zpool that has no extant devices? To: David Wolfskill Cc: fs@freebsd.org Content-Type: multipart/alternative; boundary="0000000000002c675e05d6a7776e" X-Rspamd-Queue-Id: 4JlkQs49bBz3qh1 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=WruzV+zu; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of fjwcash@gmail.com designates 2607:f8b0:4864:20::d2a as permitted sender) smtp.mailfrom=fjwcash@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d2a:from]; MLMMJ_DEST(0.00)[fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --0000000000002c675e05d6a7776e Content-Type: text/plain; charset="UTF-8" On Thu, Jan 27, 2022 at 7:51 PM David Wolfskill wrote: > TL;DR: I had created a "zroot" zpool in an attempt to get a new machine > booting from ZFS. I gave up on that (for reasons that aren't important > for this discussion), sliced and partitioned the first drive (ada0), > then madea raidz1 pool of the remaining 5 drives; the zpool is called > "tank" (which is mostly a poudriere scratchpad). > Did you do a "zpool destroy zroot" before partitioning the devices for use in the tank pool? If not, that's why it thinks the zroot pool is still "available" as it sees the old ZFS label on the devices. > Now "tank" seems fine, but "zroot" shows up as (allegedly) "importable" > but UNAVAIL; anything I try to do with it generates some form of > "no such pool" whine. > > How may I make "zroot" disappear? > > root@freetest:/boot # zfs list > NAME USED AVAIL REFER MOUNTPOINT > tank 30.6G 3.57T 12.6G /tank > tank/poudriere 17.8G 3.57T 17.8G /tank/poudriere > root@freetest:/boot # zpool status > pool: tank > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > raidz1-0 ONLINE 0 0 0 > ada1 ONLINE 0 0 0 > ada2 ONLINE 0 0 0 > ada3 ONLINE 0 0 0 > ada4 ONLINE 0 0 0 > ada5 ONLINE 0 0 0 > > errors: No known data errors > root@freetest:/boot # zpool import > pool: zroot > id: 16397883415809375312 > state: UNAVAIL > status: One or more devices are missing from the system. > action: The pool cannot be imported. Attach the missing > devices and try again. > see: http://illumos.org/msg/ZFS-8000-3C > config: > > zroot UNAVAIL insufficient replicas > raidz1-0 UNAVAIL insufficient replicas > 6484790396862720571 UNAVAIL cannot open > 14408271149544307738 UNAVAIL cannot open > 2973420537959971822 UNAVAIL cannot open > 17206168682675537956 UNAVAIL cannot open > 16237056652067533889 UNAVAIL cannot open > root@freetest:/boot # zpool destroy zroot > cannot open 'zroot': no such pool > > I am willing to back up tank, destroy the whole mess, and restore it; > the machine is still in its 'shakedown" phase, and is destined to become > my new build machine (so it should spend most of its time powered off). > > That said, if there's a (sane) way to clean this up without the backup/ > restore, I'd appreciate knowing about it. > If nothing else works, the nuclear option is to run "zpool labelclear" on each of the devices used for the zroot pool. That will remove the ZFS label from the disks, clear the GPT partition table and backup table, and render the device essentially "unformatted", ready for use. As you aren't using ZFS on ada0, you might be able to run "zpool labelclear" on just that device to make it disappear, as you have proper ZFS labels on the other drives for tank. -- Freddie Cash fjwcash@gmail.com --0000000000002c675e05d6a7776e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Thu, Jan 27, 2022 at 7:51 PM David Wol= fskill <david@catwhisker.org= > wrote:
TL;DR: I had created a "zroot" zpool in an= attempt to get a new machine
booting from ZFS.=C2=A0 I gave up on that (for reasons that aren't impo= rtant
for this discussion), sliced and partitioned the first drive (ada0),
then madea raidz1 pool of the remaining 5 drives; the zpool is called
"tank" (which is mostly a poudriere scratchpad).
=

Did you do a "zpool destroy zroot" before par= titioning the devices for use in the tank pool?=C2=A0 If not, that's wh= y it thinks the zroot pool is still "available" as it sees the ol= d ZFS label on the devices.
=C2=A0
Now "tank" seems fine, but "zroot" shows up as (alleged= ly) "importable"
but UNAVAIL; anything I try to do with it generates some form of
"no such pool" whine.

How may I make "zroot" disappear?

root@freetest:/boot # zfs list
NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0USED=C2=A0 AVAIL=C2=A0 = REFER=C2=A0 MOUNTPOINT
tank=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 30.6G=C2=A0 3.57T=C2=A0 12.6G= =C2=A0 /tank
tank/poudriere=C2=A0 17.8G=C2=A0 3.57T=C2=A0 17.8G=C2=A0 /tank/poudriere root@freetest:/boot # zpool status
=C2=A0 pool: tank
=C2=A0state: ONLINE
=C2=A0 scan: none requested
config:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 STATE=C2=A0 =C2= =A0 =C2=A0READ WRITE CKSUM
=C2=A0 =C2=A0 =C2=A0 =C2=A0 tank=C2=A0 =C2=A0 =C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 raidz1-0=C2=A0 ONLINE=C2=A0 =C2=A0 =C2= =A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ada1=C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ada2=C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ada3=C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ada4=C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ada5=C2=A0 =C2=A0 ONLINE=C2=A0 = =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00

errors: No known data errors
root@freetest:/boot # zpool import
=C2=A0 =C2=A0pool: zroot
=C2=A0 =C2=A0 =C2=A0id: 16397883415809375312
=C2=A0 state: UNAVAIL
=C2=A0status: One or more devices are missing from the system.
=C2=A0action: The pool cannot be imported. Attach the missing
=C2=A0 =C2=A0 =C2=A0 =C2=A0 devices and try again.
=C2=A0 =C2=A0see: http://illumos.org/msg/ZFS-8000-3C
=C2=A0config:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 zroot=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0UNAVAIL=C2=A0 insufficient replicas
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 raidz1-0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 UNAVAIL=C2=A0 insufficient replicas
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 6484790396862720571=C2=A0 =C2=A0U= NAVAIL=C2=A0 cannot open
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 14408271149544307738=C2=A0 UNAVAI= L=C2=A0 cannot open
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 2973420537959971822=C2=A0 =C2=A0U= NAVAIL=C2=A0 cannot open
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 17206168682675537956=C2=A0 UNAVAI= L=C2=A0 cannot open
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 16237056652067533889=C2=A0 UNAVAI= L=C2=A0 cannot open
root@freetest:/boot # zpool destroy zroot
cannot open 'zroot': no such pool

I am willing to back up tank, destroy the whole mess, and restore it;
the machine is still in its 'shakedown" phase, and is destined to = become
my new build machine (so it should spend most of its time powered off).

That said, if there's a (sane) way to clean this up without the backup/=
restore, I'd appreciate knowing about it.

If nothing else works, the nuclear option is to run "zpool labe= lclear" on each of the devices used for the zroot pool.=C2=A0 That wil= l remove the ZFS label from the disks, clear the GPT partition table and ba= ckup table, and render the device essentially "unformatted", read= y for use.

As you aren't using ZFS on ada0, yo= u might be able to run "zpool labelclear" on just that device to = make it disappear, as you have proper ZFS labels on the other drives for ta= nk.

--
Freddie Cash
fjwcash@gmail.com
--0000000000002c675e05d6a7776e-- From nobody Fri Jan 28 17:23:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 39BD219840E4 for ; Fri, 28 Jan 2022 17:23:28 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlknV6Lwjz4S7s for ; Fri, 28 Jan 2022 17:23:26 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.16.1/8.15.2) with ESMTP id 20SHNPHc078740; Fri, 28 Jan 2022 17:23:25 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.16.1/8.16.1/Submit) id 20SHNOKo078739; Fri, 28 Jan 2022 09:23:24 -0800 (PST) (envelope-from david) Date: Fri, 28 Jan 2022 09:23:24 -0800 From: David Wolfskill To: Freddie Cash Cc: fs@freebsd.org Subject: Re: ZFS: How may I get rid of a zpool that has no extant devices? Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="8ExO1aCOttY/ZX/m" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4JlknV6Lwjz4S7s X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org X-Spamd-Result: default: False [-4.40 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[david]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170:c]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[catwhisker.org]; SIGNED_PGP(-2.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --8ExO1aCOttY/ZX/m Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 28, 2022 at 09:06:59AM -0800, Freddie Cash wrote: > ... > Did you do a "zpool destroy zroot" before partitioning the devices for use > in the tank pool? If not, that's why it thinks the zroot pool is still > "available" as it sees the old ZFS label on the devices. Right; I had not (run "zfs destroy zroot") -- I think. (This was within the installer -- first time I had used the installer in years...) > ...=20 > > How may I make "zroot" disappear? > ... > If nothing else works, the nuclear option is to run "zpool labelclear" on > each of the devices used for the zroot pool. That will remove the ZFS > label from the disks, clear the GPT partition table and backup table, and > render the device essentially "unformatted", ready for use. I have (since) determined (using "zdb -l") that th eonly vestige of zroot is on /dev/ada0. > As you aren't using ZFS on ada0, you might be able to run "zpool > labelclear" on just that device to make it disappear, as you have proper > ZFS labels on the other drives for tank. > ..... OK; thanks. Success: freetest(12.3-S)[22] sudo zpool labelclear /dev/ada0 failed to open /dev/ada0: Operation not permitted freetest(12.3-S)[23] sysctl kern.geom.debugflags kern.geom.debugflags: 0 freetest(12.3-S)[24] sudo !!=3D16 sudo sysctl kern.geom.debugflags=3D16 kern.geom.debugflags: 0 -> 16 freetest(12.3-S)[25] sudo zpool labelclear /dev/ada0 use '-f' to override the following error: /dev/ada0 is a member of potentially active pool "zroot" freetest(12.3-S)[26] sudo zpool labelclear -f /dev/ada0 freetest(12.3-S)[27] sudo zpool import freetest(12.3-S)[28] =20 [Caution in case anyone is tempted to do the above: please be careful, especially if you are working with precious data. In my case, it's just a headless build machine that I am still in the process of setting up, so a problem would have been annoying, but hardly a catastrophe.] Peace, david --=20 David H. Wolfskill david@catwhisker.org Republican Senators had two chances to hold Donald Trump accountable for his malfeasance in office during his term -- and utterly failed. See https://www.catwhisker.org/~david/publickey.gpg for my public key. --8ExO1aCOttY/ZX/m Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSr0Kzv+UJRY3wfOii0+6PfV4Ix1AUCYfQmjF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0QUJE MEFDRUZGOTQyNTE2MzdDMUYzQTI4QjRGQkEzREY1NzgyMzFENAAKCRC0+6PfV4Ix 1FomAP9hmPknTu9jwgGkkbA3ctI93XkaZYJsS1xS00Lvfb1NZgD+MM+fAVKgWBW/ INW+xwDQQXLyrG0jq5x+o6eXK2JNigQ= =M47t -----END PGP SIGNATURE----- --8ExO1aCOttY/ZX/m-- From nobody Sat Jan 29 04:29:39 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7AF5519827A6; Sat, 29 Jan 2022 04:29:48 +0000 (UTC) (envelope-from peterj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jm1ZN20qhz3NnN; Sat, 29 Jan 2022 04:29:48 +0000 (UTC) (envelope-from peterj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643430588; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=1e0nd+thODBC7fsExoX1j8LT6/YVvTRl61fD749DxW4=; b=x7EI5w5Hj3Bq3Oaj/thXRh2jMxApVc+Shi2oyldWcvC6M6B4LttK+FeoYGRTBuuY8TuMrH 4W0EakH+Cz45td9iGKJIBopnU17pzI9Vu9Mg0M6YjwmvqEdXWgh7RyaJkEdZdZOssvlDXu r8o/WX6H/5AIz09W7NJ4fNzeEojhqGV5Cn16khKEUO3nt/h9aj2QZwgWi61Idu6iSVNDmU p04/4gXiaAflJdIQqb0OtY8c3PfKTgtFdre9NVsD5VhSraox5vSkydBwJfhPFBp1uDbJyy 1OLEfuEo6ioXu0098ma5FUMPhdzntIIZunxK6Fyz9JObwzS9Rwj8WfuWJaNBrQ== Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: peterj) by smtp.freebsd.org (Postfix) with ESMTPSA id 244682592B; Sat, 29 Jan 2022 04:29:46 +0000 (UTC) (envelope-from peterj@freebsd.org) Date: Sat, 29 Jan 2022 15:29:39 +1100 From: peterj@freebsd.org To: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: bio re-ordering Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="rR6QH3wdzVxX3Kxu" Content-Disposition: inline X-PGP-Key: http://www.rulingia.com/keys/peter.pgp ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643430588; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=1e0nd+thODBC7fsExoX1j8LT6/YVvTRl61fD749DxW4=; b=u2Fcj9G1WhMMQdsK+2CtYVrH0Bnxi/riKkpDBCv+VLAeCLue3rnw/dzihSdkCmaDtPr1Mp z6wBrEs2PIVxeObCFZ3DrNS6XlLM0ttwiPcDszgytGR6W4nKM2on4y+wU4jh3ANS/mWOPI Kw7typULxZm55IyQsYuSlHbB4r0bx0LaXt9nlDpz+KqkMvsMY2CS/ay05OXYXn3LCXOrdI ngxzibq2VFskqlC80LUWm2A9sDg2rRj6gBD3T6cndeR3IxrN7sX1MbB51bJ9gTnzIzcCP/ 3SO533Jd7cLyyf6mZIgiAJMrW5FNWh+JeN7e72ID/P4eA3WEz0fGu5NOzsMIdw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643430588; a=rsa-sha256; cv=none; b=tBSxVbMwRrnV8shzVDGW+70nMicx0DCk28Vwcf5kk/tU9Fc9Wwodsnde4/RCt89MyBKSMe s/EtuGcVzuCFyDhAmISDmu9rnCVHpsk4iKulA8kFEMAKW/1CKeoqYvUNQfpLqN6F42HtqA Tho7J4hOVvmY5jHIzCv/WtmaM0lcugJqJQMm8ftewnjfuT5UWC6OMoi7inGzRp2X3hfDgk Lb0cwNfr69Wck+qIEdkkGgp9v/octN3Bl+CNmfiYSWlQjerry5VJbul9CjHj+XR9et0F5z wsZM9lW2RfR4loj+Sxj3LFGigc4DMcA3B1lvZ196C+YzRkhTUqP2lz9CQw8ARQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --rR6QH3wdzVxX3Kxu Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable I'm working on a GEOM Gate network client to better handle high-latency connections and have some questions regarding bio ordering assumptions (alternatively, how much should I be able to re-order bio requests without breaking things). Within geom_gate, an incoming bio request is retrieved =66rom the kernel using a G_GATE_CMD_START ioctl, processed in userland (typically by forwarding it to a remote system) and then returned via a G_GATE_CMD_DONE ioctl. My GEOM Gate client can reorder requests quite aggressively and I suspect it's breaking some kernel assumptions regarding bio behaviour. The following questions assume that BIO_READ, BIO_WRITE and BIO_FLUSH are valid but BIO_DELETE isn't supported. a) In the absence of BIO_FLUSH operations, what (if any) are the limits on reordering operations? Given a block that initially contains A, followed by a write B, read and write C, is there any constraint on which content the read returns? b) Are individual BIO_READ and BIO_WRITE operations expected to be atomic with respect to other BIO_WRITE operations? Give 2 adjacent blocks that initially contain AB, and successive write CD, read and write EF operations to those blocks, is it expected that the read would return CD (or maybe AD or EF, assuming that's valid from the previous question) or could the write operations partially complete in different orders, resulting in something like AD, CF, EB etc? b) I assume that a BIO_FLUSH should not return DONE until all preceeding write operations have completed issued. Is it required that write operations issued after the BIO_FLUSH must not complete before the BIO_FLUSH completes? --=20 Peter Jeremy --rR6QH3wdzVxX3Kxu Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmH0wq1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzT1bA/9FmUTKFrSbavulQ5V+0VUBKjSmEX5GHYL6TolX97z/I6VqkIgS/nOERBd mYrh7c2zyiaTskTc+ytwg5x3Q+6X0SuxpKQwEy5lgCrE1I8BzglVnrdVVqxRV41g X7aWyPAIDdDpjmWhXkS507ZNcgcAo7VeJQj5Gj9flXGdy1yGFTZdklHM+e8VYcsc scLkTs/U9ctqp8cgv8rm8MCJHcxjJLF2ByXXBRWSqQhiAiCxckCID/yyMekIykC9 G/hgnMELlcTJrKrxFwDnlixCu0Eue/tu7CdbS6xtBh83Wc8oSWFNtOYOT0In6b1Z 22PlrRZOng9gNrQ94pOqdBAstLMSolOBPbkmRbnz/v+ZITFJv1g2kYJEd7SkZ4FH XX5rRUMcEB0Bz33XKVVRkmfiyyKJhuxfAMxAljC70DUByRkkYoS1dCgJa88W9Hti 7wBpye3387eyvTw7fFQCuO8lQ2z5DpAS+MXg3spdShOsrqGYYn210N4uSUeVe0B7 dAOlEyNuYPaGVb12TB3+yr1qI7EWMg0PhzlGbIJg2nKkxq8brtOE1iz5tM3qGdbK guRaXfRn4a+mRqoLQTZexTZhfjLPqGhx2TWODo+H1750dNQ+nLxCGv6lIfuQvvAw IkMqVEcW2NrKMRiYcv2neqLNHenIXOFSQFVdOb59eOvgMGD8u6E= =PDCy -----END PGP SIGNATURE----- --rR6QH3wdzVxX3Kxu-- From nobody Sat Jan 29 04:37:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 30D321986E48; Sat, 29 Jan 2022 04:37:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jm1ld0crkz3hc4; Sat, 29 Jan 2022 04:37:48 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 20T4bZvB043518 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 29 Jan 2022 06:37:38 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 20T4bZKV043517; Sat, 29 Jan 2022 06:37:35 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 29 Jan 2022 06:37:35 +0200 From: Konstantin Belousov To: peterj@freebsd.org Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: bio re-ordering Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.5 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on tom.home X-Rspamd-Queue-Id: 4Jm1ld0crkz3hc4 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-0.97 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all:c]; NEURAL_HAM_SHORT(-0.97)[-0.973]; NEURAL_SPAM_LONG(1.00)[1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-geom]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-ThisMailContainsUnwantedMimeParts: N On Sat, Jan 29, 2022 at 03:29:39PM +1100, peterj@freebsd.org wrote: > I'm working on a GEOM Gate network client to better handle high-latency > connections and have some questions regarding bio ordering assumptions > (alternatively, how much should I be able to re-order bio requests without > breaking things). Within geom_gate, an incoming bio request is retrieved > from the kernel using a G_GATE_CMD_START ioctl, processed in userland > (typically by forwarding it to a remote system) and then returned via a > G_GATE_CMD_DONE ioctl. My GEOM Gate client can reorder requests quite > aggressively and I suspect it's breaking some kernel assumptions regarding > bio behaviour. The following questions assume that BIO_READ, BIO_WRITE and > BIO_FLUSH are valid but BIO_DELETE isn't supported. > > a) In the absence of BIO_FLUSH operations, what (if any) are the limits on > reordering operations? Given a block that initially contains A, followed > by a write B, read and write C, is there any constraint on which content > the read returns? There are no limits. Either other software entities, or hardware itself, can process requests in arbitrary order. This is why things are typically done in the completion handler, and part of the reason why the complexity of UFS SU exists. > > b) Are individual BIO_READ and BIO_WRITE operations expected to be atomic > with respect to other BIO_WRITE operations? Give 2 adjacent blocks that > initially contain AB, and successive write CD, read and write EF > operations to those blocks, is it expected that the read would return CD > (or maybe AD or EF, assuming that's valid from the previous question) or > could the write operations partially complete in different orders, > resulting in something like AD, CF, EB etc? No. At very least, underlying entities can split request into several, each of which is ordered individiually. Typically, it is higher-level code that ensures that there are no concurrent modifications of the same block. For instance, we exclusively lock vnodes and buffers around metadata updates. Similarly, we lock buffers until the data is written to the device. > > b) I assume that a BIO_FLUSH should not return DONE until all preceeding > write operations have completed issued. Is it required that write > operations issued after the BIO_FLUSH must not complete before the > BIO_FLUSH completes? UFS SU relies on BIO_FLUSH being the full barrier. From nobody Sat Jan 29 05:32:02 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8DA52197597A for ; Sat, 29 Jan 2022 05:32:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vk1-xa33.google.com (mail-vk1-xa33.google.com [IPv6:2607:f8b0:4864:20::a33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jm2yP29yBz4VK2 for ; Sat, 29 Jan 2022 05:32:13 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vk1-xa33.google.com with SMTP id n14so5127470vkk.6 for ; Fri, 28 Jan 2022 21:32:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=CNSlkudfXYDjgekp9Q3cV3OId6DMLEhuiPbJKrSuDNo=; b=TwF2c5BVcOiMjsmV+dd+VHThxDKlcSgsuI/peuXAFOReKt4/oRike3fDIsVC6NKKBD 03MV20W7SHVKR+mAa2+vdhnK1zIbIrf7Nxs+shHY73L4jNCyPg2AZ/jHulqykipSxfFw uNP59biRvKDWOk3arpjrtt9EvqIygb1Qd8EljuWdDAbaBz23uItzuNlvaIMnqzEnmpDx 1xmipq6JkkWv0DoKDzEUJugxOZCyxk081DzMtnKAqqdPeDOXoElj03skvCj6Nwcez4Yl R4jBTX7ghon+rz+JvyvXvc9ymT2tQJWEyvFySqdAS/mZ//9+q+T7UCK57Jw02rOedzdH lC4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CNSlkudfXYDjgekp9Q3cV3OId6DMLEhuiPbJKrSuDNo=; b=P0eFzIwEvPHeCVsM7KudT+oiT+yuCnhPI4Dsd3P4oJbehTuD3cX+yzjKdRkg8kenQy PjIqv+rMk5jAwar/V4sItLV2sfRaiUe7nCZDfscKAIIFqOVOk+lZ3psC5Mzr3wufxFng DyfpYoYqm1O5rZiHdMpToHFMYywTG1lN9BxSwvlsfNjKMbyajJlCpUl3jwGHZ29et8x5 y0aCNvNbQLdpmraRBiW4kd2qghBqr9mv4i3Uj8uBU0x5BiaWGixqh86HVgQGR/rZxWYW GBv0OZkqmurBspYXRX9MJPFbzjTexNuXM4B/cKkXAlMe/HF28gQfGP8HwrfZisr7Z9h5 Nqnw== X-Gm-Message-State: AOAM530r/vstPcNql8AEWAsP/VenHnHf992iFAvI9xZ/+XlVY+A6A2rB iUokpjEWk77feYA7dPw8XV/PNTBR21Zi3ObBVHz8Ww== X-Google-Smtp-Source: ABdhPJyMD3grgYTRoHe9lo8Wb2SCcqSJjq3/MAuyc7Ddi8pCcpv2zqCAozMDeC8BJtIgB7BazKJ+LHZY1cdLAEN6fek= X-Received: by 2002:a05:6122:181a:: with SMTP id ay26mr5259638vkb.5.1643434326551; Fri, 28 Jan 2022 21:32:06 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Fri, 28 Jan 2022 22:32:02 -0700 Message-ID: Subject: Re: bio re-ordering To: Konstantin Belousov Cc: peterj@freebsd.org, FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="0000000000003f085605d6b1df04" X-Rspamd-Queue-Id: 4Jm2yP29yBz4VK2 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=TwF2c5BV; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::a33) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; NEURAL_SPAM_SHORT(1.00)[1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a33:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --0000000000003f085605d6b1df04 Content-Type: text/plain; charset="UTF-8" On Fri, Jan 28, 2022 at 9:38 PM Konstantin Belousov wrote: > On Sat, Jan 29, 2022 at 03:29:39PM +1100, peterj@freebsd.org wrote: > > I'm working on a GEOM Gate network client to better handle high-latency > > connections and have some questions regarding bio ordering assumptions > > (alternatively, how much should I be able to re-order bio requests > without > > breaking things). Within geom_gate, an incoming bio request is retrieved > > from the kernel using a G_GATE_CMD_START ioctl, processed in userland > > (typically by forwarding it to a remote system) and then returned via a > > G_GATE_CMD_DONE ioctl. My GEOM Gate client can reorder requests quite > > aggressively and I suspect it's breaking some kernel assumptions > regarding > > bio behaviour. The following questions assume that BIO_READ, BIO_WRITE > and > > BIO_FLUSH are valid but BIO_DELETE isn't supported. > > > > a) In the absence of BIO_FLUSH operations, what (if any) are the limits > on > > reordering operations? Given a block that initially contains A, > followed > > by a write B, read and write C, is there any constraint on which > content > > the read returns? > There are no limits. Either other software entities, or hardware itself, > can process requests in arbitrary order. This is why things are typically > done in the completion handler, and part of the reason why the complexity > of UFS SU exists. > > > > > b) Are individual BIO_READ and BIO_WRITE operations expected to be atomic > > with respect to other BIO_WRITE operations? Give 2 adjacent blocks > that > > initially contain AB, and successive write CD, read and write EF > > operations to those blocks, is it expected that the read would return > CD > > (or maybe AD or EF, assuming that's valid from the previous question) > or > > could the write operations partially complete in different orders, > > resulting in something like AD, CF, EB etc? > No. At very least, underlying entities can split request into several, > each of which is ordered individiually. Typically, it is higher-level > code that ensures that there are no concurrent modifications of the same > block. For instance, we exclusively lock vnodes and buffers around > metadata updates. Similarly, we lock buffers until the data is written > to the device. > > > > > b) I assume that a BIO_FLUSH should not return DONE until all preceeding > > write operations have completed issued. Is it required that write > > operations issued after the BIO_FLUSH must not complete before the > > BIO_FLUSH completes? > UFS SU relies on BIO_FLUSH being the full barrier. > I think that ufs relies on two ordering primitives, both marked with BIO_ORDERED today. That's what most of the drivers key off of. We always set BIO_ORDERED on all the BIO_FLUSH events as far as I Can tell. Also, anything that sets a B_BARRIER at the upper layers, also gets BIO_ORDERED added to it. b*barrierwrite() sets this, and that's used in the ffs_alloc code. Warner --0000000000003f085605d6b1df04 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Fri, Jan 28, 2022 at 9:38 PM Konst= antin Belousov <kostikbel@gmail.c= om> wrote:
peterj@freebsd.org wrote:
> I'm working on a GEOM Gate network client to better handle high-la= tency
> connections and have some questions regarding bio ordering assumptions=
> (alternatively, how much should I be able to re-order bio requests wit= hout
> breaking things).=C2=A0 Within geom_gate, an incoming bio request is r= etrieved
> from the kernel using a G_GATE_CMD_START ioctl, processed in userland<= br> > (typically by forwarding it to a remote system) and then returned via = a
> G_GATE_CMD_DONE ioctl.=C2=A0 My GEOM Gate client can reorder requests = quite
> aggressively and I suspect it's breaking some kernel assumptions r= egarding
> bio behaviour.=C2=A0 The following questions assume that BIO_READ, BIO= _WRITE and
> BIO_FLUSH are valid but BIO_DELETE isn't supported.
>
> a) In the absence of BIO_FLUSH operations, what (if any) are the limit= s on
>=C2=A0 =C2=A0 reordering operations?=C2=A0 Given a block that initially= contains A, followed
>=C2=A0 =C2=A0 by a write B, read and write C, is there any constraint o= n which content
>=C2=A0 =C2=A0 the read returns?
There are no limits.=C2=A0 Either other software entities, or hardware itse= lf,
can process requests in arbitrary order.=C2=A0 This is why things are typic= ally
done in the completion handler, and part of the reason why the complexity of UFS SU exists.

>
> b) Are individual BIO_READ and BIO_WRITE operations expected to be ato= mic
>=C2=A0 =C2=A0 with respect to other BIO_WRITE operations?=C2=A0 Give 2 = adjacent blocks that
>=C2=A0 =C2=A0 initially contain AB, and successive write CD, read and w= rite EF
>=C2=A0 =C2=A0 operations to those blocks, is it expected that the read = would return CD
>=C2=A0 =C2=A0 (or maybe AD or EF, assuming that's valid from the pr= evious question) or
>=C2=A0 =C2=A0 could the write operations partially complete in differen= t orders,
>=C2=A0 =C2=A0 resulting in something like AD, CF, EB etc?
No.=C2=A0 At very least, underlying entities can split request into several= ,
each of which is ordered individiually.=C2=A0 Typically, it is higher-level=
code that ensures that there are no concurrent modifications of the same block.=C2=A0 For instance, we exclusively lock vnodes and buffers around metadata updates.=C2=A0 Similarly, we lock buffers until the data is writte= n
to the device.

>
> b) I assume that a BIO_FLUSH should not return DONE until all preceedi= ng
>=C2=A0 =C2=A0 write operations have completed issued.=C2=A0 Is it requi= red that write
>=C2=A0 =C2=A0 operations issued after the BIO_FLUSH must not complete b= efore the
>=C2=A0 =C2=A0 BIO_FLUSH completes?
UFS SU relies on BIO_FLUSH being the full barrier.
I think that ufs relies on two ordering primitives, both marked= with BIO_ORDERED today.
That's what most of the drivers key = off of. We always set BIO_ORDERED on all the BIO_FLUSH
events as = far as I Can tell.

Also, anything that sets a = B_BARRIER at the upper layers, also gets BIO_ORDERED added
to it.= b*barrierwrite() sets this, and that's used in the ffs_alloc code.

Warner
--0000000000003f085605d6b1df04-- From nobody Sun Jan 30 21:00:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DF0EF199DE14 for ; Sun, 30 Jan 2022 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jn3WL379Vz4dBB for ; Sun, 30 Jan 2022 21:00:46 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CEFDF7B44 for ; Sun, 30 Jan 2022 21:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20UL0jN4075783 for ; Sun, 30 Jan 2022 21:00:45 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20UL0jU0075782 for fs@FreeBSD.org; Sun, 30 Jan 2022 21:00:45 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202201302100.20UL0jU0075782@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 30 Jan 2022 21:00:45 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16435764452.4C5F.73407" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643576446; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=4X7nho5HE3D3OYQM9ByrAooD5vSqQ6BzZThX1BSwI1M=; b=V/gDGqYWnzLWHQ5jCrxCnlRY+9otHR+ldVUJZDtTQUY9o4E5cuiatai1+v9tpdwUZDGmXq ka56/eKFbHcSIDuorWJpwmMzNnQtFwcUtb9rSDXL/ic1YdQl9Ofn/9+Jz8zM+PwnA7CfOt Y0UTC5he2YFtuzlsAuym1RZOZbsbdUgKoYwcCpA/K51Hg2wonc7j7+0uQbnejPCWslU/tT X3LnV9y1nSiYgsYlfsyB1LfFSd7+AvWoviNZh10hq5Lp2VW5aApfWmWSqv+G1e+p2+Drl/ LWEIrckL1Gv+EqsE70rXsCIAGm+6RMks6YSy51rEwkWhljTyJjI2AhwhrVu0cQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643576446; a=rsa-sha256; cv=none; b=VNXqqGdbUwIVcFVv/XVcas00Zr2g5JNqRwIRftZ3+ffrA2xUvMv9zumEYgVrua4vxLgV+P SWEV3i1G2HWChSEYRAzwUWqox2g42NcaDJttp5NavBql1wBz4vwuEFJuiY5IMqzgD8yoDB 0uT3bamRXI1VLR2tQ5+gPuaxlUhgx+9l5tbxvrNZyJH0rq/osk0KF2eQMQDCj2L2JWijaK Dee4AnbIunSqjdMv12BGnUzAnMioPF9PtggFqZCNEQNIjjrr2OoHRRvicsG/m0DGL8uK/v ytR+AdYSvDxnfNEu18LDwDVxf5iWvvONz6Zv5HvbNVjrZxps8WDrEJG5BkBR2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16435764452.4C5F.73407 Date: Sun, 30 Jan 2022 21:00:45 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16435764452.4C5F.73407 Date: Sun, 30 Jan 2022 21:00:45 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16435764452.4C5F.73407-- From nobody Tue Feb 1 21:10:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6A7AC197DD41 for ; Tue, 1 Feb 2022 21:10:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpHdm1f2Gz4X15 for ; Tue, 1 Feb 2022 21:10:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0ACF417EAD for ; Tue, 1 Feb 2022 21:10:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 211LAZQx081294 for ; Tue, 1 Feb 2022 21:10:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 211LAZd5081293 for fs@FreeBSD.org; Tue, 1 Feb 2022 21:10:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 249985] kernel panic at shutdown in zfs_acl_free() and list_remove(), related crash at snapshot removal Date: Tue, 01 Feb 2022 21:10:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: madpilot@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643749836; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8jCzVTIh1A+RcBmNHY9q9Tz9QD2QbSugx4bcaVGQqXY=; b=KMp1xrDhG2azANptYcv/RLxpGHxuNVrZwU2f5TS+A/I6DJtdq0pUA9IdbDcauogiQdlNET uoVkS1RvfLx7tIh7QwGMKLJfhuNbnBYm3zd4Co0AJRPkkIzR9KzMEUhp1KwsfZpXAAaSp1 zKER9muyjlnYwrnHuUO/p88yXgLHrYz5npp4D+Q+9YbGP+eQT2SxMFz+KVPKJfp8D6ZJQR uJxx44wskPdO/eDL7JOtRC14m4K8pS+OOKzHsLdQ7jDBr8IKW8xh7sKK3GCeLxMwSvHub9 51KeP6hQPq/yhsQHZ5n8LH/8wC0oCUtZlQD6Lr7+8xgQdWi77L1qiLCy0XgOuA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643749836; a=rsa-sha256; cv=none; b=Z3pY9s3hx14Vee4qLhJJ8PJCShM6ufEbIgZHPW5HwJbcz/sf5ghHUxzci2rhqqQfGhngZc P3ciW9MSsPLu9zzHcZHRqZD8qWmkxTi3aUg+JHqQ/d0Cu18wrhTr2fCv0Glbs1WxvybbuK wirFfmmotRi7o3fEOmagGwbgM38a1E4dRv4tbwBPSvMf/E3/KVVWQl3UFeJuMQgeep9jl8 0lr0aWDrEazjxJQjzvDmtHt1KmqItL083xQNpTur5ARDmUb++7fDcgN1i0M/Gty7qwXMkA uGrPZ5qUoP2NeN/AAT8IZpq+a2FAlNiWZ8p8OWTM0wOEa4leo8HsL9IrZHsarg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249985 Guido Falsi changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |Overcome By Events --- Comment #7 from Guido Falsi --- I've since reinstalled the machine from scratch and has not seen this bug anymore. Due to this I'm closing this bug report, since I'm unable to reproduce it. Maybe it was really caused by some data corruption, maybe caused by a then existing bug or unlucky circumstances. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Feb 2 07:49:31 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 65CD819A9529; Wed, 2 Feb 2022 07:49:39 +0000 (UTC) (envelope-from peterj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpYq72GhBz4WWL; Wed, 2 Feb 2022 07:49:39 +0000 (UTC) (envelope-from peterj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643788179; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=QZnyyGRzN5dHJjx/Z0tJPGLgol3M3TzZsfwKMDk/jdc=; b=A+wybSqoOvGQJ9Bn4TTj3PbODWbKJkVlWhBJHRZ1eN+PK2EEgzxR3LlrN2i0sMMWYI6FbG O8SP4CKBv/OdTPPKLJzKSDdVGHjB2xhFEcZ/YlZt+hn5CK4jYJSysAbI6CTrphyyxvBlhI dVxtQ2GNnQhUieWjwFxXpsQZvEcoerQDFm3RUzDqhuf7/iaXg9fkmXjlW3ykyNs+CpJ82W p49GNY8RvaI1UwYcek/VJ5oqFF7dvHmKnIT40d2xbfGMumjn2AkZ26GGojsQMgofcz8osJ i+W+kdiOjvFpGqtBLsoUTY8ef3xZRyycUl/oa091Fk9lGp8c4pEijsMR2W4rFQ== Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: peterj) by smtp.freebsd.org (Postfix) with ESMTPSA id CD5496895; Wed, 2 Feb 2022 07:49:37 +0000 (UTC) (envelope-from peterj@freebsd.org) Date: Wed, 2 Feb 2022 18:49:31 +1100 From: Peter Jeremy To: Warner Losh Cc: Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" Subject: Re: bio re-ordering Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="KgkkJ0JjAtxbHxnB" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643788179; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=QZnyyGRzN5dHJjx/Z0tJPGLgol3M3TzZsfwKMDk/jdc=; b=eZTH26lkDJ3Eyq1NxhlNM9rMQDQoBbGzkqhduy+QcrXrJvkbxDdOw9+myKHzDoQ9oges2t 8mGl5QP95rg3Jg3snVHhoiVuzHff+f1uB+VbB15UNzrjcNetC3kZP2TFFL15q5HalB121S 3gckREYlBq2PtCPEifDtZ2zMvLzZS6HHD9xozZUx1ltV9svDxfXgb9CahjgQmBetOxhtCU ck0RIF2itJGascZ/i0idd2ZCJqFkpPQClohrnUl7ZgL0rhbYqIFjBP4pmjoeCqaukej1xA m5GzSJzDQkS27DDG3tzCp+3M+dv/h8oM79AZn8OG0lDCts4eUO4MpuWBtPXDBA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643788179; a=rsa-sha256; cv=none; b=oMpcQEajWIKAfH/Kh97iICFl3lSaU6AbiiFsJlUCMiWz0NYYtbHflPhSqAqeuskD999oPU 2B8Qem6RVCbJoMXWDf7WeowJfkNdT1JAVEoAKRY4BNIT3gRugTRIryOuQGCYbMNCzcAV+7 2Qc+3ORAI9k8Um3azF8E2rVYjacmMC+PnyBYYSFHQlgme3Cq3o7A5P8nRN7FD7S79babV0 rn6ukv9D28pBsRwMp65CPP5Kga1jOebYEOY7/54zIPy43Ech32xpZrV5s0dJQ/FUQQpKHa 1YgChKxxACDPlyXc/XRWjswXynuyB/5/7c6CDpP5CMJ3PazPTp63J7jYiXkYaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --KgkkJ0JjAtxbHxnB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Thanks all for the very prompt responses. On 2022-Jan-28 22:32:02 -0700, Warner Losh wrote: >I think that ufs relies on two ordering primitives, both marked with >BIO_ORDERED today. >That's what most of the drivers key off of. We always set BIO_ORDERED on >all the BIO_FLUSH >events as far as I Can tell. Thanks for that warning. I don't think geom_gate understands either B_BARRIER or BIO_ORDERED. I shall have a closer look. >to it. b*barrierwrite() sets this, and that's used in the ffs_alloc code. In my case, I'm interested in ZFS, rather than UFS and it doesn't seem to set B_BARRIER or BIO_ORDERED or indirectly. --=20 Peter Jeremy --KgkkJ0JjAtxbHxnB Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmH6N4ZfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzS/uw/+ONGwBq5/3KjIJZ+6rzyBja7Yb9EdfOdhrM9C6w4H84CpjWNZK56Aph6D SOMx3x299iAUG6vAehdl5pK91nkM/XBSpdb8JehMmIy1JU+3ydDwLcbaxOxW5Zwm lhqDZLTr6Q+Nsz6PmLMknswiG2tSfuqD3AB402OCHhZzMZaMcQJJ2Yc/vvVFMdMq CkTbWiYwQf33hqcofYHFswsT98p/KF5pG9phO6gHhFowNs8hZ+xwpk4wy24pwJVf 5Se+P6gFF+UzvqZYLtHmDpxnx4AsswZt3RSKhxdneM4n+dcbZl2+wOrlixB0Eq1m vsMIyJfS7a82cynkuwSLMYjxxxqvzRYHpOfc7KE7oGhCGJdYM/evEkrEi4iZBcvg QDRPjPoqeAtfrMdcAO4ev6wEPJwdtZc/fwGu9tfulWsp1Qf6ULMRnHElzitZNdcv vppOMoS9/PPv1EzhTvLD3BID6JTrWotevVeYpN8Tdr4we5HaUdqjjIyXp/dwpCfh XWq2brxr1slTKNHWfFGyg0ZUYsjazQTuC8x9VYFonW4tUPJvDwOG+R7uYuq2F39P Z02RRbhdP6SJsoCF5IkD1Kw1No+4YwVWoedFShaho0K33Ptknm/MBydRlcmzLVB8 KGLdRHKLIQq60C6L7AaQt1A4sPDYgpdPOS4VXvYpfIUcIJcXeDE= =vHiW -----END PGP SIGNATURE----- --KgkkJ0JjAtxbHxnB-- From nobody Wed Feb 2 07:58:19 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9693719AF251 for ; Wed, 2 Feb 2022 07:58:31 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ua1-x929.google.com (mail-ua1-x929.google.com [IPv6:2607:f8b0:4864:20::929]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpZ1L5LvRz4bQR for ; Wed, 2 Feb 2022 07:58:30 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ua1-x929.google.com with SMTP id b16so17634874uaq.4 for ; Tue, 01 Feb 2022 23:58:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=s8zu7WlJC9dEqH/8BcEVlUMKRXMhiRI7M4KL8i8TN4U=; b=i0Rm3+UhIziNdoljUrRMz00YmgKSdWDXJhnn2CjfSg779Dt/KAUasFFnxgblru/RnL 8JRoT+EOAOzzKOoIkL9XRv9o+hvpW4iGR0drjcpx3N4RJkN3wHlodoaSFBrGoAfYYzvh JnLIw6SDI/2DSYoC4kgov9B7f0otAs1y7lf9ls38AerWmHGsd9mXalcgWzqcOf1UPwzn hwU6M7exQDZ6HAJWK7HWJomy5ckLmGe68Dd/l18G/JY+2WZkLXhyhiJti+qM/UefKQDX Q1dEKdxmkgScamRZuYlHWU9KlvncaxaRn6mqdMEFfKfhfltIPsZm+2B11e6nFTn4vaIC U2eA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=s8zu7WlJC9dEqH/8BcEVlUMKRXMhiRI7M4KL8i8TN4U=; b=mEsWfZcmEx7FhvwNLM5aqWxb8sSJ2RwZ2KZkg1q8XucRq2zQtnrISmnlsBC5Xz0ksS l1BVypGm76AyYxvVDFh1PeIk2ao2/6EzGTbutzCgfgOkys8C0A9EMdGqsG9YxNRg9S/z bfcs8ChgzG/WXfOmzYD4KLkFGPzm4KdpsFJpooX9OXkbp14jNW2lltwxJT4yfahxuf/T MrURYAuRKXBiWvjogoJwtiiAPcQB1196jHeqgnQUoRB4E1DDXe/wuB87ZpmWdiRfELU5 zkE4mV9KFk1ooxOoErNYf8BwSLIJ2c/w5c91ZKnWsNCnnIQjemGK91fb8JeGk74ffYMD sYNQ== X-Gm-Message-State: AOAM533xiRpSjycD7xcQvuLEw44LB4xK2Uxr0VHpK34gb2Zp/zkQA6R6 b7IImqmv4QoxJ/mPtUL/Ftzo1r4yrlGYPRv3vzoS3A== X-Google-Smtp-Source: ABdhPJxqqcq9I8UxOKXI1XheR+T4FkCOPOrYWqNagQ/fEpGi4MzLuFslX1Mv5hIJknzaJta1fCMs9bsZ6g0vDpk8YjU= X-Received: by 2002:ab0:6294:: with SMTP id z20mr10905765uao.11.1643788710161; Tue, 01 Feb 2022 23:58:30 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Wed, 2 Feb 2022 00:58:19 -0700 Message-ID: Subject: Re: bio re-ordering To: Peter Jeremy Cc: Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="00000000000027c10305d704624f" X-Rspamd-Queue-Id: 4JpZ1L5LvRz4bQR X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=i0Rm3+Uh; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::929) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.996]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::929:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-ThisMailContainsUnwantedMimeParts: N --00000000000027c10305d704624f Content-Type: text/plain; charset="UTF-8" On Wed, Feb 2, 2022, 12:49 AM Peter Jeremy wrote: > Thanks all for the very prompt responses. > > On 2022-Jan-28 22:32:02 -0700, Warner Losh wrote: > >I think that ufs relies on two ordering primitives, both marked with > >BIO_ORDERED today. > >That's what most of the drivers key off of. We always set BIO_ORDERED on > >all the BIO_FLUSH > >events as far as I Can tell. > > Thanks for that warning. I don't think geom_gate understands either > B_BARRIER or BIO_ORDERED. I shall have a closer look. > It needs to understand BIO_ORDERED. >to it. b*barrierwrite() sets this, and that's used in the ffs_alloc code. > > In my case, I'm interested in ZFS, rather than UFS and it doesn't seem > to set B_BARRIER or BIO_ORDERED or indirectly. > I went hunting ZFS for this year's ago and in the pre OpenZFS code they were used, but there were three layers of indirection that obscured it. ZFS doesn't use the buffer cache, so B_BARRIER isn't relevant. I'll see if I can find it with the new code. But if it never sets BIO_ORDERED, drivers are already reordering things. That's all any other driver in the tree worries about... Warner -- > Peter Jeremy > --00000000000027c10305d704624f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Wed, Feb 2, 2022, 12:49 AM Peter Jeremy <peterj@freebsd.org> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">Thanks all for the very prompt responses.

On 2022-Jan-28 22:32:02 -0700, Warner Losh <imp@bsdimp.com> wrote: >I think that ufs relies on two ordering primitives, both marked with >BIO_ORDERED today.
>That's what most of the drivers key off of. We always set BIO_ORDER= ED on
>all the BIO_FLUSH
>events as far as I Can tell.

Thanks for that warning.=C2=A0 I don't think geom_gate understands eith= er
B_BARRIER or BIO_ORDERED.=C2=A0 I shall have a closer look.

It needs to unde= rstand BIO_ORDERED.


=
>to it. b*barrierwrite() sets this, and that's used in the ffs_alloc= code.

In my case, I'm interested in ZFS, rather than UFS and it doesn't s= eem
to set B_BARRIER or BIO_ORDERED or indirectly.
=

I went hunting ZFS for this y= ear's ago and in the pre OpenZFS code they were used, but there were th= ree layers of indirection that obscured it. ZFS doesn't use the buffer = cache, so B_BARRIER isn't relevant. I'll see if I can find it with = the new code.

But if it = never sets BIO_ORDERED, drivers are already reordering things. That's a= ll any other driver in the tree worries about...
Warner=C2=A0

--
Peter Jeremy
--00000000000027c10305d704624f-- From nobody Wed Feb 2 09:05:17 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E634119B51A3; Wed, 2 Feb 2022 09:05:21 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpbVT3Wkpz3Gmk; Wed, 2 Feb 2022 09:05:21 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643792721; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xCgZZroRLMQvPs8q+SWnyg7yHcLBH8pnzjla4w3EX/g=; b=FYN3E2XEP94YSqjSUuOq2yuBhw5CiKXnQ3ztctix9AqhZkuY3ea9gbF5ggFfoK6acphu+D GUc0AI7/p6tX+v9fp1hyNEGmB/REAi/7ajzygstJ8SDkkov6zHo43HQHc1n0xsnyfkjAtN Bxh/oYUuc/4LnJe+aZlYP/o+f0uUalBsl1NBe9AE7VSkGryUvRzb/WL71dJeWRL+Ic1Rds ALpV/Z5veN95uFF1VY/r9oFOuXC8ge3K+kS9qTjKRvcGbI4VfCAf0quUVbjyuAB3DdKTM7 DmG+2PhjDtnZmfiqjzIjGUCUzI78DfUo/eCS6MUYsImRaxQBn0ocGbNg6+Z1Sw== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 7165573B4; Wed, 2 Feb 2022 09:05:20 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: Date: Wed, 2 Feb 2022 11:05:17 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 Subject: Re: bio re-ordering Content-Language: en-US To: Warner Losh , Peter Jeremy Cc: Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" References: From: Andriy Gapon In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643792721; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xCgZZroRLMQvPs8q+SWnyg7yHcLBH8pnzjla4w3EX/g=; b=TIFl42RwDPOwCX+efaJt4uLflVQfkGVCBX3U2EWbNQGYg/FaqguZFQUKzdBz5OkWyFyh7w niJP7V7Q7kuSj67kC/L/lLwDtF4sP6Fqg9VrATBOc5TH4w5+XsWMYE57znjCwAxt56dflW TEYvHKMS5q50RQefPjRN41D7xluwEKa1/W+UHS/qrYcBYuKRimDBjC/+XCmSbpJ+o5y5KR iubNvPw5Ot0kmDDpmjnm9jZIcr/9S7gy0aMBTfNmubG1PnYmUQdJxlGgLYTnX63gSLsIUY EmAhnsMrr+b4xre8XY/GQmgILuWjjdHjU5o94wAM1i1JoGxkdJItkri2yr02Ag== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643792721; a=rsa-sha256; cv=none; b=S+RPwDrXi89OvmaH1UsNTP7kmIUYL+K1rYCIFz9E5JuqiAQxstdkrr0qWBKnY/bV6HGQkN 2CfaJhJsqot09U+QMaKjJ6ehBNG8JMNlRUEmHXCjO6WkDIOEAoJEmyITTXkqPbwJVwCM2L SD0OYQaqjEc2OWuY6tP5FbFSEZML/G26M3JJdIjmfarlnPo5+rLWf9Vi7UjkOMSRcLEG92 qjhFY8n6ROwA0/LFmNwCRbsTAKQXpFv/Zyk4n5rNSpq7YHqoXjFwIfRNl7uwBeK2rL9YVP Y3jJJrO6pEdo3b6DbA6HDv5E5Tm/OQVnfve3ByYx3bxIm9/EOXo5LeMnCnGX6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 02/02/2022 09:58, Warner Losh wrote: > > > On Wed, Feb 2, 2022, 12:49 AM Peter Jeremy > wrote: > > Thanks all for the very prompt responses. > > On 2022-Jan-28 22:32:02 -0700, Warner Losh > wrote: > >I think that ufs relies on two ordering primitives, both marked with > >BIO_ORDERED today. > >That's what most of the drivers key off of. We always set BIO_ORDERED on > >all the BIO_FLUSH > >events as far as I Can tell. > > Thanks for that warning.  I don't think geom_gate understands either > B_BARRIER or BIO_ORDERED.  I shall have a closer look. > > > It needs to understand BIO_ORDERED. > > > >to it. b*barrierwrite() sets this, and that's used in the ffs_alloc code. > > In my case, I'm interested in ZFS, rather than UFS and it doesn't seem > to set B_BARRIER or BIO_ORDERED or indirectly. > > > I went hunting ZFS for this year's ago and in the pre OpenZFS code they were > used, but there were three layers of indirection that obscured it. ZFS doesn't > use the buffer cache, so B_BARRIER isn't relevant. I'll see if I can find it > with the new code. > > But if it never sets BIO_ORDERED, drivers are already reordering things. That's > all any other driver in the tree worries about... Hmm... it looks like both the old and new (Open)ZFS use BIO_FLUSH command without BIO_ORDERED flag. Not sure if it happens to do the right thing anyway or not. -- Andriy Gapon From nobody Wed Feb 2 09:14:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DFE2F19BBDCC for ; Wed, 2 Feb 2022 09:14:52 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vk1-xa34.google.com (mail-vk1-xa34.google.com [IPv6:2607:f8b0:4864:20::a34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpbjS0fbkz3MLT for ; Wed, 2 Feb 2022 09:14:51 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vk1-xa34.google.com with SMTP id w17so12183140vko.9 for ; Wed, 02 Feb 2022 01:14:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=URcyLJzFWa6G0qMq/BWFVhe3ys6GDyOqOKh8uu9u20I=; b=JvjbNKtCnWcU+VzmwuDnmkWiS0ETrnnLtaXp3h57YDXdTJcPIoxqGQQlF23qGF9qTy sIzqnOjRUDuqe/U7dkSTRK01QsqelWvQcIbUeMrF8+a1qunliYqrHD4Xy6HYPajf1WRs hat+hmF0zCFA6vCU6RSuTuIoPHUT5F9sZaOMJw0e//lWj42U9IKHMQM5YytDxZndSxOH yY4+Oeuduges5nvylgVsS3UmJJS0QGfVHT2DO8tRlzF7kM7HMaQWr2MGjrImdRNnwXBN Lo0unMe30et12qhiSF/0Kxx2HMG8riY28Yk6lOSFeg+G+A21JULGXpESlQ+HQ9ZVbm3e TQ2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=URcyLJzFWa6G0qMq/BWFVhe3ys6GDyOqOKh8uu9u20I=; b=udsUAv1cHa4VpPySd41/T9aZowCcMB/M1xuAIwiL5bIDcYuZnTQ5ADkubpmh0ZIB7O P03o3lRTvmZ7RkdxZdvPNvH9xiXwbAd+k1azttgD4ZuR0tAnoJs7cWKPSoFOTJ2i0K4b 6Jy7K+cmADIglfMpBXgY+UVdtM2Q8oiR0CsuXzf0K1vhumT0smv81OPcY4NQIUWd+U7q ZmjFqcTfufpVdxUjrrpWOv5qIYfZTBGU7+SWbHR28yD23TuUnqQp4JjuqyoZsnwjox3V ZC8wYh5989qawtJRI3nmfYzfnanDWeewq73w5IRuA5UBpPaHxHm7ACMIZpTuWMrqRShm vDbQ== X-Gm-Message-State: AOAM533oVPYlLCd44xBnq7WNO0a3WDek4fVw6gagkjJFLrLrO8F3Tr/h 0fE22lGGfw8XkK+5PzKq6gDyGl+UwI5zNTafGRono3+4CSw= X-Google-Smtp-Source: ABdhPJz1PRBMGRZTlwV0STGZgDiv7+29u6aTAYeS+ge7KRwh9e6TthDURt1nYgZW3/pWQjCJ3t4p4R01FBOyMDVmO70= X-Received: by 2002:a05:6122:134e:: with SMTP id f14mr11960206vkp.27.1643793291194; Wed, 02 Feb 2022 01:14:51 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Wed, 2 Feb 2022 02:14:40 -0700 Message-ID: Subject: Re: bio re-ordering To: Andriy Gapon Cc: Peter Jeremy , Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="00000000000034caef05d70573b8" X-Rspamd-Queue-Id: 4JpbjS0fbkz3MLT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=JvjbNKtC; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::a34) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.999]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a34:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com] X-ThisMailContainsUnwantedMimeParts: N --00000000000034caef05d70573b8 Content-Type: text/plain; charset="UTF-8" On Wed, Feb 2, 2022 at 2:05 AM Andriy Gapon wrote: > On 02/02/2022 09:58, Warner Losh wrote: > > > > > > On Wed, Feb 2, 2022, 12:49 AM Peter Jeremy > > wrote: > > > > Thanks all for the very prompt responses. > > > > On 2022-Jan-28 22:32:02 -0700, Warner Losh > > wrote: > > >I think that ufs relies on two ordering primitives, both marked > with > > >BIO_ORDERED today. > > >That's what most of the drivers key off of. We always set > BIO_ORDERED on > > >all the BIO_FLUSH > > >events as far as I Can tell. > > > > Thanks for that warning. I don't think geom_gate understands either > > B_BARRIER or BIO_ORDERED. I shall have a closer look. > > > > > > It needs to understand BIO_ORDERED. > > > > > > >to it. b*barrierwrite() sets this, and that's used in the > ffs_alloc code. > > > > In my case, I'm interested in ZFS, rather than UFS and it doesn't > seem > > to set B_BARRIER or BIO_ORDERED or indirectly. > > > > > > I went hunting ZFS for this year's ago and in the pre OpenZFS code they > were > > used, but there were three layers of indirection that obscured it. ZFS > doesn't > > use the buffer cache, so B_BARRIER isn't relevant. I'll see if I can > find it > > with the new code. > > > > But if it never sets BIO_ORDERED, drivers are already reordering things. > That's > > all any other driver in the tree worries about... > > Hmm... it looks like both the old and new (Open)ZFS use BIO_FLUSH command > without BIO_ORDERED flag. Not sure if it happens to do the right thing > anyway > or not. > It's an unordered flush then. The flush will happen whenever. I have a vague memory that ZFS will only issue this command in cases where there's no other I/O pending. It will be the only way for it to be reliable with nvme, since the BIO_FLUSH command isn't ordered w/o BIO_ORDERED flag. So ggate needn't do anything special for BIO_FLUSH, just BIO_ORDERED. Otherwise, it's free to reorder as it sees fit. The CAM I/O scheduler takes a little bit of liberty here, btw. It interprets BIO_ORDERED as being only wrt BIO_WRITE and BIO_FLUSH because if you schedule both a read and write, the results are undefined. nvd takes a stricter approach and honors the ordering more strictly. Warner --00000000000034caef05d70573b8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Wed, Feb 2, 2022 at 2:05 AM Andriy= Gapon <avg@freebsd.org> wrote= :
On 02/02/2022 = 09:58, Warner Losh wrote:
>
>
> On Wed, Feb 2, 2022, 12:49 AM Peter Jeremy <peterj@freebsd.org
> <mailto:pet= erj@freebsd.org>> wrote:
>
>=C2=A0 =C2=A0 =C2=A0Thanks all for the very prompt responses.
>
>=C2=A0 =C2=A0 =C2=A0On 2022-Jan-28 22:32:02 -0700, Warner Losh <imp@bsdimp.com
>=C2=A0 =C2=A0 =C2=A0<mailto:imp@bsdimp.com>> wrote:
>=C2=A0 =C2=A0 =C2=A0 >I think that ufs relies on two ordering primit= ives, both marked with
>=C2=A0 =C2=A0 =C2=A0 >BIO_ORDERED today.
>=C2=A0 =C2=A0 =C2=A0 >That's what most of the drivers key off of= . We always set BIO_ORDERED on
>=C2=A0 =C2=A0 =C2=A0 >all the BIO_FLUSH
>=C2=A0 =C2=A0 =C2=A0 >events as far as I Can tell.
>
>=C2=A0 =C2=A0 =C2=A0Thanks for that warning.=C2=A0 I don't think ge= om_gate understands either
>=C2=A0 =C2=A0 =C2=A0B_BARRIER or BIO_ORDERED.=C2=A0 I shall have a clos= er look.
>
>
> It needs to understand BIO_ORDERED.
>
>
>=C2=A0 =C2=A0 =C2=A0 >to it. b*barrierwrite() sets this, and that= 9;s used in the ffs_alloc code.
>
>=C2=A0 =C2=A0 =C2=A0In my case, I'm interested in ZFS, rather than = UFS and it doesn't seem
>=C2=A0 =C2=A0 =C2=A0to set B_BARRIER or BIO_ORDERED or indirectly.
>
>
> I went hunting ZFS for this year's ago and in the pre OpenZFS code= they were
> used, but there were three layers of indirection that obscured it. ZFS= doesn't
> use the buffer cache, so B_BARRIER isn't relevant. I'll see if= I can find it
> with the new code.
>
> But if it never sets BIO_ORDERED, drivers are already reordering thing= s. That's
> all any other driver in the tree worries about...

Hmm... it looks like both the old and new (Open)ZFS use BIO_FLUSH command <= br> without BIO_ORDERED flag.=C2=A0 Not sure if it happens to do the right thin= g anyway
or not.

It's an unordered flush the= n. The flush will happen whenever. I have a vague
memory that ZFS= will only issue this command in cases where there's no other I/O
=
pending. It will be the only way for it to be reliable with nvme, sinc= e the BIO_FLUSH
command isn't ordered w/o BIO_ORDERED flag. S= o ggate=C2=A0needn't do anything
special for BIO_FLUSH, just = BIO_ORDERED. Otherwise, it's free to reorder as it
sees fit.<= /div>

The CAM I/O scheduler takes a little bit of libert= y here, btw. It interprets BIO_ORDERED
as being only wrt BIO_WRIT= E and BIO_FLUSH because if you schedule both a read
and write, th= e results are undefined. nvd takes a stricter approach and honors the order= ing
more strictly.

Warner

=
--00000000000034caef05d70573b8-- From nobody Wed Feb 2 09:49:44 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 79ACD19A8AB0; Wed, 2 Feb 2022 09:49:48 +0000 (UTC) (envelope-from avg@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpcTm300bz3q9p; Wed, 2 Feb 2022 09:49:48 +0000 (UTC) (envelope-from avg@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643795388; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FA/jePrRhJzXTIWIr4FdLmyyvsEjugB9sd9EXmYpY9s=; b=N5wnpuAZItff9/8eh0SSFc/WPQE8cexWpY/JXRQZ9uDQA0bPhm8aNezc5u7MCnOtHb9yiz 15Ox4lnwAcaLjU8NanYdZYmb5Ob4XE9srxU9KqysWiFA7eCj2yGfjAdaPynZgscVGMi3bT cpo4p1x6zLQ3D8qFm0b7lEfO/s+clZlPeK49Wg2EgA5qzzOD3nEkKC/Ect52fDE46WSFmp 19ta3scGuI4NkzdKwnEEAIlacXJGyOW7hvZa0gdQy3F+kQ+8J+ZOFIjLfxakTdO/khGk6A +omk0JDdBCF+jwpHvX00AdzHoeUjJabQ2TdTtXftKV7k04XmFSoHNm/9dvd2PA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 89C4979E2; Wed, 2 Feb 2022 09:49:47 +0000 (UTC) (envelope-from avg@freebsd.org) Message-ID: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> Date: Wed, 2 Feb 2022 11:49:44 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 From: Andriy Gapon Subject: Re: bio re-ordering Content-Language: en-US To: Warner Losh Cc: Peter Jeremy , Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643795388; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FA/jePrRhJzXTIWIr4FdLmyyvsEjugB9sd9EXmYpY9s=; b=vmc8326HyVOWNHVQ/qp/GJnLa2h7UZVmtsup2gfTwSbJuTULJzfN54zB77Ae0wVUD/BR8a 3ZcPDQAbiyhkPvS7c4o8mYdDCTlF/Sg26DnFBEuWLI230efF7EweIsh+xq0Xd2j7AOMbB1 B68AXx4edzkPzer59d3/hSXs7KH7IvNU6XncQJkr+I3S9haocc7TbvLXPq/fSmSobyyeRA 04PoPPCdL1X+D5LIMuTfuS4+IM8GOjtTWJ1l7Vpvy7dYzdU71rATk3E5WuvN5dZ1o8MRtb rff0ZbqQ6kp3+ZJswrd9a1B2at9ISQ/dZz/96sMIBTyyW2rv5lFRerUBfZTV1g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643795388; a=rsa-sha256; cv=none; b=WW+t8UJMR9gdb6rdluD5IlGvyz2+yvfK78N5+2U8XHS1h97X8k7HjZY3CWUCaBSA8OqHf7 vSS3rzqbzrxAA1CAifyvzfVmKkBmNPd4eSSIKGgWaStPxLEfHSi/1gS9it1SK6d1W8Cikj evQlHf47+80TjiZIeLh2eCUfY1w3IJ14vfvCmpqqNtFGnsOFbItOJGm84n7BcrxzSSndX2 bY3lT0RGyLay51txEF69v7bLh8iQHbUINfTTfJz+K7RDhMo7zTQD0ptGBz/W1CjQceNXo3 YEUPYwllWO6fE4LHRNogM6jDlwQiq+ukdOstb5ZdOORdkJox9/6WzGB5pEaPCQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 02/02/2022 11:14, Warner Losh wrote: > On Wed, Feb 2, 2022 at 2:05 AM Andriy Gapon > wrote: > Hmm... it looks like both the old and new (Open)ZFS use BIO_FLUSH command > without BIO_ORDERED flag.  Not sure if it happens to do the right thing anyway > or not. > > > It's an unordered flush then. The flush will happen whenever. I have a vague > memory that ZFS will only issue this command in cases where there's no other I/O > pending. I think that there is still a potential problem that an earlier write request might get re-ordered after the flush. I think that we should add BIO_ORDERED for correctness. > It will be the only way for it to be reliable with nvme, since the > BIO_FLUSH > command isn't ordered w/o BIO_ORDERED flag. So ggate needn't do anything > special for BIO_FLUSH, just BIO_ORDERED. Otherwise, it's free to reorder as it > sees fit. > > The CAM I/O scheduler takes a little bit of liberty here, btw. It interprets > BIO_ORDERED > as being only wrt BIO_WRITE and BIO_FLUSH because if you schedule both a read > and write, the results are undefined. nvd takes a stricter approach and honors > the ordering > more strictly. > > Warner > -- Andriy Gapon From nobody Fri Feb 4 10:07:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6BE2119A1075; Fri, 4 Feb 2022 10:07:07 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jqrmq241tz4n28; Fri, 4 Feb 2022 10:07:07 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643969227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=RvUIV2G4d5RBuL0ufm9EKGobpYo1ErAUk6UXTMl8JV4=; b=TIn9k7abiQY1xVhhtngoliymQ7qOiYZFP0vjBUeIxbNO0cTeCc+lorXnLWkR6GCTy7nBan xTSxegY8s4GouSDcLOUcNYBvMs9ZUTGQ6FKcuQfqlNNyejuanym8p+1jQNatb0BKZk7qwt FRk+Yd5Df6iMpbAVrL3hwLD6mGNlFHNF/dqdfPtQHrlkEPxXgtv84XX4JthA5NQlZumoOC hiCWUWP4qrCgrsISRnplM/mc5zx67CaKQ7VeR93ExUFLSO+AJmkVJ9klqM5cquMhR8I9Jo WAr9x4Ph55dQ/34HApcVgStpSSPnFhJ0jTOqtsirty3tzSKUQ0lzcOJYALkmhw== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id ADF542F6D5; Fri, 4 Feb 2022 10:07:06 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <556a2f46-9dac-e0bc-10a7-d81bf7c99f5a@FreeBSD.org> Date: Fri, 4 Feb 2022 12:07:04 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 Content-Language: en-US To: freebsd-fs , FreeBSD Current From: Andriy Gapon Subject: rc.d/zpool should require (rw) root? Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643969227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=RvUIV2G4d5RBuL0ufm9EKGobpYo1ErAUk6UXTMl8JV4=; b=crex5P316EbWtrsoIpcdIUB6JwesJq9Z6cxxYX3RI4YrOL9O9CAEQxbWB5AkD2zImH9BqM hC+j9pHmhawfIxrMKgLQSQIkeIU5PDtwYcfkHRqC8LgbTRwL24fCSRgOXhz5toZoL31/IL gjyux+NnojZBBJi7uD1xiLdf7yik9X5MD4lGpcffm0SCliRltdkkS3eSftd1eEUSsuhvtY qV7088GTiLnyyIbRk/ZAPHRpB/AKlYjLXYswiTOFsNSC5ma+fqqvExcxbQ3oOBXg47ti1Q eEo/bW83VGqWPm+ePR6rUjWkSLvUcOofVwWjJqeJXw0fpQVG433DpR/PAp0XdA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643969227; a=rsa-sha256; cv=none; b=DQTQzgxQtAPpI0s1fB7YGJt8iNRg4BlUGnZPgGNwUW8PG2uzA6x0lYuCuo6XKbmPvASCew ZnP8mpARrbd5qHF+QU+BBMDZU/ltNLI0B8bWZm27rNVY4tTF1sWwrg27qOK44zojLLFLze lAEq5V4eLJT1ob8YjZ7mRLYNS4ZnNXGUA5vEcg0cQXMPPfuKyz54rX7gnlIWPt6R0OmOo3 Oio1VB5TemC2TL0TZLRefqq80737nhgUA9Rkl2OTJiEV0lE/7rnTSdp9Bl9DoAsYY3xt3F 9Hncwh3TyBOd4I9Wp2ce3B3ivBteY7fLLo4NRP3AvueHZvhelvnvhTiXjwWCWw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N It seems that in some cases zpool import -c requires read/write access to the zpool.cache file. So, it probably makes sense to import "other" pools (non-root) after upgrading / to rw. What do you think? -- Andriy Gapon From nobody Fri Feb 4 11:41:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9D52419B93FD; Fri, 4 Feb 2022 11:41:13 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JqtsP3XV5z3wRs; Fri, 4 Feb 2022 11:41:13 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643974873; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LFW4DI2LNPdUeC7AlQYVg9GrAMGH3IpZfRR4ATyn6PQ=; b=maTOxTTmeEs7q0NUfASeKnZTNck/qxeIiT/ssaNYjWlz0u0Q077EH4wrXuuHzZYbdheIHd Ax//CW79W8k5WJRnzPrVobsGMSGWHQ0k4sRSn6AVrL8Y7dH5Sv8pWR3rB929BkhqTG9L0M mJ3eMP2V5/K0/uSFo18Nt252svlI/6jYU80quc4Y0DrRLdobaktcj8lHIN/NxtAFVDUSkp /uRDZbWoMnpNV3KMjIKmeRdnlLeU0+kuGnjphX7NaGhfb6UdxnNIgcEK+SJcxbTR158HFs 04PMHYBYzcT8WayWh53bwLk7bbbTKoW7Z0TFFq8oJ7OFSrVr0MT/cd9u70Gdbw== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id D9B9730568; Fri, 4 Feb 2022 11:41:12 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: Date: Fri, 4 Feb 2022 13:41:10 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 From: Andriy Gapon Subject: Re: rc.d/zpool should require (rw) root? Content-Language: en-US To: Daniel Braniss Cc: freebsd-fs , FreeBSD Current References: <556a2f46-9dac-e0bc-10a7-d81bf7c99f5a@FreeBSD.org> <2904FD1B-456C-41A0-B097-52C0EEC711E7@cs.huji.ac.il> In-Reply-To: <2904FD1B-456C-41A0-B097-52C0EEC711E7@cs.huji.ac.il> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643974873; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LFW4DI2LNPdUeC7AlQYVg9GrAMGH3IpZfRR4ATyn6PQ=; b=SXk75aLowLvJze0uVdzQE0u8Fc7C9lmeEGfQAmg5mP+6xjmMbE/RyIX4ofjJczj8dv/mdv 8w21XujaXeyuQeS/uKa7Slwwm45/5mGZM0w8S1foeYQW112sLKNyn0VZa62wnXAntOQsEx 6iFdw4BLQtve240CDEUVW5NThsaU7Hd+D+OI3AahrbqHTbDMP8QuaZremX9J9OKIXjmh7Z keg+4YDaJLN8ut355mXtB7uEha/mryFka8uz/BjH51CT7fk2U5acbOYbTNYXYu8azXdEiZ Zrhv5dobMvnMwVevczTcCF2cg/h1E9sPXTJecwUm4wMqeUuKbAYxderXhtzORA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643974873; a=rsa-sha256; cv=none; b=RlJ09uGu0IM6HgZWF17QxQSfat6s1rHXkK/isSPlc2+4JzEIcXc/xSelwDGFXNeS9nToGR /L/qIi0xniGlZtr9tktP4stRIngmoHYFWn2m/xzs4Ert/Bs1//1HY0PXB9NyL8zec1A5VY +gETFJGWPXMMCh26TlXtlxMNRfyR7YPDTW5zhjgcTfDOvlb8FtEQ1E1hVFXl6ffT6xAKoE tS1bm7B7ZMa0ndXBGRni+kAJLJwfKfULXAAta8PHxhqZUCOUgRUiKz45b8XtVYyRx/jEgR uVZfQxKN3AG6/6AJMKpdIpQtX7Qr4Ly+l/1BGGP4qP8XgJHpW368zmHHcdJI7A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 04/02/2022 13:23, Daniel Braniss wrote: > > >> On 4 Feb 2022, at 12:07, Andriy Gapon wrote: >> >> >> It seems that in some cases zpool import -c requires read/write access to the zpool.cache file. So, it probably makes sense to import "other" pools (non-root) after upgrading / to rw. >> What do you think? >> > > what if root is ro? i.e: diskless? Then nothing changes. rc.d/root would leave / alone. -- Andriy Gapon From nobody Fri Feb 4 19:49:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8325919B92A4 for ; Fri, 4 Feb 2022 19:49:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jr5hJ2NfXz4SFF for ; Fri, 4 Feb 2022 19:49:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1FE4A118F5 for ; Fri, 4 Feb 2022 19:49:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 214Jn47T059833 for ; Fri, 4 Feb 2022 19:49:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 214Jn4CZ059832 for fs@FreeBSD.org; Fri, 4 Feb 2022 19:49:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245916] Superblock check-hash failed Date: Fri, 04 Feb 2022 19:49:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644004144; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8t2x503D1h+ZQbEMJZweIuRpBgsw3x20M1ccA2tzg3g=; b=xvnoe9gFP4w9me4NJVj5fttCHN9CHqqwZ0LGw5N/CyA+EWzZt+5TdYuevKqS1tPbHKY9Pk IXV6oBwbS1nDSOpt5TEWSOnI5NNlhoWZhyPbBTD7n7PipNC5nDX/fT0t6ro5qTfSvKzauc TUobQXDs7bKAwlYaXIb9dR2RET8vIK2CAkcmhxZFsR/g1bteD49R8Fv+zzVcgsk1HkVOJA DEa69zWD/sJjee8H0dslNMd1P4IajbJtgK2qGGsgZmQpcJnAU7k8wRIOQt5ugoHiBpBigr XfPz561S1R7hb+W0TyZuAQKHRJZhgTB7IFCSnqAIGfBGyXHx0nAmNYDBFhR3YQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644004144; a=rsa-sha256; cv=none; b=wWNg1s9MllaIwdNgvYXI4qnatuFts18r3PUSRS+SmSoy7IEr4A95jPFlJ+urRNNuEnCvPg IF0FZHcAMYj0/exYb2ygirHywpR29A2B/TOIJWqQr9od4fwVRdsKJGt0jST2m9Yfd0d6uq H9cLncV0hCVVlhqyO5VBh7fI1X73/tIFI3Xfm+vfCAP41GU4XaQNRsovg/WFDaH3KCE96d tOCFxqe6HfIHNtw/MXDBnerXfXcBqiyqyMFJuIsEoyhohPAlirZFPKaO5oQBKCH2JGJo0y rGdKgT4rAAqtTxfXjbyubsWzbh4t8bD8RSLYPsvz3FrcmIizopJpwrz1eUXDGg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245916 --- Comment #4 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dc0bfa109b942659f609b7e2bf3ba042ec= 0cb3f9d commit c0bfa109b942659f609b7e2bf3ba042ec0cb3f9d Author: Kirk McKusick AuthorDate: 2022-02-04 19:46:36 +0000 Commit: Kirk McKusick CommitDate: 2022-02-04 19:47:48 +0000 Have fsck_ffs(8) properly correct superblock check-hash failures. Part of the problem was that fsck_ffs would read the superblock multiple times complaining and repairing the superblock check hash each time and then at the end failing to write out the superblock with the corrected check hash. This fix reads the superblock just once and if the check hash is corrected ensures that the fixed superblock gets written. Tested by: Peter Holm PR: 245916 MFC after: 1 week Sponsored by: Netflix sbin/fsck_ffs/fsck.h | 1 + sbin/fsck_ffs/fsutil.c | 4 +- sbin/fsck_ffs/globs.c | 6 +- sbin/fsck_ffs/main.c | 309 +++++++++++++++++++++++++++++++++------------= ---- sbin/fsck_ffs/setup.c | 182 +++++++---------------------- 5 files changed, 258 insertions(+), 244 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Feb 4 19:52:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AE0FE19BB76A for ; Fri, 4 Feb 2022 19:52:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jr5lz2Jh2z4Tvx for ; Fri, 4 Feb 2022 19:52:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 193ED11D1A for ; Fri, 4 Feb 2022 19:52:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 214JqFlb065192 for ; Fri, 4 Feb 2022 19:52:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 214JqFc2065191 for fs@FreeBSD.org; Fri, 4 Feb 2022 19:52:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245916] Superblock check-hash failed Date: Fri, 04 Feb 2022 19:52:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644004335; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/5m/t74iaugEi0CoWFbjtXKRdpvh+l1CiF4DVaRvAqU=; b=FabQoiUiNQG/Y/ANAGzUE/ArmAl31OcfrUNxRrozfy0q0Jqa44+mb3m7tB6PToZBImMKsN wuw5I3n7hgzHOpgJrM81BKDe1pOsHIOYquZUuMsNU5O2yopF9DsDsZgftbCgmj2OlfVJ+k mlBcwis2qwaaWM5btXoCqhuH/eqJC6IYLCxSLY/Pjpv5g4Y3/B3PQPLZTH2tQO7oXCK6zM 4QdbGkdmNnWY0G85MwQpNbt0sm7t4qgiha+DSAekNPWtKwcUqNmPFdAOZDctfe6oX1e0VK nsgXSOyCHbOVG0vh526tQ00ySK/0lQ4g3DdbJaSwvaw2bdvIDs8OEORkPx24vw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644004335; a=rsa-sha256; cv=none; b=Um6NIPBu5Dg6EpvUSmesN7NVXe8ZD68l3unZuxugvqPFXK++IeArzuKFN5hnFcl4hQN312 Kj5yStyzZzCiRbF5aevpxZ/VW7Mx+77rZWFM0ycE527I1ba1Q5tGwHl6h9s/BB1Mzub7uW wAUKLLkCHyD4O66eeajxSxlTPm2eeDBrfPk4syXG7ZT4vmcAVQLha8pPvsxkFEJRE58dDz Sdf1jfUlJdfcp8TVFjBNTuiIfdiet7bsH7A6EANJ1XZVbjBKWIQaH1xC0UoBWLu9ZnfrxY fVVdUy/0Jva+0FWZtgOqZGISc35YiCxfcTSs4duP8crXaQ6452zT35WUndlpMA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245916 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #5 from Kirk McKusick --- Fix added to head. Will close after MFC to 13. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Feb 4 22:01:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3FD4B1989450 for ; Fri, 4 Feb 2022 22:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jr8cv0cHrz3NKC for ; Fri, 4 Feb 2022 22:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E935913A12 for ; Fri, 4 Feb 2022 22:01:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 214M1Ipl029706 for ; Fri, 4 Feb 2022 22:01:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 214M1I55029705 for fs@FreeBSD.org; Fri, 4 Feb 2022 22:01:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256816] 13.0-RELEASE-p2 ufs2+sujournal. Fatal trap 12: page fault while in kernel mode Date: Fri, 04 Feb 2022 22:01:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: viaprog@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644012079; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Hz+iswpoCq83TiRMQQ/c2mH5K2e4q8daCj7RGRpAKwM=; b=FY7p04UO7XpnjyBpOX77a7h1ZYNYVZ4iYnR1RicJ5kG0Mo/S5jbHu/ESMmPoZStkhV7Iv0 SQv5El5woK7o2ixw3sbvK89uEKpWlMrdVoY0XX8QzooLzIOC0CsSZbaZ8uyr9y3BOYTfY1 9SlktnwuIL+DhbPson6XqW0j3JytqBgG6vecyfVSUWuKmad2bQ92hal0QxyB3PzkoidFZf Hbm6wSZTBjQl2+8xEY2Fx+P7LVTFq1ug2tGwLkeq8lr4oIvaIR/rmKHwDQavFGiEZWrm1A nMlB4q8ru9Wrqhi1alw6DDrvTNYONaxELKYJykln7hvxl3fgJ5nCXSmH/SW0yQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644012079; a=rsa-sha256; cv=none; b=QYq5lcJPbsYK3GA+JJW42p0KqECRsi9BtFpN9J1KEIT0hMSWIWwfiAanAoXHPwiCefyIbp qs0Krm+3/u/f+BnZeITvjh6uucJMmEilkbZb1A0X+yA+/OA/gxfizeBGUJIoXWg94VFjt9 leZpmj7VJq+FRgWJtgmyOifNekFDwLFO1LJA6w95zJeXmc4HABPHetoBaa3RfXQX4ET8yS H0tmkGrsY7yaqog/x5cHGhQMrTSUP+XY87eBfATPQ4/vkNfOug8vntJH4QRFytIGkEQl25 ZFnNRuNhPRVvDFdn3UUTdEJxoroRiybHV34vzIYCxoVc0DwQPT5896LgXcPEkQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256816 --- Comment #4 from Igor A. Valkov --- Without softupdates journaling (tunefs -j disable) works fine for six month= s. The problem arises, as I understand it, when we try to move files that are = not yet committed to disk and are being processed by soft-updates. It occurred to me when unpacking an archive with several tens of thousands = of small files and immediately trying to move them somewhere. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Feb 5 09:50:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C1CAF19B08E6; Sat, 5 Feb 2022 09:50:16 +0000 (UTC) (envelope-from peterj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JrSLw4wKLz4XCy; Sat, 5 Feb 2022 09:50:16 +0000 (UTC) (envelope-from peterj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644054616; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=8UuycKd7Jw+0pRNeJ79pjKwEN1kpxCxQ7Y0rULrcOqo=; b=EMp/DsKDFM8U28TK09eHzDvudh9tZQoRp/cDUb1rOOQtXZf6PVj6dEgrYGQq6IYxwFyasC 0snPlI9iMlcnROt/ve8ZLPk4CFP41NukDSGpNTzlQNxegsRNbmGFUX//dr4ptqLF5mR4kP /2GyiMVU+ohAGRyCe8dlNWA9VpavhQ8QYmx1etixzTYNwioIwsAPfG2pGde5A8uCv6JJi1 Q4Ej0gEh0ZVIkwMhTURj1STX17AVCecJfsyBKQj7He7rrGFOMHzEcZbb98wKKM4xVv7Q2b sxvZ1tz2EQsqGmlaCZiyfi12ZeOVnspc2FDLFh/rPGNvF8iI39mFc9+fUlrpLA== Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: peterj) by smtp.freebsd.org (Postfix) with ESMTPSA id 021252FA6; Sat, 5 Feb 2022 09:50:14 +0000 (UTC) (envelope-from peterj@freebsd.org) Date: Sat, 5 Feb 2022 20:50:08 +1100 From: Peter Jeremy To: Andriy Gapon Cc: Warner Losh , Konstantin Belousov , FreeBSD FS , "freebsd-geom@FreeBSD.org" Subject: Re: bio re-ordering Message-ID: References: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="4gJQ1wOmIuMqLtLv" Content-Disposition: inline In-Reply-To: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644054616; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=8UuycKd7Jw+0pRNeJ79pjKwEN1kpxCxQ7Y0rULrcOqo=; b=Dz8f39brrp1+MhDrjZ1pc06tq6FjTA+u3oFgQuVzKKRJxvBzrjgx+UJ1xugRj+ZsswNnda KDoM1VHFnRLzUQZB73INuA/4EZ90UTLZAgYA1eGowncjYdqsh2ZfKhO+gRkS2G49mV9o+i ZnnujAFiLGdXTdgFDoEJ//t/tQZBkYtwKmCunvmRtU4esKAL4TLAVucjOCxazZHSOdGnP7 uEIH22e4gXzlTlkkaSkf3eW6ycrJtFUmlr0tJDsD8wfFjAZcQ7HbUgmSkBlQtCaGNZIu/Z mpq8+wJRgIv7TLBBr8olLi+itTU6gYXjNFGi7SfV3F9oqr+WOydNhs4EE+9UWQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644054616; a=rsa-sha256; cv=none; b=Rlzra6ovuig9DcFIAGU76c2jCb35noqnTKfnTuCjVE0yTkpPPVwInv/hGjDselgGBvtC8G vVhHW7G17ACBuT6jpgKM22c4E1T5O9xnALrH+1ahKefiikjcNWuvL9SjxtdU5+qVT5KhCm mf+zSSW9HadH61QlXz6HkNYo6VkLAkYxl+AH9hM7RWOOraIIA6M4jAVmC3Z25jU1LxQn+v eOmWVQrSzh8h8+g22hUhmRqZhraLeTaBTMpBhVqmj+K+0aVxvrDB3sNPSAK0r2hYyOoFI0 qZ5p5X6BO6ctcq9x5a6pipbiHsv7yDm18smUCxePjStRLvLmlS8QK2QFvbpurQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --4gJQ1wOmIuMqLtLv Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2022-Feb-02 11:49:44 +0200, Andriy Gapon wrote: >On 02/02/2022 11:14, Warner Losh wrote: >> On Wed, Feb 2, 2022 at 2:05 AM Andriy Gapon > > wrote: >> Hmm... it looks like both the old and new (Open)ZFS use BIO_FLUSH co= mmand >> without BIO_ORDERED flag.=A0 Not sure if it happens to do the right = thing anyway >> or not. >>=20 >>=20 >> It's an unordered flush then. The flush will happen whenever. I have a v= ague >> memory that ZFS will only issue this command in cases where there's no o= ther I/O >> pending. > >I think that there is still a potential problem that an earlier write requ= est=20 >might get re-ordered after the flush. >I think that we should add BIO_ORDERED for correctness. I've raised https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261731 to make geom_gate support BIO_ORDERED. Exposing the BIO_ORDERED flag to userland is quite easy (once a decision is made as to how to do that). Enhancing the geom_gate clients to correctly implement BIO_ORDERED is somewhat harder. I've done some experiments and OpenZFS doesn't generate BIO_ORDERED operations so I've also raised https://github.com/openzfs/zfs/issues/13065 I haven't looked into how difficult that would be to fix. --=20 Peter Jeremy --4gJQ1wOmIuMqLtLv Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmH+SElfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzTivg/8CcwhVnxHJpnxtsZD2pywTCT4lba0/1KOqdA2686dSvOhQheLmHAANBkW Sy3/EeDNU2PxVEEfIQEpJSuC1SUg/pfvvtSs4EFqT4sEE9uDZ4yJPi1J5ZwqT62H gBmp42sU8xY4Pzu0kT/Pnp7p7zpHOJBG51c2Xsz/Cc1+mxJfCwJ1fKE3Gf9rsvsF bJUL50+6sf+yNUg+jdySfOeeAvTNJUj2M4hxdRUDCtP+OxSI+Y/slSflQHtR+KLQ C+6RF22HDs7mSwzz37T3MWa3dmctbSSsCLDrTndN4uzPGe9OPBNy9H9jhbVqPUdH 96u5c5q/JTEPEpHVibtItKOzy/fv7YGfbTk/NSAeL+lq2qg9N3w2LShdVbbcj0lJ JwzmZ0Fc8bc2tTtPrcbbL6HsO9hQX2c3EA9NqIFdMt5tTt30MXRACIzfgIBWKDnK 9+HgQuZVF8ZwyJrQfQ7DycC4+oYvvHatcHJvGL7MjwQBKGwNKD8C/mGrrIG4Ovb6 v37jA28UN9ri1lhnMvJQxQecghoKnYIaOD2OgmrFZhfjzt3KHFRF/+Wp5tQ6IK37 7cPfl5fZLAJTNtvWJ+ruODROh4PKisto+bTgzphuuMnVy15fPnaHKDbn9cAQbIoF QmXO9WDFtj9NILEomD0dh4zfCkKCbgeK4JuIjkBZjVfPemyfOlY= =FfaK -----END PGP SIGNATURE----- --4gJQ1wOmIuMqLtLv-- From nobody Sat Feb 5 11:32:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C243719A670C for ; Sat, 5 Feb 2022 11:32:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JrVdF4QrDz3mRy for ; Sat, 5 Feb 2022 11:32:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7883C1E831 for ; Sat, 5 Feb 2022 11:32:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 215BWnj3071947 for ; Sat, 5 Feb 2022 11:32:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 215BWnYK071946 for fs@FreeBSD.org; Sat, 5 Feb 2022 11:32:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255979] fsck bad inode number 2 (256) to nextinode Date: Sat, 05 Feb 2022 11:32:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644060769; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QBlhfXb/ptligbwe4rpa5k0jVkZKExCV1S2gvmG6CDY=; b=LL7cyWNXoDIhFuFhfWg790aaAHIi2uzqN4Esoa3+7+J6UvTqU1X88ttKp8yDmim9V30F+R OKyXX8L5xcRdd7gU4sZQS8OyZDUdQNgLxKa7l3T4E78nB1HHjHsk6jDreKCsZ2th2R0ouT kel49K2q9LZE57Y/Td+qOSC+wq4kcmgzRGdJG7Bmh+Chovf2djOrVKu6X/qksurZ9rW7xK 04d0RSPbJHNRmSJP1WmqLXHUHtEz53BxwhNPKOO1V4pBczf5Nl+yZ3JDnf7Y2PUgMtqM/J PP7bpbnDGqNqL1v3/oFba/E8QtGaT2ESh8+U4zgHNOVORJVS/kMV2YHAhXtqaQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644060769; a=rsa-sha256; cv=none; b=rmcH5rtj0Ov/tC4z+a85CNsjUTef6o5BMasmsHZ8CPjX0rNJ5+5WRAQ7rs08PSOOmpo/RY 2shqNwMcNigzlBHL0X1pcllufB37agiKAy3kro2U5yU2P7lBqxzL+4A0qqNiAIINYjC0BR 2Mc0vYLCM4szXtnoBXKrhtEU3bPVAfSa+rKmGJkEJp9v1S5uPSkBB2xElDTbrhgLcMJs+j w6MH6Cp5QYmC5jNqLlwKlNHehtcEnI/7taIL5Aa/a3hRbkD4Yq0l/EemwqVXZBkC5Tspiq G/5PLStwddQMs8BYfynzfnW6RAU5iCt7ltDHYE22JihyfkqMoUXxi9/vODZptQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255979 --- Comment #33 from Graham Perrin --- (In reply to odhiambo@gmail.com from comment #18) Apologies for the terseness of my comment 19.=20 Re there's now a schedule for the release of 13.1. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Feb 6 16:42:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 119B419BAAD8 for ; Sun, 6 Feb 2022 16:43:09 +0000 (UTC) (envelope-from anothatuber@gmail.com) Received: from mail-yb1-xb32.google.com (mail-yb1-xb32.google.com [IPv6:2607:f8b0:4864:20::b32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsFSr4480z4tn8 for ; Sun, 6 Feb 2022 16:43:08 +0000 (UTC) (envelope-from anothatuber@gmail.com) Received: by mail-yb1-xb32.google.com with SMTP id z62so21519218ybc.11 for ; Sun, 06 Feb 2022 08:43:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=zXzi6UKaAQY7ih2/MWBdxom3PJHmvepAel2XXJ+qOWs=; b=HYxZlU3qyZ4WtoL44s50jGhnYntMxJyumQ1wtmQjYDjTbV5oBjQwgrGI5hCC4YT7/Z zvbLIiC/5PM4Ec3fqgX5WRrCKoSxqcfLrtTC2dHgrpm61tycRC5DW438YDsJ4KJ+GCSh TaKgpCAtZdoDjD/7JCdwKTmT07/TTxCej+aYljEA3LWkCJPOGeFJjfcY02E+Xyu8uvW0 2qvPHdCuu1vSuGAufJDbGoWsasuUyT8Iow/n6RQE9LSn060BF1ngnyTuAOJanGBCPeZ2 suKlnqkmjeO+EKC2gfM32hst15as7BvNicQQU1U5Lk4i3Fe2PEcISL1xSx7oL14DkpON lRzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=zXzi6UKaAQY7ih2/MWBdxom3PJHmvepAel2XXJ+qOWs=; b=xa7+E5h15o0XaomHtq8Z69yEpepvD2p1pHMF03HSjkA9FJ2ABDTZoAFrAbuwE/mMRT tT7PM1Jtx8SsknA6wkEMwzO0a52yaNilF/P6e5a+50CEOMlcSa8qQEf1mZ4hrYFmx68s j7QxAtOk+jDDX9wM3jBdZneeZskPWh4HdNSZ7X3BpUZaimYMqyi4ln8doxnR506YbzVU C6qqBIGa4Q+apMV2UpLYZL6doM9qXX41W759gx1D8ND+CDFSH7ioacjQhP/u9nAqM0zZ NB207uU72W9JdP0ym0ETqPUD3ICH68rkbHEcKA20xuTkV87RpIC6ehZgVADswxcypVFI 2D1A== X-Gm-Message-State: AOAM531zs7xvac9yRjSOe+SDO7kWfMvj3SGRUUOjz87dCNQVxq1wNh+u vUiVUz68CTTbUczAKGtNJxZ5N+W8X/ZvqYwff2E5L/kC X-Google-Smtp-Source: ABdhPJxAUsk24HZd7i1JELdO+s7CdilmwFZIG0RJ1l7Um3yU2YE65JzRPNyVT/USx3xQKnFGP1UHV3TN+nrBU8pr0A0= X-Received: by 2002:a0d:ff83:: with SMTP id p125mr7307923ywf.472.1644165788163; Sun, 06 Feb 2022 08:43:08 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Arno Thuber Date: Sun, 6 Feb 2022 17:42:56 +0100 Message-ID: Subject: Kerberized NFSv4: wrong security flavor To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="000000000000c15fe205d75c2de8" X-Rspamd-Queue-Id: 4JsFSr4480z4tn8 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=HYxZlU3q; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of anothatuber@gmail.com designates 2607:f8b0:4864:20::b32 as permitted sender) smtp.mailfrom=anothatuber@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b32:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000c15fe205d75c2de8 Content-Type: text/plain; charset="UTF-8" Hello there, for weeks I'm trying to get kerberized NFSv4 working on a FreeBSD server. Originally I tried using a Linux client which didn't work, so I now switched to a FreeBSD client which doesn't work either but with another error. Remark: Linux server and client are working with the same KDC. It feels I've ready each and every tutorial on kerberized NFS but just don't see the error. But now for the error on the FreeBSD client: root@freebsd-client: # mount -vvv -o nfsv4,sec=krb5 freebsd.fqdn:/srv/nfsshare /mnt/nfs/ mount_nfs: nmount: /mnt/nfs, wrong security flavor And what Wireshark shows fits the message: Remote Procedure Call, Type:Call XID:0x69cd8522 Fragment header: Last fragment, 152 bytes XID: 0x69cd8522 (1775076642) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 4 Procedure: COMPOUND (1) [The reply to this request is in frame 16] Credentials Flavor: AUTH_UNIX (1) Length: 56 Stamp: 0x61ffd269 Machine Name: freebsd-client.local.eyserver.de length: 32 contents: freebsd-client.local.eyserver.de UID: 0 GID: 0 Auxiliary GIDs (1) [5] Verifier Flavor: AUTH_NULL (0) Length: 0 GSSD is running and also seems to be in the loop (shows output on mount when run as gssd -vhd) but it seems just right away ignores the request for krb5. Do you have any ideas on this? Or at least what I can do to debug this? FreeBSD used is 13.0-RELEASE. Regards, Arno --000000000000c15fe205d75c2de8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello there,

for weeks I'= ;m trying to get kerberized NFSv4 working on a FreeBSD server. Originally I= tried using a Linux client which didn't work, so I now switched to a F= reeBSD client which doesn't work either but with another error. Remark:= Linux server and client are working with the same KDC.

It feels I've ready each and every tutorial on kerberized NFS but= just don't see the error.

But now for the= error on the FreeBSD client:
root@freebsd-client: # mount -vvv -= o nfsv4,sec=3Dkrb5 freebsd.fqdn:/srv/nfsshare /mnt/nfs/
mount_nfs: nmoun= t: /mnt/nfs, wrong security flavor

And what Wi= reshark shows fits the message:
Remote Procedure Call, Type:Call = XID:0x69cd8522
=C2=A0=C2=A0=C2=A0 Fragment header: Last fragment, 152 by= tes
=C2=A0=C2=A0=C2=A0 XID: 0x69cd8522 (1775076642)
=C2=A0=C2=A0=C2= =A0 Message Type: Call (0)
=C2=A0=C2=A0=C2=A0 RPC Version: 2
=C2=A0= =C2=A0=C2=A0 Program: NFS (100003)
=C2=A0=C2=A0=C2=A0 Program Version: 4=
=C2=A0=C2=A0=C2=A0 Procedure: COMPOUND (1)
=C2=A0=C2=A0=C2=A0 [The r= eply to this request is in frame 16]
=C2=A0=C2=A0=C2=A0 Credentials
= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Flavor: AUTH_UNIX (1)
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Length: 56
=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 Stamp: 0x61ffd269
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 Machine Name: freebsd-client.local.eyserver.de
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 length: 32
=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 contents: freebsd-client.local.eyserver.de
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 UID: 0
=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 GID: 0
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Auxili= ary GIDs (1) [5]
=C2=A0=C2=A0=C2=A0 Verifier
=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 Flavor: AUTH_NULL (0)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 Length: 0

GSSD is running and als= o seems to be in the loop (shows output on mount when run as gssd -vhd) but= it seems just right away ignores the request for krb5.
Do you ha= ve any ideas on this? Or at least what I can do to debug this?

FreeBSD used is 13.0-RELEASE.

Regards,
Arno
--000000000000c15fe205d75c2de8-- From nobody Sun Feb 6 18:09:24 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DCB8D19AF633 for ; Sun, 6 Feb 2022 18:09:32 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-3.mit.edu (outgoing-exchange-3.mit.edu [18.9.28.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsHNW5npKz3ls8 for ; Sun, 6 Feb 2022 18:09:31 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from w92exedge3.exchange.mit.edu (W92EXEDGE3.EXCHANGE.MIT.EDU [18.7.73.15]) by outgoing-exchange-3.mit.edu (8.14.7/8.12.4) with ESMTP id 216I9PPY023132 for ; Sun, 6 Feb 2022 13:09:25 -0500 Received: from w92expo29.exchange.mit.edu (18.7.74.41) by w92exedge3.exchange.mit.edu (18.7.73.15) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Sun, 6 Feb 2022 13:08:48 -0500 Received: from OC11EXPO29.exchange.mit.edu (18.9.4.102) by w92expo29.exchange.mit.edu (18.7.74.41) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Sun, 6 Feb 2022 13:09:24 -0500 Received: from OC11EXPO29.exchange.mit.edu ([18.9.4.102]) by oc11expo29.exchange.mit.edu ([18.9.4.102]) with mapi id 15.00.1497.023; Sun, 6 Feb 2022 13:09:24 -0500 From: John F Carr To: "freebsd-fs@freebsd.org" Subject: Repairing a bad ZFS free list Thread-Topic: Repairing a bad ZFS free list Thread-Index: AQHYG4Ss0OPIRzrSd0GTlURpKCamfw== Date: Sun, 6 Feb 2022 18:09:24 +0000 Message-ID: <84C3247E-B5F0-4572-AE38-3B530D61CB1C@exchange.mit.edu> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [108.7.221.50] Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Rspamd-Queue-Id: 4JsHNW5npKz3ls8 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=mit.edu; spf=pass (mx1.freebsd.org: domain of jfc@mit.edu designates 18.9.28.13 as permitted sender) smtp.mailfrom=jfc@mit.edu X-Spamd-Result: default: False [-2.04 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; RCVD_COUNT_FIVE(0.00)[5]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:18.9.28.0/24]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_SPAM_SHORT(0.96)[0.958]; RCVD_IN_DNSWL_MED(-0.20)[18.9.28.13:from]; DMARC_POLICY_ALLOW(-0.50)[mit.edu,none]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N I have a corrupt root ZFS pool on my ARM server (Ampere eMAG) running a recent version of stable/13. Is there any way to repair my system short of wiping the disk and reinstalling? All filesystems mount and there are no errors reported by zpool, but there is bad metadata, apparently a block having been allocated twice. Running "zfs destroy" tends to cause crashes like panic: VERIFY3(l->blk_birth =3D=3D r->blk_birth) failed (9269896 =3D=3D 926= 9889) The assertion is in dsl_deadlist.c:livelist_compare(). There are two livelist_entry_t objects containing blkptr_t objects with the same DVA_GET_VDEV and DVA_GET_OFFSET but distinct blk_birth. Apparently this is a bad thing. spa_livelist_delete_cb appears in the stack trace. I think the kernel is t= elling me the same block has been allocated twice and it doesn't want to free it t= wice. This problem persists across reboot. Since I want to use poudriere "stop running zfs destroy" is not a good workaround. Is it safe to disable the assertion, or will that spread the corruption even further? In the old days I would use clri or fsdb to make the problematic part of a UFS filesystem go away. How do I repair ZFS? This crash has been reported as bug https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261538 From nobody Sun Feb 6 18:23:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9229019B7E07 for ; Sun, 6 Feb 2022 18:23:49 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x933.google.com (mail-ua1-x933.google.com [IPv6:2607:f8b0:4864:20::933]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsHj068zsz3sgT for ; Sun, 6 Feb 2022 18:23:48 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x933.google.com with SMTP id w21so19492933uan.7 for ; Sun, 06 Feb 2022 10:23:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=u+8vaFVdn6eo7oyLoOMalozPCAhE+cu9b2EJb0CncWM=; b=f0MZrf/OEyMIxmRvXVvi3jnA2IJ9lr8Q9QEt0nlz4XR72fGk4SVh9M/P5+gQh49XIg XxHMQv0Pi4aE1alfjLlnwfg+ST43y/PJT9hEG+J7mJdwYS9pPpS9ivX50SBLfBrK+in9 PTz2O+Q8NcY+nFJ7JvB3PrA9xSbYiyOHbt7UyeTN+VNfIseR3AFKQsqHYWGtBYukQnxc tiWNGlKQFDThuskGIH1Kxq3IF802+ETU9yfKVFGoRy5TR8YimXJkjXC6cwYXqjcx7xIS F5r4C6vQGdjByiozJB2Aoaw651kTfwDuqwsYS1/rKAyV4plvKZZIcvrt1RIkgi3O2eQ7 9tvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=u+8vaFVdn6eo7oyLoOMalozPCAhE+cu9b2EJb0CncWM=; b=LRgzXhULWEtFbLtEXo/P3nsERo2OvV3TrlHrICYinRpcFyRQ4hbQb7vIiIm2BAT4no ddTFd0W3ePmxH0XHi8djcytLdpCJwrRc9RsAEtqem6V1x7Pde7yr1r6nkVIpxO40xJR0 yy2fF3WCaLliaSdMeKRfltx0MIce/PmjcDF5OApu1VclZig65SMlimldBcn/K7RQyg4m AUbR5wcCNonmghpDWt2KwesPJ6BOpsqNjDt0NIZR7RkF1QLoUDJhg2Yf9OVjtUxZuDbJ tpupuaeZjMfSbrVEGvedJea4WiWx75fwVlenMAYrRBaauGEkBPAhTuxB7GcS9AonwdqE sMRA== X-Gm-Message-State: AOAM530o4Qd94OwyMdiaWriVoDsmO9tW3aUts1HMoWqXyxJf6nPkBPIL zmTAtpfNNbXJrt6HEgx/8R+8VMahzNtb3cMuA5s= X-Google-Smtp-Source: ABdhPJxAQ2IfJjfavSqIvVkpzAPc2D3pucM+JZoRg8pL0m9B0QZKqzWsb+zc9ikIX5zdoGu+MdTzcdAHYq0bV22sx5A= X-Received: by 2002:a9f:2c0a:: with SMTP id r10mr2375548uaj.89.1644171828257; Sun, 06 Feb 2022 10:23:48 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <84C3247E-B5F0-4572-AE38-3B530D61CB1C@exchange.mit.edu> In-Reply-To: <84C3247E-B5F0-4572-AE38-3B530D61CB1C@exchange.mit.edu> From: Rich Date: Sun, 6 Feb 2022 13:23:40 -0500 Message-ID: Subject: Re: Repairing a bad ZFS free list To: John F Carr Cc: "freebsd-fs@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000c5ea9b05d75d95db" X-Rspamd-Queue-Id: 4JsHj068zsz3sgT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="f0MZrf/O"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::933 as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[3]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::933:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000c5ea9b05d75d95db Content-Type: text/plain; charset="UTF-8" https://github.com/openzfs/zfs/issues/11480 seems germane. I'm not 100% certain from reading the fix, but it seems like applying the patch should result in no longer panicking. - Rich On Sun, Feb 6, 2022 at 1:10 PM John F Carr wrote: > I have a corrupt root ZFS pool on my ARM server (Ampere eMAG) running > a recent version of stable/13. Is there any way to repair my system > short of wiping the disk and reinstalling? > > All filesystems mount and there are no errors reported by zpool, but > there is bad metadata, apparently a block having been allocated twice. > Running "zfs destroy" tends to cause crashes like > > panic: VERIFY3(l->blk_birth == r->blk_birth) failed (9269896 == 9269889) > > The assertion is in dsl_deadlist.c:livelist_compare(). There are two > livelist_entry_t objects containing blkptr_t objects with the same > DVA_GET_VDEV and DVA_GET_OFFSET but distinct blk_birth. Apparently > this is a bad thing. > > spa_livelist_delete_cb appears in the stack trace. I think the kernel is > telling > me the same block has been allocated twice and it doesn't want to free it > twice. > > This problem persists across reboot. Since I want to use poudriere > "stop running zfs destroy" is not a good workaround. > > Is it safe to disable the assertion, or will that spread the > corruption even further? > > In the old days I would use clri or fsdb to make the problematic part > of a UFS filesystem go away. How do I repair ZFS? > > This crash has been reported as bug > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=261538 > > > --000000000000c5ea9b05d75d95db Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
ht= tps://github.com/openzfs/zfs/issues/11480 seems germane.

=
I'm not 100% certain from reading the fix, but it seems like apply= ing the patch should result in no longer panicking.

- Rich

On Sun, Feb 6, 2022 at 1:10 PM John F Carr <jfc@mit.edu> wrote:
I have a corrupt root ZFS pool on my ARM serv= er (Ampere eMAG) running
a recent version of stable/13.=C2=A0 Is there any way to repair my system short of wiping the disk and reinstalling?

All filesystems mount and there are no errors reported by zpool, but
there is bad metadata, apparently a block having been allocated twice.
Running "zfs destroy" tends to cause crashes like

panic: VERIFY3(l->blk_birth =3D=3D r->blk_birth) failed (9269896 =3D= =3D 9269889)

The assertion is in dsl_deadlist.c:livelist_compare().=C2=A0 There are two<= br> livelist_entry_t objects containing blkptr_t objects with the same
DVA_GET_VDEV and DVA_GET_OFFSET but distinct blk_birth.=C2=A0 Apparently this is a bad thing.

spa_livelist_delete_cb appears in the stack trace.=C2=A0 I think the kernel= is telling
me the same block has been allocated twice and it doesn't want to free = it twice.

This problem persists across reboot.=C2=A0 Since I want to use poudriere "stop running zfs destroy" is not a good workaround.

Is it safe to disable the assertion, or will that spread the
corruption even further?

In the old days I would use clri or fsdb to make the problematic part
of a UFS filesystem go away.=C2=A0 How do I repair ZFS?

This crash has been reported as bug
https://bugs.freebsd.org/bugzilla/show_bu= g.cgi?id=3D261538


--000000000000c5ea9b05d75d95db-- From nobody Sun Feb 6 18:29:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 68FAB19BAE26 for ; Sun, 6 Feb 2022 18:29:08 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x934.google.com (mail-ua1-x934.google.com [IPv6:2607:f8b0:4864:20::934]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsHq75ktsz3vfh for ; Sun, 6 Feb 2022 18:29:07 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x934.google.com with SMTP id g15so5249554uap.11 for ; Sun, 06 Feb 2022 10:29:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=1BNcXGpGb9aGD+LhqNLMF5lWUB5zWEaJphPaPjkXMW8=; b=HYJX7l7XZK3DRqRqq1XxnFnUgJTgqLEozrPRqNq+6j1Al/jXHWtFYXlZmoWan4vbve BngpyfNoMYRfa3uDk1+weV1x+pf8cdnO1GS2wPy/1INmtQCbE2VMS1qkShtNy+Vmuyjw nJmNZqcSXg+HX69dK3YDqbVCSfNidY1YwVKek1lMKVE/hM3LJodmys7Pb5KjVg71gfCl tGjRBbSfG2jCnF7IwWXcb11Bbv+73F8aUA4ldiAJ+NTEOHTMzrFYO62KA6B+Nm0fU0MR sUGs3kErfm/WOH7/nUzeWxjf5su8aUiziyT+5/fzUt8+DTcV9eVF14xAqw0uQ0Q/keVo WANA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=1BNcXGpGb9aGD+LhqNLMF5lWUB5zWEaJphPaPjkXMW8=; b=YrmuCb2feN+Y+zh2wkFNfx+TXz9GZLPpT/nd6f84gU8XAnGazuIBWlHigbfN0+4Abb Ym9IvGtmfa72VD3Wv0+iJ1m+w/XILsnZ6e+IcZ76k8rpfUfy1dDhCwONWJr+C6fWxUEw RVhxJwWOnef/vbUqcVCeq1SIJx8s3GWz9ktkxNfKgolR8c+wRYYOBnGsZacORMShV+Gl HmYbeRrl44B/lBcKIpLnZA9BDeFrxHOV4+CpZYNly+l3hniA4HLARwA1J9RhnSfbv45M /0XVfVRqOfLR17M8zjEKvI06+XvGQ/Fv8RHMh+Qg+hoppBiX1sJARptMrxDXAwib1HXN a3uw== X-Gm-Message-State: AOAM530Uogc0IggW2DCQbIzD3CU6drh9/vG0Zet4DLXQHvkDQa8P69D0 Bk8QPzKKl4beXkYkb7YNPi2PPuM/dGw67t9GfUJxVRqf X-Google-Smtp-Source: ABdhPJzhRiGyVJdCp6LnGmJGJ0Z8rpIaJ5xQjuP0l7uhdD0bygURYMvvmb60FADn+Pbjld5lAq9+j/NQ8ZO11WAPXcg= X-Received: by 2002:ab0:1511:: with SMTP id o17mr2336837uae.79.1644172147209; Sun, 06 Feb 2022 10:29:07 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <84C3247E-B5F0-4572-AE38-3B530D61CB1C@exchange.mit.edu> In-Reply-To: From: Rich Date: Sun, 6 Feb 2022 13:29:00 -0500 Message-ID: Subject: Re: Repairing a bad ZFS free list To: John F Carr Cc: "freebsd-fs@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000c8bac005d75da8a5" X-Rspamd-Queue-Id: 4JsHq75ktsz3vfh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=HYJX7l7X; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::934 as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-2.26 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.74)[0.739]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::934:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000c8bac005d75da8a5 Content-Type: text/plain; charset="UTF-8" Hm, on further reading, that should already be in stable/13, sorry. That said, I might suggest reporting it there or as a new bug mentioning that one. On Sun, Feb 6, 2022 at 1:23 PM Rich wrote: > https://github.com/openzfs/zfs/issues/11480 seems germane. > > I'm not 100% certain from reading the fix, but it seems like applying the > patch should result in no longer panicking. > > - Rich > > On Sun, Feb 6, 2022 at 1:10 PM John F Carr wrote: > >> I have a corrupt root ZFS pool on my ARM server (Ampere eMAG) running >> a recent version of stable/13. Is there any way to repair my system >> short of wiping the disk and reinstalling? >> >> All filesystems mount and there are no errors reported by zpool, but >> there is bad metadata, apparently a block having been allocated twice. >> Running "zfs destroy" tends to cause crashes like >> >> panic: VERIFY3(l->blk_birth == r->blk_birth) failed (9269896 == 9269889) >> >> The assertion is in dsl_deadlist.c:livelist_compare(). There are two >> livelist_entry_t objects containing blkptr_t objects with the same >> DVA_GET_VDEV and DVA_GET_OFFSET but distinct blk_birth. Apparently >> this is a bad thing. >> >> spa_livelist_delete_cb appears in the stack trace. I think the kernel is >> telling >> me the same block has been allocated twice and it doesn't want to free it >> twice. >> >> This problem persists across reboot. Since I want to use poudriere >> "stop running zfs destroy" is not a good workaround. >> >> Is it safe to disable the assertion, or will that spread the >> corruption even further? >> >> In the old days I would use clri or fsdb to make the problematic part >> of a UFS filesystem go away. How do I repair ZFS? >> >> This crash has been reported as bug >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=261538 >> >> >> --000000000000c8bac005d75da8a5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hm, on further reading, that should already be in stable/1= 3, sorry.

That said, I might suggest reporting it there or as a new= bug mentioning that one.

On Sun, Feb 6, 2022 at 1:23 PM Rich <rincebrain@gmail.com> wrote:
=
htt= ps://github.com/openzfs/zfs/issues/11480 seems germane.

<= div>I'm not 100% certain from reading the fix, but it seems like applyi= ng the patch should result in no longer panicking.

- Rich

On Sun, Feb 6, 2022 at 1:10 PM John F Carr <jfc@mit.edu> wrote:
I have a corrupt root ZFS pool= on my ARM server (Ampere eMAG) running
a recent version of stable/13.=C2=A0 Is there any way to repair my system short of wiping the disk and reinstalling?

All filesystems mount and there are no errors reported by zpool, but
there is bad metadata, apparently a block having been allocated twice.
Running "zfs destroy" tends to cause crashes like

panic: VERIFY3(l->blk_birth =3D=3D r->blk_birth) failed (9269896 =3D= =3D 9269889)

The assertion is in dsl_deadlist.c:livelist_compare().=C2=A0 There are two<= br> livelist_entry_t objects containing blkptr_t objects with the same
DVA_GET_VDEV and DVA_GET_OFFSET but distinct blk_birth.=C2=A0 Apparently this is a bad thing.

spa_livelist_delete_cb appears in the stack trace.=C2=A0 I think the kernel= is telling
me the same block has been allocated twice and it doesn't want to free = it twice.

This problem persists across reboot.=C2=A0 Since I want to use poudriere "stop running zfs destroy" is not a good workaround.

Is it safe to disable the assertion, or will that spread the
corruption even further?

In the old days I would use clri or fsdb to make the problematic part
of a UFS filesystem go away.=C2=A0 How do I repair ZFS?

This crash has been reported as bug
https://bugs.freebsd.org/bugzilla/show_bu= g.cgi?id=3D261538


--000000000000c8bac005d75da8a5-- From nobody Sun Feb 6 21:00:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DB5A619A464D for ; Sun, 6 Feb 2022 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsM9d5S0Mz3vMN for ; Sun, 6 Feb 2022 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C9792191B2 for ; Sun, 6 Feb 2022 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 216L0ItL005470 for ; Sun, 6 Feb 2022 21:00:18 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 216L0IUN005469 for fs@FreeBSD.org; Sun, 6 Feb 2022 21:00:18 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202202062100.216L0IUN005469@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 6 Feb 2022 21:00:18 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16441812187.a10d7.4269" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644181222; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=LuBErwalH28UYcq3GH2OSHBnP47goyCTFEOoyo6ohcA=; b=UgYu/qaVEl9zw8guPNXiz9hf9d+5J8dd4BVzmI7MXqYYAnMPToDPRgiwdYhcihS9Me/v5q p/HwO/1Jo5NMAkA9789i75ENhQWlimizE2HfEqViL8O6V5GMsbkQ30kbHYsYRLbdkXJo1U PgHZHhxmwWVyj2u2lPdePC1o21dpxAzMGXgmyfjD/KBAxfmyqSr3LvSHlTwPF0yJOzI+K3 kIpImLxKdZDH6t/Xst64Dr1RTRQ9WavC87wffZvgaq1qspX0+D3y9ZM6OQfkjS8TAeCZtT UI8K6XOI45jI0qF09rVj/cDclI1v0Af579NHff9KfOPOhpm7xHVHWrbqZJ3KyA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644181222; a=rsa-sha256; cv=none; b=BCrNOp4JPKZk/TQFCvlmuWqkXwT6NtQqXZiHak8gFTg6HhCfqehg3VLpoJVMk1JagKDNeG 9M4fbS30yLgwO4VXTEaeuL3cLxlfwSep4dxGeyZYpLuTB8VnIOeLuV1h5YKQAmq1WYP/Nq JuXczkgEfHWHX+3rQTBFpNucXJnu3q5S+sbzExGYR+7tt5BfF+nW98oclXXlqYBCJjsAdm Ex+THQYqMATSIepCgXL2GQ/KP3wWWve+uMcJlUhvF+cBjXJ3E5+GWTlWUGagKl+Hcv4fcu f7CbIpfCtUuB2gaPoQRaVBnEjL7qWtWyeYqeGgZtMMrxldmYz1UtMukCJElbRQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16441812187.a10d7.4269 Date: Sun, 6 Feb 2022 21:00:18 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16441812187.a10d7.4269 Date: Sun, 6 Feb 2022 21:00:18 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16441812187.a10d7.4269-- From nobody Sun Feb 6 21:20:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 401BE19B2BA2 for ; Sun, 6 Feb 2022 21:20:58 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670066.outbound.protection.outlook.com [40.107.67.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JsMdP368Bz4cKn for ; Sun, 6 Feb 2022 21:20:57 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VCprQUh2cX3vOoLX3Ge5BsyfmvYVc1pmoeguTIBzTeKDwI+Vxx9mZ5K+7Z2ExmEbbWIFFhLIsqrU2ralruY0pwnqcPFLkeCsdkDhMmJ4CbZp4wJEE+VLSPIlXJXOhUWKepi6aqqoAXGdZQ9N5qas4psK1dFnNLr3ozuWInOaRosHgsGyFG0gGo49TigOfDpolfTL7wMOaaWNtZyE63WxptfXdrO4qMP/XFuNgSjSDIdpyyjux6wbyVQQHc4zHGYkTTV2yMJfOQOpkVs5r8XyNfmXIVZjw1MO+LEKTC4AKxVnkeSHp2sEhO53XqtsryslTQEt0Dyw8t7cHKW1M0xHaw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=u6j6AwCtEaAzvcH4fH/BC6VbhumD775ddMQN1gKtRTM=; b=Dr/mIksdNufeDRm0jRDqK8Mm9Bg+Sjt+niXfQfHHPSFWFiNu3KKu5r3jTxW+NfNrjwxKsqBQjmDe85COkjOw9tuCixGNknd3C/WhkoOiv+Ya7KzsY0swcxz1qlRntY8x68o3eLvvPqBXxaM6lb7m40gK4Hg/4htGJ2m4VzTf3pAs/7KVwfZVVfJDcy3E5l1Kp1t8p04gFQDNd5tYDMQyK5llvxbH14ahYlErK+Rs1YpDkBLBFHTESFmKDgwtH6lGgrNq0FMnChFy3QAZWlcOgWqfAs9vwCqvNE+zvw70aZTSeSs7EbpJfXLrD66RfcaWMGf0UswKphdcCBDtyKJoxA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=u6j6AwCtEaAzvcH4fH/BC6VbhumD775ddMQN1gKtRTM=; b=I5aKttehzfcT0GkyNH51yF7LIbeMnbpHhGZ+92HZL1FB3AhTzWmMS7HbtRkFYD/nkYN9N7C+HBLxbBQ+9+11KbJ5vaGhRC/TDOPaHRlmdsRlbvK+hnzVV1YFQVdDEht7VJGtzaL8FXhl3w3zb9SGuAB58kmvJBEhXy+sFYV0D7XA8P5gSlrsy67ub6JW20yw2neTc8yifKN6wSCQm9/i1a8SCO6OY1w6aqJRFIh61ftXBkJo8pyRChEntMTc1wY9AX+JkX6JMnxaS8rkQULZiZh9tHdLhEIrbTNR+L6lhgSko4OSrbXR8beC3+NygXzih92bv9DOjx/jUZtey+z3RQ== Received: from YT1PR01MB8777.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:c8::22) by YQBPR0101MB5638.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:31::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4951.12; Sun, 6 Feb 2022 21:20:50 +0000 Received: from YT1PR01MB8777.CANPRD01.PROD.OUTLOOK.COM ([fe80::243f:4c6f:8ded:4b60]) by YT1PR01MB8777.CANPRD01.PROD.OUTLOOK.COM ([fe80::243f:4c6f:8ded:4b60%4]) with mapi id 15.20.4951.018; Sun, 6 Feb 2022 21:20:50 +0000 From: Rick Macklem To: Arno Thuber , "freebsd-fs@freebsd.org" Subject: Re: Kerberized NFSv4: wrong security flavor Thread-Topic: Kerberized NFSv4: wrong security flavor Thread-Index: AQHYG3i50D6qWfWfRk+bqYc+U6DGq6yHA96a Date: Sun, 6 Feb 2022 21:20:50 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: fe13801f-558d-1392-062d-60c728bcaa8c x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: d2bf4e35-4ece-44af-04aa-08d9e9b68c8c x-ms-traffictypediagnostic: YQBPR0101MB5638:EE_ x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: hOta3imgpD2i9+Cf1afOuMCFp+h+1ZAMn9O6gFGeUz7F90QPqVJLZccW6D4syz31gi7fv3knEweAVa4bf2JRNUqe8dJBRz/SJ86pN2TDrG9ZYL1GzPZ9eNWKuOJZ4cXaAFO10CvCErlQa2BWXUXB2bJ2OpTo52B8eahsYrzVl1KFp6H2r/busyRMUmVoOYbjwzaK2DWG93yXHR1tzQz+lPkwnBI04JbEFL/WbHT6OXJNLN6huRYf6dDcM2b1NJssSmM91YjDmGTBYeJzFmB6J9Zxe0kjIEzdc3N3pDZcWTLAzGNIyE14Po0eTqJGsJdOwOb4xOSx9wp04h6SKP3yUQZqPWhdvYiLnopXW0XriDAyG3PsOFF/h3tzILeQNsW5QXR7okcJvxtXLB0O0dOkEE0jc1gytM8WDEv77fiDa/bnms80j3DFI2+OVmAtwmsnUPNZGArgpj3IpWvjXj1qdukkxqyhwoUKK5F5pdNqgabV0REo9yjR3viLyRTdQP1di1YHrcWHF+NAwQLa6+QKb9nU/fbOaAArs6jbyWURMkFBhg5z0IoK9btMGgGYNsq1T4OFfC75S9muW5BsmF0wf/oBxB2KrkvyG7odrlKuHv5SVUrE4MlUFSpVH2cUGkQ5AEk52KwjW6e3e9SNYFyHKdZ1x33CUMB6H/FJtQCpzCk/C2FDQ3uSh7LK6XOvviHAy/97HJhDmsRxEmjIeYf+JQ== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YT1PR01MB8777.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(366004)(122000001)(186003)(316002)(786003)(55016003)(83380400001)(110136005)(38100700002)(38070700005)(9686003)(15650500001)(33656002)(6506007)(66946007)(52536014)(86362001)(76116006)(71200400001)(66476007)(91956017)(508600001)(2906002)(7696005)(5660300002)(66556008)(66446008)(8676002)(64756008)(8936002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?26NjYOlsYsmarAKI+CNyEqrHvXebzUeM2ZGDjcFSSqFdYYaz+UEmMumjXb?= =?iso-8859-1?Q?Am8pWRKaCUv0ZXjWS5C9IDS0U0n8vxEHX7cQiuIsOPDqcMoGGvl0CZwnfa?= =?iso-8859-1?Q?TnSJKzn3A/4das21+OJORfvQDKcPFqA3NYM/bVCYRqv6wLdFOoZrOCt3/8?= =?iso-8859-1?Q?IQKh3FOh7O7b5rmNsp9vrZGK0TT1MwsfwtxwmexdbD3QPRC/dyzHWFQfT0?= =?iso-8859-1?Q?zy0Kk8sHPGw9udZgh6G/Q3OUc/gLJBE0AUF5J/imkd8c2wFiGSV/ARzgO2?= =?iso-8859-1?Q?401TlfhG1ArhfAEOKRh1HKUSuOACqR9KCAPZNJtICrEixlBf2PQuAEZnmJ?= =?iso-8859-1?Q?NECcNkMV8yXJOrzso2/2sGNV12gS3TwWnsQh3etkXcPKDzlqah8emDgA2b?= =?iso-8859-1?Q?EomAk9bOuOgdV3cHAWVvokzjWGxRjZnJidLHtkPJmRfpHD+ou2GDF2PFQq?= =?iso-8859-1?Q?SaHv5OOPyZTi2zadikC9WCWFahca7f/tRpUnfECXuNnzKkcDEvpYSLpM/M?= =?iso-8859-1?Q?AtaDYlGs56+oEykFsrPa2VxW6sLEsKqrez7HIC7jmHKln2EtqkyB5C3D/T?= =?iso-8859-1?Q?A90C7iyJeC3W6/GjG3uhrSU/Acjt+ylUUOCYK/ytdKlei9cY37eiSiVAcB?= =?iso-8859-1?Q?nRn5j8MNMm/6rv97TGue468NQ6374W0wesX21YlfiWJFvIBzYW2ECWd/uC?= =?iso-8859-1?Q?m4SfHjEem9bECDt7myVqlIN8drHQeuuqx2NDwtg0DIaBXhLFxwnrIsNL9U?= =?iso-8859-1?Q?cgGNMvnK2ii9DW6j9nKxFME6u4Wkkn/hjdoRp0PngBGF98s81prCYKovji?= =?iso-8859-1?Q?LCJST/GQxPWMN4DW01nN9n7Qbgjdyy1YnfIQIP5d8bKcMnCqs10RjycgH1?= =?iso-8859-1?Q?prEo3uicHzR2rhTWlNZEij6tHYzd8xuBEEbkGqk9ryOMv8JBHiYDrq9lrO?= =?iso-8859-1?Q?Q+BZFiCIBKYuPbdPonTQ1cYsM52SOBLaGt3UuvIhU5hyVWOhFGnuKT3DZQ?= =?iso-8859-1?Q?j0KO/LjDrkYe4S+QYI18DTf5t77Hjy/iEE0p9QfUAk29F4B3y1bpNP1cXb?= =?iso-8859-1?Q?BALlgXjDb4698ysfMTSUxpHbEDV9iebnwHFRJRyY3f2o5gS6+XJVHuE6l1?= =?iso-8859-1?Q?tf0OmKbDLdLVBStaPl72dHjOFLr9fhtFw2/et5Nsd0zCwQQ9f54LyilM7x?= =?iso-8859-1?Q?wUfV/B4mgX5FgAUk/mdBfUtCDHuY1H7rO3KdonHHYuZYWkpsBZy+u1YiuM?= =?iso-8859-1?Q?GS5Q2AiBG9GwcTp+Vr7WU4gxcEq6jAP+8qnM+MnnEvtRWegPFaDhmCjVx+?= =?iso-8859-1?Q?AdtiATQmiS/DIGFO0vkvPDAB51ZgJoz03pZ3dKxYKQl/e/AKtp4o3nZ01D?= =?iso-8859-1?Q?nPZ+snsJYeKV8Uc8WBsoOuN7AwnDTd5vMzHULZkc86bjlXl6xO0i6st6As?= =?iso-8859-1?Q?esyjWQJEI4GjdlVpiXFXsBlcN9f83AeN+rSRh04nAJDUtmWtEeA+yvmMOI?= =?iso-8859-1?Q?2owssZH714E/O07SAAdTl9GKkwPPBGZdsi7gYSOiYBoENcMTL/h7c9/PAr?= =?iso-8859-1?Q?GLnOVUNAFbOzASB9059b5QDNRxj6iocJBhstNANMUT967PaXRmo6KS24Zq?= =?iso-8859-1?Q?Kkhr9ItTzSqY5+U80hLg4hvSqPVGIG2LPZogQ+0bCvopgwTkACihkV7ygs?= =?iso-8859-1?Q?cmy23w4fLDd55fMQRs57bAW6K2FUdt/bSsTmi2MqZIT5v/7qoNm9hS3Z8k?= =?iso-8859-1?Q?HL2g=3D=3D?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YT1PR01MB8777.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: d2bf4e35-4ece-44af-04aa-08d9e9b68c8c X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Feb 2022 21:20:50.0473 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: H+fYZiMFYsbvteLhNG0lD5vhaKYKhdPfRZoxh4IZvafDZlHHC3AyUZKnuWcTiq+Vxot8aqOScVsoRnqdM4eXsQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB5638 X-Rspamd-Queue-Id: 4JsMdP368Bz4cKn X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=I5aKtteh; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.67.66 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.67.66:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.67.66:from] X-ThisMailContainsUnwantedMimeParts: N Arno Thuber wrote:=0A= > Hello there,=0A= >=0A= > for weeks I'm trying to get kerberized NFSv4 working on a FreeBSD server.= > Originally I tried using a Linux client which didn't work, so I now swit= ched=0A= > to a FreeBSD client which doesn't work either but with another error. =0A= > Remark: Linux server and client are working with the same KDC.=0A= >=0A= > It feels I've ready each and every tutorial on kerberized NFS but just do= n't=0A= > see the error.=0A= >=0A= > But now for the error on the FreeBSD client:=0A= > root@freebsd-client: # mount -vvv -o nfsv4,sec=3Dkrb5 =0A= > freebsd.fqdn:/srv/nfsshare /mnt/nfs/=0A= > mount_nfs: nmount: /mnt/nfs, wrong security flavor=0A= On the server, you must have sec=3Dkrb5 on the exports line(s)=0A= for the file system and on the "V4:" line.=0A= =0A= On the client, you either have to have a valid TGT in the cred. cache=0A= for uid 0=0A= OR=0A= have a host based kerberos principal in /etc/krb5.keytab that looks like:= =0A= =0A= host/@YOUR.REALM=0A= For example:=0A= host/nfs-client.my.dns.domain@MY.REALM=0A= (Not host/nfs-client@MY.REALM or host/Nfs-Client@MY.REALM)=0A= You can check this keytab entry works by doing=0A= # kinit -k host/nfs-client.my.dns.domain=0A= # klist=0A= --> You should have a TGT in the root credential cache.=0A= (When the gssd does this, it will end up in /tmp/krb5cc_gssd, but=0A= kinit -k will put it in /tmp/krb5cc_0, which is ok, since kinit -k is=0A= just testing the keytab entry.)=0A= =0A= --> Then you must specify "gssname=3Dhost" as an argument for the mount.=0A= The gssd must be running on both client and server.=0A= =0A= If you still don't get it working, run the gssd with "-v" and look at=0A= log messages (I think it does LOG_DAEMON | LOG_INFO to syslogd).=0A= =0A= If you post again, include the /etc/exports file that you have on the serve= r.=0A= =0A= rick=0A= ps: It used AUTH_SYS below as a fallback, since it could not create/find=0A= a TGT, I think?=0A= =0A= And what Wireshark shows fits the message:=0A= Remote Procedure Call, Type:Call XID:0x69cd8522=0A= Fragment header: Last fragment, 152 bytes=0A= XID: 0x69cd8522 (1775076642)=0A= Message Type: Call (0)=0A= RPC Version: 2=0A= Program: NFS (100003)=0A= Program Version: 4=0A= Procedure: COMPOUND (1)=0A= [The reply to this request is in frame 16]=0A= Credentials=0A= Flavor: AUTH_UNIX (1)=0A= Length: 56=0A= Stamp: 0x61ffd269=0A= Machine Name: freebsd-client.local.eyserver.de=0A= length: 32=0A= contents: freebsd-client.local.eyserver.de=0A= UID: 0=0A= GID: 0=0A= Auxiliary GIDs (1) [5]=0A= Verifier=0A= Flavor: AUTH_NULL (0)=0A= Length: 0=0A= =0A= GSSD is running and also seems to be in the loop (shows output on mount whe= n run as gssd -vhd) but it seems just right away ignores the request for kr= b5.=0A= Do you have any ideas on this? Or at least what I can do to debug this?=0A= =0A= FreeBSD used is 13.0-RELEASE.=0A= =0A= Regards,=0A= Arno=0A= From nobody Mon Feb 7 12:15:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DF4B819A5EFE; Mon, 7 Feb 2022 12:16:00 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JslV860HCz3qVn; Mon, 7 Feb 2022 12:16:00 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644236160; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=cd9ui52/RStpcE3HJrID3rJG8TtS+b6Yhyc6AkbB79Y=; b=JMPPBA43oEZcUPH3LrxOsVhNPj7StLTS0PYIpFrsC9Q0FPbNVg3SJIVoTLN663xASj08mu vICWbjr5SfEV2u2MZ9oDM41s9OddeuYa67iiB8qyBZah4cyiXbjnVQs8jqyxcwGpPze5F4 hmLR/FJ+a1cWvtTVS1xYANMwpEvkv6EjF/DLGgP7ditFfxYB5SRvRmLAdxCsfzYaVhTi5s 51ezkYN/+tLvQHZ4o3wi8Q4upUdyaxpY4x4M0Mftwl159zJgNzAFneAujgJPHElkE6CoKD ZkXSS6emmoMiEN6LV2ybdR5LY7xzG3ECAYsuXUZb8ANnWyBD7PyRQ7wo070hFA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 36FE42C328; Mon, 7 Feb 2022 12:16:00 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <346d021f-b737-f41a-883f-e821389c4431@FreeBSD.org> Date: Mon, 7 Feb 2022 14:15:57 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 Content-Language: en-US To: freebsd-stable List , freebsd-fs , "freebsd-geom@FreeBSD.org" From: Andriy Gapon Subject: fsck -C -p: NO WRITE ACCESS Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644236160; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=cd9ui52/RStpcE3HJrID3rJG8TtS+b6Yhyc6AkbB79Y=; b=cIenr7KV+C6How86wGdecdaxCrUuZ7kzaUv4Pay22mPHsXBrdo02G8JdvNQEDa+21VymPU sxtT9oJPiLwCfl6eGrSgcrKQJ2GIK+spMKdd4LrMoZinYjty7uwNfdVWgD+oM6ah+/HClJ 8ySCY7Z6zSmij1YAAAkWSY5qL20v85P75Ltz0/9oRQrK18XLJGZBVPt6TSW1YVKWYI5Afe jo+zT5cRo2JyNbvRpb22y0Kk1LTxQP8H/Um80Nc3+pQ6ByV6G1y8GLovmusg3FIpfQkf0O 1a4gQ+aQHRU5Nd1dLV7g7jtYQu5U3430ToX9R1WjxlvMZCOr8oHOQtyxfOd9Xw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644236160; a=rsa-sha256; cv=none; b=vX2X8LVjOh4KTAAWkDa59YYg9DDKTchzIhsoHQgfuBbynxmjR2ZvNWcURVeH3OxxhlW++E 95cGcaZr11cUjGpMjk8KUxpaAoopbaCwkRUbTBB4VlypSbQXOlgTMtfR+K6fP5hGatrNhl 9gqH9aKoDNzn1SFixGfkPG9nqrkT/s6UyTBIIgyR6+XGBrDweXoIZnca7dTmXaYVa24cxR 4kxhkKB9qQNCiuZJtmVA3ktGgxhvaEiZCychS4CWwdjfcAi2WABqG3pLvk+l0UkAhXFScw fDkoCc4o8Ze0HtObjXb2jEcUXCRY1tploeN5zaKMK/CT7sZG1/w+nZyzDNX45A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N I've got a problem where fsck behaves differently from my expectations. The problem happens with a filesystem on a GELI encrypted ZVOL. The volume has 4K block size and that's the GELI's sector size as well. FreeBSD is stable/13 from mid January. Let me demonstrate: # fsck -C -p /dev/zvol/.../vault.eli /dev/zvol/.../vault.eli: NO WRITE ACCESS /dev/zvol/.../vault.eli: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY. # fsck /dev/zvol/.../vault.eli ** /dev/zvol/.../vault.eli SAVE DATA TO FIND ALTERNATE SUPERBLOCKS? [yn] n ADD CYLINDER GROUP CHECK-HASH PROTECTION? [yn] n ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] n ADD INODE CHECK-HASH PROTECTION? [yn] n ** Last Mounted on /usr/home/avg/secret ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 136 files, 371 used, 253491 free (35 frags, 31682 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** # fsck -C -p /dev/zvol/.../vault.eli /dev/zvol/.../vault.eli: NO WRITE ACCESS /dev/zvol/.../vault.eli: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY. # mount /dev/zvol/.../vault.eli ~/secret So, mount can mount the filesystem without problems. Plain fsck suggests to enable some features, it does not find any problem and sees the filesystem as clean. But fsck -C -p fails with a rather cryptic error. I don't think I saw this before. If I try to allow fsck to enable some things that it wants, it actually does fail to write: # fsck /dev/zvol/.../vault.eli ** /dev/zvol/.../vault.eli SAVE DATA TO FIND ALTERNATE SUPERBLOCKS? [yn] y CANNOT WRITE BLK: 15 CONTINUE? [yn] n With ktrace I see: fsck_ufs CALL pwrite(0x4,0x800aa0000,0x1000,0x1e00) fsck_ufs RET pwrite -1 errno 22 Invalid argument So, a 4K write but the offset is not 4K aligned. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ A little bit more data: # dumpfs -m /dev/zvol/.../vault.eli # newfs command for /dev/zvol/.../vault.eli (/dev/zvol/.../vault.eli) newfs -L vault -O 2 -a 4 -b 32768 -d 32768 -e 4096 -f 4096 -g 16384 -h 64 -i 8192 -k 2616 -m 8 -o time -s 2097144 /dev/zvol/.../vault.eli # geli list Geom name: zvol/.../vault.eli State: ACTIVE EncryptionAlgorithm: AES-XTS KeyLength: 128 Crypto: software Version: 7 UsedKey: 0 Flags: NONE KeysAllocated: 1 KeysTotal: 1 Providers: 1. Name: zvol/.../vault.eli Mediasize: 1073737728 (1.0G) Sectorsize: 4096 Mode: r0w0e0 Consumers: 1. Name: zvol/.../vault Mediasize: 1073741824 (1.0G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e1 # tunefs -p /dev/zvol/.../vault.eli tunefs: POSIX.1e ACLs: (-a) disabled tunefs: NFSv4 ACLs: (-N) disabled tunefs: MAC multilabel: (-l) disabled tunefs: soft updates: (-n) disabled tunefs: soft update journaling: (-j) disabled tunefs: gjournal: (-J) disabled tunefs: trim: (-t) disabled tunefs: maximum blocks per file in a cylinder group: (-e) 4096 tunefs: average file size: (-f) 16384 tunefs: average number of files in a directory: (-s) 64 tunefs: minimum percentage of free space: (-m) 8% tunefs: space to hold for metadata blocks: (-k) 2616 tunefs: optimization preference: (-o) time tunefs: volume label: (-L) vault # dumpfs /dev/zvol/.../vault.eli magic 19540119 (UFS2) last mounted time Mon Feb 7 13:44:30 2022 last modified time Mon Feb 7 13:51:18 2022 superblock location 65536 id [ 581f28b7 8a03690e ] ncg 4 size 262143 blocks 253862 bsize 32768 shift 15 mask 0xffff8000 fsize 4096 shift 12 mask 0xfffff000 frag 8 shift 3 fsbtodb 3 minfree 8% optim time symlinklen 120 maxbsize 32768 maxbpg 4096 maxcontig 4 contigsumsize 4 nbfree 31682 ndir 27 nifree 130934 nffree 35 bpg 8192 fpg 65536 ipg 32768 unrefs 0 nindir 4096 inopb 128 maxfilesize 2252349704110079 sbsize 4096 cgsize 16384 csaddr 2088 cssize 4096 sblkno 24 cblkno 32 iblkno 40 dblkno 2088 cgrotor 0 fmod 0 ronly 0 clean 1 metaspace 2616 avgfpdir 64 avgfilesize 16384 flags none fsmnt /usr/home/avg/secret volname vault swuid 0 providersize 262143 cs[].cs_(nbfree,ndir,nifree,nffree): (7905,3,32748,1) (7920,17,32691,10) (7928,3,32755,21) (7929,4,32740,3) blocks in last group 8191 cg 0: magic 90255 tell 20000 time Fri Dec 17 00:25:26 2021 cgx 0 ndblk 65536 niblk 32768 initiblk 256 unrefs 0 nbfree 7905 ndir 3 nifree 32748 nffree 1 rotor 4872 irotor 19 frotor 4744 frsum 1 0 0 0 0 0 0 sum of frsum: 1 clusters 1-3: 0 0 0 clusters size 4 and over: 2 clusters free: 264-587, 611-8191 inodes used: 0-19 blks free: 2112-4703, 4751, 4888-65535 cg 1: magic 90255 tell 10020000 time Thu Oct 21 10:39:16 2021 cgx 1 ndblk 65536 niblk 32768 initiblk 256 unrefs 0 nbfree 7920 ndir 17 nifree 32691 nffree 10 rotor 4776 irotor 20 frotor 4776 frsum 5 1 1 0 0 0 0 sum of frsum: 10 clusters 1-3: 0 0 1 clusters size 4 and over: 2 clusters free: 0-2, 265-587, 598-8191 inodes used: 0-19, 21-66, 68, 70, 74-82 blks free: 0-23, 2118, 2120-4703, 4726, 4743, 4745, 4757-4758, 4764, 4781-65535 cg 2: magic 90255 tell 20020000 time Tue Dec 28 18:40:22 2021 cgx 2 ndblk 65536 niblk 32768 initiblk 256 unrefs 0 nbfree 7928 ndir 3 nifree 32755 nffree 21 rotor 4720 irotor 6 frotor 4712 frsum 0 0 0 2 0 1 1 sum of frsum: 21 clusters 1-3: 0 0 1 clusters size 4 and over: 3 clusters free: 0-2, 262-587, 590-641, 645-8191 inodes used: 0-5, 8-9, 12-14, 17, 19 blks free: 0-23, 2090-4703, 4716-5135, 5144-5147, 5153-65535 cg 3: magic 90255 tell 30020000 time Wed Sep 1 12:52:02 2021 cgx 3 ndblk 65535 niblk 32768 initiblk 256 unrefs 0 nbfree 7929 ndir 4 nifree 32740 nffree 3 rotor 4736 irotor 26 frotor 4728 frsum 0 0 1 0 0 0 0 sum of frsum: 3 clusters 1-3: 0 0 1 clusters size 4 and over: 2 clusters free: 0-2, 261-587, 592-8190 inodes used: 0-25, 27-28 blks free: 0-23, 2088-4703, 4731-4733, 4736-65527 -- Andriy Gapon From nobody Thu Feb 10 02:33:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8492419B5ED7 for ; Thu, 10 Feb 2022 02:33:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvLR02f9Wz4h7T for ; Thu, 10 Feb 2022 02:33:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3AD7C188DC for ; Thu, 10 Feb 2022 02:33:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21A2XmuR094363 for ; Thu, 10 Feb 2022 02:33:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21A2Xm2H094362 for fs@FreeBSD.org; Thu, 10 Feb 2022 02:33:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261850] fs/ext2fs: Fix bug in disk data block allocation Date: Thu, 10 Feb 2022 02:33:47 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: assigned_to see_also flagtypes.name keywords cc bug_status short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644460428; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AoZTNUgDJHCRqmXt81lcgXlZskbxfrTOriRBD7Y518E=; b=DUErmE8gYdxJaqK0NpTBVPESL15juw+o69ZYZ83z/Tfd5Q6yyVFKMk0hAKq2SZhjjh6iO2 no+NEzvqbN7nYbiRYj2ZnUU7Jf0IrAu5uGNv/2z6C7MEa3yT1HQ1Ay8fnA8Qn7QpEzxIBn 5jhT+rSr6bhRZGLu0l1+yGO1hsydpcCsmDsIxAYYRkongqhRyxJmK5nBZMHz2sjn2PYwih ZKY+n4UZ2mmA4/iyLQWNOeIRYBx+cVgbyEHiS4XsfoJ95zp0xqNKo6OYpoGOG1zmqbr3wx UGppOXofN6fXE3z/5CUI+E6R+RRAesaw0NM+fFTi7Edoa2kQlzlW3F2bq/roEQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644460428; a=rsa-sha256; cv=none; b=FH2HINwckPD6dgn1pVlGhEv41HA3dEbK2Smpdl7N//ZJiksWm/KpLI7OKXjY11tGYUUJ2L L7D9bXLasJkZoOoqL17rqJpyckRU0oa4AR0S7T8ymHm+VmpkBX/4bWo8//tApyLELyj9/R k9RIXq56rxFX9REMOzDgFtFyuNdG1aHD0LiEXzZwtyiW1pWdF92CJIJZt696FsJDg+CKx6 2sjZemu0cReTSGQh0gD46aVOW6RKHF8wbtKM5MHu5yryPxsFk9gTK9HBjJFmvbmmiJ6sSK HLQo3E6588paJQdOdWpZEGGORSfLG/FYYF4YRJSGeqS8Pd23hQ0rN8kK6AgK+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261850 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org See Also| |https://reviews.freebsd.org | |/D23259, | |https://reviews.freebsd.org | |/D24685 Flags| |maintainer-feedback?(fsu@Fr | |eeBSD.org), | |maintainer-feedback?(mjg@Fr | |eeBSD.org), | |maintainer-feedback?(nc@Fre | |eBSD.org), mfc-stable13?, | |mfc-stable12? Keywords| |needs-qa CC| |fs@FreeBSD.org, | |fsu@FreeBSD.org, | |mjg@FreeBSD.org, | |nc@FreeBSD.org Status|New |Open Summary|Ext2 FileSystem: There is a |fs/ext2fs: Fix bug in disk |bug in disk data block |data block allocation |allocation | --- Comment #1 from Kubilay Kocak --- Thank you for the bug report and patch. Could you include it as an attachme= nt please? Thanks :) ^Triage: Loop in original committer and people playing in that area of the = tree recently --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Feb 10 04:39:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 71A9619AE9C0 for ; Thu, 10 Feb 2022 04:39:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvPCn26Wnz3R4V for ; Thu, 10 Feb 2022 04:39:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 25C991A488 for ; Thu, 10 Feb 2022 04:39:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21A4dH28058757 for ; Thu, 10 Feb 2022 04:39:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21A4dHm7058756 for fs@FreeBSD.org; Thu, 10 Feb 2022 04:39:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261850] fs/ext2fs: Fix bug in disk data block allocation Date: Thu, 10 Feb 2022 04:39:17 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: chenguang.wang@terapines.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644467957; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KF6PRpdJpj9VKjfS1enfeXQ8p1+B/SusbMvPhj4pU1s=; b=rmZ8MDWG+QGrixA1zobbLsM+e/fSwfPRMEumJ6uFcao2KBpsCUCUxUtosswQP9zFPdK24g 8nZQDQbxZOJgyPHDegALpL/4itPf4GY+NEOXoXJ/HvIM8bLUqXm5pgTzPapafYaXhN80yE V7q7M7SuJPDShu2s4wmT/67LQSjqMj8hUFO0VXV56KVoDDOu77wQ3LeHhjXsfAgJUrUhJF +iwLnXosURbht35Put84HldomPgze4jeRFLfUjwoZQ1JEMbGEpag1T74KobPEAR2SF3A90 QfDxlLP5sK8rT0BKFr4PwwEZY72S3c9HEhQdR91OX7PoO+5ioQHT4TPVxCLenw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644467957; a=rsa-sha256; cv=none; b=EE+kTE64V9MXhylkYnOewtHHuD3jYFoCwKUADe3oJGNDVAiB9F8C3xi8rdi8OPA0ly8Lmq /gZ4uHtfmBwUgtik2F6EzDwTkmIjvnPGw9B+gZ2z3TisbOEIao8bd+YGA+Utd95ux5GsWT R1fhul1XMmYKkHTEDRIHproZgRCEehO4hZXMrW6qTRzOzAfo4GWxaSp1DP8BMybhDBhjGO Ks2AjKYOcTFrZZOxZOl6qIxctjxLksXKJ7vGMTXYB1YAA/gQpQSN8QujShRE0tYI7TV3n5 +imvg03weCO94ZRFwHa/3C3OA3YWBBigyjFVPydOKpKTD3v4wQgKOShR28YZmw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261850 --- Comment #2 from chenguang.wang --- (In reply to Kubilay Kocak from comment #1) Hi, Kubilay Kocak We will submit the patch after solving the local network problem. Thank= you very much=EF=BC=81 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Feb 10 07:05:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3F70F19BF00C for ; Thu, 10 Feb 2022 07:05:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvST10vFRz3HLt; Thu, 10 Feb 2022 07:05:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644476757; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kJsOlrHXqwBPAItMyCzcgDNFz8KFcS98odm0jYMr4Xc=; b=P1tHbIF6Ejxl0t0CVTp0GRAp31clhroWSBS7P1utzo4tqhG2ptpUg0k3LHEl2C6UPHWIb2 fJ6aX311FnQb1wj/saIfvL+V4OibQIqZHXnt8kAvKuNjv74LNB65C2IXEsxNwUM2Hyfz6Q niH3sl7hT+klO+fqZ7b79+ilJKszCdKBkTExUsYRAJNuQoxTPEcL8xuCXOCkRpzO3s60I/ bJqnuaPiUrW8GzMXpHaewFZBp3CTNelzLxFXvByXgKsVVca8ZLnRehXyGlGHlV5OfEYVNb n0yprichsBDw7biNMNHrrwHkkW5XHEBh5Vm4mbbnUes2E//QAM3ii1bH3SP6dg== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 72DCF2D049; Thu, 10 Feb 2022 07:05:56 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: Date: Thu, 10 Feb 2022 09:05:53 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 From: Andriy Gapon Subject: Re: fsck -C -p: NO WRITE ACCESS Content-Language: en-US To: Kirk McKusick Cc: freebsd-fs References: <202202091833.219IX4gd079144@chez.mckusick.com> In-Reply-To: <202202091833.219IX4gd079144@chez.mckusick.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644476757; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kJsOlrHXqwBPAItMyCzcgDNFz8KFcS98odm0jYMr4Xc=; b=HZSfJor5DSbn3veX67KtsTn8IRFHliAS3c7ryU2vuAvA5lfxqlqZBdtcMNKkP4SYVBNZtv 3nwz/1lc1vKy1rJB0QSjMxSY5vJ13uIpRTfrvmCAnGWX3/dtAHgiq2zTRxYM67dIIyM0Tc qxun7WOyUUMYpB2fuowENQg7/XzvE/rLhBM09x7eA5n/lcRJ9SMFrvJgRf6L4iVKFllSFY sKRkq328F90ucz9B4IYR4ssRMWKYfepLsnMQeuqTJTr6tVDFkpbJPXIiCzrmJmEcOmu+Bs hUnpSQg44FBsWidVJfYVyeAXqg4w983NqZlSVaWkGoxQV9QGP9u5PBIcmIh5MQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644476757; a=rsa-sha256; cv=none; b=osArdDFYCT7POEOtHAgwNJbgkq5gQLYhWaiMrl2rbyd+nHaACjXvR6j4oSRSHqRcchuHRp bdFZ05tKNuYYDy1xuPdMTuMWigut9elwsBBlVNUTeo5/DeHL+kbwKMV3+rdyD7yjfDQuXO FbL9RI0r13txY6K1LbYJSUFUAxHdfyM3GWd6wxgyhQpA7Kp6A29yIzd0Tkm7LZwS40KGoi VKtk+iNt0RWV4ZKOYl0hgtDqQBW3MNpDyKqCIv8pNaxvQQaCFmNEjQTtll8PPoSMrIYoI4 D5bRZSGTOkFbP89/cKRHeqQg5xgZJy62hVHgcE98+ULQ5BELyB3X/oVKZvQE0Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 09/02/2022 20:33, Kirk McKusick wrote: > Thanks for this report. I am trying to track down several issues that > it raises. Thank you very much, Kirk. > First, I am trying to figure out why you are getting a filesystem > that does not have check-hashes. The newfs(8) on 13 has always created > them by default. Did you bring this filesystem over from a 12 system? > Or did you grab this 13 image from the periodic 13-STABLE builds > (found on download.freebsd.org/ftp/snapshots/VM-IMAGES/13.0-STABLE)? > Apparently those images are built on a 12 system, so their filesystems > do not have the check hashes. This is a quite old filesystem. I think I created it in 2016 or so. > I have found the cause of the unaligned write and am working on a fix > for it. It would be helpful if you could run another experiment for me. > Rerun the `fsck/dev/zvol/.../vault.eli' but answer no to the first > question (SAVE DATA TO FIND ALTERNATE SUPERBLOCKS?) but then answer y > to the next question (ADD CYLINDER GROUP CHECK-HASH PROTECTION?). It > will want to do aligned writes and I want to know if they work. Yes! Those writes worked and fsck no longer asks about those things. Only the alternate superblock question remains: # fsck /dev/zvol/.../vault.eli ** /dev/zvol/.../vault.eli SAVE DATA TO FIND ALTERNATE SUPERBLOCKS? [yn] n ADD CYLINDER GROUP CHECK-HASH PROTECTION? [yn] y ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] y ADD INODE CHECK-HASH PROTECTION? [yn] y ** Last Mounted on /usr/home/avg/secret ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 136 files, 371 used, 253491 free (35 frags, 31682 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ***** FILE SYSTEM WAS MODIFIED ***** # fsck /dev/zvol/.../vault.eli ** /dev/zvol/.../vault.eli SAVE DATA TO FIND ALTERNATE SUPERBLOCKS? [yn] n ** Last Mounted on /usr/home/avg/secret ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 136 files, 371 used, 253491 free (35 frags, 31682 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** > I am still working to understand your original problem, and will let > you know when I get an answer to that problem. I've just thought of using ktrace with fsck -p -C and this is what I see: 674 fsck_ufs CALL fstatat(AT_FDCWD,0x7fffffffe617,0x7fffffffd858,0) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs STRU struct stat {dev=1895890688, ino=447, mode=020640, nlink=1, uid=0, gid=5, rdev=447, atime=1644476165, mtime=1644439708, ctime=1644439708, birthtime=-1, size=0, blksize=4096, blocks=0, flags=0x0 } 674 fsck_ufs RET fstatat 0 674 fsck_ufs CALL fstatat(AT_FDCWD,0x7fffffffe617,0x7fffffffd858,0) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs STRU struct stat {dev=1895890688, ino=447, mode=020640, nlink=1, uid=0, gid=5, rdev=447, atime=1644476165, mtime=1644439708, ctime=1644439708, birthtime=-1, size=0, blksize=4096, blocks=0, flags=0x0 } 674 fsck_ufs RET fstatat 0 674 fsck_ufs CALL openat(AT_FDCWD,0x7fffffffe617,0) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs RET openat 3 674 fsck_ufs CALL pread(0x3,0x800a8e000,0x2000,0x10000) 674 fsck_ufs GIO fd 3 read 4096 bytes 674 fsck_ufs RET pread 8192/0x2000 674 fsck_ufs CALL pread(0x3,0x800aae000,0x1000,0x828000) 674 fsck_ufs GIO fd 3 read 4096 bytes 674 fsck_ufs RET pread 4096/0x1000 674 fsck_ufs CALL pread(0x3,0x800a8c000,0x1000,0x30018000) 674 fsck_ufs GIO fd 3 read 4096 bytes 674 fsck_ufs RET pread 4096/0x1000 674 fsck_ufs CALL openat(AT_FDCWD,0x7fffffffe617,0x1) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs RET openat 4 674 fsck_ufs CALL close(0x3) 674 fsck_ufs RET close 0 674 fsck_ufs CALL close(0x4) 674 fsck_ufs RET close 0 674 fsck_ufs CALL fstatat(AT_FDCWD,0x7fffffffe617,0x7fffffffd840,0) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs STRU struct stat {dev=1895890688, ino=447, mode=020640, nlink=1, uid=0, gid=5, rdev=447, atime=1644476334, mtime=1644439708, ctime=1644439708, birthtime=-1, size=0, blksize=4096, blocks=0, flags=0x0 } 674 fsck_ufs RET fstatat 0 674 fsck_ufs CALL openat(AT_FDCWD,0x7fffffffe617,0) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs RET openat 3 674 fsck_ufs CALL openat(AT_FDCWD,0x7fffffffe617,0x1) 674 fsck_ufs NAMI "/dev/zvol/.../vault.eli" 674 fsck_ufs RET openat -1 errno 1 Operation not permitted Interesting... we have this sequence of opens: O_RDONLY, O_WRONLY, O_RDONLY, O_WRONLY. And for some reason the second O_WRONLY open fails. Perhaps something gets confused on the GEOM / GELI side. -- Andriy Gapon From nobody Thu Feb 10 07:19:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9D4A719C5162 for ; Thu, 10 Feb 2022 07:19:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvSml1Bpcz3LpB for ; Thu, 10 Feb 2022 07:19:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 052C81C611 for ; Thu, 10 Feb 2022 07:19:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21A7JYZU040087 for ; Thu, 10 Feb 2022 07:19:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21A7JY5g040086 for fs@FreeBSD.org; Thu, 10 Feb 2022 07:19:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261850] fs/ext2fs: Fix bug in disk data block allocation Date: Thu, 10 Feb 2022 07:19:35 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: chenguang.wang@terapines.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644477575; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6kTnEJvz1V/DAD9BYXHRy0JkyAtOfISAaHA+xQslVh8=; b=wugoDbbraMI/IerxOc0Zx03Znxeo8S8XGOmqY5WPEJYnrJIXbremFpCLqoNvLJxvTwmcl6 WrN/CSVxMmzvpSLqbHpLpIop8eHpxV73TZwCBXpoFORj7XlMOtn+Qb9UwJjyVKhUjuxPpD Q7DUJyovkx3fia2hRiDQpzVbwgGgWvUl7ikqC0q0xNt3dEBaOQgFoIRZyUlZTNkoQN+ulT JOj5Imz4+vpMth8u40jPknw5uHptKiktkb5YP8rRaDHytzK1MQyeOtk0vqy6Z6ELrh4as9 YNZiPC9w7tZfn4yAFXZQ/UzZIFV86rctg7zF/RFlO4W7mJcvz9i6cJJgoAO0Ow== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644477575; a=rsa-sha256; cv=none; b=PQHYs1wyTNaJZiNnb0T81nrodPmxnKsOE9Me+RuC9GWcHuVDMcLyrr8xgN2tMmyIGh+Cu8 ATO6vxW2qVIN1d5hu/yNBHRtYr0WATB9D6F+bKPD8/No0NOkjJwUgaov5goguH0N5pJLgg GD+Ak8hQyZyo4EHi1N0rH6Akh4P8u2PQrEEycykG3lVV36ju/q3QX+rMRSQEdKZTLDOZ/a AIImIE0CwgxjFzZviJnzaECxScTBq+LJ2vWBekwRlj+P1zVhSd/aq2L/z2cmmZp6j59qzk g/fWx9TBeJuTs1pwgLdCfrdTF7bNiSR3A4wmAmmK6vSoTZ0wqy9Be17D0c2Y3g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261850 --- Comment #3 from chenguang.wang --- Created attachment 231702 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D231702&action= =3Dedit fs/ext2fs: Fix bug in disk data block allocation. git diff fs/ext2fs/ext2_alloc.c diff --git a/fs/ext2fs/ext2_alloc.c b/fs/ext2fs/ext2_alloc.c index 4c265a1a8..9e05d02de 100644 --- a/fs/ext2fs/ext2_alloc.c +++ b/fs/ext2fs/ext2_alloc.c @@ -1067,7 +1067,7 @@ ext2_alloccg(struct inode *ip, int cg, daddr_t bpref,= int size) start =3D dtogd(fs, bpref) / NBBY; else start =3D 0; - end =3D howmany(fs->e2fs_fpg, NBBY) - start; + end =3D howmany(fs->e2fs_fpg, NBBY); retry: runlen =3D 0; runstart =3D 0; --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Feb 10 07:23:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 39B1E19A170F for ; Thu, 10 Feb 2022 07:23:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvSrj0NKLz3Nwj for ; Thu, 10 Feb 2022 07:23:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E32491C784 for ; Thu, 10 Feb 2022 07:23:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21A7N0mF043205 for ; Thu, 10 Feb 2022 07:23:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21A7N0mQ043204 for fs@FreeBSD.org; Thu, 10 Feb 2022 07:23:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261850] fs/ext2fs: Fix bug in disk data block allocation Date: Thu, 10 Feb 2022 07:23:00 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: khng@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644477781; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mkgBNn7jqWENF1c3Wm5nKRw5pjW0EE/w9eaHDSazzGM=; b=gXKG0pEQJNom9ubhlg5LLVUA7SWcPe8Y1iphQPRQHzOn4PX7X4ZR1YgFvd1j27JgCD5HgB GsuhExaUNyjbim4sw5WMbnr2XW1jsNWCGA4j5b+FQZVw1Hhs3kEv700B9sH3V7OrqBvchI lTQmnxD+EWvpuaZnWeekIYLylVg1kcck+8M6d3tsAApcllMpl08GqTk2+LIDPcTDFSNv3H Uni2ASyQpSURfX04p5G8CzZpWZsyrUGmP9Q4RGSVZmePW+lFJVUXlCk34wMpGDw9w4BLfG tfPH6PgymR/58V61xOOPTwxfCNqpgwN2kj5Q74KtNpgOm9qMH7c1+43MabHr/A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644477781; a=rsa-sha256; cv=none; b=BofEdduxB7fHdAZDSelCZZ659GtjiaTmODMYV66HgPvfsKx6UlCogTvWBL4TqTww7WZLyQ 1qK90K3cOMBbn7/4vHANDvj0gvp0oj35AUiassO0ClR+Fg4SJoLUAkK3nn3Ie95EuegMst 7T/0iInMmAXz2/xmQsAuWn1Ivk9zcR4be/bok05RYAGP5poQrE4TXSR5a7/ZPw4K3L1A8l iqLJrvJz20GD8V3Noue1oFvX7RXXC7uCxRRESfngzQDwlLgtAsOBTB8pp1kGZueKZ2+sn0 QeFPx3g+BUiP16DWkRdKe349tZggMNU9mogIfbGUYWOTLw3kPOIM8PW+f1RDIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261850 Ka Ho Ng changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |khng@freebsd.org --- Comment #4 from Ka Ho Ng --- The change looks good in my eye. You just need to open a differential revie= w in https://review.freebsd.org . --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Feb 10 07:23:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1012B19A1D0B for ; Thu, 10 Feb 2022 07:23:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvSsk6LS3z3Pkx for ; Thu, 10 Feb 2022 07:23:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BAA6B1C747 for ; Thu, 10 Feb 2022 07:23:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21A7NsA0043316 for ; Thu, 10 Feb 2022 07:23:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21A7Ns9f043315 for fs@FreeBSD.org; Thu, 10 Feb 2022 07:23:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261850] fs/ext2fs: Fix bug in disk data block allocation Date: Thu, 10 Feb 2022 07:23:54 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: khng@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644477834; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G4J/XjaPTbSOX3KDDenv62/uIJCt7Q6Zt+2VhrfeMc0=; b=aKYadKftAIYk0Gfj6mYORaOhA7OsiMur3NZRDVH6NmB/IIPeZw7onBTV5zbzK5FbsCcwEO CLrf+0YCC2hwvLopeNDx3zSYSUvcLNjWNSX4RcvSIwljtgNnpacqWbdfVdorWptv3OPE8e 3Fj9jv7mEM2JIiY1m2y8TdA1emwHg1xTKgIrH/y7el0aC7b+Mx6Rxv+oVa9wzOQuZHgeZ7 Jw3OtPMsEvdvsF4DxNfxY0zSx4q9V/sI8Z79t4i+Rth9ZZFTrDdaK5NZ9Kd+70yn5rLGyM 4lnyCo4rudhctn1Z8SqlPOIReibCSN36rNCrOTNCM63/qLLBaBI9aO92hYHsyQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644477834; a=rsa-sha256; cv=none; b=I2yL/yqzeF4xSLUPqdwKZwd1RlYTdoaHPb/Y7AIATM8F2Z6j38dXBKjn3r8W/FvRCZQSHz 1qwDY4l+0eBwwq2pTKZ2ZT9Nmq+K5aO/JAWMLjnXqTSuJj33mVzyPR+sJU0NSOm+e+dPBM aqKUB8kFbgonHfrlTUZCzvRBaapsuQNBxAuMpvljVHqhOiv4KR2TPY1ZaPJ0dyJmrpzghS ClUmsU11cfzT91V6xUEdghXnyqNBUesNzDu/9oc87f+xzVvttqr845zPW2dWjiOFZ9oLnA X2zKP8RYtpAIFgra7gac2MDDUwi2WRzPOE9I7AGAPnjTuX/ucitC0tlZBSab/w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261850 --- Comment #5 from Ka Ho Ng --- (In reply to Ka Ho Ng from comment #4) Sorry. It should be https://reviews.freebsd.org . --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Feb 10 07:31:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 445B919A6C93 for ; Thu, 10 Feb 2022 07:31:36 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvT2c1XkKz3hHV; Thu, 10 Feb 2022 07:31:36 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644478296; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bXlMIcwATeDWvi9pXy4fyfLl9Nwtv1P55j5TY12SwaE=; b=Eim3uwOtps56rYb9pXQt/voA6yhvBGu13ClK5FpuheJp/vp3mXuA1tqXopMGN84pHCJnMG tZ4G+DvNA7e/p6MGeo0vwDG+GWPJqlJMjm5rDWlhaUFAIXojPNzNj1J9Gtd1BxtBDUS0eU K52ZU77Tt3pczehupIKyPssYi8r2xDO+dZzgMs+gEEGKmNvCsRz3sna+rZ8Njm/SFoTxtw Tv/NalqLO5BFf/mT579k8y0VZ9w2J+tC/OACw6kfrQQGW7q4sdhN7xtGldetieQ6CzUnkX uZ7mm8xNqfJmx8rQDpqmb4dmenFhJKVQDaD45oOKWod1Brsz4fl61uebhEv6bA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id AEC782CA40; Thu, 10 Feb 2022 07:31:35 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <7a2e01d9-7c2b-5a7e-cdaa-d01132cd41b5@FreeBSD.org> Date: Thu, 10 Feb 2022 09:31:34 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.5.1 Subject: Re: fsck -C -p: NO WRITE ACCESS Content-Language: en-US From: Andriy Gapon To: Kirk McKusick Cc: freebsd-fs References: <202202091833.219IX4gd079144@chez.mckusick.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644478296; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bXlMIcwATeDWvi9pXy4fyfLl9Nwtv1P55j5TY12SwaE=; b=Al7TS0HaIVnFD6lxIuAUGCwrvXmSYGR0+puuzmBLoc92mCrHIVoyw1ftYekJqlkUX08tiV QiqKmRv0Hfv/Gw10mb64EIpF7g9mhpOKPrA6XzU2ynKfZYU6gotTe7FCe2oE45MGaXArcw ApteDx03sTygTQujz/1qPqGecKNO1mYovy7rSLbIWvZHYoDjLvYo2AX/1vWwdhm4qgD+Mj esVbhlVgEBLoHzeOn88+ocI+K/1JupdAdE61kTuWdgfkX+lW64RIJrSCNGiz8sp8lCa0JL HfzjfZfB/+lKQp4x7Jcknb24c+UuiitwEgIOBM0AaWvyz1QdMnRiMYjSymUZSA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644478296; a=rsa-sha256; cv=none; b=VMz/gOOeB3VzhiL6E2FXkX8V8yz1sz9UV8DOiF07ygnBUt77gnNSfXWKDG8yqlVSL/gEFi 3F3ahS7lLe3LrNoNyNl1FlCxjxEtRxzZ8s14KVarOnZGG7uBMr6Ofw4G/4KMJrEAbCYPlD KX82pxHrqERdCYFxpbMyY2O8YuRvFh6j7Ihesk0sSKTaq27yMdF0nfZbTrSrvRaLySkkWt UEpQucaxD6dJlGxpjhE/EXdjnTalXFmTlnfkTHuvrgIt7D+bxTj05eP15ODJrIZGToyazX XVcDjiCBqyzBG/bAN4W3K7zvlgzDD94V3kDQsBN2IjeSyKjySY4khvohr9zuLQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 10/02/2022 09:05, Andriy Gapon wrote: > Interesting... we have this sequence of opens: O_RDONLY, O_WRONLY, O_RDONLY, > O_WRONLY.  And for some reason the second O_WRONLY open fails. > Perhaps something gets confused on the GEOM / GELI side. It looks like closing after the first O_WRONLY open triggers the GEOM re-taste. When the second O_WRONLY is attempted there is a chance (which is very high on my system) that something has the GEOM provider opened with read and exclusive bits. It's the exclusive bit that causes the open to fail. Looks like it's g_label_taste. Not sure if something recently changed in that area or if I've just got much "luckier". -- Andriy Gapon From nobody Fri Feb 11 17:03:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 89D2C19B9391 for ; Fri, 11 Feb 2022 17:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JwKh41V2Kz4ctB for ; Fri, 11 Feb 2022 17:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 148B118136 for ; Fri, 11 Feb 2022 17:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21BH3WEZ005015 for ; Fri, 11 Feb 2022 17:03:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21BH3Wll005014 for fs@FreeBSD.org; Fri, 11 Feb 2022 17:03:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Fri, 11 Feb 2022 17:03:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: metivier.roland@chlorophyt.us X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644599012; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NXr3Eq4GFliUrZi5Bbh+2m9WaRDlTjPhKlTCRMrDTnM=; b=m1Tm5REFX5TwlaYHotnE6B+e8lrDd4PzH1Fen4G1snBNymMJp0zKW03+r1PwXTwJl3obvN opwsS8A3G7OtRKkSUKqM4oBcJDPLYNI6h8JaLAMfBXUZ4cALMsMyX1K5yx3PzLAAJJCWCT FlfkZhxA/Iq9TCAbMwk84sC0ChKd6Hxl6pOKb8+LX/ytnBuFwokZT25hNaerfNwaCmzOCC QV55NgxULFDaFTqp1StHIPRB/LLQfH2AAzhL8IMYgZ8keFnXbbCSIKwwYAv8TAph6hFP7l 8zGxTp+D/L4GIXKWnchjQxCMe7Y/jlBrqZNwgZsfHHaK7yuMs/ugBpQeG/B+5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644599012; a=rsa-sha256; cv=none; b=fT3UW2CCYg9JT34r2oUJvpjrrjxR6pKGV1ej2R5Wgu2B7XXB8FQUEe6PZmPnPBh+eyggm1 fwdvXD1Tq0RXIjvnClM6rwcIv2wrXfemuHXwh0z+VY1+eEv84r7i8jrM/Ctx8cRt6U9Lg2 Raox4+sPcmqXGgNgcwwMesw8KSGyTdt7IjATcFg/i5F6SAZ80TUI7lZ9G8JVl9JCASGNZM xqFGUr6xZmOLZKLfEs7AXdsMqqWjkpkp0twhOjthSfgjhF25GvtWtPCzk+eCfxHiks4DDL h5bZ4tw9y5Ce+gQYXuAdyRcJNIB4RJ0Z/8lHYRneyZwvmiJzL4XJ/EnXpNbhEA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 Roland Metivier changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |metivier.roland@chlorophyt. | |us --- Comment #4 from Roland Metivier --- I confirm that this happens to me on one of the older retro computers I've rebuilt with spare parts. Still hangs the installer (13.0-RELEASE) with the following specs when the = ZFS module is loaded/used: - 4GB DDR2 may cause "physmem" to wrap indeed. - Pentium 4 at 3.6GHz requires me to use a 32-bit i386 kernel. - Two 250GB WD Caviar SEs in a mirror might require ZFS. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Feb 13 21:00:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3693019B1CDD for ; Sun, 13 Feb 2022 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JxfrC48P5z3HyY for ; Sun, 13 Feb 2022 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4D56222192 for ; Sun, 13 Feb 2022 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21DL0B2E048364 for ; Sun, 13 Feb 2022 21:00:11 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21DL0BFr048363 for fs@FreeBSD.org; Sun, 13 Feb 2022 21:00:11 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202202132100.21DL0BFr048363@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 13 Feb 2022 21:00:11 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16447860111.caFaB.47454" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644786011; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Vqlzj400dMkMv0rHQncXJLloedBcCiCMFQKkvWCmSN4=; b=eqgccd6KB6jsO/hUXxUDHxWHI4DM4dgwNgoEP8/S3nMHwGlB0G646P+Y2ZBKGdvw8SI4YE qO9zt4j+VkmZ5udsHAg4cv92yqK6MauaoKKTg8hskpd4Nt7OXcxmecNkVl1pgRoE42XpyN YaI4iUdHqlFYjZR97Jl0DhuXi6ZTYaU2g5PjpjLo9Gp3jWjA92vTTKLJguWyJLrpb5Lj7X SZn50cSSJDQ5WqcmT5kXK/E9TK9SNtojgsa6FPSZ2hlLfh7pmh/inGt0iajWhDRPvd/x7j AixgkZSC0dNRYQJ1G9lJ9w/1QZJ/nwdgXbRxn7/xE26M/O7KKAG4gJ8numqmzA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644786011; a=rsa-sha256; cv=none; b=UWUqjNCM/FEBNMz1IL4E0bPFwHMagPYjWWrsu6cAR+kkAamaafSkAhnNqcGjQdWHZvplCQ 7462gDVwHrZMhxp+AoQVU5Q1tCA3O+Sd9385/rM8m00jbyfJEoLn7/S+oMlE6hVaPOWA7P MSxMCLnRAOltw06mKC5aZ/jG1oR/LZaRVHdu+WJbvOLa+e7uOVdlY98cid8gISGJ/gL+bN XM6blCCb/GcjhIZ2a02v+L64FXHwJHXmu0NLlg2aMcwLGxPQAfjFe3PpHkUr5VBk3plB7T N0negX8J/HqXsJIm33yjcvGHMypinHfsD2H5irrbDWNVEe0pHGpXYiTF0nJBZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16447860111.caFaB.47454 Date: Sun, 13 Feb 2022 21:00:11 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16447860111.caFaB.47454 Date: Sun, 13 Feb 2022 21:00:11 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16447860111.caFaB.47454-- From nobody Mon Feb 14 13:08:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4734519C72DD for ; Mon, 14 Feb 2022 13:08:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jy4Kj0MjLz4yfJ for ; Mon, 14 Feb 2022 13:08:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DD153758E for ; Mon, 14 Feb 2022 13:08:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21ED8efQ065174 for ; Mon, 14 Feb 2022 13:08:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21ED8etJ065173 for fs@FreeBSD.org; Mon, 14 Feb 2022 13:08:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257890] Storage controller lockup on zfs scrub [smartpqi][zfs] Date: Mon, 14 Feb 2022 13:08:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: peter@guenschel.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644844121; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7hDSnttVrQnxX+XaJx9/zrj/BtfCybvdreDZhVJgveE=; b=ASbwMrgc+ESzVfQG9ce9KcxnGzzVEtmmHL5OLywegqHTe+wYkICsL3lQJo3uXNhnTBFUt/ UINJT82N/4WkIyfqADMDcbJQrTjzwsN8JH3bQLWC3vsF+TdVvBJ3E5FGvHEoRuMRj7Sb6n 0m/FtfgAX/RJRJDD9jgzPACiIERK12IdvVBjCsSTTKm/DUeWE2LQmDcST390vVSAQ4RPWS +Ce4Hitmlg361ARdoSUtITSYu1h9chRCL0hZ9iILLZ2ihs2+mNmmMYF7c1O+ygblVmaNKE uOzKw556TwdsYwlfjEHdxwVvzGy1DAUPBAPKvBVat+PkIA52xTZ1QRgjBlEpzQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644844121; a=rsa-sha256; cv=none; b=ns01Dj4e8bAj8AFI3mgALce3rjE8Xd6DrA4FQrZm9EROtDOgOi2sNxvZ993R0U+S3G50rS 7MvhIXhSZCY4hMlG2x07qiDvPBcFRwjLm8AI8JAFOUcgROqGFSE1+2RrXfpf+C6SPnJH5p ZfPbxLfZJgM2N1M9MfpVO5M1epSIcMX4vqWArANo0aBo8MR8Os7zUK4wt3iLFD4578HvGH ca4VvOPJnVmrwwtLBNvwAXt/SBY0CyXdGXaRKqp/xKkc+cbsXqZ+WoaasIp3Qld01cc8g3 L+lKVlr98vz3KdH6OVFxtGhopG8KhIfI9pxZ43I4v3974gScCNzV+ng7g7WaCw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257890 --- Comment #6 from Peter --- All - resolution can be found in thread for bug #240145. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Feb 15 03:54:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EC861194DE8C for ; Tue, 15 Feb 2022 03:54:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JyS0G52kcz4cfg for ; Tue, 15 Feb 2022 03:54:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8EA121B827 for ; Tue, 15 Feb 2022 03:54:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21F3sspG043248 for ; Tue, 15 Feb 2022 03:54:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21F3ss6L043247 for fs@FreeBSD.org; Tue, 15 Feb 2022 03:54:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Tue, 15 Feb 2022 03:54:54 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ypnow@163.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644897294; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9gqYK7caYZ6+KXRElvXVQttqLnYLw0C0X589nkl48vg=; b=Zm9rPgkAtGhKUvqAQJ9RsLi5fA3M4vkGSu3tdJqxEBZq5SuLFBKuWPRIuvKizphcmUEukc cxk4pb0NjRWPduaMJRDLuQDJYIZxja6rxmSwxxzXYmpM33l1YpfolkGwbiZ3f8rd6wy4ZE YZI8d7XD586xKQiKLZBAPrsJjgiJ+cl2KL6YUFI8WtJQwE4NKmf192ZVVg9V2d/5dK26+U VMPD3+MkBrC/DV61BPdEIFXoUwkJdChpH/LmkFmLVjeIyLT/gdQlrWc7WO0EmYL4s9mvtl plX9oVpH1KUfHBrZ6Pov1dMzJ9RTHR59nWfojbn47gHn8rc1Hnhjx5tCZ8Il0A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644897294; a=rsa-sha256; cv=none; b=Vz9k/6y7qZIRVxLgtlIjHzaJyd8AigEfA+Gh+eOyToqQaVbBf7N5fs/FykoWk1XyELBX1z Q24tUVuFN9bOd6/X1vX46XPq7Cmjw34rIouJ9E1tSit+dUMovq7GenpcQCKd/1B+fbE+uE BVdIbYq3AZtJ6d0YL6MjlGmz1Vx6E0WLtOTFib0/qGiD2XwBFNZ/HuTRwvyHKvSqTYKb7J n+KVyraBxpgmtWW2+kYwhuToBrkGz6gJ1BMa1X34VYZVvWq22qew7RHulYimwab5910lWa J32Wo9GIbfxiIvO5W+GzBuhrkVuy2llq5subC/JEm1srlAXhHXv+gdEBNo9xtg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 --- Comment #16 from Pader --- It's been almost 49 days ago with NFSv3, everything's normal. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Tue Feb 15 06:44:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E4F0619CEF3F; Tue, 15 Feb 2022 06:44:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JyWmT67FTz3Gk4; Tue, 15 Feb 2022 06:44:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644907497; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Zmup9jBddcN0rBtb6sTLRRHl+xvE98LgBhI/gb1B4l4=; b=MKj9JMFUP0KcaZyZf4Jt7NDJFXJsZeuPeRwIK9alBNxBKnA0CEblf9yRY5bcjrQ/uS99H1 P9LeJp07yVDH3k7nsEco6rZCP1KtlN8pczPKkPTnuFOe2+GxyrgdGSCzyP1K0ui+iHeOJv 1pC4Jdal7Fww26hFwUOaey6Fw9T0j60jkCN0KEsUx/iP6quiSJFiNrEgXYSbT7GGGTmEcQ nGBspPc+kSh3oLLZB+RgfDd4FPoPecjCaP/L9mtsWOJleL1sLhGC2FguQOkeQ9cSI8ngdI 4UXEpi7rpzBin47WI3nSWtvMdg+hcmHgVTpHIYHHM647R7uAog9SI74qvdFqpA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 3DB3A28B64; Tue, 15 Feb 2022 06:44:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <5eac56d0-51fb-5e23-0d2a-3c6b6bf163d0@FreeBSD.org> Date: Tue, 15 Feb 2022 08:44:54 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.6.0 From: Andriy Gapon Subject: Re: fsck -C -p: NO WRITE ACCESS Content-Language: en-US To: freebsd-stable List , freebsd-fs , "freebsd-geom@FreeBSD.org" References: <346d021f-b737-f41a-883f-e821389c4431@FreeBSD.org> <20220214231758.GD97875@funkthat.com> In-Reply-To: <20220214231758.GD97875@funkthat.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644907497; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Zmup9jBddcN0rBtb6sTLRRHl+xvE98LgBhI/gb1B4l4=; b=WnB/NxEsZS6j0bAgUr/1RbpKTjyJ8oav+TnLBYSqcIaPuMNEvBGaiVypv19FC/2vJBu/k3 k0bd+TTvs2HHAi9HOUTt/OVQgYssN7hRp5CTE+7kIAdEsu+hEM1T/PiEvqVvveLkFo0QDO pxAeDfVUCnvmZVSOKaj5nj7d7LAST+v70/nf83FgHp7+xCyRlIL3Id6ccFMr09d0ZBumY+ OdggCR6/fyRhKAm+50fpvBZZbYkKsPgwU4w7OQNgdfWCqv3nf8tlPxJY5Vh2d4nOz3i/ul yHI849I/lelLJHk40BCeLEbScGDycWqeOJY1tTyIRXHFTpx66TRxawwlgalr/Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644907497; a=rsa-sha256; cv=none; b=ndpOy1p8JKeKiKxE4niK0RpDHxAv7lpiaYZ/JwAtz/k214lrlY44AWNzRVwClzj8pu/fde YlJLs4T+pCjxpeWw58x+4Ho11glQpj2EoHfdN/3Q2vU4hJyjHxB6A6pdQfpscCu6vt0Sxp PK2oKwOqmh7vanL9csWO/zq+pVBZuta8+aaPIuDHG+s4bk7lJDQEaZajs6ieJseubSFMti K4OiKNaUzFap3c0MaKLqczm368tR+Qj7WerEuMtMXDnVXIPbbLmLfbnOLVJc4MRKWIl0nW oE1a8KTbODX4r6364Z9tHH2sjiZ6IKVJVBn+mCtyua3ffrP9I15Huqh4tA2uKw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 15/02/2022 01:17, John-Mark Gurney wrote: > Andriy Gapon wrote this message on Mon, Feb 07, 2022 at 14:15 +0200: >> I've got a problem where fsck behaves differently from my expectations. >> The problem happens with a filesystem on a GELI encrypted ZVOL. >> The volume has 4K block size and that's the GELI's sector size as well. >> FreeBSD is stable/13 from mid January. > > Did you put a ffs filesystem that was formatted on a 512 byte sector disk > onto this geli device? As far as I can recall, no. I created it with newsfs on the geli device. > fsck calculates the sector size via (/sbin/fsck_ffs/setup.c): > dev_bsize = sblock.fs_fsize / fsbtodb(&sblock, 1); > > and fsbtodb: > ../../sys/ufs/ffs/fs.h:#define fsbtodb(fs, b) ((daddr_t)(b) << (fs)->fs_fsbtodb) > >> fsize 4096 shift 12 mask 0xfffff000 >> frag 8 shift 3 fsbtodb 3 > > fsize / (1 << 3) == 4096 / 8 == 512. > > so, likely updating fsbtodb to be 0 instead of 3 would fix this. I'm not > sure how to do this though, as tunefs and fsdb don't seem to have options > to do this, and likely you'll want to update all the superblocks w/ this > new value. > -- Andriy Gapon From nobody Tue Feb 15 22:41:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5F7CB19BA6A5 for ; Tue, 15 Feb 2022 22:41:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jyx0K1bqGz3ktQ for ; Tue, 15 Feb 2022 22:41:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 177EB2B99 for ; Tue, 15 Feb 2022 22:41:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21FMfbPr057988 for ; Tue, 15 Feb 2022 22:41:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21FMfblj057987 for fs@FreeBSD.org; Tue, 15 Feb 2022 22:41:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256746] fsck_ffs completely broken for background fsck Date: Tue, 15 Feb 2022 22:41:36 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rew@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ X-Bugzilla-Changed-Fields: cc flagtypes.name assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644964897; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/2o+ZYu2fw1sb8cma061/xyz+motZ3O1zQ/BJyQLSMA=; b=X10tDX92UQWeLppR32km7+GKYmEJPqIOe6P72C8F75LeUjIzmhIuCAwdEoY5B2dAbTroPX FmJfsmPtaC80+NEF3h+/7Eq3qioAI9qAzOCo6W2pUsmTS4kbIjaYxlojlAmEhED3mHnivk F5Pcv9jK7YOstmH9ayPT6tuxUrOqLeO28FG7gxCc++ckdRNLdnDAcuG30qPMgbPTHYYwM4 O83CvwpQpLzeyLmhsFuh6szEq3fAF1Vn+rsiVwALf0V3D8Id/GOFoEQ08vo5+/xlAKTuK8 oVFraox8Aa0q2DzSEEcDjsQqoKcsnIWzNkHAahLdIpfjXfymtIBfUbDpSFDfjg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644964897; a=rsa-sha256; cv=none; b=cVUxitHCBn4eD03S6xR59kLF8y21jVnd4PADpJBIQ2vAT2p/o4mS/h/EuvR5+Qws24+0Oe 3sDlDa1sawURuvAQ2aaq7dN2XWQNDqgJyMoEpZhcgx1jmjH69tHjjRFVlFltRqK3ZX11Y8 LB+lLOQkQFzZDkBBfD96ngFvtQJC8aun9yUiE8soVQ2PhW1zmQ8IMl0PXYHUzu58YSqNB+ 5lBnqUoknH6vYp356Kh3Y1DmrTgbVnbS7K6+KN8SJl8VvyX28GuT6LyKdTcKkCYTypk0y6 bcN3qhF3EppiCkM6ognDzlr9IJvB/CM5QmRqQsrsaa0wSfOvfc7NKvj/hXaoiw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256746 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org Flags| |mfc-stable13+ Assignee|fs@FreeBSD.org |rew@FreeBSD.org --- Comment #9 from Kubilay Kocak --- ^Triage: Assign to committer that resolved and track merge(s) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Feb 15 23:21:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A664C19C2231 for ; Tue, 15 Feb 2022 23:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JyxtR3gBXz3pvs for ; Tue, 15 Feb 2022 23:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5EEA83258 for ; Tue, 15 Feb 2022 23:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21FNLZSM077360 for ; Tue, 15 Feb 2022 23:21:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21FNLZv5077359 for fs@FreeBSD.org; Tue, 15 Feb 2022 23:21:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTY3MTJdIFVGUzoga2VybmVsIHBhbmljOiBmZnNfYmxr?= =?UTF-8?B?ZnJlZV9jZzogZnJlZWluZyBmcmVlIGZyYWcg4oCTIGluIHJlc3BvbnNlIHRv?= =?UTF-8?B?IHBrZy1kZWxldGUoOCkgc29vbiBhZnRlciBsb2dpbg==?= Date: Tue, 15 Feb 2022 23:21:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Unable to Reproduce X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644967295; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SUF/l8okNqOlJn90bMX1WaDl3Pmd8Bl4n8YZjbR0H78=; b=kztG+ppN/SHfMfLpY3n1TCObFbKrAwJDgLMYIDxhVXmYcIQs/ludPLqB4m9wITCofnAvzZ QLHhNvaOG6Ww62YKW2oCbA0fx1S4XYl0OHk1ClUEygTEbQxB77WMdqPvphDDeM6ditXtrZ NgmYDljVtqd81oBRotsPdUtJLxU5URMlBgtFAyQIjI9JN4dJQccAhG2RT6g4JZMuIIl56K gDfZxQMYuUpVWxVc4j2UOJZumKDqqfOKfymMUexi56VjljMuOjzQXTM5RKAnQ/pmRevRvr DvabOpulh5p33WzBXLlMgdEi7oIll2yULlzBpN/EK6DJKXVe0TNemuztGnWZFA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644967295; a=rsa-sha256; cv=none; b=OCSqcTwCi/qg5LK/vkhwV9AT6n3tM/HDxoXDSwIuampTH4MZH5bUUY1E2uQp6pZK2ZL8CG M4lURVz0eIrZcMnhrwScdg9pajc3WfeC8LeXuIrkKZXezTow7ce5mX4QRIXorNGlEPUJZg u9phDhJ2bSSBrB3X6n4r6Ii+E9E3PjOoNkhzvrcJ1SMyQtqW34gXyDc1qjAOdPkp0EzBbN p9uyX9ekhpOH+7eE68yqgs308sX14Uf+rpvbRWEw0Jy6J0cFtgAQR0WTQz/77v/IEC7a56 pAuV12I0iM9DZnKYxEXsk2sWHR/Vht/XQ719Po91obHG0KYq2533zvQRaoDqKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256712 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Unable to Reproduce Status|Open |Closed --- Comment #24 from Kirk McKusick --- Without further information I do not think there is anything more that can = be done with this bug report. If more information comes to light, please open a new report. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Feb 15 23:27:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1A8DD19C370C for ; Tue, 15 Feb 2022 23:27:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jyy0p6g3pz3qfx for ; Tue, 15 Feb 2022 23:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C13F43884 for ; Tue, 15 Feb 2022 23:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21FNR6vK080090 for ; Tue, 15 Feb 2022 23:27:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21FNR6bQ080089 for fs@FreeBSD.org; Tue, 15 Feb 2022 23:27:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257439] [lor] lock order reversal when unmounting a UFS fs Date: Tue, 15 Feb 2022 23:27:05 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644967627; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OG5oGJ54D/D+o7V3ilGKvTi5n8I7r1Tnx3/c1hoMHww=; b=yj6rxfJhH3Tv9ZeaFDAWtt9eS+x60X4xzy7aiLQ15JdzJennag95srVBwSMKdWvyVXwVOw gazb6NQHd0m6qEpzIeCL63bAYufHnR6Ec3k+1z6FClgCd6Qs7K2jbaOC1S34TVUXy7+8JG 1Hwq8nHfWNU6UjOIUwSDAMOLY/iU14nJqspLJLhtzU1UmwszVShHl5QqJJYgT8sQRwklvE rwPUykXsTacnqtRtmkDuCuio5WDA1CaCMqqLkbOiG5C/5vaSTnBUujlPx3ZO1Y7bmjqAbu i+JBlLXZUbNmTi5XcZ8nCZVtsSYiWxzcnWuDsy1T365PAvJsOH2hE4KXiKeddg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644967627; a=rsa-sha256; cv=none; b=iHK/lSkYVaZaNVUyD4S//K3kj+3gvAvnJCofHi4qiiTrE7xMISyl6WlrEOYK61VrJn01gY uC/FU4RrVAAi7Tbryxru6ubiKgC5pxmFDRAbhPJd/4QYsgCbMxatlmQ/pv++uPqFt4ezCz /EF9j8qvhKvyXygW/3YDiTaEmSkmwjPtRKZlWvasu//PeS7mUzJ3T3rh0gq4hJRwmgP3t/ eKikd4ZLs0XoXxliwvZ/a5hXWTBqP/CedNmIjdsAcss+ZOajH1fHnJuAA5VzYFRyuunQe2 bIZPiihqSgUd/lMXsxs2ks/ehSlIs9mZx6H86AEcfrpyXDMC3FAWG61LY9EV9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257439 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --- Comment #3 from Kirk McKusick --- These were eliminated by a series of commits by Kostik (kib) and myself. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Feb 16 01:15:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3AF9B19C2658 for ; Wed, 16 Feb 2022 01:15:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jz0Q10Ksqz4cW0 for ; Wed, 16 Feb 2022 01:15:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DFEC45192 for ; Wed, 16 Feb 2022 01:15:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21G1FahI036605 for ; Wed, 16 Feb 2022 01:15:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21G1FaWn036604 for fs@FreeBSD.org; Wed, 16 Feb 2022 01:15:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245916] Superblock check-hash failed Date: Wed, 16 Feb 2022 01:15:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644974137; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rohJ0ttUYHwNv0ACGG70E6MaaNh1Ss78O2dc0xDLxO4=; b=w8oCJe1RpHYSIC2FsRO4t8ycfXHj0wsAks9WNpPVPyrRz55LpML9JE/+k1mm2LBIPYIJlv PHOPvvirwdEDQ/Bgwpxnu8ZeKCe3icpNo3ek4RJqokAzUZrlPGgr2eT5Gstz/drQQbWlyk McLwvGx4wT4RtcDRY1wTvNuuJs3TXmHuoxucbi3hNbkzu73HQ2qp6fIqOchB3kW6IQ7Vw9 7yIJKldelNB11ri1/N6zXpxDBRUmgrISn9SH4HZ7dZZj36RrJii61UQ2L3joyfrkZ2Y4Su 688V3l236v5FylIzDKIR3QroJX7JrOHE8zdk4L7SK/9a/mELVFr/48rPgxfcXw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644974137; a=rsa-sha256; cv=none; b=fVIXyT8Ah22x6gFRRZQgk3eqJWBr2S2M7MApx/Gca18fHcQXuC0UVlF/6//xsMKFBIa7G/ WBpE6TYJDlZEn7v8GjWFxZvgOdZyrV+hYRAyNgzsNAkCsr64WqI1x2fmQyAAG4xHjpltn2 ZeuyzWt4//B3tlJgHeJo2dTPdPXZMXtNMa+zTVOqHkgfQu0ej+3kuv12qAMSgesrwxCefL 2+URQElvgrqzlpwiXVlJm5YForC+viIfGym1vMmmAiX+dYXEFz8n6t4S8qRdf3CVaFeQbm 9ofsfbHVyO2JIQKKnb0vpNdQMeHJ5aWN1q+sTA9/jPxQs2GFQdq6OJUiHiZVkQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245916 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D166926a3dee05875b9cb38356871d9ce0= 7083c0d commit 166926a3dee05875b9cb38356871d9ce07083c0d Author: Kirk McKusick AuthorDate: 2022-02-16 01:09:07 +0000 Commit: Kirk McKusick CommitDate: 2022-02-16 01:14:22 +0000 Have fsck_ffs(8) properly correct superblock check-hash failures. cherry pick cleanups from commit c0bfa109b942659f609b7e2bf3ba042ec0cb3f= 9d PR: 245916 sbin/fsck_ffs/main.c | 2 +- sbin/fsck_ffs/setup.c | 6 +++--- 2 files changed, 4 insertions(+), 4 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Feb 16 01:15:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 357A919C2807 for ; Wed, 16 Feb 2022 01:15:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jz0Q208lsz4cQL for ; Wed, 16 Feb 2022 01:15:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DA9FF5196 for ; Wed, 16 Feb 2022 01:15:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21G1FbTS036623 for ; Wed, 16 Feb 2022 01:15:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21G1FbRp036622 for fs@FreeBSD.org; Wed, 16 Feb 2022 01:15:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245916] Superblock check-hash failed Date: Wed, 16 Feb 2022 01:15:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644974138; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MPP59W5T0wMPYddmdBFxZSR8OAIr15QIOPzKnwy5hrk=; b=NPRGedZz/Jo3bfISUJzRS1SlFLKg9eYT0W5pG6xyKvSqB0tsozIvxGaim4RBAmu8vvH4Vv it/NJADUooqCuqNWbvlBXJe+DoTTsifjZoTviCR2f+cvj1EXhCE5lfo1295fJyPpZSDftC b707YH9/Tt56DBDNrclDeZ1Dqo5IWyrsJS8FFHaK9SnKQKp8+zRVxPoeudAW3v5mwmqt96 As0vG3wNvjzK5QEDb9OjW/j6W9SNgQsKWXpVO+mONy8domD+XT7LPNMJ590SXVJ5EnMjU+ dPYyfct/ikBi2yZDZfgBOka3ml8FKPiADd8/4oQl8Gv8xDzxFBavtswAD5JWMg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644974138; a=rsa-sha256; cv=none; b=kY/VY3kLewj6XA3RyQyUNyWExXHPrXeQdOMA6PYrvPT+2cttt2FrquHRrRFXYoP/ZJyv3O xmhdX7fEBtWnA5bHPe2yDVATGkZIBv4+zo+UocTI40/sD8dSxI64BBEorlraL1mIEASaqI YLfgS5v3kq5M3H5+SlIkY1MrzlohVG2W8T7w4pGlGOoaqFBgTakN3lCQrUT3iAn4E2AWpb 7Qb2gYJ2ubBGgrVx1b5Sydby9+F6ho9ZDnBm/gSHVh4XmI6eBypoB0YIhkaIvZviamBTGN YQq2NshnfOEsXX7IRysjYRUMXSd6ioqt3hnXVmR6CjJ4cIwCoTzZ/2hp+BBMwQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245916 --- Comment #7 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Defd949aaba7449ae994fe5052178c2ba3= efd2e7b commit efd949aaba7449ae994fe5052178c2ba3efd2e7b Author: Kirk McKusick AuthorDate: 2022-02-04 19:46:36 +0000 Commit: Kirk McKusick CommitDate: 2022-02-16 01:14:22 +0000 Have fsck_ffs(8) properly correct superblock check-hash failures. (cherry picked from commit c0bfa109b942659f609b7e2bf3ba042ec0cb3f9d) PR: 245916 sbin/fsck_ffs/fsck.h | 1 + sbin/fsck_ffs/fsutil.c | 4 +- sbin/fsck_ffs/globs.c | 6 +- sbin/fsck_ffs/main.c | 309 +++++++++++++++++++++++++++++++++------------= ---- sbin/fsck_ffs/setup.c | 182 +++++++---------------------- 5 files changed, 258 insertions(+), 244 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Feb 16 01:18:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4A96F19C3159 for ; Wed, 16 Feb 2022 01:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jz0St10L5z4dKn for ; Wed, 16 Feb 2022 01:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F41424F53 for ; Wed, 16 Feb 2022 01:18:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21G1I56l037014 for ; Wed, 16 Feb 2022 01:18:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21G1I5ru037013 for fs@FreeBSD.org; Wed, 16 Feb 2022 01:18:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245916] Superblock check-hash failed Date: Wed, 16 Feb 2022 01:18:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1644974286; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LDw+Yma2496PJ1tcfSPrtIoORMNad7r2/3Q3DLF+ZGE=; b=NOXB7v3/c7UUS7wIDSWSbYrJiBLBBQRSiLR6ahvSs2ovKanwPojnWgbz3R/2jRlN7x4AoE ZgOlLnfhlcEARQv4GuFFrMiQ7Umr5OOy/MOUGu/tLZMoTUE7nvIgcT6Lo0aJCfFSAnENOb BUV+OeXgICBTohZkcIC//7ThpwFg1HOi1LrZg47ktQlvkCYKasGaWb5VZVAqX/sryTVJOB XaZw+IEvzSfPbipBhV27xYeVCS4h2uKZ2vg9Qqr0FEC/aTCYCfeU1P7gr5AU+uhO6Vf3u/ cbyVPljUecNB9BxsOY+jHYzN6ycZ8xaxmOgK35R9O1gfpdPOWh51BeXV1fg4Lw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1644974286; a=rsa-sha256; cv=none; b=bOB/yVOh9oeB1ZlDKO4tr/PGtIo+5yC3x8qcJ58QvBPxSO0aNk04Dl3iOwkP6b7HmLykfU iym/sxFf1woyJlRYO0LeGf/u/F3qIsGkMGkzXCZulgcxRylZ6TGRWeFRsBg6wY7cNyNEWt HNjjiNjb1uqRraONrkXiGXGa4TN5cGV+5MM2AWIAUtZs4dvIDZk/wH/hTaqxqL7ap0QBpM /haWDbmtubNBa3WeNP3CjESC3imTHU0XuvuHhdxNci0IlRsVp18qdPUDaNZwVt78Xa/CRS Wj4JR56vLI9ssQNWVsz/iLWKoqJzzBD+1VzY6d+EP9j07LTveXLIvSC4z4J6WA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245916 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #8 from Kirk McKusick --- Has been MFC'ed to 13 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Feb 18 08:36:18 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5A97E19DFD92; Fri, 18 Feb 2022 08:36:24 +0000 (UTC) (envelope-from peterj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0Q5h23wzz3krc; Fri, 18 Feb 2022 08:36:24 +0000 (UTC) (envelope-from peterj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645173384; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Mi3SNNA0tJ81NnE97oPCcZrkn1pwqsn3FXY6VLeV9nk=; b=NuVQY8gj4J32CaN4omvBFfZ7Tz/yEsfXO1fphYyFsEP/rJvCgKeUgoLqHe0mTliYCtvlu/ 8Bcp+1H0qgy/Se9j7xELAlucwKZ/n1IhnM+77+1JSG9I704BnFFTeABKefQF0C405yJT5W fnf/oKi6uS4gibKHwoxTgUXT2ZAuRmfJR6S2QxzL4qp0irRqoB/zFmWI6/54qo7OhF67kb Me0Phja/FJRviW2wz46zeOKSyeR5PhTs44rpcj9tTJOk8rgnLHQE9Jwn+kO9fDTXoQnfwo AUa/6jRqXNLNCRWPXVig4GkNKVJ3KllZxFrohkh+cfzMVulKG+JVYFrQgk6hLw== Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: peterj) by smtp.freebsd.org (Postfix) with ESMTPSA id 305E62CC64; Fri, 18 Feb 2022 08:36:22 +0000 (UTC) (envelope-from peterj@freebsd.org) Date: Fri, 18 Feb 2022 19:36:18 +1100 From: Peter Jeremy To: FreeBSD FS , "freebsd-geom@FreeBSD.org" Subject: Re: bio re-ordering Message-ID: References: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> <20220218014814.GJ97875@funkthat.com> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="q22ohTV72yYk0JEy" Content-Disposition: inline In-Reply-To: <20220218014814.GJ97875@funkthat.com> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645173384; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Mi3SNNA0tJ81NnE97oPCcZrkn1pwqsn3FXY6VLeV9nk=; b=HkdFhopweco12sWSZJubr4/sSnL0VqZHI0AVJjJ/tGPjhBztJr44nPkK6FfN/KJ2T9a7an qXB8oPiNL2PKLxdT6O7mSw/Wz2Ll0KMA4vaag9bO8AaMwxQwBsN09cFH5LUVZQAiGSget+ eynS2x/G5LgiwHRDiHET1hn+dHsk4etmm67GOVNnRf96cNlnh8xPseTGDdWBmzpfxQ7t47 3u5xwLfqWKxZS2PUrBIAspc9nQSm+/aze0mudPXHP3CyoqebNuHqYzTH77la8MsUPUsfmG TX+730wH3vb1WTzKsLL47cxODFFWmNYuvxuk6tVHORZ8d+oihbsVbndZScpbKw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645173384; a=rsa-sha256; cv=none; b=Jh324HppuCQzLywXKfy3uIp0nq49F4uJzr+vMB/kvgbwusxNvqXLGkqsJyOeJdF87yVLqG KRc5AyLz9mEoW1hgVg/BrnVtQ5pPxXh/Sd9R6XqSHecmmDgg26ppUJV/YdPLGiYD/9LmST wNLaCy52XoVdsJO29XuTGz3jZeXnQGYgtedChmEdmgaiL06YVwJh/jsPrJ+t/KBLCY+e71 hs2QZQZJZqGMN4cilVXLzq+E8ZhDELLT7+ksXS3HsxHy8wJS68KIqqai6bN9CsWIMKLfhP kZ5htmzNMYyQB99FgknHK+q1tDoZKa5jdooz+azAJdvBNWdKdeINbdpsMEeraA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --q22ohTV72yYk0JEy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2022-Feb-17 17:48:14 -0800, John-Mark Gurney wrote: >Peter Jeremy wrote this message on Sat, Feb 05, 2022 at 20:50 +1100: >> I've raised https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261731 to >> make geom_gate support BIO_ORDERED. Exposing the BIO_ORDERED flag to >> userland is quite easy (once a decision is made as to how to do that). >> Enhancing the geom_gate clients to correctly implement BIO_ORDERED is >> somewhat harder. > >The clients are single threaded wrt IOs, so I don't think updating them >are required. ggatec(8) and ggated(8) will not reorder I/Os. I'm not sure about hast. >I do have patches to improve things by making ggated multithreaded to >improve IOPs, and so making this improvement would allow those patches >to be useful. Likewise, I found ggatec and ggated to be too slow for my purposes and so I've implemented my own variant (not network API compatible) that can/does reorder requests. That was when I noticed that BIO_ORDERED wasn't implemented. >I do have a question though, what is the exact semantics of _ORDERED? I can't authoritatively answer this, sorry. >And right now, the ggate protocol (from what I remember) doesn't have >a way to know when the remote kernel has received notification that an >IO is complete. A G_GATE_CMD_START write request will be sent to the remote system and issued as a pwrite(2) then an acknowledgement packet will be returned and passed back to the local kernel via G_GATE_CMD_DONE. There's no support for BIO_FLUSH or BIO_ORDERED so there's no way for the local kernel to know when the write has been written to non-volatile store. >> I've done some experiments and OpenZFS doesn't generate BIO_ORDERED >> operations so I've also raised https://github.com/openzfs/zfs/issues/130= 65 >> I haven't looked into how difficult that would be to fix. Unrelated to the above but for completeness: OpenZFS avoids the need for BIO_ORDERED by not issuing additional I/Os until previous I/Os have been retired when ordering is important. (It does rely on BIO_FLUSH). --=20 Peter Jeremy --q22ohTV72yYk0JEy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmIPWn1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzQoug/9HBdIH8xPRej9/4/cO0136I3bxqIynTIvQiIvDcdy9E1DbqrfSV5yB7dR GyvVaIFMCvR3PljmDpGU9J7Gr/uzohcOOX3oU7mZ0XENGYFztbZrQ7ZAsw9KGgPP WgTNqrXlGkMDx1RALf/KRU/YhiRg7alQAl/ulTfwxyG9OixzDQT5JcD4tOv3SIzR ouhLo3MaXvy0NbNERAzelLNJApE+P5SM1i7XUFEY2ri5KmSkfV2ogV+E4ZZCu5Jj 6pb5u2gFEQDMeH+tfDxSGdjqV3ssP5hwY2wjzweMEpS1cJ2hvE/oLMAo9+/Z+mQN PtlYxYqIWtV6R+ZArbcyHUWXctvSO0lRTcwe62PqEAcNANLUl4RNrK3RZ12xsNwT HRyZE8LOK1dTHratF02UJ6dLaajR4CXRFkiJu6xfN8Hy8R9oejTcezICiWEYsZV1 l9QHKW2Vr8xwJjVjAz+YZBvWRoD7MQS8Am4/6zMfBYvosJU9KGHXMKroi0v43Hl0 UDC0yQtaHhIE4qPM64UtonkFKR1bC8fJJYVeO+hj9s1rA1dZG+c+tIuLbVPVQ8Hg 8fk18jy7IeksOHM9maO54kf5Oj77alrs1XjpX6wEW+0/pRFula4OluV+fDoZTv7J uoa0fVm+uEDlRd3bzOitVdXh3vMvMmiF/4yCLhiTET58e6CQTjc= =RNi/ -----END PGP SIGNATURE----- --q22ohTV72yYk0JEy-- From nobody Fri Feb 18 16:31:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 62BD119CE08B for ; Fri, 18 Feb 2022 16:31:27 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ua1-x931.google.com (mail-ua1-x931.google.com [IPv6:2607:f8b0:4864:20::931]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0cdp5FlXz3qt2 for ; Fri, 18 Feb 2022 16:31:26 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ua1-x931.google.com with SMTP id 60so4532390uae.1 for ; Fri, 18 Feb 2022 08:31:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=DfM7FmnDyvj93Hq+rlHbfv7sKthuIm5IHBzHrT4W0X0=; b=aZiMq2WJWbQO4PiGsD7cYVQTbdTI8dOjF4/BLS7SJqpCfmkbZ/wNana3jcEB2v7BhJ kmZ/5N7/Puea65hyCy8VQK8YTyLMPD0+7Jcz0QjgPowoz2OZC6pl/Oc8robxCs6wtpwL ArPhfIbU6ijb6wxnaJYOGUVLNLwGfNXxcnPuZUj+MWLkOzMoL9Wacg9jbv8QlGmWyqOB +bUVAjn7vXGuCpufcNQjsAGjUSM5eiZmvnLm21Kd/obqQAOf4TTg3dK2tsK77x9fOMsh fTgRLqTfimUZRkO3nsw7Sr770nI4SSHMaThVWD9aE9wCD6+pcBK9Iy1Dts9TBmVNe8Lk OUhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=DfM7FmnDyvj93Hq+rlHbfv7sKthuIm5IHBzHrT4W0X0=; b=YiN+oN0+JOTAU1zqPP9/YQ8gXHforPMvDPhdbEeSxMSHkSzVHuUaz+VZ8zJV3b6Og4 1KWF9PvoOGo7IydF2n3L+h/ZiVBQ7sYfPCVYS4OY89tumBzBjDXpoS61SCbX8ydCDsU/ RkNYsSIU/ejxaiwKBW/37N9kLx0JE2gCLcEACJ55huQfn6QozlB5fbFb8iMXRSmVJuIL AUobqJl1t0olboUx/5wGNS/8gDz9mlGDOr6iaTr7dfYeMeaCsIizmVEbpM+PtWylW7M1 ChdcOT7bhOxYmoHN/1/kuzBuLjer5gmzgRtOHLw0uIC+l6KaUktzKSOSuhmLDpgsIIEi eNaQ== X-Gm-Message-State: AOAM532PxTCb9mciesMsMWL3DJUpoNWUKrULKPvTLQ9w6ZE84uHAIWkH A414PEJ/tuKN8vHVLMFzsu0e8sZuZVFRMLr5cwb6KoSh7pwafA== X-Google-Smtp-Source: ABdhPJztBpdSw7moYd7bY191fRxYYL1rvkRZTpRl9cZUrHzwc0KMTNjBr34k2DaCOHk+bYCsUUd5twk3sv7ipaL+7ww= X-Received: by 2002:ab0:1530:0:b0:33c:53cf:6844 with SMTP id o45-20020ab01530000000b0033c53cf6844mr3266746uae.85.1645201885697; Fri, 18 Feb 2022 08:31:25 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> <20220218014814.GJ97875@funkthat.com> In-Reply-To: From: Warner Losh Date: Fri, 18 Feb 2022 09:31:13 -0700 Message-ID: Subject: Re: bio re-ordering To: Peter Jeremy Cc: FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="000000000000fb45dd05d84d69e2" X-Rspamd-Queue-Id: 4K0cdp5FlXz3qt2 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=aZiMq2WJ; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::931) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.89 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.90)[-0.905]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.99)[-0.993]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::931:from]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com] X-ThisMailContainsUnwantedMimeParts: N --000000000000fb45dd05d84d69e2 Content-Type: text/plain; charset="UTF-8" So I spent some time looking at what BIO_ORDERED means in today's kernel and flavored it with my indoctrination of the ordering guarantees with BIO requests from when I wrote the CAM I/O scheduler. it's kinda long, but spells out what BIO_ORDERED means, where it can come from and who depends on it for what. On Fri, Feb 18, 2022 at 1:36 AM Peter Jeremy wrote: > On 2022-Feb-17 17:48:14 -0800, John-Mark Gurney wrote: > >Peter Jeremy wrote this message on Sat, Feb 05, 2022 at 20:50 +1100: > >> I've raised https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=261731 to > >> make geom_gate support BIO_ORDERED. Exposing the BIO_ORDERED flag to > >> userland is quite easy (once a decision is made as to how to do that). > >> Enhancing the geom_gate clients to correctly implement BIO_ORDERED is > >> somewhat harder. > > > >The clients are single threaded wrt IOs, so I don't think updating them > >are required. > > ggatec(8) and ggated(8) will not reorder I/Os. I'm not sure about hast. > > >I do have patches to improve things by making ggated multithreaded to > >improve IOPs, and so making this improvement would allow those patches > >to be useful. > > Likewise, I found ggatec and ggated to be too slow for my purposes and > so I've implemented my own variant (not network API compatible) that > can/does reorder requests. That was when I noticed that BIO_ORDERED > wasn't implemented. > > >I do have a question though, what is the exact semantics of _ORDERED? > > I can't authoritatively answer this, sorry. > This is under documented. Clients, in general, are expected to cope with I/O that completes in an arbitrary order. They are expected to not schedule new I/O that depends on old I/O completing for whatever reason (usually on-media consistency). BIO_ORDERED is used to create a full barrier in the stream of I/Os. The comments in the code say vaguely: /* * This bio must be executed after all previous bios in the queue have been * executed, and before any successive bios can be executed. */ Drivers implement this as a partitioning of requests. All requests before it are completed, then the BIO_ORDERED operation is done, then requests after it are scheduled with the device. BIO_FLUSH I think is the only remaining operation that's done as BIO_ORDERED directly. xen.../blkback.c, geom_io.c and ffs_softdep.c are the only ones that set it and all on BIO_FLUSH operations. bio/buf clients depend on this to ensure metadata on the drive is in a consistent state after it's been updated. xen/.../blkback.c also sets it for all BLKIF_OP_WRITE_BARRIER operations (so write barriers). In the upper layers, we have struct buf instead of struct bio to describe future I/Os that the buffer cache may need to do. There's a flag B_BARRIER that gets turned into BIO_ORDERED in geom_vfs. B_BARRIER is set in only two places (and copied in one other) in vfs_bio.c. babarrierwrite and bbarrierwrite for async vs sync writes respectively. CAM will set BIO_ORDERED for all BIO_ZONE commands for reasons that are at best unclear to me, but which won't matter for this discussion. ffs_alloc.c (so UFS again) is the only place that uses babarrierwrite. It is used to ensure that all inode initializations are completed before the cylinder group bitmap is written out. This is done with newfs, when new cylinder groups are created with growfs, and apparently in a few other cases where additional inodes are created in newly-created UFS2 filesystems. This can be disabled with vfs.ffs.doasyncinodeinit=0 when barrier writes aren't working as advertised, but there's a big performance hit from doing so until all the inodes for the filesystem have been lazily populated. No place uses bbarrierwrite that I can find. Based on all of that, the CAM's dynamic I/O scheduler will reorder reads around a BIO_ORDERED operation, but not writes, trims or flushes. Since, in general, operations happen in an arbitrary order, scheduling both a read and a write at the same time for the same block will result in undefined results. Different drivers handle this differently. CAM will honor the BIO_ORDERED tag by scheduling the I/O with an ordering tag so that the SCSI hardware will properly order the result. The simpler ATA version will use a non NCQ request to force the proper ordering (since to send a non-NCQ request, you have to drain the queue, do that one command, and then start up again). nvd will just throw the I/O at the device, until it encounters a BIO_ORDERED request. Then it will queue everything until all the current requests complete, then do the ordered request, then do the rest of the queued I/O as if it had just showed up. Most drivers use bioq_disksort(), which will queue the request to the end of the bioq and mark things so all I/Os after that are in their new 'elevator car' for its elevator sort algorithm. This means that CAM's normal ways of dequeuing the request will preserve ordering through the periph driver's start routine (where the dynamic schedule will honor it for writes, but not reads, but the default scheduler will honor it for both). > >And right now, the ggate protocol (from what I remember) doesn't have > >a way to know when the remote kernel has received notification that an > >IO is complete. > > A G_GATE_CMD_START write request will be sent to the remote system and > issued as a pwrite(2) then an acknowledgement packet will be returned > and passed back to the local kernel via G_GATE_CMD_DONE. There's no > support for BIO_FLUSH or BIO_ORDERED so there's no way for the local > kernel to know when the write has been written to non-volatile store. > That's unfortunate. UFS can work around the BIO_ORDERED problem with a simple setting, but not the BIO_FLUSH problem. > >> I've done some experiments and OpenZFS doesn't generate BIO_ORDERED > >> operations so I've also raised > https://github.com/openzfs/zfs/issues/13065 > >> I haven't looked into how difficult that would be to fix. > > Unrelated to the above but for completeness: OpenZFS avoids the need > for BIO_ORDERED by not issuing additional I/Os until previous I/Os have > been retired when ordering is important. (It does rely on BIO_FLUSH). > To be clear: OpenZFS won't schedule new I/Os until the BIO_FLUSH it sends down w/o the BIO_ORDERED flag completes, right? The parenthetical confuses me on how to parse it: BIO_FLUSH is needed and ZFS depends on it completing with all blocks flushed to stable media, or ZFS depends on BIO_FLUSH being strongly ordered relative to other commands. I think you mean the former, but want to make sure. The root of this problem, I think, is the following: % man 9 bio No manual entry for bio I think I'll have to massage this email into an appropriate man page. At the very least, I should turn some/all of the above into a blog post :) Warner --000000000000fb45dd05d84d69e2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
So I spent some time looking at what BIO_ORDERED mean= s in today's kernel
and flavored it with my indoctrination of= the ordering guarantees with BIO requests
from when I wrote the = CAM I/O scheduler. it's kinda long, but spells out what
BIO_O= RDERED means, where it can come from and who depends on it for what.
<= br>
On Fri,= Feb 18, 2022 at 1:36 AM Peter Jeremy <peterj@freebsd.org> wrote:
On 2022-Feb-17 17:48:14 -0800, John-Mark Gurney <= jmg@funkthat.com&= gt; wrote:
>Peter Jeremy wrote this message on Sat, Feb 05, 2022 at 20:50 +1100: >> I've raised https://bugs.free= bsd.org/bugzilla/show_bug.cgi?id=3D261731 to
>> make geom_gate support BIO_ORDERED.=C2=A0 Exposing the BIO_ORDERED= flag to
>> userland is quite easy (once a decision is made as to how to do th= at).
>> Enhancing the geom_gate clients to correctly implement BIO_ORDERED= is
>> somewhat harder.
>
>The clients are single threaded wrt IOs, so I don't think updating = them
>are required.

ggatec(8) and ggated(8) will not reorder I/Os.=C2=A0 I'm not sure about= hast.

>I do have patches to improve things by making ggated multithreaded to >improve IOPs, and so making this improvement would allow those patches<= br> >to be useful.

Likewise, I found ggatec and ggated to be too slow for my purposes and
so I've implemented my own variant (not network API compatible) that can/does reorder requests.=C2=A0 That was when I noticed that BIO_ORDERED wasn't implemented.

>I do have a question though, what is the exact semantics of _ORDERED?
I can't authoritatively answer this, sorry.

This is under documented. Clients, in general, are expected to cop= e with
I/O that completes in an arbitrary order. They are expecte= d to not schedule
new I/O that depends on old I/O completing for = whatever reason (usually
on-media consistency). BIO_ORDERED is us= ed to create a full barrier
in the stream of I/Os. The comments i= n the code say vaguely:

/*
=C2=A0* This bio mus= t be executed after all previous bios in the queue have been
=C2=A0* exe= cuted, and before any successive bios can be executed.
=C2=A0*/

Drivers implement this as a partitioning of requests. = All requests before
it are completed, then the BIO_ORDERED operat= ion is done, then requests
after it are scheduled with the device= .

BIO_FLUSH I think is the only remaining operatio= n that's done as BIO_ORDERED
directly. xen.../blkback.c, geom= _io.c and ffs_softdep.c are the only ones that set it
and all on = BIO_FLUSH operations. bio/buf clients depend on this to ensure metadata
on the drive is in a consistent state after it's been updated.

xen/.../blkback.c also sets it for all=C2=A0BLKIF_O= P_WRITE_BARRIER operations (so
write barriers).

In the upper layers, we have struct buf instead of struct bio to de= scribe future I/Os
that the buffer cache may need to do. Ther= e's a flag B_BARRIER that gets turned
into BIO_ORDERED in geo= m_vfs. B_BARRIER is set in only two places (and copied
in one oth= er) in vfs_bio.c.=C2=A0babarrierwrite and=C2=A0bbarrierwrite for async vs s= ync writes
respectively.

CAM will set BI= O_ORDERED for all BIO_ZONE commands for reasons that are
at best = unclear to me, but which won't matter for this discussion.
ffs_alloc.c (so UFS again) is the only place that uses=C2=A0ba= barrierwrite. It is used
to ensure that all inode initializations= are completed before the cylinder group
bitmap is written out. T= his is done with newfs, when new cylinder groups are
created with= growfs, and apparently in a few other cases where additional inodes
<= div>are created in newly-created UFS2 filesystems. This can be disabled wit= h
vfs.ffs.doasyncinodeinit=3D0 when barrier writes aren't wor= king as advertised,
but there's a big performance hit from do= ing so until all the inodes for the
filesystem have been lazily p= opulated.

No place uses bbarrierwrite that I can f= ind.

Based on all of that, the CAM's dynamic I= /O scheduler will reorder reads
around a BIO_ORDERED operation, b= ut not writes, trims or flushes. Since,
in general, operations ha= ppen in an arbitrary order, scheduling both a read
and a write at= the same time for the same block will result in undefined
result= s.

Different drivers handle this differently. CAM = will honor the BIO_ORDERED
tag by scheduling the I/O with an orde= ring tag so that the SCSI hardware will
properly order the result= . The simpler ATA version will use a non NCQ request
to force the= proper ordering (since to send a non-NCQ request, you have to
dr= ain the queue, do that one command, and then start up again). nvd will just= throw
the I/O at the device, until it encounters a BIO_ORDERED r= equest. Then it will queue
everything until all the current reque= sts complete, then do the ordered request, then
do the rest of th= e queued I/O as if it had just showed up.

Most dri= vers use bioq_disksort(), which will queue the request to the end of the bi= oq
and mark things so all I/Os after that are in their new 'e= levator car' for its elevator sort
algorithm. This means that= CAM's normal ways of dequeuing the request will preserve
ord= ering through the periph driver's start routine (where the dynamic sche= dule will honor
it for writes, but not reads, but the default sch= eduler will honor it for both).
=C2=A0
>And right now, the ggate protocol (from what I remember) doesn't ha= ve
>a way to know when the remote kernel has received notification that an<= br> >IO is complete.

A G_GATE_CMD_START write request will be sent to the remote system and
issued as a pwrite(2) then an acknowledgement packet will be returned
and passed back to the local kernel via G_GATE_CMD_DONE.=C2=A0 There's = no
support for BIO_FLUSH or BIO_ORDERED so there's no way for the local kernel to know when the write has been written to non-volatile store.

That's unfortunate. UFS can work around = the BIO_ORDERED problem with
a simple setting, but not the BIO_FL= USH problem.
=C2=A0
>> I've done some experiments and OpenZFS doesn't generate BI= O_ORDERED
>> operations so I've also raised https://githu= b.com/openzfs/zfs/issues/13065
>> I haven't looked into how difficult that would be to fix.

Unrelated to the above but for completeness:=C2=A0 OpenZFS avoids the need<= br> for BIO_ORDERED by not issuing additional I/Os until previous I/Os have
been retired when ordering is important.=C2=A0 (It does rely on BIO_FLUSH).=

To be clear: OpenZFS won't schedul= e new I/Os until the BIO_FLUSH it sends
down w/o the BIO_ORDERED = flag completes, right? The parenthetical confuses
me on how to pa= rse it: BIO_FLUSH is needed and ZFS depends on it completing
with= all blocks flushed to stable media, or ZFS depends on BIO_FLUSH being
strongly ordered relative to other commands. I think you mean the for= mer, but want
to make sure.

The root of = this problem, I think, is the following:
=C2=A0 =C2=A0 =C2=A0% ma= n 9 bio
=C2=A0 =C2=A0 =C2=A0No manual entry for bio
I think I'll have to massage this email into an appropria= te man page.

At the very least, I should turn some/all of the above into a bl= og post :)

Warner
=
--000000000000fb45dd05d84d69e2-- From nobody Fri Feb 18 17:47:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 33A8E19DC53B; Fri, 18 Feb 2022 17:47:47 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-oi1-x233.google.com (mail-oi1-x233.google.com [IPv6:2607:f8b0:4864:20::233]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0fKt1ym9z4X2J; Fri, 18 Feb 2022 17:47:46 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: by mail-oi1-x233.google.com with SMTP id s5so3848858oic.10; Fri, 18 Feb 2022 09:47:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=aMMNte5dp/rubOBojl/NpXpgI3B4maGBWDs8nly+WfA=; b=a8MnR0pun4DAkt2qClo585vAto0LkZZqYbCsJtI/k5+gvMnHlT9gqK5Emyhv13cjp6 CeHkwtj5PddyzINsRz+cLnrcUdi9yx37INDdtuo+V+CHPlpc9yK/yfUMo3mKkDMSq9w2 GR3KHlgBGpEDJ5YcYxmILkZWeU+QK4ByWU82d/9j3gO6nJAUqFKFBDw3K3wwEXEnkzpp i6dFMX9RO/oDNnGi2OQqEtZn5qs8b92o3g/Tt59IVb60uWxefDbAjirE4Oy2kHj/UPyK yHi3y6BRP5BVBmOGRepThE14Tmbse4Drp+eyumPg8dO8DdTovy8BiCz7+40HmAs/PVSi e9EQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=aMMNte5dp/rubOBojl/NpXpgI3B4maGBWDs8nly+WfA=; b=ZshZb7fCxpSrsXa7GZY7ClzeuSEQbdqWTMk9ATi7xTBs524jMLSTf6pAfieSnMEtgU vP0lNzZ9xQVMFFq30lBCVHM15Xkj2JwsiPfN0whp3ViCmyKcq+CULtgM2HTDeg6JWt+n FhV73Fsxc4WZwLp326enEdFsd+6OCtTSxguNeKd3eQSY13nJgKg1+/E9E/osTmW/rhhJ j+9x7LYwLX8DL6BSQX6mGgKO2y3t8R5caJ+V/MXV7ksX+Cf5EQ7GroVwWzE3HMOwqA44 x4R4Ic9rT4KtNl3I8pi0Axb1GDvC0q25KpWikrsPPTXxb0Z/cZINxDpw/k2jsrqVGxR1 qYfA== X-Gm-Message-State: AOAM53029PubdR41h9eNsmiLg4jAcdzboysy+1Nq73nJ9HLtOP4EldiI dJMo+q2lNf5UF0dm9qiyzR/T4Hlkr41w1UiBnPA= X-Google-Smtp-Source: ABdhPJyEaJZ5FbxBzWGO1Oteg7bVXQw24Gq58j10FTTnz9dpTup8Z2hScAlETY5b//lTfrJc2BZls4ElqSnLgb2pTvg= X-Received: by 2002:a05:6808:14c6:b0:2cc:ceca:922a with SMTP id f6-20020a05680814c600b002ccceca922amr3915373oiw.12.1645206465498; Fri, 18 Feb 2022 09:47:45 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> <20220218014814.GJ97875@funkthat.com> In-Reply-To: From: Mehmet Erol Sanliturk Date: Fri, 18 Feb 2022 20:47:09 +0300 Message-ID: Subject: Re: bio re-ordering To: Warner Losh Cc: Peter Jeremy , FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="000000000000f5514505d84e7a95" X-Rspamd-Queue-Id: 4K0fKt1ym9z4X2J X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=a8MnR0pu; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mesanliturk@gmail.com designates 2607:f8b0:4864:20::233 as permitted sender) smtp.mailfrom=mesanliturk@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::233:from]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-geom]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000f5514505d84e7a95 Content-Type: text/plain; charset="UTF-8" On Fri, Feb 18, 2022 at 7:31 PM Warner Losh wrote: > So I spent some time looking at what BIO_ORDERED means in today's kernel > and flavored it with my indoctrination of the ordering guarantees with BIO > requests > from when I wrote the CAM I/O scheduler. it's kinda long, but spells out > what > BIO_ORDERED means, where it can come from and who depends on it for what. > > On Fri, Feb 18, 2022 at 1:36 AM Peter Jeremy wrote: > >> On 2022-Feb-17 17:48:14 -0800, John-Mark Gurney wrote: >> >Peter Jeremy wrote this message on Sat, Feb 05, 2022 at 20:50 +1100: >> >> I've raised https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=261731 >> to >> >> make geom_gate support BIO_ORDERED. Exposing the BIO_ORDERED flag to >> >> userland is quite easy (once a decision is made as to how to do that). >> >> Enhancing the geom_gate clients to correctly implement BIO_ORDERED is >> >> somewhat harder. >> > >> >The clients are single threaded wrt IOs, so I don't think updating them >> >are required. >> >> ggatec(8) and ggated(8) will not reorder I/Os. I'm not sure about hast. >> >> >I do have patches to improve things by making ggated multithreaded to >> >improve IOPs, and so making this improvement would allow those patches >> >to be useful. >> >> Likewise, I found ggatec and ggated to be too slow for my purposes and >> so I've implemented my own variant (not network API compatible) that >> can/does reorder requests. That was when I noticed that BIO_ORDERED >> wasn't implemented. >> >> >I do have a question though, what is the exact semantics of _ORDERED? >> >> I can't authoritatively answer this, sorry. >> > > This is under documented. Clients, in general, are expected to cope with > I/O that completes in an arbitrary order. They are expected to not schedule > new I/O that depends on old I/O completing for whatever reason (usually > on-media consistency). BIO_ORDERED is used to create a full barrier > in the stream of I/Os. The comments in the code say vaguely: > > /* > * This bio must be executed after all previous bios in the queue have been > * executed, and before any successive bios can be executed. > */ > > Drivers implement this as a partitioning of requests. All requests before > it are completed, then the BIO_ORDERED operation is done, then requests > after it are scheduled with the device. > > BIO_FLUSH I think is the only remaining operation that's done as > BIO_ORDERED > directly. xen.../blkback.c, geom_io.c and ffs_softdep.c are the only ones > that set it > and all on BIO_FLUSH operations. bio/buf clients depend on this to ensure > metadata > on the drive is in a consistent state after it's been updated. > > xen/.../blkback.c also sets it for all BLKIF_OP_WRITE_BARRIER operations > (so > write barriers). > > In the upper layers, we have struct buf instead of struct bio to describe > future I/Os > that the buffer cache may need to do. There's a flag B_BARRIER that gets > turned > into BIO_ORDERED in geom_vfs. B_BARRIER is set in only two places (and > copied > in one other) in vfs_bio.c. babarrierwrite and bbarrierwrite for async vs > sync writes > respectively. > > CAM will set BIO_ORDERED for all BIO_ZONE commands for reasons that are > at best unclear to me, but which won't matter for this discussion. > > ffs_alloc.c (so UFS again) is the only place that uses babarrierwrite. It > is used > to ensure that all inode initializations are completed before the cylinder > group > bitmap is written out. This is done with newfs, when new cylinder groups > are > created with growfs, and apparently in a few other cases where additional > inodes > are created in newly-created UFS2 filesystems. This can be disabled with > vfs.ffs.doasyncinodeinit=0 when barrier writes aren't working as > advertised, > but there's a big performance hit from doing so until all the inodes for > the > filesystem have been lazily populated. > > No place uses bbarrierwrite that I can find. > > Based on all of that, the CAM's dynamic I/O scheduler will reorder reads > around a BIO_ORDERED operation, but not writes, trims or flushes. Since, > in general, operations happen in an arbitrary order, scheduling both a read > and a write at the same time for the same block will result in undefined > results. > > Different drivers handle this differently. CAM will honor the BIO_ORDERED > tag by scheduling the I/O with an ordering tag so that the SCSI hardware > will > properly order the result. The simpler ATA version will use a non NCQ > request > to force the proper ordering (since to send a non-NCQ request, you have to > drain the queue, do that one command, and then start up again). nvd will > just throw > the I/O at the device, until it encounters a BIO_ORDERED request. Then it > will queue > everything until all the current requests complete, then do the ordered > request, then > do the rest of the queued I/O as if it had just showed up. > > Most drivers use bioq_disksort(), which will queue the request to the end > of the bioq > and mark things so all I/Os after that are in their new 'elevator car' for > its elevator sort > algorithm. This means that CAM's normal ways of dequeuing the request will > preserve > ordering through the periph driver's start routine (where the dynamic > schedule will honor > it for writes, but not reads, but the default scheduler will honor it for > both). > > >> >And right now, the ggate protocol (from what I remember) doesn't have >> >a way to know when the remote kernel has received notification that an >> >IO is complete. >> >> A G_GATE_CMD_START write request will be sent to the remote system and >> issued as a pwrite(2) then an acknowledgement packet will be returned >> and passed back to the local kernel via G_GATE_CMD_DONE. There's no >> support for BIO_FLUSH or BIO_ORDERED so there's no way for the local >> kernel to know when the write has been written to non-volatile store. >> > > That's unfortunate. UFS can work around the BIO_ORDERED problem with > a simple setting, but not the BIO_FLUSH problem. > > >> >> I've done some experiments and OpenZFS doesn't generate BIO_ORDERED >> >> operations so I've also raised >> https://github.com/openzfs/zfs/issues/13065 >> >> I haven't looked into how difficult that would be to fix. >> >> Unrelated to the above but for completeness: OpenZFS avoids the need >> for BIO_ORDERED by not issuing additional I/Os until previous I/Os have >> been retired when ordering is important. (It does rely on BIO_FLUSH). >> > > To be clear: OpenZFS won't schedule new I/Os until the BIO_FLUSH it sends > down w/o the BIO_ORDERED flag completes, right? The parenthetical confuses > me on how to parse it: BIO_FLUSH is needed and ZFS depends on it completing > with all blocks flushed to stable media, or ZFS depends on BIO_FLUSH being > strongly ordered relative to other commands. I think you mean the former, > but want > to make sure. > > The root of this problem, I think, is the following: > % man 9 bio > No manual entry for bio > ---------------------------------------------------------------------- > I think I'll have to massage this email into an appropriate man page. > At the very least, I should turn some/all of the above into a blog post :) > > Warner > ---------------------------------------------------------------------- The above sentence is WONDERFUL ... In my some messages , I am saying that : - Make Handbook parts , man pages a "blog" system , - Attach the related messages to these parts , - Relay comments / questions specified for these pages to mailing lists , - After a while or at suitable times , move "knowledge" ( meaning "what to do" ) in these messages into related parts . My opinion is that my ideas are not very effective . If the above sentence can "converge" to such a structure , it may be really WONDERFUL ... With my best wishes , Mehmet Erol Sanliturk --000000000000f5514505d84e7a95 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Fri, Feb 18, 2022= at 7:31 PM Warner Losh <imp@bsdimp.co= m> wrote:
So I spent some time looking at what BIO_ORDERED mea= ns in today's kernel
and flavored it with my indoctrination o= f the ordering guarantees with BIO requests
from when I wrote the= CAM I/O scheduler. it's kinda long, but spells out what
BIO_= ORDERED means, where it can come from and who depends on it for what.
=
On Fri= , Feb 18, 2022 at 1:36 AM Peter Jeremy <peterj@freebsd.org> wrote:
On 2022-Feb-17 17:48:14 -0800, Jo= hn-Mark Gurney <jm= g@funkthat.com> wrote:
>Peter Jeremy wrote this message on Sat, Feb 05, 2022 at 20:50 +1100: >> I've raised https://bugs.free= bsd.org/bugzilla/show_bug.cgi?id=3D261731 to
>> make geom_gate support BIO_ORDERED.=C2=A0 Exposing the BIO_ORDERED= flag to
>> userland is quite easy (once a decision is made as to how to do th= at).
>> Enhancing the geom_gate clients to correctly implement BIO_ORDERED= is
>> somewhat harder.
>
>The clients are single threaded wrt IOs, so I don't think updating = them
>are required.

ggatec(8) and ggated(8) will not reorder I/Os.=C2=A0 I'm not sure about= hast.

>I do have patches to improve things by making ggated multithreaded to >improve IOPs, and so making this improvement would allow those patches<= br> >to be useful.

Likewise, I found ggatec and ggated to be too slow for my purposes and
so I've implemented my own variant (not network API compatible) that can/does reorder requests.=C2=A0 That was when I noticed that BIO_ORDERED wasn't implemented.

>I do have a question though, what is the exact semantics of _ORDERED?
I can't authoritatively answer this, sorry.

This is under documented. Clients, in general, are expected to cop= e with
I/O that completes in an arbitrary order. They are expecte= d to not schedule
new I/O that depends on old I/O completing for = whatever reason (usually
on-media consistency). BIO_ORDERED is us= ed to create a full barrier
in the stream of I/Os. The comments i= n the code say vaguely:

/*
=C2=A0* This bio mus= t be executed after all previous bios in the queue have been
=C2=A0* exe= cuted, and before any successive bios can be executed.
=C2=A0*/

Drivers implement this as a partitioning of requests. = All requests before
it are completed, then the BIO_ORDERED operat= ion is done, then requests
after it are scheduled with the device= .

BIO_FLUSH I think is the only remaining operatio= n that's done as BIO_ORDERED
directly. xen.../blkback.c, geom= _io.c and ffs_softdep.c are the only ones that set it
and all on = BIO_FLUSH operations. bio/buf clients depend on this to ensure metadata
on the drive is in a consistent state after it's been updated.

xen/.../blkback.c also sets it for all=C2=A0BLKIF_O= P_WRITE_BARRIER operations (so
write barriers).

In the upper layers, we have struct buf instead of struct bio to de= scribe future I/Os
that the buffer cache may need to do. Ther= e's a flag B_BARRIER that gets turned
into BIO_ORDERED in geo= m_vfs. B_BARRIER is set in only two places (and copied
in one oth= er) in vfs_bio.c.=C2=A0babarrierwrite and=C2=A0bbarrierwrite for async vs s= ync writes
respectively.

CAM will set BI= O_ORDERED for all BIO_ZONE commands for reasons that are
at best = unclear to me, but which won't matter for this discussion.
ffs_alloc.c (so UFS again) is the only place that uses=C2=A0ba= barrierwrite. It is used
to ensure that all inode initializations= are completed before the cylinder group
bitmap is written out. T= his is done with newfs, when new cylinder groups are
created with= growfs, and apparently in a few other cases where additional inodes
<= div>are created in newly-created UFS2 filesystems. This can be disabled wit= h
vfs.ffs.doasyncinodeinit=3D0 when barrier writes aren't wor= king as advertised,
but there's a big performance hit from do= ing so until all the inodes for the
filesystem have been lazily p= opulated.

No place uses bbarrierwrite that I can f= ind.

Based on all of that, the CAM's dynamic I= /O scheduler will reorder reads
around a BIO_ORDERED operation, b= ut not writes, trims or flushes. Since,
in general, operations ha= ppen in an arbitrary order, scheduling both a read
and a write at= the same time for the same block will result in undefined
result= s.

Different drivers handle this differently. CAM = will honor the BIO_ORDERED
tag by scheduling the I/O with an orde= ring tag so that the SCSI hardware will
properly order the result= . The simpler ATA version will use a non NCQ request
to force the= proper ordering (since to send a non-NCQ request, you have to
dr= ain the queue, do that one command, and then start up again). nvd will just= throw
the I/O at the device, until it encounters a BIO_ORDERED r= equest. Then it will queue
everything until all the current reque= sts complete, then do the ordered request, then
do the rest of th= e queued I/O as if it had just showed up.

Most dri= vers use bioq_disksort(), which will queue the request to the end of the bi= oq
and mark things so all I/Os after that are in their new 'e= levator car' for its elevator sort
algorithm. This means that= CAM's normal ways of dequeuing the request will preserve
ord= ering through the periph driver's start routine (where the dynamic sche= dule will honor
it for writes, but not reads, but the default sch= eduler will honor it for both).
=C2=A0
>And right now, the ggate protocol (from what I remember) doesn't ha= ve
>a way to know when the remote kernel has received notification that an<= br> >IO is complete.

A G_GATE_CMD_START write request will be sent to the remote system and
issued as a pwrite(2) then an acknowledgement packet will be returned
and passed back to the local kernel via G_GATE_CMD_DONE.=C2=A0 There's = no
support for BIO_FLUSH or BIO_ORDERED so there's no way for the local kernel to know when the write has been written to non-volatile store.

That's unfortunate. UFS can work around = the BIO_ORDERED problem with
a simple setting, but not the BIO_FL= USH problem.
=C2=A0
>> I've done some experiments and OpenZFS doesn't generate BI= O_ORDERED
>> operations so I've also raised https://githu= b.com/openzfs/zfs/issues/13065
>> I haven't looked into how difficult that would be to fix.

Unrelated to the above but for completeness:=C2=A0 OpenZFS avoids the need<= br> for BIO_ORDERED by not issuing additional I/Os until previous I/Os have
been retired when ordering is important.=C2=A0 (It does rely on BIO_FLUSH).=

To be clear: OpenZFS won't schedul= e new I/Os until the BIO_FLUSH it sends
down w/o the BIO_ORDERED = flag completes, right? The parenthetical confuses
me on how to pa= rse it: BIO_FLUSH is needed and ZFS depends on it completing
with= all blocks flushed to stable media, or ZFS depends on BIO_FLUSH being
strongly ordered relative to other commands. I think you mean the for= mer, but want
to make sure.

The root of = this problem, I think, is the following:
=C2=A0 =C2=A0 =C2=A0% ma= n 9 bio
=C2=A0 =C2=A0 =C2=A0No manual entry for bio



--------------------------------------------------------= --------------
=C2=A0
I think= I'll have to massage this email into an appropriate man page.
At the very least, I shou= ld turn some/all of the above into a blog post :)

Warner


------------------------------------= ----------------------------------

=C2=A0
The above sentence is WONDERFUL ...

In my some messages , I am saying that :


- Make Handbook parts , man pages a=C2=A0 "blo= g" system ,
- Attach the related messages to these part= s ,
- Relay comments / questions specified for these pages t= o mailing lists ,
- After a while or at suitable times , mov= e "knowledge" ( meaning "what to do" ) in these
=C2=A0 messages into related parts .

My opinion is that my ideas are not very effective .
=

If the above sentence can=C2=A0 &qu= ot;converge" to such a structure , it may be really WONDERFUL ...


With my best wishes ,

Mehmet Erol Sanliturk

<= /div>




=


--000000000000f5514505d84e7a95-- From nobody Fri Feb 18 21:01:19 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ADA5519D53B9 for ; Fri, 18 Feb 2022 21:01:31 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vs1-xe30.google.com (mail-vs1-xe30.google.com [IPv6:2607:f8b0:4864:20::e30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0kdQ6wWlz4vQG for ; Fri, 18 Feb 2022 21:01:30 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vs1-xe30.google.com with SMTP id g20so11309306vsb.9 for ; Fri, 18 Feb 2022 13:01:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vqR01Ykca/SUcYxQD4qlCjHkhcQ9Ld5sT2fppns3mOU=; b=crB9liATf0Cj2tvnAMlQWwpu5lqBD/xslHe3a/0sAtiXCPb2TE9JaznC7Zy0u1R7KA 4tbkTo36bSk/2bBX0TA2mOfX2cT7qA93J0Ralg29pulmKhOxqPjv9je73qPSkVvHPnS9 0CgyDphTxoyK8Q5bkqK9QjJ70QuXQE2IeSSXHN62SbNEiuu3PGNJWnitcsqRQFMv4hZq iehHjfqPKlV8kE17vLCqya0ojsEqQ+Rq+ywaPHjUMljttf1cVMFKun/HYY0sUrsSf1KF 7YFcZzY0HfQ2FlMxrHUB9Ul6PT1t+snz15AbXSRGY9qP7GzWz0mFcDFw6HAdfyj0OX6i Zf0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vqR01Ykca/SUcYxQD4qlCjHkhcQ9Ld5sT2fppns3mOU=; b=cOJA7mM3xprXcirlYaWdIVFDzTLnQXAmixOGrIyvq9yP0msuG8EeJbYkc3Q7Sp29iZ LM3TXNy+XABVpPJabCmc5EYxeSwFkGVXqkGXBPGCHeZJFV0aHl61V9kB8Kaga5YfxPsp /edIRvb5OInscCFfgCGyLxAkfcpqUd9wX83Y0hMWtpJXLid63G4z3s6pc+9D2cSlVEZg dYJPb3xGztnua+OMH2+sw9GSHAaJTz+hNYBDGdRkAXgDP6E59juVDif9lEnW8BgQrVle QHXQnosnOXZ2JnLNEbGJRuMiHNhluD9N2XToVaHGJkmxueCqf1Cb/IRwaWxJSe2iUKtv gxlw== X-Gm-Message-State: AOAM530xum2Q11Ix/OAn3wccOe/zSYb1fwKqRTijM8x0A2ExiA3aCd8G +PMD6QShzX1dNTcrwNBPa33mY9/CdAsBWIjc5LMzpA== X-Google-Smtp-Source: ABdhPJxPTjdj1VaY2DB/QpO+chw7L4/gV6pAY5yR6yc6GHasdmuxCfSKiVByIi2u3sIneoKeCkn3hnjpV/Y56a3q8bE= X-Received: by 2002:a05:6102:3e8e:b0:31b:aaec:cece with SMTP id m14-20020a0561023e8e00b0031baaeccecemr4196055vsv.42.1645218090308; Fri, 18 Feb 2022 13:01:30 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <9848cde6-5c12-cdd4-e722-42fe26fa0349@FreeBSD.org> <20220218014814.GJ97875@funkthat.com> <202202182057.21IKvEEI079058@critter.freebsd.dk> In-Reply-To: <202202182057.21IKvEEI079058@critter.freebsd.dk> From: Warner Losh Date: Fri, 18 Feb 2022 14:01:19 -0700 Message-ID: Subject: Re: bio re-ordering To: Poul-Henning Kamp Cc: Peter Jeremy , FreeBSD FS , "freebsd-geom@FreeBSD.org" Content-Type: multipart/alternative; boundary="000000000000d9eaa805d8512fc7" X-Rspamd-Queue-Id: 4K0kdQ6wWlz4vQG X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=crB9liAT; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::e30) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.52 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.52)[-0.520]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e30:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com] X-ThisMailContainsUnwantedMimeParts: N --000000000000d9eaa805d8512fc7 Content-Type: text/plain; charset="UTF-8" On Fri, Feb 18, 2022 at 1:57 PM Poul-Henning Kamp wrote: > -------- > Warner Losh writes: > > > The root of this problem, I think, is the following: > > % man 9 bio > > No manual entry for bio > > I think I'll have to massage this email into an appropriate man page. > > Please do, and charge the necessary beer to my account :-) > Now that's a dangerous thing to promise... Warner --000000000000d9eaa805d8512fc7 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
--000000000000d9eaa805d8512fc7-- From nobody Fri Feb 18 21:06:39 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 261CB19D6709 for ; Fri, 18 Feb 2022 21:07:00 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp1.via.net (smtp1.via.net [157.22.3.5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0kll10l2z3BxQ for ; Fri, 18 Feb 2022 21:06:59 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp1.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 21IL6pc1012837 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL) for ; Fri, 18 Feb 2022 13:06:51 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at smtp1.via.net Received: from smtpclient.apple ([209.81.2.60]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 21IL6nD4017818 for ; Fri, 18 Feb 2022 13:06:51 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at mail.via.net From: joe mcguckin Content-Type: multipart/alternative; boundary="Apple-Mail=_BD9D91BB-61AF-4F71-9289-9CDF5EAAE486" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: ZFS disk question Message-Id: <09DE987A-229B-4906-A79A-E75AFE5199E9@via.net> Date: Fri, 18 Feb 2022 13:06:39 -0800 To: freebsd-fs X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp1.via.net [157.22.3.5]); Fri, 18 Feb 2022 13:06:51 -0800 (PST) X-Rspamd-Queue-Id: 4K0kll10l2z3BxQ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of joe@via.net designates 157.22.3.5 as permitted sender) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-2.88 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[joe]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[via.net]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.977]; R_SPF_ALLOW(-0.20)[+MX]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[157.22.3.5:from] X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_BD9D91BB-61AF-4F71-9289-9CDF5EAAE486 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Looking around for drives, the most common are the 512e drives. Can = these drives (Specifically the Toshiba and Seagate Exos) drives operate = in 4Kn mode also? I notice the manufacturers offer a seperate p/n for = 512e mode and 4Kn mode drives. Do they need to be reformatted? Thanks, Joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax --Apple-Mail=_BD9D91BB-61AF-4F71-9289-9CDF5EAAE486 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Looking around for drives, the most common are the 512e = drives. Can these drives (Specifically the Toshiba and Seagate Exos) = drives operate in 4Kn mode also? I notice the manufacturers offer a = seperate p/n for 512e mode and 4Kn mode drives. Do they need to be = reformatted?

Thanks,

Joe


Joe = McGuckin
ViaNet Communications

joe@via.net
650-207-0372 cell
650-213-1302 = office
650-969-2124 fax



= --Apple-Mail=_BD9D91BB-61AF-4F71-9289-9CDF5EAAE486-- From nobody Fri Feb 18 21:21:43 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5B67119D927B for ; Fri, 18 Feb 2022 21:22:02 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f173.google.com (mail-oi1-f173.google.com [209.85.167.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K0l553x1tz3F9x for ; Fri, 18 Feb 2022 21:22:01 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f173.google.com with SMTP id j2so4463724oie.7 for ; Fri, 18 Feb 2022 13:22:01 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=NPxDnXFwWNZmkMLynVbXZaFFdeNReBydCHSTGkKfKgg=; b=vhIJl5fknNhaMyZkZVZU5GPBrgyPIzZ3tuMhe+CwdAVoxrDQR+aVD5P1QYsP3hhUBG 9szm1COD2qp45L+G4mLSSazM6CnuElF7uqAHQc5YLnkx4hQOhofgazhF6YZS+AjpYhme nMFfTGT4K7zebd5eSt4QN25N/9H96+PASxOsCXYxQsAJIfkZ47qhq0wkP6fJR7qUp0Wu 9I1BEqZOGkF3RRY61pLvfOwae4L1tUtLCR94arNd8c/jmuAu2XfpqNjsWTrgDbMLN7kW 7tb5H87n8EIGiaZLMh/9I47NZvDQn8YKQllZUMwqay/nmqY2+PqvccWHKj8z+CpsYjHT vPlA== X-Gm-Message-State: AOAM530XyN7p5JihCraSgTzwTBsR2oyAiCFv0QwVsuIWPE0BfZR96kn7 ZGfFTjjuSMbt8pWjJnlJj1o4O8uUBJAmo1uKaQ0= X-Google-Smtp-Source: ABdhPJxhBZs1U/9YCJOvhudbu6pHTK5FzIW/VL7q4NhTyQfenNL2De3RYQdgPeFCDSN641fUd4NLbrpHd5sol2jp6dM= X-Received: by 2002:a05:6808:687:b0:2d3:a8e8:e494 with SMTP id k7-20020a056808068700b002d3a8e8e494mr5972744oig.235.1645219314799; Fri, 18 Feb 2022 13:21:54 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <09DE987A-229B-4906-A79A-E75AFE5199E9@via.net> In-Reply-To: <09DE987A-229B-4906-A79A-E75AFE5199E9@via.net> From: Alan Somers Date: Fri, 18 Feb 2022 14:21:43 -0700 Message-ID: Subject: Re: ZFS disk question To: joe mcguckin Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4K0l553x1tz3F9x X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.173 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.98 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.980]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.173:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.173:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N You can't switch them to 4kn, but you don't need to. ZFS works just fine with 512e disks. It will always respect the 4k physical sectors. On Fri, Feb 18, 2022 at 2:07 PM joe mcguckin wrote: > > Looking around for drives, the most common are the 512e drives. Can these= drives (Specifically the Toshiba and Seagate Exos) drives operate in 4Kn m= ode also? I notice the manufacturers offer a seperate p/n for 512e mode and= 4Kn mode drives. Do they need to be reformatted? > > Thanks, > > Joe > > > Joe McGuckin > ViaNet Communications > > joe@via.net > 650-207-0372 cell > 650-213-1302 office > 650-969-2124 fax > > > From nobody Sun Feb 20 09:01:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2244319D90DD for ; Sun, 20 Feb 2022 09:01:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K1fYl6qCwz3wBC for ; Sun, 20 Feb 2022 09:01:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CAF98198E1 for ; Sun, 20 Feb 2022 09:01:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21K91VYP076470 for ; Sun, 20 Feb 2022 09:01:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21K91Vio076469 for fs@FreeBSD.org; Sun, 20 Feb 2022 09:01:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTY3MTJdIFVGUzoga2VybmVsIHBhbmljOiBmZnNfYmxr?= =?UTF-8?B?ZnJlZV9jZzogZnJlZWluZyBmcmVlIGZyYWcg4oCTIGluIHJlc3BvbnNlIHRv?= =?UTF-8?B?IHBrZy1kZWxldGUoOCkgc29vbiBhZnRlciBsb2dpbg==?= Date: Sun, 20 Feb 2022 09:01:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Unable to Reproduce X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645347692; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wGC4/q1YbNsreh5+pqi+gHTy3FKqCxjbmimvSrFy1UY=; b=uUVJsfR3gv/o+n3vnEVQQEJ76nXhgACnNmtdlSy3C9h7tNixdpF0pCYBExEbMseNCzwxOC 88CafLq0uTHAEonIa+XV8Nku/0fh0aeBXonxAGmM6ZlmrGiFip0W0zxXsGFWqFJvvYiFRk oixI3qMdMGL2mibiJHmsx72MrWCUWw/8kPC+dHJP6ijBLpmxX8AfG2v6QVadwWV3ppOHuP zXhFM6ELG5r2/aDhaQrblqAfmJ+YUly6pHzIfD/EbWBMFzUmLGjnNhxc84H0bRVRieYFHB tnbQkaGix0qDDDuaGR1SWHMpNI7f1QD8b10TFnDq3kJgzOy6EcSbwIv6TKQcZg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645347692; a=rsa-sha256; cv=none; b=ADU2k6m1GzNHhDHISEbEvUSowlkl8tv8NFqr3iEg/piF4bvIWd4JApVL9Un502st7A13oQ lYxiOhxHcwAs//KAW3FkpBnkOcSZO1BjKafUiwVdJf8CtVOaBAZanC4OJMU/CD39GBJZC1 QPnCOK2gDXO2oKb8gzBUqxSqSsDXdtG9msbY6WIPUKCHfRAAFvjptYi2Po0Fd7RPv1Lm9a V/xR55qnZpCWgVTnF8Dw0Gmv3pXOVhFnTBX1AOPW2QPO1LbNEddHHVhHvp/c//64t3p2OF svumqxIsb3OKq5aGuwg+J0ptyRXxh+xZpX2yHQ1TzemB9QKtNOKNfV/1awdo7Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256712 --- Comment #25 from Graham Perrin --- (In reply to Kirk McKusick from comment #24) Thanks, and if you were awaiting information from me: sorry, I wasn't aware= .=20 The computer that I most often used for tests of this type was written off a few months ago. If an alternative computer becomes available, I might set a= side some time for this. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Feb 20 21:00:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 37C8F19C9B92 for ; Sun, 20 Feb 2022 21:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K1yWG6jCKz3Kyt for ; Sun, 20 Feb 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1D4CD23340 for ; Sun, 20 Feb 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21KL0QEL066109 for ; Sun, 20 Feb 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21KL0QAE066107 for fs@FreeBSD.org; Sun, 20 Feb 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202202202100.21KL0QAE066107@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 20 Feb 2022 21:00:26 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16453908260.fd4a16.64779" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645390827; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=bO+ede3KFxLqLtmoGRTBDGNn2dC14GUMHp6TnYm2Dcc=; b=jlkHAyK1sEoNhQxVCx8tbwbq22oem6ELK382GBj7QaGU2xr43odT/fD8/AWbl86VM30huu m6AzmOxXbj5U55zpuTF5fR9Buyn4nTeWisy0z3i6mRTx0ZCMveTgtOfQ3+KzIPqyQwFmF3 9V32sAH4FUWBURkVKiHxbPFvzrFBg4cGqFgc6ID0zS9wEcJ4BtUbCvzxSyDfbHeDAbZasa lFXVR/uiUjZZ8HmUVu2pee0/7eW/3E6Cgly+kP7cPYoEAx1ee1UN1eUj4vRQzwgq7nbUeM FXu2kPGP2jioino1xjZj6Ivt+sGJR8gF7vz3ccsvi1WjWpOWEe/N7D9thg+ctQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645390827; a=rsa-sha256; cv=none; b=Dwe5ILU0YMb/GAA86aE7sDOKZzigLnT0dTeVFpFDxteaYIcR5+XOWkBa9bAJhaCUc+vnio PrWk3DIJVxaQn+C/gZdCkOfRa3mPmCXAx4FlCqwjXQbFMy38FRuyueO6FJWnfSTAGQiTTH FTs0s4cSZK0k+aakOE3UL3IyCXBhulOe/27Kq2NT0EFCSiEvi79XA1QmPHmnKeCHUi5+Kb oWGSuOLryVgY78MbtIhN2JcKKzfKTVCgi1aWzQhAqayMMk529F2e88BImzaNcElkhoELav ak11h1FS8GSMARFV1ypZDFag+D0udDVjAnKTkqxxKlrF78Tih+Cyablf2GDf2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16453908260.fd4a16.64779 Date: Sun, 20 Feb 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16453908260.fd4a16.64779 Date: Sun, 20 Feb 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16453908260.fd4a16.64779-- From nobody Mon Feb 21 11:39:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A095419D4142; Mon, 21 Feb 2022 11:39:53 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K2L214Dd0z4sxP; Mon, 21 Feb 2022 11:39:53 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645443593; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=emT4zi6SjSR/IduGa1BCQC1A/iNx5efxMHBwXElIMUc=; b=k8RbIBW70pjD6WMpT5K/pCMagIhEzL6ynhr8tR4oNcR3lXPVC/GgQGNHpqtlhJsXkxiVep bCf7O2ELW2nBkhfDZafrJtp+H2jNXc2dosZ1+wfr0gAtUjsNJUJRexZ6ZqmSZamXs9mFum HXH1vg96r1k2ElCCQG0qmMIAOF0ytcCap+5jePlbNffIRpudFo+Ri8qwedlHnapQ2q8Z3D CLysi2syT18pPlsxd6dV9NClwF7XDBPHRD2A0phUg7d4LtGAUfacTuWTAduaGrOtRtDxQh 0/XtLDx4q3Ym5Jh2pEMSPSeGD+ji+jS5KHPQhKoIWj6NhhfE5DXDHKz7rIoVEg== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id EAAAA3EB6; Mon, 21 Feb 2022 11:39:52 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: Date: Mon, 21 Feb 2022 13:39:51 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.6.0 From: Andriy Gapon Subject: Re: fsck -C -p: NO WRITE ACCESS Content-Language: en-US To: freebsd-stable List , freebsd-fs , "freebsd-geom@FreeBSD.org" References: <346d021f-b737-f41a-883f-e821389c4431@FreeBSD.org> <20220214231758.GD97875@funkthat.com> <5eac56d0-51fb-5e23-0d2a-3c6b6bf163d0@FreeBSD.org> <20220218020821.GK97875@funkthat.com> In-Reply-To: <20220218020821.GK97875@funkthat.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645443593; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=emT4zi6SjSR/IduGa1BCQC1A/iNx5efxMHBwXElIMUc=; b=kOG2ORqNtnqtkNgOuNtzibs9cmEegqvAE69FkDaYil7hPCFTBs5mux1jdOUVROVGEL642h 9ZUtAdx5Dcmkpj+WV/ioe9EGoPFOsX3plaWmb+yg7WAbvywLblVSwfo56jJjh4J+oLp62U 0Y5Y9FQBCnapvSWG5xWMQ4Sj945332EZ+DkILCivg9oQBKHYMG6p5Yn3l4LQ1DH4xJ6R3y 1QAPCIYsCASwh1b9wJFCgR8c9sGNfeu/GfQI7n8eD4NoLiosINLavnM3RUCuA/th+o4F9o PXFJlfktp2Ayt9qylWnMWcpxvpDMKH2oPUy9zN9kpJ5K5CjUdrwkwLk6JrP5jg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645443593; a=rsa-sha256; cv=none; b=deTqSqk8ed2ghK9E6B3RWiE91KB4W6lUvqLksfnQVWvJnWS/qJEmNJcvkH7ApEROJQRdTI RCy2kBHMQwUnbzFzrlJo7MVZBnVWBuHkszKXY8uhQgG0ZSbfL7L/Q9PfgqIP6Olt3tqBrQ Uq1ER+SUmVgHu+APWgEIxI6TI6J8XWwfW9G+ds8waBXpsYoGzDOFJK23vmDQKT7qQRhvh+ eOoFrJvqfrQ597GjpHc+S0SJ7U3S3ldQEerGlUDPcih+pg+LrQ5y2Tt6P7yH3xlTsDBmph d+qp88d98T8GohLMTsWL3Ln8TlJNdJC/eiUrTbhBUXrZKtV8gHlITLpfe+/UHQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 18/02/2022 04:08, John-Mark Gurney wrote: > Andriy Gapon wrote this message on Tue, Feb 15, 2022 at 08:44 +0200: >> On 15/02/2022 01:17, John-Mark Gurney wrote: >>> Andriy Gapon wrote this message on Mon, Feb 07, 2022 at 14:15 +0200: >>>> I've got a problem where fsck behaves differently from my expectations. >>>> The problem happens with a filesystem on a GELI encrypted ZVOL. >>>> The volume has 4K block size and that's the GELI's sector size as well. >>>> FreeBSD is stable/13 from mid January. >>> >>> Did you put a ffs filesystem that was formatted on a 512 byte sector disk >>> onto this geli device? >> >> As far as I can recall, no. I created it with newsfs on the geli device. > > Looks like it's a bug in newfs, as I just reproduced this myself: > fsbtodb int32_t 0x00000003 > > and manually specifying a sector size of 4096 to newfs does not fix the > issue. > > This is the issue: > https://cgit.freebsd.org/src/blame/sbin/newfs/newfs.c#n399 > > It changes the sectorsize back down to 512 from whatever it should > be, which means that the calculation in mkfs.c becomes off. I'd file > a bug report and get someone who knows FFS to look at it. I tried to > change mkfs.c to use realsectorsize isntead, so fsbtodb is set to 0, but > then it break ffsinfo, because it's calculations are likely wrong. Thank you very much for looking into this. I'll try to draw Kirk's attention to this issue (he is also in this thread, but a different sub-thread). >>> fsck calculates the sector size via (/sbin/fsck_ffs/setup.c): >>> dev_bsize = sblock.fs_fsize / fsbtodb(&sblock, 1); >>> >>> and fsbtodb: >>> ../../sys/ufs/ffs/fs.h:#define fsbtodb(fs, b) ((daddr_t)(b) << (fs)->fs_fsbtodb) >>> >>>> fsize 4096 shift 12 mask 0xfffff000 >>>> frag 8 shift 3 fsbtodb 3 >>> >>> fsize / (1 << 3) == 4096 / 8 == 512. >>> >>> so, likely updating fsbtodb to be 0 instead of 3 would fix this. I'm not >>> sure how to do this though, as tunefs and fsdb don't seem to have options >>> to do this, and likely you'll want to update all the superblocks w/ this >>> new value. > -- Andriy Gapon From nobody Mon Feb 21 12:32:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DB95319DD577 for ; Mon, 21 Feb 2022 12:32:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K2MBb57M0z3GWm for ; Mon, 21 Feb 2022 12:32:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 90BAD104D0 for ; Mon, 21 Feb 2022 12:32:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21LCWN7u046754 for ; Mon, 21 Feb 2022 12:32:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21LCWNwE046753 for fs@FreeBSD.org; Mon, 21 Feb 2022 12:32:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Mon, 21 Feb 2022 12:32:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645446743; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KwY+vtPEZiiciFpSa1/jh0H6aBJPhjDNCZ2jf01tmrI=; b=UaHoe3XecZ/Dz+r6jvgIzQi0E81Vmk4HYQZGeYenEucdZiUB3mWKL69V2I9ktXE7PqsC+V JncSfbiPeG3nek7WoEqlpyDN6o8wMisnmJD2wAbsDZYo3wYlkZb8wDFz9Osh0yQJubfPe+ NDGMN1Mq/R/wx3tdnjTVJ6AyjA5h5N169AROyGpT9q8g2vpc2Eu++JeiC6KylDCQvCseL5 ui3oRn2VXj/mqZX4UQWwDeyz93QzYL1xXrpale53W+6UtTMCr9+nG4IctCZdqUuZ5wkAfY lRICWC8ynqU9mS9FUkihjKKthIoXuT6byMkwXDsd/7vwD0/AR73eFFfftbDIVQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645446743; a=rsa-sha256; cv=none; b=JaZYpKoLOhjJJAANX/iATP2FyDQgTmp1mMxz3/LQSPrR15GoEYFGbDnMeHW1MAqnfkBD1g eJE3Hf+r8secQjDDENna+hokRCy/AYPr7e2j3QMTzvV/sNJaGYOgD/iOqUlBIWWIBNkman sGXsyDkiygU9pYXAJrK1QzNSzzzpjxmOZLymIxE1hsjyLhIKWj1kGe7D7/iO5qAvQW3YXK z47mnokzwWPLCUTi3rdqFa2MdTupctAjW6LJUX5vMOa/RCdBQST/w/xtP7V4Cbj36DH6cx 18bjizjgieYALTYuHULSg5+Fe8Xb/W8Oe1N02z/P9mzo3K0p7Afd7ow+pFQrCA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 --- Comment #5 from Andriy Gapon --- (In reply to HONDA Kazuhito from comment #0) Just want to add a detail to the explanation of the problem. 0x9B9AD000 result is actually a signed int, so in decimal it is -1684353024. When that value is compared with hsize * zfs_arc_average_blocksize, the val= ue gets converted to uint64_t because that's the type of the expression on the left side. So, it becomes 0xffffffff9b9ad000. So, the comparison can never be true as the maximum value of hsize * zfs_arc_average_blocksize is 0x8000000000000000 and then it wraps around to zero. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Feb 21 12:38:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9A5C019DE549 for ; Mon, 21 Feb 2022 12:38:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K2MKS3CP3z3HCh for ; Mon, 21 Feb 2022 12:38:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4B211104DA for ; Mon, 21 Feb 2022 12:38:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21LCcKla047737 for ; Mon, 21 Feb 2022 12:38:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21LCcKnB047736 for fs@FreeBSD.org; Mon, 21 Feb 2022 12:38:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Mon, 21 Feb 2022 12:38:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645447100; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4Qh/BFOUISguGDzLoIRqBzrvpWWmavtYCE/oZJEeBIE=; b=aOydW0wplfniYtittmvQM/nynfZjW0LruUxvLu+MsqSqeGYbulUIHkgDsbu6Imgrk8Chl/ Su2L6cMxzErGhvliQKkChQvnAa6C8OZ+2Y54Fg9FT16RpsqmQQP9xgSl2P2qPqqaGZTeuC b6GNlz2fgfuRL8QV/6bZ/6hgydGYiMayImJVM1wfshV7JLqcdB3xvghBvpdT+c0APM/lWD zpo/ob1W9JXtaB7HtWvi6ZqRGRcTySOhaGcJMGXAqNqSmrn9AKiPqtDukbETb2AB3gI+uK zEbuwvp5uHGPTsK7w9mSti2xLoutmSi27DUsjid7PnPuEQTl6bibzPz6nZpaxA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645447100; a=rsa-sha256; cv=none; b=BvLDcRHVbQ3z3H9OKe1eW9TN8kWpPPmt1wSvrHPRk1DVQoxPd7nOiydJf7iqd0ph5JzRqR esTyBgQZ8Z22YVIgnkf60cxan0kjbDBKNg659qMWB8PHrElBRTFx2bvM21lgeYqXOr5kog gLzhOq+cB7mkkdz0kg5tgW4itsMVs7rygg0aMQ2i4I1WFjrDawEcl/op6l9y/5n2xHx7MT 0FRnZV6bC4wbL59lL7OvsMhzTy/DIbWcPvEc8KFFcoEmosWqnjoqbI0tJwrFI1Cj6fXJFd EUGgpNf2r2G0UuyjyPfVkyVkx94T/kO4f4gnLHJVQWf8IHMze1tg9ZlkSDgJlw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |emaste@freebsd.org --- Comment #6 from Andriy Gapon --- I see that this issue got fixed in stable/13 as a "side-effect" of commit b= ase 15177c1aac9f3. Do we want to create an erratum for it? Or should we just wait for 13.1 given that i386 is tier 2, PAE is not used = very often, and 13.1 is planned to be released soon-ish? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Feb 21 16:40:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 69C6719C5489 for ; Mon, 21 Feb 2022 16:40:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K2Shs1f55z4rZ0 for ; Mon, 21 Feb 2022 16:40:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 18E9E13AE3 for ; Mon, 21 Feb 2022 16:40:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21LGeTD6076698 for ; Mon, 21 Feb 2022 16:40:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21LGeTOs076697 for fs@FreeBSD.org; Mon, 21 Feb 2022 16:40:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 249115] The zfs command in the installer fails to log a set command Date: Mon, 21 Feb 2022 16:40:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dclarke@blastwave.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645461629; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AcyzqyCX1t/97BNOa6GngtNnAa439HRJ1J9+ovHDnEU=; b=rbIKkOtKDKtdDcmwSm1UABwgz3ceN8f84nA8o4ppgJSUAp4TBvmNOtEBSGNOwYvvzRvVQb s/uEXj/1971fu1T4K8QBJ9O5qhqZYsC6gvDVnRKEwDZ7daXcQ7W/BUee+weQAJE9k8USTP +bKIS/cNNPseQxoEDrjVFVemGByhdPPmNizad3ruI8wNG7DC3iVfCAxJZWNpfu4QBh2TSh uRXnl2xCMsE1J0n5qpBISCMeXJF6wSrfY5qeFhkv6Ef1xw1JdDbbGViB84CF6fGWY8VaKt SW62xIoZdqxzjoxSHiqQtsyUVILjNa0dsyp99f1j5OHrnXCUQr3CGVReEMdx4Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645461629; a=rsa-sha256; cv=none; b=EQTeVrx+5p9i4tsb3seKpdrbk/kdsMpSX4Hqze0nlxRiXpb/oTDG0rqbgff1tQFOcgcYE5 BIguyWo00nQvaNXwGVz4rTD5omIJZOewOUqdOhElMwQaiupGSDIGlLHIkggQaERJE/y0g7 mAvDIAoRS0Ou3iByKm9yVX4BmjsbEBkRgAexX+FwqmAiBqhh7LNLIVFGIigH9am3EOSh1D GfFkAkkiBh5AwsA4f+oAmK7Pm8LPJSr+RD0MEInIDjdhq8t86MaFY3B76Z0eXv8PHR+R2p 0L9xtnmrqeBGVwi/6fysHalYN/qf0lgr2PpkKheijAL1WXXad1qYMvRzVxj+bQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249115 --- Comment #6 from Dennis Clarke --- I did a test with 13 RELEASE installer iso images and the error still persists but it seems to only happen during installation. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Feb 21 18:25:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2EE7819D8F40 for ; Mon, 21 Feb 2022 18:25:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K2W2Y6hfVz3MGb for ; Mon, 21 Feb 2022 18:25:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C40DD1570C for ; Mon, 21 Feb 2022 18:25:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21LIPvxP035177 for ; Mon, 21 Feb 2022 18:25:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21LIPv6Y035176 for fs@FreeBSD.org; Mon, 21 Feb 2022 18:25:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251035] ZFS: Allow 64 bit ZFS to support 32 bit ioctls (Wine) Date: Mon, 21 Feb 2022 18:25:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jrtc27@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645467958; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=R1GQtlTkeD2/ys2i7nLUarBQuCZPIt4OFVGIUUuqHI4=; b=X62FBkt4umcLdJY9o7EpheJyYEX8vQ8xs7YqdbtVM7dBUShGSH9uR9SVwYAJ2bH5AJVX3L l9vrt+k668q2dphhv5oPpJDu64D5KlQN4+bK6XiI92XX0M4ZJHH+yRTDhkGk1aJXZtmvlf 47Ri7GmpwN5GOTPsO8T8r+9NkzIMzhkqzM4A9ERzTwgCIatVUQ7SO5Mjao++QTUEGB2tJn 1X4Lpy4X8ZSG/ZnFOBSATmNAoJ1PABmOKKoQFVP6NTWyg2wo7o9fBxOH7cPMM6dBGYNYGu atd3RLcATV0myt5+qTLfRe5wWsY2k2TveCyaJRSvKDLakrs1mx1bkv24KfvySQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645467958; a=rsa-sha256; cv=none; b=L0l9PCde3TL04hAkq35l88rYZSxhVk/j5wYLA2Y9NfhqKJS02XfmATqBWk0pSDUvIGLyTl bKSQ3BHeXiV0ITQ/ILm/qnNkZ1dfgOgE5+ciWZtcBP4MUKTch7jSyUBuwGmZVjDeuLkZOJ KQdkQZcYmsStuvpqNBWaOFAA+08Pdzj+m2VItFe8f2b8Nq487/A8BcnsJl77jLfA/QDOML bGz4nG23fPeARLp8PU4gFBnX2Dq7Q9R9APjbl4bvAmNwnPO8gcjNQIDjXhqiYhvr9h04mR mmOZ+YaSoV994TLLIL6GXCC8vx+DE5Frk3QvUEmAg0h5oRMiO7h9sFGFFK8lEw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251035 Jessica Clarke changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jrtc27@freebsd.org --- Comment #5 from Jessica Clarke --- This is wrong for anything other than X86; it's only i386 that has this stu= pid ABI quirk. PowerPC freebsd32 would break if you added that unconditionally,= for example, as would MIPS if MFC'ed to stable branches (though not sure how we= ll supported freebsd32 is there). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Feb 22 18:34:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1CE9019CF492 for ; Tue, 22 Feb 2022 18:34:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K379v6lphz3tXY for ; Tue, 22 Feb 2022 18:34:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C86BA14A0 for ; Tue, 22 Feb 2022 18:34:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21MIYR4P064113 for ; Tue, 22 Feb 2022 18:34:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21MIYRnP064112 for fs@FreeBSD.org; Tue, 22 Feb 2022 18:34:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256024] [zfs] `zpool upgrade' doesn't warn about updating bootloader anymore Date: Tue, 22 Feb 2022 18:34:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grembo@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645554868; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fVxHPsHnGcrDdbxXo7IlFjTuItK+mj+1GJtWkBMpPFU=; b=i2vYGMeiR6MYgSEAXv5aK4k+y7ZaR/orhnoe90/qk5n3CGPywWsZC35a48vegRZqR8SREB JuT80Qw4Zecerj4JcvyaGHMSxQ74oOvLQ+Q3D4tvcW3CdBCZsDaUXBswSwUYGhYgS1cGuc Z3bcl+1pRnhb9aMj+7pp1bjHH9nvw/xws4oomjfJx0TO3+eiLrfbTegJtXJHbFqwmHvnqC jUBTpBp84fnZkjau3OLk53Z7SH2dcN8PWZcynYElaHkzNvnsmTHnGaYxs9HFWlm+RNtEJm zfS1+8DGGjv3R4O9/q9qwRMdM6Q/0tFav8dgREiwAAd7FKBLwL9l5gLSN5aIGg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645554868; a=rsa-sha256; cv=none; b=Y9l/OC9nQUUTmXdwM73u4AZs7gFAuPtLhS4mrXHlLqjMH6xeHSizGQd+lRXhshJ5gyDkPX KrgX6ta/7RXGojUfHVLYMJwfDCZ/hRtEjNWBEp3+cFx5uMvrrFBbqM56gy3WIhcT0TNX/F hX6Rto6Lg8+ZsOsoN3n6teptl7GoXdxs7+NcL0pzY1x3uyS0sk5OP2kTC6P7K46//ErINw aO2uzYRzvYdRN2LuQ9lohyLTWU2soQINErrXsn70T/PVzX5QDUlwRwysXU03XGZ4pT5jAa EHSPmZP/LPW/uctT2Eim+zcvqHy2qj2hVmaDhqqrDPz4BGVlxe6K8/190oDY5w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256024 Michael Gmelin changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --- Comment #18 from Michael Gmelin --- As the pull request has been merged upstream, it will (or did) trickle down eventually, so I'm closing this. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Feb 23 00:33:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4D06019D8B91 for ; Wed, 23 Feb 2022 00:33:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K3H8Q0JnVz4cxG for ; Wed, 23 Feb 2022 00:33:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E03E367E8 for ; Wed, 23 Feb 2022 00:33:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21N0XfjI053113 for ; Wed, 23 Feb 2022 00:33:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21N0Xf5N053112 for fs@FreeBSD.org; Wed, 23 Feb 2022 00:33:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Wed, 23 Feb 2022 00:33:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ota@j.email.ne.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645576422; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=t9qlJivtXLhcTINW7gB9feTTSfvbVG9ZzEWpm97WD7I=; b=m7av9z5rFvs3Tqplo6KVjwB6H4Rii/hXvap1w4nqaS+uw53WGlnEyRuJyw8E9buVqhnO0z 2ljCcQ65nokXui+pwWnJwQo1Q4fhRB6bikwX1FC5+VZbPslVJyse2JejRsK7gAstTbgEUS BM4EF3+l4R0NrR4XuM426DCvav3/Hq+/jbcXBXAsxqz4QsvNZuMwAUREdlAJztY5H1PWIO s8y5+ADuwj8HY7V9Ta9PKfEgfg/GSCLq2Ea05WUvz+7mFYoJC4nN0FlRBAnaBPyNHjsUHr sGpXKaC/OHcGEMqkDv6AVToLrwgk3FXWxsLKyPkR3cQmnIko3+KGfouKzzu5Xg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645576422; a=rsa-sha256; cv=none; b=sPf5MDuhHlYoR7+tOQJOAM051saqsjE8A/Y9xWSyxiST1DtKkB+4WbpcDkoVNTiVDsus+u AjEA+wJqZXCNPIJs8gNXd3BJzzbNcHYF3zrxUDJcnscGdR6dWTyAClWx5KSxIO0BiL0cTD KOmgoKD4q8EqjGpWr0Kyn/vyPxQ9jp68FuAkwmaujm2m3vIZngYfQDTJQJY51QkjPmlI3a TSbbbwgeLwF4BypWhUYcP+k2ahe92GFtTWJPvmUCDSb1cvs5/b75x2rJASR+c2BI2It0w7 kWaADpafWx4zzoDJnOdm65TKH6VlGqvS1wVaM11yc0IgRLo3/9otXG30h0zWFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 --- Comment #7 from ota@j.email.ne.jp --- (In reply to Andriy Gapon from comment #6) Konstantin Belousov made change such that 13.x release don't need explicit = PAE to use extended memory. Also threshold is 2GB. This problem hasn't been escalated so much than I anticipated. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Feb 25 13:27:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7060119DC029 for ; Fri, 25 Feb 2022 13:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K4rCt0cNTz3j01 for ; Fri, 25 Feb 2022 13:27:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E525720885 for ; Fri, 25 Feb 2022 13:27:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21PDR5Rj011040 for ; Fri, 25 Feb 2022 13:27:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21PDR5Cu011039 for fs@FreeBSD.org; Fri, 25 Feb 2022 13:27:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251828] "zfs create -o " ignores mode when creating the device node Date: Fri, 25 Feb 2022 13:27:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: zedupsys@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645795626; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3AVOoQqheeKvHuJJA34zzW2KU5mPUTW4HT2G86t4CGk=; b=VvygQ2rYZ1L5HWyTAanvJvF9r/DANgu0Qa2YKJ5OyI4dDkZnVgh9J9OSziDyYCUma1hr+p 7dEes2ek9AJWUHxjOLuwASNUA9E1Z2l6f/y2xFAyzvYdo1UA9SM5cwv0jw6ouKk6rRCnzj 2jF9h+HgJG9kn+W1li+/fwLobDjfmdrI6rJaOkX8LpDxiHnru/C5O+Uny29Fw8ahnupiMl hvLRSrBRs5P6C7Gjmtu1CJcTVxXYwFi3WSNhPT53qyK4XIjzlie5nSl4Ve25mvWJj0dYum abOOXBtwTWYv1fKJhe+mwwWFBOxJEmc9rD9HEESkN7C9Z3cDDNYFt7PR67f2Mw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645795626; a=rsa-sha256; cv=none; b=Gn5Vd+Owvw0s61jXqCqmIVlAtLvhIpb95rT8qEZwfBOH8wDxUcXgdrHLK7GAvRTLpDdVfF LsHDAt54VXcnKGkz5RDM1wxTeppRKmkLNtYRhDaZJIl2KL06Zk2nfIVaTX6kXFrEqzfIwq RKTkWfjQoPegqcOkrDf1/Jaytkux6fwmjajEwx8kinAYfG+ecEFYf9YB0PxBLZmMcDut9a 1ifhUbbMDDEsKkoEUSDJFMauhlmo9YSsfQIPsxrlsm+lgi83yjS/WWpSaWnt8/yr8W0H2x X7+5upOGTNgFT+FI/X6SaoTrWYE7DGZeLUoZQahnilFdzU3qr15sCW8gK/6aOw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251828 Janis changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |zedupsys@gmail.com --- Comment #5 from Janis --- I tested this bug, whose fix seems to have introduced bug #262189 as report= ed by me. In 13.0-RELEASE there was no way to reproduce this bug. In each shown case received answer from gpart was: gpart: arg0 'zvol/testpool/vol': Invalid argument So i specially tested 12.2-RELEASE, but i could not repeat it exactly, but partially. I believe that it is due to the reasoning as in bug #262189, sin= ce i had virtual machine, VirtualBox, 1 vCPU assigned. Thus, in each case i got = the same answer, volmode=3Ddev was not respected at all. # zfs create -o volmode=3Ddev -V 64m testpool/vol # gpart create -s gpt /dev/zvol/testpool/vol zvol/testpool/vol created # zfs create -V 64m testpool/vol # zfs set volmode=3Ddev testpool/vol # gpart create -s gpt /dev/zvol/testpool/vol zvol/testpool/vol created But if i did this flow: # zfs create -V 64m testpool/vol # zfs set volmode=3Ddev testpool/vol # .. reboot system .. # gpart create -s gpt /dev/zvol/testpool/vol gpart: arg0 'zvol/testpool/vol': Invalid argument then returned value is as expected. In 12.2-RELEASE i could not reproduce bug #262189 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Feb 27 21:01:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C9E2919D9DFD for ; Sun, 27 Feb 2022 21:01:17 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K6GC06Kvlz4XKh for ; Sun, 27 Feb 2022 21:01:16 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7F0356C03 for ; Sun, 27 Feb 2022 21:01:16 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 21RL1Gmn064725 for ; Sun, 27 Feb 2022 21:01:16 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 21RL1Gef064724 for fs@FreeBSD.org; Sun, 27 Feb 2022 21:01:16 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202202272101.21RL1Gef064724@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 27 Feb 2022 21:01:16 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16459956761.71aA3.62674" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1645995677; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ZWaNu7rKt9uBBdvskhT3AmEXRmyix8ZjEyWhlEPpcw8=; b=H7ncPu/YMtRsEZMjkbt0egiGSSF6KfDeZ5EXKpKwWqpw8L3+b/hit1WGkG0B939OCiDCZW MoGSB1vxY405BlmieBwDWqYiOTn8qCkXHOl+fBv9MlqZZ64U+L8Z529PqobBgvgjjKtp16 mEPV8AO1jl54Mr/kGA6p1obI4doggdTfkETMmg73yZpPVV0ryTVgMaaP+2h35F8B3/vxZO CojC+GD04R87n8U0yvz1Ti8CuOM5+WkH5SP0g3SodzB5Sy9e4xj4ZIA/wOEzsQK747aPQi HAGgXafwrkzOFHz+E0IgWbXteZ8zHJ3J/fDpCNgmFu8ZkeCP6trs0ZPzRoh2xQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1645995677; a=rsa-sha256; cv=none; b=RP97ay7Xra08MDOwfEHoIUlv4NPZHPfSGYQnx544rpaaDDLMFBUYvkLrknEmzzw8DMhrAr yXGTGI2eEU+6gTfs393XRZXR9Ykx4SLWK7Qx5qen9+1Aw3fGYqlTx+EkzrO9Plm0Mdkzl2 KfR7tuMggb14ccYvmwe4wy5rfP4e0qBym2ksJ3qPiEZc0MpJR0ePt7kwkp4on8wxT4YjKn 4kc48eWxdjQjrqnjWydiGQr23IYJKYVErbM06hdRwYE4JbBDM6CWd2MYRD1Ywe8lP0thwh sVXFqpUkz7jRL/iWSjmMdVHc54bH95iWdwZ3bS051Plvcmdec9bK7rAQBLjHSQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16459956761.71aA3.62674 Date: Sun, 27 Feb 2022 21:01:16 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus 7 problems total for which you should take action. --16459956761.71aA3.62674 Date: Sun, 27 Feb 2022 21:01:16 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus

7 problems total for which you should take action.
--16459956761.71aA3.62674-- From nobody Fri Mar 4 12:10:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 78B951A06810 for ; Fri, 4 Mar 2022 12:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K96BL2DMHz4rDp for ; Fri, 4 Mar 2022 12:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 28F7B3B25 for ; Fri, 4 Mar 2022 12:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 224CAYlt055934 for ; Fri, 4 Mar 2022 12:10:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 224CAYQ2055933 for fs@FreeBSD.org; Fri, 4 Mar 2022 12:10:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250323] OpenZFS L2ARC size shrinking over time Date: Fri, 04 Mar 2022 12:10:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: pete@twisted.org.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646395834; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9FpTChaZe9fY61fRwd76wk9cjiT9aIoKAOIe0boMNMA=; b=yzXoL1G/dmhTi2M14jlKpOSmwBFvc2Mnciv5yxsC6KifKKeHxDGr/JIvy04W/tjRwRdt3Y /EO7RqTm7jVieFdo4/WF7OiSlpaW2eigrns3CIw0s4K4qaUgldSnVFAS/XXAuDqkQT7lO1 AGMF0TRySTjUOi/fIzacQBqH6RW9UH2POoywLwJXR8+cSuEUqYclLSJURRWNMMA2Lrg+ai 2tXsGdsMj5Ccgeqwe9JpM8pBhSHNzLa5/SryEBQU+8QYW+T7IigeZdCbKEFeBLnksM8Q2u qa4WQsvZmpVeaTSh43Dl6uhDgcC2Cl925xfUyPV5r/Z2TTXyaZU4qpIzklLIOA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646395834; a=rsa-sha256; cv=none; b=C4Iu6kBEtAzXhv13EIpjr77cY+D0GE1+vFSEyI/7XWKJDiE4oRL00ENJ6d5LaMdoE+TzlE SuwJF5l+5OSiMpp7Ud0VZ53k2jNMnkEKS6OyJQH+iWszXT08fQvSQJq76KwI/2tGye8qj5 OuYxzE9yd5M+xSu1u3+CYR2RYoEhEE4oNk/WkPHupr38tkcBhJsYsid1sUHR9Ovk+HtBJh V9C0PrEYVWLUz2KG2Lk3w5CQzy02qLErw0Y6oIMUQMQp5jJuZ/bst6cMxeCS8F3GK0ySe2 tpL6WoIx6hzHx+IwpcbSY7By5ih/JpMu7gh8BaRJUy6XiDIV35+0dtmlP2Sy6g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250323 Pete French changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pete@twisted.org.uk --- Comment #2 from Pete French --- I'm also seeing this, on a recent STABLE. The size of L2ARC as reported by bfs-stats shrinks over time, and I dont think its an accounting error, as t= he performance of the datbase on the machine returns to what it was when I did= nt have L2ARC at all. The odd thing is, when I reboot the machine, it then shows the L2ARC as bei= ng full of data, and performance goes back to normal. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Mar 4 16:22:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D5C9B19E4F58 for ; Fri, 4 Mar 2022 16:23:03 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4K9Cng1yrVz3sTn for ; Fri, 4 Mar 2022 16:23:03 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id 9DE9A2110B2 for ; Fri, 4 Mar 2022 11:22:57 -0500 (EST) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 4F51724CD9D for ; Fri, 4 Mar 2022 11:22:57 -0500 (EST) Message-ID: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> Date: Fri, 4 Mar 2022 11:22:56 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Content-Language: en-US To: freebsd-fs@freebsd.org From: Karl Denninger Subject: md disks EXTREMELY slow 12.3-STABLE Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms040805000707010801050004" X-Rspamd-Queue-Id: 4K9Cng1yrVz3sTn X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-5.85 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.95)[-0.954]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms040805000707010801050004 Content-Type: multipart/alternative; boundary="------------K4SjODmFa6lpgcokx0SkZXxk" --------------K4SjODmFa6lpgcokx0SkZXxk Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Not a little slow, RIDICULOUSLY slow. Crochet uses these.  Since 12.3 the effective I/O rate, which pegs them at 100% busy, is in the 50tps (!!) range.  This is a machine with a crap-ton of available RAM (over 10Gb) and effectively no swap use, running off SSD for the root pool (ZFS.) Load average is 0.3 yet the md0 drive is pinned at 100% busy with just 50 transactions-per-second! This used to be fast in 12.2 and before. Any ideas as to what might have changed that is causing this? FreeBSD 12.3-STABLE #18 stable/12-n234659-7963d46bb8c-dirty: Wed Dec 29 10:59:44 EST 2021 -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------K4SjODmFa6lpgcokx0SkZXxk Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

Not a little slow, RIDICULOUSLY slow.

Crochet uses these.  Since 12.3 the effective I/O rate, which pegs them at 100% busy, is in the 50tps (!!) range.  This is a machine with a crap-ton of available RAM (over 10Gb) and effectively no swap use, running off SSD for the root pool (ZFS.)  Load average is 0.3 yet the md0 drive is pinned at 100% busy with just 50 transactions-per-second!

This used to be fast in 12.2 and before.

Any ideas as to what might have changed that is causing this?

FreeBSD 12.3-STABLE #18 stable/12-n234659-7963d46bb8c-dirty: Wed Dec 29 10:59:44 EST 2021    

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------K4SjODmFa6lpgcokx0SkZXxk-- --------------ms040805000707010801050004 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzA0MTYyMjU2 WjBPBgkqhkiG9w0BCQQxQgRAJpcuuh0awUuypxhtT4S0kQodbnP9czyR9IbT8UzwoZwTzqMB Lo5A+7aIB3tXPtO8SUHvPKIFuR0YbwPCKO6DmzBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgBRcXI93GfpKcNNMINERhGbWFwCeKGaStgpz8bbMFQgW7kZ2atpQ628G1NECT5o9h4l dDx1CT0F5LxrNkaalv8pcv6uZi7453Z4p3DYN/fQFmibFQtmSk/XvaoT6R5/wzXSmGjkd+I/ ULLHxTuBKuROgns5sPYhOXRgqkM5XuomMnV2vFAXQzXrjNb98AOsI8SvRJVchba8LORJM5bw yDaQGpbSe6dNSC12iY86hCDiVm6XuXftQPS0qG7/FTytZzi1satIdhJoFu8t5ghhSnqNi4QN CO5MEt1vd6LHsmoLVGFXw9rxQRhbrzS3EQ3ft3CakAInhKqDxA7iuhhyYreFEJwvVx9fSYda qhQTsV00QhWfrMcnK65Unj5WxG6vkIqUkIvPTBOiuJQvTPuCn1VqqyBh56z8nUDdtOpoFUKw lJMYyusaEhxS59HqxywxwYYuetl+gaeZlnnjDWIzyT32WwE9lnZjIDfAil286uU2GndcWqiO aCy38W/MJREMVVi8Thg98eYJOuELVpOzBdoWE6GsYRIkuKJvnjMuWLRMjaim9H7OjrjLHBXV xq4NyJHcjWSfBzVS5sPig1RVnKd1y7a7ZzzgGHoxcCe4eHsXb9cK6NPZIfGkosbMi43bN5Cj HOfTk1nUFai4MNB2iWQEvm5/JGJYUJvaboN15knilwAAAAAAAA== --------------ms040805000707010801050004-- From nobody Fri Mar 4 19:34:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 596FB19ED3D1 for ; Fri, 4 Mar 2022 19:34:10 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K9J291lxzz4qZc for ; Fri, 4 Mar 2022 19:34:09 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1646422442; bh=jZwTor1tr8dHcFyewY4InPZ/bjb0ZW9m2nfJz1N8rCU=; h=X-UI-Sender-Class:Date:Subject:To:References:From:In-Reply-To; b=OGgims4F2vdfh4K8iuPbeiZZMZAT4rtcXe2S8YbCad2yRQNAOMmNZWdBbj+mpFFzN H6wtP2ueHaI62dTMZGC6zeyy5XWQXg451xGiLAnEqCrMsldTRDxLHPc97oTBET/ozs 5ALTXDb1FspueoEUs5nuIBMSH2V6DwmvE3u99tco= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.0.1.209] ([178.114.233.16]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1N7zBb-1oCOUL0RhT-0154ia for ; Fri, 04 Mar 2022 20:34:02 +0100 Message-ID: Date: Fri, 4 Mar 2022 20:34:01 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: md disks EXTREMELY slow 12.3-STABLE Content-Language: en-US To: freebsd-fs@freebsd.org References: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> From: infoomatic In-Reply-To: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:1zvxV4PxW4JIrh8A4bw9eL+sHbHCYUhJVfScIPwLoQfd0L+Cnk2 Y1+NcW0QZQ1aqvVznz/rBJ1rxlpEhj1YcK7V3m+lgy5rk6Gag+AuQR8JylFxjYhqRzm+Yx1 g+VJeBG42C9f/eDEICK29nH6D0rj0hQKRCvQcRrE9zJ6mqff6ystlfGLvP+dfh56N1H9s75 RlzcvdqOitCaRF6iHXB2w== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:dpe1Opaekps=:xxgb1u3kyw1CYCcxdd7Xi3 ZlsZUC6n4OuNSOv7hIbF7JCZtCxGkqeTa7QfuWAnsWLavuw1xX+ycyDBoz6s3xKNeATkjey20 nPG+bLqzEZga9ZfGIBbwB471r7pH0zxqfVvRw+fHCjtBRixwmFnarAt7ROiFPpYfnORJg19/2 inBmg8BtH5g3EckIztHxm5Yh4QPMDwwIUwLXWsUUsHXhhMtrqnNz1tVc3OFFA4QseA+lETlze brO3GUI2afpyhjNbGSd8zeTe5Y0hc15yTMYL2HbW8DMt8oXMBoAOncADy78cZGhNCv9rqmsLU sqBBxDZPKruLV9kv8fZKnzxXIUj4mIA9GqFGQqQjM1vFDPEzPyYbNx9h97rYdzkeY6u6WVZdl 1tzZYzBznNvwpYtPlBPuTWjJ0GAZy4wQelHJSo3KwTyz0pmnkaY0MgMRpTq8MiCLzmHuHMCwh IDYYMkll1KiIduNKEmQtGabPPzs8Rde0zHyYhp4x8XqMCG5E9B7Odon2OnbAYzzi7cZoVaCyL 7dPZyDX9et82okgA1/ronS4QUK2Esbl29wassL5y3P4sjS0Uq43UJVTooTwS5+jqrZxRXYiVn FOuJ7jQfc9PL3xga56aObZxr/NJzABgQE1a8TvP09tXLos/F+eJJOSA4lv9HAapHpQvaYTH1c 4AreFoGhZ3Rvs760eZB9GORXsaJomIct3h5OxzQ+hCrXHilWDKLF21XpAww05tT3hfZ2OajcB rRzs36v1+/DbTuVNCMAqnC1W3Vua0qz2h6fmKRl4NSfn1sIsfYqSQroTWN6kGfx3nBuKoaXXd TZeLCcx0OQYpFFufucA+p8YPKPu30w6QvvxBxRnvIWxmXzs7+qM54eAz0nqPDFBS5svD91jrv 7tjg9AD/CBVJiDL45RUQitfVW7L94Bq+abwYHdMeVqGiD73QldTAb1zX1s6VC/WYgPAcmI8T7 lUV8Hw0/k3c318DOICmzXFLVtge4RQn4vdaxj4t0tNSdzO2w8nUMVnKJIPlHAn5X7Q8sgzkkp RBNCgQ22uKuLaLNs/Ii0df3G1jNR4A//ZqwgqR1iWz2kJEUgQ1JsVOTQh5oiuQAn+GpQbLr10 dt8emToqdnxigg= X-Rspamd-Queue-Id: 4K9J291lxzz4qZc X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=OGgims4F; dmarc=pass (policy=none) header.from=gmx.at; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.21 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-5.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.at]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.21:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[gmx.net:dkim]; MLMMJ_DEST(0.00)[freebsd-fs]; RWL_MAILSPIKE_VERYGOOD(0.00)[212.227.17.21:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 04.03.22 17:22, Karl Denninger wrote: > Load average is 0.3 yet the md0 drive is pinned at 100% busy with just > 50 transactions-per-second! you mean md(4), the memory disk, right? ... just to be sure it is no typo From nobody Fri Mar 4 20:06:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D92DC19F6165 for ; Fri, 4 Mar 2022 20:06:36 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4K9Jlb6g93z3FFb for ; Fri, 4 Mar 2022 20:06:35 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id A00B02110B0 for ; Fri, 4 Mar 2022 15:06:05 -0500 (EST) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 30C753FABA1 for ; Fri, 4 Mar 2022 15:06:05 -0500 (EST) Message-ID: <8eb0baaa-f22b-57f7-6b6f-6d93ddb2dee5@denninger.net> Date: Fri, 4 Mar 2022 15:06:03 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: md disks EXTREMELY slow 12.3-STABLE Content-Language: en-US To: freebsd-fs@freebsd.org References: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms030208070108040609080600" X-Rspamd-Queue-Id: 4K9Jlb6g93z3FFb X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-5.89 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms030208070108040609080600 Content-Type: multipart/alternative; boundary="------------I5l8nHjmYppWH0zKCbCrNVzJ" --------------I5l8nHjmYppWH0zKCbCrNVzJ Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 3/4/2022 14:34, infoomatic wrote: > On 04.03.22 17:22, Karl Denninger wrote: >> Load average is 0.3 yet the md0 drive is pinned at 100% busy with just >> 50 transactions-per-second! > > you mean md(4), the memory disk, right? ... just to be sure it is no typo > Correct. I think I've found the issue -- The "-13" build is using a vnode on the spinning rust ZFS pool (albeit a fairly high-performance one comprised of mirrored vdevs) for backing store.  I'm not sure WHY this winds up being so insanely slow, but it does.  I'm going to move it either to memory/swap (since I have a bunch) or stick it on the SSD pool since creating an md in RAM is, as expected, ridiculously fast. -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------I5l8nHjmYppWH0zKCbCrNVzJ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 3/4/2022 14:34, infoomatic wrote:
On 04.03.22 17:22, Karl Denninger wrote:
Load average is 0.3 yet the md0 drive is pinned at 100% busy with just
50 transactions-per-second!

you mean md(4), the memory disk, right? ... just to be sure it is no typo

Correct.

I think I've found the issue -- The "-13" build is using a vnode on the spinning rust ZFS pool (albeit a fairly high-performance one comprised of mirrored vdevs) for backing store.  I'm not sure WHY this winds up being so insanely slow, but it does.  I'm going to move it either to memory/swap (since I have a bunch) or stick it on the SSD pool since creating an md in RAM is, as expected, ridiculously fast.

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------I5l8nHjmYppWH0zKCbCrNVzJ-- --------------ms030208070108040609080600 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzA0MjAwNjAz WjBPBgkqhkiG9w0BCQQxQgRA5JoLy71mnY1Oy1m+jcrxDdPSNRY4DjFPZanyEBV7Vt/Lhanq nDwFKZAUZNpUMWq49WiGhjGajrpjhyQKt44nGzBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgC3uKot1gnA8p3eVZ9nuzUQpMfrPpsaV3iLOYrgRMfmJ+LrcMRyntozOQ3/fOKHnNbW yfCFbOQ/Uu+WsRiAu0FiIuIDvusJ+TBpn9pHxtYh/1qnRWiMsq+RPGjWlMaMAChXSxNvHvi5 eBZWN0dwCldhp1i/q61povIpORanGWLgK70Q9RdZkDuVKO6B9gGY8D9i7CzfMG94XsI6bK8i wMBDM/PyciUXG7+8PfPBN/ijMkiKftg4pPu5OvzJcbEakAA+10r1YQnAPiFwrwtqRdGodW0I WlD0S8UePVQn7XeO41nvVkBCO235BYTDsbiXgxMccjHm/+U+yyKnvyvJ/0eEyBtfl6UOXW5U iaPjAzqQXDy4tfTGjGbcI/Rw/C7x/qrQr49nlews9ODXNXBGo70U6Dqfo5q0aISkk9Zl6lxO B1NWfgluYSWXqzmd0HAYZCdHl+uiKyoNwrkgwYalFz9+I7saabaRPxsWQKmVxOu6cIuYGWWd oZMses43qAbda5ZWmN/rAR5CKN4wqRD4RMrjZn0HK9Lj7jddsi6e1CJJzLkdHMtn8kCzjRzQ 312IslHUoT7jK3RII7OmjkTZv8lxalU6x5QgbUaIAFRzkrckj/1jqCpMW7rx4FXAMbhd6EIU TgRHVjEYZG79m7EyX8V4VQ7eMtDpD8T1xWGcleBKQAAAAAAAAA== --------------ms030208070108040609080600-- From nobody Sat Mar 5 01:11:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3B73319E5E78 for ; Sat, 5 Mar 2022 01:11:29 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K9RWM6qPNz4YLy for ; Sat, 5 Mar 2022 01:11:27 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 2251BJtK029851 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Fri, 4 Mar 2022 20:11:19 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4::29] ([IPv6:2607:f3e0:0:4:0:0:0:29]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 2251BJ6e014950 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 4 Mar 2022 20:11:19 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: Date: Fri, 4 Mar 2022 20:11:20 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: md disks EXTREMELY slow 12.3-STABLE Content-Language: en-US To: Karl Denninger , freebsd-fs@freebsd.org References: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> <8eb0baaa-f22b-57f7-6b6f-6d93ddb2dee5@denninger.net> From: mike tancsa In-Reply-To: <8eb0baaa-f22b-57f7-6b6f-6d93ddb2dee5@denninger.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4K9RWM6qPNz4YLy X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 3/4/2022 3:06 PM, Karl Denninger wrote: > On 3/4/2022 14:34, infoomatic wrote: >> On 04.03.22 17:22, Karl Denninger wrote: >>> Load average is 0.3 yet the md0 drive is pinned at 100% busy with just >>> 50 transactions-per-second! >> >> you mean md(4), the memory disk, right? ... just to be sure it is no >> typo >> > Correct. > > I think I've found the issue -- The "-13" build is using a vnode on > the spinning rust ZFS pool (albeit a fairly high-performance one > comprised of mirrored vdevs) for backing store.  I'm not sure WHY this > winds up being so insanely slow, but it does.  I'm going to move it > either to memory/swap (since I have a bunch) or stick it on the SSD > pool since creating an md in RAM is, as expected, ridiculously fast. > /Try doing mount -o async. It makes a big difference speed wise for writes. / /    ---Mike/ From nobody Sun Mar 6 21:01:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C023A1A031C2 for ; Sun, 6 Mar 2022 21:01:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KBYsf610qz3G16 for ; Sun, 6 Mar 2022 21:01:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 678891B7EC for ; Sun, 6 Mar 2022 21:01:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 226L1AEJ078165 for ; Sun, 6 Mar 2022 21:01:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 226L1A2e078164 for fs@FreeBSD.org; Sun, 6 Mar 2022 21:01:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202203062101.226L1A2e078164@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 6 Mar 2022 21:01:10 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16466004701.78Ac78.75356" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646600471; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jkwoFD7AvjTpfuVcDMzWMVpDs+g4hnWXPA2MmUQVSVo=; b=LSmHuqtayCGvYcb9YXnaj2uW6IWFq71W3FQAR6FKmwN6a6vpuQ416v6FvpEZDrkttw90Qs 60FHRZVIcYdOaMmkTtQccNoHDR8k0uWLvAL5JPrFqzTqYDTA/Z6wnbFHwlwKZqfDmxpT9p nvWdWyPlmmQFWFqjN4kkI4/b12vf67pXov5yZnwkFRwetic2O1AF+bXLFL8Ls5ioQG48ur LRW4q4VEe223ewS7wLeBytELUZvCe9xRvkZ7s5/dGscYCJyeC8fZjqXK2J9IS6Frx5Vhy/ 5JlItGdG63Pk02VjTWsGTnJZx6e4VO1OQcZKCnQe/YpRTOM/v+n4aG0j/Nyy2w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646600471; a=rsa-sha256; cv=none; b=fIRjadD2ACTKFx21p415/ltz1yHvmheJNN28Aw+VjkDYxeiy7PB4FLS3XcoiqQTvIQOMN5 TPJTu0dQG0X4UPLTO7oLROw6APuCcB9V2pm6XKVkHoXbMVFTSmzL8juTcHeXVhv7g+lp+8 Km4GmA0VwNzPxBWgyyi8PJ6uK2o1wufgVvOW17PfASKhl5hBdw6y9KsPvJ5D8of9xXXosb MAxvpjze7AJ5wPGwKZWmWCNhdZwldhEUYt8JRa6PkwfxNeyWjuM13dWXwX7xz4tJWorJAP nbpFIeP7sGhCL13UsXiBBZWdkABkWfd/+qIrXAqVNA1JTm9nZ/3HC6wV5q/S8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16466004701.78Ac78.75356 Date: Sun, 6 Mar 2022 21:01:10 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16466004701.78Ac78.75356 Date: Sun, 6 Mar 2022 21:01:10 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16466004701.78Ac78.75356-- From nobody Mon Mar 7 17:55:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AF5E319F3F50 for ; Mon, 7 Mar 2022 17:55:14 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KC5hd4cVKz3ByF for ; Mon, 7 Mar 2022 17:55:13 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id BF9CA21108B for ; Mon, 7 Mar 2022 12:55:07 -0500 (EST) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 56A2544BFF4 for ; Mon, 7 Mar 2022 12:55:07 -0500 (EST) Message-ID: Date: Mon, 7 Mar 2022 12:55:06 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: md disks EXTREMELY slow 12.3-STABLE Content-Language: en-US To: freebsd-fs@freebsd.org References: <97013161-b119-4c98-a294-c733ca000a34@denninger.net> <8eb0baaa-f22b-57f7-6b6f-6d93ddb2dee5@denninger.net> From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms060602000501060201030608" X-Rspamd-Queue-Id: 4KC5hd4cVKz3ByF X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-5.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms060602000501060201030608 Content-Type: multipart/alternative; boundary="------------XWJ3Mog6t08ZmMklstcaqR5P" --------------XWJ3Mog6t08ZmMklstcaqR5P Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 3/4/2022 20:11, mike tancsa wrote: > On 3/4/2022 3:06 PM, Karl Denninger wrote: >> On 3/4/2022 14:34, infoomatic wrote: >>> On 04.03.22 17:22, Karl Denninger wrote: >>>> Load average is 0.3 yet the md0 drive is pinned at 100% busy with just >>>> 50 transactions-per-second! >>> >>> you mean md(4), the memory disk, right? ... just to be sure it is no >>> typo >>> >> Correct. >> >> I think I've found the issue -- The "-13" build is using a vnode on >> the spinning rust ZFS pool (albeit a fairly high-performance one >> comprised of mirrored vdevs) for backing store.  I'm not sure WHY >> this winds up being so insanely slow, but it does.  I'm going to move >> it either to memory/swap (since I have a bunch) or stick it on the >> SSD pool since creating an md in RAM is, as expected, ridiculously fast. >> > > /Try doing mount -o async. It makes a big difference speed wise for > writes. > / > > /    ---Mike/ > Mounting the md filesystem -async does not help at all. /dev/md0s1 on /work/Crochet-work-ARM64-14/_.mount.boot (msdosfs, local) /dev/md0s2a on /work/Crochet-work-ARM64-14/_.mount.freebsd (ufs, asynchronous, local) It appears the interaction between using a ZFS-hosted vnode as backing store for an md() on spinning media results in some sort of pathological behavior. "make installworld", which is simply file copies, demonstrates the problem. Putting the backing store on a ZFS pool that is SSD-based results in expected performance.  I thus surmise that the issue is that the interrelationship between the two is leading to a crazy amount of seek activity on the devices in question.  The zfs filesystem in question (/work) has the default record size (128K) and lz4 compression enabled, nothing else interesting. -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------XWJ3Mog6t08ZmMklstcaqR5P Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 3/4/2022 20:11, mike tancsa wrote:
On 3/4/2022 3:06 PM, Karl Denninger wrote:
On 3/4/2022 14:34, infoomatic wrote:
On 04.03.22 17:22, Karl Denninger wrote:
Load average is 0.3 yet the md0 drive is pinned at 100% busy with just
50 transactions-per-second!

you mean md(4), the memory disk, right? ... just to be sure it is no typo

Correct.

I think I've found the issue -- The "-13" build is using a vnode on the spinning rust ZFS pool (albeit a fairly high-performance one comprised of mirrored vdevs) for backing store.  I'm not sure WHY this winds up being so insanely slow, but it does.  I'm going to move it either to memory/swap (since I have a bunch) or stick it on the SSD pool since creating an md in RAM is, as expected, ridiculously fast.


/Try doing mount -o async. It makes a big difference speed wise for writes.
/

/    ---Mike/

Mounting the md filesystem -async does not help at all.

/dev/md0s1 on /work/Crochet-work-ARM64-14/_.mount.boot (msdosfs, local)
/dev/md0s2a on /work/Crochet-work-ARM64-14/_.mount.freebsd (ufs, asynchronous, local)

It appears the interaction between using a ZFS-hosted vnode as backing store for an md() on spinning media results in some sort of pathological behavior. "make installworld", which is simply file copies, demonstrates the problem.

Putting the backing store on a ZFS pool that is SSD-based results in expected performance.  I thus surmise that the issue is that the interrelationship between the two is leading to a crazy amount of seek activity on the devices in question.  The zfs filesystem in question (/work) has the default record size (128K) and lz4 compression enabled, nothing else interesting.

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------XWJ3Mog6t08ZmMklstcaqR5P-- --------------ms060602000501060201030608 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzA3MTc1NTA2 WjBPBgkqhkiG9w0BCQQxQgRAXlLTPdgjpTxw7kUpM48p7qzv/D+Wbq8RDa0vC/xQuMLOqJAO pl6Q1sxEyOa0VM2z+DUJlnVPm3b3fDWcoYrRajBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgC3x630vLluUPKjlbEq2Tv8wq++iyc9bRcwx+GmT155ZZaTZ8z1Z/asqdWSvyxhlw7f UbMMldHsEXe4TuQ8we1Dze/XVreLCK/fDq/Uw6+r7escgrz1j8JC+4JF7iHRgWQTqtSjEE1e R/WS5/xDk4fsBweobH+LFzl2BXKcWOytB0kW/YDavtq1vTMHcx0z0VxLVriQCkJ49rc6Nsty PBfPHfT7ZFFc+S3/GldM+AXvlSDlxJzgyk+7trm5pjj0TlaXJXr64PQfA1wlHn1SJZj7xvzt LbZfgjignuJGXuxDRlZMb4uJkwgr5CaXNUtYzYXCkIKh+bccPh5CQen1J64tTQPWrnqNTFi5 vaDuy2O7+wguYN50HPst/Gtdd1HWrJpfbXWoCVYQTpNqncOQnH+Hq68hkysVLiIE8BGWHC94 oSbmR/KT4TBcRYMKj9jd6mzhFLp4qFjhsh0jgJp3bG6CYw/tL6XqoHUhzJ+VbUWjBUg8kzsw q5qN4AEbPmQW9KChC44DsplNQd5wQ8sHz6csRTirjYYrSmPXkq5UJns3TQtIVRTh1LbsYGwV MIoKfglsVOjA78YQDlKj8+RCN04xXlizTA5sXshdY5+0etjKfClgawKsxrXZXDn5d+Xq/cSk saPhNoQiQkxDWAiXIxQCgYwEAQ0w7obwtIIMXmo4ewAAAAAAAA== --------------ms060602000501060201030608-- From nobody Mon Mar 7 19:52:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 820AD19FA8BF for ; Mon, 7 Mar 2022 19:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KC8J45QwHz3Knw for ; Mon, 7 Mar 2022 19:52:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 633106ACE for ; Mon, 7 Mar 2022 19:52:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 227Jqas4010586 for ; Mon, 7 Mar 2022 19:52:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 227Jqavo010585 for fs@FreeBSD.org; Mon, 7 Mar 2022 19:52:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256511] UFS assertion failure when shutting down from single-user mode Date: Mon, 07 Mar 2022 19:52:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646682757; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Fr1eBx3Xc8W2JT7OGX+9xc+puW11IRJEgpqwT0HdLBU=; b=fQVFc8HAkEVMNkX+U6AQX7ypibGIxUUoGqSQyne9uON+hwtbOyxkLQbBzFMRl31nlOSzYX Jofx4rQrvG81DxilNAb9XQiz9Nc4+J02DWAYcsmE+mgB8rh+s/UGRPz65tEvJuIlpOQBIT R5t6oiXzqXB2m1vm1fwv5Av2QA71RkPxFvZBZO+ObzrGUvHsmK8xX1zi5y9U0CQUVQdWqT yqfOIijSQYG1yAVKfhrQcf6TgypScXCaLPTrrmYRNf50O11IKPjwcQRe0AoMwenCTXA/4L DoLVEXaXlWmW8G2mnJu9Vi2i/UkRrR360yvCgIYAnD7HJCCjjX9HIyltkBDAcg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646682757; a=rsa-sha256; cv=none; b=hoVRMl9C6nd3z8NWQBfXJg4TOb1JXMIbm7brEq33GBnEvrM/U48cWtNIC0maAKb7l2tvad OJPB+r4h25lnGJ7KnyCgfCKYyb6A8wdGv7qDqTODYRqsYziuCqfzPB4XWKx3QQS1UfJWHJ zIqDAb5bBLjCcnOPaX+SLBZxeiBQrpL/7ZOEZvBHNOKksfYtxZpdgO94FrfWadN7NjvLyh nP37Cje2oFsnN/zxA/XAv1kDVUf+inRvOGw5LefPlcW/QLuB9sTZnvXYICsN1kUXzGmgXK 2B9WxcS0PY6NqAGBgriTi7R+d0QSqANuttpGhwQYVHZNGUcV4XvKKG/8fLkuzw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256511 --- Comment #7 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D0455cc7104ec8e8dd54b3f44049112a5a= 8ca329c commit 0455cc7104ec8e8dd54b3f44049112a5a8ca329c Author: Robert Wing AuthorDate: 2022-03-07 19:18:03 +0000 Commit: Robert Wing CommitDate: 2022-03-07 19:48:44 +0000 ffs_mount(): return early if namei() fails to lookup disk device With soft updates enabled, an INVARIANTS panic is hit in ffs_unmount(). The problem occurs in ffs_mount() when upgrading a mount from ro->rw. During a mount update, the soft update code gets set up but doesn't get cleaned up if namei() fails when looking up the disk device. Avoid this scenario by looking up the disk device first and bail early if the namei() lookup fails. PR: 256511 MFC After: 2 weeks Reviewed by: mckusick, kib Differential Revision: https://reviews.freebsd.org/D30870 sys/ufs/ffs/ffs_vfsops.c | 148 +++++++++++++++++++++++--------------------= ---- 1 file changed, 72 insertions(+), 76 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Mar 7 19:53:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 98C3919FAD19 for ; Mon, 7 Mar 2022 19:53:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KC8K43F46z3L1h for ; Mon, 7 Mar 2022 19:53:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4FD896A4B for ; Mon, 7 Mar 2022 19:53:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 227JrSXK010775 for ; Mon, 7 Mar 2022 19:53:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 227JrSLu010774 for fs@FreeBSD.org; Mon, 7 Mar 2022 19:53:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256511] UFS assertion failure when shutting down from single-user mode Date: Mon, 07 Mar 2022 19:53:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646682808; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XKbbLqciIod1qRDB2Z4TBGJ1YxYnp5v60JQs3ssIF/c=; b=sHnMKSFOH2KQFboncLN8kf7OzCog1/BnSxxhJ2u30HefKJW/TkCTKeM8McGjI7CwSkRLTx hb8c075k8cr2Steh4Uovo39mDEKJKOLOKGs+9vhUYlhwawKQW2mHgTLXYXN2OHu55AXJzK ldraNyiq0Uqv1bQhiNkGA96t7NPlbmgVgqBrki2e9QC0B/AzpHTurzyK4V5H0DE6m686MK VQvTgqaVJFJAVVu71NIZYYs6tkjNyAWcQw7/4a0dEOtMFqK2Y4+wiO77ShcQXphBHS+njx wmQ3FbQJEnL4QLHqGVShflOSGw2Ulg0CwgW0+MZmiFONzmjsdesifT78zJqqig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646682808; a=rsa-sha256; cv=none; b=faWZrime0Y+62v3klZwxizE1hVmXA6ELMwNYz34CqRfKJli8kEztLLU9Ctj2uQCcrUf7CS DhyIswLM2xUoEnoQ29aEG3cJn8nUrlaiPOCzbuGcJ10CUT8bj5suIdBcgyEFqyQzqv6AfG k0isqeIu0fs7Dtxq0hmu3g7Tl9MbbnRyuWuBSIFkkRXPw8S1hNOOkHY5ucK4dPvD0hTaWW FzL3WnczarPI/q02R7n7kV9r7bhbI9SyK6dpL7w8/RyVS5Wkb9kzXMwClAsHLL//K+x0LB ctic1JocxJT8EoQPrP+2blvINwEMlqKBX8m9LOecfCy4Mz6UeTWbuyo9MwSbfA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256511 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Mar 7 22:12:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AF9DE1A03244 for ; Mon, 7 Mar 2022 22:12:11 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KCCP64Wf8z4YV4 for ; Mon, 7 Mar 2022 22:12:10 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-463-ZxNDYxixPEu40dsKz8jm1A-1; Mon, 07 Mar 2022 17:12:03 -0500 X-MC-Unique: ZxNDYxixPEu40dsKz8jm1A-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Mon, 7 Mar 2022 17:12:01 -0500 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Mon, 7 Mar 2022 17:12:01 -0500 From: Michael Jung To: FreeBSD FS Subject: HELP Thread-Topic: HELP Thread-Index: AdgycFzMUqFcEV7lRZqbs50DAO4xLw== Date: Mon, 7 Mar 2022 22:12:01 +0000 Message-ID: <6c712c0ceae142d194f73db416204fa5@MAIL-HUB.pai.local> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_6c712c0ceae142d194f73db416204fa5MAILHUBpailocal_" X-Rspamd-Queue-Id: 4KCCP64Wf8z4YV4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.50 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; RCVD_IN_DNSWL_NONE(0.00)[170.10.129.197:from]; SUBJ_ALL_CAPS(0.30)[4]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[170.10.129.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_6c712c0ceae142d194f73db416204fa5MAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, 2101 High Wickham Place, Suite 101, Louisville, KY 40245 Disclaimer The information contained in this communication from the sender is confiden= tial. It is intended solely for use by the recipient and others authorized = to receive it. If you are not the recipient, you are hereby notified that a= ny disclosure, copying, distribution or taking action in relation of the co= ntents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been auto= matically archived by Mimecast, a leader in email security and cyber resili= ence. Mimecast integrates email defenses with brand protection, security aw= areness training, web security, compliance and other essential capabilities= . Mimecast helps protect large and small organizations from malicious activ= ity, human error and technology failure; and to lead the movement toward bu= ilding a more resilient world. To find out more, visit our website. --_000_6c712c0ceae142d194f73db416204fa5MAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <= /head>

 

 

CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245





<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--_000_6c712c0ceae142d194f73db416204fa5MAILHUBpailocal_-- From nobody Thu Mar 10 06:43:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9F45E1A0E59D for ; Thu, 10 Mar 2022 06:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KDfff2vWKz3sDP for ; Thu, 10 Mar 2022 06:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 43D7920491 for ; Thu, 10 Mar 2022 06:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22A6hsAV088785 for ; Thu, 10 Mar 2022 06:43:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22A6hs2g088784 for fs@FreeBSD.org; Thu, 10 Mar 2022 06:43:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255611] patch to add units in description of vfs.zfs.arc.{min,max} MIBs Date: Thu, 10 Mar 2022 06:43:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: parv.0zero9+freebsd@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646894634; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=f7zeP5C6wG+yf1L+3B5vuFHQY5vyutSJfkd+qSOg0J4=; b=OZqQE+lgYg0RNAri9nwXzksOEBWIGZD5Y/g2veQdQZbK2LZ2qXrcM/THtVTFqirLRAXEC6 ba6SaK7mm4QTqxmGBYUOm/4Zv1Oo8nJUPV7XzmNC0/XKPOIzEabbM87yZHCv7tFuaxP5NZ RmTX+SYCde7dUxp2TmVOKTp7Nqw5tlQ1dYZRma589kXUWwoi+YIQH0BZEs7Yaandh3jGrk cyVuvic0ut5LGFiWvV2s7UY+ShiHC4PsRZocvwoYXaXLsAj4NQFAmimLyTJz7Afks+erCA eefbTQgPhCkmuw+DV0ZCz+/97sEfLVCDK+1+MuOzMXmUOYEUW5qjs/noBa6AbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646894634; a=rsa-sha256; cv=none; b=tJ4dKuwgH6AO3jMqtCRNRkWjsOrNe7h6YRt67NbhWulWn3D817ET8RJEMJtnIRfi4I1wKj nk+O61rzI7LsiSYeHvr2M0P0AGDDYXMuhjNAUCi7PZYyBPdwQmCHiDRRo6et6vkpgAtWAY QjXAMljQsNtXvp19E70lP3xJWYSJgiKUAxgnKUX/UOzG+YbAHOWT6VdiQwGSnCYOiV1eK5 2sBhQ8ujxz9lxYB8BfprQdycmO77H15f9IBPgr4HV3q19C8/zp86kdqGHcmf+II2J592ki GnFZScUqO1MW5cGXr9Bp3UqQsLBjeKkP3awugNfGnwoMnPdQoWHhuRxo09pimQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255611 parv changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events Status|New |Closed --- Comment #1 from parv --- I have lost interest for lack of progress; maintaining my own local patch. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 10 14:26:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8111719F6938 for ; Thu, 10 Mar 2022 14:26:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KDrwQ1pcHz3KYQ for ; Thu, 10 Mar 2022 14:26:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1A744266A6 for ; Thu, 10 Mar 2022 14:26:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22AEQUvw054042 for ; Thu, 10 Mar 2022 14:26:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22AEQUZN054041 for fs@FreeBSD.org; Thu, 10 Mar 2022 14:26:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Thu, 10 Mar 2022 14:26:30 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646922390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=pSa1JhZBD1Dw9mpA9iRe4XdOXMzMgZ5EoAK9Hl00gi8=; b=IzVC8oKUEQMrKF/GxNS770qXpbxvWQgPLw3rkhOMMNSM8prbOzuctvPYDGu3NP39wpgdA/ xMUhsgnn3NVdpVPREOlUOg0ex13QHQOnRS6QDriZYoOKpDKT35SAElHstGi7f8vCMK9n/a jbAgYW0/kS7hSCNHAl3vRVe+oSt0/LNL3aO0AeVWIcpRGUjryPX+K0PBF9ogO1ELzFelqW kPTerFIbNRILMPlo92sbCWwLGWjCItMJuWnTk/nGbCWFDKdxpcz361K6UUDRxQeQ5Tt7AW XhADRdrBalCBad3A9UDnClTzaAjnD6GzK7iHkSKJ7z/QtkgwPhV/gxLG1et5tg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646922390; a=rsa-sha256; cv=none; b=jxRsFm9TFiQrxCtzC4ORFVXGPKN5lRqScy88tuEJdeQr4YHzrU4m77G+3YEOG4ZNXRrS+L KPXtx1D/NYEXiSwSxyKZPCtXMlCLuqQbo8rXVtdv36XmYcN5D4xburQInaRQSuQTm9kV2a /Kb29hQlfHF64UnKYLURPI4/iyzJ+rI9JsSr8Jsc0kOKVUMtN7lLMjXlennNwSf/pMf36r PlYfRClp2DVMxIMvhC74DNeMMv5d9AGfgFoMDixf29nVfl+4vaxJo1r/vqn+JwPMb1EWCa Kt+klOWoEgODEBFV761d7X++n4BhEpXXJq0a4w+flDIwThm0b1ZzDgIs4GxwwA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Bug ID: 262468 Summary: (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Product: Base System Version: Unspecified Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: grahamperrin@gmail.com CC: fs@FreeBSD.org Condensed from in particular:=20 > Mar 9 15:36:17 mowa219-gjp4-8570p-freebsd kernel:=20 > Key file /usr/home/grahamperrin/Documents/personal/VirtualBox.key=20 > not found, empty or unreadable. Skipping Transcend/VirtualBox.. Workaround:=20 1. shutdown now 2. enter a shell e.g. the default /bin/sh 3. exit to multi-user mode In other words: the key file _is_ found, but not initially; not when requir= ed. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Mar 10 14:48:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4C89119FBDBF for ; Thu, 10 Mar 2022 14:48:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KDsPV4yLgz3NqX for ; Thu, 10 Mar 2022 14:48:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8A67026D3D for ; Thu, 10 Mar 2022 14:48:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22AEmEW9065880 for ; Thu, 10 Mar 2022 14:48:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22AEmEdN065879 for fs@FreeBSD.org; Thu, 10 Mar 2022 14:48:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Thu, 10 Mar 2022 14:48:14 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_file_loc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646923694; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eJs4auHEv3MGAEKOxXasxmI1die5JAmH2Bdif87QTLc=; b=de/7gi9R7CoHzXlm5l1hkeAE7JCt3WISDU9J3wykZQ4633eDzbbuojBaKTbcMlU/MGz5m8 GfAuvaFvv6+5tyxYYwvtcP+L/n1PS+0t56qmctcvRW+3B81mvXv9B48JRfwWw9W2nMdZIV f15KmKWNiIt0ZmJ79Jlo4nz/lfKTFswsrjnb5Plu1n9Y0gHWFBEnSbrATJO7Thgp78Xb+V fNOmcKXS417i6MMxqOMrCAidntxdTb9fyxMD7+g3giU8ENntZjvVCdYJvIr6d5MstcbKRL ppJJeOoayxzC3uTgFuItEwnt64ANgfYF9J+BOQUVokyedfqjd1QNGI9393D+GA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646923694; a=rsa-sha256; cv=none; b=cmQ8zhl5X9YnXig754G3mJ2cmMRovr6rprqP4jCIbuTqBKflXDRydbv1K6HAYIwMUkXg/q 2Mrcu91TQfqesuzhyyT8+govB09KER8mFJbQ/yuzR1XL6ccren8vmrS0F7mfG2vWst7y/l oLR9+B/vNRNIM9zRM4bfyl4MescihjdrPB8f+4krbHyZs2hHcjMsr7OczZ9eWmFeeVn2nn ONz1vyNbWHgjyYgj9AFFdKwl1Nkcco9NdGBlhIN2E5z070vfX1X2sgdxpsLDtXwRLOVQwr I/RjLHKVVJUmbYFLbD8yMVLuiC3MpL7QT2C7lxOJvBf2LGuEGnGVTmQ7irTNnw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |https://github.com/freebsd/ | |freebsd-src/commit/33ff3979 | |6ffe469a764e485ac49c31700a5 | |1fd6f --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Mar 10 15:40:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6124A1A06F3A for ; Thu, 10 Mar 2022 15:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KDtZ112GSz3lh6 for ; Thu, 10 Mar 2022 15:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0105E27664 for ; Thu, 10 Mar 2022 15:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22AFee6x096201 for ; Thu, 10 Mar 2022 15:40:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22AFeeTr096200 for fs@FreeBSD.org; Thu, 10 Mar 2022 15:40:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255611] patch to add units in description of vfs.zfs.arc.{min,max} MIBs Date: Thu, 10 Mar 2022 15:40:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646926841; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=U3QEuIXpoBr8wrfW580Os6Dd4d3nIOP7io4eXdWKWPI=; b=f2sPBig9uhVrc2iC8fXm9aIpFCYmQdaSSO2bfWvMzdk94E9bvGm5TCmv7f7Gz6kNMHZjxq VPmKpI0FC9QpYoD7GSd7F4H1b4FGLmoicn66AQe2kfT7IcH0gCtK20t0DuybNPyjlebOlm sbv5ywjltG0nNCNlCoPimPV6/UvATWmQ5Ase7qHwa3syZzRMGGHySoAyYtsM/qLFZ2yD0c h/QWmEeS6wPbl7aEtr6SYeRATQ8y/f3JU+a9PhtLCp5vgdQ1NTkQMLyLXlPvjD1c5XHwKy RqHGqjZRwG0AgBDAR5arOCCFZncmiBwF0hrKT7aAqJcHrVpjODVxhlPIj2lCbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646926841; a=rsa-sha256; cv=none; b=Z6mGm8YfaEluq6XrxGbuPZU2pcLZyk0QROBjLjxN9ZDu2jW7xePGI1Or+d2lUAsjySzAQR RchAOM7dkzwLt9RKeFonWtGQl2/xkMN3p5OjHbDJulxYwFh0jntinwHftLmppIlAjtNvJ6 7nNX+xKRpqMM2teP3d3iD+KxrfoRqiH91LQO2yEfc5Bh/AmjUoBvJ4aWc4ABabQ6BlBKX2 2cc4CmmEWdMNsM7+CQbEIsFdb6l+JPuQ8pGgnbL69wvetiZ50GV0+nr0Ztub2kHpUw+vdn fzi2OMyukbVidMutwpF0uoZJzUloPzJPYl42zDK1OGajoK16tkhhRVKafKQALw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255611 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #2 from Warner Losh --- For OpenZFS things, it's better to submit them to the OpenZFS upstream than= to FreeBSD where there's a great hesitancy to change the upstream code w/o a really good reason. sorry that you didn't get this feedback sooner. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Mar 13 21:00:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3DE121A26F98 for ; Sun, 13 Mar 2022 21:01:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KGsXC4stJz3D4h for ; Sun, 13 Mar 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6D48C20646 for ; Sun, 13 Mar 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22DL0xDW023777 for ; Sun, 13 Mar 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22DL0x2b023776 for fs@FreeBSD.org; Sun, 13 Mar 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202203132100.22DL0x2b023776@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 13 Mar 2022 21:00:59 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16472052591.bf70aebBc.20832" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647205260; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=bcD3gz5QHlfGiUc0CIbHCO8UUBwqc/7ya8IGEzNeKdM=; b=KN971Hy+9ZsEXMGsKVDHRm2f+jpLeotPcIXr0dmHUwXoPv3x1sUujrJOe0IuKGOK+Bet7V P+R9KHwD3Yd57X4khZIp0GQG77wMYsFfftRJW9ZgcU7bkbrKmtMV8dUJscRIlsTll2NCLZ IAZ6DaD/2WMw/Aad/rgXEo5aull7nMnVZcOQmEXhEaR+6JNbOVMXOAXzSbSDLl41P3pJUQ RjVIaVbOgdZufqgt4M+AgBANaYn3inT3rm/8b9tIjZE7K3UQlhJEZbsfhMrg+EwFRo6BpK NGco87Ug+MBRMu1eyZQ5m6H3wm1Hnwm3jvRrU0CNSGAjYOMlkc1Eg1MYdpcKlg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647205260; a=rsa-sha256; cv=none; b=Y6XOU91/deliylbgHy1uEKt1+PKIB5D8mSq1HvamX0x7Mv2GTyJZzCQHNyIBSKP3Q6arh+ U3lc9Sc+x1SwbDhgJa8dqmErTbcDG2QGONuPYUY3kslI5vRaQomap/C1tjqIyNfJ6jaIN3 AHyKWyuZcQQN3Cg4yFTY51hbnDcgZBlvWw5ECBd0B6LsFYLP++bQlok04a2YrEat0YRfZR dFaBFAlvlX1U3mKytk4kjp+xX/XhC6WFEyJ+eDAr+7w19qKUHd5MxxShEWM98IOtwQRIb1 xIr5WxCqCRLKVWuxcbknlueDt5+W5asw4iaZzmizewgfzb1cUOkfq3jbUnFCvQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16472052591.bf70aebBc.20832 Date: Sun, 13 Mar 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16472052591.bf70aebBc.20832 Date: Sun, 13 Mar 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16472052591.bf70aebBc.20832-- From nobody Mon Mar 14 11:24:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5547E1A2727B for ; Mon, 14 Mar 2022 11:24:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHDhm6tzBz4kfN for ; Mon, 14 Mar 2022 11:24:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CA0B34B00 for ; Mon, 14 Mar 2022 11:24:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22EBOetW096727 for ; Mon, 14 Mar 2022 11:24:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22EBOe12096726 for fs@FreeBSD.org; Mon, 14 Mar 2022 11:24:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Mon, 14 Mar 2022 11:24:40 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_severity version Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647257081; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bGwnDVw6t9t41OyWusLQwj6LudzbnY4mpmDlXDAGd+c=; b=TGofQyWjeHPI+VSOyi67NjvuZ5E6JQnhST0T8M0hsiyBOk6UUGc7JGilOx7CLn253J5UB1 A+Zh39nPzwk0bRkUpFDbeLtpA3EqYjTIBDL/Upegzt+zzJVDr1bgdw6ui+BzCFZi6R4+1x LrrD8b+VWTgwq53m/XABAeTurCV8j7dvMI+7d0NRzOsFgMYvl1WKXg//KKNi3h2admffLv h6WFhJwPt8k0nCsRq90JRSj/YbifaH35cVloo+DqhlGt7OukQLWmKArF3PQkSqrF5lpz9x i7hg/qNYbAPHahK4c7BxjD+TbCj5lxSaGbpH2QsIKF4ZYekafjb1eohgt2pCQQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647257081; a=rsa-sha256; cv=none; b=WJjZ26FzME4QlQcTawT6BicNDh7S2KcLd/dp/zk9udpgBv1yzSW8poVFN3YnuTwxc4+yn9 6of0tfRfrl5SjkBOvhQI/BZv5y8KiEjOMpDGFe1AWAvfAlQ5N8RxDbqLYjfMviisCq6ys0 Tjl0Z4GVykGLnv9WQk1zWMbzDHKuVUo+44EfSl6lPf8BdiFziumGqV4BFDUiTflALnfgdJ xUmT0OhtOXnvnXwmy0ZX2/zyiXe3oqCJozYxa5cypvK4zFuGEfmhfozkhLL/BPt3P9FxAj YzDmw7fmRFI2bf0oLjmbS3BcZqYmQq7Q3mFfJbbEPjAfo+xrv0ubn6he+WCLAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Affects Only Me |Affects Some People Version|Unspecified |13.1-RELEASE --- Comment #1 from Graham Perrin --- Cross-reference for release notes for 13.1.=20 Is kern the proper component for this bug?=20 freqlabs@ wrote (in the OpenZFS repo):=20 > The zfskeys script and other zfs rc sripts are part of FreeBSD. =E2=80=A6 > You'll want to get in touch with whoever wrote that =E2=80=A6 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Mar 14 14:27:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B337E1A228F6 for ; Mon, 14 Mar 2022 14:27:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHJmD2Gs5z3P7G for ; Mon, 14 Mar 2022 14:27:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 20E5C6F26 for ; Mon, 14 Mar 2022 14:27:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22EERub6097409 for ; Mon, 14 Mar 2022 14:27:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22EERu6U097408 for fs@FreeBSD.org; Mon, 14 Mar 2022 14:27:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Mon, 14 Mar 2022 14:27:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc component bug_status keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647268076; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WUoR1uuTzSSdTdgGaD0HrBNWdNwzR9ZJfcp43ZXKNsE=; b=lpiWQTv2Tr3At0Gr3eZpXQxCoBWqL9RTgrZiowwZDNPEUsoYAIB/3e0LMAW+MOfuV2dPK2 B0YvMkqVjLmyzhLDZMCDJi3RQ5RH3AR+2wMQ/FCZPsogxiXqTEcY/trMKo2gH+1iFSoH4p t9U0BR272dRudF97jEhlJcMAASCOfmzeQtNnzeaOON7C8VKutxd1Cn/Nl/CwvKvW9XWJcn YEcXeWVY0oIUnS4aKtKgAs9NZ12M2hOkIa3AYjYv7VvJjiSWysHsQyrc91e7MHRgX41mnE BHQmdbLfTBJlNMCaG+/2gqvErJmg0LQxXXWYNF3z5M1ZQCBZh1cIDVuDWYLkJQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647268076; a=rsa-sha256; cv=none; b=iitW1zUcXg1S8nLnl7Y/3bXU+Dz2qfV7GiB2RCG+YnfqzWrvsTNkO5fFzx7vhUArI/5R8b KZMfXrRUMP0cvDCZMde/OaQssxorX+X8v7tpGwzlIjaNf2VDIILS2sCjftQ/SNH7REIoph X7gGANeMwQVdA5JlopdMP2pNe2FqZgK9MMJOle4gU3socUSodBdoBWY0BF7PZBnqbSULc1 CqA/D7mfaMivXUpMHLPnP73dIck8Mi9dEGMYn7qdjZwZk5zZe10X2zNnRiYyMsY3VtoxnV 0Fo+5drBrCpvFzSh6l05zJT/nbRMw0IQ/xfVIYWQ83y5GwoOKqmuC+zTEbde9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |0mp@FreeBSD.org Component|kern |misc Status|New |Open Keywords| |needs-patch --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Mar 14 18:47:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 81EFD1A0C7DC for ; Mon, 14 Mar 2022 18:47:43 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHQWy3Dknz4qLm for ; Mon, 14 Mar 2022 18:47:42 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 22EIlYnP051545 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Mon, 14 Mar 2022 14:47:35 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:452:1a6f:9d09:607] ([IPv6:2607:f3e0:0:4:452:1a6f:9d09:607]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 22EIlY2E079070 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Mon, 14 Mar 2022 14:47:34 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <108defea-700e-d1e0-e210-d32a8af5e8f0@sentex.net> Date: Mon, 14 Mar 2022 14:47:35 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Content-Language: en-US To: freebsd-fs From: mike tancsa Subject: ctl.conf / iscsi docs and best practices Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KHQWy3Dknz4qLm X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[sentex.net]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N Looking at diving deeper into FreeBSD as an iscsi target and initiator, but more so as a target server.  Looking at the handbook, there are not a lot of docs there and the sample ctl.conf entries dont really follow the style of the example ctl.conf file generated by something like TrueNAS.  Are there any better FreeBSD docs out there ? Anyone have any decent go to docs around iscsi in general that are good primers as well ? My goal is to serve up storage for a bunch of Linux KVM initiators with the iscsi targets on FreeBSD being zvols. e.g. in TrueNAS, I see it define a bunch of individual LUNs and then targets as so. lun "freebsd2" {         ctl-lun "1"         path "/dev/zvol/tankstripe/freebsd2"         blocksize "512"         serial "000743299890001"         device-id "iSCSI Disk      000743299890001 "         option "vendor" "TrueNAS"         option "product" "iSCSI Disk"         option "revision" "0123"         option "naa" "0x6589cfc000000c330e3ddde42a36408a"         option "insecure_tpc" "on"         option "rpm" "1" } lun "freebsd3" {         ctl-lun "2"         path "/dev/zvol/tankstripe/freebsd3"         blocksize "4096"         serial "000743299890002"         device-id "iSCSI Disk      000743299890002 "         option "vendor" "TrueNAS"         option "product" "iSCSI Disk"         option "revision" "0123"         option "naa" "0x6589cfc0000001cd46c021f21b31d0cc"         option "insecure_tpc" "on"         option "rpm" "1" } Then define more LUNs in the targets that reference the above LUNs target "iqn.2005-10.org.freenas.ctl:freebsd2" {         alias "freebsd2"         portal-group "pg1" "ag4tg2_2"         lun "0" "freebsd2" } target "iqn.2005-10.org.freenas.ctl:freebsd3" {         alias "freebsd3"         portal-group "pg1" "ag4tg3_3"         lun "0" "freebsd3" } So the lun that refers to the block of storage also has a ctl-lun that seems to be uniq. What is the purpose of that ? Same with serial #s and Device-IDs. Are these merely informational or are they a requirement for something ? If multiple initiators are to have sessions to the target, with only one actively writing to it, are there any special options I need to set ? I also noticed in ctladm are several cache sync options.  My go - to zfs replication software is zrepl which has hooks that can be fired before and after a snapshot.  Do I want to send some sort of cache flush command to the target ? Or is that the guest OS' responsibility to do a sync that that the snapshot is coherent as possible. Thanks for any pointers.     ---Mike From nobody Mon Mar 14 19:00:11 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B3B331A0FB8C for ; Mon, 14 Mar 2022 19:00:24 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHQpb6Nydz4s5k for ; Mon, 14 Mar 2022 19:00:23 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-675-AZ6RX6ujPs-KTLBKpaZXdw-1; Mon, 14 Mar 2022 15:00:13 -0400 X-MC-Unique: AZ6RX6ujPs-KTLBKpaZXdw-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Mon, 14 Mar 2022 15:00:12 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Mon, 14 Mar 2022 15:00:12 -0400 From: Michael Jung To: mike tancsa , freebsd-fs Subject: RE: ctl.conf / iscsi docs and best practices Thread-Topic: ctl.conf / iscsi docs and best practices Thread-Index: AQHYN9UFjKE2dPgbAkG80ppi0/Mx+Ky/O0bQ Date: Mon, 14 Mar 2022 19:00:11 +0000 Message-ID: <76fdc117f673476189d3fd7a2424c76e@MAIL-HUB.pai.local> References: <108defea-700e-d1e0-e210-d32a8af5e8f0@sentex.net> In-Reply-To: <108defea-700e-d1e0-e210-d32a8af5e8f0@sentex.net> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Type: multipart/alternative; boundary="MCBoundary=_12203141500149031" X-Rspamd-Queue-Id: 4KHQpb6Nydz4s5k X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-1.01 / 15.00]; ARC_NA(0.00)[]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_SPAM_MEDIUM(0.69)[0.685]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.129.197:from]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[170.10.129.197:from]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; NEURAL_HAM_SHORT(-1.00)[-0.997]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --MCBoundary=_12203141500149031 Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 SSBqdXN0IHN0YXJ0ZWQgd29ya2luZyB3aXRoIHRoZSB0YXJnZXQgYWdhaW4gYWJvdXQgYSB3ZWVr IGFnbywgaGVyZSBpcyBteSBzZXR1cC4NCg0KRm9yIHR3byByZW1vdGUgaW5pdGlhdG9ycyB0byBj b25uZWN0IHRvIHRoZSBzYW1lIHRhcmdldCB5b3UgbmVlZA0Kb3B0aW9uICJoYSBzaGFyZWQiICJv biINCg0KTWF5YmUgdGhpcyBoZWxwcyB5b3UgYSBsaXR0bGUuDQoNCi0tbWlrZWoNCg0KcG9ydGFs LWdyb3VwICJwZzAiIHsNCiAgICAgICAgZGlzY292ZXJ5LWF1dGgtZ3JvdXAgIm5vLWF1dGhlbnRp Y2F0aW9uIg0KICAgICAgICBsaXN0ZW4gIjE5Mi4xNjguNi4xMTozMjYwIg0KICAgICAgICBsaXN0 ZW4gIls6Ol06MzI2MCINCiAgICAgICAgb3B0aW9uICJoYV9zaGFyZWQiICJvbiINCn0NCg0KDQph dXRoLWdyb3VwICJhZzAiIHsNCiAgICAgICAgaW5pdGlhdG9yLW5hbWUgImlxbi4xOTk4LTAxLmNv bS52bXdhcmU6aHYxLTM5NzJlYWYzIg0KICAgICAgICBpbml0aWF0b3ItbmFtZSAiaXFuLjE5OTgt MDEuY29tLnZtd2FyZTplc3hpMi5taWtlai5sb2NhbDo5ODA2MTMzNDU6NjQiDQogICAgICAgIGlu aXRpYXRvci1uYW1lICJpcW4uMTk5OC0wMS5jb20udm13YXJlOmVzeGkzLm1pa2VqLmxvY2FsLjox ODA1NjkwMDExOjY0Ig0KICAgICAgICBpbml0aWF0b3ItcG9ydGFsICIxOTIuMTY4LjYuOCINCiAg ICAgICAgaW5pdGlhdG9yLXBvcnRhbCAiMTkyLjE2OC42LjE0Ig0KICAgICAgICBpbml0aWF0b3It cG9ydGFsICIxOTIuMTY4LjYuNSINCiAgICAgICAgYXV0aC10eXBlICJub25lIg0KfQ0KDQoNCmF1 dGgtZ3JvdXAgImFnMSIgew0KICAgICAgICBpbml0aWF0b3ItbmFtZSAiaXFuLjE5OTQtMDUuY29t LnVuaXRyZW5kczo2MGUyZjFkMTVlNTciDQogICAgICAgIGluaXRpYXRvci1wb3J0YWwgIjE5Mi4x NjguNi45Ig0KICAgICAgICBhdXRoLXR5cGUgIm5vbmUiDQp9DQoNCg0KbHVuICJlc3hpLXN0b3Jl MSIgew0KICAgICAgICBwYXRoICIvZGV2L3p2b2wvcmFpZC01NDAwLTEvZXN4aS1zdG9yZTEiDQog ICAgICAgIGJsb2Nrc2l6ZSAiNTEyIg0KICAgICAgICBzZXJpYWwgIllFQUggUklHSFQiDQogICAg ICAgIGRldmljZS1pZCAiaVNDU0kgRGlzayINCiAgICAgICAgb3B0aW9uICJ2ZW5kb3IiICJNaWtl SiINCiAgICAgICAgb3B0aW9uICJwcm9kdWN0IiAiaVNDU0kgRGlzayINCiAgICAgICAgb3B0aW9u ICJyZXZpc2lvbiIgIjAxMjMiDQogICAgICAgIG9wdGlvbiAibmFhIiAiMHg2NTg5Y2ZjMDAwMDAw NzllOGEwZDIyM2U5MzU0NDBhYiINCiAgICAgICAgb3B0aW9uICJpbnNlY3VyZV90cGMiICJvbiIN CiAgICAgICAgb3B0aW9uICJycG0iICIxIg0KfQ0KDQpsdW4gInVuaXRyZW5kczEiIHsNCiAgICAg ICAgcGF0aCAiL2Rldi96dm9sL3JhaWQtNTQwMC0xL3VuaXRyZW5kczEiDQogICAgICAgIGJsb2Nr c2l6ZSAiNTEyIg0KICAgICAgICBzZXJpYWwgIllFQUggUklHSFQiDQogICAgICAgIGRldmljZS1p ZCAiaVNDU0kgRGlzayINCiAgICAgICAgb3B0aW9uICJ2ZW5kb3IiICJNaWtlSiINCiAgICAgICAg b3B0aW9uICJwcm9kdWN0IiAiaVNDU0kgRGlzayINCiAgICAgICAgb3B0aW9uICJyZXZpc2lvbiIg IjAxMjMiDQogICAgICAgIG9wdGlvbiAibmFhIiAiMHg2NTg5Y2ZjMDAwMDAwNzllOGEwZDIyM2U5 MzU0NDBhYyINCiAgICAgICAgb3B0aW9uICJpbnNlY3VyZV90cGMiICJvbiINCiAgICAgICAgb3B0 aW9uICJycG0iICIxIg0KfQ0KDQoNCg0KdGFyZ2V0ICJpcW4uMjAwNS0xMC5vcmcubWlrZWouY3Rs OmVzeGktc3RvcmUxIiB7DQogICAgICAgIGF1dGgtZ3JvdXAgImFnMCINCiAgICAgICAgcG9ydGFs LWdyb3VwICJwZzAiDQogICAgICAgIGFsaWFzICJlc3hpLXN0b3JlMSINCiAgICAgICAgbHVuICIw IiAiZXN4aS1zdG9yZTEiDQp9DQoNCnRhcmdldCAiaXFuLjE5OTQtMDUuY29tLnVuaXRyZW5kczo2 MGUyZjFkMTVlNTciIHsNCiAgICAgICAgYXV0aC1ncm91cCAiYWcxIg0KICAgICAgICBwb3J0YWwt Z3JvdXAgInBnMCINCiAgICAgICAgYWxpYXMgInVuaXRyZW5zMTEiDQogICAgICAgIGx1biAiMSIg InVuaXRyZW5kczEiDQp9DQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9tOiBvd25l ci1mcmVlYnNkLWZzQGZyZWVic2Qub3JnIFttYWlsdG86b3duZXItZnJlZWJzZC1mc0BmcmVlYnNk Lm9yZ10gT24gQmVoYWxmIE9mIG1pa2UgdGFuY3NhDQpTZW50OiBNb25kYXksIE1hcmNoIDE0LCAy MDIyIDI6NDggUE0NClRvOiBmcmVlYnNkLWZzIDxmcmVlYnNkLWZzQGZyZWVic2Qub3JnPg0KU3Vi amVjdDogY3RsLmNvbmYgLyBpc2NzaSBkb2NzIGFuZCBiZXN0IHByYWN0aWNlcw0KDQpMb29raW5n IGF0IGRpdmluZyBkZWVwZXIgaW50byBGcmVlQlNEIGFzIGFuIGlzY3NpIHRhcmdldCBhbmQgaW5p dGlhdG9yLCBidXQgbW9yZSBzbyBhcyBhIHRhcmdldCBzZXJ2ZXIuICBMb29raW5nIGF0IHRoZSBo YW5kYm9vaywgdGhlcmUgYXJlIG5vdCBhIGxvdCBvZiBkb2NzIHRoZXJlIGFuZCB0aGUgc2FtcGxl IGN0bC5jb25mIGVudHJpZXMgZG9udCByZWFsbHkgZm9sbG93IHRoZSBzdHlsZSBvZiB0aGUgZXhh bXBsZSBjdGwuY29uZiBmaWxlIGdlbmVyYXRlZCBieSBzb21ldGhpbmcgbGlrZSBUcnVlTkFTLiAg QXJlIHRoZXJlIGFueSBiZXR0ZXIgRnJlZUJTRCBkb2NzIG91dCB0aGVyZSA/IEFueW9uZSBoYXZl IGFueSBkZWNlbnQgZ28gdG8gZG9jcyBhcm91bmQgaXNjc2kgaW4gZ2VuZXJhbCB0aGF0IGFyZSBn b29kIHByaW1lcnMgYXMgd2VsbCA/IE15IGdvYWwgaXMgdG8gc2VydmUgdXAgc3RvcmFnZSBmb3Ig YSBidW5jaCBvZiBMaW51eCBLVk0gaW5pdGlhdG9ycyB3aXRoIHRoZSBpc2NzaSB0YXJnZXRzIG9u IEZyZWVCU0QgYmVpbmcgenZvbHMuDQoNCmUuZy4gaW4gVHJ1ZU5BUywgSSBzZWUgaXQgZGVmaW5l IGEgYnVuY2ggb2YgaW5kaXZpZHVhbCBMVU5zIGFuZCB0aGVuIHRhcmdldHMgYXMgc28uDQoNCmx1 biAiZnJlZWJzZDIiIHsNCiAgICAgICAgIGN0bC1sdW4gIjEiDQogICAgICAgICBwYXRoICIvZGV2 L3p2b2wvdGFua3N0cmlwZS9mcmVlYnNkMiINCiAgICAgICAgIGJsb2Nrc2l6ZSAiNTEyIg0KICAg ICAgICAgc2VyaWFsICIwMDA3NDMyOTk4OTAwMDEiDQogICAgICAgICBkZXZpY2UtaWQgImlTQ1NJ IERpc2sgICAgICAwMDA3NDMyOTk4OTAwMDEgIg0KICAgICAgICAgb3B0aW9uICJ2ZW5kb3IiICJU cnVlTkFTIg0KICAgICAgICAgb3B0aW9uICJwcm9kdWN0IiAiaVNDU0kgRGlzayINCiAgICAgICAg IG9wdGlvbiAicmV2aXNpb24iICIwMTIzIg0KICAgICAgICAgb3B0aW9uICJuYWEiICIweDY1ODlj ZmMwMDAwMDBjMzMwZTNkZGRlNDJhMzY0MDhhIg0KICAgICAgICAgb3B0aW9uICJpbnNlY3VyZV90 cGMiICJvbiINCiAgICAgICAgIG9wdGlvbiAicnBtIiAiMSINCn0NCg0KbHVuICJmcmVlYnNkMyIg ew0KICAgICAgICAgY3RsLWx1biAiMiINCiAgICAgICAgIHBhdGggIi9kZXYvenZvbC90YW5rc3Ry aXBlL2ZyZWVic2QzIg0KICAgICAgICAgYmxvY2tzaXplICI0MDk2Ig0KICAgICAgICAgc2VyaWFs ICIwMDA3NDMyOTk4OTAwMDIiDQogICAgICAgICBkZXZpY2UtaWQgImlTQ1NJIERpc2sgICAgICAw MDA3NDMyOTk4OTAwMDIgIg0KICAgICAgICAgb3B0aW9uICJ2ZW5kb3IiICJUcnVlTkFTIg0KICAg ICAgICAgb3B0aW9uICJwcm9kdWN0IiAiaVNDU0kgRGlzayINCiAgICAgICAgIG9wdGlvbiAicmV2 aXNpb24iICIwMTIzIg0KICAgICAgICAgb3B0aW9uICJuYWEiICIweDY1ODljZmMwMDAwMDAxY2Q0 NmMwMjFmMjFiMzFkMGNjIg0KICAgICAgICAgb3B0aW9uICJpbnNlY3VyZV90cGMiICJvbiINCiAg ICAgICAgIG9wdGlvbiAicnBtIiAiMSINCn0NCg0KVGhlbiBkZWZpbmUgbW9yZSBMVU5zIGluIHRo ZSB0YXJnZXRzIHRoYXQgcmVmZXJlbmNlIHRoZSBhYm92ZSBMVU5zDQoNCnRhcmdldCAiaXFuLjIw MDUtMTAub3JnLmZyZWVuYXMuY3RsOmZyZWVic2QyIiB7DQogICAgICAgICBhbGlhcyAiZnJlZWJz ZDIiDQogICAgICAgICBwb3J0YWwtZ3JvdXAgInBnMSIgImFnNHRnMl8yIg0KDQogICAgICAgICBs dW4gIjAiICJmcmVlYnNkMiINCn0NCg0KdGFyZ2V0ICJpcW4uMjAwNS0xMC5vcmcuZnJlZW5hcy5j dGw6ZnJlZWJzZDMiIHsNCiAgICAgICAgIGFsaWFzICJmcmVlYnNkMyINCiAgICAgICAgIHBvcnRh bC1ncm91cCAicGcxIiAiYWc0dGczXzMiDQoNCiAgICAgICAgIGx1biAiMCIgImZyZWVic2QzIg0K fQ0KDQoNClNvIHRoZSBsdW4gdGhhdCByZWZlcnMgdG8gdGhlIGJsb2NrIG9mIHN0b3JhZ2UgYWxz byBoYXMgYSBjdGwtbHVuIHRoYXQgc2VlbXMgdG8gYmUgdW5pcS4gV2hhdCBpcyB0aGUgcHVycG9z ZSBvZiB0aGF0ID8gU2FtZSB3aXRoIHNlcmlhbCAjcyBhbmQgRGV2aWNlLUlEcy4gQXJlIHRoZXNl IG1lcmVseSBpbmZvcm1hdGlvbmFsIG9yIGFyZSB0aGV5IGEgcmVxdWlyZW1lbnQgZm9yIHNvbWV0 aGluZyA/DQoNCklmIG11bHRpcGxlIGluaXRpYXRvcnMgYXJlIHRvIGhhdmUgc2Vzc2lvbnMgdG8g dGhlIHRhcmdldCwgd2l0aCBvbmx5IG9uZSBhY3RpdmVseSB3cml0aW5nIHRvIGl0LCBhcmUgdGhl cmUgYW55IHNwZWNpYWwgb3B0aW9ucyBJIG5lZWQgdG8gc2V0ID8NCg0KSSBhbHNvIG5vdGljZWQg aW4gY3RsYWRtIGFyZSBzZXZlcmFsIGNhY2hlIHN5bmMgb3B0aW9ucy4gIE15IGdvIC0gdG8gemZz IHJlcGxpY2F0aW9uIHNvZnR3YXJlIGlzIHpyZXBsIHdoaWNoIGhhcyBob29rcyB0aGF0IGNhbiBi ZSBmaXJlZCBiZWZvcmUgYW5kIGFmdGVyIGEgc25hcHNob3QuICBEbyBJIHdhbnQgdG8gc2VuZCBz b21lIHNvcnQgb2YgY2FjaGUgZmx1c2ggY29tbWFuZCB0byB0aGUgdGFyZ2V0ID8gT3IgaXMgdGhh dCB0aGUgZ3Vlc3QgT1MnIHJlc3BvbnNpYmlsaXR5IHRvIGRvIGEgc3luYyB0aGF0IHRoYXQgdGhl IHNuYXBzaG90IGlzIGNvaGVyZW50IGFzIHBvc3NpYmxlLg0KDQpUaGFua3MgZm9yIGFueSBwb2lu dGVycy4NCg0KICAgICAtLS1NaWtlDQoNCg0KDQoNCg0KQ09ORklERU5USUFMSVRZIE5PVEU6IFRo aXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0aGUgdXNlDQpvZiB0aGUgaW5kaXZpZHVh bCBvciBlbnRpdHkgdG8gd2hvbSBpdCBpcyBhZGRyZXNzZWQgYW5kIG1heQ0KY29udGFpbiBpbmZv cm1hdGlvbiB0aGF0IGlzIHByaXZpbGVnZWQsIGNvbmZpZGVudGlhbCwgYW5kDQpleGVtcHQgZnJv bSBkaXNjbG9zdXJlIHVuZGVyIGFwcGxpY2FibGUgbGF3LiBJZiB0aGUgcmVhZGVyDQpvZiB0aGlz IG1lc3NhZ2UgaXMgbm90IHRoZSBpbnRlbmRlZCByZWNpcGllbnQsIHlvdSBhcmUgaGVyZWJ5DQpu b3RpZmllZCB0aGF0IGFueSBkaXNzZW1pbmF0aW9uLCBkaXN0cmlidXRpb24gb3IgY29weWluZw0K b2YgdGhpcyBjb21tdW5pY2F0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQuIElmIHlvdSBoYXZl DQpyZWNlaXZlZCB0aGlzIHRyYW5zbWlzc2lvbiBpbiBlcnJvciwgcGxlYXNlIG5vdGlmeSB1cyBi eQ0KdGVsZXBob25lIGF0ICg1MDIpIDIxMi00MDAwIG9yIG5vdGlmeSB1cyBhdCBQQUksIERlcHQu IDk5LA0KMjEwMSBIaWdoIFdpY2toYW0gUGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kg NDAyNDUNCg0KRGlzY2xhaW1lcg0KDQpUaGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMg Y29tbXVuaWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRl bmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXpl ZCB0byByZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhl cmVieSBub3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24g b3IgdGFraW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZv cm1hdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQoNClRo aXMgZW1haWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1h eSBoYXZlIGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIg aW4gZW1haWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0 ZXMgZW1haWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5l c3MgdHJhaW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFs IGNhcGFiaWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3Jn YW5pemF0aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hu b2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBh IG1vcmUgcmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0 ZS4NCg== --MCBoundary=_12203141500149031 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8 I just started working with the target again about = a week ago, here is my setup.

For two remote initiators to connect to the same target you need
option "ha shared" "on"

Maybe this helps you a little.

--mikej

portal-group "pg0" {
discovery-auth-group "no-authentication"
listen "192.168.6.11:3260"
listen "[::]:3260"
option "ha_shared" "on"
}


auth-group "ag0" {
initiator-name "iqn.1998-01.com.vmware:hv1-3972eaf3"
initiator-name "iqn.1998-01.com.vmware:esxi2.mikej.local:98061= 3345:64"
initiator-name "iqn.1998-01.com.vmware:esxi3.mikej.local.:1805= 690011:64"
initiator-portal "192.168.6.8"
initiator-portal "192.168.6.14"
initiator-portal "192.168.6.5"
auth-type "none"
}


auth-group "ag1" {
initiator-name "iqn.1994-05.com.unitrends:60e2f1d15e57" initiator-portal "192.168.6.9"
auth-type "none"
}


lun "esxi-store1" {
path "/dev/zvol/raid-5400-1/esxi-store1"
blocksize "512"
serial "YEAH RIGHT"
device-id "iSCSI Disk"
option "vendor" "MikeJ"
option "product" "iSCSI Disk"
option "revision" "0123"
option "naa" "0x6589cfc00000079e8a0d223e935440ab&quo= t;
option "insecure_tpc" "on"
option "rpm" "1"
}

lun "unitrends1" {
path "/dev/zvol/raid-5400-1/unitrends1"
blocksize "512"
serial "YEAH RIGHT"
device-id "iSCSI Disk"
option "vendor" "MikeJ"
option "product" "iSCSI Disk"
option "revision" "0123"
option "naa" "0x6589cfc00000079e8a0d223e935440ac&quo= t;
option "insecure_tpc" "on"
option "rpm" "1"
}



target "iqn.2005-10.org.mikej.ctl:esxi-store1" {
auth-group "ag0"
portal-group "pg0"
alias "esxi-store1"
lun "0" "esxi-store1"
}

target "iqn.1994-05.com.unitrends:60e2f1d15e57" {
auth-group "ag1"
portal-group "pg0"
alias "unitrens11"
lun "1" "unitrends1"
}

-----Original Message-----
From: owner-freebsd-fs@free= bsd.org [mailto:owner-freebsd-fs@freebsd.org] On Behalf Of mike tancsa<= BR> Sent: Monday, March 14, 2022 2:48 PM
To: freebsd-fs <freebsd-fs@freebsd.org>
Subject: ctl.conf / iscsi docs and best practices

Looking at diving deeper into FreeBSD as an iscsi target and initiator, but= more so as a target server. Looking at the handbook, there are not a lot = of docs there and the sample ctl.conf entries dont really follow the style = of the example ctl.conf file generated by something like TrueNAS. Are ther= e any better FreeBSD docs out there ? Anyone have any decent go to docs aro= und iscsi in general that are good primers as well ? My goal is to serve up= storage for a bunch of Linux KVM initiators with the iscsi targets on Free= BSD being zvols.

e.g. in TrueNAS, I see it define a bunch of individual LUNs and then target= s as so.

lun "freebsd2" {
ctl-lun "1"
path "/dev/zvol/tankstripe/freebsd2"
blocksize "512"
serial "000743299890001"
device-id "iSCSI Disk 000743299890001 "
option "vendor" "TrueNAS"
option "product" "iSCSI Disk"
option "revision" "0123"
option "naa" "0x6589cfc000000c330e3ddde42a36408a&qu= ot;
option "insecure_tpc" "on"
option "rpm" "1"
}

lun "freebsd3" {
ctl-lun "2"
path "/dev/zvol/tankstripe/freebsd3"
blocksize "4096"
serial "000743299890002"
device-id "iSCSI Disk 000743299890002 "
option "vendor" "TrueNAS"
option "product" "iSCSI Disk"
option "revision" "0123"
option "naa" "0x6589cfc0000001cd46c021f21b31d0cc&qu= ot;
option "insecure_tpc" "on"
option "rpm" "1"
}

Then define more LUNs in the targets that reference the above LUNs

target "iqn.2005-10.org.freenas.ctl:freebsd2" {
alias "freebsd2"
portal-group "pg1" "ag4tg2_2"

lun "0" "freebsd2"
}

target "iqn.2005-10.org.freenas.ctl:freebsd3" {
alias "freebsd3"
portal-group "pg1" "ag4tg3_3"

lun "0" "freebsd3"
}


So the lun that refers to the block of storage also has a ctl-lun that seem= s to be uniq. What is the purpose of that ? Same with serial #s and Device-= IDs. Are these merely informational or are they a requirement for something= ?

If multiple initiators are to have sessions to the target, with only one ac= tively writing to it, are there any special options I need to set ?

I also noticed in ctladm are several cache sync options. My go - to zfs re= plication software is zrepl which has hooks that can be fired before and af= ter a snapshot. Do I want to send some sort of cache flush command to the = target ? Or is that the guest OS' responsibility to do a sync that that the= snapshot is coherent as possible.

Thanks for any pointers.

---Mike





CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245


<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--MCBoundary=_12203141500149031-- From nobody Mon Mar 14 19:12:30 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2073F1A1265F for ; Mon, 14 Mar 2022 19:12:32 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHR4b2wwHz4vGB for ; Mon, 14 Mar 2022 19:12:31 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 22EJCUiV077700 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Mon, 14 Mar 2022 15:12:30 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:452:1a6f:9d09:607] ([IPv6:2607:f3e0:0:4:452:1a6f:9d09:607]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 22EJCUma085741 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 14 Mar 2022 15:12:30 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <126d56d2-1b1e-6717-4b9c-5dd7bae9985e@sentex.net> Date: Mon, 14 Mar 2022 15:12:30 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: ctl.conf / iscsi docs and best practices Content-Language: en-US To: Michael Jung , freebsd-fs References: <108defea-700e-d1e0-e210-d32a8af5e8f0@sentex.net> <76fdc117f673476189d3fd7a2424c76e@MAIL-HUB.pai.local> From: mike tancsa In-Reply-To: <76fdc117f673476189d3fd7a2424c76e@MAIL-HUB.pai.local> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KHR4b2wwHz4vGB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.38 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 3/14/2022 3:00 PM, Michael Jung wrote: > I just started working with the target again about a week ago, here is > my setup. > > For two remote initiators to connect to the same target you need > option "ha shared" "on" > > Maybe this helps you a little. > It does, thank you!!  Couple of questions below. > auth-group "ag0" { > initiator-name "iqn.1998-01.com.vmware:hv1-3972eaf3" > initiator-name "iqn.1998-01.com.vmware:esxi2.mikej.local:980613345:64" > initiator-name "iqn.1998-01.com.vmware:esxi3.mikej.local.:1805690011:64" > initiator-portal "192.168.6.8" > initiator-portal "192.168.6.14" > initiator-portal "192.168.6.5" > auth-type "none" > } > For the above auth group, for the portal IPs I guess this means those users are only allowed to connect from those IP addresses but you cant restrict a user to a specific IP ? > > option "naa" "0x6589cfc00000079e8a0d223e935440ab" > the naa is just a uniq identifier ? Who / what makes use of that ? A quick google says its just used to identify the serial #. Why / when would I want to do that ? In the two targets below, why use lun "0" and why lun "1" in the second target ? From the config I generated from TrueNAS, it kept the lun as "0" for each target. Just convention ? Thanks again!     ---Mike > > > target "iqn.2005-10.org.mikej.ctl:esxi-store1" { > auth-group "ag0" > portal-group "pg0" > alias "esxi-store1" > lun "0" "esxi-store1" > } > > target "iqn.1994-05.com.unitrends:60e2f1d15e57" { > auth-group "ag1" > portal-group "pg0" > alias "unitrens11" > lun "1" "unitrends1" > } > From nobody Mon Mar 14 19:36:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 67A5B1A18807 for ; Mon, 14 Mar 2022 19:37:01 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.133.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHRcr5PY0z3FP0 for ; Mon, 14 Mar 2022 19:37:00 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-64-0SvAzxddM0WCkzEBAv9Lbw-1; Mon, 14 Mar 2022 15:36:51 -0400 X-MC-Unique: 0SvAzxddM0WCkzEBAv9Lbw-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Mon, 14 Mar 2022 15:36:50 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Mon, 14 Mar 2022 15:36:50 -0400 From: Michael Jung To: mike tancsa , freebsd-fs Subject: RE: ctl.conf / iscsi docs and best practices Thread-Topic: ctl.conf / iscsi docs and best practices Thread-Index: AQHYN9UFjKE2dPgbAkG80ppi0/Mx+Ky/O0bQgABHBAD//73z8A== Date: Mon, 14 Mar 2022 19:36:50 +0000 Message-ID: References: <108defea-700e-d1e0-e210-d32a8af5e8f0@sentex.net> <76fdc117f673476189d3fd7a2424c76e@MAIL-HUB.pai.local> <126d56d2-1b1e-6717-4b9c-5dd7bae9985e@sentex.net> In-Reply-To: <126d56d2-1b1e-6717-4b9c-5dd7bae9985e@sentex.net> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Type: multipart/alternative; boundary="MCBoundary=_12203141536530841" X-Rspamd-Queue-Id: 4KHRcr5PY0z3FP0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.133.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.978]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.133.197:from]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.197:from] X-ThisMailContainsUnwantedMimeParts: N --MCBoundary=_12203141536530841 Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 DQpJTkxJTkUNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9tOiBtaWtlIHRhbmNzYSBb bWFpbHRvOm1pa2VAc2VudGV4Lm5ldF0NClNlbnQ6IE1vbmRheSwgTWFyY2ggMTQsIDIwMjIgMzox MyBQTQ0KVG86IE1pY2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5jb20+OyBm cmVlYnNkLWZzIDxmcmVlYnNkLWZzQGZyZWVic2Qub3JnPg0KU3ViamVjdDogUmU6IGN0bC5jb25m IC8gaXNjc2kgZG9jcyBhbmQgYmVzdCBwcmFjdGljZXMNCg0KT24gMy8xNC8yMDIyIDM6MDAgUE0s IE1pY2hhZWwgSnVuZyB3cm90ZToNCj4gSSBqdXN0IHN0YXJ0ZWQgd29ya2luZyB3aXRoIHRoZSB0 YXJnZXQgYWdhaW4gYWJvdXQgYSB3ZWVrIGFnbywgaGVyZSBpcw0KPiBteSBzZXR1cC4NCj4NCj4g Rm9yIHR3byByZW1vdGUgaW5pdGlhdG9ycyB0byBjb25uZWN0IHRvIHRoZSBzYW1lIHRhcmdldCB5 b3UgbmVlZA0KPiBvcHRpb24gImhhIHNoYXJlZCIgIm9uIg0KPg0KPiBNYXliZSB0aGlzIGhlbHBz IHlvdSBhIGxpdHRsZS4NCj4NCkl0IGRvZXMsIHRoYW5rIHlvdSEhICBDb3VwbGUgb2YgcXVlc3Rp b25zIGJlbG93Lg0KDQoNCj4gYXV0aC1ncm91cCAiYWcwIiB7DQo+IGluaXRpYXRvci1uYW1lICJp cW4uMTk5OC0wMS5jb20udm13YXJlOmh2MS0zOTcyZWFmMyINCj4gaW5pdGlhdG9yLW5hbWUgImlx bi4xOTk4LTAxLmNvbS52bXdhcmU6ZXN4aTIubWlrZWoubG9jYWw6OTgwNjEzMzQ1OjY0Ig0KPiBp bml0aWF0b3ItbmFtZSAiaXFuLjE5OTgtMDEuY29tLnZtd2FyZTplc3hpMy5taWtlai5sb2NhbC46 MTgwNTY5MDAxMTo2NCINCj4gaW5pdGlhdG9yLXBvcnRhbCAiMTkyLjE2OC42LjgiDQo+IGluaXRp YXRvci1wb3J0YWwgIjE5Mi4xNjguNi4xNCINCj4gaW5pdGlhdG9yLXBvcnRhbCAiMTkyLjE2OC42 LjUiDQo+IGF1dGgtdHlwZSAibm9uZSINCj4gfQ0KPg0KDQpGb3IgdGhlIGFib3ZlIGF1dGggZ3Jv dXAsIGZvciB0aGUgcG9ydGFsIElQcyBJIGd1ZXNzIHRoaXMgbWVhbnMgdGhvc2UgdXNlcnMgYXJl IG9ubHkgYWxsb3dlZCB0byBjb25uZWN0IGZyb20gdGhvc2UgSVAgYWRkcmVzc2VzIGJ1dCB5b3Ug Y2FudCByZXN0cmljdCBhIHVzZXIgdG8gYSBzcGVjaWZpYyBJUCA/DQoNCj4+PkFzIGZhciBhcyB3 aGF0IEkgaGF2ZSBkb25lIGluIHRoZSBwYXN0IHdpdGggb3RoZXIgdGFyZ2V0cywgd2hhdCBJIHRo aW5rIEZyZWVCU0QncyB0YXJnZXQgaXMNCj4+PmVhc2lseSBjYXBhYmxlIG9mIHdvdWxkIGJlIHRv IHVzZSBDSEFQIGF1dGhlbnRpY2F0aW9uIHRvIHJlc3RyaWN0IGluaXRpYXRvcnMuICBUaGlzIGlz IG15DQo+Pj5ob21lIGxhYiBzbyBJIGRpZG4ndCBib3RoZXIgd2l0aCBpdCwgc3BpbiB1cCB0cnVl bmFzIGFuZCBzZXR1cCB1cCBjaGFwIGFuZCBsb29rIGF0ID4+Pi9ldGMvY3RsLmNvbmYNCj4+PmFu ZCB0aGF0IHdpbGwgZ2V0IHlvdSBzdGFydGVkLiAgWW91IGNhbiB0aGVuIGxpbWl0IGJ5IElQL0NI QVAgc2VjcmV0LCBJUCBvbmx5LCBDSEFQIHNlY3JldCBvbmx5Li4uDQoNCj4NCj4gb3B0aW9uICJu YWEiICIweDY1ODljZmMwMDAwMDA3OWU4YTBkMjIzZTkzNTQ0MGFiIg0KPg0KdGhlIG5hYSBpcyBq dXN0IGEgdW5pcSBpZGVudGlmaWVyID8gV2hvIC8gd2hhdCBtYWtlcyB1c2Ugb2YgdGhhdCA/IEEg cXVpY2sgZ29vZ2xlIHNheXMgaXRzIGp1c3QgdXNlZCB0byBpZGVudGlmeSB0aGUgc2VyaWFsICMu IFdoeSAvIHdoZW4gd291bGQgSSB3YW50IHRvIGRvIHRoYXQgPw0KDQo+Pj5VbmlxdWUgSWRlbnRp ZmllciAtIFRvIHRoZSBiZXN0IG9mIG15IGtub3dsZWRnZSB0aGF04oCZcyBhbGwgaXQgaXMgLSBJ J20gbm90IGFuIGV4cGVydCBoZXJlLg0KDQpJbiB0aGUgdHdvIHRhcmdldHMgYmVsb3csIHdoeSB1 c2UgbHVuICIwIiBhbmQgd2h5IGx1biAiMSIgaW4gdGhlIHNlY29uZCB0YXJnZXQgPyBGcm9tIHRo ZSBjb25maWcgSSBnZW5lcmF0ZWQgZnJvbSBUcnVlTkFTLCBpdCBrZXB0IHRoZSBsdW4gYXMgIjAi IGZvciBlYWNoIHRhcmdldC4gSnVzdCBjb252ZW50aW9uID8NCg0KPj4+IEkgdXNlIHR3byBkaWZm ZXJlbnQgTFVOUyBiZWNhdXNlIExVTiAwIGlzIHNoYXJlZCBiZXR3ZWVuIG15IHRocmVlIGVzeGkg aG9zdHMsIGFuZCB0aGV5DQo+Pj4ga25vdyBob3cgdG8gcGxheSBuaWNlbHkgb24gYSBzaGFyZWQg TFVOLg0KPj4+IFVuaXRyZW5kcywgd2hpY2ggaXMgYSBiYWNrdXAgc29sdXRpb24gd291bGQgd2lw ZSBvdXQgZXZlcnl0aGluZyBvbiBMVU4gMCBpZiBJIGxldCBpdA0KPj4+IGhhdmUgYWNjZXNzIHRv IGl0LiAgU28sIEkgaGF2ZSB0d28gWkZTIHBvb2xzIHNldHMgYXMgdm9sbW9kZT1kZXYsIHRoZW4g SSBzaGFyZSB0aGVtIGFzIHR3byBkaWZmZXJlbnQgTFVOUy4NCj4+PiAtLW1pa2VqDQoNClRoYW5r cyBhZ2FpbiENCg0KICAgICAtLS1NaWtlDQoNCg0KPg0KPg0KPiB0YXJnZXQgImlxbi4yMDA1LTEw Lm9yZy5taWtlai5jdGw6ZXN4aS1zdG9yZTEiIHsgYXV0aC1ncm91cCAiYWcwIg0KPiBwb3J0YWwt Z3JvdXAgInBnMCINCj4gYWxpYXMgImVzeGktc3RvcmUxIg0KPiBsdW4gIjAiICJlc3hpLXN0b3Jl MSINCj4gfQ0KPg0KPiB0YXJnZXQgImlxbi4xOTk0LTA1LmNvbS51bml0cmVuZHM6NjBlMmYxZDE1 ZTU3IiB7IGF1dGgtZ3JvdXAgImFnMSINCj4gcG9ydGFsLWdyb3VwICJwZzAiDQo+IGFsaWFzICJ1 bml0cmVuczExIg0KPiBsdW4gIjEiICJ1bml0cmVuZHMxIg0KPiB9DQo+DQoNCg0KDQoNCkNPTkZJ REVOVElBTElUWSBOT1RFOiBUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVz ZQ0Kb2YgdGhlIGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFu ZCBtYXkNCmNvbnRhaW4gaW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBjb25maWRlbnRp YWwsIGFuZA0KZXhlbXB0IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYg dGhlIHJlYWRlcg0Kb2YgdGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50 LCB5b3UgYXJlIGhlcmVieQ0Kbm90aWZpZWQgdGhhdCBhbnkgZGlzc2VtaW5hdGlvbiwgZGlzdHJp YnV0aW9uIG9yIGNvcHlpbmcNCm9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJpY3RseSBwcm9o aWJpdGVkLiBJZiB5b3UgaGF2ZQ0KcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3Is IHBsZWFzZSBub3RpZnkgdXMgYnkNCnRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAwMCBvciBub3Rp ZnkgdXMgYXQgUEFJLCBEZXB0LiA5OSwNCjIxMDEgSGlnaCBXaWNraGFtIFBsYWNlLCBTdWl0ZSAx MDEsIExvdWlzdmlsbGUsIEtZIDQwMjQ1DQoNCkRpc2NsYWltZXINCg0KVGhlIGluZm9ybWF0aW9u IGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUgc2VuZGVyIGlzIGNvbmZp ZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkgdGhlIHJlY2lwaWVudCBh bmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91IGFyZSBub3QgdGhlIHJl Y2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkgZGlzY2xvc3VyZSwgY29w eWluZywgZGlzdHJpYnV0aW9uIG9yIHRha2luZyBhY3Rpb24gaW4gcmVsYXRpb24gb2YgdGhlIGNv bnRlbnRzIG9mIHRoaXMgaW5mb3JtYXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRlZCBhbmQgbWF5 IGJlIHVubGF3ZnVsLg0KDQpUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5uZWQgZm9yIHZpcnVzZXMg YW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2FsbHkgYXJjaGl2ZWQgYnkg TWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBjeWJlciByZXNpbGllbmNl LiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGggYnJhbmQgcHJvdGVjdGlv biwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJpdHksIGNvbXBsaWFuY2Ug YW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMuIE1pbWVjYXN0IGhlbHBzIHByb3RlY3Qg bGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJvbSBtYWxpY2lvdXMgYWN0aXZpdHksIGh1 bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7IGFuZCB0byBsZWFkIHRoZSBtb3ZlbWVu dCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVudCB3b3JsZC4gVG8gZmluZCBvdXQgbW9y ZSwgdmlzaXQgb3VyIHdlYnNpdGUuDQo= --MCBoundary=_12203141536530841 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8
INLINE
-----Original Message-----
From: mike tancsa [mailto:mike@sentex.net]
Sent: Monday, March 14, 2022 3:13 PM
To: Michael Jung <mikej@paymentallianceintl.com>; freebsd-fs <free= bsd-fs@freebsd.org>
Subject: Re: ctl.conf / iscsi docs and best practices

On 3/14/2022 3:00 PM, Michael Jung wrote:
> I just started working with the target again about a week ago, here is=
> my setup.
>
> For two remote initiators to connect to the same target you need
> option "ha shared" "on"
>
> Maybe this helps you a little.
>
It does, thank you!! Couple of questions below.


> auth-group "ag0" {
> initiator-name "iqn.1998-01.com.vmware:hv1-3972eaf3"
> initiator-name "iqn.1998-01.com.vmware:esxi2.mikej.local:98061334= 5:64"
> initiator-name "iqn.1998-01.com.vmware:esxi3.mikej.local.:1805690= 011:64"
> initiator-portal "192.168.6.8"
> initiator-portal "192.168.6.14"
> initiator-portal "192.168.6.5"
> auth-type "none"
> }
>

For the above auth group, for the portal IPs I guess this means those users= are only allowed to connect from those IP addresses but you cant restrict = a user to a specific IP ?

>>>As far as what I have done in the past with other targets, what= I think FreeBSD's target is
>>>easily capable of would be to use CHAP authentication to restri= ct initiators. This is my
>>>home lab so I didn't bother with it, spin up truenas and setup = up chap and look at >>>/etc/ctl.conf
>>>and that will get you started. You can then limit by IP/CHAP s= ecret, IP only, CHAP secret only...

>
> option "naa" "0x6589cfc00000079e8a0d223e935440ab"<= BR> >
the naa is just a uniq identifier ? Who / what makes use of that ? A quick = google says its just used to identify the serial #. Why / when would I want= to do that ?

>>>Unique Identifier - To the best of my knowledge that=E2=80=99s = all it is - I'm not an expert here.

In the two targets below, why use lun "0" and why lun "1&quo= t; in the second target ? From the config I generated from TrueNAS, it kept= the lun as "0" for each target. Just convention ?

>>> I use two different LUNS because LUN 0 is shared between my th= ree esxi hosts, and they
>>> know how to play nicely on a shared LUN.
>>> Unitrends, which is a backup solution would wipe out everythin= g on LUN 0 if I let it
>>> have access to it. So, I have two ZFS pools sets as volmode= =3Ddev, then I share them as two different LUNS.
>>> --mikej

Thanks again!

---Mike


>
>
> target "iqn.2005-10.org.mikej.ctl:esxi-store1" { auth-group = "ag0"
> portal-group "pg0"
> alias "esxi-store1"
> lun "0" "esxi-store1"
> }
>
> target "iqn.1994-05.com.unitrends:60e2f1d15e57" { auth-group= "ag1"
> portal-group "pg0"
> alias "unitrens11"
> lun "1" "unitrends1"
> }
>




CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245


<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--MCBoundary=_12203141536530841-- From nobody Tue Mar 15 02:55:26 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3CA071A0249F for ; Tue, 15 Mar 2022 02:55:58 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp3.via.net (smtp3.via.net [157.22.3.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHdM60GDqz4s3v for ; Tue, 15 Mar 2022 02:55:44 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp3.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 22F2taGx012174 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL) for ; Mon, 14 Mar 2022 19:55:36 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at smtp3.via.net Received: from smtpclient.apple ([209.81.2.60]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 22F2taGZ024924 for ; Mon, 14 Mar 2022 19:55:36 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at mail.via.net From: joe mcguckin Content-Type: multipart/alternative; boundary="Apple-Mail=_D5993E86-24FD-405A-AB0C-5A0358D38C12" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Can't see USB disk device Message-Id: Date: Mon, 14 Mar 2022 19:55:26 -0700 To: freebsd-fs X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp3.via.net [157.22.3.7]); Mon, 14 Mar 2022 19:55:37 -0700 (PDT) X-Rspamd-Queue-Id: 4KHdM60GDqz4s3v X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=temperror reason="query timed out" header.from=via.net (policy=temperror); spf=temperror (mx1.freebsd.org: error in processing during lookup of joe@via.net: DNS error) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-0.76 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[joe]; FROM_HAS_DN(0.00)[]; R_SPF_DNSFAIL(0.00)[?any]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_MEDIUM(0.72)[0.718]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DMARC_DNSFAIL(0.00)[via.net : query timed out]; NEURAL_HAM_SHORT(-0.78)[-0.780]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[157.22.3.7:from] X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_D5993E86-24FD-405A-AB0C-5A0358D38C12 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 FreeeBSD 12.3-Release I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an = external enclosure with a USB interface, formatted with NTFS. When I = plug in the USB disk, I do not see the device. All I see from the log = is: ugen7.2: at usbus7 I assume the CALDIGIT enclosure has a hub chip to accomodate all the = different interfaces (USBA, USBC, mini USB). Although FreeBSD won=E2=80=99t mount the disk automatically (I=E2=80=99ll = be using the NTFS fuse fs for that), I=E2=80=99d expect to see a log = message where FreeBSD sees the SATA/USB drive. Shouldn't a hub be transparent and the mass storage USB device be = enumerated? I should mention that this works flawlessly on the Mac=E2=80=A6 Thanks, Joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax --Apple-Mail=_D5993E86-24FD-405A-AB0C-5A0358D38C12 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 FreeeBSD 12.3-Release

I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted = in an external enclosure with a USB interface,  formatted with = NTFS. When I plug in the USB disk, I do not see the device. All I see = from the log is:

    ugen7.2: <CalDigit = AVPro2 Hub> at usbus7

I assume the CALDIGIT = enclosure has a hub chip to accomodate all the different interfaces = (USBA, USBC, mini USB).

Although FreeBSD won=E2=80=99t mount the disk automatically = (I=E2=80=99ll be using the NTFS fuse fs for that), I=E2=80=99d expect to = see a log message where FreeBSD sees the SATA/USB drive.

Shouldn't a hub be = transparent and the mass storage USB device be enumerated?

I should mention that = this works flawlessly on the Mac=E2=80=A6

Thanks,

Joe

Joe = McGuckin
ViaNet Communications

joe@via.net
650-207-0372 cell
650-213-1302 = office
650-969-2124 fax

= --Apple-Mail=_D5993E86-24FD-405A-AB0C-5A0358D38C12-- From nobody Tue Mar 15 07:58:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5CF2C1A29807 for ; Tue, 15 Mar 2022 07:58:39 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-vk1-xa2c.google.com (mail-vk1-xa2c.google.com [IPv6:2607:f8b0:4864:20::a2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHm4Z5Z5Tz4Vpv for ; Tue, 15 Mar 2022 07:58:38 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: by mail-vk1-xa2c.google.com with SMTP id d7so323630vkd.11 for ; Tue, 15 Mar 2022 00:58:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Kv7tXuKDaeueEJLiOjbIWgw1J0Rgbd9yEA1Ce5N/3MM=; b=odLJWb2AarH/OVNSpSpKSsj//m3UeuG7Pbg/nwAfQymbSd2ngzldfHVO8D5R2abH4V mvyVkl5vqp/bKHEdNogEpIWF8UdVhLptWNDmgLjM8BybCIqI540pFGN0UoSc3ktQUdM7 +SY45644VQkAPhMItNLwlekCE05V49Jnnt2p5MpPY0mB00EZnGZu9i0g7Vb2k3EYYXNT yHtguVnzuDFYoSXtA+2R9g+QL7UBZ1D77cqo0+3wpy/v3IrHLbQheqimi10ZtahYKlVa OVGPwVoyJTqpbA0JMSFo/Ngzb9H484Zr+JwOlmwVH0AvQ9K7jBsfFJ4C5AcpzzWXp9Jy 7laQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Kv7tXuKDaeueEJLiOjbIWgw1J0Rgbd9yEA1Ce5N/3MM=; b=H+IUPwU4roCFPVHLaEl17ySW9sFbEyh/W2L7RAdLqkeGkQuw5jcSs2dLpP/uEdr62P YizjYCvHmxGIyJPxF906RNVQjFUorlWAaqBpCtOvFaIdIEaHGGHpE/swANqPcQx7H5B9 9S0ygAa6IaNJNm30s9wEaP+F3uZ0HwZ3SAj72d6BMi+zLTEaoYGl/l7V8Dj7jtEdpxZF Dd1CNhDPKaiWgJb4vJ2r3gcVOyUjqFfTSId+DEIL3ENELKBVgdhmXE1miCgR3YCzz+Yc vVg0nv8zNJ2igmESfqOo+SJI3S3GbY9pWn+l2UajlIG6ZYXpIpDG7wKS7MOTBwbsOLEL vI8Q== X-Gm-Message-State: AOAM530CuLQ86wrrRCxo+65i6/u7FEUU7wxPuoJ6jsxd5zyxpvvua3hR pZ6mmlEzesTLECaaxkswSVtPxhHjDnFoWQ0VsR8HTQ5hQoSRTg== X-Google-Smtp-Source: ABdhPJzRmk1Iy0a2nLy+nsTvNsKu+AHSBB42UNK+bcBOKFBDmNL6j2rgVxzubL9iIRio4RmmI6jrbhxCKcBjs7dfsGM= X-Received: by 2002:a1f:6101:0:b0:336:ea3c:48b0 with SMTP id v1-20020a1f6101000000b00336ea3c48b0mr10947200vkb.19.1647331118120; Tue, 15 Mar 2022 00:58:38 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mehmet Erol Sanliturk Date: Tue, 15 Mar 2022 10:58:01 +0300 Message-ID: Subject: Re: Can't see USB disk device To: joe mcguckin Cc: freebsd-fs Content-Type: multipart/alternative; boundary="0000000000001f812605da3d2a4e" X-Rspamd-Queue-Id: 4KHm4Z5Z5Tz4Vpv X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=odLJWb2A; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mesanliturk@gmail.com designates 2607:f8b0:4864:20::a2c as permitted sender) smtp.mailfrom=mesanliturk@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a2c:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --0000000000001f812605da3d2a4e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Mar 15, 2022 at 5:56 AM joe mcguckin wrote: > FreeeBSD 12.3-Release > > I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an exter= nal enclosure > with a USB interface, formatted with NTFS. When I plug in the USB disk, = I > do not see the device. All I see from the log is: > > ugen7.2: at usbus7 > > I assume the CALDIGIT enclosure has a hub chip to accomodate all the > different interfaces (USBA, USBC, mini USB). > > Although FreeBSD won=E2=80=99t mount the disk automatically (I=E2=80=99ll= be using the > NTFS fuse fs for that), I=E2=80=99d expect to see a log message where Fre= eBSD sees > the SATA/USB drive. > > ---------------------------------------------------------------------------= ------- > Shouldn't a hub be transparent and the mass storage USB device be > enumerated? > > I should mention that this works flawlessly on the Mac=E2=80=A6 > In Fedora Linux KDE , attaching and using a USB NTFS hard disk is only selecting it from the Dolphin file manager when it is attached and doing whatever you want with it . Only so much , no more anything ( except by selecting ( such disks to be mounted automatically when they are attached ) from "Settings" related menus only one time ) . I am not using anything other than KDE . With my best wishes , Mehmet Erol Sanliturk ---------------------------------------------------------------------------= ------- > > Thanks, > > Joe > > Joe McGuckin > ViaNet Communications > > joe@via.net > 650-207-0372 cell > 650-213-1302 office > 650-969-2124 fax > > > > --0000000000001f812605da3d2a4e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Tue, Mar 15, 2022= at 5:56 AM joe mcguckin <joe@via.net= > wrote:
FreeeBSD 12.3-Release

<= div>I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an ext= ernal enclosure with a USB interface, =C2=A0formatted with NTFS. When I plu= g in the USB disk, I do not see the device. All I see from the log is:

=C2=A0 =C2=A0=C2=A0ugen7.2: <CalDigit AVPro2 Hub> at us= bus7

I assume the CALDIGIT enclosure has a hub chi= p to accomodate all the different interfaces (USBA, USBC, mini USB).
<= div>
Although FreeBSD won=E2=80=99t mount the disk automatica= lly (I=E2=80=99ll be using the NTFS fuse fs for that), I=E2=80=99d expect t= o see a log message where FreeBSD sees the SATA/USB drive.




-----------------------------------------= -----------------------------------------

=C2=A0
<= blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-l= eft:1px solid rgb(204,204,204);padding-left:1ex">
Shouldn&= #39;t a hub be transparent and the mass storage USB device be enumerated?

I should mention that this works flawlessly on the = Mac=E2=80=A6




In Fedora Li= nux KDE , attaching and using a USB=C2=A0 NTFS=C2=A0 hard disk is only
selecting it from the Dolphin file manager when it is attached a= nd
doing whatever you want with it .

Only so much , no more anything ( except by selecting
<= /div>
( such disks to be mounted automatically when they are attac= hed )
from "Settings" related menus only one = time=C2=A0 ) .
I am not using anything other= than KDE .


With my = best wishes ,


Mehmet= Erol Sanliturk


------------------------------------------------------------------------= ----------


=C2=A0

Thanks,
<= div>
Joe

Joe McGuckin
ViaN= et Communications

650-207-0372 cell
650-= 213-1302 office
650-969-2124 fax


<= /span>

--0000000000001f812605da3d2a4e-- From nobody Tue Mar 15 12:38:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D39841A1F427 for ; Tue, 15 Mar 2022 12:39:36 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-vs1-xe2a.google.com (mail-vs1-xe2a.google.com [IPv6:2607:f8b0:4864:20::e2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHtJm0l18z3hR8 for ; Tue, 15 Mar 2022 12:39:36 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: by mail-vs1-xe2a.google.com with SMTP id y20so12432724vsy.2 for ; Tue, 15 Mar 2022 05:39:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=goDi2E7P35uf2z1dISzVVZb2wLIlJulbx15gTAe8JTg=; b=fFMJ6aivuHt81cxEdDEElwFBy8ym+v0jlwt2Ab53CoPxM80u0+INF8ELnT4M6Q+Vvu bAsZFxHtGkLhHAUgdext2BD0u5FMpFosgLinQ0oD1YZuD0zEl31AVYKqNwoykgnlJFeK /5fe+DxIooclyWiy4QV1ZdGwGPQ0GnEyQ4gIEtaMYtrrEuqaSwSryGGHjp00ZAD3S9gj ih0aD6+BL5kVAruYz9TCxpmHLS3Y2xt85t+WQhIw3mo7uL0aYc71LzswUrbqDKrydEAU Flzi5ScEv+ozrx/25/D0lwobHq0qhzAVPGpUk/t9Ua+e7ZzbGMktTEJABBDkAtfAXIXe oC3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=goDi2E7P35uf2z1dISzVVZb2wLIlJulbx15gTAe8JTg=; b=A+e/9UiVnr/xtIEasLzqWVf2pE+mFrkySxy8c4QPa0vRLr7LQ8JKdMNkfmOWwSMw5K k5rqJp+LX+hLzBxQ08KSSISgINHrHTHl5mmoHra+17YCF7FD25RSLVvjT/rLoXasNPGL ggusaMgcscEoSa2eCQcmaB5S+/i5otNKoiOLqvI6AJWfajEFQOqH46bKW+z/2wdvgwkU EAmIIl/jP4ffen/d+aen+RmjunKr4skEoc4kGODGtHcRXTEJpxvzbTUGP86X/1vuiXca eGbPIL19K50fqaTIbphnbFEg8ls9k39dtvz/CWu2O+9YYeVtXgUNideXO3+0+lCeGKjv 6/4w== X-Gm-Message-State: AOAM531uVOSZ2TmgcBAQPXpkxw6fQX+cfithlee7y49MDzT7KfS47aZH IwwAMgLpZ5qI49hPp0t5RynMk7qigSFI84/NxbB+1C+bEYzKHg== X-Google-Smtp-Source: ABdhPJzUASXHa6/bdEhrJk6eIePVUuWi86eVCks3a0dh52TzaOye0o1bgPNS8GtDju4T0EAMVMLZpvM9Arq/uiUCO1o= X-Received: by 2002:a67:e1c4:0:b0:320:9b70:e4de with SMTP id p4-20020a67e1c4000000b003209b70e4demr11443343vsl.64.1647347975486; Tue, 15 Mar 2022 05:39:35 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mehmet Erol Sanliturk Date: Tue, 15 Mar 2022 15:38:58 +0300 Message-ID: Subject: Re: Can't see USB disk device To: joe mcguckin Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000e6822805da411686" X-Rspamd-Queue-Id: 4KHtJm0l18z3hR8 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=fFMJ6aiv; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mesanliturk@gmail.com designates 2607:f8b0:4864:20::e2a as permitted sender) smtp.mailfrom=mesanliturk@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2a:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000e6822805da411686 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Mar 15, 2022 at 10:58 AM Mehmet Erol Sanliturk < m.e.sanliturk@gmail.com> wrote: > > > On Tue, Mar 15, 2022 at 5:56 AM joe mcguckin wrote: > >> FreeeBSD 12.3-Release >> >> I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an exte= rnal enclosure >> with a USB interface, formatted with NTFS. When I plug in the USB disk,= I >> do not see the device. All I see from the log is: >> >> ugen7.2: at usbus7 >> >> I assume the CALDIGIT enclosure has a hub chip to accomodate all the >> different interfaces (USBA, USBC, mini USB). >> >> Although FreeBSD won=E2=80=99t mount the disk automatically (I=E2=80=99l= l be using the >> NTFS fuse fs for that), I=E2=80=99d expect to see a log message where Fr= eeBSD sees >> the SATA/USB drive. >> >> > > > > -------------------------------------------------------------------------= --------- > > > >> Shouldn't a hub be transparent and the mass storage USB device be >> enumerated? >> >> I should mention that this works flawlessly on the Mac=E2=80=A6 >> > > > > > In Fedora Linux KDE , attaching and using a USB NTFS hard disk is only > selecting it from the Dolphin file manager when it is attached and > doing whatever you want with it . > > Only so much , no more anything ( except by selecting > ( such disks to be mounted automatically when they are attached ) > from "Settings" related menus only one time ) . > I am not using anything other than KDE . > > > With my best wishes , > > > Mehmet Erol Sanliturk > > > > -------------------------------------------------------------------------= --------- > > If you are using KDE in FreeBSD or you can use it , it will be possible to use mount the USB NTFS hard disks when they are attached . Perhaps there may be some adjustments to "Settings" related menu . I have not used FreeBSD for a long time ( perhaps since 9.2 ) because in my computers FreeBSD was not working at sufficient speed . I think other FreeBSD users will help you if you ask . As a response to my one of the message , they explained to me how to mount hard disk in user land without root privileges . I am sorry that I have deleted all of my previous messages due to my error = . I am not sure what message it was . If you ask , they will respond to you also . The suggested program for Linux was the following : whereis udisks2 udisks2 /usr/libexec/udisks2 /usr/libexec/udisks2/udisks2 /usr/libexec/udisks2/udisksd whereis udisks* whereis udisk* udisks man udisks udisks --dump udisks --mount /dev/sde1 /pack There should be another possibility to use "devd" . If you search the following phrases in Google one by one : freebsd devd freebsd devd usb freebsd devfs freebsd devfs usb you may find sufficient links to study ... Mehmet Erol Sanliturk > > >> >> Thanks, >> >> Joe >> >> Joe McGuckin >> ViaNet Communications >> >> joe@via.net >> 650-207-0372 cell >> 650-213-1302 office >> 650-969-2124 fax >> >> >> >> --000000000000e6822805da411686 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Tue, Mar 15, 2022= at 10:58 AM Mehmet Erol Sanliturk <m.e.sanliturk@gmail.com> wrote:


On Tue, Mar 15= , 2022 at 5:56 AM joe mcguckin <joe@via.net> wrote:
FreeeBSD 12.3-Release

I=E2=80= =99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an external enclo= sure with a USB interface, =C2=A0formatted with NTFS. When I plug in the US= B disk, I do not see the device. All I see from the log is:

<= /div>
=C2=A0 =C2=A0=C2=A0ugen7.2: <CalDigit AVPro2 Hub> at usbus7=

I assume the CALDIGIT enclosure has a hub chi= p to accomodate all the different interfaces (USBA, USBC, mini USB).
<= div>
Although FreeBSD won=E2=80=99t mount the disk automatica= lly (I=E2=80=99ll be using the NTFS fuse fs for that), I=E2=80=99d expect t= o see a log message where FreeBSD sees the SATA/USB drive.




-----------------------------------------------------------------= -----------------

=C2=A0
Shouldn't a hub be transparent and the mass storage USB device be= enumerated?

I should mention that this works flaw= lessly on the Mac=E2=80=A6




In Fedora Linux KDE , = attaching and using a USB=C2=A0 NTFS=C2=A0 hard disk is only
selecting it from the D= olphin file manager when it is attached and
doing whatever you want with it .

Only so much , no more anything ( except by selecting
( such disks to = be mounted automatically when they are attached )
from "Settings" rel= ated menus only one time=C2=A0 ) .
I am not using anything other than KDE .


With my best wishes ,


Mehmet Erol Sanliturk


------------------------------------------= ----------------------------------------

<= /blockquote>



If = you are using KDE in FreeBSD or you can use it ,
it will be = possible to use mount the USB NTFS hard disks when
they are= attached .
Perhaps there may be some adjustments to "S= ettings" related menu .
I have not used FreeBSD for a l= ong time ( perhaps since 9.2 ) because in my
computers FreeB= SD was not working at sufficient speed .
I=C2=A0 think other= FreeBSD users will help you if you ask .



As a response to my one of the message , the= y explained to me how to
mount hard disk in user land w= ithout root privileges .
I am sorry that I have deleted all = of my previous messages due to my error .
I am not sure what= message it was .
If you ask , they will respond to you als= o .


The suggested=C2=A0 progra= m for Linux was the following :


whereis = udisks2
udisks2
/usr/libexec/udisks2
/usr/libexec/udisks2/udisks2<= br>/usr/libexec/udisks2/udisksd
whereis udisks*
whereis udisk*
udi= sks
man udisks
udisks --dump
udisks --mount /dev/sde1 /pack

=C2=A0

There shou= ld be another possibility to use=C2=A0 "devd" .
=
If you search the following phrases in Google one by on= e :

freebsd devd
freebsd = devd usb

freebsd devfs
freebsd devfs = usb

you may find sufficient links to stu= dy ...



Mehmet E= rol Sanliturk



<= /div>


=C2=A0

Thanks,

=
Joe

Joe McGuckin
ViaNet Commu= nications

650-207-0372 cell
650-213-1302= office
650-969-2124 fax

--000000000000e6822805da411686-- From nobody Tue Mar 15 13:02:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 24E331A25098 for ; Tue, 15 Mar 2022 13:03:37 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-vs1-xe2e.google.com (mail-vs1-xe2e.google.com [IPv6:2607:f8b0:4864:20::e2e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KHtrS15Gvz3mLF for ; Tue, 15 Mar 2022 13:03:36 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: by mail-vs1-xe2e.google.com with SMTP id u82so20731715vsu.0 for ; Tue, 15 Mar 2022 06:03:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=RgPza/4gjcB/xfbmrzGgCKY3wpbec81VxKOfpEoVmrg=; b=Tr687jx8BSJFQV4xG3Sk35BV3xIaMS7O8NSz+HEPxyzi6xHPCHhTLreE5FqbVdqGbB ExRKtuZWTnX+HF4iQHrVHbTp7+AxxE/rJ536vb2j2fjT8/lsjgbR2MD2ytN8EmdbGiVe bDQwUJtiLFzhnM2yMmHmH3+nNv44n59931U4K2jz4gBYGo1f4YN36eEoVklaG2xgCu1s O41JJ5wN8jf0IN0TnJBvNR/AQ0L9kGaSZci7gJLDR+lpceOY6QRlcOwmNzKQQICzgtLO TwPn3nYeWK3NbFiZCONG4J+V+GxW0HLY350mk1ZzuUtEpzs+Fgd+A+jSq5c0NauRLkCl JuDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=RgPza/4gjcB/xfbmrzGgCKY3wpbec81VxKOfpEoVmrg=; b=rliFgCXYS2F9cr5tq93cUFkxYuJ12Y8wa+vNuFilRuf0QXNNqCW/JS1XIgZ6PfYux4 twCEytpBUeGYH6MD7O1LcX4O0hWQpAQWgMGTarmpRHFsnMs0HPGFS9sX+N/TNBzny1I3 wXIP8HkgVFPv1bs1K2vIPKxp4VGBC/8zXb4PdCPUA1SAc78uu0k+DdqPcMhctEOm8Tws ZXPOvhpjDAxmoIfQgQgTNrQ7R6sjZdA+D1GlKQv27NkxEeg4TzqiIMGH5DhNdRWA6V8v 2+4a/95UzA+yJzitxefPyTAxT4RWBYrO3Jvk24oyACpuxwkh00bSRhG19ofvjQkXe7eU drjg== X-Gm-Message-State: AOAM530j7fYodz9iavl92pzpjFAXQdailqJzMbs9m4hDooqWbySwBjkx dEfBzifkSFNpfeCgzP1OfR/cQdl9GYJiYLpbDrt1fordD4Ytzg== X-Google-Smtp-Source: ABdhPJzMmter3A+iX2qTXIjoxj29G2J807GG7aVQtQkSHSLx/RstaDGV23kcM8Xiz0XKCXSYRzFlQHTh9xr0WDszx/0= X-Received: by 2002:a67:fe12:0:b0:31b:9356:40fe with SMTP id l18-20020a67fe12000000b0031b935640femr10921076vsr.1.1647349415505; Tue, 15 Mar 2022 06:03:35 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mehmet Erol Sanliturk Date: Tue, 15 Mar 2022 16:02:59 +0300 Message-ID: Subject: Re: Can't see USB disk device To: joe mcguckin Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000bb786505da416cbd" X-Rspamd-Queue-Id: 4KHtrS15Gvz3mLF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Tr687jx8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mesanliturk@gmail.com designates 2607:f8b0:4864:20::e2e as permitted sender) smtp.mailfrom=mesanliturk@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.99)[-0.992]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2e:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000bb786505da416cbd Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Mar 15, 2022 at 3:38 PM Mehmet Erol Sanliturk < m.e.sanliturk@gmail.com> wrote: > > > On Tue, Mar 15, 2022 at 10:58 AM Mehmet Erol Sanliturk < > m.e.sanliturk@gmail.com> wrote: > >> >> >> On Tue, Mar 15, 2022 at 5:56 AM joe mcguckin wrote: >> >>> FreeeBSD 12.3-Release >>> >>> I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an ext= ernal enclosure >>> with a USB interface, formatted with NTFS. When I plug in the USB disk= , I >>> do not see the device. All I see from the log is: >>> >>> ugen7.2: at usbus7 >>> >>> I assume the CALDIGIT enclosure has a hub chip to accomodate all the >>> different interfaces (USBA, USBC, mini USB). >>> >>> Although FreeBSD won=E2=80=99t mount the disk automatically (I=E2=80=99= ll be using the >>> NTFS fuse fs for that), I=E2=80=99d expect to see a log message where F= reeBSD sees >>> the SATA/USB drive. >>> >>> >> >> >> >> ------------------------------------------------------------------------= ---------- >> >> >> >>> Shouldn't a hub be transparent and the mass storage USB device be >>> enumerated? >>> >>> I should mention that this works flawlessly on the Mac=E2=80=A6 >>> >> >> >> >> >> In Fedora Linux KDE , attaching and using a USB NTFS hard disk is only >> selecting it from the Dolphin file manager when it is attached and >> doing whatever you want with it . >> >> Only so much , no more anything ( except by selecting >> ( such disks to be mounted automatically when they are attached ) >> from "Settings" related menus only one time ) . >> I am not using anything other than KDE . >> >> >> With my best wishes , >> >> >> Mehmet Erol Sanliturk >> >> >> >> ------------------------------------------------------------------------= ---------- >> >> > > > If you are using KDE in FreeBSD or you can use it , > it will be possible to use mount the USB NTFS hard disks when > they are attached . > Perhaps there may be some adjustments to "Settings" related menu . > I have not used FreeBSD for a long time ( perhaps since 9.2 ) because in = my > computers FreeBSD was not working at sufficient speed . > I think other FreeBSD users will help you if you ask . > > > > As a response to my one of the message , they explained to me how to > mount hard disk in user land without root privileges . > I am sorry that I have deleted all of my previous messages due to my erro= r > . > I am not sure what message it was . > If you ask , they will respond to you also . > > > The suggested program for Linux was the following : > > > whereis udisks2 > udisks2 > /usr/libexec/udisks2 > /usr/libexec/udisks2/udisks2 > /usr/libexec/udisks2/udisksd > whereis udisks* > whereis udisk* > udisks > man udisks > udisks --dump > udisks --mount /dev/sde1 /pack > > > > There should be another possibility to use "devd" . > > If you search the following phrases in Google one by one : > > freebsd devd > freebsd devd usb > > freebsd devfs > freebsd devfs usb > > you may find sufficient links to study ... > > > > Mehmet Erol Sanliturk > > > > Some more links : https://lists.freebsd.org/pipermail/freebsd-stable/2016-January/084002.html Auto-mounting USB NTFS formatted devices on FreeBSD 10.2 and HEAD https://lists.freebsd.org/pipermail/freebsd-current/2016-May/060963.html boot fails "Can't stat /dev/da0a: No such file or directory" : Mounting USB disk during boot https://forums.freebsd.org/threads/63534/ DSBMD - a media mounting daemon/automounter for FreeBSD https://lists.freebsd.org/pipermail/freebsd-questions/2018-February/280835.= html Automount USB drive when connected https://www.google.com/search?q=3DAutomount+USB+drive+when+connected+by+use= r&sxsrf=3DAPq-WButOLJKU3nyyuxemHLUKUhS31NZMw%3A1647349213563&source=3Dhp&ei= =3D3Y0wYo7UH-OExc8P0ZCyWA&iflsig=3DAHkkrS4AAAAAYjCb7f4PBe2AzJSFP9as96m2vj8a= xyOo&ved=3D0ahUKEwjOtsWFlsj2AhVjQvEDHVGIDAsQ4dUDCAY&uact=3D5&oq=3DAutomount= +USB+drive+when+connected+by+user&gs_lcp=3DCgdnd3Mtd2l6EAM6BQghEKABOggIIRAW= EB0QHjoECCEQFVAAWLNnYKd8aABwAHgAgAGoAYgBgwqSAQMwLjmYAQCgAQKgAQE&sclient=3Dg= ws-wiz Automount USB drive when connected by user https://www.google.com/search?q=3DAutomount+USB+drive+when+connected+in+use= rland&sxsrf=3DAPq-WBvXeDXCaUCWuQp0t9FR6J1RuyYiAg%3A1647349233624&ei=3D8Y0wY= prWJY2Xxc8Pk_-RuAc&ved=3D0ahUKEwjakpCPlsj2AhWNS_EDHZN_BHcQ4dUDCA0&uact=3D5&= oq=3DAutomount+USB+drive+when+connected+in+userland&gs_lcp=3DCgdnd3Mtd2l6EA= M6BwgAEEcQsAM6BQghEKABOgQIIxAnOggIIRAWEB0QHjoHCCEQChCgAUoECEEYAEoECEYYAFCw3= QFYhoMCYPCIAmgCcAF4AIABtQGIAcYSkgEEMC4xOJgBAKABAcgBCMABAQ&sclient=3Dgws-wiz Automount USB drive when connected in userland Mehmet Erol Sanliturk > >> >> >>> >>> Thanks, >>> >>> Joe >>> >>> Joe McGuckin >>> ViaNet Communications >>> >>> joe@via.net >>> 650-207-0372 cell >>> 650-213-1302 office >>> 650-969-2124 fax >>> >>> >>> >>> --000000000000bb786505da416cbd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Tue, Mar 15, 2022= at 3:38 PM Mehmet Erol Sanliturk <m.e.sanliturk@gmail.com> wrote:


On Tue, Mar 15= , 2022 at 10:58 AM Mehmet Erol Sanliturk <m.e.sanliturk@gmail.com> wrote:
<= br>

On Tue, Mar 15, 2022 at 5:56 AM joe mcguckin <joe@via.net> wrote:
FreeeBSD 12.3-Release
<= br>
I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted= in an external enclosure with a USB interface, =C2=A0formatted with NTFS. = When I plug in the USB disk, I do not see the device. All I see from the lo= g is:

=C2=A0 =C2=A0=C2=A0ugen7.2: <CalDigit AVPro2 Hub= > at usbus7

I assume the CALDIGIT enclosure has a hub chi= p to accomodate all the different interfaces (USBA, USBC, mini USB).
<= div>
Although FreeBSD won=E2=80=99t mount the disk automatica= lly (I=E2=80=99ll be using the NTFS fuse fs for that), I=E2=80=99d expect t= o see a log message where FreeBSD sees the SATA/USB drive.




-----------------------------------------------------------------= -----------------

=C2=A0
Shouldn't a hub be transparent and the mass storage USB device be= enumerated?

I should mention that this works flaw= lessly on the Mac=E2=80=A6




In Fedora Linux KDE , = attaching and using a USB=C2=A0 NTFS=C2=A0 hard disk is only
selecting it from the D= olphin file manager when it is attached and
doing whatever you want with it .

Only so much , no more anything ( except by selecting
( such disks to = be mounted automatically when they are attached )
from "Settings" rel= ated menus only one time=C2=A0 ) .
I am not using anything other than KDE .


With my best wishes ,


Mehmet Erol Sanliturk


------------------------------------------= ----------------------------------------

<= /blockquote>



If you are using KDE in Fre= eBSD or you can use it ,
it will be possible to use mount the USB NTFS hard disks w= hen
they = are attached .
Perhaps there may be some adjustments to "Settings" related= menu .
I= have not used FreeBSD for a long time ( perhaps since 9.2 ) because in my<= /div>
computers= FreeBSD was not working at sufficient speed .
I=C2=A0 think other FreeBSD users wil= l help you if you ask .



As a respon= se to my one of the message , they explained to me how to
mount hard disk in us= er land without root privileges .
I am sorry that I have deleted all of my previous = messages due to my error .
I am not sure what message it was .
If you ask , they will respon= d to you also .


The suggested=C2=A0 program for Linux = was the following :


whereis udisks2
u= disks2
/usr/libexec/udisks2
/usr/libexec/udisks2/udisks2
/usr/libe= xec/udisks2/udisksd
whereis udisks*
whereis udisk*
udisks
man u= disks
udisks --dump
udisks --mount /dev/sde1 /pack

=
=C2=A0

There should be another possibility to use=C2= =A0 "devd" .

If you search the following phrases in Google one by one :
<= div style=3D"font-family:tahoma,sans-serif;font-size:large">
freebsd devd
<= div style=3D"font-family:tahoma,sans-serif;font-size:large">freebsd devd us= b

freebsd devfs
freebsd devfs usb

you may find sufficient links to study ...


=

Mehmet Erol Sanliturk





Some more links :

<= /div>


https://lists.freebsd.org/piperma= il/freebsd-stable/2016-January/084002.html
Auto-mounting USB NTFS fo= rmatted devices on FreeBSD 10.2 and HEAD


ht= tps://lists.freebsd.org/pipermail/freebsd-current/2016-May/060963.html<= br>boot fails "Can't stat /dev/da0a: No such file or directory&quo= t; : Mounting USB disk during boot



https://forums.freebsd.o= rg/threads/63534/
DSBMD - a media mounting daemon/automounter for Fr= eeBSD


https://lists.freebsd.org/pipermail/freeb= sd-questions/2018-February/280835.html
Automount USB drive when conn= ected



=
Automount USB drive when connected by user



Automount USB drive whe= n connected in userland


=C2=A0
Mehmet Erol Sanliturk





=C2=A0

Thanks,

Joe
Joe McGuckin
ViaNet Communications

joe@via.net
650-207-0372 cell
650-213-1302 office
650-969-2= 124 fax



--000000000000bb786505da416cbd-- From nobody Tue Mar 15 20:11:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5B5A01A10413 for ; Tue, 15 Mar 2022 20:11:16 +0000 (UTC) (envelope-from martin@lispworks.com) Received: from mail.lispworks.com (mail.lispworks.com [46.17.166.21]) by mx1.freebsd.org (Postfix) with ESMTP id 4KJ4Kv073bz4nfX for ; Tue, 15 Mar 2022 20:11:14 +0000 (UTC) (envelope-from martin@lispworks.com) Received: from higson.cam.lispworks.com (higson.cam.lispworks.com [192.168.1.7]) by lwfs1-cam.cam.lispworks.com (8.16.1/8.16.1) with ESMTP id 22FKB5JX080640; Tue, 15 Mar 2022 20:11:05 GMT (envelope-from martin@lispworks.com) Received: from higson.cam.lispworks.com (localhost.localdomain [127.0.0.1]) by higson.cam.lispworks.com (8.14.4) id 22FKB3nl002145; Tue, 15 Mar 2022 20:11:03 GMT Received: (from martin@localhost) by higson.cam.lispworks.com (8.14.4/8.14.4/Submit) id 22FKB3XL002141; Tue, 15 Mar 2022 20:11:03 GMT Date: Tue, 15 Mar 2022 20:11:03 GMT Message-Id: <202203152011.22FKB3XL002141@higson.cam.lispworks.com> From: Martin Simmons To: joe mcguckin CC: freebsd-fs@freebsd.org In-reply-to: (message from joe mcguckin on Mon, 14 Mar 2022 19:55:26 -0700) Subject: Re: Can't see USB disk device References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4KJ4Kv073bz4nfX X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of martin@lispworks.com has no SPF policy when checking 46.17.166.21) smtp.mailfrom=martin@lispworks.com X-Spamd-Result: default: False [0.82 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.989]; FREEFALL_USER(0.00)[martin]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.96)[0.964]; NEURAL_HAM_LONG(-0.15)[-0.151]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[lispworks.com]; AUTH_NA(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:51055, ipnet:46.17.160.0/21, country:GB] X-ThisMailContainsUnwantedMimeParts: N >>>>> On Mon, 14 Mar 2022 19:55:26 -0700, joe mcguckin said: > > FreeeBSD 12.3-Release > > I’m trying to mount a 3.5” SATA drive mounted in an external enclosure with a USB interface, formatted with NTFS. When I plug in the USB disk, I do not see the device. All I see from the log is: > > ugen7.2: at usbus7 > > I assume the CALDIGIT enclosure has a hub chip to accomodate all the different interfaces (USBA, USBC, mini USB). > > Although FreeBSD won’t mount the disk automatically (I’ll be using the NTFS fuse fs for that), I’d expect to see a log message where FreeBSD sees the SATA/USB drive. > > Shouldn't a hub be transparent and the mass storage USB device be enumerated? You could try setting some debugging sysctls to 1 to see if that gives any more info. See the list: sysctl -a hw.usb | grep debug __Martin From nobody Wed Mar 16 04:06:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D93571A21497 for ; Wed, 16 Mar 2022 04:06:35 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp2.via.net (smtp2.via.net [157.22.3.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KJGtL5K7Yz3qYr for ; Wed, 16 Mar 2022 04:06:34 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp2.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 22G46QVO024263 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Tue, 15 Mar 2022 21:06:27 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at smtp2.via.net Received: from smtpclient.apple (6.sub-174-194-205.myvzw.com [174.194.205.6]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 22G46OvG010092 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Tue, 15 Mar 2022 21:06:26 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.1 at mail.via.net Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Joe Mcguckin List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: Can't see USB disk device Date: Tue, 15 Mar 2022 21:06:13 -0700 Message-Id: References: <202203152011.22FKB3XL002141@higson.cam.lispworks.com> Cc: freebsd-fs@freebsd.org In-Reply-To: <202203152011.22FKB3XL002141@higson.cam.lispworks.com> To: Martin Simmons X-Mailer: iPad Mail (19C63) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp2.via.net [157.22.3.6]); Tue, 15 Mar 2022 21:06:27 -0700 (PDT) X-Rspamd-Queue-Id: 4KJGtL5K7Yz3qYr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of joe@via.net designates 157.22.3.6 as permitted sender) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-2.76 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.88)[-0.878]; FREEFALL_USER(0.00)[joe]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+MX]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[via.net]; NEURAL_HAM_LONG(-0.98)[-0.981]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; RECEIVED_SPAMHAUS_PBL(0.00)[174.194.205.6:received]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[157.22.3.6:from] X-ThisMailContainsUnwantedMimeParts: N Thanks! > On Mar 15, 2022, at 1:22 PM, Martin Simmons wrote: >=20 > =EF=BB=BF >>=20 >>>>>> On Mon, 14 Mar 2022 19:55:26 -0700, joe mcguckin said: >>=20 >> FreeeBSD 12.3-Release >>=20 >> I=E2=80=99m trying to mount a 3.5=E2=80=9D SATA drive mounted in an exter= nal enclosure with a USB interface, formatted with NTFS. When I plug in the= USB disk, I do not see the device. All I see from the log is: >>=20 >> ugen7.2: at usbus7 >>=20 >> I assume the CALDIGIT enclosure has a hub chip to accomodate all the diff= erent interfaces (USBA, USBC, mini USB). >>=20 >> Although FreeBSD won=E2=80=99t mount the disk automatically (I=E2=80=99ll= be using the NTFS fuse fs for that), I=E2=80=99d expect to see a log messag= e where FreeBSD sees the SATA/USB drive. >>=20 >> Shouldn't a hub be transparent and the mass storage USB device be enumera= ted? >=20 > You could try setting some debugging sysctls to 1 to see if that gives any= > more info. See the list: >=20 > sysctl -a hw.usb | grep debug >=20 > __Martin From nobody Wed Mar 16 14:12:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CCC631A1385E for ; Wed, 16 Mar 2022 14:12:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KJXKz4lfyz3J4v for ; Wed, 16 Mar 2022 14:12:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 841F117F1D for ; Wed, 16 Mar 2022 14:12:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22GECtQU058512 for ; Wed, 16 Mar 2022 14:12:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22GECt8o058511 for fs@FreeBSD.org; Wed, 16 Mar 2022 14:12:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256205] ZFS: data corruption with SEEK_HOLE/SEEK_DATA on dirty files written through nullfs(5) Date: Wed, 16 Mar 2022 14:12:51 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mikael@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647439975; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=adOCqN2/28k6BI92iP5N77NJHv2iGG7z4+VvSncJ2us=; b=IKnkAUnyn1YutiQ6aRAIEeCWTCY5MrTUYNRMkCGqRCrsCW6wg5kdVdBtD4otc43oNAt9Jl BTwQC8FqlC0yoNDTsnPB0t/UJ0xRpqIvumaDuVMetWcWTXBaiCM4Z17jtSI3Dzhr4hsw6C cRmgayxKQEcbLk2P2haiiPVj59e3g6IkqJ7/zNOTHBCY3jQfA6dn9C3LwJUl9MpSWnop3U igopf29PG2Isj/yGGXqGwiKTjJE4B7DcaDItcqC/BdJ+nPZMOzso8m7OveCVdXeG6Pws77 wJO3SfyJqJ2ulmkQ/hjaXitLRMfQ5VMJbZdRxHJGPiwZBSETNDexRCwSE7J42Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647439975; a=rsa-sha256; cv=none; b=kr3tKNPqgqz2z5JPeNnPdV5WOVMZAV8aSuvdON8VcjnEKBDseB+jSmU3Plb0r365/VZgt5 IBLVhkENqFkT0wO13rneb/l91PuVmUuTBmxxG5jI/sgbabX4/FJAEUUGuR9Zlf2I8xdrXO j9qnW741MkSjowIWloOP/atyv4X6MwwHwKrEnvna9u8vQz+nJNVI/Eppa11L1WVo4wKbhm mI3AsI7p3fEsbIcYQherDEA1cTLxlL9GUF7bAvrEOYVFRRQWrmA5oAQJzXMvldR0wmdTzd pAdNjQphSVSaQ6SZu4vgNAKkNbJk+Xu+z/LoT+AvJ/pZ9u/WVOhuwFmZJ61eMg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256205 Mikael Urankar changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mikael@FreeBSD.org --- Comment #30 from Mikael Urankar --- FYI the dates in https://www.freebsd.org/security/advisories/FreeBSD-EN-22:11.zfs.asc are in= the future (v1.0 2022-05-15 -- Initial release etc) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Mar 16 17:55:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3C14D1A21F94 for ; Wed, 16 Mar 2022 17:56:38 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KJdJ52Fnpz4l5D for ; Wed, 16 Mar 2022 17:56:37 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id BB3F62110D1 for ; Wed, 16 Mar 2022 13:56:00 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 4E9023F718C for ; Wed, 16 Mar 2022 13:56:00 -0400 (EDT) Message-ID: <3cca9997-97f7-7c49-9531-4069618539b1@denninger.net> Date: Wed, 16 Mar 2022 13:55:58 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Content-Language: en-US To: freebsd-fs@freebsd.org From: Karl Denninger Subject: md option "async" risks kernel deadlock? Why. Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms080507080703090509080803" X-Rspamd-Queue-Id: 4KJdJ52Fnpz4l5D X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-3.91 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_SPAM_MEDIUM(0.99)[0.985]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-fs] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms080507080703090509080803 Content-Type: multipart/alternative; boundary="------------AOP6UJMcao4zF4E0KZ6YYGrS" --------------AOP6UJMcao4zF4E0KZ6YYGrS Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit From the man page for mdconfig(8)     -o [no]option              Set or reset options.              [no]async                      For vnode backed devices: avoid IO_SYNC for increased                      performance but at the risk of deadlocking the entire                      kernel. Why and how severe is this risk? The scenario where I care is the use of md to build and populate a "disk" image often used with Crochet and nanobsd so as to create an image file that can then be directly dd'd to a media device (e.g. SD card) and booted. When the backing store for this is a ZFS file on spinning rust the performance is beyond horrid; about 50tps is all you get, presumably due to clashes between the backing store and md itself which winds up forcing a crazy amount of seeks.  I suspect its seek-related because if the zfs pool is on SSD its plenty fast -- but a backing on spinning rust, including all mirror vdev-comprised pools (which are quite fast for general file storage) is silly-slow. Setting the zfs mountpoint to async has no impact on performance.  I assume that setting mdconfig's option very well might, but kernel deadlocks are bad news, so I'm trying to understand the risk profile since these builds are done on a production machine. Thanks! -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------AOP6UJMcao4zF4E0KZ6YYGrS Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

From the man page for mdconfig(8)

    -o [no]option
             Set or reset options.

             [no]async
                     For vnode backed devices: avoid IO_SYNC for increased
                     performance but at the risk of deadlocking the entire
                     kernel.

Why and how severe is this risk?

The scenario where I care is the use of md to build and populate a "disk" image often used with Crochet and nanobsd so as to create an image file that can then be directly dd'd to a media device (e.g. SD card) and booted.

When the backing store for this is a ZFS file on spinning rust the performance is beyond horrid; about 50tps is all you get, presumably due to clashes between the backing store and md itself which winds up forcing a crazy amount of seeks.  I suspect its seek-related because if the zfs pool is on SSD its plenty fast -- but a backing on spinning rust, including all mirror vdev-comprised pools (which are quite fast for general file storage) is silly-slow.

Setting the zfs mountpoint to async has no impact on performance.  I assume that setting mdconfig's option very well might, but kernel deadlocks are bad news, so I'm trying to understand the risk profile since these builds are done on a production machine.

Thanks!

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------AOP6UJMcao4zF4E0KZ6YYGrS-- --------------ms080507080703090509080803 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzE2MTc1NTU4 WjBPBgkqhkiG9w0BCQQxQgRAEnOzcbRhTvIeG13osOuLrWolrWq6Vb+78iibFEgx+e5+3CHy MbifTTCXgRpJpGxSypfYi3xXaT7m0sWwDzO86zBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgB3xYHY8GdZnYZhecxcJ2UM+cpD4mroPet61d7DMQTnZ8QuBeyuXcg4w5tiohxPgFzi wTRcf3eWuGo1fh2Q8UrRwVZKE0rhMhbJiCyJXdHIeTVREXJHFTuGGrviGyQqcbbpX39JK7wr JzIdVP6002HIp4jicnNVL7eOpncfo5cW5PzPIgYTbSDacWLD8tArA60SY0tKK9KYqJB33+Yi +F8QNAqDKFkqKJYW6ZSYw11oIzj2Lh45C/XuGoUSk5A5OxttsgPfQV8DDbuimwQC0wbOCakw FBH5K0Dp+rS515ttXaDORS/l60JWZ5EapJmnax3n22pn4FvVFORWpo9rgPRqiJJC14lT5gNR m6LH0b4gK6YMB5sFBn3AJoVhuV19fykg+yFAsJ8lZGA5Fhbt67+tPdIXY2TeD0+Ey4E0XTq8 /RdW/KkSw9P6eaGS8zp/b5yGhOhVdVZhAdxyBXLz7pgzyp9ad1u5CIuWDIiM8rABdXJnMpsw j9nk4IBffTOPT2kU54lv53WVloIsokrNrlGR/oKidZTO3pPEdn8ox2Ns+pRjO5RcoS8/ZKPJ 4NDyhJ/UpFRfZNh5jQ1tkEUuQGxdbxLgH9gCtwI9Crxhu4gE5e99TPF9mc8+lUQn+e6qU7cg PeRvhOfNVpkhf2RNPkGaaPoig3RlGU0AqUZlKTchjwAAAAAAAA== --------------ms080507080703090509080803-- From nobody Thu Mar 17 03:36:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1477D1A315FF for ; Thu, 17 Mar 2022 03:36:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KJt9N4k2yz4TPY for ; Thu, 17 Mar 2022 03:36:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 827AC230F0 for ; Thu, 17 Mar 2022 03:36:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22H3aeoe027937 for ; Thu, 17 Mar 2022 03:36:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22H3aeuj027936 for fs@FreeBSD.org; Thu, 17 Mar 2022 03:36:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225076] loss zfs pool after reboot Date: Thu, 17 Mar 2022 03:36:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: donaldcallen@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647488200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9nM9MwYTTKAkBn9/P+gbwCFZJpkZPWczYSkF/ATA3NQ=; b=S49IYro65SE1Op6tYteDE85XcGyQ8CdRZlfFBPXITznmMOzA1OThAn4uBoLdaDEM6dw6Zc 9kqqpmmg6xcsgUq2tZ1X+WCNuBWTWDJCfWMijZYFEfCKRxwnI68+W0E8BFIz1HIKQgB782 HDz0Um4M5JbuKrbrOlZjgsyrMpgYsaLdS6VwwOAHa3xbhRUeO75lARPMFo9PtFabS/znnF kB8wh4tc4QljwateDQdvGeTrO7rDWl0vEesSZz4OI7cbiH3jzGeWw7n+mIjhTiNXuCs5aP crNXPMYDt7ph2YlOVgTqfgQvg3rf2VVFahqbPpaYiK/yfHFgiBIilsHhmFW5sQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647488200; a=rsa-sha256; cv=none; b=Qn56BfKOFyWNFjvVLBOMT1YF04YQD4LF79qI6zSxolv50R3nq7BbO41MvjoQtrENr8Slrx m1V1PuA++qcBCjXNfAFRaFBBJdNewnBn3949IOeDJ5YMckDwI4ua0ruRiq1TMzTi9arpmH 6RuOvFc0bzQkjKgCOOOvkS7JMrcyOdNlJO4Y83hrrxRsFTg+L2jkN07Z0MUNAE3YjwMNjq i9EeenNzbF3p9HFnenWla6aqr1FivPjR35QPu7Dhoausb/GmZseRAUzuz+NCPc9aB3T6E7 bj3lEch9H3oEtEHfy8o+qowN+E8M2t7SR8csZKNYJo2kEj6JdPodVcDkDa998g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225076 donaldcallen@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |donaldcallen@gmail.com --- Comment #2 from donaldcallen@gmail.com --- More than 5 years after this report, I am seeing the same behavior. It's mo= re than a bit disconcerting to see a problem this serious unaddressed after su= ch a long time. I have a USB-connected 2TB Seagate Barracuda I use for backups and archives. The entire drive is a simple zfs pool. When I reboot the system with the po= ol mounted, the rebooted system shows the pool mounted, via df, which shows the expected number of GB used. But an ls of the mount-point shows no files -- nothing. If I unmount the filesystem and remount it, the file-system now operates normally. I am running FreeBSD 13. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 17 08:13:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 666F61A2E20C for ; Thu, 17 Mar 2022 08:13:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KK0KH065mz3k3D for ; Thu, 17 Mar 2022 08:13:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D85F126F1E for ; Thu, 17 Mar 2022 08:13:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22H8Dsd1097090 for ; Thu, 17 Mar 2022 08:13:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22H8Dsd5097089 for fs@FreeBSD.org; Thu, 17 Mar 2022 08:13:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225076] loss zfs pool after reboot Date: Thu, 17 Mar 2022 08:13:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ronald-lists@klop.ws X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647504835; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uSwNRohx+u68k3Shv/kAQY87rO+LHCg4ICR87a8i7z4=; b=A1SeI8fBnkRTpQ9KUNKBdk2nfuxFLSwE94MtpTa6EH/XDh9OC5QdAupMYVPJ6ENNkD+atE 5r0pvFPFRItbz0CXCXUD1GlX6EgycIhj7+UX63u482YYZLUbGckC34WEhXgCv800jdpoz8 HdKNolg0bjklf57VyC8B0AUbZJK8wxbPffdxXQ8wvE5j/Lb/Esrj0qWomYUqDXc3N261P1 DIy4ctufoDBsHdQddB7hWtGD/3IlWMUU6ymL1E7TSCv6kWVdiBBRhKRvnzC7nKh3mAFOpL pqltrUSfbxg5zIFDac6S7KobLCnxSsV+nbQxaPzrA4HHzlBVgMnxRjKpK4iieQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647504835; a=rsa-sha256; cv=none; b=J2Xbsf/kWCyu6wOFGeYuvVWsTVEjgPlEdnQbU7MrT8oWhEyKvPTt/mBNaglE0+6oPkOXC9 OjR8eK9JG6OrMDFGGb08ZvEdxyAZ3c788wX1XzisAvueqbuJOkJPrQc+NO802sPgHC9Xk1 DdUl03IiANDZSm1Yon+EjO8hr71a6v6Kv9aY9IEwEjyK/OnrPuF72717KhWRSvLn94WdBg 2cijWkzxB8A28lNzRGHdhOlsDXcADRoKpHh3abVP8TAs1U2S4gauacuXhOIGVTJ46icHFW 0BhVd0Cl+YvAVvKPRqAb7ju0NbTx36Pcw1Gi54m5zpr3TZfsuI90wQBgOeFqQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225076 Ronald Klop changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ronald-lists@klop.ws --- Comment #3 from Ronald Klop --- (In reply to donaldcallen from comment #2) Does this match the problem? https://forums.freebsd.org/threads/auto-importing-a-zfs-pool.12875/ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 17 08:21:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C5AD61A2F973 for ; Thu, 17 Mar 2022 08:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KK0TS26Czz3lKB for ; Thu, 17 Mar 2022 08:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2850926F23 for ; Thu, 17 Mar 2022 08:21:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22H8L015099690 for ; Thu, 17 Mar 2022 08:21:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22H8L09E099689 for fs@FreeBSD.org; Thu, 17 Mar 2022 08:21:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225076] loss zfs pool after reboot Date: Thu, 17 Mar 2022 08:21:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ronald-lists@klop.ws X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647505260; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zaFxuh/8A/uMkRC4P6xjG0BSiw9+4qYASIHyXEnfQDU=; b=h0KD+vq9W8DV1HsKi9SwOT0Y9LdTBvMmqC8IvTQgVhox7gA4J82+xbmbHzkqHeZ7p8AnBA oMqWJtCvFSNFShr6Mn9ptM5RiB8i7hMnNQGAzeTNlXSOdBhrKGJCNcLI2vjb1TBi7huz4f yNtMwFHNaUq/ii/ByKJLIlvLzChspvOnrdJtPxIg2KoDo3L6OoMYgkzhAEpGgVaw0DOFvM rlpHWhRjbl/1241kBaSoVGLjdZQ8vO+TXFNHhh2P7Rh3+Qjn+EhOzxS6IP/iByYi5pmAYm BEhPKbu2LUMlUctNM6pGSa8P0yfT1+jauRsRcljaPd5ZfW9GMvLo210bAqdchw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647505260; a=rsa-sha256; cv=none; b=bF1uf/eFp8beNOM3Lb+cMH3jhXgI1phdasqUTIq8+mjedWH1+VECO2yFi4trdzgEgbHwYz oXSMYDnCgqcKlKC/R+Sxc3FseeTtDbHuVPmVsMv0PacZVAwxvBQxOfS7LW+4P5Jnc9pOw4 LVOHRjC7lKUMw+D14L8V7jbv9cCKctoA5liXgRC492OJIhSuVcaVUwj5Df7lGFD2YRQCZg Kc9Njp0iJRrZXweXC+GTjeOHrEim6FMs7lV5+yEnibd/Db3e0NECra0c7jV2ZRlI67u1m7 BHgT3YRwMUx7DRruic+0Ntqi70gnpnn3MPn2SGCMrmU85CvXt2W2TvUKdhHvyg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225076 --- Comment #4 from Ronald Klop --- (In reply to donaldcallen from comment #2) Oh I re-read your issue. It is different than the original issue. My previo= us reply is about the original issue which does not have the pool imported aft= er reboot.=20 You have the pool imported properly. Just the directory is hidden behind another mount. Can you provide more info about your system but in a new iss= ue or on the mailinglist? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 17 12:27:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 035911A24DDA for ; Thu, 17 Mar 2022 12:27:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KK5yB59DQz4qr5 for ; Thu, 17 Mar 2022 12:27:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 91C9E242E for ; Thu, 17 Mar 2022 12:27:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22HCRkPe041762 for ; Thu, 17 Mar 2022 12:27:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22HCRkXp041761 for fs@FreeBSD.org; Thu, 17 Mar 2022 12:27:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225076] loss zfs pool after reboot Date: Thu, 17 Mar 2022 12:27:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: donaldcallen@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647520066; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JUzWYgbGh5zOd8XaUN4lzuHMa51wf9OItiRroB2Uxcg=; b=GzKXoBnBuL7HYOIck/j4jdT53bd+YqPdO93k5F+/yJH0OyeR4IRaJpKYsc1OpS4ijlbdIj zu9QQXHFZqIIpmuOo7PaDF4YwSHylyN+znwfR8SCuk8QjRdzOtehCq/jgj3uGnX+SGoxZK nXSIFUMZQPEYYiELvbaewDMwerncWjIUQFk8aHSqhfiCKW5ZuA2kz35qmN+702y3Zf2IJh n8dmcUrQ9NJ2n2nnlPksI3SF+UloT+XUUNB/C5tqx6wqct9Ey66AgX05tVw/pDUBqoCwQP DkRJ7tcu/pNIWiGllPT+5jsxPyuYPTTAFp4fD8pQeVUnxsSW+aEzw4DAhHTGqA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647520066; a=rsa-sha256; cv=none; b=keEbS1JJbKHkb9s28/q0ri1KH9hs/JXF40ZuUWUIX4i8EIbTOH9iEfinknh8Sn896+4dLK jrnlrrD/R4lvk7LPaqUZTNNRJ0Qf6r8BDoxzvAFUhBeyeMKq1hveMO52Pj/DI90VYDRTcQ mdHR16z4iTvgDaCXB0JYsPSZDbpiws8pmu21HTZ9syZdelZkqpxZUzgRJsl01IloTfp2QI 4MZtbju9ctMNVcJOoFMz9qvQs3Jbx9VXs0SDovqfUAdKnxPImGzFMfDfvtkFqBjrZcKqul wHRArRoLDWJSFjQ8npVqib0Erwqm8AcETFQ/75AWl4J7utPlFb+/bbNjkZVJaQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225076 --- Comment #5 from donaldcallen@gmail.com --- @Ronald Klop I opened a separate PR as you requested. Please see Bug 262617 - ZFS pool on USB drive does not mount correctly on startup --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 17 13:19:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 13A2B1A33CE0 for ; Thu, 17 Mar 2022 13:19:41 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KK7641VgQz54Nt for ; Thu, 17 Mar 2022 13:19:40 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id C9409211082 for ; Thu, 17 Mar 2022 09:19:39 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 79300496569 for ; Thu, 17 Mar 2022 09:19:39 -0400 (EDT) Message-ID: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> Date: Thu, 17 Mar 2022 09:19:38 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Content-Language: en-US To: freebsd-fs@freebsd.org From: Karl Denninger Subject: Hybrid partition tables -- can gpart make them? Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms050502050403000901070905" X-Rspamd-Queue-Id: 4KK7641VgQz54Nt X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-4.89 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:c]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.990]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SUBJECT_ENDS_QUESTION(1.00)[]; MLMMJ_DEST(0.00)[freebsd-fs] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms050502050403000901070905 Content-Type: multipart/alternative; boundary="------------VtiOKTH1Cn9N0RnPTF1M680z" --------------VtiOKTH1Cn9N0RnPTF1M680z Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit First, the "why" -- I wish to have *two* OS partitions, a data partition and a config partition under NanoBSD on a Pi3 or 4. Both boot using EFI and the "3", at least, appears to refuse to do so off a GPT-labeled disk.  This means I need *five* slices and MBR can only do 4. I attempted to have one slice be "Freebsd" with the two OS partitions inside it, which would work *except* it doesn't because I can't set "bootme" on those; the EFI loader always finds the first usable UFS partition and boots it.  I need to be able to toggle that to boot the *second* partition. I've replaced boot1.efi (quite some time ago) with loader_lua.efi in the EFI partition.  This works, but there does not appear to be a way to tell it that I want it to default to something other than the first bootable partition it finds. The intent is to enable the capability to upgrade the OS without having to wipe/reload the card the unit boots from, then set the other partition as the  "next boot."  This works quite nicely with nanoBSD generally for MBR-bootable devices (and I use it with the pcEngines boards), but doesn't on the Pi due to requiring the EFI partition which means I run out of slots, never mind that the loader will still find and boot the first one. -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------VtiOKTH1Cn9N0RnPTF1M680z Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

First, the "why" -- I wish to have *two* OS partitions, a data partition and a config partition under NanoBSD on a Pi3 or 4.  Both boot using EFI and the "3", at least, appears to refuse to do so off a GPT-labeled disk.  This means I need *five* slices and MBR can only do 4.

I attempted to have one slice be "Freebsd" with the two OS partitions inside it, which would work *except* it doesn't because I can't set "bootme" on those; the EFI loader always finds the first usable UFS partition and boots it.  I need to be able to toggle that to boot the *second* partition.

I've replaced boot1.efi (quite some time ago) with loader_lua.efi in the EFI partition.  This works, but there does not appear to be a way to tell it that I want it to default to something other than the first bootable partition it finds.

The intent is to enable the capability to upgrade the OS without having to wipe/reload the card the unit boots from, then set the other partition as the  "next boot."  This works quite nicely with nanoBSD generally for MBR-bootable devices (and I use it with the pcEngines boards), but doesn't on the Pi due to requiring the EFI partition which means I run out of slots, never mind that the loader will still find and boot the first one.

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------VtiOKTH1Cn9N0RnPTF1M680z-- --------------ms050502050403000901070905 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzE3MTMxOTM5 WjBPBgkqhkiG9w0BCQQxQgRApQ5CNvgQKKPvjPlHOtPaGxW38hCNalOck1XnJjc40d+Tz5WH YGhJWF0sabBgPGOsf55x18FWaWJlyxZwrVgZgzBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgBKAPCd9RkJId+hIQ34LwGcGJ+yyQLagnN6SRDHLdqweBVUfUuMiSU33LsDQNTkm+CQ re3vCB+ZBDMdZew0Y8d+Sk3gnsRWbPD3NrkfgwMKNmy/HdCCE2cKycpolbapely9YGK4GTz9 JxdPO8alIEEgaiKLZYg9c4JxB+fBxX03EfiFf28wT8UAzFLfXlLrO2x4H66HVBsMBKAY5f4z dD4uQgTki8CHrQgvO3QPLv0dQ4QKC30+nay2oLpHhvop04XtwjSYFFONRcF3nHSb9W0SApAV HKtQG4EqKaMpcmv2Mg2TmgBemNpEKA2IQ5Bc/prwYgBYplTFqyQtQlA/zV/1XDtGK8mxsdh1 1fR8ScfPvaCVuyOKnFOD+QjRFg39b5TMvruFEH/8KBi30EfBX2jt8WXPETPpYzNvadhF2wUP rbctketOEQys02mh0trTAp2zjg8w4eSmdIRk4WKgfLMW+oGjgSDk+DbAu5GjYNVSTgE5eecT WNGfspstwKgAADGmgLbJqluZNwTvFJJq8xg0ZdbRnpWVfvqucBNV3zh3g/IwgkbLphU5hD/b 68EiOcBhNg9eqXNJmYiMynMIBoVClYczJx3qEpX+wn146Eu1t8PWxKNE1rh9Ic6x1k0FlpSm zYarGpwWzf1eRtMtHO5YCiclNI+JlUi50zGrWAAD/wAAAAAAAA== --------------ms050502050403000901070905-- From nobody Thu Mar 17 15:51:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3BCE91A12EDA for ; Thu, 17 Mar 2022 15:51:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKBSl4rtkz3n7T for ; Thu, 17 Mar 2022 15:51:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7932A53B7 for ; Thu, 17 Mar 2022 15:51:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22HFp30D057398 for ; Thu, 17 Mar 2022 15:51:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22HFp39B057397 for fs@FreeBSD.org; Thu, 17 Mar 2022 15:51:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Thu, 17 Mar 2022 15:51:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647532263; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tiT3fUaYHWBgnvTWTJ0VJOgFgWVb69EBzQNqlV2JFBk=; b=npGVA64vRo6lgKyefM057vBEl7i3zgpPxLHiem5TUunVPbzjnwz6KXDlErZaiREu3misgy 0yLSsHwKJst6Ra4CNfpNSutZ/1KcU9kE7cw0v4NhIby90kLALX8xmeEjRO06FLnB3x4T4n +NAB2WKGj2tA/qeeriu28fACJtMJ8uPQy6n7utqfBpuP0+sLDRDElFvmdnFgoqVvOec8/f 2Oz1otU04zI4X+axNwKGRFNi/rnlTrU6GQrGBqniU3HPgcI/wjzmMScJqI0kHlruhVODYh PWam/7VpDJOyLBcXUTFi/YgBi98nBivEIeH1JlyRmN/ezC/p+NXSx64Cc83e8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647532263; a=rsa-sha256; cv=none; b=yyBCA0h0AaZORTk6IkFw9ryuzXeqErLhLYagJsfvIzMs3v6sG1kIqJKYHioB7nPTB/uIwk dZGdQUzTmm6l3zwP/Hk61NdHkKn2zo40DPRbMvZBOGhSGWKNgNdUiclBd7+Wp9m8cgY7na 0sbgyL6shxrovLUWHJ1rgphetS+osTZ5YTVriEVBDkVF4nD5f0GOwvzOgcw0JGQ0hMN69o YVyQ2uo8jdQuONOCabXnkWkBVHWMu7SxPUFypPYtz4jCwD2Sd1ww+m1Qu9rny7HbLgSWjp Rn7vklAXDMuf0150JGKuECoIcLQ8ZJGdV6NxW4RX3xOZoI7xa7XzonKypcUdhw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress Assignee|bugs@FreeBSD.org |0mp@FreeBSD.org --- Comment #2 from Mateusz Piotrowski <0mp@FreeBSD.org> --- I'll take a look at it. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Mar 17 15:51:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 131221A13A5F for ; Thu, 17 Mar 2022 15:51:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKBTn1gH7z3nXc for ; Thu, 17 Mar 2022 15:51:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0815E5716 for ; Thu, 17 Mar 2022 15:51:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22HFpuDk057577 for ; Thu, 17 Mar 2022 15:51:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22HFpu8v057576 for fs@FreeBSD.org; Thu, 17 Mar 2022 15:51:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Thu, 17 Mar 2022 15:51:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647532317; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bLygwRZOGcxJp6vA6YGu3C6DXgrZQzwRED4TS4GbUy4=; b=QBMY0TxnHjHWYiAHknc+TD2kh5zqcGIa3Dzlr0LAG3QlK1G4TR1YbGz1mUcqrR1MicbtMP ooTCVLiHV2Xd8oGKBpmVsqnKaomHXPnK1iQhBl/AOF5IgMJ0B+pRRls2q+SWMQuWyiWZBr v2myJOnXFYLXAjQQO1d++5ggaBApPjeKmmG+kCFWAUl9YeIu0QEEZPQJd5xeN0ugwRNnzX GbCEGeyjoWqku9wgkFhuzjdRbmw9Y2hihq1i12SF0Mu4yJlH+DbFUBp3qFbQ3TIgAlgC1x /A2OTrMPFiX5RQ0j/4FiTW2a7PTtWxfFKyNQLyBefKdUOVpvJLFVoBbs1ZQFCw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647532317; a=rsa-sha256; cv=none; b=yb9v4JJxuQslTK+3nkQPYAY0QcMxBGOXgxWGjFwQdpZgpE1fJTm1YDJzxcsrNGRbGlvfyB uUDuqYwuq8qhV3tZUICO+B75Kqr3rnsviFBlytekZx7q1SuWwEsX523gBvkV4RwXk+O5Ts zzWUF+jpZGJBvtODoQ6fYRKgNwXIaoNgtkzynGEGavjD6m9PoxGTtXlkjIhz6rgHxUeyIE q6LPQABrJv6qTTF5sA1LP84M5LB3/K9pmgU/pTrk6oaRP6/pKFcWcQpUP1rW4cx/przV7s v4gFKgmVO0q1oWC0sAl1Tk1whS4uwmVtu4HOk0RW1xNIxCBfPFCvPcQyahTjOA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfs/ | |zfs/issues/13038 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Mar 18 04:19:36 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0A27F1A15DC0 for ; Fri, 18 Mar 2022 04:19:47 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vs1-xe2d.google.com (mail-vs1-xe2d.google.com [IPv6:2607:f8b0:4864:20::e2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKW4f0g8Vz3wWL for ; Fri, 18 Mar 2022 04:19:45 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vs1-xe2d.google.com with SMTP id u198so108614vsu.10 for ; Thu, 17 Mar 2022 21:19:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=1yfYW/rPe8Z+25LAOPMZ6av7OgVjdM/tMbsxJ7bALko=; b=PmT5DVVcM3d0mCYEeJJNrdlbXA4wPXQ16D6aixJ76gZywNXKaa9oR2r8dGJFjRh9lI ZX2DgNiuhPZO8jxEmevfQ53JfNJvBsUUyVjeaKhwWa9WvrEuq1EL9thHzxQrSTDaxF6r 8G4pPnOE1kceHEt5fKzCqzSLGYWpMNnVezb+WrN0tMwrIk4jYlWZN3gHzguBFn4hlx1o RPJmKcaPaXGtqDC19v2vMOS8DGwYbhyER2xKREMoo2OApstsCp5b5Sk7DVfrQLlpioi6 8LNkvy1cHtGtVzHViYnjIdGiW3t/lFqcrEGurQ7BRce3AR3JnzGHkkHFG/uwQ2uOhVX6 L5sg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=1yfYW/rPe8Z+25LAOPMZ6av7OgVjdM/tMbsxJ7bALko=; b=Xyc2/99noIqRDRt1lO53RvET4jooS+/8hhCZojqYVlF6RD5d7MS/G4izocMg2Dxzfc VvGS55tTjvZMx9WxKJipgbAulec6qr66LCrj9OzWBhj2Lvc0houxsZIqHCLWeIwYiWIT +x2DD1rKBpYKafnjlBUiygPrc7PHpJJWofROrVssnqK1w5hlRU5mJpCfGX36E6xVV1ET Htu2f5+/Y1+sHVK5TacFlzeMuzJUYzgFE3FANj7o5Whq4YJYxVxd27Jh0W1alJ0xGrXD PB80f9SSIWf4J1uGNX771eW+0Cj0p4Uzk6so45whnmvlBjdaFDGC5K39p6IgCXazMF5M WrPA== X-Gm-Message-State: AOAM533SV/5bjpGWcQCohp9N7zd57o/AFZIq+V1z9n31TkbS2CUls0Sf H2QLgItfChWWNCViyYVYbAuOcYt/AhSveEQWaiYmB29K/DI= X-Google-Smtp-Source: ABdhPJzLoLOZbgCbigwyXW3YW8cmN6uV6hOLxCTar4rjm8N0M2nwNXYNLPo9ux9fWXFFEntA8cbev3db8TSzv8vvwIU= X-Received: by 2002:a05:6102:ed5:b0:322:ba55:d279 with SMTP id m21-20020a0561020ed500b00322ba55d279mr2966268vst.77.1647577185363; Thu, 17 Mar 2022 21:19:45 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> In-Reply-To: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> From: Warner Losh Date: Thu, 17 Mar 2022 22:19:36 -0600 Message-ID: Subject: Re: Hybrid partition tables -- can gpart make them? To: Karl Denninger Cc: FreeBSD FS Content-Type: multipart/alternative; boundary="000000000000dfbf8f05da767483" X-Rspamd-Queue-Id: 4KKW4f0g8Vz3wWL X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=PmT5DVVc; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::e2d) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-0.01 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.985]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.98)[0.976]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2d:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000dfbf8f05da767483 Content-Type: text/plain; charset="UTF-8" On Thu, Mar 17, 2022 at 7:20 AM Karl Denninger wrote: > First, the "why" -- I wish to have *two* OS partitions, a data partition > and a config partition under NanoBSD on a Pi3 or 4. Both boot using EFI > and the "3", at least, appears to refuse to do so off a GPT-labeled disk. > This means I need *five* slices and MBR can only do 4. > > I attempted to have one slice be "Freebsd" with the two OS partitions > inside it, which would work *except* it doesn't because I can't set > "bootme" on those; the EFI loader always finds the first usable UFS > partition and boots it. I need to be able to toggle that to boot the > *second* partition. > > I've replaced boot1.efi (quite some time ago) with loader_lua.efi in the > EFI partition. This works, but there does not appear to be a way to tell > it that I want it to default to something other than the first bootable > partition it finds > It follows the EFI Boot Manager protocol, but the RPi doesn't give a good way to persist that data. If you could get GPT working, you could use gptboot.efi, which allows you to set which GPT partition to boot. We use that at Netflix for this exact scenario. More, see below... The intent is to enable the capability to upgrade the OS without having to > wipe/reload the card the unit boots from, then set the other partition as > the "next boot." This works quite nicely with nanoBSD generally for > MBR-bootable devices (and I use it with the pcEngines boards), but doesn't > on the Pi due to requiring the EFI partition which means I run out of > slots, never mind that the loader will still find andn boot the first one. > So, we read in \efi\freebsd\loader.efi off the ESP by default. We use it to set boot environment variable (not UEFI ones, though there's a UEFI override for this filename) This lets you set currdev to be the device that you wish to boot off of in there. This will load all the /boot files off that partition (at least all the lua scripts, config, etc). I've tested this, but wound up using the GPT method for selecting partitions because that's operationally better for the purpose that I'd needed this for. This won't help with the gpart creation question, nor with the mkimage issue. The RPi requires the MBR partitioning to find things. GPT goes hand in hand with MBR, since we put a 'protective mbr' on the disk in addition to the GPT tables. That's part of the GPT spec. mkimage could be hacked to create this hybrid, where you'd have one FAT slice in the MBR world, and you could have the full layout you want with GPT. However, that's kinda weird, and I don't know how our code would cope with that (I've never tried it, though I have discussed it theoretically with benno when he was trying to have a unified gpt/iso boot loader in BIOS land).... Warner --000000000000dfbf8f05da767483 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Thu, Mar 17, 2022 at 7:20 AM Karl = Denninger <karl@denninger.net&= gt; wrote:
=20 =20 =20

First, the "why" -- I wish to have *two* OS partitions, a = data partition and a config partition under NanoBSD on a Pi3 or 4.=C2=A0 Both boot using EFI and the "3", at least, appears to refus= e to do so off a GPT-labeled disk.=C2=A0 This means I need *five* slices and MBR can only do 4.

I attempted to have one slice be "Freebsd" with the two OS partitions inside it, which would work *except* it doesn't becaus= e I can't set "bootme" on those; the EFI loader always fi= nds the first usable UFS partition and boots it.=C2=A0 I need to be able to toggle that to boot the *second* partition.

I've replaced boot1.efi (quite some time ago) with loader_lua.ef= i in the EFI partition.=C2=A0 This works, but there does not appear to = be a way to tell it that I want it to default to something other than the first bootable partition it finds


=
It follows the EFI Boot Manager protocol, but the RPi doesn'= t give a good way to persist that data.

If you cou= ld get GPT working, you could use gptboot.efi, which allows you to set whic= h GPT partition to boot. We use that at Netflix for this exact scenario.

More, see below...

=

The intent is to enable the capability to upgrade the OS without having to wipe/reload the card the unit boots from, then set the other partition as the=C2=A0 "next boot."=C2=A0 This works = quite nicely with nanoBSD generally for MBR-bootable devices (and I use it with the pcEngines boards), but doesn't on the Pi due to requiring the EFI partition which means I run out of slots, never mind that the loader will still find andn boot the first one.

So, we read in \efi\freebsd\loader.efi off the ESP by default. We use= it to set boot environment variable (not UEFI ones, though there's a U= EFI override for this filename)

This lets you = set currdev to be the device that you wish to boot off of in there. This wi= ll load all the /boot files off that partition (at least all the lua script= s, config, etc). I've tested this, but wound up using the GPT method fo= r selecting partitions because that's operationally better for the purp= ose that I'd needed this for.

This won't h= elp with the gpart creation question, nor with the mkimage issue. The RPi r= equires the MBR partitioning to find things. GPT goes hand in hand with MBR= , since we put a 'protective mbr' on the disk in addition to the GP= T tables. That's part of the GPT spec. mkimage could be hacked to creat= e this hybrid, where you'd have one FAT slice in the MBR world, and you= could have the full layout you want with GPT. However, that's kinda we= ird, and I don't know how our code would cope with that (I've never= tried it, though I have discussed it theoretically with benno when he was = trying to have a unified gpt/iso boot loader in BIOS land)....

Warner
--000000000000dfbf8f05da767483-- From nobody Fri Mar 18 04:31:04 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 468CC1A18675 for ; Fri, 18 Mar 2022 04:31:18 +0000 (UTC) (envelope-from ggm@algebras.org) Received: from mail-lf1-x12c.google.com (mail-lf1-x12c.google.com [IPv6:2a00:1450:4864:20::12c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKWKx1r1Hz4S5b for ; Fri, 18 Mar 2022 04:31:16 +0000 (UTC) (envelope-from ggm@algebras.org) Received: by mail-lf1-x12c.google.com with SMTP id g17so12322641lfh.2 for ; Thu, 17 Mar 2022 21:31:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=algebras-org.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=rzyeP2Bh+c1vNLm09BOq9wtFeHvJZuKUs8HwjmXB68s=; b=qimGFrTwlDo8+zB78QA/cSACV24gZAmZfpQgRVdgJOUldItRtj0prOtov2OgjXQN1o SLZz2KxDJI0YCX3DyfZrDXc/UeoVt4cAp3/mmwmOuR8Tp0/MOiWZD/P2wKXIcOQ4o1lj ZBix1lb8rPEyUlRYRDpG9e6UE48Xg0pzIDVciNmUBzd/Q2ckw1V3EYk4qW5jV38nLNR2 QX6PWKMAWUD2YhTP2VnTD9oooRuv4CnQ9v7p9kZ7SjX7IorBADHpnsn+y31Tpq7m37+x m3CdIBqfAtzJRSoUEIQ3y1+2ETyhWjs99i/jcRZkiSVJz+6iry3S5vtLAGRCsNglAosm 3T6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=rzyeP2Bh+c1vNLm09BOq9wtFeHvJZuKUs8HwjmXB68s=; b=22Rgc3R2XsK0zl8HXBpTA7eN8KU0Z6n6rx85qgwG1mgpGqP0FF9bJ2+gST7ThQg8EJ y7PfT0SYMaMuEIXdsnVZ+lDRcnIHFaa/4WsZGGrrGIH4a90WhH63V8KoIWvKlMSJYtc2 QAFkCLjAuowf2ZP2geZWRLeIiRUBc0SDQjv0lzkBoK/wmGSwmR6dDACtDM7F/YIhFm2V AcWyNmuguOKuLK1GU+gN6Q1+rq4JsXQbXFEgGyXh25wTfJ1L8h7L4CaIBd85MFhM0ES1 qD4QPJE9MrBP6ggZWt9Z6FYsBU888WaWpyxvzSQgUH7f0+iqIr3DYJscJwiR+oTmI09n Uucw== X-Gm-Message-State: AOAM533/2UiUn6Y1L6GaDNn7aivBQ0fZ2/lBrltDOUw4+63DiRD8NW2K DqsUrmG7xkqvUGBwUPCR9UqQ9LUa/agqfiyr3cfWgY9rSK8= X-Google-Smtp-Source: ABdhPJyRpeLJ3f04zxcCN+B0jYNZLQiacm0IWYg+UZShNMjttQgM2ex1D3Xk1CpZwHCp9/CeZ0riRJI3CLv0D3jitWg= X-Received: by 2002:a05:6512:2253:b0:449:f7ea:4ed7 with SMTP id i19-20020a056512225300b00449f7ea4ed7mr3606439lfu.73.1647577874992; Thu, 17 Mar 2022 21:31:14 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> In-Reply-To: From: George Michaelson Date: Fri, 18 Mar 2022 14:31:04 +1000 Message-ID: Subject: Re: Hybrid partition tables -- can gpart make them? To: Warner Losh Cc: Karl Denninger , FreeBSD FS Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4KKWKx1r1Hz4S5b X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=algebras-org.20210112.gappssmtp.com header.s=20210112 header.b=qimGFrTw; dmarc=none; spf=pass (mx1.freebsd.org: domain of ggm@algebras.org designates 2a00:1450:4864:20::12c as permitted sender) smtp.mailfrom=ggm@algebras.org X-Spamd-Result: default: False [-0.50 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[algebras-org.20210112.gappssmtp.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[algebras.org]; NEURAL_SPAM_SHORT(1.00)[1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[algebras-org.20210112.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12c:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N not an FS developer, mostly an occasional FBsd installer these days on bigger hw but I do run Pi and want. to run FBsd on Pi. I got a P4, wound up on (unhappy!) Ubuntu for ZFS on a radxa SATA hat. I really wanted FreeBSD but it wasn't ready for prime time when I commissioned the system. FWIW I would really appreciate the installer logic making this kind of protective MBR+GPT outcome work, especially on the hardware like the PI which has its own peculiarities in boot. Having to work out the special cases for each box is a pain, but if I can incur the pain in "you" rather than in me, its pain once, works everywhere. I think thats the kind of incurred pain we want! -G On Fri, Mar 18, 2022 at 2:19 PM Warner Losh wrote: > > > > On Thu, Mar 17, 2022 at 7:20 AM Karl Denninger wrote= : >> >> First, the "why" -- I wish to have *two* OS partitions, a data partition= and a config partition under NanoBSD on a Pi3 or 4. Both boot using EFI a= nd the "3", at least, appears to refuse to do so off a GPT-labeled disk. T= his means I need *five* slices and MBR can only do 4. >> >> I attempted to have one slice be "Freebsd" with the two OS partitions in= side it, which would work *except* it doesn't because I can't set "bootme" = on those; the EFI loader always finds the first usable UFS partition and bo= ots it. I need to be able to toggle that to boot the *second* partition. >> >> I've replaced boot1.efi (quite some time ago) with loader_lua.efi in the= EFI partition. This works, but there does not appear to be a way to tell = it that I want it to default to something other than the first bootable par= tition it finds > > > It follows the EFI Boot Manager protocol, but the RPi doesn't give a good= way to persist that data. > > If you could get GPT working, you could use gptboot.efi, which allows you= to set which GPT partition to boot. We use that at Netflix for this exact = scenario. > > More, see below... > >> The intent is to enable the capability to upgrade the OS without having = to wipe/reload the card the unit boots from, then set the other partition a= s the "next boot." This works quite nicely with nanoBSD generally for MBR= -bootable devices (and I use it with the pcEngines boards), but doesn't on = the Pi due to requiring the EFI partition which means I run out of slots, n= ever mind that the loader will still find andn boot the first one. > > So, we read in \efi\freebsd\loader.efi off the ESP by default. We use it = to set boot environment variable (not UEFI ones, though there's a UEFI over= ride for this filename) > > This lets you set currdev to be the device that you wish to boot off of i= n there. This will load all the /boot files off that partition (at least al= l the lua scripts, config, etc). I've tested this, but wound up using the G= PT method for selecting partitions because that's operationally better for = the purpose that I'd needed this for. > > This won't help with the gpart creation question, nor with the mkimage is= sue. The RPi requires the MBR partitioning to find things. GPT goes hand in= hand with MBR, since we put a 'protective mbr' on the disk in addition to = the GPT tables. That's part of the GPT spec. mkimage could be hacked to cre= ate this hybrid, where you'd have one FAT slice in the MBR world, and you c= ould have the full layout you want with GPT. However, that's kinda weird, a= nd I don't know how our code would cope with that (I've never tried it, tho= ugh I have discussed it theoretically with benno when he was trying to have= a unified gpt/iso boot loader in BIOS land).... > > Warner From nobody Fri Mar 18 08:19:26 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 252901A2D7FC for ; Fri, 18 Mar 2022 08:19:29 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-vk1-xa36.google.com (mail-vk1-xa36.google.com [IPv6:2607:f8b0:4864:20::a36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKcPC6d6bz3GGw for ; Fri, 18 Mar 2022 08:19:27 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: by mail-vk1-xa36.google.com with SMTP id n128so1711112vkf.6 for ; Fri, 18 Mar 2022 01:19:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=cO7a7PCV2rX+O/RwWqnkSdPD/QqH3+bym2dLSQ7jSg0=; b=p3vi14juEjtUQhe/ayEDSW1+qKdZ0VWiCLwYC6ASofPNtkzz4e1HK2w3vbGh52vw4v xX78tbMZJU4JrhLO+K/yuNgfEF1V9EoyjBpqx+vtdZMbYcsuoyg+xEr+xmda8FuBzhVI kPnX0Ua8An0Y85AD55hutjhIw2TKbKxXQskSMEpPaDLEBWtKyh+WACgafQotDhG3G8n9 nXwXKZqWX1o+0MKM6u2O+2eciWCIc+nmcy+u51YVRR90pe8wFP1lzw+tqKfvrNUGfPWM Imt9m48YCG1pBTNUVeTaIT4KO6C3f+2cWGXPgemrsVnY9GKlCccPlJdHkceiXdMW9nzG grVg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=cO7a7PCV2rX+O/RwWqnkSdPD/QqH3+bym2dLSQ7jSg0=; b=L8t5xD4kEO3vsrlvXciCpXrhZdylFek77hhX2BuilqlLYIyV2nNmzhooh/CtFpUsdd 0ivApbJgYXvKEVCAN9+2fO7bPvwqWidZUkS8KgZ0dLQxO7ZsDB9QlFxHUf4IFkxUsUo6 gmvH2jcKmANW8swYuUP7DADg6QKOOaFye3zXa31U/E0HYZkdPWygYZsX2J/CfXFhNdm9 81yb/W3+Xqj9Ov2PeDDtjjdW1KiCPVQ4xUM3zksVsclckQFBM7HfoBcOh8fmiM+6cTpO p2x8fRV89w6WFZsTDGsX47MpUCFR/z6IaYx0lziY3nw3pAJ2TriHH9iRIlW3wiFMh8Hz cpUA== X-Gm-Message-State: AOAM533GewnRVmSlJHaBhJwmwT00oKQIyRKCWDuzmHEgTg05mxn5K2G+ /VoTjl8lRH7JivkVRE1e4N5gkFSw9C3xm/OjcDnDsGRWTdGR6JKa0/U= X-Google-Smtp-Source: ABdhPJwnTJj3tyVfM89xHJhvG+ktL0qBtOdj+bvC5l4EQyXiOtzNY+G33BEawu/JO2XADN56xt2pSS/eQr6ed5Ps8IY= X-Received: by 2002:a05:6122:130b:b0:33a:c3b9:7405 with SMTP id e11-20020a056122130b00b0033ac3b97405mr3703991vkp.19.1647591567113; Fri, 18 Mar 2022 01:19:27 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a59:d703:0:b0:297:bdd7:cb22 with HTTP; Fri, 18 Mar 2022 01:19:26 -0700 (PDT) In-Reply-To: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> References: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> From: grarpamp Date: Fri, 18 Mar 2022 04:19:26 -0400 Message-ID: Subject: Re: Hybrid partition tables -- can gpart make them? To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KKcPC6d6bz3GGw X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=p3vi14ju; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2607:f8b0:4864:20::a36 as permitted sender) smtp.mailfrom=grarpamp@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.996]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a36:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 3/17/22, Karl Denninger wrote: > I need *five* slices and MBR can only do 4. Only 4 primary, but one can be an extended partition containing a logical partition and a matryoshka nest of many more. From nobody Fri Mar 18 10:49:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ED2F61A2AB6C for ; Fri, 18 Mar 2022 10:50:05 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (cross.sbone.de [195.201.62.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKgl06gMQz3w1c for ; Fri, 18 Mar 2022 10:50:04 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 84DC48D4A179; Fri, 18 Mar 2022 10:49:56 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id F26E2E70816; Fri, 18 Mar 2022 10:49:54 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id KmakAArSqvfD; Fri, 18 Mar 2022 10:49:52 +0000 (UTC) Received: from [192.168.2.110] (unknown [IPv6:fde9:577b:c1a9:31:68d3:4708:a90a:e0e6]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 62802E707CB; Fri, 18 Mar 2022 10:49:51 +0000 (UTC) From: "Bjoern A. Zeeb" To: "George Michaelson" Cc: "Warner Losh" , "Karl Denninger" , "FreeBSD FS" Subject: Re: Hybrid partition tables -- can gpart make them? Date: Fri, 18 Mar 2022 10:49:49 +0000 X-Mailer: MailMate (2.0BETAr6151) Message-ID: In-Reply-To: References: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4KKgl06gMQz3w1c X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 195.201.62.131 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net X-Spamd-Result: default: False [-0.30 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:195.201.62.131]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[zabbadoz.net]; NEURAL_SPAM_MEDIUM(0.99)[0.987]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.984]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:195.201.0.0/16, country:DE]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 18 Mar 2022, at 4:31, George Michaelson wrote: > not an FS developer, mostly an occasional FBsd installer these days on > bigger hw but I do run Pi and want. to run FBsd on Pi. I got a P4, > wound up on (unhappy!) Ubuntu for ZFS on a radxa SATA hat. I really > wanted FreeBSD but it wasn't ready for prime time when I commissioned > the system. > > FWIW I would really appreciate the installer logic making this kind of > protective MBR+GPT outcome work, especially on the hardware like the > PI which has its own peculiarities in boot. Having to work out the > special cases for each box is a pain, but if I can incur the pain in > "you" rather than in me, its pain once, works everywhere. I think > thats the kind of incurred pain we want! I’ve been using gdisk from ports to do the Hybrid for the Pi according to scribbles from: https://wiki.freebsd.org/BjoernZeeb/RPi I hadn’t managed to get around to look into gpart and see if it’s possible to easily add that to it but it also seems my only use case so not sure it was worth it. /bz > > -G > > On Fri, Mar 18, 2022 at 2:19 PM Warner Losh wrote: >> >> >> >> On Thu, Mar 17, 2022 at 7:20 AM Karl Denninger >> wrote: >>> >>> First, the "why" -- I wish to have *two* OS partitions, a data >>> partition and a config partition under NanoBSD on a Pi3 or 4. Both >>> boot using EFI and the "3", at least, appears to refuse to do so off >>> a GPT-labeled disk. This means I need *five* slices and MBR can >>> only do 4. >>> >>> I attempted to have one slice be "Freebsd" with the two OS >>> partitions inside it, which would work *except* it doesn't because I >>> can't set "bootme" on those; the EFI loader always finds the first >>> usable UFS partition and boots it. I need to be able to toggle that >>> to boot the *second* partition. >>> >>> I've replaced boot1.efi (quite some time ago) with loader_lua.efi in >>> the EFI partition. This works, but there does not appear to be a >>> way to tell it that I want it to default to something other than the >>> first bootable partition it finds >> >> >> It follows the EFI Boot Manager protocol, but the RPi doesn't give a >> good way to persist that data. >> >> If you could get GPT working, you could use gptboot.efi, which allows >> you to set which GPT partition to boot. We use that at Netflix for >> this exact scenario. >> >> More, see below... >> >>> The intent is to enable the capability to upgrade the OS without >>> having to wipe/reload the card the unit boots from, then set the >>> other partition as the "next boot." This works quite nicely with >>> nanoBSD generally for MBR-bootable devices (and I use it with the >>> pcEngines boards), but doesn't on the Pi due to requiring the EFI >>> partition which means I run out of slots, never mind that the loader >>> will still find andn boot the first one. >> >> So, we read in \efi\freebsd\loader.efi off the ESP by default. We use >> it to set boot environment variable (not UEFI ones, though there's a >> UEFI override for this filename) >> >> This lets you set currdev to be the device that you wish to boot off >> of in there. This will load all the /boot files off that partition >> (at least all the lua scripts, config, etc). I've tested this, but >> wound up using the GPT method for selecting partitions because that's >> operationally better for the purpose that I'd needed this for. >> >> This won't help with the gpart creation question, nor with the >> mkimage issue. The RPi requires the MBR partitioning to find things. >> GPT goes hand in hand with MBR, since we put a 'protective mbr' on >> the disk in addition to the GPT tables. That's part of the GPT spec. >> mkimage could be hacked to create this hybrid, where you'd have one >> FAT slice in the MBR world, and you could have the full layout you >> want with GPT. However, that's kinda weird, and I don't know how our >> code would cope with that (I've never tried it, though I have >> discussed it theoretically with benno when he was trying to have a >> unified gpt/iso boot loader in BIOS land).... >> >> Warner From nobody Fri Mar 18 11:26:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 405F01A34A5D for ; Fri, 18 Mar 2022 11:26:59 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKhYZ2mR8z4Ygy for ; Fri, 18 Mar 2022 11:26:58 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id 015C82110A5; Fri, 18 Mar 2022 07:26:51 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 8510C1D2467; Fri, 18 Mar 2022 07:26:51 -0400 (EDT) Message-ID: <14170134-a925-1f24-6138-eb57ce881752@denninger.net> Date: Fri, 18 Mar 2022 07:26:50 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: Hybrid partition tables -- can gpart make them? Content-Language: en-US To: Warner Losh Cc: FreeBSD FS References: <68449cab-c5d7-47ff-99e1-d0e6963374d0@denninger.net> From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms000407000004030404060808" X-Rspamd-Queue-Id: 4KKhYZ2mR8z4Ygy X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-3.06 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEFALL_USER(0.00)[karl]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; HAS_ATTACHMENT(0.00)[]; ARC_NA(0.00)[]; NEURAL_SPAM_MEDIUM(0.83)[0.831]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.995]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.81.26.48:received] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms000407000004030404060808 Content-Type: multipart/alternative; boundary="------------gzBL93ra00EIDAG6rgmuBuF2" --------------gzBL93ra00EIDAG6rgmuBuF2 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 3/18/2022 00:19, Warner Losh wrote: > > > On Thu, Mar 17, 2022 at 7:20 AM Karl Denninger wrote: > > First, the "why" -- I wish to have *two* OS partitions, a data > partition and a config partition under NanoBSD on a Pi3 or 4.  > Both boot using EFI and the "3", at least, appears to refuse to do > so off a GPT-labeled disk.  This means I need *five* slices and > MBR can only do 4. > > I attempted to have one slice be "Freebsd" with the two OS > partitions inside it, which would work *except* it doesn't because > I can't set "bootme" on those; the EFI loader always finds the > first usable UFS partition and boots it.  I need to be able to > toggle that to boot the *second* partition. > > I've replaced boot1.efi (quite some time ago) with loader_lua.efi > in the EFI partition.  This works, but there does not appear to be > a way to tell it that I want it to default to something other than > the first bootable partition it finds > > > It follows the EFI Boot Manager protocol, but the RPi doesn't give a > good way to persist that data. > > If you could get GPT working, you could use gptboot.efi, which allows > you to set which GPT partition to boot. We use that at Netflix for > this exact scenario. > > More, see below... > > The intent is to enable the capability to upgrade the OS without > having to wipe/reload the card the unit boots from, then set the > other partition as the  "next boot." This works quite nicely with > nanoBSD generally for MBR-bootable devices (and I use it with the > pcEngines boards), but doesn't on the Pi due to requiring the EFI > partition which means I run out of slots, never mind that the > loader will still find andn boot the first one. > > So, we read in \efi\freebsd\loader.efi off the ESP by default. We use > it to set boot environment variable (not UEFI ones, though there's a > UEFI override for this filename) > > This lets you set currdev to be the device that you wish to boot off > of in there. This will load all the /boot files off that partition (at > least all the lua scripts, config, etc). I've tested this, but wound > up using the GPT method for selecting partitions because that's > operationally better for the purpose that I'd needed this for. > > This won't help with the gpart creation question, nor with the mkimage > issue. The RPi requires the MBR partitioning to find things. GPT goes > hand in hand with MBR, since we put a 'protective mbr' on the disk in > addition to the GPT tables. That's part of the GPT spec. mkimage could > be hacked to create this hybrid, where you'd have one FAT slice in the > MBR world, and you could have the full layout you want with GPT. > However, that's kinda weird, and I don't know how our code would cope > with that (I've never tried it, though I have discussed it > theoretically with benno when he was trying to have a unified gpt/iso > boot loader in BIOS land).... > > Warner I found a solution that works. The EFI lua loader, if placed on the EFI partition directly, will load /and use /a config file on the MSDOS partition at EFI/FreeBSD/loader.env, and in there you can stick the directive "rootdev=......" (such as "disk0s2a" or "disk0s2b") Now the disk layout can be: MBR    EFI    Freebsd       freebsd-ufs (system 1)       freebsd-ufs (system 2)       config (for nanobsd, overlay for the MD areas       data (miscellaneous things) You can then update the second system partition while it is running, validate that the load was good (e.g. cryptographic sum verify if you want, fsck of the new system boot partition is clean, that the /etc/fstab entry for root is adjusted in the "new" area as appropriate, etc) and then change rootdev only on success.  This is basically the same process that NanoBSD uses for MBR disks in setting the active primary partition which works as intended on MBR devices and it works on the Pi3 and 4 which boot from EFI. What I thought I was going to have to do was have a fifth partition in front of the two system ones that had *only* the /boot/lua and /boot/defaults/loader.conf files, because otherwise if you are updating the first partition and it fails you're boned since that's where the directive is to change the rootdev.  But since the loader will obey the directive on the EFI partition that has proved to be unnecessary. -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------gzBL93ra00EIDAG6rgmuBuF2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 3/18/2022 00:19, Warner Losh wrote:


On Thu, Mar 17, 2022 at 7:20 AM Karl Denninger <karl@denninger.net> wrote:

First, the "why" -- I wish to have *two* OS partitions, a data partition and a config partition under NanoBSD on a Pi3 or 4.  Both boot using EFI and the "3", at least, appears to refuse to do so off a GPT-labeled disk.  This means I need *five* slices and MBR can only do 4.

I attempted to have one slice be "Freebsd" with the two OS partitions inside it, which would work *except* it doesn't because I can't set "bootme" on those; the EFI loader always finds the first usable UFS partition and boots it.  I need to be able to toggle that to boot the *second* partition.

I've replaced boot1.efi (quite some time ago) with loader_lua.efi in the EFI partition.  This works, but there does not appear to be a way to tell it that I want it to default to something other than the first bootable partition it finds


It follows the EFI Boot Manager protocol, but the RPi doesn't give a good way to persist that data.

If you could get GPT working, you could use gptboot.efi, which allows you to set which GPT partition to boot. We use that at Netflix for this exact scenario.

More, see below...

The intent is to enable the capability to upgrade the OS without having to wipe/reload the card the unit boots from, then set the other partition as the  "next boot."  This works quite nicely with nanoBSD generally for MBR-bootable devices (and I use it with the pcEngines boards), but doesn't on the Pi due to requiring the EFI partition which means I run out of slots, never mind that the loader will still find andn boot the first one.

So, we read in \efi\freebsd\loader.efi off the ESP by default. We use it to set boot environment variable (not UEFI ones, though there's a UEFI override for this filename)

This lets you set currdev to be the device that you wish to boot off of in there. This will load all the /boot files off that partition (at least all the lua scripts, config, etc). I've tested this, but wound up using the GPT method for selecting partitions because that's operationally better for the purpose that I'd needed this for.

This won't help with the gpart creation question, nor with the mkimage issue. The RPi requires the MBR partitioning to find things. GPT goes hand in hand with MBR, since we put a 'protective mbr' on the disk in addition to the GPT tables. That's part of the GPT spec. mkimage could be hacked to create this hybrid, where you'd have one FAT slice in the MBR world, and you could have the full layout you want with GPT. However, that's kinda weird, and I don't know how our code would cope with that (I've never tried it, though I have discussed it theoretically with benno when he was trying to have a unified gpt/iso boot loader in BIOS land)....

Warner

I found a solution that works.

The EFI lua loader, if placed on the EFI partition directly, will load and use a config file on the MSDOS partition at EFI/FreeBSD/loader.env, and in there you can stick the directive "rootdev=......" (such as "disk0s2a" or "disk0s2b")

Now the disk layout can be:

MBR
   EFI
   Freebsd
      freebsd-ufs (system 1)
      freebsd-ufs (system 2)
      config (for nanobsd, overlay for the MD areas
      data (miscellaneous things)

You can then update the second system partition while it is running, validate that the load was good (e.g. cryptographic sum verify if you want, fsck of the new system boot partition is clean, that the /etc/fstab entry for root is adjusted in the "new" area as appropriate, etc) and then change rootdev only on success.  This is basically the same process that NanoBSD uses for MBR disks in setting the active primary partition which works as intended on MBR devices and it works on the Pi3 and 4 which boot from EFI.

What I thought I was going to have to do was have a fifth partition in front of the two system ones that had *only* the /boot/lua and /boot/defaults/loader.conf files, because otherwise if you are updating the first partition and it fails you're boned since that's where the directive is to change the rootdev.  But since the loader will obey the directive on the EFI partition that has proved to be unnecessary.

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------gzBL93ra00EIDAG6rgmuBuF2-- --------------ms000407000004030404060808 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMjIwMzE4MTEyNjUw WjBPBgkqhkiG9w0BCQQxQgRA0vo5NQ2KVZUmAPvJ6cRS1L+tFJMvNoMggAkz0vxyk/7iYCJO 2y8UxMWS0gpc0WES/GM+H6PUNWrMp2hUi1MD8DBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgB0cwMpEPJpm67Vc0eeGEJ+fDcYyn4zmw9XtPHIAxoLVjFAHbf5vJ+ASorHdcVNZEdp 1lZHL1onxOElJ3QH5LE+7SbJaL9R6awV/Ld10+d7Iig0ShAauMbRoRm/PyHOPmjiU05B73u0 DZrpcDv2iXKDAvQ+NxL1fvPv0HGqfFCz0lgnJWhJRiBA1inJbsJ4xfTDbmFEJ+rWagu5rLW9 VjgMrP3onFCdjdXwPA1qNyI+lDHDEOFgybG/Q2p6/sFA+YwvEPRJB4Q3fUjwBSJ3+ebH1hxr ieketYlOJfoqyDosZQV+7tdz4DyvO2UqiWBe82h0E+Tivr52VPvdUNiECCTD31+obm9N4Q+f 0q8fQgAJEWYWOseHSU3a9koP0C7bgGIO1+EIxU8Imde5YGrl0/s1HnMzDNSfkU8C/YxpEDE0 D/YZ4IQGlgcNtK7gbZTx5vY5sEuddZpZKa/3Ftsu9J2BAbFpCatRKXAg56tk6xFrdIrHKBK7 vrMo7LOe0l4czKb5UVoM8WU24T9+SGZ9Ix4iNu+givhioX754En8iLbUEj2GbFBK4Fg46CD5 Kh47+0vsBEbEhjrqlyviyfS2SqL9iaQSi3rQX7nTSvOvHM1na2+Rp0CMRjbgB0dvy6EILKqS xCEGRJcMxd0IbBQXX4zj2B4l8u3RKIUO0iWgx70hIQAAAAAAAA== --------------ms000407000004030404060808-- From nobody Fri Mar 18 12:52:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D48D41A215B0 for ; Fri, 18 Mar 2022 12:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKkSP4v9wz4mpn for ; Fri, 18 Mar 2022 12:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 896251F44B for ; Fri, 18 Mar 2022 12:52:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22ICqbFW075006 for ; Fri, 18 Mar 2022 12:52:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22ICqbGw075005 for fs@FreeBSD.org; Fri, 18 Mar 2022 12:52:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Fri, 18 Mar 2022 12:52:37 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647607957; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pCQUHGEdsXctV8ugU59I2kiZm5Wq+8/Nt8556no5kfM=; b=jkC7dXjYBoEHCKHeka/5qwGwJR8FF0B8LD/s1rRH7MbJ8WYlOeT2lNw17tPUFxhHvQYTvU 0y1HasNyyXC0+I4oj1D8rmD+RNewK2sGqbaxdGmwlTehbDuC7oJ3SjP8RsyV5BKAvhJKC+ onYc3ZRtsgLv5sKwei2WdDhgqaNsrJD5EoLmsI1Kg0+zKasgJqoSeU29b6EGffJqIRClNo KADPd0y5b1tgchrCd0VpSIvAH5cTzbxp3xkdjCna0r8uHHSQ+FxIDAK3wIgVwIQ0RPLkcY +IdVvvNc+Zky9P40TLxQ6gfsLqiHRDv5zc+rvk5I3dbUBGalVu+Rg5g1PCvFFw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647607957; a=rsa-sha256; cv=none; b=Swn+KZCcUQgWZ9ynr5C9vykE1VEGslfJkQpqSZnRkB2uBSs3I19oQHO3CjdQBSo6BbQiqh iPAr8keqmCv/5yggFCKtlpqZvn73CTY5WJm13HWlBiCNfXJe7/CvfjSpMAp1q4CGCZosgh upeNEnz/KJn2Rg7LeehTlQft8I6Diak/K6uliNL1wOtwgjfQ7S7S5lFNZzA9CfEQMDBe7z N9FthcFTvk4RisHWpuGwVSI6NbcdLERNi2NWDX+UMkbuohk/4Fyma/wTETLHyrkzNZkx08 7dbBVy6GR8gEVhvAJ4RGw5JDLA7UiAyrH4bRumvRbJwotmIsf/fdtMxANGl3cQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://reviews.freebsd.org | |/D34601 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Mar 18 12:52:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 75E181A2156D for ; Fri, 18 Mar 2022 12:52:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKkSY6zLJz4mYJ for ; Fri, 18 Mar 2022 12:52:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D02131F48E for ; Fri, 18 Mar 2022 12:52:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22ICqjW8075043 for ; Fri, 18 Mar 2022 12:52:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22ICqjrq075042 for fs@FreeBSD.org; Fri, 18 Mar 2022 12:52:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Fri, 18 Mar 2022 12:52:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647607966; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=F5Z+Ca2Z2ZZrIyKgCgokLoK2ozsV80zoiczTTAALUEk=; b=Iu+ESHxs1TWHyh7MvMTiXr7yC6+AxNxHd7ZRY02fN+yHOzYFKjuJUEN8sLGaAn3Bs4mt3t OJxcjjb8hWP5kyJcd4SQx+PjCiREb3g7Mm6Gu50Z+SbAooXzsqBrfMCKaa0Oy7wuNF9O7U RAkGm/yUIQX6IGNVKtDZwn4egWjgi6kPz8xGoqTDPcy6yMigH2OJpODybY8BVM8HqccCAj e6IOs/QRiYKGAqOxzONj0yTcSu9aGf+Hb3at5cxsYEIS0bBd9dSC5tP/HuytZYDlJ3mVdz Etg2GJ4g2XkKr4pNKxubnEfYqz0HhAbFmnXjnW98j3R+mf69Jgm5rKBnZqIHFQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647607966; a=rsa-sha256; cv=none; b=UskAKCuxgllxII8r9tnW3611tzw8kCTsba7k0foNmy3QFixpAenz3PDITixF56vsu9Pl0+ 9P3rjEdR7GX2YGnyohvBtphHWQSAqPlWvaeTQgthlpoZVBieriGgTrkQ+b1KxHXNhDoB0d 7PN/LZbNp+oQf9P7rwIsCwqp5VnxmJ6s1UMaLOxtPc/q9tThfgW2jQaxVohoUKcr7ZlMEs 2wGijjZ7kNyKKMkcpdMZCzu61+e+qVOwjCmhS0zF4Q7yNrj/8oJDtP6hYe4u5gc5p4N0gZ URnGvaoP23/0+L8VdN5Vs96tVlYNPYBKE8sUDLd2zhGwMmjMRez9aS6dFYxvmw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords|needs-patch | --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Mar 18 13:55:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 29D0B1A13E0E for ; Fri, 18 Mar 2022 13:55:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKlsS6Mwsz3HjV for ; Fri, 18 Mar 2022 13:55:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BCA90203C5 for ; Fri, 18 Mar 2022 13:55:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22IDtu42010084 for ; Fri, 18 Mar 2022 13:55:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22IDtuk8010083 for fs@FreeBSD.org; Fri, 18 Mar 2022 13:55:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Fri, 18 Mar 2022 13:55:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647611756; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G3YMWScnkOMnWM7iT64AqRSCl3b1pD7aK3Esk7Hjt88=; b=nXRxnyb517dVGhMte0uFwGyWVK1bN5DwRu6jK3XcZ3tdUbNa5lPkoSWMEBNj39wvl6dUCq KFxGJoSQrIjWNtswhU0UpLdFFg0/d/w0cAF+93dJAxLE9clXtctcHgM6g0R3qbt1Gxozx8 UyuIiuIaZn89bV+sNoz0yX1ME2yMua0y67mAKMwriDtCN9pS3uJQ52D8igPPg9Et+QT2PF 7iktBbnmPYTivDQjdsM6Yd+VtG3+MsztIbx3t+GBNP2Qmjk4Kzd9/03Z/izVqMjB43QWh3 85CD3/N66rj/+Jb9Mxz6lFyAeBGRZEqTufbA+ECZCw44Vz4aCIR/8VAD8jNxcw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647611756; a=rsa-sha256; cv=none; b=dWGZuhOL6qNvwsM3HbaVMAdCTf9IHe3tkXXsBR652U7OLY9Xbh3rTKmSe+fMrC8mSS5Onl WAs891DlxoIM/10HLUX2k+bFz5LalALWeJ+QH8jV22FaGSjRhr0CCuml69fm9iHgbEJIVl zu6C8WEe98cA6S3FeMiScaXUz6oHPBvEiQwxbDytDvUMHpg/9b2k2+esAbPk67c/Pb1k1g t2I0H1kbAUKrY994AkNwpiVfjjCkl+9LsekKP4VkytlSUXny5w1um7WgSZz93tyjopViER Gp+yB1kV5tPHSidmk9mq5vp/rRdqxS1v2zSt8LXA2kjhYac9nLOaNO+f/5gFsg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 --- Comment #3 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D97aeda2243568b386d792514996a06dae= c55eece commit 97aeda2243568b386d792514996a06daec55eece Author: Mateusz Piotrowski <0mp@FreeBSD.org> AuthorDate: 2022-03-18 12:35:16 +0000 Commit: Mateusz Piotrowski <0mp@FreeBSD.org> CommitDate: 2022-03-18 13:53:52 +0000 zfskeys: Support autoloading of keys stored on ZFS The zfskeys service script starts before the zfs service script, so that dataset decryption keys are available when `zfs mount -a` is run. One of the potential edge cases of this design is that if a key is stored on ZFS it won't be loaded until `zfs mount -a` is issued. In order to address that let's try to load the additional keys and mount related ZFS datasets after the zfs script finishes its standard mounting procedure. PR: 262468 Reported by: Graham Perrin Reviewed by: allanjude Approved by: allanjude (src) Fixes: 33ff39796ffe Add zfskeys rc.d script for auto-loading encryption keys MFC after: 3 days Sponsored by: Modirum Sponsored by: Klara Inc. Differential Revision: https://reviews.freebsd.org/D34601 libexec/rc/rc.d/zfs | 12 ++++++++++++ 1 file changed, 12 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Mar 18 14:54:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C94841A25BB2 for ; Fri, 18 Mar 2022 14:54:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KKn8l3Y37z3msY for ; Fri, 18 Mar 2022 14:54:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 56B0220D6C for ; Fri, 18 Mar 2022 14:54:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22IEsFBG044578 for ; Fri, 18 Mar 2022 14:54:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22IEsF0v044577 for fs@FreeBSD.org; Fri, 18 Mar 2022 14:54:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Fri, 18 Mar 2022 14:54:15 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647615255; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=i7njDqOZHoYE4BrdmP7qFWsQfHw/Plw8ecxS1b2eXFc=; b=OKarUg3M3IC8MvHqW4TbOaOU+P45hP1W2HEDOqrrU3M0pL2z6wGDIA48C96/MSQlMuqJIT j33DsL44moW+kMD8dzsD4ErJA307x6DHn+i79bCIauvc5HMPZsMRi/Z+PPZJL/KeRSwzNB joVrY/Pd+hNRiI+4dCWZyOgn8iUDA0jiliL2tiE//bWMSeeL2CUYN3XIeMZIY+MnvYkSQ8 jhMQgZ9EZf8n1YWVXpuYeRyQpmrg3whohk1L7Q0wdPX9MxzobHFOB+2996wtxbkfPQ+cf4 lBkg6Lg+NRMIxEPYR2bNvog5hPeaE2tSweqoUsz/Qfr6gZ3kYsCupCbP4aTUgA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647615255; a=rsa-sha256; cv=none; b=vhVyNoovL1ofpAAwTDYXIDt2uBFXJfszWQIIFesOLIEtirE+up1kudTY+NWh5P7p+vXu80 YSoUCi39UqOskXyDqa4YhYC+x7VE+qTq8my8KVOxSElK/Os3bc7jRqIHsfgwqiTl75/gxw eg3zlTB4Gcdf9N4iPzqe71DcqXeSBYR8pacGszOQVBDLgh2t7xC/RLIlKouD4Ghy4RodHO WankD0pKnVqlNSmCQTLIbmEFT+4b6jXaLrIgwFniiOiEjHO8ZAXWe8gWgivyXMDkrmHqG4 iQZR/LCVHH3sQJSgEtHiKmw6tIuLieaei0AK2wqb0nCMUQe9EffoF3ZaXpG4QQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |mfc-stable13?, | |mfc-stable12- --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Mar 19 08:55:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 00EA21A1120A for ; Sat, 19 Mar 2022 08:55:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KLF8b5pLzz4Ss7 for ; Sat, 19 Mar 2022 08:55:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A433910727 for ; Sat, 19 Mar 2022 08:55:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22J8thM4059106 for ; Sat, 19 Mar 2022 08:55:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22J8thcv059105 for fs@FreeBSD.org; Sat, 19 Mar 2022 08:55:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key not loaded for a file system within a pool that imports automatically at startup Date: Sat, 19 Mar 2022 08:55:43 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647680143; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qhJZu3wEXmj2jODd7icnGrrXfBUHPgdsaewZB2cwa7s=; b=ouUeabgGB9MzwjESJaKHBcA6C2RGXZcUhy7Bd1Sqayi4H9rnjoIby9luRcagOK71rAntpv rF0IYT1jFNXht5w/aPegUKJoS1JNhn9IVomw/whUk7GBahhwaklz71lLh+HW2AU242WDFn H+DrnMT7bcv9OIxw4icSN/M+ejbewzueJgCTKhuN6XCrG+5h8Stn7qDOyzMU+ZOATgiCP6 Hf4QZyAqpm0jFN8GF6IqNibhGFK+41NRB4gdaLmMEvF4cEyZn056WtkbDbJkL17nWT8clz Z/mN8PyiHwicVIQ2KFC/n5hfyt0wBOa/4j1d2IMbIprYJRtjQKrChZnvCoV0WQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647680143; a=rsa-sha256; cv=none; b=JXUJPRnqoz0gGUrfnZ68ckjj8N/O6ngvMBdricMvoD1+YNgCpttaxodlswEsqH5cRKoD0d H5MmLMtQKyvenwjEhtf55qDcjy/FHwK1+LlhaFKM3bmbTYAZKlRQ4NbWXbGRf8Unw7d+LU o89sMECjsi6EWXseloahg8lF/u8zUJS0r0UZ0D+PrlXg5hoNuLIXWlNiXt2fQPoJNbGXnz HwbtMm++J2c/LtFSA2kjAR/J0EgBNgriHOBJIwEiyORJZohm6j3lzrqgQBs3VgC4WsN7JG +Ln25n+DEg3jzxYilk4JMRHF2QjCMu7HgzJL9MJkprzVZTL4frkhF9a9o0cOaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 --- Comment #4 from Graham Perrin --- (In reply to commit-hook from comment #3) Thank you!=20 Essentially: fixed.=20 There remains a (debatably) spurious line reporting that the file is not fo= und, before the file is found.=20 >From /var/log/console.log =E2=80=93 the first of the lines at 08:14:59: ---- =E2=80=A6 Mar 19 08:08:07 mowa219-gjp4-8570p-freebsd kernel: Stopping devd. Mar 19 08:08:07 mowa219-gjp4-8570p-freebsd kernel: Waiting for PIDS: 81691. Mar 19 08:08:07 mowa219-gjp4-8570p-freebsd kernel: Writing entropy file: . Mar 19 08:08:07 mowa219-gjp4-8570p-freebsd kernel: Writing early boot entro= py file: . Mar 19 08:14:59 mowa219-gjp4-8570p-freebsd kernel: Key file /usr/home/grahamperrin/Documents/personal/VirtualBox.key not found, empty or unreadable. Skipping Transcend/VirtualBox.. Mar 19 08:14:59 mowa219-gjp4-8570p-freebsd kernel: Loading key for Transcend/VirtualBox from file:///usr/home/grahamperrin/Documents/personal/VirtualBox.key.. Mar 19 08:14:59 mowa219-gjp4-8570p-freebsd kernel: Loading kernel modules: =E2=80=A6 ---- --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Mar 19 09:08:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 843871A14014 for ; Sat, 19 Mar 2022 09:08:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KLFRc0tCfz4V3x for ; Sat, 19 Mar 2022 09:08:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EF21910933 for ; Sat, 19 Mar 2022 09:08:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22J98hoG067710 for ; Sat, 19 Mar 2022 09:08:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22J98huV067709 for fs@FreeBSD.org; Sat, 19 Mar 2022 09:08:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Sat, 19 Mar 2022 09:08:44 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647680924; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dVq5mSzd8kSCdKASUokvdiNrfTnv/c0cEqfUSqov6Co=; b=Qz+q9Wyr+GYVTW+Rxs1S/3loL5c4JjOVuk3uiIySf4WnUI5P6oL6r2Z/20qkij4edgzmOT moFph9apeUVQyxVAoSLOxvLseD86JxgvxRUg+Eew9YUaI9rYeG/n6GAQ0ipuHY+nZAH45L 49UOy/cRUtU/HSp8+xdEmZJ4V65aw3heMubVPd/y7YanPsC63LYVmucajLGHE8ubltWtcn cFDyEF2JkDCjeR4fF49hcbUuC6CVF+vUu92z+S84eB9kl5ZXQz4n0Eowi98Y3LWF6Kkr4u Ax0ito7AGizPyeU+EXmojb3YBwc0Efdo7B8z+WU8jY3wws4+FNN9CoLENdC6gw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647680924; a=rsa-sha256; cv=none; b=k8Oex3OladNMrgJX+1iclF+AqhU5dPQLE2p4/VHNroC86wIwHrsBDVI8uBEGwqw0/DkkyX DyGmgVXfEH5dtsxqBgkqv1wBSXXJoHmVCQgWjynZteY7J0PnWaPIwwG7s3+9nVsVmvSJop Wt/YfEoEYXxJZqcezfDaAvpggPcdwa8lv6Epd+8P+AloH7Bj+ccaCb6jcna8SvEcGa4hps Qxypjpersr5Qhkp3+iNvbF6m9vGCUbNkZ2sF4EHd/UBl98yAGHo940fXfAn2uz2lyTPolD NPrqRas45quanCV9Io/qhhUC8m0zNriE4VSVLCKik47MPLqqHZuSyJe5MhZzzQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|(13038) zfskeys_enable: |(13038) zfskeys_enable: |encryption key not loaded |encryption key file stored |for a file system within a |on ZFS not found during |pool that imports |normal system startup |automatically at startup | --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Mar 20 18:42:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7D6DC1A2A995 for ; Sun, 20 Mar 2022 18:42:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KM6781FNLz4j0f for ; Sun, 20 Mar 2022 18:42:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0B2FE4A8E for ; Sun, 20 Mar 2022 18:42:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22KIgRpG038349 for ; Sun, 20 Mar 2022 18:42:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22KIgRdN038347 for fs@FreeBSD.org; Sun, 20 Mar 2022 18:42:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Sun, 20 Mar 2022 18:42:28 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc version Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647801748; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=B9DeYBLA8R7vGAHMlsuf/O+JxMD8fNYcVsBmsO7oEYE=; b=YjIKDP18OIcWyB1XMe7vg6hPYWOV2RlaLO59YbKUiDCQN0ryJZ9fLBA2JR4eBqXLO//CE/ 57Pj7k39/Ui9ZJ61bslacRAezTzNcWGC8y+NxUnyUFeg6crjK4Gr7VXJZPhaCn1FT4CXHs aEVmKq8hnsDH6ZG/2gkcsuGyYBHzk+2dpmJse9Y6EvMGhrOOM5HW6FzmOHcSxU146EVyAX gWB4Jq0qGhNr7yx0mL4+syQ3WrAa/AV/ZaAPtPm0o8anQFMmnaeHfPEJ4TvrFObYhylqw7 kQenc3z5BZGZB6rwysQC5YNvRSP+XEy9ho+rMWtpech1Nnjjy6fQNIoN4x/fRQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647801748; a=rsa-sha256; cv=none; b=myYI+W9k68cyUbK1VWTKYQU5LZaJJc4fBBDbwiv92anDQtHhk8Equ0S1e7wWJIvBFMgzi8 /1rq+yjaECtc7OU+AUeNvxEZ+kwiWUKnkjo4UsmPsxBzjHlkVsPB9m9Hr1oIH+NKEppOgm brtW1j3Ujrk9kyIaCab8dVjG29e8yl25cBowCozbZ5sUK7Aw03uX+oWFK/bef1Z1XRsG6E p4XgDrpOs7qDK8nQyluvJnKJDgpoEVc6+lPBAGx6vZn94kKDBqu33QpjEB5CiMTH/CRJzx H+9gxAKcrHz+M+07Lgrey0hECbwM6KV5csiTj2RCFceR9P1t5RT2umfzYpVlKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|UFS: bad file descriptor: |UFS: bad file descriptor: |soft update journaling can |soft update journaling can |not be enabled on |not be enabled on some |FreeBSD-provided disk |FreeBSD-provided disk |images for 13.0-RELEASE and |images =E2=80=93 failed to= write |13.0-STABLE =E2=80=93 failed to |updated cg |write updated cg | Version|13.0-RELEASE |13.1-RELEASE --- Comment #6 from Graham Perrin --- Reproducible with:=20 FreeBSD-13.1-BETA2-amd64.vhd --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Mar 20 21:00:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8F99D1A3417D for ; Sun, 20 Mar 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KM9Bx27Fgz3Qg7 for ; Sun, 20 Mar 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 20566653B for ; Sun, 20 Mar 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22KL0vHU008347 for ; Sun, 20 Mar 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22KL0vjo008346 for fs@FreeBSD.org; Sun, 20 Mar 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202203202100.22KL0vjo008346@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 20 Mar 2022 21:00:57 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16478100570.A4eA.6382" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647810057; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=5rG+w3SkFI8ZMNzF/g66bP4q0J5NQ/I0LgkqqLfYMGg=; b=PnOZoQvvVXVrVTV8m57JkGaCVIXBwhHr7BI7yVv7SEV5R9/ksz6Rum1VVJXmDXyyh/G42C 8xBPnfQ9SXmLNP09jyN6TxSlgUSedglQiIHp6ItVomaTKCzPrqdPCCGlQMhi0zAOXOtGql uGzPh97mhTwEdSHvGXT5VRdXJ4ezpJPLzNZfd+KVAW9jsGtp2uAPQMjwBNTUY5BqG8fGsl NtGFQpqQz8P2Zdc9zVbzoed+Ev9y972qTkBp8qzKno9k22EEIaAhVwSknw1lCoOJvnEhg0 oBUqP+lCql/E+ZsII7fvxn8o8/TN4YJ+HzPAq4Dg8htWxYrc+QPNsKyh8oW2Eg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647810057; a=rsa-sha256; cv=none; b=VMXd99fXkt/FR4HZGMpBjHKdfdHaneDxUhmIFr+M+kn5rq2P3VRZFnUSv/1cHNV1pvqYx3 wyOtzdu4X5REtpHoBOhKYVlDrC597rRs0zIK0c44F9QfBmHpi+X51INzCPqBeVyx8OLzmY nxYkKArFF0mMUlkVqVo/BsBheS8eyCFSVeUjjQnf0IlzpFJ4I9HdQlwCe1uHGzoE8b5zI1 canLI5FRRdr2f2yJC9n/Z8xKmrdoEVv26xkycLOfQmcuQ5lhftr9QAGcbl+xfqQtcXTkOP l7joK+0bx1Xwm4CbgPm7UgNzI83iqVsNlItuqEYcqMBhEMeTgBWJ4bq15xp8vw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16478100570.A4eA.6382 Date: Sun, 20 Mar 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16478100570.A4eA.6382 Date: Sun, 20 Mar 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16478100570.A4eA.6382-- From nobody Mon Mar 21 14:49:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 84FDF1A30A42 for ; Mon, 21 Mar 2022 14:50:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KMcwS2L9Qz4mbW for ; Mon, 21 Mar 2022 14:50:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 209D81D067 for ; Mon, 21 Mar 2022 14:50:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22LEo0dq055655 for ; Mon, 21 Mar 2022 14:50:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22LEo0Ld055652 for fs@FreeBSD.org; Mon, 21 Mar 2022 14:50:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Mon, 21 Mar 2022 14:49:59 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1647874200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=c3NeFjEmAniW94s9TWAX51jxeOS4ahLysnQ0WtiQXcI=; b=ncsYY0KG1jMqtPk10098i5bWez+nuMpPUG7SNNZN0YSONXMqTiE99f4fhSDHcVwjYHXlap VvfblyDBAGZd6XIYP7LKoQAHI4yv9CqdaUlYS07q6gRfnfysE9U+1ViZORRaC0dzvYAWlR BuRAjMBIHgoM9HF8J6KrTbfup6qhzOvXVUXcr3+WKJeIqJHxDKlMX/dLiDHdYfi3gw3O6C sOmftxddKGBgjDnctDynUG6oDVyxX9UpDrZka3kc6QoF0KbRisg6Be5H+xROqhKdlKRIof cj6qLKjTkDLUwnTpw0Xp4ibFF5e0imecY1zR00CXMhbdicgCeI+bWfZD9CrUsA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1647874200; a=rsa-sha256; cv=none; b=xsJW9+zAFnA3U2bZI+hD+2OoemtZNvJ81zGqb787beLCMUvW/vuGRYb1TdBDpl0hN1DHaG EB94Zvh3wCHAhETJSNDKh94Fn70J1I8ANmLc+i2xCiesJPtVruLjk3RlCCFraL4zdYe2Sv 5bYiFbHLXEp6C2fDB+F4td6U5KE/79NUaxtl/h+okMkNlsKmsFyYj92LIm3FJbE/eYbMHm eQSjDAc9siCwg3wTyaxy0fdEASL95KdcD105MkeLPD5o8hrHKlPKRDCDtOBuuCAe0I95yO IsDs+7/hx887mfFpaH3Ndn5iYii242K3MiH9ARQp2z0W/zmYm1og+CC6HuxFhQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 --- Comment #5 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D2411090f69401998569f24144b08ffc05= 0e3cebc commit 2411090f69401998569f24144b08ffc050e3cebc Author: Mateusz Piotrowski <0mp@FreeBSD.org> AuthorDate: 2022-03-18 12:35:16 +0000 Commit: Mateusz Piotrowski <0mp@FreeBSD.org> CommitDate: 2022-03-21 14:47:20 +0000 zfskeys: Support autoloading of keys stored on ZFS The zfskeys service script starts before the zfs service script, so that dataset decryption keys are available when `zfs mount -a` is run. One of the potential edge cases of this design is that if a key is stored on ZFS it won't be loaded until `zfs mount -a` is issued. In order to address that let's try to load the additional keys and mount related ZFS datasets after the zfs script finishes its standard mounting procedure. PR: 262468 Reported by: Graham Perrin Reviewed by: allanjude Approved by: allanjude (src) Fixes: 33ff39796ffe Add zfskeys rc.d script for auto-loading encryption keys MFC after: 3 days Sponsored by: Modirum Sponsored by: Klara Inc. Differential Revision: https://reviews.freebsd.org/D34601 (cherry picked from commit 97aeda2243568b386d792514996a06daec55eece) libexec/rc/rc.d/zfs | 12 ++++++++++++ 1 file changed, 12 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed Mar 23 20:28:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 21E0A1A2739D for ; Wed, 23 Mar 2022 20:28:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KP0LW6Xj9z4cmR for ; Wed, 23 Mar 2022 20:28:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C122B1E67 for ; Wed, 23 Mar 2022 20:28:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22NKSpSc064692 for ; Wed, 23 Mar 2022 20:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22NKSpCc064691 for fs@FreeBSD.org; Wed, 23 Mar 2022 20:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Wed, 23 Mar 2022 20:28:51 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648067332; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5mOSRNgDe+SVD+9lWhFtazZmwK1D9WYv1ZQieqo6v5k=; b=XZ5WXGx2F2JI9cPw0rot7UvJnJo0a21jPjRjJNi1qE9328AtUk7o/EHrJqVucNCKgeTOMr cNTLIxOau/AvjLFARzCjunR8ZV5qee8rZjCyTOf/vnwVGeWYr+EzyfnKHjJWfB18neRcog sutdvcda9pESlkKapYqiL+XdNYGu+GltcTuDz8tnllRav78jqQda8BpakLW3CKQsB19YKY jppw2tgzqpKt5O5aJLX8nZ2CdQP5YMSPllaQ0EwAEZPxf5LnYp3ob5LyhOWPayJ+l+YXC5 YAx0/hTG3e/hbdwzeGYXSz7/mixQLdhXfDaN1jOEpSE+4tp7MhpVRfB6Xbeyqw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648067332; a=rsa-sha256; cv=none; b=lH0rqj2erHOJ1NsDcvJ6FDAt+zuxbBpy73LF3is5qL45M6espQrA9SCrmaq2WB5IpMEVaK ntSald0MZ4jFkUEIc+7yumlQwVrcY3D19ydxl+o4hOqzfmuIrpmgmFn+ovvBmuwxHVXCvm L2HqKKVnqKOw7JunoGkqNCYgo/vyRi61PjpQ6EwIdeJcpUwLQtkR/+WsKngmApWcJEyb6Y 1EknP0gjKY4KUzXx7k7uqWmxwvnnTkncV+ITvNbqt8TJw8mpYgfC0u5Mzj+eMLIPAYopb7 3rn4X1OP9wURgzduoikanmkDIDST32JJYdFwPbZhKs98NZmH5XIdVwXDyLpgZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch releng/13.1 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Df23b24655f7cb3626d69f64f60b215a48= 70c3722 commit f23b24655f7cb3626d69f64f60b215a4870c3722 Author: Mateusz Piotrowski <0mp@FreeBSD.org> AuthorDate: 2022-03-18 12:35:16 +0000 Commit: Glen Barber CommitDate: 2022-03-23 20:27:44 +0000 zfskeys: Support autoloading of keys stored on ZFS The zfskeys service script starts before the zfs service script, so that dataset decryption keys are available when `zfs mount -a` is run. One of the potential edge cases of this design is that if a key is stored on ZFS it won't be loaded until `zfs mount -a` is issued. In order to address that let's try to load the additional keys and mount related ZFS datasets after the zfs script finishes its standard mounting procedure. PR: 262468 Reported by: Graham Perrin Reviewed by: allanjude Approved by: re (delphij) Approved by: allanjude (src) Fixes: 33ff39796ffe Add zfskeys rc.d script for auto-loading encryption keys Sponsored by: Modirum Sponsored by: Klara Inc. Differential Revision: https://reviews.freebsd.org/D34601 (cherry picked from commit 97aeda2243568b386d792514996a06daec55eece) (cherry picked from commit 2411090f69401998569f24144b08ffc050e3cebc) libexec/rc/rc.d/zfs | 12 ++++++++++++ 1 file changed, 12 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed Mar 23 22:26:16 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 158701A27C4E for ; Wed, 23 Mar 2022 22:26:29 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f51.google.com (mail-ot1-f51.google.com [209.85.210.51]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KP2yD1Ymqz3JNW for ; Wed, 23 Mar 2022 22:26:28 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f51.google.com with SMTP id k18-20020a9d7012000000b005cdb11186f2so802587otj.9 for ; Wed, 23 Mar 2022 15:26:28 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=uiwu25dmIbH1hX+FEYwAPo3ApwKhd9/SMU5uyAZsy9o=; b=aoUsz+ylZgrJ87aY0DMn7MKBREi+lv3oOMV3krVqakv39EBA7Nv+hLnXIRt4VlsNlR 9qDYf7zsPUs7kFzBj9Yb+tSpiT1jg8uPWeCeHz51vJfolRhR9V1mytRSg14gWWqds4xB ZFI7as4kn+PjIA8sYuSVaL9iXvJs3blkeMMyXGymS0kGRs6HPNuKdXAnh8P9afY1F5um QBHIxIAwfJwYwswJE4Uvb7JBQO+hVhlavG1fRVpLUJKG1LZaY+9DwiyXIQ+skn91eXao ziaeoK80kANJizL6hTGRj+9N4QZgwlQMbRrAP/m4he4L8RzMJFND6KTMjRnIolv+Oxj3 hFUg== X-Gm-Message-State: AOAM533DuijEGVW4eB9CbNuCveabenkASvAbFf7tl1qvVq/+1LSWXmHX PhCzOWvwR8ZEFViJyg3Rq48wQvshyM7FiY9nWow16wSguDE= X-Google-Smtp-Source: ABdhPJyuwmx8le+ZlOumyvFKLX8PsDDrOWf024QI9o/noSiqmg3LXVvoqW2myTRDULkp685DF0UhUZk2XaRn79Vo66Y= X-Received: by 2002:a9d:65d7:0:b0:5b2:7265:efcd with SMTP id z23-20020a9d65d7000000b005b27265efcdmr944096oth.371.1648074387134; Wed, 23 Mar 2022 15:26:27 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Alan Somers Date: Wed, 23 Mar 2022 16:26:16 -0600 Message-ID: Subject: What's the best FS-agnostic test suite for a file system's data path operations? To: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KP2yD1Ymqz3JNW X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.51 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [0.98 / 15.00]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.51:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.02)[-0.019]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.995]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.99)[0.990]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.51:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N pjdfstest is great at testing control-path operations, like mkdir, chmod, etc. And it works on any POSIX-compliant file system. But it doesn't include any datapath operations like write, read, or copy_file_range. fsx is great for finding datapath bugs and it also works on any posix-compliant operating system. However, it's a random torture test, not deterministic. Does anybody have any good ideas for how to either turn fsx deterministic, or else a good argument that random torture tests are inherently superior to deterministic tests for datapath operations? Alternatively, does anybody know of a good alternative to fsx? I've heard of fsstress and xfstests. But the former looks pretty much like an fsx clone, and the latter isn't totally file-system agnostic. There's some urgency here: I've already had five inquiries about my pjdfstest rewrite proposal for GSoC. I hate turning people down, so I'm wondering if I can extend the proposal to accomodate two students, or maybe create a second proposal. Some possibilities: * Merge fsx into pjdfstest (my first idea) * Extend fsx to include newer operations like copy_file_range and fspacectl (probably too small for a whole summer) Another GSoC idea would be to implement virtio-fs. However, I haven't done my own homework on that yet. I don't know how hard it would be. If anybody has any other ideas, please add them to the wiki at https://wiki.freebsd.org/SummerOfCodeIdeas ASAP because there's a lot of interest this year. -Alan From nobody Thu Mar 24 06:36:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1AA091A27023 for ; Thu, 24 Mar 2022 06:36:42 +0000 (UTC) (envelope-from BATV+3868aa8635b3ec16ad0d+6787+infradead.org+hch@bombadil.srs.infradead.org) Received: from bombadil.infradead.org (bombadil.infradead.org [IPv6:2607:7c80:54:e::133]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KPFqs1Kbkz3hT3; Thu, 24 Mar 2022 06:36:40 +0000 (UTC) (envelope-from BATV+3868aa8635b3ec16ad0d+6787+infradead.org+hch@bombadil.srs.infradead.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=In-Reply-To:Content-Type:MIME-Version :References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=vQ39eU9QB49mtYcz5g0n4TLaxcDwaagYYnTGe/CA3z4=; b=4kMGFxTZH4O9lG2wH2JUCQgw82 zdGANi+AD+lfm6iHFK1pkLBTMsv/wxkI7tBr/wxo+7YCZHLt4ljrb9XVt2jB5hLb6pUPIyi/YaN+x GPLmzQawttUsSo2uYLc7O50kSbqaeT5Tfwxg8qY520BYCgs+lcIxtZ6AXoWblseqK0AJ8onjLqRFK 2JOxLmMbNQh6D70op7/jJHDGLtX8FXvXkMxCAP+A0bLiuiciwQe1JRLy2bva4D8UU3csA2cPGWN+P UDbbnePmgvNwD7wRMV3H2I2R3xmMcRiB/CVn5EZnZsdYPr3mo8R+Ulm7Tjh+f4zIepEFRluV/hp1T Hz/2ZZpA==; Received: from hch by bombadil.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1nXH5K-00FrJg-7y; Thu, 24 Mar 2022 06:36:38 +0000 Date: Wed, 23 Mar 2022 23:36:38 -0700 From: Christoph Hellwig To: Alan Somers Cc: freebsd-fs Subject: Re: What's the best FS-agnostic test suite for a file system's data path operations? Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-SRS-Rewrite: SMTP reverse-path rewritten from by bombadil.infradead.org. See http://www.infradead.org/rpr.html X-Rspamd-Queue-Id: 4KPFqs1Kbkz3hT3 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=infradead.org header.s=bombadil.20210309 header.b=4kMGFxTZ; dmarc=none; spf=none (mx1.freebsd.org: domain of BATV@bombadil.srs.infradead.org has no SPF policy when checking 2607:7c80:54:e::133) smtp.mailfrom=BATV@bombadil.srs.infradead.org X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[2607:7c80:54:e::133:from]; RCPT_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[infradead.org:+]; FORGED_SENDER(0.30)[hch@infradead.org,BATV@bombadil.srs.infradead.org]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7247, ipnet:2607:7c80:54::/48, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; TAGGED_FROM(0.00)[3868aa8635b3ec16ad0d,6787,infradead.org,hch]; FROM_NEQ_ENVFROM(0.00)[hch@infradead.org,BATV@bombadil.srs.infradead.org]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[infradead.org:s=bombadil.20210309]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[infradead.org:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[infradead.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Wed, Mar 23, 2022 at 04:26:16PM -0600, Alan Somers wrote: > * Extend fsx to include newer operations like copy_file_range and > fspacectl (probably too small for a whole summer) FYI, the fork of fsx in xfstests as a lot of of modern operations like copy_file_range. It is very much Linux specific, but might still be a good starting point for you. From nobody Thu Mar 24 07:37:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E02FE1A3634A for ; Thu, 24 Mar 2022 07:37:49 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-ua1-x92a.google.com (mail-ua1-x92a.google.com [IPv6:2607:f8b0:4864:20::92a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KPHBN634Vz3r3L for ; Thu, 24 Mar 2022 07:37:48 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: by mail-ua1-x92a.google.com with SMTP id 34so1702521uao.13 for ; Thu, 24 Mar 2022 00:37:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=TbmLtOpAkpt1TLGF0UiqYs3ueube+1lql0RRjFwUdh4=; b=JjYSzmLsoONJ8Kjd3CeNtjOIDy7DNlTylY2iaJgkW0b/uAo76JX4b7fZUAfz1ow5Dn 4llPZQeNdPqeHHiMUltRiPqzrICq0vrndkc3QQsdwhEzqXhElW81ueoQ5hqm6kag3JAY 6FIJO2GkmncarvryHgRoLW2PAO53jSXZjarFLdM+q5k5npvgzK0erfW8BQpQfnAv70vy kDy1BKcKJQaEQUKZh4CRI/sk/CY9Ez7zpS5gKXp+DgltReTTkBb9icy3NRgX19hT5elf qroqrGhcNM4kEz0yoELz023XRPEAV38QwDT8T5uu/Dq5gQsEWDzVhpD4Wc/ua2D6z6gd 5tlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=TbmLtOpAkpt1TLGF0UiqYs3ueube+1lql0RRjFwUdh4=; b=5IvKN3+OyHaaf3mvnpShPXAnSZCPbKRWpW5aPGfcFsWt+haFt+/xGBLuJXBSdmwhVl tHMLXmgpK9iLdptzvMVRgCm1DJOAVx6ODEMzJ1pNs+iOM2Xv1pOTsZUOQxT2ngZ8kDzm DDtZCheJfRWZvMi6IeUjQSH7Ul50OaYQQZozoEWDyORrSdHNz5NOGe7UOLB+cRMMJs5p lwu0oCArFcxvuuBFzyTzbZ+RwGk+774h90Y85PBwquNp4aXJb0AliH7G6LIwuBoLtxTG VYOx9sIZKCHHkbnxPIMT9Wz//9qGmZVYPWFLSGDMtpYoMsfJzTmyyKk40aw4eN6dD9rM 7LDQ== X-Gm-Message-State: AOAM532WDe9+N7oB0vb2cv/IaNrLEo9d939CO8W1r6BBWaabIXXP30bT 2ZEty257EKvidjGiXkkjZmlY7vhM6fQDzc/bvOCuJV9fcllxNn3oeTKgKA== X-Google-Smtp-Source: ABdhPJxi+5ZHOdqC81K1QB2Ri77qmKSAZpdVXCg5n0DinrqY+CFflyy8hC93RLWOQKyZOBHpgBEjpC3bQXGfiQlClCY= X-Received: by 2002:ab0:4ac1:0:b0:351:ed7d:e65c with SMTP id t1-20020ab04ac1000000b00351ed7de65cmr1913544uae.36.1648107468141; Thu, 24 Mar 2022 00:37:48 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a05:612c:14c1:b0:2a2:beee:4b76 with HTTP; Thu, 24 Mar 2022 00:37:47 -0700 (PDT) In-Reply-To: References: From: grarpamp Date: Thu, 24 Mar 2022 03:37:47 -0400 Message-ID: Subject: Re: What's the best FS-agnostic test suite for a file system's data path operations? To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KPHBN634Vz3r3L X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=JjYSzmLs; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2607:f8b0:4864:20::92a as permitted sender) smtp.mailfrom=grarpamp@gmail.com X-Spamd-Result: default: False [-2.95 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.963]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.992]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::92a:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Just another tool... https://www.iozone.org/ From nobody Thu Mar 24 15:49:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D90D01A429B3 for ; Thu, 24 Mar 2022 15:49:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KPV5Q2y5Cz4fgh for ; Thu, 24 Mar 2022 15:49:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 416731A561 for ; Thu, 24 Mar 2022 15:49:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22OFnEbR086573 for ; Thu, 24 Mar 2022 15:49:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22OFnEgY086572 for fs@FreeBSD.org; Thu, 24 Mar 2022 15:49:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Thu, 24 Mar 2022 15:49:14 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648136954; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CC3RSwKzrx2RmP8hh/uk3802Jv9gBZbw10Y05GnOPao=; b=OYXipCd+6yoUkYtvXpPFgKDW6u1YwPIF+7VT8amHtABpHnxy25pgGVuF2rynQK9BPAbcsf yS2e6tVX68UWdXsnncheGqa11P0WbqSOmrqNn5K8A40VOisvXQzgiYHDh1VA/gHmW9hb6b 1TUmvJu8GCGCytbCq5A5M97jMOjOu8iDYwZKhnVjoWszy3x4Zl7mPB8P0fOXlbnKKT8Tx2 gXHaoMgMWBsdafdKGMyk2+2SFxJv3EeIlX+KHhajJJOyFKIKJexFN3Y2urm76qFWKKfUh1 nizNRnLgbuKY6NvhQfneq7B41gPALYZnbiSZ+kf61+SB5hiNc7vd+O5MmbML9Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648136954; a=rsa-sha256; cv=none; b=nv8loQFnlGQAxRJcOxKXN/Mzzj1V3dRoU5DCjQ8drO07qBbMxUsWMkLGts9UZ6F65JFKjO 00W3/F6hFqMiGgwjt9BaxkLPqOXhO7E0Dk9qz+omm7FWe2QnvbyDbiKfkquJ5DKTkMEF/m rV7RxBJ+ppQhb3sZtmSaQOv0WCXlx12ZCkppEGHjLRfh2DA6p0+/Xf4LT8G8ITEey7miG+ 5Q8DHC14qYaJkZ2ol5sl4gb4uWmZfI3BEu4oWmPYkUaZ+eOJfdjtO0BUCFC8QDTS38Dehb gPgthURe45VS00/MEb6CV7NghfVI26F3nacHTetd4JrWZNbZUOgcC5rHr+bqKw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Mar 24 15:49:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EF6271A42BD3 for ; Thu, 24 Mar 2022 15:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KPV5Y5MGGz4fvV for ; Thu, 24 Mar 2022 15:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 98D821AAF4 for ; Thu, 24 Mar 2022 15:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22OFnLQj086605 for ; Thu, 24 Mar 2022 15:49:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22OFnLvW086604 for fs@FreeBSD.org; Thu, 24 Mar 2022 15:49:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Thu, 24 Mar 2022 15:49:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12- X-Bugzilla-Changed-Fields: flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648136961; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6p4gTO/d4SMkuerQPv4wlIQjXHxFhsUipiSZhLF4Ww8=; b=SMqVSDOTBgjS/ObN5nRoGbplLSBaY2q0DxJVPdH+3Er5/QVWckkPkPGFrCY9OYmrt2I/Ct 8Tk6NxshLvLvMDyVGUjaRsa6poV17C/jgRgQ9odRekN9sgoGTQ07V5lTr/alUx9uydDmYx 7OCttxlUjGnJAZIurmRX8pw56vyAA4eik4Hr+A282gGLAHRYQSoL8D6y851wDBkMSA+UXJ IeO9ZV8ncUs/c4i/9CU3hLK7cOuvapG+c4ELMDvLYvc2/mUpsLtLYgUUzVtFpMvrk9eN4M jD30wAAlCcYmynFo6O9ypdnQc0f4joasjt6PNVR0JQkfByUBwU9E71RkPTylHA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648136961; a=rsa-sha256; cv=none; b=hWgp23xROhuzjZEA+39MeMzJ4CW4LcL2mRGMx0w5TcBasf7rMqisAkqUtgpOTIWS2Zoxio iOFAETCgg8N4xYTMkkgHEQvb393yYC3W0RkI/Ly66WC8nyV6qcbxD0Ofim8Z9OkCU5RvRr CHS4ACapt2lzW9indee2NA6l+r5TrlH5HEAW1zJB/ZCdzVJiXnvV/xFuWuLKx7dVw6UYeC G0M0YF6ERiTfNYuq59fchGBjUQ5jtqXJ+BgtKhqd6II5SbKNL31ykE7oYKyjFPtfOhZNsg ioAG77iS/+dfoDb08XOvV+lVUtqKQ1KIUu5d8NP0tF5NTqbbT6vKrii8rCtR0w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|mfc-stable13? |mfc-stable13+ --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Mar 25 05:48:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3FADB1A23087 for ; Fri, 25 Mar 2022 05:48:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KPrjR5njYz4hCv for ; Fri, 25 Mar 2022 05:48:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A6E7826846 for ; Fri, 25 Mar 2022 05:48:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22P5mBRo030002 for ; Fri, 25 Mar 2022 05:48:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22P5mBfB030001 for fs@FreeBSD.org; Fri, 25 Mar 2022 05:48:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262760] Trying to import certain zpool leads to kernel panic on amd64 Date: Fri, 25 Mar 2022 05:48:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648187291; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Kl6+XlH2v5QmvgnzJIFuP6kq59xkKSPySkhxPXecj04=; b=bnIh8tfM2jqRi/oOsMTBng8c8bt1qYRwT1D+MGNMyhuFfCAsQYpSB0eCZra8jbG7Gbg1BR 5r7GQcoH8g74ocpB+Vk+PXVKbsDUAdnRTxpGzX4x102Va7jy5+aPQ+83ynMLBUPEEN5NIJ SrxEZo6ByUx7KdBYavXj8SD2+jXEWi84GQaWSizy1Hpmj098CSg7S79gNrtcedq/u/rf0j gR8HCnYKx/iRXchap8HLzbgv6vgHMYMdZgLcTakt3w6BNsuAuGafTKrLF/IoguvClBznbd sEfXYZm4eDMyyhsP+rNODwK6jHzIR97wpaC6pDLcmj4n3ysCSNfo0Rgm2oHFwA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648187291; a=rsa-sha256; cv=none; b=syvQ8cEqJbneayb29xIfC7gxHrFyG4WNNZrnE5l6iFso+yZGu8sfRR2Ds9SnzjwYikpuIp tSv3ecWaz2UPllnM1cpAyB/m0cDRuZ/+1OblpX9u7P/Rss3bF2KdKy7dDsWkhR+vSRTv1W ZMOCEIbRyGwKK4dcq7ZXzlL1vjqb8exYlPp902dlFymMCqsDfqxFP/qwDsjrc93cpM6R8k Z3RsESs4AxaPSAU1c+jlglivn/9GX4LW5khZIBdLPQMC474j/Om16h8TSVQOcK/EW5qSHe 9vQqfWoBeq0mqoYthhkR3PgV5fiYBmFL4xhfeL2gNQycvcy2nJhTePHE6ZG5Cw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262760 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |panic Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Mar 25 13:33:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A4BFB1A24FE9 for ; Fri, 25 Mar 2022 13:34:22 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ33K37K1z3HZH for ; Fri, 25 Mar 2022 13:34:21 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id B2043415F2 for ; Fri, 25 Mar 2022 07:34:20 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 8OkxdJFpz0qZ for ; Fri, 25 Mar 2022 07:34:20 -0600 (MDT) Received: from [169.254.207.51] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id B264F40615 for ; Fri, 25 Mar 2022 07:34:19 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net B264F40615 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net B264F40615 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1648215259; bh=u1HuEijYQXYjTSyJONQ9lTsxJYp02ng7rjIGd0b82hw=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=ywW+Rojn2U/lPHblzIUTzm2tGnP2SKOqHLJzsYx1O2CwJ8A/Um1HjfWZAMswvS95s krjY/3kxxn0V6GuuBTARJTHb1r05+mos5n+Y4uL2V11EJGifvyZ70ghXz7kwRBY7L+ WeQkGqfjoXy7ZHUWFwKLwtxrOX0Y7+LAsZneddrM= From: "John Doherty" To: freebsd-fs@freebsd.org Subject: create zpool from zvols? Date: Fri, 25 Mar 2022 07:33:54 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4KQ33K37K1z3HZH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=ywW+Rojn; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[jld3.net:+]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentation and demonstration, I would like to create zpools using zvols as the underlying block devices. For example, I have these: [root@ibex] # zfs list -r -t volume zroot | grep zv zroot/zv0 8.25G 832G 56K - zroot/zv1 8.25G 832G 56K - This seems as if it would do what I want: [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1} would create 'ztest' with the following layout: ztest mirror zvol/zroot/zv0 zvol/zroot/zv1 But when I try to actually do it, it doesn't work: [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} cannot create 'ztest': no such pool or dataset FWIW, doing something similar on OmniOS works fine: [root@orca] # uname -srvp SunOS 5.11 omnios-r151040-852962cae3 i386 [root@orca] # zfs create -V 2G rpool/zv0 [root@orca] # zfs create -V 2G rpool/zv1 [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1} [root@orca] # zpool status ztest pool: ztest state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM ztest ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0 /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0 errors: No known data errors I thought I had done this in the past. Am I doing something wrong? Am I misremembering and this never worked? Using files created with truncate(1) rather zvols seems to work fine so maybe that's what I did before. Not sure, it's been a long time since I wanted to do something like this. Thanks for any enlightenment. From nobody Fri Mar 25 13:41:18 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 391371A26BAF for ; Fri, 25 Mar 2022 13:41:30 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-vk1-xa2c.google.com (mail-vk1-xa2c.google.com [IPv6:2607:f8b0:4864:20::a2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ3CY3w0Xz3Jgx for ; Fri, 25 Mar 2022 13:41:29 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-vk1-xa2c.google.com with SMTP id l184so4277196vkh.0 for ; Fri, 25 Mar 2022 06:41:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=GzpZL2vgldlzzXhIu2wAfxPdbme6luEZ9PYvrYUjjP8=; b=qi0fY2z8rPVKZe02bCtfIItsVkk3R0JONvsjhjsUHs5wWtAjAx8MDVAL/boZ0G50TG nVFO1v3HMHLNPDBh8BVXZeSxCnheUhyX7Zg/e7+6FLKW5Sbx+kQhZTLQgunTuzysH9mD 8M1P2Nu+RJ7T2i41qaYUbOpfkrUQZyTNReIMAbD2zSspyZa/HBundLcLOlpgQkjJl4dM cykfbZI/XtgXh+QgZ7G+OdLfx7oqj9OCqqLz4XiKNEFpxDakfXUMt1sZVDeZUlOaReru 1gbHjHKG1ywOegtEHCAt4sSoX4rIBxmDHo2VHq/l05KxVXGy78jmFpq8a7Ip4kcuIOff K8ZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=GzpZL2vgldlzzXhIu2wAfxPdbme6luEZ9PYvrYUjjP8=; b=MqAkxRlchwgvOGcwF+a+l09R44PsEm9x3RoQgWgJjcNWBBk+iqPsYcIrHxao0+h7dC jjbEEBhbVkCsuHmoKZi6vg/hsgGsWA1wwKl9+r0eVhR6BIx9zTyzcJ0MB/Pxytxl9a7v RtYuWrziajPEjdIRjISAUsxmNzdp3gfOZUPYItDyB+dSkU8fxK1zHIzyZAFw78DMT3BL WYaGxu7EJAM4bwFRJ+sTXgwbnxreiSMTavGo7Qhy2HrS7I0g4qp7reRBZ7eSz8VKMEHp MZmqnq5FqzPJjczEs32EU2s3LhQBE9a3Je0O93aAQduvrGcqlI4PyO5CcN/F/wc9zwtE A9Qw== X-Gm-Message-State: AOAM5320uwqZoVOLkfVCs2MhlTVy6M0H1wSxJ3Py7Q/QSz3j+CnnJogV zJAJ2ZykTgTdpuHd6ylUZJ4Bmuo0KU7j1DNu9XfogpOVv5A= X-Google-Smtp-Source: ABdhPJwS7ug5cDcunVKVOIsdDteAi0UUFPUy8H1FnwFhYkk8WjmHrwouhE3YBRF8AtlBVGxC6/ZT/2CzYI9MmvFy6U8= X-Received: by 2002:a1f:a40d:0:b0:33e:cc56:70c6 with SMTP id n13-20020a1fa40d000000b0033ecc5670c6mr4974136vke.27.1648215688859; Fri, 25 Mar 2022 06:41:28 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> In-Reply-To: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> From: Rich Date: Fri, 25 Mar 2022 09:41:18 -0400 Message-ID: Subject: Re: create zpool from zvols? To: John Doherty Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000a5d52605db0b1e44" X-Rspamd-Queue-Id: 4KQ3CY3w0Xz3Jgx X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=qi0fY2z8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::a2c as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-1.57 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[3]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.997]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.58)[-0.575]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a2c:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000a5d52605db0b1e44 Content-Type: text/plain; charset="UTF-8" https://reviews.freebsd.org/D4998 added a knob to allow you to do this even though it sometimes deadlocks, which is why it's off by default. It's a FreeBSD-only tunable. That tunable is still there in the post-OpenZFS FreeBSD, too, though it's labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so it seems likely that it still can cause undesirable outcomes. - Rich On Fri, Mar 25, 2022 at 9:34 AM John Doherty wrote: > Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentation > and demonstration, I would like to create zpools using zvols as the > underlying block devices. > > For example, I have these: > > [root@ibex] # zfs list -r -t volume zroot | grep zv > zroot/zv0 8.25G 832G 56K - > zroot/zv1 8.25G 832G 56K - > > This seems as if it would do what I want: > > [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1} > would create 'ztest' with the following layout: > > ztest > mirror > zvol/zroot/zv0 > zvol/zroot/zv1 > > But when I try to actually do it, it doesn't work: > > [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} > cannot create 'ztest': no such pool or dataset > > FWIW, doing something similar on OmniOS works fine: > > [root@orca] # uname -srvp > SunOS 5.11 omnios-r151040-852962cae3 i386 > [root@orca] # zfs create -V 2G rpool/zv0 > [root@orca] # zfs create -V 2G rpool/zv1 > [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1} > [root@orca] # zpool status ztest > pool: ztest > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > ztest ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0 > /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0 > > errors: No known data errors > > I thought I had done this in the past. Am I doing something wrong? Am I > misremembering and this never worked? > > Using files created with truncate(1) rather zvols seems to work fine so > maybe that's what I did before. Not sure, it's been a long time since I > wanted to do something like this. > > Thanks for any enlightenment. > > --000000000000a5d52605db0b1e44 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
https://revi= ews.freebsd.org/D4998 added a knob to allow you to do this even though = it sometimes deadlocks, which is why it's off by default.

It's a FreeBSD-only tunable.

That tunable = is still there in the post-OpenZFS FreeBSD, too, though it's labeled &q= uot;Allow zpools to use zvols as vdevs (DANGEROUS)", so it seems likel= y that it still can cause undesirable outcomes.

- Ri= ch



On Fri, Mar 25, 2022= at 9:34 AM John Doherty <bsdlists@= jld3.net> wrote:
Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentati= on
and demonstration, I would like to create zpools using zvols as the
underlying block devices.

For example, I have these:

[root@ibex] # zfs list -r -t volume zroot | grep zv
zroot/zv0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 8.25G=C2=A0 =C2= =A0832G=C2=A0 =C2=A0 =C2=A0 =C2=A056K=C2=A0 -
zroot/zv1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 8.25G=C2=A0 =C2= =A0832G=C2=A0 =C2=A0 =C2=A0 =C2=A056K=C2=A0 -

This seems as if it would do what I want:

[root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1}
would create 'ztest' with the following layout:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 ztest
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 mirror
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 zvol/zroot/zv0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 zvol/zroot/zv1

But when I try to actually do it, it doesn't work:

[root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}
cannot create 'ztest': no such pool or dataset

FWIW, doing something similar on OmniOS works fine:

[root@orca] # uname -srvp
SunOS 5.11 omnios-r151040-852962cae3 i386
[root@orca] # zfs create -V 2G rpool/zv0
[root@orca] # zfs create -V 2G rpool/zv1
[root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1}
[root@orca] # zpool status ztest
=C2=A0 =C2=A0pool: ztest
=C2=A0 state: ONLINE
=C2=A0 =C2=A0scan: none requested
config:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0STATE=C2=A0 =C2=A0 = =C2=A0READ WRITE CKSUM
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ztest=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ONLINE=C2=A0 =C2=A0 =C2=A0= =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0mirror-0=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ONLINE=C2=A0 =C2=A0 =C2=A0 =C2= =A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0/dev/zvol/dsk/rpool/zv0=C2= =A0 ONLINE=C2=A0 =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 = =C2=A00
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0/dev/zvol/dsk/rpool/zv1=C2= =A0 ONLINE=C2=A0 =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 = =C2=A00

errors: No known data errors

I thought I had done this in the past. Am I doing something wrong? Am I misremembering and this never worked?

Using files created with truncate(1) rather zvols seems to work fine so maybe that's what I did before. Not sure, it's been a long time sin= ce I
wanted to do something like this.

Thanks for any enlightenment.

--000000000000a5d52605db0b1e44-- From nobody Fri Mar 25 13:49:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 96E501A33983 for ; Fri, 25 Mar 2022 13:49:44 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ3P15SVwz3QkV for ; Fri, 25 Mar 2022 13:49:41 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 1FB15415F2; Fri, 25 Mar 2022 07:49:40 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id Uzpz5p0Rrep5; Fri, 25 Mar 2022 07:49:39 -0600 (MDT) Received: from [169.254.207.51] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 1179440615; Fri, 25 Mar 2022 07:49:39 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 1179440615 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 1179440615 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1648216179; bh=yYVyBhs6Op3R2mQOLwvQr0DxzHX62xInBuTK61GIsug=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=Le3n1A1sJV7x8jlRRUUl+6Iy2ox1PBnZBhq9K0JMDqoyHWm9s13icmEGEphuCJk1l 5HcLmibiYJiHsl1aTKCJTe2zWk83UaanGcu8tkey1CAUZlGzrQmUE3hVS+dxi0/nWP 1ryEJUfZEHrW3rvY/FSLo6ZMoYwYF+3l801JBR+E= From: "John Doherty" To: Rich Cc: freebsd-fs Subject: Re: create zpool from zvols? Date: Fri, 25 Mar 2022 07:49:38 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: References: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4KQ3P15SVwz3QkV X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=Le3n1A1s; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N Thanks for the super-quick response. I guess I'll just use plain files then. I don't really want to use the zpools for anything, I just want an easy way to experiment with and demonstrate zpool create commands. FWIW, the tunable does allow the "zpool create" command to work: [root@ibex] # sysctl vfs.zfs.vol.recursive vfs.zfs.vol.recursive: 1 [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} [root@ibex] # zpool status ztest pool: ztest state: ONLINE config: NAME STATE READ WRITE CKSUM ztest ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 zvol/zroot/zv0 ONLINE 0 0 0 zvol/zroot/zv1 ONLINE 0 0 0 errors: No known data errors On Fri 2022-03-25 07:41 AM MDT -0600, wrote: > https://reviews.freebsd.org/D4998 added a knob to allow you to do this > even > though it sometimes deadlocks, which is why it's off by default. > > It's a FreeBSD-only tunable. > > That tunable is still there in the post-OpenZFS FreeBSD, too, though > it's > labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so it seems > likely that it still can cause undesirable outcomes. > > - Rich > > > > On Fri, Mar 25, 2022 at 9:34 AM John Doherty > wrote: > >> Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentation >> and demonstration, I would like to create zpools using zvols as the >> underlying block devices. >> >> For example, I have these: >> >> [root@ibex] # zfs list -r -t volume zroot | grep zv >> zroot/zv0 8.25G 832G 56K - >> zroot/zv1 8.25G 832G 56K - >> >> This seems as if it would do what I want: >> >> [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1} >> would create 'ztest' with the following layout: >> >> ztest >> mirror >> zvol/zroot/zv0 >> zvol/zroot/zv1 >> >> But when I try to actually do it, it doesn't work: >> >> [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} >> cannot create 'ztest': no such pool or dataset >> >> FWIW, doing something similar on OmniOS works fine: >> >> [root@orca] # uname -srvp >> SunOS 5.11 omnios-r151040-852962cae3 i386 >> [root@orca] # zfs create -V 2G rpool/zv0 >> [root@orca] # zfs create -V 2G rpool/zv1 >> [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1} >> [root@orca] # zpool status ztest >> pool: ztest >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> ztest ONLINE 0 0 0 >> mirror-0 ONLINE 0 0 0 >> /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0 >> /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0 >> >> errors: No known data errors >> >> I thought I had done this in the past. Am I doing something wrong? Am >> I >> misremembering and this never worked? >> >> Using files created with truncate(1) rather zvols seems to work fine >> so >> maybe that's what I did before. Not sure, it's been a long time since >> I >> wanted to do something like this. >> >> Thanks for any enlightenment. From nobody Fri Mar 25 15:16:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2609B1A247E4 for ; Fri, 25 Mar 2022 15:16:57 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ5Kg68xyz583X for ; Fri, 25 Mar 2022 15:16:55 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 03E22415F2 for ; Fri, 25 Mar 2022 09:16:55 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id gn9X4-FhTkJ8 for ; Fri, 25 Mar 2022 09:16:52 -0600 (MDT) Received: from [172.21.35.238] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 3D61B40124 for ; Fri, 25 Mar 2022 09:16:52 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 3D61B40124 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 3D61B40124 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1648221412; bh=OtGqmiH/C0IPzzQosuh5/418gXMKxt0AACZLIdyyVw8=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=LgqXvQincMW2m89pv+lzgBE/oH+M6GQsJRlTvtVG+TzZytSMyb+2Ez8gRBm3kqHB6 VThaQr+tpKlLGRCqFAjSujPmqLG7m76LrGiInePb7OOFFpzNCb1nTST0XvjnXBjNp3 pV0NFhjC2G7AoKfW03QTFP/za4OmMlvxyjXDlrpA= From: "John Doherty" To: freebsd-fs@freebsd.org Subject: mirror vdevs with different sizes Date: Fri, 25 Mar 2022 09:16:13 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4KQ5Kg68xyz583X X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=LgqXvQin; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-3.75 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[jld3.net:+]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-0.75)[-0.754]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N Hello, I have an existing zpool with 12 mirrors of 8 TB disks. It is currently about 60% full and we expect to fill the remaining space fairly quickly. I would like to expand it, preferably using 12 mirrors of 16 TB disks. Any reason I shouldn't do this? Using plain files created with truncate(1) like these: [root@ibex] # ls -lh /vd/vd* -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd0 -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd1 -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd2 -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd3 I can first do this: [root@ibex] # zpool create ztest mirror /vd/vd{0,1} [root@ibex] # zpool list ztest NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT ztest 7.50G 384K 7.50G - - 0% 0% 1.00x ONLINE - And then do this: [root@ibex] # zpool add ztest mirror /vd/vd{2,3} [root@ibex] # zpool list ztest NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT ztest 23G 528K 23.0G - - 0% 0% 1.00x ONLINE - And FWIW, everything works as expected. But I've never constructed a real zpool with vdevs of different sizes and I don't know whether there might be any expected problems. I could just create a new zpool with new disks, but most of the existing data and most of the expected new data is in just two file systems and for simplicity's sake from the perspective of those users, it would be nicer to just make the existing file systems larger than to give them access to a new, different one. Any comments, suggestions, warnings, etc. much appreciated. Thanks. From nobody Fri Mar 25 16:02:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AEF7E1A3078E for ; Fri, 25 Mar 2022 16:02:46 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ6L90qkQz3GQq for ; Fri, 25 Mar 2022 16:02:24 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-455-Z7E-8IfQNI27EtLH8sCfmA-1; Fri, 25 Mar 2022 12:02:14 -0400 X-MC-Unique: Z7E-8IfQNI27EtLH8sCfmA-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Fri, 25 Mar 2022 12:02:13 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Fri, 25 Mar 2022 12:02:13 -0400 From: Michael Jung To: John Doherty , Rich CC: freebsd-fs Subject: RE: create zpool from zvols? Thread-Topic: create zpool from zvols? Thread-Index: AQHYQE3bLD+JMqTQAEKC7luKKooYQqzQXnQAgAACVAD//9mLMA== Date: Fri, 25 Mar 2022 16:02:12 +0000 Message-ID: <07cf88d380d94a2f8f97af23bb7d8965@MAIL-HUB.pai.local> References: <72AA1AC8-E623-4B73-A3F3-3FDB0ABDFCEA@jld3.net> In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_" X-Rspamd-Queue-Id: 4KQ6L90qkQz3GQq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-2.48 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.129.197:from]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; RCVD_IN_DNSWL_NONE(0.00)[170.10.129.197:from]; NEURAL_HAM_SHORT(-0.68)[-0.677]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[jld3.net,gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; SUBJECT_ENDS_QUESTION(1.00)[] X-ThisMailContainsUnwantedMimeParts: N --_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi! I have never tried to use ZFS type 'volume' as a zpool but you can share a zpool between zfs type 'filesystem' and type 'volume'. Here I share two type 'volume' stores as iscsi targets and one type 'filesystem' as a zpool. If you interested in my iscsi config /etc/ctl.conf email me off list to mikej@mikej.com. ZFS raid-5400-1 is a simple 14 x raidz2 pool in my home lab. root@draid:/raid-5400-1 # zfs list -t volume NAME USED AVAIL REFER MOUNTPOINT raid-5400-1/esxi-store1 2.16T 3.51T 443G - raid-5400-1/unitrends1 1.08T 2.70T 171G - root@draid:/raid-5400-1 # zfs list -t filesystem NAME USED AVAIL REFER MOUNTPOINT raid-5400-1 3.24T 1.79T 236K /raid-5400-1 Since your experimenting - I am too. (for the curios while slightly off topic) I have been testing ZFS Draid - here is how that pool looks. root@draid:/raid-5400-1 # zpool list -v tank NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP D= EDUP HEALTH ALTROOT tank 18.5T 8.02T 10.4T - - 0% 43% 1= .00x ONLINE - draid2:2d:10c:0s-0 9.03T 4.06T 4.97T - - 0% 44.9% = - ONLINE gpt/da0p1 - - - - - - - = - ONLINE gpt/d10p1 - - - - - - - = - ONLINE da39p1 - - - - - - - = - ONLINE da40p1 - - - - - - - = - ONLINE da41p1 - - - - - - - = - ONLINE da43p1 - - - - - - - = - ONLINE da44p1 - - - - - - - = - ONLINE da42p1 - - - - - - - = - ONLINE da45p1 - - - - - - - = - ONLINE gpt/d19p1 - - - - - - - = - ONLINE draid2:2d:10c:0s-1 9.03T 3.96T 5.07T - - 0% 43.8% = - ONLINE da46p1 - - - - - - - = - ONLINE gpt/d11p1 - - - - - - - = - ONLINE gpt/d12p1 - - - - - - - = - ONLINE gpt/d13p1 - - - - - - - = - ONLINE gpt/d14p1 - - - - - - - = - ONLINE gpt/d15p1 - - - - - - - = - ONLINE gpt/d16p1 - - - - - - - = - ONLINE gpt/d17p1 - - - - - - - = - ONLINE gpt/d18p1 - - - - - - - = - ONLINE da18p1 - - - - - - - = - ONLINE special - - - - - - - = - - mirror-3 398G 2.86G 395G - - 0% 0.71% = - ONLINE gpt/special0 - - - - - - - = - ONLINE gpt/special1 - - - - - - - = - ONLINE logs - - - - - - - = - - mirror-2 15.5G 256K 15.5G - - 0% 0.00% = - ONLINE gpt/slog0 - - - - - - - = - ONLINE gpt/slog1 - - - - - - - = - ONLINE CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, 2101 High Wickham Place, Suite 101, Louisville, KY 40245 From: owner-freebsd-fs@freebsd.org [mailto:owner-freebsd-fs@freebsd.org] On= Behalf Of John Doherty Sent: Friday, March 25, 2022 9:50 AM To: Rich Cc: freebsd-fs Subject: Re: create zpool from zvols? Thanks for the super-quick response. I guess I'll just use plain files then. I don't really want to use the zpools for anything, I just want an easy way to experiment with and demonstrate zpool create commands. FWIW, the tunable does allow the "zpool create" command to work: [root@ibex] # sysctl vfs.zfs.vol.recursive vfs.zfs.vol.recursive: 1 [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} [root@ibex] # zpool status ztest pool: ztest state: ONLINE config: NAME STATE READ WRITE CKSUM ztest ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 zvol/zroot/zv0 ONLINE 0 0 0 zvol/zroot/zv1 ONLINE 0 0 0 errors: No known data errors On Fri 2022-03-25 07:41 AM MDT -0600, > wrote: > https://reviews.freebsd.org/D4998 adde= d a knob to allow you to do this > even > though it sometimes deadlocks, which is why it's off by default. > > It's a FreeBSD-only tunable. > > That tunable is still there in the post-OpenZFS FreeBSD, too, though > it's > labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so it seems > likely that it still can cause undesirable outcomes. > > - Rich > > > > On Fri, Mar 25, 2022 at 9:34 AM John Doherty > > wrote: > >> Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentation >> and demonstration, I would like to create zpools using zvols as the >> underlying block devices. >> >> For example, I have these: >> >> [root@ibex] # zfs list -r -t volume zroot | grep zv >> zroot/zv0 8.25G 832G 56K - >> zroot/zv1 8.25G 832G 56K - >> >> This seems as if it would do what I want: >> >> [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1} >> would create 'ztest' with the following layout: >> >> ztest >> mirror >> zvol/zroot/zv0 >> zvol/zroot/zv1 >> >> But when I try to actually do it, it doesn't work: >> >> [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} >> cannot create 'ztest': no such pool or dataset >> >> FWIW, doing something similar on OmniOS works fine: >> >> [root@orca] # uname -srvp >> SunOS 5.11 omnios-r151040-852962cae3 i386 >> [root@orca] # zfs create -V 2G rpool/zv0 >> [root@orca] # zfs create -V 2G rpool/zv1 >> [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1} >> [root@orca] # zpool status ztest >> pool: ztest >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> ztest ONLINE 0 0 0 >> mirror-0 ONLINE 0 0 0 >> /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0 >> /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0 >> >> errors: No known data errors >> >> I thought I had done this in the past. Am I doing something wrong? Am >> I >> misremembering and this never worked? >> >> Using files created with truncate(1) rather zvols seems to work fine >> so >> maybe that's what I did before. Not sure, it's been a long time since >> I >> wanted to do something like this. >> >> Thanks for any enlightenment. Disclaimer The information contained in this communication from the sender is confiden= tial. It is intended solely for use by the recipient and others authorized = to receive it. If you are not the recipient, you are hereby notified that a= ny disclosure, copying, distribution or taking action in relation of the co= ntents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been auto= matically archived by Mimecast, a leader in email security and cyber resili= ence. Mimecast integrates email defenses with brand protection, security aw= areness training, web security, compliance and other essential capabilities= . Mimecast helps protect large and small organizations from malicious activ= ity, human error and technology failure; and to lead the movement toward bu= ilding a more resilient world. To find out more, visit our website. --_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <= /head>

Hi!

 

I have never tried to use ZFS type ‘vol= ume’ as a zpool but you can share a

zpool between zfs type ‘filesystem̵= 7; and type ‘volume’.  Here I share two

type ‘volume’ stores as iscsi tar= gets and one type ‘filesystem’ as a

zpool. If you interested in my iscsi config /= etc/ctl.conf email me off list

to mikej@mikej.com.

 

ZFS raid-5400-1 is a simple 14 x raidz2 pool = in my home lab.

 

root@draid:/raid-5400-1 # zfs list -t volume<= o:p>

NAME 

       &nb= sp;            = USED  AVAIL  REFER  MOUNTPOINT

<SNIP>

raid-5400-1/esxi-store1  2.16T  3.5= 1T   443G  -

raid-5400-1/unitrends1   1.08T = ; 2.70T   171G  -

<SNIP>

 

root@draid:/raid-5400-1 # zfs list -t filesys= tem

NAME       = ;            &n= bsp;          USED  AVAIL=   REFER  MOUNTPOINT

<SNIP>

raid-5400-1     &nbs= p;            &= nbsp;   3.24T  1.79T   236K  /raid-5400-1

<SNIP>

 

Since your experimenting – I am too. (f= or the curios while slightly

off topic) I have been testing ZFS Draid R= 11; here is how that pool looks.

 

root@draid:/raid-5400-1 # zpool list -v tank<= o:p>

NAME       = ;          SIZE  ALLOC&nb= sp;  FREE  CKPOINT  EXPANDSZ   FRAG  &nb= sp; CAP  DEDUP    HEALTH  ALTROOT

tank       = ;         18.5T  8.02T  1= 0.4T        -    &nb= sp;    -     0%    43%&nb= sp; 1.00x    ONLINE  -

  draid2:2d:10c:0s-0  9.03T  4= .06T  4.97T        -  &nb= sp;      -     0%  44.9%&= nbsp;     -    ONLINE<= /p>

    gpt/da0p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d10p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    da39p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    da40p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    da41p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         -  =     -      -   =    -    ONLINE

    da43p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    da44p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    da42p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    da45p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    gpt/d19p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

  draid2:2d:10c:0s-1  9.03T  3= .96T  5.07T        -  &nb= sp;      -     0%  43.8%&= nbsp;     -    ONLINE<= /p>

    da46p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

    gpt/d11p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d12p1   &nbs= p;       -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d13p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d14p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d15p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d16p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d17p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/d18p1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    da18p1   &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -    ONLINE

special      &n= bsp;          -  &nb= sp;   -      -    &n= bsp;   -         - &= nbsp;    -      -   =    -         -=

  mirror-3     =       398G  2.86G   395G  = ;      -       =   -     0%  0.71%    &nbs= p; -    ONLINE

    gpt/special0  &n= bsp;     -      -  &= nbsp;   -        -  =        -      - = ;     -      -  &nbs= p; ONLINE

    gpt/special1  &n= bsp;     -      -  &= nbsp;   -        -   = ;      -      - = ;     -      -  &nbs= p; ONLINE

logs       = ;             -=       -      -  = ;      -       =   -      -      -&nb= sp;     -       &nbs= p; -

  mirror-2     =      15.5G   256K  15.5G  &nbs= p;     -        = ; -     0%  0.00%      -&= nbsp;   ONLINE

    gpt/slog0   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

    gpt/slog1   = ;        -     = -      -       = ; -         -   &nbs= p;  -      -      -&= nbsp;   ONLINE

 

 

CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245



From: owner-freebsd-fs@freebsd.org [= mailto:owner-freebsd-fs@freebsd.org] On Behalf Of John Doherty
Sent: Friday, March 25, 2022 9:50 AM
To: Rich <rincebrain@gmail.com>
Cc: freebsd-fs <freebsd-fs@freebsd.org>
Subject: Re: create zpool from zvols?

 

Thanks for the super-quick response. I guess I'll ju= st use plain files
then. I don't really want to use the zpools for anything, I just want an easy way to experiment with and demonstrate zpool create commands.

FWIW, the tunable does allow the "zpool create" command to work:<= br>
[root@ibex] # sysctl vfs.zfs.vol.recursive
vfs.zfs.vol.recursive: 1
[root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1}
[root@ibex] # zpool status ztest
pool: ztest
state: ONLINE
config:

NAME STATE READ WRITE CKSUM
ztest ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
zvol/zroot/zv0 ONLINE 0 0 0
zvol/zroot/zv1 ONLINE 0 0 0

errors: No known data errors

On Fri 2022-03-25 07:41 AM MDT -0600, <rincebrain@gmail.com> wrote:

> https://reviews.freebsd.org/D4998 added a knob to allow you to do this =
> even
> though it sometimes deadlocks, which is why it's off by default.
>
> It's a FreeBSD-only tunable.
>
> That tunable is still there in the post-OpenZFS FreeBSD, too, though <= br> > it's
> labeled "Allow zpools to use zvols as vdevs (DANGEROUS)", so= it seems
> likely that it still can cause undesirable outcomes.
>
> - Rich
>
>
>
> On Fri, Mar 25, 2022 at 9:34 AM John Doherty <bsdlists@jld3.net>
> wrote:
>
>> Hello, I am using ZFS on FreeBSD 13.0-RELEASE-p8. For experimentat= ion
>> and demonstration, I would like to create zpools using zvols as th= e
>> underlying block devices.
>>
>> For example, I have these:
>>
>> [root@ibex] # zfs list -r -t volume zroot | grep zv
>> zroot/zv0 8.25G 832G 56K -
>> zroot/zv1 8.25G 832G 56K -
>>
>> This seems as if it would do what I want:
>>
>> [root@ibex] # zpool create -n ztest mirror /dev/zvol/zroot/zv{0,1}=
>> would create 'ztest' with the following layout:
>>
>> ztest
>> mirror
>> zvol/zroot/zv0
>> zvol/zroot/zv1
>>
>> But when I try to actually do it, it doesn't work:
>>
>> [root@ibex] # zpool create ztest mirror /dev/zvol/zroot/zv{0,1} >> cannot create 'ztest': no such pool or dataset
>>
>> FWIW, doing something similar on OmniOS works fine:
>>
>> [root@orca] # uname -srvp
>> SunOS 5.11 omnios-r151040-852962cae3 i386
>> [root@orca] # zfs create -V 2G rpool/zv0
>> [root@orca] # zfs create -V 2G rpool/zv1
>> [root@orca] # zpool create ztest mirror /dev/zvol/dsk/rpool/zv{0,1= }
>> [root@orca] # zpool status ztest
>> pool: ztest
>> state: ONLINE
>> scan: none requested
>> config:
>>
>> NAME STATE READ WRITE CKSUM
>> ztest ONLINE 0 0 0
>> mirror-0 ONLINE 0 0 0
>> /dev/zvol/dsk/rpool/zv0 ONLINE 0 0 0
>> /dev/zvol/dsk/rpool/zv1 ONLINE 0 0 0
>>
>> errors: No known data errors
>>
>> I thought I had done this in the past. Am I doing something wrong?= Am
>> I
>> misremembering and this never worked?
>>
>> Using files created with truncate(1) rather zvols seems to work fi= ne
>> so
>> maybe that's what I did before. Not sure, it's been a long time si= nce
>> I
>> wanted to do something like this.
>>
>> Thanks for any enlightenment.



<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--_000_07cf88d380d94a2f8f97af23bb7d8965MAILHUBpailocal_-- From nobody Fri Mar 25 16:09:39 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0897C1A323B0 for ; Fri, 25 Mar 2022 16:09:58 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f46.google.com (mail-ot1-f46.google.com [209.85.210.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ6Vr6DgPz3HpL for ; Fri, 25 Mar 2022 16:09:56 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f46.google.com with SMTP id d15-20020a9d72cf000000b005cda54187c3so5819782otk.2 for ; Fri, 25 Mar 2022 09:09:56 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=uvZudZYbNb08bb4DFwWyyLGkNcD/1uF3lKlSiopgTu4=; b=Pycv26Hv7bdkBmYfyw4u5y+052V88y/Bwf/zAYk+2UxApWokhBkvl+yOv2cM4WNiUS fijzXZBGcygHk5E/RE2eb/wVgqb3Vtu/sIJFNP7ytyxrNtWoNxdOWI5AauFAYeedYf9d +kF0P87+kWoCIZyoPxX7qM1ksEAoBPowP/Ju8QGmrE0z+6+g3ASGZh1eazKbecX5LFL9 AQwmieQMKPvkySbkW6/L0kEZHfBYfWsH4P9A283hfTftlJz918QyZ2oJ3+uJxACaiXZZ Uj5dobhjNJvh7bbNqTMxqjemM8S51WxCFdWHTFk2UL0eE9qknPNwdexG1kkNS4MtkUir bTbg== X-Gm-Message-State: AOAM5330KkOzPyV4lPtbvE/1AOwuTOx8URaaoVIHve/SqS4FuSzK/XKQ aNxfjkclzHk2ZpgFkJWokmUc77yaLCLepblALgPgsatk X-Google-Smtp-Source: ABdhPJyDc1zao5wME6iXwfn1wcn5PWJSK86RvdnuPdU2jb/uTdDn9Xjgt5lK4R112HYfbc6nx5wmytvvZ+EDaTnAzRM= X-Received: by 2002:a9d:6a84:0:b0:5cd:ad64:a50 with SMTP id l4-20020a9d6a84000000b005cdad640a50mr4555135otq.114.1648224590162; Fri, 25 Mar 2022 09:09:50 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> In-Reply-To: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> From: Alan Somers Date: Fri, 25 Mar 2022 10:09:39 -0600 Message-ID: Subject: Re: mirror vdevs with different sizes To: John Doherty Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KQ6Vr6DgPz3HpL X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.46 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.83 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.46:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.84)[-0.840]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.46:from]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N There's nothing wrong with doing that. The performance won't be perfectly balanced, because the new disks will have a lower ratio of IOPS/TB. But that's fine. Go ahead. -Alan On Fri, Mar 25, 2022 at 9:17 AM John Doherty wrote: > > Hello, I have an existing zpool with 12 mirrors of 8 TB disks. It is > currently about 60% full and we expect to fill the remaining space > fairly quickly. > > I would like to expand it, preferably using 12 mirrors of 16 TB disks. > Any reason I shouldn't do this? > > Using plain files created with truncate(1) like these: > > [root@ibex] # ls -lh /vd/vd* > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd0 > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd1 > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd2 > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd3 > > I can first do this: > > [root@ibex] # zpool create ztest mirror /vd/vd{0,1} > [root@ibex] # zpool list ztest > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > HEALTH ALTROOT > ztest 7.50G 384K 7.50G - - 0% 0% 1.00x > ONLINE - > > And then do this: > > [root@ibex] # zpool add ztest mirror /vd/vd{2,3} > [root@ibex] # zpool list ztest > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > HEALTH ALTROOT > ztest 23G 528K 23.0G - - 0% 0% 1.00x > ONLINE - > > And FWIW, everything works as expected. But I've never constructed a > real zpool with vdevs of different sizes and I don't know whether there > might be any expected problems. > > I could just create a new zpool with new disks, but most of the existing > data and most of the expected new data is in just two file systems and > for simplicity's sake from the perspective of those users, it would be > nicer to just make the existing file systems larger than to give them > access to a new, different one. > > Any comments, suggestions, warnings, etc. much appreciated. Thanks. > From nobody Fri Mar 25 16:32:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 65B531A376AE for ; Fri, 25 Mar 2022 16:32:34 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ70x1QX8z3LZW; Fri, 25 Mar 2022 16:32:32 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 170BA415F2; Fri, 25 Mar 2022 10:32:32 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id LJSOWLQ9dcLq; Fri, 25 Mar 2022 10:32:31 -0600 (MDT) Received: from [172.21.35.238] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 3EDAD40124; Fri, 25 Mar 2022 10:32:31 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 3EDAD40124 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 3EDAD40124 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1648225951; bh=jeee8MPZCyeTRT0jMBSdTXFdHPlHCWYa80FQLsDlI08=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=RSDHNZm0ImBA9Ghios5UkpyH9fmy0VI0XS7ZAhJxSJF6i/RaylWd+P70uNMajIiPh ri5kiszptOJ3nDRFBItduzynVPC8nHmNo0xwu8rzLTCnOygaLzyriDuIhe8IjG6B2R y+kKIIeK/hLuwGjhcf3Q/F84lX8ydH6n7o8prWqY= From: "John Doherty" To: "Alan Somers" Cc: freebsd-fs Subject: Re: mirror vdevs with different sizes Date: Fri, 25 Mar 2022 10:32:09 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <03992FEF-5749-4798-BFF3-71593605796A@jld3.net> In-Reply-To: References: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain X-Rspamd-Queue-Id: 4KQ70x1QX8z3LZW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=RSDHNZm0; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-3.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-0.70)[-0.699]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N Thanks very much for your response. On Fri 2022-03-25 10:09 AM MDT -0600, wrote: > There's nothing wrong with doing that. The performance won't be > perfectly balanced, because the new disks will have a lower ratio of > IOPS/TB. But that's fine. Go ahead. > -Alan > > On Fri, Mar 25, 2022 at 9:17 AM John Doherty wrote: > >> >> Hello, I have an existing zpool with 12 mirrors of 8 TB disks. It is >> currently about 60% full and we expect to fill the remaining space >> fairly quickly. >> >> I would like to expand it, preferably using 12 mirrors of 16 TB disks. >> Any reason I shouldn't do this? From nobody Fri Mar 25 17:05:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7826B1A29E44 for ; Fri, 25 Mar 2022 17:05:18 +0000 (UTC) (envelope-from martin@lispworks.com) Received: from mail.lispworks.com (mail.lispworks.com [46.17.166.21]) by mx1.freebsd.org (Postfix) with ESMTP id 4KQ7kh6JVTz3k4F; Fri, 25 Mar 2022 17:05:16 +0000 (UTC) (envelope-from martin@lispworks.com) Received: from higson.cam.lispworks.com (higson.cam.lispworks.com [192.168.1.7]) by lwfs1-cam.cam.lispworks.com (8.16.1/8.16.1) with ESMTP id 22PH56Q6001618; Fri, 25 Mar 2022 17:05:06 GMT (envelope-from martin@lispworks.com) Received: from higson.cam.lispworks.com (localhost.localdomain [127.0.0.1]) by higson.cam.lispworks.com (8.14.4) id 22PH56KC029815; Fri, 25 Mar 2022 17:05:06 GMT Received: (from martin@localhost) by higson.cam.lispworks.com (8.14.4/8.14.4/Submit) id 22PH56du029811; Fri, 25 Mar 2022 17:05:06 GMT Date: Fri, 25 Mar 2022 17:05:06 GMT Message-Id: <202203251705.22PH56du029811@higson.cam.lispworks.com> From: Martin Simmons To: Alan Somers CC: bsdlists@jld3.net, freebsd-fs@freebsd.org In-reply-to: (message from Alan Somers on Fri, 25 Mar 2022 10:09:39 -0600) Subject: Re: mirror vdevs with different sizes References: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> X-Rspamd-Queue-Id: 4KQ7kh6JVTz3k4F X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of martin@lispworks.com has no SPF policy when checking 46.17.166.21) smtp.mailfrom=martin@lispworks.com X-Spamd-Result: default: False [-0.03 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FREEFALL_USER(0.00)[martin]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[lispworks.com]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.96)[0.959]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:51055, ipnet:46.17.160.0/21, country:GB] X-ThisMailContainsUnwantedMimeParts: N List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Is "the new disks will have a lower ratio of IOPS/TB" another way of saying "more of the data will be stored on the new disks, so they will be accessed more frequently"? Or is this something about larger vdevs in general? __Martin >>>>> On Fri, 25 Mar 2022 10:09:39 -0600, Alan Somers said: > > There's nothing wrong with doing that. The performance won't be > perfectly balanced, because the new disks will have a lower ratio of > IOPS/TB. But that's fine. Go ahead. > -Alan > > On Fri, Mar 25, 2022 at 9:17 AM John Doherty wrote: > > > > Hello, I have an existing zpool with 12 mirrors of 8 TB disks. It is > > currently about 60% full and we expect to fill the remaining space > > fairly quickly. > > > > I would like to expand it, preferably using 12 mirrors of 16 TB disks. > > Any reason I shouldn't do this? > > > > Using plain files created with truncate(1) like these: > > > > [root@ibex] # ls -lh /vd/vd* > > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd0 > > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd1 > > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd2 > > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd3 > > > > I can first do this: > > > > [root@ibex] # zpool create ztest mirror /vd/vd{0,1} > > [root@ibex] # zpool list ztest > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > HEALTH ALTROOT > > ztest 7.50G 384K 7.50G - - 0% 0% 1.00x > > ONLINE - > > > > And then do this: > > > > [root@ibex] # zpool add ztest mirror /vd/vd{2,3} > > [root@ibex] # zpool list ztest > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > HEALTH ALTROOT > > ztest 23G 528K 23.0G - - 0% 0% 1.00x > > ONLINE - > > > > And FWIW, everything works as expected. But I've never constructed a > > real zpool with vdevs of different sizes and I don't know whether there > > might be any expected problems. > > > > I could just create a new zpool with new disks, but most of the existing > > data and most of the expected new data is in just two file systems and > > for simplicity's sake from the perspective of those users, it would be > > nicer to just make the existing file systems larger than to give them > > access to a new, different one. > > > > Any comments, suggestions, warnings, etc. much appreciated. Thanks. > > > From nobody Fri Mar 25 17:19:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4E2A81A2FB92 for ; Fri, 25 Mar 2022 17:19:36 +0000 (UTC) (envelope-from alan@peak.org) Received: from zmail.rdrop.com (zmail.rdrop.com [199.26.172.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ83C2tQHz3ns4 for ; Fri, 25 Mar 2022 17:19:35 +0000 (UTC) (envelope-from alan@peak.org) Received: from localhost (localhost [IPv6:::1]) by zmail.rdrop.com (Postfix) with ESMTP id EA1A398040 for ; Fri, 25 Mar 2022 10:19:18 -0700 (PDT) Received: from zmail.rdrop.com ([IPv6:::1]) by localhost (zmail.rdrop.com [IPv6:::1]) (amavisd-new, port 10032) with ESMTP id RHwTkRwuQtnQ for ; Fri, 25 Mar 2022 10:19:18 -0700 (PDT) Received: from localhost (localhost [IPv6:::1]) by zmail.rdrop.com (Postfix) with ESMTP id 5675498042 for ; Fri, 25 Mar 2022 10:19:18 -0700 (PDT) X-Virus-Scanned: amavisd-new at zmail.rdrop.com Received: from zmail.rdrop.com ([IPv6:::1]) by localhost (zmail.rdrop.com [IPv6:::1]) (amavisd-new, port 10026) with ESMTP id WveMR90ktATU for ; Fri, 25 Mar 2022 10:19:18 -0700 (PDT) Received: from [IPV6:2607:f678:1::150] (valde.intranet.peak.org [IPv6:2607:f678:1::150]) by zmail.rdrop.com (Postfix) with ESMTPSA id D1F2498040 for ; Fri, 25 Mar 2022 10:19:17 -0700 (PDT) Message-ID: <1c0fc320-d5ae-06f7-73c1-36f54c8aeabf@peak.org> Date: Fri, 25 Mar 2022 10:19:08 -0700 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 From: Alan Batie Subject: Re: mirror vdevs with different sizes To: freebsd-fs@freebsd.org References: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> <202203251705.22PH56du029811@higson.cam.lispworks.com> Content-Language: en-US In-Reply-To: <202203251705.22PH56du029811@higson.cam.lispworks.com> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="------------ms050104080603090904010909" X-Rspamd-Queue-Id: 4KQ83C2tQHz3ns4 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=peak.org (policy=none); spf=fail (mx1.freebsd.org: domain of alan@peak.org does not designate 199.26.172.25 as permitted sender) smtp.mailfrom=alan@peak.org X-Spamd-Result: default: False [-4.09 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_FAIL(1.00)[-all]; RCVD_COUNT_FIVE(0.00)[6]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:13868, ipnet:199.26.172.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[peak.org : No valid SPF, No valid DKIM,none] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms050104080603090904010909 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 3/25/22 10:05 AM, Martin Simmons wrote: > Is "the new disks will have a lower ratio of IOPS/TB" another way of saying > "more of the data will be stored on the new disks, so they will be accessed > more frequently"? Or is this something about larger vdevs in general? A disk can handle a certain number of IOPS, regardless of capacity (typically around 200 for spinning disks). Bigger disks will inherently have a lower ratio of IOPS/TB meaning you're not going to get the same level of overall performance with them. For example, if you have 2 1T drives, you have 400 IOPS available to access all of those 2 TB, whereas if you have 1 2T drive, you only have 200 IOPS available. --------------ms050104080603090904010909 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC DUkwggXUMIIDvKADAgECAhAMMw88bglGagL44OzsSc8lMA0GCSqGSIb3DQEBCwUAMIGBMQsw CQYDVQQGEwJJVDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcGA1UEBwwQUG9udGUgU2FuIFBpZXRy bzEXMBUGA1UECgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNVBAMMI0FjdGFsaXMgQ2xpZW50IEF1 dGhlbnRpY2F0aW9uIENBIEczMB4XDTIxMDkwNjE3NTI0M1oXDTIyMDkwNjE3NTI0M1owGDEW MBQGA1UEAwwNYWxhbkBwZWFrLm9yZzCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEB ALV/uIOK+Qf8ASno9qFxpCgp+6847hJbD4SSqk0S5z5xfQ+5KJnej80R0Ke6vhtJcsUfc4h1 yoVnT4zfM/Pipxjr93gUbB9qW/nM85Y3RmImG9/nFSoPVH4qLrjJo1OcEZsiQI2b/F5evPSO oX9z4rwyYcFRwNJtA4Q7NrvmAgZUMUqMtlqBEHhgck05wShQ+vN8lJoNLiIpVe3fVpn29z1c xLy3xP87qOeiWJgurFsa6rs5vVSZz96R7hrjCx9wGL9uGPUqOzJiSJRffrLjdVPoAKjwp49r O+91p05Q4juVzGMrdpAe4ccc4QDdQO9uvgUe8rr0NdK4rbqZlZtCuh8CAwEAAaOCAa4wggGq MAwGA1UdEwEB/wQCMAAwHwYDVR0jBBgwFoAUvpepqoS/gL8QU30JMvnhLjIbz3cwfgYIKwYB BQUHAQEEcjBwMDsGCCsGAQUFBzAChi9odHRwOi8vY2FjZXJ0LmFjdGFsaXMuaXQvY2VydHMv YWN0YWxpcy1hdXRjbGlnMzAxBggrBgEFBQcwAYYlaHR0cDovL29jc3AwOS5hY3RhbGlzLml0 L1ZBL0FVVEhDTC1HMzAYBgNVHREEETAPgQ1hbGFuQHBlYWsub3JnMEcGA1UdIARAMD4wPAYG K4EfARgBMDIwMAYIKwYBBQUHAgEWJGh0dHBzOi8vd3d3LmFjdGFsaXMuaXQvYXJlYS1kb3du bG9hZDAdBgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwSAYDVR0fBEEwPzA9oDugOYY3 aHR0cDovL2NybDA5LmFjdGFsaXMuaXQvUmVwb3NpdG9yeS9BVVRIQ0wtRzMvZ2V0TGFzdENS TDAdBgNVHQ4EFgQUcuISJ82upP8iJblX7gwv+PLnWpswDgYDVR0PAQH/BAQDAgWgMA0GCSqG SIb3DQEBCwUAA4ICAQC+mMGSRBkavTrzfhnDT51ZVh6lJGCvI9SFhgeFtcfSNY4KCSQ54yZQ x82kwgQSFTUI3VRme2r3nINZcoaoAJ0p/Kfk2N5Pt4dgGTQmSyjS9BTDleMm04poagasF0YI eLf4xGW+e8OcSrBGwVx8XVZLDR7D08YeDT95ARIGEyBBuld1oSkKXeFaTAyuYOYeaYY6F14p TUNQvrTyZlUcgv7i1wsKKuXmP8Hb84ZkDmAiP/6urJdQAb0GEmbu9QjiL+h3BuTRiYTUmn7f OzeCKyLjf6UT8hC1G7rdOhEdybOOOmdD7kLFVkTcjq83SYhHc4Avm/kcEoVSCkOXu61SHU53 gIP751i8I+P88/GWQLY++VhYzZNkFQDxSYRMndkKdLfhr3b9DVCHflp2ohA0ZC0vT2aubJFW q3NsJYZ1Dm7tFCtV4CAseQl5Ci/421RLeiTTAI8Hx0H6FJZZxBRFfgZeisyHBfeILjWZcaUd DTTF5NZmjD0WmjZZSKZU+Xi34kvY5UY6GjurQ1exO9/xRM/dlPru1PxJZGrtpQREZn9jKEs+ BBMg/dmGkDNaGVZ/MZbJmBF0yYLz3eavfHFMj3c6H+bEljqBGxaDTR7rRaVdBu6r/vKbL+do hHXh7P5dAxY1JSrxFm2cdV0VlG8TjMsWZeW8mBs3gcIMI2nEzdqwezCCB20wggVVoAMCAQIC EBcQPt49ihy1ygZRk+fKQ2swDQYJKoZIhvcNAQELBQAwazELMAkGA1UEBhMCSVQxDjAMBgNV BAcMBU1pbGFuMSMwIQYDVQQKDBpBY3RhbGlzIFMucC5BLi8wMzM1ODUyMDk2NzEnMCUGA1UE AwweQWN0YWxpcyBBdXRoZW50aWNhdGlvbiBSb290IENBMB4XDTIwMDcwNjA4NDU0N1oXDTMw MDkyMjExMjIwMlowgYExCzAJBgNVBAYTAklUMRAwDgYDVQQIDAdCZXJnYW1vMRkwFwYDVQQH DBBQb250ZSBTYW4gUGlldHJvMRcwFQYDVQQKDA5BY3RhbGlzIFMucC5BLjEsMCoGA1UEAwwj QWN0YWxpcyBDbGllbnQgQXV0aGVudGljYXRpb24gQ0EgRzMwggIiMA0GCSqGSIb3DQEBAQUA A4ICDwAwggIKAoICAQDt5oeWocGktu3CQlX3Pw8PImBfE+CmQ4iGSZF5HBsvGlAP3EYB7va6 OobMUWHvxA+ACHEpWq0YfNh6rRUlULOGcIpEFtVf4nAiEvdQtiFQBmtWJSn3naoMHqpMvmwZ 4lL0Xr1U9JHmTqkU3DuYcNNO3S+hYWDZpWQbeSGibNVeiJ4kY6JDh0fvqloK1BsuS3n2OgAr PYGfAYtDjCvT2d+6Ym3kArHZjEcrZeBI+yVVnjPwbTSCKax8DtS2NP/CJ6RjpnRvuSwusRy8 4OdwdB71VKs1EDXj1ITcCWRZpkz+OhV6L8Zh+P0rmOSJF6KdHiaozfncURx4s54GFJNRGkx1 DnCxcuL0NJMYG42/hrDYOjNv+oGWSEZO/CT3aaLSMB5wTbZKfcD1R+tTanXD+5Gz5Mi15DTE 7QH8naZjZxqqhyxL1KyuIgaVDxvQtPSjo5vTsoa09rn+Ui8ybHnvYO/a/68OIQIHLGbUd2CO nwm0TiZ3Jg/oYGxwnJPvU1nDXNcecWTIJvFF5qD2ppJH3HgJVVePUEOY1E4Kp3k0B8hdRdhM V5n+O6RCKCTFcZaESF8sELgdrqnCLPP1+rX7DA8pxZoX0/9Jk64EOsbfQyLIJlrrob2YS0Xl ku6HisZ8qrHLhnkzF5y7O34xmatIp8oZ5c54QP+K5flnTYzWjuIxLwIDAQABo4IB9DCCAfAw DwYDVR0TAQH/BAUwAwEB/zAfBgNVHSMEGDAWgBRS2Ig6yJ94Zu2J83s4cJTJAgI20DBBBggr BgEFBQcBAQQ1MDMwMQYIKwYBBQUHMAGGJWh0dHA6Ly9vY3NwMDUuYWN0YWxpcy5pdC9WQS9B VVRILVJPT1QwRQYDVR0gBD4wPDA6BgRVHSAAMDIwMAYIKwYBBQUHAgEWJGh0dHBzOi8vd3d3 LmFjdGFsaXMuaXQvYXJlYS1kb3dubG9hZDAdBgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUH AwQwgeMGA1UdHwSB2zCB2DCBlqCBk6CBkIaBjWxkYXA6Ly9sZGFwMDUuYWN0YWxpcy5pdC9j biUzZEFjdGFsaXMlMjBBdXRoZW50aWNhdGlvbiUyMFJvb3QlMjBDQSxvJTNkQWN0YWxpcyUy MFMucC5BLiUyZjAzMzU4NTIwOTY3LGMlM2RJVD9jZXJ0aWZpY2F0ZVJldm9jYXRpb25MaXN0 O2JpbmFyeTA9oDugOYY3aHR0cDovL2NybDA1LmFjdGFsaXMuaXQvUmVwb3NpdG9yeS9BVVRI LVJPT1QvZ2V0TGFzdENSTDAdBgNVHQ4EFgQUvpepqoS/gL8QU30JMvnhLjIbz3cwDgYDVR0P AQH/BAQDAgEGMA0GCSqGSIb3DQEBCwUAA4ICAQAmm+cbWQ10sxID6edV94SAhc1CwzthHFfH puYS30gisWUfWpgp43Dg1XzG2in3VGV7XrzCCGZh4JM/XQWp+4oxmyV42Qjz9vc8GRksgo6X 2nYObPYZzQjda9wxsCB38i4G3H33w8lf9sFvl0xm4ZXZ2s2bF/PdqvrK0ZgvF51+MoIPnli/ wJBw3p72xbk5Sb1MneSO3tZ293WFzDmz7tuGU0PfytYUkG7O6annGqbU1I6CA6QVKUqeFLPo dSODAFqJ3pimKD0vX9MuuSa0QinH7CkiPtZMD0mpwwzIsnSs3qOOl60tIZQOTc0I6lCe1LLh rz7Q75J6nNL9N5zVwZ1I3o2Lb8Dt7BA13VFuZvZIzapUGV83R7pmSVaj1Bik1nJ/R393e6mw ppsT140KDVLh4Oenywmp2VpBDuEj9RgICAO0sibv8n379LbO7ARa0kw9y9pggFzN2PAX25b7 w0n9m78kpv3z3vW65rs6wl7E8VEHNfv8+cnb81dxN3C51KElz+l31zchFTurD5HFEpyEhzO/ fMS5AkweRJIzwozxNs7OL/S/SVTpJLJL1ukZ1lnHHX0d3xCzRy/5HqfK3uiG22LPB5+RjNDo bPAjAz2BKMfkF/+v0pzn8mqqkopQaJzEAbLbMpgQYHRCjvrUxxwjJyUFb2Z+40UNtMF4MTK7 zTGCA/MwggPvAgEBMIGWMIGBMQswCQYDVQQGEwJJVDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcG A1UEBwwQUG9udGUgU2FuIFBpZXRybzEXMBUGA1UECgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNV BAMMI0FjdGFsaXMgQ2xpZW50IEF1dGhlbnRpY2F0aW9uIENBIEczAhAMMw88bglGagL44Ozs Sc8lMA0GCWCGSAFlAwQCAQUAoIICLTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yMjAzMjUxNzE5MDlaMC8GCSqGSIb3DQEJBDEiBCDxhX4vSKYn71lk57Uj KlOwTzt5KTOBVzrN7In/QCZ8OjBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFlAwQBKjALBglg hkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMCAgFAMAcG BSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGnBgkrBgEEAYI3EAQxgZkwgZYwgYExCzAJBgNVBAYT AklUMRAwDgYDVQQIDAdCZXJnYW1vMRkwFwYDVQQHDBBQb250ZSBTYW4gUGlldHJvMRcwFQYD VQQKDA5BY3RhbGlzIFMucC5BLjEsMCoGA1UEAwwjQWN0YWxpcyBDbGllbnQgQXV0aGVudGlj YXRpb24gQ0EgRzMCEAwzDzxuCUZqAvjg7OxJzyUwgakGCyqGSIb3DQEJEAILMYGZoIGWMIGB MQswCQYDVQQGEwJJVDEQMA4GA1UECAwHQmVyZ2FtbzEZMBcGA1UEBwwQUG9udGUgU2FuIFBp ZXRybzEXMBUGA1UECgwOQWN0YWxpcyBTLnAuQS4xLDAqBgNVBAMMI0FjdGFsaXMgQ2xpZW50 IEF1dGhlbnRpY2F0aW9uIENBIEczAhAMMw88bglGagL44OzsSc8lMA0GCSqGSIb3DQEBAQUA BIIBADThmVhySTafsfdIQ6Jnz96BaGjJSn98buqi1ZRdx2Pw6S1YVBnhbkFBVHKiDfEEHVkp gz3B4BnILAl9VseocdtEiLaK4f5ZUq2JyX+c3Cjj9nhsEk7p8MefwbJOE6YHmUbkA6OXhKsF LXQNzX2sqEOkgTq9VMsX90KNn9yjEDkRwpsQxxCLf9nVVuFsAXhuwd0DUPaJ23KTjXdS7V5Q o7+/R5ZQ6CuU5ZgXevGF/Aic0WP6no91IM780bQ3QWw0NfKTc2A6VybgaYRN0nZO0cRqbTgo pJ2uEFuD4AJqB8bvWEUfB4w8lCmVuftIyI3nGOI+e8W+TVuMDnk7jKu1XSUAAAAAAAA= --------------ms050104080603090904010909-- From nobody Fri Mar 25 17:34:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 88DD41A335B9 for ; Fri, 25 Mar 2022 17:34:28 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oo1-f45.google.com (mail-oo1-f45.google.com [209.85.161.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQ8NM38fZz3rq2 for ; Fri, 25 Mar 2022 17:34:27 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oo1-f45.google.com with SMTP id h3-20020a4ae8c3000000b00324b9ae6ff2so1319737ooe.10 for ; Fri, 25 Mar 2022 10:34:27 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=tlptXK/h7xdgJUpNMzOtQNRn0PhOEbxr0/bTPd9qaQw=; b=wwPZvfyu/GpBBTgzLx/mdsjzLsYS9tqbu3cCJH10lXDg8BMgud6cdNZ1EkCK4rkiSK iYh/fltxh4dMA3yqoJ+zoofSV7emLptZEjpV1apYfVGhEq0dK8c52ewRl5IZR40wP/UA OVYmPSv4fqyNOLOKCbOrkNZJwxlG+X2t1bSiPIoO9Q46cPSqX2hZ+j1x22TG2sVyMqMj oEQvwWVlu6OQw1BivlOdcYYnRe+RS+dOkvBJ5yBWs+BESppfsuf3d7VKGebp/Xfq0SdM SE1c7mvnD73XRtpky+gQmtkIMzcRTZIDeWiJ9S3njfnLQ/Rr5ZIB+6kIMbxLkxaVgvA+ kloA== X-Gm-Message-State: AOAM530vfGDsxzs2nf9xtNkFptfmsIJNhNRdm2rJv4/TcmULseX97wb/ 7ZHibtnmiKxUSpYL02/53wSQZgxO4xspGEBfIcIkTrtB X-Google-Smtp-Source: ABdhPJzI//URx4Q3apNGU3cAPSdOZaVmZ5HVzAxJPn3obcuRvwdjK3ErXtVUFYskl357sNMikW9C7qORh2IsfTiW8xs= X-Received: by 2002:a4a:1106:0:b0:324:acea:8de with SMTP id 6-20020a4a1106000000b00324acea08demr4261157ooc.41.1648229660605; Fri, 25 Mar 2022 10:34:20 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <95932839-F6F8-4DCB-AA7F-46040CFA1DE1@jld3.net> <202203251705.22PH56du029811@higson.cam.lispworks.com> In-Reply-To: <202203251705.22PH56du029811@higson.cam.lispworks.com> From: Alan Somers Date: Fri, 25 Mar 2022 11:34:09 -0600 Message-ID: Subject: Re: mirror vdevs with different sizes To: Martin Simmons Cc: John Doherty , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KQ8NM38fZz3rq2 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.161.45 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-1.13 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RWL_MAILSPIKE_GOOD(0.00)[209.85.161.45:from]; NEURAL_SPAM_SHORT(0.85)[0.848]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.161.45:from]; NEURAL_HAM_MEDIUM(-0.98)[-0.978]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Yes, exactly. There's nothing mysterious about large vdevs in ZFS, it's just that a greater fraction of the OP's pool's data will be stored on the new disks, but their performance won't likely be much better than the old disks. -Alan On Fri, Mar 25, 2022 at 11:05 AM Martin Simmons wrote: > > Is "the new disks will have a lower ratio of IOPS/TB" another way of saying > "more of the data will be stored on the new disks, so they will be accessed > more frequently"? Or is this something about larger vdevs in general? > > __Martin > > > >>>>> On Fri, 25 Mar 2022 10:09:39 -0600, Alan Somers said: > > > > There's nothing wrong with doing that. The performance won't be > > perfectly balanced, because the new disks will have a lower ratio of > > IOPS/TB. But that's fine. Go ahead. > > -Alan > > > > On Fri, Mar 25, 2022 at 9:17 AM John Doherty wrote: > > > > > > Hello, I have an existing zpool with 12 mirrors of 8 TB disks. It is > > > currently about 60% full and we expect to fill the remaining space > > > fairly quickly. > > > > > > I would like to expand it, preferably using 12 mirrors of 16 TB disks. > > > Any reason I shouldn't do this? > > > > > > Using plain files created with truncate(1) like these: > > > > > > [root@ibex] # ls -lh /vd/vd* > > > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd0 > > > -rw-r--r-- 1 root wheel 8.0G Mar 25 08:49 /vd/vd1 > > > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd2 > > > -rw-r--r-- 1 root wheel 16G Mar 25 08:49 /vd/vd3 > > > > > > I can first do this: > > > > > > [root@ibex] # zpool create ztest mirror /vd/vd{0,1} > > > [root@ibex] # zpool list ztest > > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > > HEALTH ALTROOT > > > ztest 7.50G 384K 7.50G - - 0% 0% 1.00x > > > ONLINE - > > > > > > And then do this: > > > > > > [root@ibex] # zpool add ztest mirror /vd/vd{2,3} > > > [root@ibex] # zpool list ztest > > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > > HEALTH ALTROOT > > > ztest 23G 528K 23.0G - - 0% 0% 1.00x > > > ONLINE - > > > > > > And FWIW, everything works as expected. But I've never constructed a > > > real zpool with vdevs of different sizes and I don't know whether there > > > might be any expected problems. > > > > > > I could just create a new zpool with new disks, but most of the existing > > > data and most of the expected new data is in just two file systems and > > > for simplicity's sake from the perspective of those users, it would be > > > nicer to just make the existing file systems larger than to give them > > > access to a new, different one. > > > > > > Any comments, suggestions, warnings, etc. much appreciated. Thanks. > > > > > From nobody Sun Mar 27 21:00:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A03C71A3D428 for ; Sun, 27 Mar 2022 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KRSsX5Mtdz56G2 for ; Sun, 27 Mar 2022 21:00:48 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C38421CC08 for ; Sun, 27 Mar 2022 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22RL0lOa070205 for ; Sun, 27 Mar 2022 21:00:47 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22RL0lYp070204 for fs@FreeBSD.org; Sun, 27 Mar 2022 21:00:47 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202203272100.22RL0lYp070204@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 27 Mar 2022 21:00:47 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16484148475.3a789.66697" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648414849; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=BOyabq1ts3iXhYMsaVyyBF1rKNEFNFboI0azBn7P1fI=; b=Wm/SN8Hrc3UTHqwpsDQeL3NkaZ2vhLvLcvLdMKRCCwSJ6tU5LewxS996o9MoYZKlDaYeyX XP4YySSk7AMRwsas5aQi/5vgbq8ogsOL5d8/iLpxQ3g25h/3od09IJF3lS4cbw5W/RgCm4 nlsFWdrCwF7yI6tr42tfaaQrpWFw5UpxN/us0oQOmPc5mBL/536ban6ng7N7qGQcWt1rlk a8BwTzBmL1WxNvIJUZK8jEyYnxqjc1kUfDoGNcAwolzDL6qR1SotBIkDbjYsMGevN9Mzl+ tP/cCMu6TRYztGpyToq15q5dnIYFlrlx3trnGtR+DpNA26T7cItq9HfMXJF1qA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648414849; a=rsa-sha256; cv=none; b=GLR5q0sfJm3I7ukEtmNqB4EibyPU0ycseNyab/r3i7zJ4MB3uOlYeFk1WYRM9REnjYxjSr x9h6oE95Da9gPkXnbuKOpYNU2+IizU7dP2jQLDe5m+LnXn83B1xx8XgG9dDIcwAbZwqlaY rDLJym0MoT0h8Jh0XAD/bFIeotvk/6/o/5BnxeRGYdGrsatHaEi2LmZ7eOEy/ZXKU947Jv /x8n3FjuEKrZQeooQ2V8ltJo8qES/zDzgNr1rIkLzUKBbOEat1AaGXq0pIR/lVSs1pXfKW ALphkaMTAf4Chtdrbxa+gl7Tj651X8rwiKCEegIkXYvwqoic7PITnZ+OG+594g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16484148475.3a789.66697 Date: Sun, 27 Mar 2022 21:00:47 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16484148475.3a789.66697 Date: Sun, 27 Mar 2022 21:00:47 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16484148475.3a789.66697-- From nobody Tue Mar 29 04:24:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B15A51A4280E for ; Tue, 29 Mar 2022 04:24:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KSGg42xdYz3vx6 for ; Tue, 29 Mar 2022 04:24:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4233A17E13 for ; Tue, 29 Mar 2022 04:24:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22T4OWKB009082 for ; Tue, 29 Mar 2022 04:24:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22T4OW9s009081 for fs@FreeBSD.org; Tue, 29 Mar 2022 04:24:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251720] zfs receive does not accept data from old (FreeBSD 8) system. Date: Tue, 29 Mar 2022 04:24:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: darius@dons.net.au X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648527872; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ara6cbM+8eV8jjpDN5g2penV0dEDm+pJy1fmtZT+uBA=; b=c+b7LinA2on0sIgVFHsPNQc6ycCEVGBip8kYaEpd3qUm5yjR+EdJJR0zleHO5YEEuY8CB/ mhGcMzFPpsWR40NEaT8x81p7Qhf0AMOSwg43UDzSve4nhuH0aCUFHYpJqPf+FNIL8noizM T2h9X1ODzJNkQIdKz52nFdSzhfWKFsNIb2yBoifRHUHf6zEMm/gz1WbR5Tyk9FdSMshv3G gSQaNpY9/RG89LGNTstxplF6qw7r8KjRi7QjO9gd2VdtrpMtYc83c9dh57Ow9ij7NsZfJU uNy6rTm17gF4wKuNneQMNj5+rSpamPKwv2cRQQIoz/o5go8InFamTVQuz5OqZA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648527872; a=rsa-sha256; cv=none; b=FsA1mRqupkNp+JQEQ4pARYOsg+L+hSN35dRm+GqJOdgp8/BjqweZOOK1BquHOPv5KsAkSM KXDYsHsWUhhQB+uXXrKBkdi1ShfHNwo+Fp9pCjMDsHHF4rYz/AbpRPWk6mMqw3DsCgG21+ uM0uQn69QrNmPYuU7EYHCmGVvIBDXYsOSsOMdjA0Dpb2ZXPQkczDChgRUdYvmtzAhfyPU6 w9D1HC0JcyLLxLxuv213u1ooYAYoWzHnGJ+IHJGCz7OhWraVilzLtf4OmZA/9TNJAecTPp k/h0Pm720P4I2Rzg+/hbZ+rbctoY1DzLCn4PemAW5WU6KABIwtp4CavUn2v1NQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251720 --- Comment #1 from Daniel O'Connor --- I tested this again on FreeBSD 14.0-CURRENT main-3468cd95c and it works so I guess it was fixed by an OpenZFS import. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Mar 29 04:24:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BEAED1A42F3D for ; Tue, 29 Mar 2022 04:24:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KSGgC3hMxz3wB3 for ; Tue, 29 Mar 2022 04:24:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5FF8C1727A for ; Tue, 29 Mar 2022 04:24:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22T4OdPp009123 for ; Tue, 29 Mar 2022 04:24:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22T4Ods2009122 for fs@FreeBSD.org; Tue, 29 Mar 2022 04:24:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251720] zfs receive does not accept data from old (FreeBSD 8) system. Date: Tue, 29 Mar 2022 04:24:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: darius@dons.net.au X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648527879; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=J5rZYVprrh3GGh0DPq60MqTak4WpRJAkhtqzS94GazI=; b=JsCrK0Y0Yym5wfATEbvevIfhgp8W7lSuEYqfuaKZ9rWh9VPKCDCs4/364uxBHo/8ojbHsn 1AnHupJG2hAAzWInyjIEaoyNxM25AudKGYma2YfNMQbkpr108rwkP3Oo+LarVUHjGZLoDq JT+0ONc1Vdf0VzBKMmOLZw6uQv9chGHovv5Qw7MYD/iUhJ4IKeqwbmeSF0BnVsQiSD3Hy2 JV7lBPhsMsVlgST8fz5hmDLwC0vjTmjwov09HQhHJm20QJv+r5BmBEEOJKVwgmc6Tn1d0N FM81QLMZBlgEc13tgrKWC1g++LVmNqZP0nGYlKlOg+AXLgNppNW3lNkgXZOEWQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648527879; a=rsa-sha256; cv=none; b=T5tgNWRPuRsbEPPBYSm0yd3wPvb7yC0gTcrk1mfMW/TyOPs0o8n1J9NDM01I46C5yYNqP3 +KCKpXe/MYrzG1fSKxupFhDSWCH79WSfR15vuWBbUck98gPDlMVzqT0vxuSOKyHlAT987h mpZkOe1+NhhWRX5XHvnl81c4DaANegFYncjujemXigKXtxiKwFRFlToq2fzM1FP+ib/Cv+ joAWqVkTSJesapqG9Kar7s7Dqi06cSeH6z/c5YtFVm1i1h18JWP/PkgkV6WjELTZctMNqI gOIrqbyODU5P7gTFsthlFjhBqBh1ohgVY5dVvmq8jQAskjq/Z+umfcVbblQWGA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251720 Daniel O'Connor changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Apr 3 15:02:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DA1721A5A99B for ; Sun, 3 Apr 2022 15:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KWcbQ4jMZz3vyp for ; Sun, 3 Apr 2022 15:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 80E841F87E for ; Sun, 3 Apr 2022 15:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 233F2w9f006750 for ; Sun, 3 Apr 2022 15:02:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 233F2w9a006749 for fs@FreeBSD.org; Sun, 3 Apr 2022 15:02:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 212168] [panic] [UFS] use-after-free panic (0xdeadc0dedeadc0de) Date: Sun, 03 Apr 2022 15:02:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RC1 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648998178; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vzIvVN+FKDvNHvC+rM6Cv/Kmd2QcLOOUXsf9KrMEQ1s=; b=Q/Jqk7py/eM9TwDgX/zkIdIPsHwO6OFGIS+CkLyrqpPBwxBIKLBy6RAuH0CnMWrPrkc0hH 5dZv21HeLvSbZRMxIQ6roqeiYUoodOVPaDxKbU2pFiZE7xW8vdlLZwGampOX7rUMy0TxlN wQe0Z47P30ioB+LD/IpkiLWK8GVenxTW9J1JQPzCc2qDJzLO9J78I4oNnB6x/LegxhOXcZ 9WcpPQO8jToQ7LE70OjuDGTLVuUIPxT+bH9cJLtAC7EG54qeBh3XyjLpRWJCjfWSGjz8Qg DwTSoxs7xn1QKl1bmJrXd1XWnxWCyshl44fTzFzXB+gczG3JrFRFsPvfFm2/VA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648998178; a=rsa-sha256; cv=none; b=J8TZEDGPqIXbN1UZLrZBZHyebbPdjslfaTHC/I0lmk0maEuNQZ9gn0aCSfCo50FW5NQF4z v9RX3WtfOmMcW1a1MlA9GueOrC/c8AdeTpYJlB14utoPiuGUJnisZT5RaOSw1r42Mf5n/T 9l9az9/rpH/UyoxGnjx6bT0/XbSwT2Jt2xCYgclylK045X71NQtX7pL8n5va9pZx0weqrt bnB6+bqAKsHUqDt/SoetTPOIh9Ov8AsoGNj0oedSd0x1wM18p0KrxTKdae+b6A6GCoB914 94r5Pz7XcwWghyU7fZ/gPOVacy8OSFIaBLpT2prnELmmoZ+5vQntedjoOPUrcA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212168 --- Comment #19 from Ed Maste --- Is this issue OBE? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Apr 3 18:27:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2A6931A66687 for ; Sun, 3 Apr 2022 18:27:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KWj7N6RQ1z4rVQ for ; Sun, 3 Apr 2022 18:27:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B8CFE22634 for ; Sun, 3 Apr 2022 18:27:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 233IRSNK013569 for ; Sun, 3 Apr 2022 18:27:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 233IRSAo013568 for fs@FreeBSD.org; Sun, 3 Apr 2022 18:27:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 212168] [panic] [UFS] use-after-free panic (0xdeadc0dedeadc0de) Date: Sun, 03 Apr 2022 18:27:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RC1 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649010449; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SfmzOjBOS9Q33YFC9KQK9UbF02/eKVS96lWmuQCuZwA=; b=gtO0l8KqmnUqdC+7U/+XixCbN6RsbYoMznOBOrgrJTUYfhslmXuhdxO/FlW8NK9I0Fe/Q5 AqqtFqabF1bQjEKEUnDQ8/eqYG+pSXoxAS0lxGL9W7ceNB1wXR/iMa3W3YNO/kYB+Ax480 /H8+RWVlUZH3zqdeZFZ78zLQ1EOfyKIDVQwq4pXog2BvQ+UmVap/2LcZpx9hsfUory+f5K HfR/HcAde3wT+4BtzDd82pH5t/zO95F7uD+jj9pEeuGCgvzN0kZ6Qom9M5FCZ7KB6SDQNX cbDPCO7NfHPHT0EgZwjvfN/NABSbUmlYzARDRLzVYzmhojfwfsfE52OrAtggTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649010449; a=rsa-sha256; cv=none; b=kBNlYzi0wvLIS8oV1CCrCmbljpGjeLoX41MLPgZi4byEC47aHec2wncmsSZQsJtqoTLpo2 jp7RVbI7IVilMQ/WvFGSzpaROe6nMjwvdD/mF9HE8lneVSk8OeqBp7NTTIfX2fXi5kBCf+ yZxMfuCF6Lv8LvcZay55zzHRxnemdUR62bGg5YWivI0b9VlEETWxo7SJdrf6CTpRXcd286 dCZa16xFK5EXwz1GR0i/iy93FHm1UJKlJhXPJgeius4M48NDnrkw8eJV9d+0FHkp9eDIE4 3gCRuOmv72XrVNk7qFWJtdZACrVcaNei6vWSTP6agjBV+sUstNfsJx2OX5BM8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212168 --- Comment #20 from Kirk McKusick --- (In reply to Ed Maste from comment #19) Reading through the comments for this bug, it appears that it was being cau= sed by the lack of a memory barrier on the ARM64. The fact that it was not appearing on any other architectures and that Andrew Turner's addition of a memory barrier instruction seemed to fix the problem leads me to believe th= at this report has been resolved (at least if Andrew committed his change). If Andrew's change has not been committed, then it seems like it should be. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Apr 3 21:00:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D7E751A60C1F for ; Sun, 3 Apr 2022 21:00:34 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KWmX144jzz3kDL for ; Sun, 3 Apr 2022 21:00:33 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 12EF324857 for ; Sun, 3 Apr 2022 21:00:33 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 233L0Wsk092305 for ; Sun, 3 Apr 2022 21:00:32 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 233L0Wca092304 for fs@FreeBSD.org; Sun, 3 Apr 2022 21:00:32 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202204032100.233L0Wca092304@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 3 Apr 2022 21:00:32 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16490196325.e63d8Cf.90949" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649019634; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=1ZqUhxigFgUcJIajyScTUHBhS4l/C98hblhgVJ+7hEI=; b=kL49DVtDXBfaE/5lfkmBuqyhwpykYgTnaVcw8oHeyt/DGDjMZSPKZ1xx+kNfDDvSup0Vbb I/T6snP8OrFLl5niSxLGfTwrHCSZOLKmIVoG4CP2U4/EotbBXasIg+r79wZardOwZllYI+ pUZhnau80QfAsJJ22dt8HB1MyDtTUKOwQNIkX4U4uV/+xTiv0W5r2LT3+ua0C/A711nQg0 4LvjXNUrr8pNG03Pa0J2PrHoIa5CQd0gZ98zBNzwcK2Pn2eG8L6rSzbLSbez94MZv9Z0B7 b6spUyROuT0OTIcvboUb+YIqWciTF31sSrVWp7fGRlXitf/gqq0+4xwfR3oYNQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649019634; a=rsa-sha256; cv=none; b=HpX2FP2Hm272NABQa5lAjLLGzH+LWpg57PXk9YE0LpXRhM+FfHqfjkuKXXCnZeYirvCdjl Y807Fxoz4ey5fSHZSJ84xsAN/QtbmI+D4gwG0NpIVysb3tKi87LEypKuu6UHovbwmJ5w8M KfyPnkzUPNCLGCWTtHSlEhXX9meqbRKFGbExZieUHOjtbxOWb2pCQ+37cisTdjODKLHthY Ty/2fH33phyCoLJ6UYqXy2hBhClldtEeiPg0+MMVOjwnVKUBfuUdKZtnlv2wW4t9HGawkZ tufoaE0Dg+1s+efJaHOjwI9ee7JTQ2QJIOnxHUpOtW2DWzBiuuLbwnxHdKgE6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16490196325.e63d8Cf.90949 Date: Sun, 3 Apr 2022 21:00:32 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16490196325.e63d8Cf.90949 Date: Sun, 3 Apr 2022 21:00:32 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16490196325.e63d8Cf.90949-- From nobody Tue Apr 5 21:05:25 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 88D351AA2AEF for ; Tue, 5 Apr 2022 21:05:44 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KY0Y34yC6z4l03 for ; Tue, 5 Apr 2022 21:05:43 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f176.google.com with SMTP id k10so455178oia.0 for ; Tue, 05 Apr 2022 14:05:43 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=nrAMl7ZHlsFPYpM9wxmvvmj3kRdeBK/cPsha8XmhHBU=; b=l4rxBIbjaIvZPwtT+TcTOL7FYgsDC9vb9ditnmpIrgjEeXcVRNXoaXdIVGhP5ACeyq lOKlmpNj8XqF34bmx62HqyCm8E/OXbgXHBh/EXHPYxVwjrVpMrsmK2Sc2eWICfEPvp6P 2S6P/aDtqF0GayX0wG295PQpFsr8dX3Droa1FgSAX+HBpqNgEC7BBc1qNYi+jSP9hjO/ qN/AgVPeVEyz71BE+49Ln94GbFQfGIHWTw9tMlHv7lCp07F6BBc+vP46BzfoB03NQN7q kLd05eyI+azoIKGj36Sb2WfCfT37n4VtCmN/6Kyf/HIofuAp9iY4YLaxGErL8NvOrIGG GTBA== X-Gm-Message-State: AOAM532deOeJsRdDl3Jl0Q7YCw+FlSgZR2PVwgPn2FGGBWbLlmn4wYwE AMhwjPvTmrk870WPqbJ0kDu5Q2IxyZ3WDMd3W2VXCD39QSE= X-Google-Smtp-Source: ABdhPJxzjNZrk2U2pJATIGeF6sOoSLaXmGQZ5PQRK4Ar3YySfaYE0wB3mvpMybiGjdeLnLTLrAZ863wZ7MDLX0kGFts= X-Received: by 2002:a05:6808:1884:b0:2da:5cc2:2bbb with SMTP id bi4-20020a056808188400b002da5cc22bbbmr2329711oib.72.1649192736535; Tue, 05 Apr 2022 14:05:36 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Alan Somers Date: Tue, 5 Apr 2022 15:05:25 -0600 Message-ID: Subject: Hour-long sleeps in the ZFS write throttle: fix for 13.1 ? To: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KY0Y34yC6z4l03 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.176 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-1.90 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.996]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.900]; TO_DOM_EQ_FROM_DOM(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.176:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.176:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N All year long I've occasionally seen my ZFS processes get blocked in dmu_tx_wait. They stay blocked for more than an hour but eventually recover. I finally found the cause: an integer overflow bug in ustosbt. The fix is simple enough, but my question is: should we try to commit this in time for 13.1-RELEASE? It's a very disruptive bug, but also very hard to trigger. It takes a pretty highly congested ZFS system to trigger it. In theory the bug could affect other subsystems, too. https://github.com/openzfs/zfs/issues/13289 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=263073 From nobody Wed Apr 6 00:24:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1EBBC1A8499B for ; Wed, 6 Apr 2022 00:24:53 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ua1-x932.google.com (mail-ua1-x932.google.com [IPv6:2607:f8b0:4864:20::932]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KY4yq6qn8z3n1L for ; Wed, 6 Apr 2022 00:24:51 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ua1-x932.google.com with SMTP id s28so908024uac.1 for ; Tue, 05 Apr 2022 17:24:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=5eFQNF7C1F+ZHGN6o0iV/D7hdMUybR06JJpZf5ZlYDY=; b=DZE57LDOB7SbhYJzmPrpSa93Rp/QoDYT8QsBpmlQaAaLyDPruH3mC9Rcmzw9bTCrt6 4TP24K2ZGgt9ekKJ2uRQZdfuPTeEw0SUjxwJ0KPX6oRH0TR05g8peVsJwi8xrIvNx3DY uyzLDtLv1J9uVinRQaxRZ1+ubU43E2cX+dqUtJGitJaXp7AT5JQYqTspXkMJduxr35st BnIoUb+i1nrY7jOtkClszPEFNvL9t/g/dXSg/BkUNG797pNO4tzGxHsy2RTiBalGLTKa 8WiNkNRnDP0AHCRCANA6FhXeId8Rqwpun4/RFCGyKNFlp5Dou5WivDPeN8+vSIC8C8X+ LuZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5eFQNF7C1F+ZHGN6o0iV/D7hdMUybR06JJpZf5ZlYDY=; b=qVaLMlyKaUme+6dJr8QoTto1dr4hJTYfHJjUUnngiLKVhW4S1cisJ9Rzp5UmWHdmgC zOMm10sWxoYj9pgJCxiVbwdQY6y5jqVRTKVH4ZXn9fHrk3PGxaAMWEWBMq7Itswfpyz2 AZw88N+V/0Dta6/RdH8KWdFXShD6Qxtz1/lF4l8MGPuax2B7/fDOF8/rtCJMzxyZW0Ic afKKuY0Hmxba7IIagg04r0NvxoiX/zRsbj07imzLnFqnGYEh7vzpn6LvGvez2chh+Xz3 jVWTvxSjHdL7Uilw3aUo2w066akeTFN1cR31VofqAQ9bpUny8H6TCY6YgyPTvBivY+ek W+SA== X-Gm-Message-State: AOAM533fs7FkKC/l5NsGsjUxyW5Bjdm3yNk6aAtu3opgT2TRAWUusW3L UhH5xcO6fQDhXy5d/cdUEZU8kQu9i/JxVkMdzqi49v/KvfCoxiB6 X-Google-Smtp-Source: ABdhPJz4yOu9iIT7Ucs038m1FiOVilG2bHvEYsYhKqm5K0apkIV0yOlTGHOy0NGmHNwF5e1TcprFmbC4TVOB79sRo2g= X-Received: by 2002:a05:6102:2333:b0:325:b03e:aa4b with SMTP id b19-20020a056102233300b00325b03eaa4bmr2045951vsa.68.1649204691390; Tue, 05 Apr 2022 17:24:51 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Tue, 5 Apr 2022 18:24:40 -0600 Message-ID: Subject: Re: Hour-long sleeps in the ZFS write throttle: fix for 13.1 ? To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000cae50605dbf16376" X-Rspamd-Queue-Id: 4KY4yq6qn8z3n1L X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=DZE57LDO; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::932) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-0.24 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.76)[0.755]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::932:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000cae50605dbf16376 Content-Type: text/plain; charset="UTF-8" On Tue, Apr 5, 2022 at 3:06 PM Alan Somers wrote: > All year long I've occasionally seen my ZFS processes get blocked in > dmu_tx_wait. They stay blocked for more than an hour but eventually > recover. I finally found the cause: an integer overflow bug in > ustosbt. The fix is simple enough, but my question is: should we try > to commit this in time for 13.1-RELEASE? It's a very disruptive bug, > but also very hard to trigger. It takes a pretty highly congested ZFS > system to trigger it. In theory the bug could affect other > subsystems, too. > > https://github.com/openzfs/zfs/issues/13289 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=263073 These routines were originally not meant for large times (> 1s). However, that was poorly documented and so I fixed it. But did so incorrectly. If you look at the bug, I've posted what I think is the fix (it also matches Alan's description). Warner --000000000000cae50605dbf16376 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Tue, Apr 5, 2022 at 3:06 PM Alan S= omers <asomers@freebsd.org>= ; wrote:
All yea= r long I've occasionally seen my ZFS processes get blocked in
dmu_tx_wait.=C2=A0 They stay blocked for more than an hour but eventually recover.=C2=A0 I finally found the cause: an integer overflow bug in
ustosbt.=C2=A0 The fix is simple enough, but my question is: should we try<= br> to commit this in time for 13.1-RELEASE?=C2=A0 It's a very disruptive b= ug,
but also very hard to trigger.=C2=A0 It takes a pretty highly congested ZFS=
system to trigger it.=C2=A0 In theory the bug could affect other
subsystems, too.

https://github.com/openzfs/zfs/issues/13289
https://bugs.freebsd.org/bugzilla/show_bu= g.cgi?id=3D263073

These routines were o= riginally not meant for large times (> 1s). However,
that was = poorly documented and so I fixed it. But did so incorrectly.
= If you look at the bug, I've posted what I think is the fix (it also ma= tches
Alan's description).

Warner
--000000000000cae50605dbf16376-- From nobody Wed Apr 6 11:15:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 31E3D1AA5E3A; Wed, 6 Apr 2022 11:15:38 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYMPj1Gy7z4cHM; Wed, 6 Apr 2022 11:15:37 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id 5FF0860C050; Wed, 6 Apr 2022 13:15:35 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=_bd91ad01df27068b5d25c9b898f7c3df" Date: Wed, 06 Apr 2022 13:15:35 +0200 From: egoitz@ramattack.net To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org Subject: Desperate with 870 QVO and ZFS Message-ID: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYMPj1Gy7z4cHM X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-2.67 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,multipart/alternative,text/plain,multipart/related]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.994]; MIME_BASE64_TEXT(0.10)[]; FROM_NO_DN(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; NEURAL_HAM_MEDIUM(-0.99)[-0.990]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+,4:~,5:~,6:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_bd91ad01df27068b5d25c9b898f7c3df Content-Type: multipart/alternative; boundary="=_044aea7dd22a9f76a92b49bbdb55310b" --=_044aea7dd22a9f76a92b49bbdb55310b Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII Good morning, I write this post with the expectation that perhaps someone could help me I am running some mail servers with FreeBSD and ZFS. They use 870 QVO (not EVO or other Samsung SSD disks) disks as storage. They can easily have from 1500 to 2000 concurrent connections. The machines have 128GB of ram and the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% percent at most. The problem I'm facing is that they could be running just fine and suddenly at some peak hour, the IO goes to 60 or 70% and the machine becomes extremely slow. ZFS is all by default, except the sync parameter which is set disabled. Apart from that the ARC is limited to 64GB. But even this is extremely odd. The used ARC is near 20GB. I have seen, that meta cache in arc is very near to the limit that FreeBSD automatically sets depending on the size of the ARC you set. It seems that almost all ARC is used by meta cache. I have seen this effect in all my mail servers with this hardware and software config. I do attach a zfs-stats output, but from now that the servers are not so loaded as described. I do explain. I run a couple of Cyrus instances in these servers. One as master, one as slave on each server. The commented situation from above, happens when both Cyrus instances become master, so when we are using two Cyrus instances giving service in the same machine. For avoiding issues, know we have balanced and we have a master and a slave in each server. You know, a slave instance has almost no io and only a single connection for replication. So the zfs-stats output is from now we have let's say half of load in each server, because they have one master and one slave instance. As said before, when I place two masters in same server, perhaps all day works, but just at 11:00 am (for example) the IO goes to 60% (it doesn't increase) but it seems like if the IO where not being able to be served, let's say more than a limit. More than a concrete io limit (I'd say 60%). I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later... I have get a nice performance when copying for instance mailboxes from five to five.... I can flood a gigabit interface when copying mailboxes between servers from five to five.... they seem to perform.... Could anyone please shed us some light in this issue?. I don't really know what to think. Best regards, --=_044aea7dd22a9f76a92b49bbdb55310b Content-Type: multipart/related; boundary="=_c643a5b1c3a123a0b3bc0c046160d9bb" --=_c643a5b1c3a123a0b3bc0c046160d9bb Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8
Good morning,

I write this post with = the expectation that perhaps someone could help me 3D":)"

I am running some mail servers with FreeBSD and ZFS. They use 870 = QVO (not EVO or other Samsung SSD disks) disks as storage. They can easily = have from 1500 to 2000 concurrent connections. The machines have 128GB of r= am and the CPU is almost absolutely idle. The disk IO is normally at 30 or = 40% percent at most.

The problem I'm facing is that they could= be running just fine and suddenly at some peak hour, the IO goes to 60 or = 70% and the machine becomes extremely slow. ZFS is all by default, except t= he sync parameter which is set disabled. Apart from that the ARC is limited= to 64GB. But even this is extremely odd. The used ARC is near 20GB. I have= seen, that meta cache in arc is very near to the limit that FreeBSD automa= tically sets depending on the size of the ARC you set. It seems that almost= all ARC is used by meta cache. I have seen this effect in all my mail serv= ers with this hardware and software config.

I do attach a zfs-= stats output, but from now that the servers are not so loaded as described= =2E I do explain. I run a couple of Cyrus instances in these servers. One a= s master, one as slave on each server. The commented situation from above, = happens when both Cyrus instances become master, so when we are using two C= yrus instances giving service in the same machine. For avoiding issues, kno= w we have balanced and we have a master and a slave in each server. You kno= w, a slave instance has almost no io and only a single connection for repli= cation. So the zfs-stats output is from now we have let's say half of load = in each server, because they have one master and one slave instance.
=
As said before, when I place two masters in same server, perhaps all= day works, but just at 11:00 am (for example) the IO goes to 60% (it doesn= 't increase) but it seems like if the IO where not being able to be served,= let's say more than a limit. More than a concrete io limit (I'd say 60%)= =2E

I don't really know if, perhaps the QVO technology could b= e the guilty here.... because... they say are desktop computers disks... bu= t later... I have get a nice performance when copying for instance mailboxe= s from five to five.... I can flood a gigabit interface when copying mailbo= xes between servers from five to five.... they seem to perform....
Could anyone please shed us some light in this issue?. I don't really = know what to think.

Best regards,
 


--=_c643a5b1c3a123a0b3bc0c046160d9bb Content-Transfer-Encoding: base64 Content-ID: Content-Type: image/gif; name=d8974688.gif Content-Disposition: inline; filename=d8974688.gif; size=42 R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7 --=_c643a5b1c3a123a0b3bc0c046160d9bb-- --=_044aea7dd22a9f76a92b49bbdb55310b-- --=_bd91ad01df27068b5d25c9b898f7c3df Content-Transfer-Encoding: base64 Content-Type: text/plain; name=zfs-stats.txt Content-Disposition: attachment; filename=zfs-stats.txt; size=12369 L3RtcC96ZnMtc3RhdHMgLWEKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQpaRlMgU3Vic3lzdGVtIFJlcG9ydAkJ CQlXZWQgQXByICA2IDExOjU4OjE4IDIwMjIKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgpTeXN0ZW0gSW5mb3Jt YXRpb246CgoJS2VybmVsIFZlcnNpb246CQkJCTEyMDIwMDAgKG9zcmVsZGF0ZSkKCUhhcmR3YXJl IFBsYXRmb3JtOgkJCWFtZDY0CglQcm9jZXNzb3IgQXJjaGl0ZWN0dXJlOgkJCWFtZDY0CgoJWkZT IFN0b3JhZ2UgcG9vbCBWZXJzaW9uOgkJNTAwMAoJWkZTIEZpbGVzeXN0ZW0gVmVyc2lvbjoJCQk1 CgpGcmVlQlNEIDEyLjItUkVMRUFTRS1wNiByMzY5ODU1IEdFTkVSSUMgMTE6NThBTSAgdXAgMTQ4 IGRheXMsIDIwOjI5LCAxIHVzZXIsIGxvYWQgYXZlcmFnZXM6IDIuMTEsIDIuNDcsIDIuMjYKCi0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLQoKU3lzdGVtIE1lbW9yeToKCgkzLjI0JQk0LjAzCUdpQiBBY3RpdmUsCTcx LjUwJQk4OC45MwlHaUIgSW5hY3QKCTIyLjc4JQkyOC4zMwlHaUIgV2lyZWQsCTAuMDAlCTAJQnl0 ZXMgQ2FjaGUKCTIuMjUlCTIuODAJR2lCIEZyZWUsCTAuMjMlCTI5Mi42MQlNaUIgR2FwCgoJUmVh bCBJbnN0YWxsZWQ6CQkJCTEyOC4wMAlHaUIKCVJlYWwgQXZhaWxhYmxlOgkJCTk5LjcwJQkxMjcu NjIJR2lCCglSZWFsIE1hbmFnZWQ6CQkJOTcuNDclCTEyNC4zOQlHaUIKCglMb2dpY2FsIFRvdGFs OgkJCQkxMjguMDAJR2lCCglMb2dpY2FsIFVzZWQ6CQkJMjguMzMlCTM2LjI2CUdpQgoJTG9naWNh bCBGcmVlOgkJCTcxLjY3JQk5MS43NAlHaUIKCktlcm5lbCBNZW1vcnk6CQkJCQkzLjIxCUdpQgoJ RGF0YToJCQkJOTguODIlCTMuMTcJR2lCCglUZXh0OgkJCQkxLjE4JQkzOC42NQlNaUIKCktlcm5l bCBNZW1vcnkgTWFwOgkJCQkxMjQuMzkJR2lCCglTaXplOgkJCQkyMi4zNCUJMjcuNzkJR2lCCglG cmVlOgkJCQk3Ny42NiUJOTYuNjAJR2lCCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCkFSQyBTdW1tYXJ5OiAo SEVBTFRIWSkKCU1lbW9yeSBUaHJvdHRsZSBDb3VudDoJCQkwCgpBUkMgTWlzYzoKCURlbGV0ZWQ6 CQkJCTEuNzgJYgoJTXV0ZXggTWlzc2VzOgkJCQkxODcuMjUJbQoJRXZpY3QgU2tpcHM6CQkJCTg3 LjM1CWIKCkFSQyBTaXplOgkJCQkyOS4yNSUJMTguNzIJR2lCCglUYXJnZXQgU2l6ZTogKEFkYXB0 aXZlKQkJMTIuNTAlCTguMDAJR2lCCglNaW4gU2l6ZSAoSGFyZCBMaW1pdCk6CQkxMi41MCUJOC4w MAlHaUIKCU1heCBTaXplIChIaWdoIFdhdGVyKToJCTg6MQk2NC4wMAlHaUIKCURlY29tcHJlc3Nl ZCBEYXRhIFNpemU6CQkJOS41MglHaUIKCUNvbXByZXNzaW9uIEZhY3RvcjoJCQkwLjUxCgpBUkMg U2l6ZSBCcmVha2Rvd246CglSZWNlbnRseSBVc2VkIENhY2hlIFNpemU6CTIuNjclCTUxMi4wMAlN aUIKCUZyZXF1ZW50bHkgVXNlZCBDYWNoZSBTaXplOgk5Ny4zMyUJMTguMjIJR2lCCgpBUkMgSGFz aCBCcmVha2Rvd246CglFbGVtZW50cyBNYXg6CQkJCTMuMTEJbQoJRWxlbWVudHMgQ3VycmVudDoJ CTE5LjIxJQk1OTYuNjIJawoJQ29sbGlzaW9uczoJCQkJMjAzLjY0CW0KCUNoYWluIE1heDoJCQkJ NQoJQ2hhaW5zOgkJCQkJMTAuMjMJawoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgpBUkMgRWZmaWNpZW5jeToJ CQkJCTE4OC4wNgliCglDYWNoZSBIaXQgUmF0aW86CQk5OC42MyUJMTg1LjQ4CWIKCUNhY2hlIE1p c3MgUmF0aW86CQkxLjM3JQkyLjU4CWIKCUFjdHVhbCBIaXQgUmF0aW86CQk5OC42MiUJMTg1LjQ2 CWIKCglEYXRhIERlbWFuZCBFZmZpY2llbmN5OgkJOTguNDQlCTU3LjM2CWIKCURhdGEgUHJlZmV0 Y2ggRWZmaWNpZW5jeToJMi40NSUJODU5LjAzCW0KCglDQUNIRSBISVRTIEJZIENBQ0hFIExJU1Q6 CgkgIE1vc3QgUmVjZW50bHkgVXNlZDoJCTEwLjg5JQkyMC4yMAliCgkgIE1vc3QgRnJlcXVlbnRs eSBVc2VkOgkJODkuMTAlCTE2NS4yNgliCgkgIE1vc3QgUmVjZW50bHkgVXNlZCBHaG9zdDoJMC4w NyUJMTM4LjcwCW0KCSAgTW9zdCBGcmVxdWVudGx5IFVzZWQgR2hvc3Q6CTAuMTYlCTMwMC44NAlt CgoJQ0FDSEUgSElUUyBCWSBEQVRBIFRZUEU6CgkgIERlbWFuZCBEYXRhOgkJCTMwLjQ0JQk1Ni40 NgliCgkgIFByZWZldGNoIERhdGE6CQkwLjAxJQkyMS4wMQltCgkgIERlbWFuZCBNZXRhZGF0YToJ CTY5LjU0JQkxMjguOTgJYgoJICBQcmVmZXRjaCBNZXRhZGF0YToJCTAuMDElCTE2LjA5CW0KCglD QUNIRSBNSVNTRVMgQlkgREFUQSBUWVBFOgoJICBEZW1hbmQgRGF0YToJCQkzNC43NSUJODk2LjY3 CW0KCSAgUHJlZmV0Y2ggRGF0YToJCTMyLjQ3JQk4MzguMDIJbQoJICBEZW1hbmQgTWV0YWRhdGE6 CQkzMS4xOCUJODA0LjU3CW0KCSAgUHJlZmV0Y2ggTWV0YWRhdGE6CQkxLjYwJQk0MS4yNwltCgot LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0KCkwyQVJDIGlzIGRpc2FibGVkCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KClBlciBk YXRhc2V0IHN0YXRpc3RpY3MgYXJlIG5vdCBhdmFpbGFibGUKCi0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKRmls ZS1MZXZlbCBQcmVmZXRjaDoKCkRNVSBFZmZpY2llbmN5OgkJCQkJODMuNTIJYgoJSGl0IFJhdGlv OgkJCTIuNzQlCTIuMjkJYgoJTWlzcyBSYXRpbzoJCQk5Ny4yNiUJODEuMjMJYgoKLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tCgpWREVWIGNhY2hlIGlzIGRpc2FibGVkCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KClpGUyBUdW5h YmxlcyAoc3lzY3RsKToKCWtlcm4ubWF4dXNlcnMgICAgICAgICAgICAgICAgICAgICAgICAgICA4 NTAzCgl2bS5rbWVtX3NpemUgICAgICAgICAgICAgICAgICAgICAgICAgICAgMTMzNTYwMzA3NzEy Cgl2bS5rbWVtX3NpemVfc2NhbGUgICAgICAgICAgICAgICAgICAgICAgMQoJdm0ua21lbV9zaXpl X21pbiAgICAgICAgICAgICAgICAgICAgICAgIDAKCXZtLmttZW1fc2l6ZV9tYXggICAgICAgICAg ICAgICAgICAgICAgICAxMzE5NDEzOTUwODc0Cgl2ZnMuemZzLnRyaW0ubWF4X2ludGVydmFsICAg ICAgICAgICAgICAgMQoJdmZzLnpmcy50cmltLnRpbWVvdXQgICAgICAgICAgICAgICAgICAgIDMw Cgl2ZnMuemZzLnRyaW0udHhnX2RlbGF5ICAgICAgICAgICAgICAgICAgMzIKCXZmcy56ZnMudHJp bS5lbmFibGVkICAgICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLnZvbC5pbW1lZGlhdGVfd3Jp dGVfc3ogICAgICAgICAgMzI3NjgKCXZmcy56ZnMudm9sLnVubWFwX3N5bmNfZW5hYmxlZCAgICAg ICAgICAwCgl2ZnMuemZzLnZvbC51bm1hcF9lbmFibGVkICAgICAgICAgICAgICAgMQoJdmZzLnpm cy52b2wucmVjdXJzaXZlICAgICAgICAgICAgICAgICAgIDAKCXZmcy56ZnMudm9sLm1vZGUgICAg ICAgICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLnZlcnNpb24uenBsICAgICAgICAgICAgICAg ICAgICAgNQoJdmZzLnpmcy52ZXJzaW9uLnNwYSAgICAgICAgICAgICAgICAgICAgIDUwMDAKCXZm cy56ZnMudmVyc2lvbi5hY2wgICAgICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLnZlcnNpb24u aW9jdGwgICAgICAgICAgICAgICAgICAgNwoJdmZzLnpmcy5kZWJ1ZyAgICAgICAgICAgICAgICAg ICAgICAgICAgIDAKCXZmcy56ZnMuc3VwZXJfb3duZXIgICAgICAgICAgICAgICAgICAgICAwCgl2 ZnMuemZzLmltbWVkaWF0ZV93cml0ZV9zeiAgICAgICAgICAgICAgMzI3NjgKCXZmcy56ZnMuc3lu Y19wYXNzX3Jld3JpdGUgICAgICAgICAgICAgICAyCgl2ZnMuemZzLnN5bmNfcGFzc19kb250X2Nv bXByZXNzICAgICAgICAgNQoJdmZzLnpmcy5zeW5jX3Bhc3NfZGVmZXJyZWRfZnJlZSAgICAgICAg IDIKCXZmcy56ZnMuemlvLmR2YV90aHJvdHRsZV9lbmFibGVkICAgICAgICAxCgl2ZnMuemZzLnpp by5leGNsdWRlX21ldGFkYXRhICAgICAgICAgICAgMAoJdmZzLnpmcy56aW8udXNlX3VtYSAgICAg ICAgICAgICAgICAgICAgIDEKCXZmcy56ZnMuemlvLnRhc2txX2JhdGNoX3BjdCAgICAgICAgICAg ICA3NQoJdmZzLnpmcy56aWxfbWF4YmxvY2tzaXplICAgICAgICAgICAgICAgIDEzMTA3MgoJdmZz Lnpmcy56aWxfc2xvZ19idWxrICAgICAgICAgICAgICAgICAgIDc4NjQzMgoJdmZzLnpmcy56aWxf bm9jYWNoZWZsdXNoICAgICAgICAgICAgICAgIDAKCXZmcy56ZnMuemlsX3JlcGxheV9kaXNhYmxl ICAgICAgICAgICAgICAwCgl2ZnMuemZzLmNhY2hlX2ZsdXNoX2Rpc2FibGUgICAgICAgICAgICAg MAoJdmZzLnpmcy5zdGFuZGFyZF9zbV9ibGtzeiAgICAgICAgICAgICAgIDEzMTA3MgoJdmZzLnpm cy5kdGxfc21fYmxrc3ogICAgICAgICAgICAgICAgICAgIDQwOTYKCXZmcy56ZnMubWluX2F1dG9f YXNoaWZ0ICAgICAgICAgICAgICAgICAxMgoJdmZzLnpmcy5tYXhfYXV0b19hc2hpZnQgICAgICAg ICAgICAgICAgIDEzCgl2ZnMuemZzLnZkZXYudHJpbV9tYXhfcGVuZGluZyAgICAgICAgICAgMTAw MDAKCXZmcy56ZnMudmRldi5iaW9fZGVsZXRlX2Rpc2FibGUgICAgICAgICAwCgl2ZnMuemZzLnZk ZXYuYmlvX2ZsdXNoX2Rpc2FibGUgICAgICAgICAgMAoJdmZzLnpmcy52ZGV2LmRlZl9xdWV1ZV9k ZXB0aCAgICAgICAgICAgIDMyCgl2ZnMuemZzLnZkZXYucXVldWVfZGVwdGhfcGN0ICAgICAgICAg ICAgMTAwMAoJdmZzLnpmcy52ZGV2LndyaXRlX2dhcF9saW1pdCAgICAgICAgICAgIDQwOTYKCXZm cy56ZnMudmRldi5yZWFkX2dhcF9saW1pdCAgICAgICAgICAgICAzMjc2OAoJdmZzLnpmcy52ZGV2 LmFnZ3JlZ2F0aW9uX2xpbWl0X25vbl9yb3RhdGluZzEzMTA3MgoJdmZzLnpmcy52ZGV2LmFnZ3Jl Z2F0aW9uX2xpbWl0ICAgICAgICAgIDEwNDg1NzYKCXZmcy56ZnMudmRldi5pbml0aWFsaXppbmdf bWF4X2FjdGl2ZSAgICAxCgl2ZnMuemZzLnZkZXYuaW5pdGlhbGl6aW5nX21pbl9hY3RpdmUgICAg MQoJdmZzLnpmcy52ZGV2LnJlbW92YWxfbWF4X2FjdGl2ZSAgICAgICAgIDIKCXZmcy56ZnMudmRl di5yZW1vdmFsX21pbl9hY3RpdmUgICAgICAgICAxCgl2ZnMuemZzLnZkZXYudHJpbV9tYXhfYWN0 aXZlICAgICAgICAgICAgNjQKCXZmcy56ZnMudmRldi50cmltX21pbl9hY3RpdmUgICAgICAgICAg ICAxCgl2ZnMuemZzLnZkZXYuc2NydWJfbWF4X2FjdGl2ZSAgICAgICAgICAgMgoJdmZzLnpmcy52 ZGV2LnNjcnViX21pbl9hY3RpdmUgICAgICAgICAgIDEKCXZmcy56ZnMudmRldi5hc3luY193cml0 ZV9tYXhfYWN0aXZlICAgICAxMAoJdmZzLnpmcy52ZGV2LmFzeW5jX3dyaXRlX21pbl9hY3RpdmUg ICAgIDEKCXZmcy56ZnMudmRldi5hc3luY19yZWFkX21heF9hY3RpdmUgICAgICAzCgl2ZnMuemZz LnZkZXYuYXN5bmNfcmVhZF9taW5fYWN0aXZlICAgICAgMQoJdmZzLnpmcy52ZGV2LnN5bmNfd3Jp dGVfbWF4X2FjdGl2ZSAgICAgIDEwCgl2ZnMuemZzLnZkZXYuc3luY193cml0ZV9taW5fYWN0aXZl ICAgICAgMTAKCXZmcy56ZnMudmRldi5zeW5jX3JlYWRfbWF4X2FjdGl2ZSAgICAgICAxMAoJdmZz Lnpmcy52ZGV2LnN5bmNfcmVhZF9taW5fYWN0aXZlICAgICAgIDEwCgl2ZnMuemZzLnZkZXYubWF4 X2FjdGl2ZSAgICAgICAgICAgICAgICAgMTAwMAoJdmZzLnpmcy52ZGV2LmFzeW5jX3dyaXRlX2Fj dGl2ZV9tYXhfZGlydHlfcGVyY2VudDYwCgl2ZnMuemZzLnZkZXYuYXN5bmNfd3JpdGVfYWN0aXZl X21pbl9kaXJ0eV9wZXJjZW50MzAKCXZmcy56ZnMudmRldi5taXJyb3Iubm9uX3JvdGF0aW5nX3Nl ZWtfaW5jMQoJdmZzLnpmcy52ZGV2Lm1pcnJvci5ub25fcm90YXRpbmdfaW5jICAgIDAKCXZmcy56 ZnMudmRldi5taXJyb3Iucm90YXRpbmdfc2Vla19vZmZzZXQxMDQ4NTc2Cgl2ZnMuemZzLnZkZXYu bWlycm9yLnJvdGF0aW5nX3NlZWtfaW5jICAgNQoJdmZzLnpmcy52ZGV2Lm1pcnJvci5yb3RhdGlu Z19pbmMgICAgICAgIDAKCXZmcy56ZnMudmRldi50cmltX29uX2luaXQgICAgICAgICAgICAgICAx Cgl2ZnMuemZzLnZkZXYuY2FjaGUuYnNoaWZ0ICAgICAgICAgICAgICAgMTYKCXZmcy56ZnMudmRl di5jYWNoZS5zaXplICAgICAgICAgICAgICAgICAwCgl2ZnMuemZzLnZkZXYuY2FjaGUubWF4ICAg ICAgICAgICAgICAgICAgMTYzODQKCXZmcy56ZnMudmRldi52YWxpZGF0ZV9za2lwICAgICAgICAg ICAgICAwCgl2ZnMuemZzLnZkZXYubWF4X21zX3NoaWZ0ICAgICAgICAgICAgICAgMzQKCXZmcy56 ZnMudmRldi5kZWZhdWx0X21zX3NoaWZ0ICAgICAgICAgICAyOQoJdmZzLnpmcy52ZGV2Lm1heF9t c19jb3VudF9saW1pdCAgICAgICAgIDEzMTA3MgoJdmZzLnpmcy52ZGV2Lm1pbl9tc19jb3VudCAg ICAgICAgICAgICAgIDE2Cgl2ZnMuemZzLnZkZXYuZGVmYXVsdF9tc19jb3VudCAgICAgICAgICAg MjAwCgl2ZnMuemZzLnR4Zy50aW1lb3V0ICAgICAgICAgICAgICAgICAgICAgNQoJdmZzLnpmcy5z cGFjZV9tYXBfaWJzICAgICAgICAgICAgICAgICAgIDE0Cgl2ZnMuemZzLnNwZWNpYWxfY2xhc3Nf bWV0YWRhdGFfcmVzZXJ2ZV9wY3QyNQoJdmZzLnpmcy51c2VyX2luZGlyZWN0X2lzX3NwZWNpYWwg ICAgICAgIDEKCXZmcy56ZnMuZGR0X2RhdGFfaXNfc3BlY2lhbCAgICAgICAgICAgICAxCgl2ZnMu emZzLnNwYV9hbGxvY2F0b3JzICAgICAgICAgICAgICAgICAgNAoJdmZzLnpmcy5zcGFfbWluX3Ns b3AgICAgICAgICAgICAgICAgICAgIDEzNDIxNzcyOAoJdmZzLnpmcy5zcGFfc2xvcF9zaGlmdCAg ICAgICAgICAgICAgICAgIDUKCXZmcy56ZnMuc3BhX2FzaXplX2luZmxhdGlvbiAgICAgICAgICAg ICAyNAoJdmZzLnpmcy5kZWFkbWFuX2VuYWJsZWQgICAgICAgICAgICAgICAgIDEKCXZmcy56ZnMu ZGVhZG1hbl9jaGVja3RpbWVfbXMgICAgICAgICAgICA1MDAwCgl2ZnMuemZzLmRlYWRtYW5fc3lu Y3RpbWVfbXMgICAgICAgICAgICAgMTAwMDAwMAoJdmZzLnpmcy5kZWJ1Z2ZsYWdzICAgICAgICAg ICAgICAgICAgICAgIDAKCXZmcy56ZnMucmVjb3ZlciAgICAgICAgICAgICAgICAgICAgICAgICAw Cgl2ZnMuemZzLnNwYV9sb2FkX3ZlcmlmeV9kYXRhICAgICAgICAgICAgMQoJdmZzLnpmcy5zcGFf bG9hZF92ZXJpZnlfbWV0YWRhdGEgICAgICAgIDEKCXZmcy56ZnMuc3BhX2xvYWRfdmVyaWZ5X21h eGluZmxpZ2h0ICAgICAxMDAwMAoJdmZzLnpmcy5tYXhfbWlzc2luZ190dmRzX3NjYW4gICAgICAg ICAgIDAKCXZmcy56ZnMubWF4X21pc3NpbmdfdHZkc19jYWNoZWZpbGUgICAgICAyCgl2ZnMuemZz Lm1heF9taXNzaW5nX3R2ZHMgICAgICAgICAgICAgICAgMAoJdmZzLnpmcy5zcGFfbG9hZF9wcmlu dF92ZGV2X3RyZWUgICAgICAgIDAKCXZmcy56ZnMuY2N3X3JldHJ5X2ludGVydmFsICAgICAgICAg ICAgICAzMDAKCXZmcy56ZnMuY2hlY2tfaG9zdGlkICAgICAgICAgICAgICAgICAgICAxCgl2ZnMu emZzLm11bHRpaG9zdF9mYWlsX2ludGVydmFscyAgICAgICAgMTAKCXZmcy56ZnMubXVsdGlob3N0 X2ltcG9ydF9pbnRlcnZhbHMgICAgICAyMAoJdmZzLnpmcy5tdWx0aWhvc3RfaW50ZXJ2YWwgICAg ICAgICAgICAgIDEwMDAKCXZmcy56ZnMubWdfZnJhZ21lbnRhdGlvbl90aHJlc2hvbGQgICAgICA4 NQoJdmZzLnpmcy5tZ19ub2FsbG9jX3RocmVzaG9sZCAgICAgICAgICAgIDAKCXZmcy56ZnMuY29u ZGVuc2VfcGN0ICAgICAgICAgICAgICAgICAgICAyMDAKCXZmcy56ZnMubWV0YXNsYWJfc21fYmxr c3ogICAgICAgICAgICAgICA0MDk2Cgl2ZnMuemZzLm1ldGFzbGFiLmJpYXNfZW5hYmxlZCAgICAg ICAgICAgMQoJdmZzLnpmcy5tZXRhc2xhYi5sYmFfd2VpZ2h0aW5nX2VuYWJsZWQgIDEKCXZmcy56 ZnMubWV0YXNsYWIuZnJhZ21lbnRhdGlvbl9mYWN0b3JfZW5hYmxlZDEKCXZmcy56ZnMubWV0YXNs YWIucHJlbG9hZF9lbmFibGVkICAgICAgICAxCgl2ZnMuemZzLm1ldGFzbGFiLnByZWxvYWRfbGlt aXQgICAgICAgICAgMwoJdmZzLnpmcy5tZXRhc2xhYi51bmxvYWRfZGVsYXkgICAgICAgICAgIDgK CXZmcy56ZnMubWV0YXNsYWIubG9hZF9wY3QgICAgICAgICAgICAgICA1MAoJdmZzLnpmcy5tZXRh c2xhYi5taW5fYWxsb2Nfc2l6ZSAgICAgICAgIDMzNTU0NDMyCgl2ZnMuemZzLm1ldGFzbGFiLmRm X2ZyZWVfcGN0ICAgICAgICAgICAgNAoJdmZzLnpmcy5tZXRhc2xhYi5kZl9hbGxvY190aHJlc2hv bGQgICAgIDEzMTA3MgoJdmZzLnpmcy5tZXRhc2xhYi5kZWJ1Z191bmxvYWQgICAgICAgICAgIDAK CXZmcy56ZnMubWV0YXNsYWIuZGVidWdfbG9hZCAgICAgICAgICAgICAwCgl2ZnMuemZzLm1ldGFz bGFiLmZyYWdtZW50YXRpb25fdGhyZXNob2xkNzAKCXZmcy56ZnMubWV0YXNsYWIuZm9yY2VfZ2Fu Z2luZyAgICAgICAgICAxNjc3NzIxNwoJdmZzLnpmcy5mcmVlX2Jwb2JqX2VuYWJsZWQgICAgICAg ICAgICAgIDEKCXZmcy56ZnMuZnJlZV9tYXhfYmxvY2tzICAgICAgICAgICAgICAgICAtMQoJdmZz Lnpmcy56ZnNfc2Nhbl9jaGVja3BvaW50X2ludGVydmFsICAgIDcyMDAKCXZmcy56ZnMuemZzX3Nj YW5fbGVnYWN5ICAgICAgICAgICAgICAgICAwCgl2ZnMuemZzLm5vX3NjcnViX3ByZWZldGNoICAg ICAgICAgICAgICAgMAoJdmZzLnpmcy5ub19zY3J1Yl9pbyAgICAgICAgICAgICAgICAgICAgIDAK CXZmcy56ZnMucmVzaWx2ZXJfbWluX3RpbWVfbXMgICAgICAgICAgICAzMDAwCgl2ZnMuemZzLmZy ZWVfbWluX3RpbWVfbXMgICAgICAgICAgICAgICAgMTAwMAoJdmZzLnpmcy5zY2FuX21pbl90aW1l X21zICAgICAgICAgICAgICAgIDEwMDAKCXZmcy56ZnMuc2Nhbl9pZGxlICAgICAgICAgICAgICAg ICAgICAgICA1MAoJdmZzLnpmcy5zY3J1Yl9kZWxheSAgICAgICAgICAgICAgICAgICAgIDQKCXZm cy56ZnMucmVzaWx2ZXJfZGVsYXkgICAgICAgICAgICAgICAgICAyCgl2ZnMuemZzLnpmZXRjaC5h cnJheV9yZF9zeiAgICAgICAgICAgICAgMTA0ODU3NgoJdmZzLnpmcy56ZmV0Y2gubWF4X2lkaXN0 YW5jZSAgICAgICAgICAgIDY3MTA4ODY0Cgl2ZnMuemZzLnpmZXRjaC5tYXhfZGlzdGFuY2UgICAg ICAgICAgICAgODM4ODYwOAoJdmZzLnpmcy56ZmV0Y2gubWluX3NlY19yZWFwICAgICAgICAgICAg IDIKCXZmcy56ZnMuemZldGNoLm1heF9zdHJlYW1zICAgICAgICAgICAgICA4Cgl2ZnMuemZzLnBy ZWZldGNoX2Rpc2FibGUgICAgICAgICAgICAgICAgMAoJdmZzLnpmcy5kZWxheV9zY2FsZSAgICAg ICAgICAgICAgICAgICAgIDUwMDAwMAoJdmZzLnpmcy5kZWxheV9taW5fZGlydHlfcGVyY2VudCAg ICAgICAgIDYwCgl2ZnMuemZzLmRpcnR5X2RhdGFfc3luY19wY3QgICAgICAgICAgICAgMjAKCXZm cy56ZnMuZGlydHlfZGF0YV9tYXhfcGVyY2VudCAgICAgICAgICAxMAoJdmZzLnpmcy5kaXJ0eV9k YXRhX21heF9tYXggICAgICAgICAgICAgIDQyOTQ5NjcyOTYKCXZmcy56ZnMuZGlydHlfZGF0YV9t YXggICAgICAgICAgICAgICAgICA0Mjk0OTY3Mjk2Cgl2ZnMuemZzLm1heF9yZWNvcmRzaXplICAg ICAgICAgICAgICAgICAgMTA0ODU3NgoJdmZzLnpmcy5kZWZhdWx0X2licyAgICAgICAgICAgICAg ICAgICAgIDE3Cgl2ZnMuemZzLmRlZmF1bHRfYnMgICAgICAgICAgICAgICAgICAgICAgOQoJdmZz Lnpmcy5zZW5kX2hvbGVzX3dpdGhvdXRfYmlydGhfdGltZSAgIDEKCXZmcy56ZnMubWRjb21wX2Rp c2FibGUgICAgICAgICAgICAgICAgICAwCgl2ZnMuemZzLnBlcl90eGdfZGlydHlfZnJlZXNfcGVy Y2VudCAgICAgNQoJdmZzLnpmcy5ub3B3cml0ZV9lbmFibGVkICAgICAgICAgICAgICAgIDEKCXZm cy56ZnMuZGVkdXAucHJlZmV0Y2ggICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLmRidWZfY2Fj aGVfbG93YXRlcl9wY3QgICAgICAgICAgMTAKCXZmcy56ZnMuZGJ1Zl9jYWNoZV9oaXdhdGVyX3Bj dCAgICAgICAgICAxMAoJdmZzLnpmcy5kYnVmX21ldGFkYXRhX2NhY2hlX292ZXJmbG93ICAgIDAK CXZmcy56ZnMuZGJ1Zl9tZXRhZGF0YV9jYWNoZV9zaGlmdCAgICAgICA2Cgl2ZnMuemZzLmRidWZf Y2FjaGVfc2hpZnQgICAgICAgICAgICAgICAgNQoJdmZzLnpmcy5kYnVmX21ldGFkYXRhX2NhY2hl X21heF9ieXRlcyAgIDEwNzM3NDE4MjQKCXZmcy56ZnMuZGJ1Zl9jYWNoZV9tYXhfYnl0ZXMgICAg ICAgICAgICAyMTQ3NDgzNjQ4Cgl2ZnMuemZzLmFyY19taW5fcHJlc2NpZW50X3ByZWZldGNoX21z ICAgNgoJdmZzLnpmcy5hcmNfbWluX3ByZWZldGNoX21zICAgICAgICAgICAgIDEKCXZmcy56ZnMu bDJjX29ubHlfc2l6ZSAgICAgICAgICAgICAgICAgICAwCgl2ZnMuemZzLm1mdV9naG9zdF9kYXRh X2VzaXplICAgICAgICAgICAgMTQ2NjE1MzQ3MgoJdmZzLnpmcy5tZnVfZ2hvc3RfbWV0YWRhdGFf ZXNpemUgICAgICAgIDcwNzIzODA0MTYKCXZmcy56ZnMubWZ1X2dob3N0X3NpemUgICAgICAgICAg ICAgICAgICA4NTM4NTMzODg4Cgl2ZnMuemZzLm1mdV9kYXRhX2VzaXplICAgICAgICAgICAgICAg ICAgMAoJdmZzLnpmcy5tZnVfbWV0YWRhdGFfZXNpemUgICAgICAgICAgICAgIDAKCXZmcy56ZnMu bWZ1X3NpemUgICAgICAgICAgICAgICAgICAgICAgICA5ODMxMjcwNDAKCXZmcy56ZnMubXJ1X2do b3N0X2RhdGFfZXNpemUgICAgICAgICAgICAwCgl2ZnMuemZzLm1ydV9naG9zdF9tZXRhZGF0YV9l c2l6ZSAgICAgICAgMAoJdmZzLnpmcy5tcnVfZ2hvc3Rfc2l6ZSAgICAgICAgICAgICAgICAgIDAK CXZmcy56ZnMubXJ1X2RhdGFfZXNpemUgICAgICAgICAgICAgICAgICAwCgl2ZnMuemZzLm1ydV9t ZXRhZGF0YV9lc2l6ZSAgICAgICAgICAgICAgMAoJdmZzLnpmcy5tcnVfc2l6ZSAgICAgICAgICAg ICAgICAgICAgICAgIDEyOTAzMzUxMjk2Cgl2ZnMuemZzLmFub25fZGF0YV9lc2l6ZSAgICAgICAg ICAgICAgICAgMAoJdmZzLnpmcy5hbm9uX21ldGFkYXRhX2VzaXplICAgICAgICAgICAgIDAKCXZm cy56ZnMuYW5vbl9zaXplICAgICAgICAgICAgICAgICAgICAgICAxMjUxMjI1NjAKCXZmcy56ZnMu bDJhcmNfbm9ydyAgICAgICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLmwyYXJjX2ZlZWRfYWdh aW4gICAgICAgICAgICAgICAgMQoJdmZzLnpmcy5sMmFyY19ub3ByZWZldGNoICAgICAgICAgICAg ICAgIDEKCXZmcy56ZnMubDJhcmNfZmVlZF9taW5fbXMgICAgICAgICAgICAgICAyMDAKCXZmcy56 ZnMubDJhcmNfZmVlZF9zZWNzICAgICAgICAgICAgICAgICAxCgl2ZnMuemZzLmwyYXJjX2hlYWRy b29tICAgICAgICAgICAgICAgICAgMgoJdmZzLnpmcy5sMmFyY193cml0ZV9ib29zdCAgICAgICAg ICAgICAgIDgzODg2MDgKCXZmcy56ZnMubDJhcmNfd3JpdGVfbWF4ICAgICAgICAgICAgICAgICA4 Mzg4NjA4Cgl2ZnMuemZzLmFyY19tZXRhX3N0cmF0ZWd5ICAgICAgICAgICAgICAgMAoJdmZzLnpm cy5hcmNfbWV0YV9saW1pdCAgICAgICAgICAgICAgICAgIDE3MTc5ODY5MTg0Cgl2ZnMuemZzLmFy Y19mcmVlX3RhcmdldCAgICAgICAgICAgICAgICAgNjk0NzI0Cgl2ZnMuemZzLmFyY19rbWVtX2Nh Y2hlX3JlYXBfcmV0cnlfbXMgICAgMTAwMAoJdmZzLnpmcy5jb21wcmVzc2VkX2FyY19lbmFibGVk ICAgICAgICAgIDEKCXZmcy56ZnMuYXJjX2dyb3dfcmV0cnkgICAgICAgICAgICAgICAgICA2MAoJ dmZzLnpmcy5hcmNfc2hyaW5rX3NoaWZ0ICAgICAgICAgICAgICAgIDcKCXZmcy56ZnMuYXJjX2F2 ZXJhZ2VfYmxvY2tzaXplICAgICAgICAgICA4MTkyCgl2ZnMuemZzLmFyY19ub19ncm93X3NoaWZ0 ICAgICAgICAgICAgICAgNQoJdmZzLnpmcy5hcmNfbWluICAgICAgICAgICAgICAgICAgICAgICAg IDg1ODk5MzQ1OTIKCXZmcy56ZnMuYXJjX21heCAgICAgICAgICAgICAgICAgICAgICAgICA2ODcx OTQ3NjczNgoJdmZzLnpmcy5hYmRfY2h1bmtfc2l6ZSAgICAgICAgICAgICAgICAgIDQwOTYKCXZm cy56ZnMuYWJkX3NjYXR0ZXJfZW5hYmxlZCAgICAgICAgICAgICAxCgotLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0K --=_bd91ad01df27068b5d25c9b898f7c3df-- From nobody Wed Apr 6 11:28:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 966A01A81E70; Wed, 6 Apr 2022 11:28:48 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYMhv4tm0z4gLP; Wed, 6 Apr 2022 11:28:47 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id D560C60C055; Wed, 6 Apr 2022 13:28:45 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_2094f57367545a643dbb74ca4f8ba24d" Date: Wed, 06 Apr 2022 13:28:45 +0200 From: egoitz@ramattack.net To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Desperate with 870 QVO and ZFS In-Reply-To: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYMhv4tm0z4gLP X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain,multipart/related]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_2094f57367545a643dbb74ca4f8ba24d Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 The most extrange thing is... When machine boots ARC is in 40 value of GB used (for instance), but later decreases to 20GB (and this is not an example... is exact) in all my servers.... it's like if the ARC metadata which is more or less 17GB would limite the whole ARC..... With the traffic of this machines, it should I suppose the ARC should be larger than it is... and ARC in loader.conf is limited to 64GB (the half the ram this machines have) El 2022-04-06 13:15, egoitz@ramattack.net escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Good morning, > > I write this post with the expectation that perhaps someone could help me > > I am running some mail servers with FreeBSD and ZFS. They use 870 QVO (not EVO or other Samsung SSD disks) disks as storage. They can easily have from 1500 to 2000 concurrent connections. The machines have 128GB of ram and the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% percent at most. > > The problem I'm facing is that they could be running just fine and suddenly at some peak hour, the IO goes to 60 or 70% and the machine becomes extremely slow. ZFS is all by default, except the sync parameter which is set disabled. Apart from that the ARC is limited to 64GB. But even this is extremely odd. The used ARC is near 20GB. I have seen, that meta cache in arc is very near to the limit that FreeBSD automatically sets depending on the size of the ARC you set. It seems that almost all ARC is used by meta cache. I have seen this effect in all my mail servers with this hardware and software config. > > I do attach a zfs-stats output, but from now that the servers are not so loaded as described. I do explain. I run a couple of Cyrus instances in these servers. One as master, one as slave on each server. The commented situation from above, happens when both Cyrus instances become master, so when we are using two Cyrus instances giving service in the same machine. For avoiding issues, know we have balanced and we have a master and a slave in each server. You know, a slave instance has almost no io and only a single connection for replication. So the zfs-stats output is from now we have let's say half of load in each server, because they have one master and one slave instance. > > As said before, when I place two masters in same server, perhaps all day works, but just at 11:00 am (for example) the IO goes to 60% (it doesn't increase) but it seems like if the IO where not being able to be served, let's say more than a limit. More than a concrete io limit (I'd say 60%). > > I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later... I have get a nice performance when copying for instance mailboxes from five to five.... I can flood a gigabit interface when copying mailboxes between servers from five to five.... they seem to perform.... > > Could anyone please shed us some light in this issue?. I don't really know what to think. > > Best regards, > > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. --=_2094f57367545a643dbb74ca4f8ba24d Content-Type: multipart/related; boundary="=_6e3b5663f91f7c881feb9dbfb751600c" --=_6e3b5663f91f7c881feb9dbfb751600c Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

The most extrange thing is... When machine boots ARC is = in 40 value of GB used (for instance), but later decreases to 20GB (and thi= s is not an example... is exact) in all my servers.... it's like if the ARC= metadata which is more or less 17GB would limite the whole ARC.....

 

With the traffic of this machines, it should I suppose t= he ARC should be larger than it is... and ARC in loader.conf is limited to = 64GB (the half the ram this machines have)

 


El 2022-04-06 13:15, egoitz@ramattack.net escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Good morning,

I write this post with = the expectation that perhaps someone could help me 3D":)"

I am running = some mail servers with FreeBSD and ZFS. They use 870 QVO (not EVO or other = Samsung SSD disks) disks as storage. They can easily have from 1500 to 2000= concurrent connections. The machines have 128GB of ram and the CPU is almo= st absolutely idle. The disk IO is normally at 30 or 40% percent at most.
The problem I'm facing is that they could be running just fine = and suddenly at some peak hour, the IO goes to 60 or 70% and the machine be= comes extremely slow. ZFS is all by default, except the sync parameter whic= h is set disabled. Apart from that the ARC is limited to 64GB. But even thi= s is extremely odd. The used ARC is near 20GB. I have seen, that meta cache= in arc is very near to the limit that FreeBSD automatically sets depending= on the size of the ARC you set. It seems that almost all ARC is used by me= ta cache. I have seen this effect in all my mail servers with this hardware= and software config.

I do attach a zfs-stats output, but from= now that the servers are not so loaded as described. I do explain. I run a= couple of Cyrus instances in these servers. One as master, one as slave on= each server. The commented situation from above, happens when both Cyrus i= nstances become master, so when we are using two Cyrus instances giving ser= vice in the same machine. For avoiding issues, know we have balanced and we= have a master and a slave in each server. You know, a slave instance has a= lmost no io and only a single connection for replication. So the zfs-stats = output is from now we have let's say half of load in each server, because t= hey have one master and one slave instance.

As said before, wh= en I place two masters in same server, perhaps all day works, but just at 1= 1:00 am (for example) the IO goes to 60% (it doesn't increase) but it seems= like if the IO where not being able to be served, let's say more than a li= mit. More than a concrete io limit (I'd say 60%).

I don't real= ly know if, perhaps the QVO technology could be the guilty here.... because= =2E.. they say are desktop computers disks... but later... I have get a nic= e performance when copying for instance mailboxes from five to five.... I c= an flood a gigabit interface when copying mailboxes between servers from fi= ve to five.... they seem to perform....

Could anyone please sh= ed us some light in this issue?. I don't really know what to think.
<= br /> Best regards,
 




ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.
--=_6e3b5663f91f7c881feb9dbfb751600c Content-Transfer-Encoding: base64 Content-ID: <1649244525624d796dc0952013070694@ramattack.net> Content-Type: image/gif; name=d8974688.gif Content-Disposition: inline; filename=d8974688.gif; size=42 R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7 --=_6e3b5663f91f7c881feb9dbfb751600c-- --=_2094f57367545a643dbb74ca4f8ba24d-- From nobody Wed Apr 6 11:29:42 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 25B0E1A8308F for ; Wed, 6 Apr 2022 11:29:46 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYMk10Zwjz4hZY for ; Wed, 6 Apr 2022 11:29:45 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 0C52A60BEEA for ; Wed, 6 Apr 2022 13:29:43 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_66cda114d0c28bf7be278349800c9349" Date: Wed, 06 Apr 2022 13:29:42 +0200 From: egoitz@ramattack.net To: Freebsd fs Subject: Re: Desperate with 870 QVO and ZFS In-Reply-To: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYMk10Zwjz4hZY X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain,multipart/related]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_66cda114d0c28bf7be278349800c9349 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 The most extrange thing is... When machine boots ARC is in 40 value of GB used (for instance), but later decreases to 20GB (and this is not an example... is exact) in all my servers.... it's like if the ARC metadata which is more or less 17GB would limite the whole ARC..... With the traffic of this machines, it should I suppose the ARC should be larger than it is... and ARC in loader.conf is limited to 64GB (the half the ram this machines have) El 2022-04-06 13:15, egoitz@ramattack.net escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Good morning, > > I write this post with the expectation that perhaps someone could help me > > I am running some mail servers with FreeBSD and ZFS. They use 870 QVO (not EVO or other Samsung SSD disks) disks as storage. They can easily have from 1500 to 2000 concurrent connections. The machines have 128GB of ram and the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% percent at most. > > The problem I'm facing is that they could be running just fine and suddenly at some peak hour, the IO goes to 60 or 70% and the machine becomes extremely slow. ZFS is all by default, except the sync parameter which is set disabled. Apart from that the ARC is limited to 64GB. But even this is extremely odd. The used ARC is near 20GB. I have seen, that meta cache in arc is very near to the limit that FreeBSD automatically sets depending on the size of the ARC you set. It seems that almost all ARC is used by meta cache. I have seen this effect in all my mail servers with this hardware and software config. > > I do attach a zfs-stats output, but from now that the servers are not so loaded as described. I do explain. I run a couple of Cyrus instances in these servers. One as master, one as slave on each server. The commented situation from above, happens when both Cyrus instances become master, so when we are using two Cyrus instances giving service in the same machine. For avoiding issues, know we have balanced and we have a master and a slave in each server. You know, a slave instance has almost no io and only a single connection for replication. So the zfs-stats output is from now we have let's say half of load in each server, because they have one master and one slave instance. > > As said before, when I place two masters in same server, perhaps all day works, but just at 11:00 am (for example) the IO goes to 60% (it doesn't increase) but it seems like if the IO where not being able to be served, let's say more than a limit. More than a concrete io limit (I'd say 60%). > > I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later... I have get a nice performance when copying for instance mailboxes from five to five.... I can flood a gigabit interface when copying mailboxes between servers from five to five.... they seem to perform.... > > Could anyone please shed us some light in this issue?. I don't really know what to think. > > Best regards, > > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. --=_66cda114d0c28bf7be278349800c9349 Content-Type: multipart/related; boundary="=_13724513d8e08ff17290e4a602323cd0" --=_13724513d8e08ff17290e4a602323cd0 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

The most extrange thing is... When machine boots ARC is = in 40 value of GB used (for instance), but later decreases to 20GB (and thi= s is not an example... is exact) in all my servers.... it's like if the ARC= metadata which is more or less 17GB would limite the whole ARC.....

 

With the traffic of this machines, it should I suppose t= he ARC should be larger than it is... and ARC in loader.conf is limited to = 64GB (the half the ram this machines have)

 


El 2022-04-06 13:15, egoitz@ramattack.net escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Good morning,

I write this post with = the expectation that perhaps someone could help me 3D":)"

I am running = some mail servers with FreeBSD and ZFS. They use 870 QVO (not EVO or other = Samsung SSD disks) disks as storage. They can easily have from 1500 to 2000= concurrent connections. The machines have 128GB of ram and the CPU is almo= st absolutely idle. The disk IO is normally at 30 or 40% percent at most.
The problem I'm facing is that they could be running just fine = and suddenly at some peak hour, the IO goes to 60 or 70% and the machine be= comes extremely slow. ZFS is all by default, except the sync parameter whic= h is set disabled. Apart from that the ARC is limited to 64GB. But even thi= s is extremely odd. The used ARC is near 20GB. I have seen, that meta cache= in arc is very near to the limit that FreeBSD automatically sets depending= on the size of the ARC you set. It seems that almost all ARC is used by me= ta cache. I have seen this effect in all my mail servers with this hardware= and software config.

I do attach a zfs-stats output, but from= now that the servers are not so loaded as described. I do explain. I run a= couple of Cyrus instances in these servers. One as master, one as slave on= each server. The commented situation from above, happens when both Cyrus i= nstances become master, so when we are using two Cyrus instances giving ser= vice in the same machine. For avoiding issues, know we have balanced and we= have a master and a slave in each server. You know, a slave instance has a= lmost no io and only a single connection for replication. So the zfs-stats = output is from now we have let's say half of load in each server, because t= hey have one master and one slave instance.

As said before, wh= en I place two masters in same server, perhaps all day works, but just at 1= 1:00 am (for example) the IO goes to 60% (it doesn't increase) but it seems= like if the IO where not being able to be served, let's say more than a li= mit. More than a concrete io limit (I'd say 60%).

I don't real= ly know if, perhaps the QVO technology could be the guilty here.... because= =2E.. they say are desktop computers disks... but later... I have get a nic= e performance when copying for instance mailboxes from five to five.... I c= an flood a gigabit interface when copying mailboxes between servers from fi= ve to five.... they seem to perform....

Could anyone please sh= ed us some light in this issue?. I don't really know what to think.
<= br /> Best regards,
 




ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.
--=_13724513d8e08ff17290e4a602323cd0 Content-Transfer-Encoding: base64 Content-ID: <1649244583624d79a70083e553940346@ramattack.net> Content-Type: image/gif; name=d8974688.gif Content-Disposition: inline; filename=d8974688.gif; size=42 R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7 --=_13724513d8e08ff17290e4a602323cd0-- --=_66cda114d0c28bf7be278349800c9349-- From nobody Wed Apr 6 12:56:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 496061A9CC29; Wed, 6 Apr 2022 12:57:08 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id 4KYPfq0Vp5z54ZK; Wed, 6 Apr 2022 12:57:06 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Wed, 06 Apr 2022 14:54:32 +0200 Received-SPF: SoftFail (connect.ultra-secure.de: domain of ultra-secure.de does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=217.71.83.52; helo=smtpclient.apple; envelope-from= Received-SPF: None (connect.ultra-secure.de: domain of smtpclient.apple does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=helo; client-ip=217.71.83.52; helo=smtpclient.apple; envelope-from= Received: from smtpclient.apple (217-071-083-052.ip-tech.ch [217.71.83.52]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id 6C816542-0484-4947-801C-2EA8A9DBC4A1.1 envelope-from (authenticated bits=0) (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 verify=NO); Wed, 06 Apr 2022 14:54:29 +0200 From: Rainer Duffner Message-Id: <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> Content-Type: multipart/alternative; boundary="Apple-Mail=_BC042E58-8575-4525-A55E-47AA4EF4E371" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.80.82.1.1\)) Subject: Re: Desperate with 870 QVO and ZFS Date: Wed, 6 Apr 2022 14:56:53 +0200 In-Reply-To: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org To: egoitz@ramattack.net References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> X-Mailer: Apple Mail (2.3696.80.82.1.1) X-Haraka-GeoIP: EU, CH, 451km X-Haraka-ASN: 24951 X-Haraka-GeoIP-Received: 217.71.83.52:CH X-Haraka-ASN: 24951 217.71.80.0/20 X-Haraka-ASN-CYMRU: asn=24951 net=217.71.80.0/20 country=CH assignor=ripencc date=2003-08-07 X-Haraka-FCrDNS: 217-071-083-052.ip-tech.ch X-Haraka-p0f: os="Mac OS X " link_type="DSL" distance=16 total_conn=4 shared_ip=N X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.2 required=5.0 tests=ALL_TRUSTED,BAYES_00, HTML_MESSAGE,SPF_HELO_NONE,SPF_SOFTFAIL,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 21448, bad: 624, connections: 23952, history: 20824, asn_score: 292, asn_connections: 310, asn_good: 292, asn_bad: 0, pass:asn, asn_all_good, relaying X-Rspamd-Queue-Id: 4KYPfq0Vp5z54ZK X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of rainer@ultra-secure.de designates 88.198.71.201 as permitted sender) smtp.mailfrom=rainer@ultra-secure.de X-Spamd-Result: default: False [-2.41 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.92)[-0.917]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[ultra-secure.de]; NEURAL_HAM_LONG(-0.99)[-0.990]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.80)[-0.798]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:24940, ipnet:88.198.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_BC042E58-8575-4525-A55E-47AA4EF4E371 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net: >=20 > I don't really know if, perhaps the QVO technology could be the guilty = here.... because... they say are desktop computers disks... but later. Yeah, they are. Most likely, they don=E2=80=99t have some sort of super-cap. A power-failure might totally toast the filesystem. These disks are - IMO - designed to accelerate read-operations. Their = sustained write-performance is usually mediocre, at best. They might work well for small data-sets - because that is really = written to some cache and the firmware just claims it=E2=80=99s = =E2=80=9Ewritten=E2=80=9C, but once the data-set becomes big enough, = they are about as fast as a fast SATA-disk. https://www.tomshardware.com/reviews/samsung-970-evo-plus-ssd,5608.html --Apple-Mail=_BC042E58-8575-4525-A55E-47AA4EF4E371 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8

Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net:

I don't really know if, perhaps the QVO technology could be = the guilty here.... because... they say are desktop computers disks... = but later.


Yeah, they = are.

Most = likely, they don=E2=80=99t have some sort of super-cap.

A power-failure might = totally toast the filesystem.

These disks are - IMO -  designed = to accelerate read-operations. Their sustained write-performance is = usually mediocre, at best.

They might work well for small data-sets - because that is = really written to some cache and the firmware just claims it=E2=80=99s = =E2=80=9Ewritten=E2=80=9C, but once the data-set becomes big enough, = they are about as fast as a fast SATA-disk.

https://www.tomshardware.com/reviews/samsung-970-evo-plus-ssd,5= 608.html


= --Apple-Mail=_BC042E58-8575-4525-A55E-47AA4EF4E371-- From nobody Wed Apr 6 13:22:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3A3F01A830D1 for ; Wed, 6 Apr 2022 13:22:13 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.133.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYQCm3vLvz57j9 for ; Wed, 6 Apr 2022 13:22:12 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-654-5uqdydDQO1OS_r7586L3Pw-1; Wed, 06 Apr 2022 09:22:03 -0400 X-MC-Unique: 5uqdydDQO1OS_r7586L3Pw-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Wed, 6 Apr 2022 09:22:02 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Wed, 6 Apr 2022 09:22:02 -0400 From: "Michael Jung (USER)" To: freebsd-fs Subject: DRAID - Expansion and other issues Thread-Topic: DRAID - Expansion and other issues Thread-Index: AdhJtcngdXkAOXWiT1GRYc8ck+wOog== Date: Wed, 6 Apr 2022 13:22:01 +0000 Message-ID: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_f42afbe959104522952f3eb57fa5f865MAILHUBpailocal_" X-Rspamd-Queue-Id: 4KYQCm3vLvz57j9 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.133.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.90 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.133.197:from]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_f42afbe959104522952f3eb57fa5f865MAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi! I started playing with draid some months ago and I have a problem I cannot = figure out. I started out with a single draid2:2d:10c:0s and life was good. Ran some t= ests, added a special device and life was better. Then I expanded the pool by adding an= other draid2:2d:10c:0s. Now the problem: the pool says it has ~18TB worth of spa= ce, the file system only shows ~9TB. It did not auto-expand. I'm currently on main-n253875-8e72f458c6d: but I initially spun this up jus= t after DRAID was brought Into the tree, at least when I became aware of it. I have= tried individually on lining devices in the pool with "-e", exporting/importing t= he pool etc. and basically every suggestion my "google foo" would lead me to. I have no useful data on this pool and I can destroy and re-create it but I= would like to save some time and get opinions or fact on: Can a draid pool be expanded after a special device has been added? It wou= ld seem so but the filesystem does not reflect that.? What at is the correct way to wire down the following - I had problems afte= r not doing this since the 2.x days and would really want to wire down my draid devices= now that I have other pools. I have pool construction all scripted but of course I want physical disk da= to always be consistent. Then I easily test any construct someone comes up with. root@draid:/home/mikej # camcontrol devlist -b scbus0 on ata0 bus 0 scbus1 on ata1 bus 0 scbus2 on mpt0 bus 0 scbus3 on mps0 bus 0 <-- scbus4 on camsim0 bus 0 scbus-1 on xpt0 bus 0 root@draid:/home/mikej # mps0: port 0x5000-0x50ff mem 0xfd4fc000-= 0xfd4fffff,0xfd480000-0xfd4bffff irq 19 at device 0.0 on pci4 mps0: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd mps0: IOCCapabilities: 1285c at scbus3 target 63 lun 0 (da42,pass35) at scbus3 target 67 lun 0 (da46,pass39) at scbus3 target 68 lun 0 (da47,pass40) EXAMPLE: Is this correct? hint.scbus.3.at=3D"mps0" hint.da.42.at=3D"scbus3" hint.da.42.target=3D"63" hint.da.42.unit=3D"0" hint.da.46.at=3D"scbus3" hint.da.46.target=3D"67" hint.da.46.unit=3D"0" hint.da.47.at=3D"scbus3" hint.da.47.target=3D"68" hint.da.47.unit=3D"0" I will try again, but this did not seem to work for me. This is my home la= b but it's now painful to spin down this host as it's a iSCSI target for several machi= nes for a ESXi project I'm working on so I would like to put wired down SCSI devices = to rest. And yes, I have scheduled VM backups for my project to another data store t= hat is not this box ;-) It's also odd, that I did not get all GPT labels in the zpool. All disks ha= ve GPT labels. I have added for the next reboot to loader.conf. kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"1 This is an old Dell MD-1000 shelf I had laying around with a bunch of 1TB d= rives which I thought would be perfect for playing around with draid. mikej@draid:~ $ zpool get all tank | grep expand tank autoexpand on local tank expandsize - - mikej@draid:~ $ zpool list -v tank NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP D= EDUP HEALTH ALTROOT tank 18.5T 8.02T 10.4T - - 0% 43% 1= .00x ONLINE - draid2:2d:10c:0s-0 9.03T 4.06T 4.97T - - 0% 44.9% = - ONLINE gpt/da0p1 - - - - - - - = - ONLINE gpt/d10p1 - - - - - - - = - ONLINE da39p1 - - - - - - - = - ONLINE da40p1 - - - - - - - = - ONLINE da41p1 - - - - - - - = - ONLINE da43p1 - - - - - - - = - ONLINE da44p1 - - - - - - - = - ONLINE da42p1 - - - - - - - = - ONLINE da45p1 - - - - - - - = - ONLINE gpt/d19p1 - - - - - - - = - ONLINE draid2:2d:10c:0s-1 9.03T 3.96T 5.07T - - 0% 43.8% = - ONLINE da46p1 - - - - - - - = - ONLINE gpt/d11p1 - - - - - - - = - ONLINE gpt/d12p1 - - - - - - - = - ONLINE gpt/d13p1 - - - - - - - = - ONLINE gpt/d14p1 - - - - - - - = - ONLINE gpt/d15p1 - - - - - - - = - ONLINE gpt/d16p1 - - - - - - - = - ONLINE gpt/d17p1 - - - - - - - = - ONLINE gpt/d18p1 - - - - - - - = - ONLINE da18p1 - - - - - - - = - ONLINE special - - - - - - - = - - mirror-3 398G 2.86G 395G - - 0% 0.71% = - ONLINE gpt/special0 - - - - - - - = - ONLINE gpt/special1 - - - - - - - = - ONLINE logs - - - - - - - = - - mirror-2 15.5G 256K 15.5G - - 0% 0.00% = - ONLINE gpt/slog0 - - - - - - - = - ONLINE gpt/slog1 - - - - - - - = - ONLINE mikej@draid:~ $ zfs get mountpoint tank NAME PROPERTY VALUE SOURCE tank mountpoint /tank default mikej@draid:~ $ df /tank Filesystem 1K-blocks Used Avail Capacity Mounted on tank 9558892004 4301310224 5257581780 45% /tank <-- ~9TB not = 18TB mikej@draid:~ $ mikej@draid:~ $ zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT ccache 9.50G 9.10G 406M - - 89% 95% 1.00x = ONLINE - raid-5400-1 6.28T 1.19T 5.09T - - 6% 19% 1.00x = ONLINE - tank 18.5T 8.02T 10.4T - - 0% 43% 1.00x = ONLINE - <-- zfsroot 103G 32.6G 70.4G - - 25% 31% 1.00x = ONLINE - mikej@draid:~ $ Thanks in advance for any comments or sugesstions. --mikej CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, 2101 High Wickham Place, Suite 101, Louisville, KY 40245 Disclaimer The information contained in this communication from the sender is confiden= tial. It is intended solely for use by the recipient and others authorized = to receive it. If you are not the recipient, you are hereby notified that a= ny disclosure, copying, distribution or taking action in relation of the co= ntents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been auto= matically archived by Mimecast, a leader in email security and cyber resili= ence. Mimecast integrates email defenses with brand protection, security aw= areness training, web security, compliance and other essential capabilities= . Mimecast helps protect large and small organizations from malicious activ= ity, human error and technology failure; and to lead the movement toward bu= ilding a more resilient world. To find out more, visit our website. --_000_f42afbe959104522952f3eb57fa5f865MAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <= /head>

Hi!

 

I started playing with draid some months ago and I have a p= roblem I cannot figure out.

 

I started out with a single draid2:2d:10c:0s and life was g= ood.  Ran some tests, added

a special device and life was better. Then I expanded the p= ool by adding another

draid2:2d:10c:0s.  Now the problem: the pool says it h= as ~18TB worth of space, the

file system only shows ~9TB. It did not auto-expand.

 

I’m currently on main-n253875-8e72f458c6d: but I init= ially spun this up just after

DRAID was brought Into the tree, at least when I became awa= re of it. I have tried

individually on lining devices in the pool with “-e&#= 8221;, exporting/importing the pool etc.

and basically every suggestion my “google foo” = would lead me to.

 

I have no useful data on this pool and I can destroy and re= -create it but I would

like to save some time and get opinions or fact on:

 

Can a draid pool be expanded after a special device has bee= n added?  It would seem so

but the filesystem does not reflect that.?

 

What at is the correct way to wire down the following ̵= 1; I had problems after not doing

this since the 2.x days and would really want to wire down = my draid devices now

that I have other pools. 

 

I have pool construction all scripted but of course I want = physical disk da<x> to always be

consistent. Then I easily test any construct someone comes = up with.

 

root@draid:/home/mikej # camcontrol devlist -b

scbus0 on ata0 bus 0

scbus1 on ata1 bus 0

scbus2 on mpt0 bus 0

scbus3 on mps0 bus 0   ß=

scbus4 on camsim0 bus 0

scbus-1 on xpt0 bus 0

root@draid:/home/mikej #

 

 

<dmesg>

mps0: <Avago Technologies (LSI) SAS2008> port 0x5000-= 0x50ff mem 0xfd4fc000-0xfd4fffff,0xfd480000-0xfd4bffff irq 19 at device 0.0= on pci4

mps0: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd<= /o:p>

mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,Snap= Buf,EEDP,TransRetry,EventReplay,HostDisc>

 

<camcontrol>

<SEAGATE ST91000640SS AS09>    &n= bsp;   at scbus3 target 63 lun 0 (da42,pass35)<= /p>

<SEAGATE ST91000640SS AS09>    &n= bsp;   at scbus3 target 67 lun 0 (da46,pass39)<= /p>

<SEAGATE ST91000640SS AS08>    &n= bsp;   at scbus3 target 68 lun 0 (da47,pass40)<= /p>

 

EXAMPLE: Is this correct?

 

hint.scbus.3.at=3D”mps0”

 

hint.da.42.at=3D”scbus3”

hint.da.42.target=3D”63”

hint.da.42.unit=3D”0”

 

hint.da.46.at=3D”scbus3”

hint.da.46.target=3D”67”

hint.da.46.unit=3D”0”

 

hint.da.47.at=3D”scbus3”

hint.da.47.target=3D”68”

hint.da.47.unit=3D”0"

 

I will try again, but this did not seem to work for me.&nbs= p; This is my home lab but it’s

now painful to spin down this host as it’s a iSCSI ta= rget for several machines for a

ESXi project I’m working on so I would like to put wi= red down SCSI devices to rest.

 

And yes, I have scheduled VM backups for my project to anot= her data store that is not

this box ;-)

 

It’s also odd, that I did not get all GPT labels in t= he zpool. All disks have GPT labels. 

 

I have added for the next reboot to loader.conf. 

 

kern.geom.label.disk_ident.enable=3D"0"

kern.geom.label.gptid.enable=3D"1

 

This is an old Dell MD-1000 shelf I had laying around with = a bunch of 1TB drives

which I thought would be perfect for playing around with dr= aid.

 

mikej@draid:~ $ zpool get all tank | grep expand=

tank  autoexpand      &n= bsp;            = ;  on           = ;            &n= bsp;     local

tank  expandsize      &n= bsp;            = ;  -           =             &nb= sp;      -

mikej@draid:~ $ zpool list -v tank

NAME         &= nbsp;       SIZE  ALLOC   FREE=   CKPOINT  EXPANDSZ   FRAG    CAP  = DEDUP    HEALTH  ALTROOT

tank         &= nbsp;      18.5T  8.02T  10.4T &nbs= p;      -       = ;  -     0%    43%  1.00x = ;   ONLINE  -

  draid2:2d:10c:0s-0  9.03T  4.06T  4.9= 7T        -     = ;    -     0%  44.9%  &nb= sp;   -    ONLINE

    gpt/da0p1     &= nbsp;     -      -  =     -        -  &nbs= p;      -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d10p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    da39p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da40p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da41p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da43p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da44p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da42p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

    da45p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -    &n= bsp; -      -      -=     ONLINE

    gpt/d19p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

  draid2:2d:10c:0s-1  9.03T  3.96T  5.0= 7T        -     = ;    -     0%  43.8%  &nb= sp;   -    ONLINE

    da46p1     &nbs= p;        -     = ; -      -       &nb= sp;-         -   &nb= sp;  -      -      -=     ONLINE

    gpt/d11p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d12p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d13p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d14p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d15p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d16p1      =      -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d17p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/d18p1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    da18p1     &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=     ONLINE

special        &nbs= p;        -     = ; -      -      &nbs= p; -         -   &nb= sp;  -      -      -=          -

  mirror-3       &n= bsp;   398G  2.86G   395G    &= nbsp;   -         - =     0%  0.71%      -  &nb= sp; ONLINE

    gpt/special0    &nbs= p;   -      -    &nb= sp; -        -    &n= bsp;    -      -   &= nbsp;  -      -    ONLINE=

    gpt/special1    &nbs= p;   -      -    &nb= sp; -        -    &n= bsp;    -      -   &= nbsp;  -      -    ONLINE=

logs         &= nbsp;          -  &n= bsp;   -      -    &= nbsp;   -         - =      -      -   = ;   -         -

  mirror-2       &n= bsp;  15.5G   256K  15.5G     =    -         -  = ;   0%  0.00%      -  &nb= sp; ONLINE

    gpt/slog0     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

    gpt/slog1     &= nbsp;     -      -  =     -        -  = ;       -      -&nbs= p;     -      -  &nb= sp; ONLINE

 

mikej@draid:~ $ zfs get mountpoint tank

NAME  PROPERTY    VALUE  &nbs= p;    SOURCE

tank  mountpoint  /tank    &n= bsp;  default

 

 

mikej@draid:~ $ df /tank

Filesystem  1K-blocks     &nb= sp; Used      Avail Capacity  Mounted on=

tank       9558892004 4301310= 224 5257581780    45%    /tank   ß= ~9TB n= ot 18TB

mikej@draid:~ $

 

mikej@draid:~ $ zpool list

NAME          = SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   = FRAG    CAP  DEDUP    HEALTH  ALTRO= OT

ccache       9.50G  9.10= G   406M        -  &= nbsp;      -    89%  &nbs= p; 95%  1.00x    ONLINE  -

raid-5400-1  6.28T  1.19T  5.09T  =       -       &= nbsp; -     6%    19%  1.00x &= nbsp;  ONLINE  -

tank         18.5T&= nbsp; 8.02T  10.4T        - &n= bsp;       -     0% =    43%  1.00x    ONLINE  -  &n= bsp;        ß=

zfsroot       103G  32.6= G  70.4G        -   =       -    25%    31= %  1.00x    ONLINE  -

mikej@draid:~ $

 

Thanks in advance for any comments or sugesstions.

 

--mikej

 

 

 

CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245





<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--_000_f42afbe959104522952f3eb57fa5f865MAILHUBpailocal_-- From nobody Wed Apr 6 14:05:22 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1D9121A8DDA8 for ; Wed, 6 Apr 2022 14:05:28 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.133.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYR9g2Kldz3JSR for ; Wed, 6 Apr 2022 14:05:27 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-132-jqvxHfgfM7-ttHw3C0eUzA-1; Wed, 06 Apr 2022 10:05:23 -0400 X-MC-Unique: jqvxHfgfM7-ttHw3C0eUzA-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Wed, 6 Apr 2022 10:05:22 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Wed, 6 Apr 2022 10:05:22 -0400 From: "Michael Jung (USER)" To: Rich , freebsd-fs Subject: RE: DRAID - Expansion and other issues Thread-Topic: DRAID - Expansion and other issues Thread-Index: AdhJtcngdXkAOXWiT1GRYc8ck+wOogAJ+eAAAAfTtHA= Date: Wed, 6 Apr 2022 14:05:22 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_fe01e1eebc4f46c58e6732b89781221bMAILHUBpailocal_" X-Rspamd-Queue-Id: 4KYR9g2Kldz3JSR X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.133.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-1.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.989]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; NEURAL_HAM_LONG(-0.96)[-0.957]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_SPAM_SHORT(0.97)[0.973]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.133.197:from]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_fe01e1eebc4f46c58e6732b89781221bMAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 VGhhbmtzIFJpY2guDQoNCkkgaGVhciB3aGF0IHlvdSBhcmUgc2F5aW5nLCBidXQgSSBhZGRlZCB0 aGVtIGxpa2UgeW91IHdvdWxkIGFkZCBhIHNlY29uZCB2ZGV2IHRvIGEgcmFpZHoxL3oyIHBvb2wu IE5vbmUgb2YgdGhlIG9ubGluZSB0YWxrcyBub3IgZG9jdW1lbnRhdGlvbiBtZW50aW9uIGRyYWlk IGV4cGFuc2lvbiwgYW5kIEkgd2FzIHVuZGVyIHRoZSBpbXByZXNzaW9uIHRoYXQgeW91IGNvdWxk IG5vdCBleHBhbmQgYSBkcmFpZDI6MmQ6MTBjOjBzIHRvIGRyYWlkMjoyZDoyMGM6MHMgZm9yIGV4 YW1wbGUuDQoNCkkgYWJzb2x1dGVseSBjb3VsZCBiZSB3cm9uZyBpbiBteSBhc3N1bXB0aW9uIGJ1 dCBkbyBub3Qgc2VlIGhvdyB0byBkbyB0aGUgZXhwYW5zaW9uIG90aGVyIHRoYW4gaG93IEkgZGlk IGl0Lg0KDQotLW1pa2VqDQoNCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tDQoNCkkn bSBub3QgYW4gZXhwZXJ0IG9uIGRyYWlkLCBidXQgeW91IGFwcGVhciB0byBoYXZlIGRlZmluZWQg dHdvIGRyYWlkIHZkZXZzIHdpdGggYSByYXRpbyBvZiAyIGRhdGEgZGlza3MgdG8gMiBwYXJpdHkg ZGlza3MgZm9yIHRoZSBpbnRlcm5hbCAicmVkdW5kYW5jeSBncm91cHMiLCBzbyA1MCUgb3Zlcmhl YWQgc2VlbXMgcGFyIGZvciB0aGUgY291cnNlLCBtdWNoIGxpa2UgaWYgeW91IGhhZCBkZWZpbmVk IDQtZGlzayByYWlkejIgdmRldnMuDQoNCi0gUmljaA0KDQpPbiBXZWQsIEFwciA2LCAyMDIyIGF0 IDk6MjIgQU0gTWljaGFlbCBKdW5nIChVU0VSKSA8bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5j b208bWFpbHRvOm1pa2VqQHBheW1lbnRhbGxpYW5jZWludGwuY29tPj4gd3JvdGU6DQpIaSENCg0K SSBzdGFydGVkIHBsYXlpbmcgd2l0aCBkcmFpZCBzb21lIG1vbnRocyBhZ28gYW5kIEkgaGF2ZSBh IHByb2JsZW0gSSBjYW5ub3QgZmlndXJlIG91dC4NCg0KSSBzdGFydGVkIG91dCB3aXRoIGEgc2lu Z2xlIGRyYWlkMjoyZDoxMGM6MHMgYW5kIGxpZmUgd2FzIGdvb2QuICBSYW4gc29tZSB0ZXN0cywg YWRkZWQNCmEgc3BlY2lhbCBkZXZpY2UgYW5kIGxpZmUgd2FzIGJldHRlci4gVGhlbiBJIGV4cGFu ZGVkIHRoZSBwb29sIGJ5IGFkZGluZyBhbm90aGVyDQpkcmFpZDI6MmQ6MTBjOjBzLiAgTm93IHRo ZSBwcm9ibGVtOiB0aGUgcG9vbCBzYXlzIGl0IGhhcyB+MThUQiB3b3J0aCBvZiBzcGFjZSwgdGhl DQpmaWxlIHN5c3RlbSBvbmx5IHNob3dzIH45VEIuIEl0IGRpZCBub3QgYXV0by1leHBhbmQuDQoN CknigJltIGN1cnJlbnRseSBvbiBtYWluLW4yNTM4NzUtOGU3MmY0NThjNmQ6IGJ1dCBJIGluaXRp YWxseSBzcHVuIHRoaXMgdXAganVzdCBhZnRlcg0KRFJBSUQgd2FzIGJyb3VnaHQgSW50byB0aGUg dHJlZSwgYXQgbGVhc3Qgd2hlbiBJIGJlY2FtZSBhd2FyZSBvZiBpdC4gSSBoYXZlIHRyaWVkDQpp bmRpdmlkdWFsbHkgb24gbGluaW5nIGRldmljZXMgaW4gdGhlIHBvb2wgd2l0aCDigJwtZeKAnSwg ZXhwb3J0aW5nL2ltcG9ydGluZyB0aGUgcG9vbCBldGMuDQphbmQgYmFzaWNhbGx5IGV2ZXJ5IHN1 Z2dlc3Rpb24gbXkg4oCcZ29vZ2xlIGZvb+KAnSB3b3VsZCBsZWFkIG1lIHRvLg0KDQpJIGhhdmUg bm8gdXNlZnVsIGRhdGEgb24gdGhpcyBwb29sIGFuZCBJIGNhbiBkZXN0cm95IGFuZCByZS1jcmVh dGUgaXQgYnV0IEkgd291bGQNCmxpa2UgdG8gc2F2ZSBzb21lIHRpbWUgYW5kIGdldCBvcGluaW9u cyBvciBmYWN0IG9uOg0KDQpDYW4gYSBkcmFpZCBwb29sIGJlIGV4cGFuZGVkIGFmdGVyIGEgc3Bl Y2lhbCBkZXZpY2UgaGFzIGJlZW4gYWRkZWQ/ICBJdCB3b3VsZCBzZWVtIHNvDQpidXQgdGhlIGZp bGVzeXN0ZW0gZG9lcyBub3QgcmVmbGVjdCB0aGF0Lj8NCg0KV2hhdCBhdCBpcyB0aGUgY29ycmVj dCB3YXkgdG8gd2lyZSBkb3duIHRoZSBmb2xsb3dpbmcg4oCTIEkgaGFkIHByb2JsZW1zIGFmdGVy IG5vdCBkb2luZw0KdGhpcyBzaW5jZSB0aGUgMi54IGRheXMgYW5kIHdvdWxkIHJlYWxseSB3YW50 IHRvIHdpcmUgZG93biBteSBkcmFpZCBkZXZpY2VzIG5vdw0KdGhhdCBJIGhhdmUgb3RoZXIgcG9v bHMuDQoNCkkgaGF2ZSBwb29sIGNvbnN0cnVjdGlvbiBhbGwgc2NyaXB0ZWQgYnV0IG9mIGNvdXJz ZSBJIHdhbnQgcGh5c2ljYWwgZGlzayBkYTx4PiB0byBhbHdheXMgYmUNCmNvbnNpc3RlbnQuIFRo ZW4gSSBlYXNpbHkgdGVzdCBhbnkgY29uc3RydWN0IHNvbWVvbmUgY29tZXMgdXAgd2l0aC4NCg0K cm9vdEBkcmFpZDovaG9tZS9taWtlaiAjIGNhbWNvbnRyb2wgZGV2bGlzdCAtYg0Kc2NidXMwIG9u IGF0YTAgYnVzIDANCnNjYnVzMSBvbiBhdGExIGJ1cyAwDQpzY2J1czIgb24gbXB0MCBidXMgMA0K c2NidXMzIG9uIG1wczAgYnVzIDAgICA8LS0NCnNjYnVzNCBvbiBjYW1zaW0wIGJ1cyAwDQpzY2J1 cy0xIG9uIHhwdDAgYnVzIDANCnJvb3RAZHJhaWQ6L2hvbWUvbWlrZWogIw0KDQoNCjxkbWVzZz4N Cm1wczA6IDxBdmFnbyBUZWNobm9sb2dpZXMgKExTSSkgU0FTMjAwOD4gcG9ydCAweDUwMDAtMHg1 MGZmIG1lbSAweGZkNGZjMDAwLTB4ZmQ0ZmZmZmYsMHhmZDQ4MDAwMC0weGZkNGJmZmZmIGlycSAx OSBhdCBkZXZpY2UgMC4wIG9uIHBjaTQNCm1wczA6IEZpcm13YXJlOiAyMC4wMC4wNC4wMCwgRHJp dmVyOiAyMS4wMi4wMC4wMC1mYnNkDQptcHMwOiBJT0NDYXBhYmlsaXRpZXM6IDEyODVjPFNjc2lU YXNrRnVsbCxEaWFnVHJhY2UsU25hcEJ1ZixFRURQLFRyYW5zUmV0cnksRXZlbnRSZXBsYXksSG9z dERpc2M+DQoNCjxjYW1jb250cm9sPg0KPFNFQUdBVEUgU1Q5MTAwMDY0MFNTIEFTMDk+ICAgICAg ICBhdCBzY2J1czMgdGFyZ2V0IDYzIGx1biAwIChkYTQyLHBhc3MzNSkNCjxTRUFHQVRFIFNUOTEw MDA2NDBTUyBBUzA5PiAgICAgICAgYXQgc2NidXMzIHRhcmdldCA2NyBsdW4gMCAoZGE0NixwYXNz MzkpDQo8U0VBR0FURSBTVDkxMDAwNjQwU1MgQVMwOD4gICAgICAgIGF0IHNjYnVzMyB0YXJnZXQg NjggbHVuIDAgKGRhNDcscGFzczQwKQ0KDQpFWEFNUExFOiBJcyB0aGlzIGNvcnJlY3Q/DQoNCmhp bnQuc2NidXMuMy5hdDxodHRwOi8vaGludC5zY2J1cy4zLmF0Pj3igJ1tcHMw4oCdDQoNCmhpbnQu ZGEuNDIuYXQ8aHR0cDovL2hpbnQuZGEuNDIuYXQ+PeKAnXNjYnVzM+KAnQ0KaGludC5kYS40Mi50 YXJnZXQ94oCdNjPigJ0NCmhpbnQuZGEuNDIudW5pdD3igJ0w4oCdDQoNCmhpbnQuZGEuNDYuYXQ8 aHR0cDovL2hpbnQuZGEuNDYuYXQ+PeKAnXNjYnVzM+KAnQ0KaGludC5kYS40Ni50YXJnZXQ94oCd NjfigJ0NCmhpbnQuZGEuNDYudW5pdD3igJ0w4oCdDQoNCmhpbnQuZGEuNDcuYXQ8aHR0cDovL2hp bnQuZGEuNDcuYXQ+PeKAnXNjYnVzM+KAnQ0KaGludC5kYS40Ny50YXJnZXQ94oCdNjjigJ0NCmhp bnQuZGEuNDcudW5pdD3igJ0wIg0KDQpJIHdpbGwgdHJ5IGFnYWluLCBidXQgdGhpcyBkaWQgbm90 IHNlZW0gdG8gd29yayBmb3IgbWUuICBUaGlzIGlzIG15IGhvbWUgbGFiIGJ1dCBpdOKAmXMNCm5v dyBwYWluZnVsIHRvIHNwaW4gZG93biB0aGlzIGhvc3QgYXMgaXTigJlzIGEgaVNDU0kgdGFyZ2V0 IGZvciBzZXZlcmFsIG1hY2hpbmVzIGZvciBhDQpFU1hpIHByb2plY3QgSeKAmW0gd29ya2luZyBv biBzbyBJIHdvdWxkIGxpa2UgdG8gcHV0IHdpcmVkIGRvd24gU0NTSSBkZXZpY2VzIHRvIHJlc3Qu DQoNCkFuZCB5ZXMsIEkgaGF2ZSBzY2hlZHVsZWQgVk0gYmFja3VwcyBmb3IgbXkgcHJvamVjdCB0 byBhbm90aGVyIGRhdGEgc3RvcmUgdGhhdCBpcyBub3QNCnRoaXMgYm94IDstKQ0KDQpJdOKAmXMg YWxzbyBvZGQsIHRoYXQgSSBkaWQgbm90IGdldCBhbGwgR1BUIGxhYmVscyBpbiB0aGUgenBvb2wu IEFsbCBkaXNrcyBoYXZlIEdQVCBsYWJlbHMuDQoNCkkgaGF2ZSBhZGRlZCBmb3IgdGhlIG5leHQg cmVib290IHRvIGxvYWRlci5jb25mLg0KDQprZXJuLmdlb20ubGFiZWwuZGlza19pZGVudC5lbmFi bGU9IjAiDQprZXJuLmdlb20ubGFiZWwuZ3B0aWQuZW5hYmxlPSIxDQoNClRoaXMgaXMgYW4gb2xk IERlbGwgTUQtMTAwMCBzaGVsZiBJIGhhZCBsYXlpbmcgYXJvdW5kIHdpdGggYSBidW5jaCBvZiAx VEIgZHJpdmVzDQp3aGljaCBJIHRob3VnaHQgd291bGQgYmUgcGVyZmVjdCBmb3IgcGxheWluZyBh cm91bmQgd2l0aCBkcmFpZC4NCg0KbWlrZWpAZHJhaWQ6fiAkIHpwb29sIGdldCBhbGwgdGFuayB8 IGdyZXAgZXhwYW5kDQp0YW5rICBhdXRvZXhwYW5kICAgICAgICAgICAgICAgICAgICAgb24gICAg ICAgICAgICAgICAgICAgICAgICAgICAgIGxvY2FsDQp0YW5rICBleHBhbmRzaXplICAgICAgICAg ICAgICAgICAgICAgLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0NCm1pa2VqQGRyYWlk On4gJCB6cG9vbCBsaXN0IC12IHRhbmsNCk5BTUUgICAgICAgICAgICAgICAgIFNJWkUgIEFMTE9D ICAgRlJFRSAgQ0tQT0lOVCAgRVhQQU5EU1ogICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRI ICBBTFRST09UDQp0YW5rICAgICAgICAgICAgICAgIDE4LjVUICA4LjAyVCAgMTAuNFQgICAgICAg IC0gICAgICAgICAtICAgICAwJSAgICA0MyUgIDEuMDB4ICAgIE9OTElORSAgLQ0KICBkcmFpZDI6 MmQ6MTBjOjBzLTAgIDkuMDNUICA0LjA2VCAgNC45N1QgICAgICAgIC0gICAgICAgICAtICAgICAw JSAgNDQuOSUgICAgICAtICAgIE9OTElORQ0KICAgIGdwdC9kYTBwMSAgICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJ TkUNCiAgICBncHQvZDEwcDEgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGEzOXAxICAgICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGRhNDBwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQx cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0M3AxICAgICAgICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElO RQ0KICAgIGRhNDRwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAg ICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQycDEgICAgICAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg IC0gICAgT05MSU5FDQogICAgZGE0NXAxICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGdwdC9k MTlwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgZHJhaWQyOjJkOjEwYzowcy0xICA5LjAzVCAgMy45 NlQgIDUuMDdUICAgICAgICAtICAgICAgICAgLSAgICAgMCUgIDQzLjglICAgICAgLSAgICBPTkxJ TkUNCiAgICBkYTQ2cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L2QxMXAxICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGdwdC9kMTJwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBncHQv ZDEzcDEgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L2QxNHAxICAgICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElO RQ0KICAgIGdwdC9kMTVwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAg ICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBncHQvZDE2cDEgICAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg IC0gICAgT05MSU5FDQogICAgZ3B0L2QxN3AxICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGdwdC9k MThwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE4cDEgICAgICAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5F DQpzcGVjaWFsICAgICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAgLQ0KICBtaXJyb3ItMyAgICAgICAgICAg Mzk4RyAgMi44NkcgICAzOTVHICAgICAgICAtICAgICAgICAgLSAgICAgMCUgIDAuNzElICAgICAg LSAgICBPTkxJTkUNCiAgICBncHQvc3BlY2lhbDAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg ICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L3Nw ZWNpYWwxICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAg ICAgIC0gICAgICAtICAgIE9OTElORQ0KbG9ncyAgICAgICAgICAgICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgIC0N CiAgbWlycm9yLTIgICAgICAgICAgMTUuNUcgICAyNTZLICAxNS41RyAgICAgICAgLSAgICAgICAg IC0gICAgIDAlICAwLjAwJSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L3Nsb2cwICAgICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAt ICAgIE9OTElORQ0KICAgIGdwdC9zbG9nMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAg ICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCg0KbWlrZWpAZHJh aWQ6fiAkIHpmcyBnZXQgbW91bnRwb2ludCB0YW5rDQpOQU1FICBQUk9QRVJUWSAgICBWQUxVRSAg ICAgICBTT1VSQ0UNCnRhbmsgIG1vdW50cG9pbnQgIC90YW5rICAgICAgIGRlZmF1bHQNCg0KDQpt aWtlakBkcmFpZDp+ICQgZGYgL3RhbmsNCkZpbGVzeXN0ZW0gIDFLLWJsb2NrcyAgICAgICBVc2Vk ICAgICAgQXZhaWwgQ2FwYWNpdHkgIE1vdW50ZWQgb24NCnRhbmsgICAgICAgOTU1ODg5MjAwNCA0 MzAxMzEwMjI0IDUyNTc1ODE3ODAgICAgNDUlICAgIC90YW5rICAgPC0tIH45VEIgbm90IDE4VEIN Cm1pa2VqQGRyYWlkOn4gJA0KDQptaWtlakBkcmFpZDp+ICQgenBvb2wgbGlzdA0KTkFNRSAgICAg ICAgICBTSVpFICBBTExPQyAgIEZSRUUgIENLUE9JTlQgIEVYUEFORFNaICAgRlJBRyAgICBDQVAg IERFRFVQICAgIEhFQUxUSCAgQUxUUk9PVA0KY2NhY2hlICAgICAgIDkuNTBHICA5LjEwRyAgIDQw Nk0gICAgICAgIC0gICAgICAgICAtICAgIDg5JSAgICA5NSUgIDEuMDB4ICAgIE9OTElORSAgLQ0K cmFpZC01NDAwLTEgIDYuMjhUICAxLjE5VCAgNS4wOVQgICAgICAgIC0gICAgICAgICAtICAgICA2 JSAgICAxOSUgIDEuMDB4ICAgIE9OTElORSAgLQ0KdGFuayAgICAgICAgIDE4LjVUICA4LjAyVCAg MTAuNFQgICAgICAgIC0gICAgICAgICAtICAgICAwJSAgICA0MyUgIDEuMDB4ICAgIE9OTElORSAg LSAgICAgICAgICAgPC0tDQp6ZnNyb290ICAgICAgIDEwM0cgIDMyLjZHICA3MC40RyAgICAgICAg LSAgICAgICAgIC0gICAgMjUlICAgIDMxJSAgMS4wMHggICAgT05MSU5FICAtDQptaWtlakBkcmFp ZDp+ICQNCg0KVGhhbmtzIGluIGFkdmFuY2UgZm9yIGFueSBjb21tZW50cyBvciBzdWdlc3N0aW9u cy4NCg0KLS1taWtlag0KDQoNCg0KDQpDT05GSURFTlRJQUxJVFkgTk9URTogVGhpcyBtZXNzYWdl IGlzIGludGVuZGVkIG9ubHkgZm9yIHRoZSB1c2UNCm9mIHRoZSBpbmRpdmlkdWFsIG9yIGVudGl0 eSB0byB3aG9tIGl0IGlzIGFkZHJlc3NlZCBhbmQgbWF5DQpjb250YWluIGluZm9ybWF0aW9uIHRo YXQgaXMgcHJpdmlsZWdlZCwgY29uZmlkZW50aWFsLCBhbmQNCmV4ZW1wdCBmcm9tIGRpc2Nsb3N1 cmUgdW5kZXIgYXBwbGljYWJsZSBsYXcuIElmIHRoZSByZWFkZXINCm9mIHRoaXMgbWVzc2FnZSBp cyBub3QgdGhlIGludGVuZGVkIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkNCm5vdGlmaWVkIHRo YXQgYW55IGRpc3NlbWluYXRpb24sIGRpc3RyaWJ1dGlvbiBvciBjb3B5aW5nDQpvZiB0aGlzIGNv bW11bmljYXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUNCnJlY2VpdmVk IHRoaXMgdHJhbnNtaXNzaW9uIGluIGVycm9yLCBwbGVhc2Ugbm90aWZ5IHVzIGJ5DQp0ZWxlcGhv bmUgYXQgKDUwMikgMjEyLTQwMDAgb3Igbm90aWZ5IHVzIGF0OiBQQUksIERlcHQuIDk5LA0KMjEw MSBIaWdoIFdpY2toYW0gUGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kgNDAyNDUNCg0K DQoNCg0KRGlzY2xhaW1lcg0KDQpUaGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29t bXVuaWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRl ZCBzb2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0 byByZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVi eSBub3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3Ig dGFraW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1h dGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQoNClRoaXMg ZW1haWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBo YXZlIGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4g ZW1haWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMg ZW1haWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3Mg dHJhaW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNh cGFiaWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5p emF0aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xv Z3kgZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1v cmUgcmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4N Cg0KRGlzY2xhaW1lcg0KDQpUaGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29tbXVu aWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBz b2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byBy ZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBu b3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFr aW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlv biBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQoNClRoaXMgZW1h aWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBoYXZl IGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4gZW1h aWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMgZW1h aWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3MgdHJh aW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFi aWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0 aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kg ZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUg cmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4NCg== --_000_fe01e1eebc4f46c58e6732b89781221bMAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+DQo8bWV0YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRl eHQvaHRtbDsgY2hhcnNldD11dGYtOCI+DQo8bWV0YSBuYW1lPSJHZW5lcmF0b3IiIGNvbnRlbnQ9 Ik1pY3Jvc29mdCBXb3JkIDE1IChmaWx0ZXJlZCBtZWRpdW0pIj4NCjxzdHlsZT48IS0tDQovKiBG b250IERlZmluaXRpb25zICovDQpAZm9udC1mYWNlDQoJe2ZvbnQtZmFtaWx5OldpbmdkaW5nczsN CglwYW5vc2UtMTo1IDAgMCAwIDAgMCAwIDAgMCAwO30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1p bHk6IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9u dC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJcGFub3NlLTE6MiAxNSA1IDIgMiAyIDQg MyAyIDQ7fQ0KQGZvbnQtZmFjZQ0KCXtmb250LWZhbWlseTpWZXJkYW5hOw0KCXBhbm9zZS0xOjIg MTEgNiA0IDMgNSA0IDQgMiA0O30NCi8qIFN0eWxlIERlZmluaXRpb25zICovDQpwLk1zb05vcm1h bCwgbGkuTXNvTm9ybWFsLCBkaXYuTXNvTm9ybWFsDQoJe21hcmdpbjowaW47DQoJbWFyZ2luLWJv dHRvbTouMDAwMXB0Ow0KCWZvbnQtc2l6ZToxMi4wcHQ7DQoJZm9udC1mYW1pbHk6IlRpbWVzIE5l dyBSb21hbiIsc2VyaWY7fQ0KYTpsaW5rLCBzcGFuLk1zb0h5cGVybGluaw0KCXttc28tc3R5bGUt cHJpb3JpdHk6OTk7DQoJY29sb3I6Ymx1ZTsNCgl0ZXh0LWRlY29yYXRpb246dW5kZXJsaW5lO30N CmE6dmlzaXRlZCwgc3Bhbi5Nc29IeXBlcmxpbmtGb2xsb3dlZA0KCXttc28tc3R5bGUtcHJpb3Jp dHk6OTk7DQoJY29sb3I6cHVycGxlOw0KCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQ0KcA0K CXttc28tc3R5bGUtcHJpb3JpdHk6OTk7DQoJbXNvLW1hcmdpbi10b3AtYWx0OmF1dG87DQoJbWFy Z2luLXJpZ2h0OjBpbjsNCgltc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0bzsNCgltYXJnaW4tbGVm dDowaW47DQoJZm9udC1zaXplOjEyLjBwdDsNCglmb250LWZhbWlseToiVGltZXMgTmV3IFJvbWFu IixzZXJpZjt9DQpzcGFuLkVtYWlsU3R5bGUxOA0KCXttc28tc3R5bGUtdHlwZTpwZXJzb25hbDsN Cglmb250LWZhbWlseToiQ2FsaWJyaSIsc2Fucy1zZXJpZjsNCgljb2xvcjojMUY0OTdEO30NCnNw YW4uRW1haWxTdHlsZTE5DQoJe21zby1zdHlsZS10eXBlOnBlcnNvbmFsLWNvbXBvc2U7DQoJZm9u dC1mYW1pbHk6IkNhbGlicmkiLHNhbnMtc2VyaWY7DQoJY29sb3I6d2luZG93dGV4dDt9DQouTXNv Q2hwRGVmYXVsdA0KCXttc28tc3R5bGUtdHlwZTpleHBvcnQtb25seTsNCglmb250LWZhbWlseToi Q2FsaWJyaSIsc2Fucy1zZXJpZjt9DQpAcGFnZSBXb3JkU2VjdGlvbjENCgl7c2l6ZTo4LjVpbiAx MS4waW47DQoJbWFyZ2luOjEuMGluIDEuMGluIDEuMGluIDEuMGluO30NCmRpdi5Xb3JkU2VjdGlv bjENCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQ0KLS0+PC9zdHlsZT48IS0tW2lmIGd0ZSBtc28gOV0+ PHhtbD4NCjxvOnNoYXBlZGVmYXVsdHMgdjpleHQ9ImVkaXQiIHNwaWRtYXg9IjEwMjYiIC8+DQo8 L3htbD48IVtlbmRpZl0tLT48IS0tW2lmIGd0ZSBtc28gOV0+PHhtbD4NCjxvOnNoYXBlbGF5b3V0 IHY6ZXh0PSJlZGl0Ij4NCjxvOmlkbWFwIHY6ZXh0PSJlZGl0IiBkYXRhPSIxIiAvPg0KPC9vOnNo YXBlbGF5b3V0PjwveG1sPjwhW2VuZGlmXS0tPg0KPHN0eWxlIHR5cGU9InRleHQvY3NzIj4uc3R5 bGUxIHtmb250LWZhbWlseTogIlRpbWVzIE5ldyBSb21hbiI7fTwvc3R5bGU+PC9oZWFkPjxib2R5 IGxhbmc9IkVOLVVTIiBsaW5rPSJibHVlIiB2bGluaz0icHVycGxlIj4NCjxkaXYgY2xhc3M9Ildv cmRTZWN0aW9uMSI+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXpl OjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5UaGFua3MgUmljaC48 bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij48bzpw PiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5J IGhlYXIgd2hhdCB5b3UgYXJlIHNheWluZywgYnV0IEkgYWRkZWQgdGhlbSBsaWtlIHlvdSB3b3Vs ZCBhZGQgYSBzZWNvbmQgdmRldiB0byBhIHJhaWR6MS96MiBwb29sLiBOb25lIG9mIHRoZSBvbmxp bmUgdGFsa3Mgbm9yIGRvY3VtZW50YXRpb24gbWVudGlvbiBkcmFpZCBleHBhbnNpb24sIGFuZCBJ IHdhcyB1bmRlcg0KIHRoZSBpbXByZXNzaW9uIHRoYXQgeW91IGNvdWxkIG5vdCBleHBhbmQgYSBk cmFpZDI6MmQ6MTBjOjBzIHRvIGRyYWlkMjoyZDoyMGM6MHMgZm9yIGV4YW1wbGUuPG86cD48L286 cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PG86cD4mbmJzcDs8 L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+SSBhYnNvbHV0 ZWx5IGNvdWxkIGJlIHdyb25nIGluIG15IGFzc3VtcHRpb24gYnV0IGRvIG5vdCBzZWUgaG93IHRv IGRvIHRoZSBleHBhbnNpb24gb3RoZXIgdGhhbiBob3cgSSBkaWQgaXQuPG86cD48L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PG86cD4mbmJzcDs8L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+LS1taWtlajxvOnA+PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDs7Y29sb3I6IzFGNDk3 RCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90Oztjb2xvcjojMUY0OTdEIj4tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLTxvOnA+ PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtj b2xvcjojMUY0OTdEIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8ZGl2Pg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+SSdtIG5vdCBhbiBleHBlcnQgb24gZHJhaWQsIGJ1dCB5b3UgYXBwZWFy IHRvIGhhdmUgZGVmaW5lZCB0d28gZHJhaWQgdmRldnMgd2l0aCBhIHJhdGlvIG9mIDIgZGF0YSBk aXNrcyB0byAyIHBhcml0eSBkaXNrcyBmb3IgdGhlIGludGVybmFsICZxdW90O3JlZHVuZGFuY3kg Z3JvdXBzJnF1b3Q7LCBzbyA1MCUgb3ZlcmhlYWQgc2VlbXMgcGFyIGZvciB0aGUgY291cnNlLCBt dWNoIGxpa2UgaWYgeW91IGhhZCBkZWZpbmVkIDQtZGlzaw0KIHJhaWR6MiB2ZGV2cy48bzpwPjwv bzpwPjwvcD4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwv cD4NCjwvZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPi0gUmljaDxvOnA+PC9vOnA+ PC9wPg0KPC9kaXY+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxvOnA+Jm5ic3A7PC9v OnA+PC9wPg0KPGRpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj5PbiBXZWQsIEFwciA2 LCAyMDIyIGF0IDk6MjIgQU0gTWljaGFlbCBKdW5nIChVU0VSKSAmbHQ7PGEgaHJlZj0ibWFpbHRv Om1pa2VqQHBheW1lbnRhbGxpYW5jZWludGwuY29tIj5taWtlakBwYXltZW50YWxsaWFuY2VpbnRs LmNvbTwvYT4mZ3Q7IHdyb3RlOjxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8YmxvY2txdW90ZSBz dHlsZT0iYm9yZGVyOm5vbmU7Ym9yZGVyLWxlZnQ6c29saWQgI0NDQ0NDQyAxLjBwdDtwYWRkaW5n OjBpbiAwaW4gMGluIDYuMHB0O21hcmdpbi1sZWZ0OjQuOHB0O21hcmdpbi1yaWdodDowaW4iPg0K PGRpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkhpITwvc3Bhbj48 bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9z cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5JIHN0 YXJ0ZWQgcGxheWluZyB3aXRoIGRyYWlkIHNvbWUgbW9udGhzIGFnbyBhbmQgSSBoYXZlIGEgcHJv YmxlbSBJIGNhbm5vdCBmaWd1cmUgb3V0Ljwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJn aW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5JIHN0YXJ0ZWQgb3V0IHdpdGggYSBzaW5nbGUg ZHJhaWQyOjJkOjEwYzowcyBhbmQgbGlmZSB3YXMgZ29vZC4mbmJzcDsgUmFuIHNvbWUgdGVzdHMs IGFkZGVkDQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPmEgc3BlY2lhbCBkZXZpY2UgYW5kIGxpZmUgd2FzIGJldHRlci4gVGhlbiBJIGV4cGFu ZGVkIHRoZSBwb29sIGJ5IGFkZGluZyBhbm90aGVyDQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmRyYWlkMjoyZDoxMGM6MHMuJm5ic3A7IE5v dyB0aGUgcHJvYmxlbTogdGhlIHBvb2wgc2F5cyBpdCBoYXMgfjE4VEIgd29ydGggb2Ygc3BhY2Us IHRoZQ0KPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij5maWxlIHN5c3RlbSBvbmx5IHNob3dzIH45VEIuIEl0IGRpZCBub3QgYXV0by1leHBhbmQu PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4m bmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPknigJltIGN1cnJlbnRseSBvbiBtYWluLW4yNTM4NzUtOGU3MmY0NThjNmQ6IGJ1dCBJIGlu aXRpYWxseSBzcHVuIHRoaXMgdXAganVzdCBhZnRlcg0KPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1t YXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQt ZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5EUkFJRCB3YXMgYnJvdWdodCBJbnRvIHRo ZSB0cmVlLCBhdCBsZWFzdCB3aGVuIEkgYmVjYW1lIGF3YXJlIG9mIGl0LiBJIGhhdmUgdHJpZWQN Cjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ aW5kaXZpZHVhbGx5IG9uIGxpbmluZyBkZXZpY2VzIGluIHRoZSBwb29sIHdpdGgg4oCcLWXigJ0s IGV4cG9ydGluZy9pbXBvcnRpbmcgdGhlIHBvb2wgZXRjLjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+YW5kIGJhc2ljYWxseSBldmVyeSBzdWdn ZXN0aW9uIG15IOKAnGdvb2dsZSBmb2/igJ0gd291bGQgbGVhZCBtZSB0by48L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48 bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+SSBoYXZlIG5v IHVzZWZ1bCBkYXRhIG9uIHRoaXMgcG9vbCBhbmQgSSBjYW4gZGVzdHJveSBhbmQgcmUtY3JlYXRl IGl0IGJ1dCBJIHdvdWxkDQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPmxpa2UgdG8gc2F2ZSBzb21lIHRpbWUgYW5kIGdldCBvcGluaW9ucyBv ciBmYWN0IG9uOjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij5DYW4gYSBkcmFpZCBwb29sIGJlIGV4cGFuZGVkIGFmdGVyIGEgc3BlY2lh bCBkZXZpY2UgaGFzIGJlZW4gYWRkZWQ/Jm5ic3A7IEl0IHdvdWxkIHNlZW0gc288L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmJ1dCB0aGUgZmls ZXN5c3RlbSBkb2VzIG5vdCByZWZsZWN0IHRoYXQuPzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxw IGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFy Z2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21z by1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5XaGF0IGF0IGlzIHRoZSBjb3JyZWN0 IHdheSB0byB3aXJlIGRvd24gdGhlIGZvbGxvd2luZyDigJMgSSBoYWQgcHJvYmxlbXMgYWZ0ZXIg bm90IGRvaW5nPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5 bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48 c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3 JnF1b3Q7Ij50aGlzIHNpbmNlIHRoZSAyLnggZGF5cyBhbmQgd291bGQgcmVhbGx5IHdhbnQgdG8g d2lyZSBkb3duIG15IGRyYWlkIGRldmljZXMgbm93DQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRoYXQgSSBoYXZlIG90aGVyIHBvb2xzLiZu YnNwOw0KPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPkkgaGF2ZSBwb29sIGNvbnN0cnVjdGlvbiBhbGwgc2NyaXB0ZWQgYnV0IG9mIGNv dXJzZSBJIHdhbnQgcGh5c2ljYWwgZGlzayBkYSZsdDt4Jmd0OyB0byBhbHdheXMgYmUNCjwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Y29uc2lz dGVudC4gVGhlbiBJIGVhc2lseSB0ZXN0IGFueSBjb25zdHJ1Y3Qgc29tZW9uZSBjb21lcyB1cCB3 aXRoLjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJt c28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90 OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5 bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48 c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3 JnF1b3Q7Ij5yb290QGRyYWlkOi9ob21lL21pa2VqICMgY2FtY29udHJvbCBkZXZsaXN0IC1iPC9z cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5zY2J1 czAgb24gYXRhMCBidXMgMDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+c2NidXMxIG9uIGF0YTEgYnVzIDA8L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnNjYnVzMiBvbiBtcHQwIGJ1cyAwPC9z cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5zY2J1 czMgb24gbXBzMCBidXMgMCZuYnNwOyZuYnNwOw0KPC9zcGFuPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6V2luZ2RpbmdzIj7Dnzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+c2NidXM0IG9uIGNhbXNpbTAgYnVzIDA8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnNj YnVzLTEgb24geHB0MCBidXMgMDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29O b3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1h bHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+cm9vdEBkcmFpZDovaG9tZS9taWtlaiAjPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvO21hcmdpbi1sZWZ0Oi41aW4iPg0KPHNwYW4g c3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90 OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5 bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvO21h cmdpbi1sZWZ0Oi41aW4iPg0KPHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWls eTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1t YXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQt ZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbHQ7ZG1lc2cmZ3Q7PC9zcGFuPjxvOnA+ PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFs dDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXpl OjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5tcHMwOiAmbHQ7QXZh Z28gVGVjaG5vbG9naWVzIChMU0kpIFNBUzIwMDgmZ3Q7IHBvcnQgMHg1MDAwLTB4NTBmZiBtZW0g MHhmZDRmYzAwMC0weGZkNGZmZmZmLDB4ZmQ0ODAwMDAtMHhmZDRiZmZmZiBpcnEgMTkgYXQgZGV2 aWNlDQogMC4wIG9uIHBjaTQ8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPm1wczA6IEZpcm13YXJlOiAyMC4wMC4wNC4wMCwgRHJpdmVyOiAyMS4w Mi4wMC4wMC1mYnNkPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij5tcHMwOiBJT0NDYXBhYmlsaXRpZXM6IDEyODVjJmx0O1Njc2lUYXNrRnVsbCxE aWFnVHJhY2UsU25hcEJ1ZixFRURQLFRyYW5zUmV0cnksRXZlbnRSZXBsYXksSG9zdERpc2MmZ3Q7 PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4m bmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPiZsdDtjYW1jb250cm9sJmd0Ozwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jmx0O1NFQUdBVEUgU1Q5MTAwMDY0MFNTIEFTMDkmZ3Q7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGF0IHNjYnVzMyB0YXJnZXQg NjMgbHVuIDAgKGRhNDIscGFzczM1KTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jmx0O1NFQUdBVEUgU1Q5MTAwMDY0MFNTIEFTMDkmZ3Q7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGF0IHNjYnVzMyB0YXJnZXQg NjcgbHVuIDAgKGRhNDYscGFzczM5KTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jmx0O1NFQUdBVEUgU1Q5MTAwMDY0MFNTIEFTMDgmZ3Q7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGF0IHNjYnVzMyB0YXJnZXQg NjggbHVuIDAgKGRhNDcscGFzczQwKTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t Ym90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5FWEFNUExFOiBJcyB0aGlzIGNvcnJlY3Q/PC9zcGFu PjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4t dG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9u dC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPjxh IGhyZWY9Imh0dHA6Ly9oaW50LnNjYnVzLjMuYXQiIHRhcmdldD0iX2JsYW5rIj5oaW50LnNjYnVz LjMuYXQ8L2E+PeKAnW1wczDigJ08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PGEgaHJlZj0iaHR0cDovL2hpbnQuZGEuNDIuYXQiIHRh cmdldD0iX2JsYW5rIj5oaW50LmRhLjQyLmF0PC9hPj3igJ1zY2J1czPigJ08L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmhpbnQuZGEuNDIudGFy Z2V0PeKAnTYz4oCdPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij5oaW50LmRhLjQyLnVuaXQ94oCdMOKAnTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij48YSBocmVmPSJodHRwOi8vaGlu dC5kYS40Ni5hdCIgdGFyZ2V0PSJfYmxhbmsiPmhpbnQuZGEuNDYuYXQ8L2E+PeKAnXNjYnVzM+KA nTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ aGludC5kYS40Ni50YXJnZXQ94oCdNjfigJ08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmhpbnQuZGEuNDYudW5pdD3igJ0w4oCdPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPjxhIGhy ZWY9Imh0dHA6Ly9oaW50LmRhLjQ3LmF0IiB0YXJnZXQ9Il9ibGFuayI+aGludC5kYS40Ny5hdDwv YT494oCdc2NidXMz4oCdPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij5oaW50LmRhLjQ3LnRhcmdldD3igJ02OOKAnTwvc3Bhbj48bzpwPjwvbzpw PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0 bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+aGludC5kYS40Ny51bml0PeKA nTAmcXVvdDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi IHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0 byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVy IE5ldyZxdW90OyI+SSB3aWxsIHRyeSBhZ2FpbiwgYnV0IHRoaXMgZGlkIG5vdCBzZWVtIHRvIHdv cmsgZm9yIG1lLiZuYnNwOyBUaGlzIGlzIG15IGhvbWUgbGFiIGJ1dCBpdOKAmXM8L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPm5vdyBwYWluZnVs IHRvIHNwaW4gZG93biB0aGlzIGhvc3QgYXMgaXTigJlzIGEgaVNDU0kgdGFyZ2V0IGZvciBzZXZl cmFsIG1hY2hpbmVzIGZvciBhPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05v cm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFs dDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv dXJpZXIgTmV3JnF1b3Q7Ij5FU1hpIHByb2plY3QgSeKAmW0gd29ya2luZyBvbiBzbyBJIHdvdWxk IGxpa2UgdG8gcHV0IHdpcmVkIGRvd24gU0NTSSBkZXZpY2VzIHRvIHJlc3QuPC9zcGFuPjxvOnA+ PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFs dDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXpl OjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+ PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10 b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkFuZCB5ZXMs IEkgaGF2ZSBzY2hlZHVsZWQgVk0gYmFja3VwcyBmb3IgbXkgcHJvamVjdCB0byBhbm90aGVyIGRh dGEgc3RvcmUgdGhhdCBpcyBub3Q8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPnRoaXMgYm94IDstKTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxw IGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFy Z2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21z by1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5JdOKAmXMgYWxzbyBvZGQsIHRoYXQg SSBkaWQgbm90IGdldCBhbGwgR1BUIGxhYmVscyBpbiB0aGUgenBvb2wuIEFsbCBkaXNrcyBoYXZl IEdQVCBsYWJlbHMuJm5ic3A7DQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+SSBoYXZlIGFkZGVkIGZvciB0aGUgbmV4dCByZWJvb3Qg dG8gbG9hZGVyLmNvbmYuJm5ic3A7DQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0 b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2lu LWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWls eTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+a2Vybi5nZW9tLmxhYmVsLmRpc2tfaWRlbnQuZW5h YmxlPSZxdW90OzAmcXVvdDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPmtlcm4uZ2VvbS5sYWJlbC5ncHRpZC5lbmFibGU9JnF1b3Q7MTwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7 PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5U aGlzIGlzIGFuIG9sZCBEZWxsIE1ELTEwMDAgc2hlbGYgSSBoYWQgbGF5aW5nIGFyb3VuZCB3aXRo IGEgYnVuY2ggb2YgMVRCIGRyaXZlcw0KPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij53aGljaCBJIHRob3VnaHQgd291bGQgYmUgcGVyZmVjdCBm b3IgcGxheWluZyBhcm91bmQgd2l0aCBkcmFpZC48L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp bi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkIHpwb29sIGdl dCBhbGwgdGFuayB8IGdyZXAgZXhwYW5kPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij50YW5rJm5ic3A7IGF1dG9leHBhbmQmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgb24mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgbG9jYWw8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRh bmsmbmJzcDsgZXhwYW5kc2l6ZSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC08L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPm1pa2VqQGRyYWlkOn4gJCB6cG9vbCBsaXN0 IC12IHRhbms8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPk5BTUUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgU0laRSZu YnNwOyBBTExPQyZuYnNwOyZuYnNwOyBGUkVFJm5ic3A7IENLUE9JTlQmbmJzcDsgRVhQQU5EU1om bmJzcDsmbmJzcDsgRlJBRyZuYnNwOyZuYnNwOyZuYnNwOyBDQVAmbmJzcDsgREVEVVAmbmJzcDsm bmJzcDsmbmJzcDsgSEVBTFRIJm5ic3A7IEFMVFJPT1Q8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRhbmsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgMTguNVQmbmJzcDsgOC4wMlQmbmJzcDsgMTAuNFQmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDAlJm5ic3A7Jm5i c3A7Jm5ic3A7IDQzJSZuYnNwOyAxLjAweCZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkUmbmJzcDsg LTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7IGRyYWlkMjoyZDoxMGM6MHMtMCZuYnNwOyA5LjAzVCZuYnNwOyA0LjA2VCZuYnNwOyA0 Ljk3VCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgMCUmbmJzcDsgNDQuOSUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0 b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQvZGEwcDEmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSAmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48 bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5i c3A7Jm5ic3A7IGdwdC9kMTBwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05v cm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFs dDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv dXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZGEzOXAxJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJ TkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNv LW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsi PiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQwcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwv bzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6 YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5i c3A7IGRhNDFwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t Ym90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZGE0M3AxJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZu YnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQ0cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7 Jm5ic3A7Jm5ic3A7IGRhNDJwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21z by1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZGE0 NXAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQvZDE5cDEmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpw PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7IGRyYWlk MjoyZDoxMGM6MHMtMSZuYnNwOyA5LjAzVCZuYnNwOyAzLjk2VCZuYnNwOyA1LjA3VCZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUm bmJzcDsgNDMuOCUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQ2cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7LSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7 Jm5ic3A7Jm5ic3A7IGdwdC9kMTFwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9t LWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90 O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZ3B0L2QxMnAxJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNw OyZuYnNwOyBncHQvZDEzcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9kMTRwMSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjgu MHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJz cDsgZ3B0L2QxNXAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQvZDE2cDEmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdw dC9kMTdwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsg T05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZ3B0L2QxOHAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE4cDEm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+c3BlY2lhbCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7IG1pcnJvci0zJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDM5OEcmbmJzcDsgMi44 NkcmbmJzcDsmbmJzcDsgMzk1RyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsgMC43MSUmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSAmbmJzcDsmbmJzcDsmbmJzcDtPTkxJTkU8L3NwYW4+PG86cD48L286cD48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87 bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBn cHQvc3BlY2lhbDAmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48 bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5i c3A7Jm5ic3A7IGdwdC9zcGVjaWFsMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05M SU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7 Ij5sb2dzJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw Oy0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t Ym90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgbWlycm9yLTImbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMTUuNUcmbmJzcDsmbmJzcDsg MjU2SyZuYnNwOyAxNS41RyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsgMC4wMCUmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQv c2xvZzAmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9O TElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJt c28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90 OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9zbG9nMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7ICZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOy0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJn aW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPm1pa2VqQGRyYWlkOn4gJCB6ZnMgZ2V0 IG1vdW50cG9pbnQgdGFuazwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+TkFNRSZuYnNwOyBQUk9QRVJUWSZuYnNwOyZuYnNwOyZuYnNwOyBWQUxV RSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBTT1VSQ0U8L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRhbmsmbmJzcDsgbW91 bnRwb2ludCZuYnNwOyAvdGFuayZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBk ZWZhdWx0PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkIGRmIC90YW5rPC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5GaWxlc3lzdGVtJm5ic3A7IDFL LWJsb2NrcyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBVc2VkJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IEF2YWlsIENhcGFjaXR5Jm5ic3A7IE1vdW50ZWQgb248L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRhbmsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgOTU1ODg5MjAwNCA0MzAxMzEwMjI0 IDUyNTc1ODE3ODAmbmJzcDsmbmJzcDsmbmJzcDsgNDUlJm5ic3A7Jm5ic3A7Jm5ic3A7IC90YW5r Jm5ic3A7Jm5ic3A7DQo8L3NwYW4+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTpXaW5nZGluZ3MiPsOfPC9zcGFuPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiB+OVRCIG5vdCAxOFRCPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5taWtlakBkcmFp ZDp+ICQ8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkIHpwb29sIGxpc3Q8L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPk5BTUUmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgU0laRSZuYnNwOyBBTExPQyZuYnNw OyZuYnNwOyBGUkVFJm5ic3A7IENLUE9JTlQmbmJzcDsgRVhQQU5EU1ombmJzcDsmbmJzcDsgRlJB RyZuYnNwOyZuYnNwOyZuYnNwOyBDQVAmbmJzcDsgREVEVVAmbmJzcDsmbmJzcDsmbmJzcDsgSEVB TFRIJm5ic3A7IEFMVFJPT1Q8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPmNjYWNoZSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyA5LjUwRyZuYnNwOyA5LjEwRyZuYnNwOyZuYnNwOyA0MDZNJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyA4OSUmbmJzcDsmbmJzcDsmbmJzcDsg OTUlJm5ic3A7IDEuMDB4Jm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORSZuYnNwOyAtPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5yYWlkLTU0MDAt MSZuYnNwOyA2LjI4VCZuYnNwOyAxLjE5VCZuYnNwOyA1LjA5VCZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgNiUmbmJzcDsmbmJzcDsm bmJzcDsgMTklJm5ic3A7IDEuMDB4Jm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORSZuYnNwOyAtPC9z cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij50YW5r Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDE4LjVUJm5i c3A7IDguMDJUJm5ic3A7IDEwLjRUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7 LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAwJSZuYnNwOyZuYnNwOyZuYnNwOyA0MyUmbmJzcDsg MS4wMHgmbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FJm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsNCjwvc3Bhbj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OldpbmdkaW5ncyI+w588L3NwYW4+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+DQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPnpmc3Jvb3QmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMTAzRyZu YnNwOyAzMi42RyZuYnNwOyA3MC40RyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsgMjUlJm5ic3A7Jm5ic3A7Jm5ic3A7IDMxJSZuYnNwOyAxLjAw eCZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkUmbmJzcDsgLTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPlRoYW5r cyBpbiBhZHZhbmNlIGZvciBhbnkgY29tbWVudHMgb3Igc3VnZXNzdGlvbnMuPC9zcGFuPjxvOnA+ PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFs dDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXpl OjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+ PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10 b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPi0tbWlrZWo8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPiZuYnNwOzxvOnA+ PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFs dDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj4mbmJzcDs8bzpwPjwvbzpwPjwvcD4N CjwvZGl2Pg0KPGRpdj4NCjxwPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0FyaWFsJnF1b3Q7LHNhbnMtc2VyaWYiPiZuYnNwOzxvOnA+PC9vOnA+PC9zcGFu PjwvcD4NCjxkaXYgc3R5bGU9ImJvcmRlci10b3A6c29saWQgIzY2NjY2NiAxLjBwdDtib3JkZXIt bGVmdDpub25lO2JvcmRlci1ib3R0b206c29saWQgIzY2NjY2NiAxLjBwdDtib3JkZXItcmlnaHQ6 bm9uZTtwYWRkaW5nOjQuMHB0IDBpbiA0LjBwdCAwaW4iPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1hcmdpbi1ib3R0b206MTIuMHB0Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjcuNXB0 O2ZvbnQtZmFtaWx5OiZxdW90O1ZlcmRhbmEmcXVvdDssc2Fucy1zZXJpZiI+Q09ORklERU5USUFM SVRZIE5PVEU6IFRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0aGUgdXNlPGJyPg0K b2YgdGhlIGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBt YXkgPGJyPg0KY29udGFpbiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVnZWQsIGNvbmZpZGVu dGlhbCwgYW5kIDxicj4NCmV4ZW1wdCBmcm9tIGRpc2Nsb3N1cmUgdW5kZXIgYXBwbGljYWJsZSBs YXcuIElmIHRoZSByZWFkZXIgPGJyPg0Kb2YgdGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50ZW5k ZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSA8YnI+DQpub3RpZmllZCB0aGF0IGFueSBkaXNz ZW1pbmF0aW9uLCBkaXN0cmlidXRpb24gb3IgY29weWluZyA8YnI+DQpvZiB0aGlzIGNvbW11bmlj YXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUgPGJyPg0KcmVjZWl2ZWQg dGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3IsIHBsZWFzZSBub3RpZnkgdXMgYnkgPGJyPg0KdGVs ZXBob25lIGF0ICg1MDIpIDIxMi00MDAwIG9yIG5vdGlmeSB1cyBhdDogUEFJLCBEZXB0LiA5OSwg PGJyPg0KMjEwMSBIaWdoIFdpY2toYW0gUGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kg NDAyNDU8YnI+DQo8YnI+DQo8YnI+DQo8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8L2Rpdj4NCjwv ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbi1ib3R0b206MTIuMHB0Ij48 bzpwPiZuYnNwOzwvbzpwPjwvcD4NCjxwPjxiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O1ZlcmRhbmEmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojNjY2NjY2 Ij5EaXNjbGFpbWVyPC9zcGFuPjwvYj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjBwdDtmb250 LWZhbWlseTomcXVvdDtWZXJkYW5hJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzY2NjY2NiI+PG86 cD48L286cD48L3NwYW4+PC9wPg0KPHA+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtWZXJkYW5hJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzY2NjY2NiI+VGhl IGluZm9ybWF0aW9uIGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUgc2Vu ZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkgdGhl IHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91IGFy ZSBub3QNCiB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueSBk aXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFraW5nIGFjdGlvbiBpbiByZWxh dGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlvbiBpcyBzdHJpY3RseSBwcm9o aWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuPGJyPg0KPGJyPg0KVGhpcyBlbWFpbCBoYXMgYmVl biBzY2FubmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3YXJlLCBhbmQgbWF5IGhhdmUgYmVlbiBhdXRv bWF0aWNhbGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0LCBhIGxlYWRlciBpbiBlbWFpbCBzZWN1cml0 eSBhbmQgY3liZXIgcmVzaWxpZW5jZS4gTWltZWNhc3QgaW50ZWdyYXRlcyBlbWFpbCBkZWZlbnNl cyB3aXRoIGJyYW5kIHByb3RlY3Rpb24sIHNlY3VyaXR5IGF3YXJlbmVzcyB0cmFpbmluZywgd2Vi IHNlY3VyaXR5LA0KIGNvbXBsaWFuY2UgYW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMu IE1pbWVjYXN0IGhlbHBzIHByb3RlY3QgbGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJv bSBtYWxpY2lvdXMgYWN0aXZpdHksIGh1bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7 IGFuZCB0byBsZWFkIHRoZSBtb3ZlbWVudCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVu dCB3b3JsZC4gVG8gZmluZCBvdXQgbW9yZSwgdmlzaXQgb3VyIHdlYnNpdGUuPG86cD48L286cD48 L3NwYW4+PC9wPg0KPC9kaXY+DQo8L2Jsb2NrcXVvdGU+DQo8L2Rpdj4NCjwvZGl2Pg0KDQoNCjxi cj48YnI+PHAgc3R5bGU9ImZvbnQtZmFtaWx5OiBWZXJkYW5hOyBmb250LXNpemU6MTBwdDsgY29s b3I6IzY2NjY2NjsiPjxiPkRpc2NsYWltZXI8L2I+PC9wPjxwIHN0eWxlPSJmb250LWZhbWlseTog VmVyZGFuYTsgZm9udC1zaXplOjhwdDsgY29sb3I6IzY2NjY2NjsiPlRoZSBpbmZvcm1hdGlvbiBj b250YWluZWQgaW4gdGhpcyBjb21tdW5pY2F0aW9uIGZyb20gdGhlIHNlbmRlciBpcyBjb25maWRl bnRpYWwuIEl0IGlzIGludGVuZGVkIHNvbGVseSBmb3IgdXNlIGJ5IHRoZSByZWNpcGllbnQgYW5k IG90aGVycyBhdXRob3JpemVkIHRvIHJlY2VpdmUgaXQuIElmIHlvdSBhcmUgbm90IHRoZSByZWNp cGllbnQsIHlvdSBhcmUgaGVyZWJ5IG5vdGlmaWVkIHRoYXQgYW55IGRpc2Nsb3N1cmUsIGNvcHlp bmcsIGRpc3RyaWJ1dGlvbiBvciB0YWtpbmcgYWN0aW9uIGluIHJlbGF0aW9uIG9mIHRoZSBjb250 ZW50cyBvZiB0aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQgYW5kIG1heSBi ZSB1bmxhd2Z1bC48YnI+PGJyPlRoaXMgZW1haWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNl cyBhbmQgbWFsd2FyZSwgYW5kIG1heSBoYXZlIGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBi eSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4gZW1haWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVu Y2UuIE1pbWVjYXN0IGludGVncmF0ZXMgZW1haWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0 aW9uLCBzZWN1cml0eSBhd2FyZW5lc3MgdHJhaW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5j ZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFiaWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVj dCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwg aHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVt ZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUgcmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBt b3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS48L3A+PC9ib2R5PjwvaHRtbD4NCg== --_000_fe01e1eebc4f46c58e6732b89781221bMAILHUBpailocal_-- From nobody Wed Apr 6 14:36:42 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2BB861A9766C; Wed, 6 Apr 2022 14:36:48 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYRsp5Qf7z3hrB; Wed, 6 Apr 2022 14:36:45 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id B81CB60C64B; Wed, 6 Apr 2022 16:36:42 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_99711a23deca8e31b3fd04d620ec3dd4" Date: Wed, 06 Apr 2022 16:36:42 +0200 From: egoitz@ramattack.net To: Rainer Duffner Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> Message-ID: <0ef282aee34b441f1991334e2edbcaec@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYRsp5Qf7z3hrB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_99711a23deca8e31b3fd04d620ec3dd4 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Rainer! Thank you so much for your help :) :) Well I assume they are in a datacenter and should not be a power outage.... About dataset size... yes... our ones are big... they can be 3-4 TB easily each dataset..... We bought them, because as they are for mailboxes and mailboxes grow and grow.... for having space for hosting them... We knew they had some speed issues, but those speed issues, we thought (as Samsung explains in the QVO site) they started after exceeding the speeding buffer this disks have. We though that meanwhile you didn't exceed it's capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps we were wrong?. Best regards, El 2022-04-06 14:56, Rainer Duffner escribió: >> Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net: >> I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later. > > Yeah, they are. > > Most likely, they don't have some sort of super-cap. > > A power-failure might totally toast the filesystem. > > These disks are - IMO - designed to accelerate read-operations. Their sustained write-performance is usually mediocre, at best. > > They might work well for small data-sets - because that is really written to some cache and the firmware just claims it's „written", but once the data-set becomes big enough, they are about as fast as a fast SATA-disk. > > https://www.tomshardware.com/reviews/samsung-970-evo-plus-ssd,5608.html --=_99711a23deca8e31b3fd04d620ec3dd4 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Rainer!


Thank you so much for your help :) :)

Well I assume they are in a datacenter and should not be a power outage= =2E...

About dataset size... yes... our ones are big... they can be 3-4 TB easi= ly each dataset.....

We bought them, because as they are for mailboxes and mailboxes grow and= grow.... for having space for hosting them...

We knew they had some speed issues, but those speed issues, we thought (= as Samsung explains in the QVO site) they started after exceeding the speed= ing buffer this disks have. We though that meanwhile you didn't exceed it's= capacity (the capacity of the speeding buffer) no speed problem arises. Pe= rhaps we were wrong?.


Best regards,



El 2022-04-06 14:56, Rainer Duffner escribió:



Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net:

I don't really know if, perhaps the QVO technolo= gy could be the guilty here.... because... they say are desktop computers d= isks... but later.

 
Yeah, they are.
 
Most likely, they don't have some sort of super-cap.
 
A power-failure might totally toast the filesystem.
 
These disks are - IMO -  designed to accelerate read-operations= =2E Their sustained write-performance is usually mediocre, at best.
 
They might work well for small data-sets - because that is really writ= ten to some cache and the firmware just claims it's „written", but on= ce the data-set becomes big enough, they are about as fast as a fast SATA-d= isk.
 
 
 
 
--=_99711a23deca8e31b3fd04d620ec3dd4-- From nobody Wed Apr 6 14:57:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AA4301A9DA96 for ; Wed, 6 Apr 2022 14:57:55 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-7.mit.edu (outgoing-exchange-7.mit.edu [18.9.28.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYSLB5GDQz3pGZ for ; Wed, 6 Apr 2022 14:57:51 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from w92exedge3.exchange.mit.edu (W92EXEDGE3.EXCHANGE.MIT.EDU [18.7.73.15]) by outgoing-exchange-7.mit.edu (8.14.7/8.12.4) with ESMTP id 236EvWTG014723; Wed, 6 Apr 2022 10:57:43 -0400 Received: from OC11EXPO29.exchange.mit.edu (18.9.4.102) by w92exedge3.exchange.mit.edu (18.7.73.15) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Wed, 6 Apr 2022 10:56:26 -0400 Received: from OC11EXPO29.exchange.mit.edu (18.9.4.102) by oc11expo29.exchange.mit.edu (18.9.4.102) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Wed, 6 Apr 2022 10:57:14 -0400 Received: from OC11EXPO29.exchange.mit.edu ([18.9.4.102]) by oc11expo29.exchange.mit.edu ([18.9.4.102]) with mapi id 15.00.1497.023; Wed, 6 Apr 2022 10:57:14 -0400 From: John F Carr To: "egoitz@ramattack.net" CC: "freebsd-fs@freebsd.org" Subject: Re: Desperate with 870 QVO and ZFS Thread-Topic: Desperate with 870 QVO and ZFS Thread-Index: AQHYSae2PxESj506kky2T4intWV7dqzjPPIA Date: Wed, 6 Apr 2022 14:57:14 +0000 Message-ID: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> In-Reply-To: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [108.7.221.50] Content-Type: text/plain; charset="us-ascii" Content-ID: <881C66B0C8A23F45B966E1A2A58135CB@exchange.mit.edu> Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Rspamd-Queue-Id: 4KYSLB5GDQz3pGZ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=mit.edu; spf=pass (mx1.freebsd.org: domain of jfc@mit.edu designates 18.9.28.58 as permitted sender) smtp.mailfrom=jfc@mit.edu X-Spamd-Result: default: False [-3.98 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_FIVE(0.00)[5]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:18.9.28.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_EXCELLENT(0.00)[18.9.28.58:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[18.9.28.58:from]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[mit.edu,none]; NEURAL_HAM_SHORT(-0.98)[-0.976]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Apr 6, 2022, at 07:15 , egoitz@ramattack.net wrote: >=20 > Good morning, >=20 > I write this post with the expectation that perhaps someone could help me= >=20 > I am running some mail servers with FreeBSD and ZFS. They use 870 QVO (no= t EVO or other Samsung SSD disks) disks as storage. They can easily have fr= om 1500 to 2000 concurrent connections. The machines have 128GB of ram and = the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% per= cent at most. >=20 > The problem I'm facing is that they could be running just fine and sudden= ly at some peak hour, the IO goes to 60 or 70% and the machine becomes extr= emely slow. ZFS is all by default, except the sync parameter which is set d= isabled. Apart from that the ARC is limited to 64GB. But even this is extre= mely odd. The used ARC is near 20GB. I have seen, that meta cache in arc is= very near to the limit that FreeBSD automatically sets depending on the si= ze of the ARC you set. It seems that almost all ARC is used by meta cache. = I have seen this effect in all my mail servers with this hardware and softw= are config. >=20 My system with nvd0: NVMe namespace has a problem with high write volume. If I build llvm with debugging symbo= ls, which writes about 70 GB, the filesystem nearly grinds to a halt. I ha= ve to use a spinning disk to get decent performance on this workload. Ther= e is some old talk on the mailing lists about certain drives handling TRIM = commands badly. See comment by Ted Ts'o here: https://forums.freebsd.org/t= hreads/ssd-trim-maintenance.56951/ Unfortunately the documentation for adjusting trim settings is out of date. From nobody Wed Apr 6 15:28:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 743CF1A836BF for ; Wed, 6 Apr 2022 15:29:32 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYT2g4FWpz3sfT for ; Wed, 6 Apr 2022 15:29:31 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: by mail-io1-xd2a.google.com with SMTP id g21so3287442iom.13 for ; Wed, 06 Apr 2022 08:29:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=FEu/bhJlTBVkdfIkobaSalDTOudXuaDPJ+G5DbpS7Nc=; b=TCi+BNcRYZCvE6gBIkIXlbEjEoDOE1Jsm3Uxpk6dAlZBEED9tquJLsFTvOsCW3g28y 4D+KqRey2tCH+IB+YV1iI8mZtzi76LrfWTRX0MMgYpQkaBs61aBDnBP15m+bHJPlY2c+ 9RuJn9YZup92QkoG+vU/V4vEc3RgcrKBUAuIYkkv9FV67MhX/yYJl4VpxWoBXaXRrpPv MckOa9JsF8650l5D/zWV6bmJ7JeXW+OxEmbRjKNQl8nMEOjbcS0XrPSG2iVlQSHEQoSD boOKGiqybm7QKa70VJlBUOZWFMUqIv7FOFHcmlEEvNsrZKxmFUF0J/oquV0zgo0CnZra qQog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=FEu/bhJlTBVkdfIkobaSalDTOudXuaDPJ+G5DbpS7Nc=; b=tP5oN9ejA3CkAlU2XAsyOOtz+HP2uB6UwjaTVh5dKl5XwsgAshMvykKl7afN6WIDsq zuZQO4Jh9/mS1snK/Wed8YZrYjkiL8jzI4oMalxhBDBJOqxzCmrjv1pkQvM+ytQNtnBz fpBI1J50PrxPa6+WAJQ9JImPwUmQMaUPdgSjnYSSjGcyrjyRrSeOGTagU3vyzm+p4fjJ yEqUJVd7ht6d3GQC6VfJtEgj85+Y4gtxsNneTe6dRNelEe+dTMj1dqNd9FS4IVM41LyM s7/MxVOUb35pJ/tM0vaoF0rp5G7XYGELlOgkRtuzKWcL3f/PcIHZYCUcJfDwiybCpy+c 3GgA== X-Gm-Message-State: AOAM5334ETYHEKH7ViYdiNwgCL5JpuXPJ4mJwT/b+etXWJAiRcLc0VgW ujIPHf6n5e2LYcyHKIKtQaYeXocAES+fi16MMcgO8g== X-Google-Smtp-Source: ABdhPJwFSZvOxKQP2zIegmKDfRHd011uM1c4IAdjGpyccSfJefn8Tl4T6YXW2C4dlghB9r9Pj89XpXkZ3avuhKXZwBQ= X-Received: by 2002:a05:6638:dd4:b0:323:d48f:83b5 with SMTP id m20-20020a0566380dd400b00323d48f83b5mr4599284jaj.174.1649258965332; Wed, 06 Apr 2022 08:29:25 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> In-Reply-To: From: Steven Hartland Date: Wed, 6 Apr 2022 16:28:59 +0100 Message-ID: Subject: Re: Desperate with 870 QVO and ZFS To: John F Carr Cc: "egoitz@ramattack.net" , "freebsd-fs@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000c5950205dbfe06ab" X-Rspamd-Queue-Id: 4KYT2g4FWpz3sfT X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=multiplay-co-uk.20210112.gappssmtp.com header.s=20210112 header.b=TCi+BNcR; dmarc=pass (policy=none) header.from=multiplay.co.uk; spf=pass (mx1.freebsd.org: domain of steven@multiplay.co.uk designates 2607:f8b0:4864:20::d2a as permitted sender) smtp.mailfrom=steven@multiplay.co.uk X-Spamd-Result: default: False [-3.70 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[multiplay-co-uk.20210112.gappssmtp.com:s=20210112]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[multiplay-co-uk.20210112.gappssmtp.com:+]; DMARC_POLICY_ALLOW(-0.50)[multiplay.co.uk,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d2a:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[killing@multiplay.co.uk,steven@multiplay.co.uk]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[killing@multiplay.co.uk,steven@multiplay.co.uk] X-ThisMailContainsUnwantedMimeParts: N --000000000000c5950205dbfe06ab Content-Type: text/plain; charset="UTF-8" What does gstat -pd report? On Wed, 6 Apr 2022 at 15:59, John F Carr wrote: > On Apr 6, 2022, at 07:15 , egoitz@ramattack.net wrote: > > > > Good morning, > > > > I write this post with the expectation that perhaps someone could help > me > > > > I am running some mail servers with FreeBSD and ZFS. They use 870 QVO > (not EVO or other Samsung SSD disks) disks as storage. They can easily have > from 1500 to 2000 concurrent connections. The machines have 128GB of ram > and the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% > percent at most. > > > > The problem I'm facing is that they could be running just fine and > suddenly at some peak hour, the IO goes to 60 or 70% and the machine > becomes extremely slow. ZFS is all by default, except the sync parameter > which is set disabled. Apart from that the ARC is limited to 64GB. But even > this is extremely odd. The used ARC is near 20GB. I have seen, that meta > cache in arc is very near to the limit that FreeBSD automatically sets > depending on the size of the ARC you set. It seems that almost all ARC is > used by meta cache. I have seen this effect in all my mail servers with > this hardware and software config. > > > > My system with > > nvd0: NVMe namespace > > has a problem with high write volume. If I build llvm with debugging > symbols, which writes about 70 GB, the filesystem nearly grinds to a halt. > I have to use a spinning disk to get decent performance on this workload. > There is some old talk on the mailing lists about certain drives handling > TRIM commands badly. See comment by Ted Ts'o here: > https://forums.freebsd.org/threads/ssd-trim-maintenance.56951/ > > Unfortunately the documentation for adjusting trim settings is out of date. > > > --000000000000c5950205dbfe06ab Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
What does gstat -pd report= ?

On Wed, 6 Apr 2022 at 15:59, John F Carr <jfc@mit.edu> wrote:
On Apr 6, 2022, at 07:15 , egoitz@ramattack.net wrote:
>
> Good morning,
>
> I write this post with the expectation that perhaps someone could help= me <d8974688.gif>
>
> I am running some mail servers with FreeBSD and ZFS. They use 870 QVO = (not EVO or other Samsung SSD disks) disks as storage. They can easily have= from 1500 to 2000 concurrent connections. The machines have 128GB of ram a= nd the CPU is almost absolutely idle. The disk IO is normally at 30 or 40% = percent at most.
>
> The problem I'm facing is that they could be running just fine and= suddenly at some peak hour, the IO goes to 60 or 70% and the machine becom= es extremely slow. ZFS is all by default, except the sync parameter which i= s set disabled. Apart from that the ARC is limited to 64GB. But even this i= s extremely odd. The used ARC is near 20GB. I have seen, that meta cache in= arc is very near to the limit that FreeBSD automatically sets depending on= the size of the ARC you set. It seems that almost all ARC is used by meta = cache. I have seen this effect in all my mail servers with this hardware an= d software config.
>

My system with

nvd0: <Samsung SSD 970 EVO 1TB> NVMe namespace

has a problem with high write volume.=C2=A0 If I build llvm with debugging = symbols, which writes about 70 GB, the filesystem nearly grinds to a halt.= =C2=A0 I have to use a spinning disk to get decent performance on this work= load.=C2=A0 There is some old talk on the mailing lists about certain drive= s handling TRIM commands badly.=C2=A0 See comment by Ted Ts'o here: https://forums.freebsd.org/threads/ssd-tr= im-maintenance.56951/

Unfortunately the documentation for adjusting trim settings is out of date.=


--000000000000c5950205dbfe06ab-- From nobody Wed Apr 6 15:30:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 92CF11A83BBB; Wed, 6 Apr 2022 15:30:52 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYT4C3mk8z3svy; Wed, 6 Apr 2022 15:30:51 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 6607560C676; Wed, 6 Apr 2022 17:30:49 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_aa8d0836ba0370d8efdf8758a7e3ea30" Date: Wed, 06 Apr 2022 17:30:49 +0200 From: egoitz@ramattack.net To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: Desperate with 870 QVO and ZFS In-Reply-To: <0ef282aee34b441f1991334e2edbcaec@ramattack.net> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Message-ID: <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYT4C3mk8z3svy X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_aa8d0836ba0370d8efdf8758a7e3ea30 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 One perhaps important note!! When this happens... almost all processes appear in top in the following state: txg state or txg-> bio.... perhaps should the the vfs.zfs.dirty_data_max, vfs.zfs.txg.timeout, vfs.zfs.vdev.async_write_active_max_dirty_percent be increased, decreased.... I'm afraid of doing some chage ana finally ending up with an inestable server.... I'm not an expert in handling these values.... Any recommendation?. Best regards, El 2022-04-06 16:36, egoitz@ramattack.net escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Hi Rainer! > > Thank you so much for your help :) :) > > Well I assume they are in a datacenter and should not be a power outage.... > > About dataset size... yes... our ones are big... they can be 3-4 TB easily each dataset..... > > We bought them, because as they are for mailboxes and mailboxes grow and grow.... for having space for hosting them... > > We knew they had some speed issues, but those speed issues, we thought (as Samsung explains in the QVO site) they started after exceeding the speeding buffer this disks have. We though that meanwhile you didn't exceed it's capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps we were wrong?. > > Best regards, > > El 2022-04-06 14:56, Rainer Duffner escribió: > > Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net: > I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later. > > Yeah, they are. > > Most likely, they don't have some sort of super-cap. > > A power-failure might totally toast the filesystem. > > These disks are - IMO - designed to accelerate read-operations. Their sustained write-performance is usually mediocre, at best. > > They might work well for small data-sets - because that is really written to some cache and the firmware just claims it's „written", but once the data-set becomes big enough, they are about as fast as a fast SATA-disk. > > https://www.tomshardware.com/reviews/samsung-970-evo-plus-ssd,5608.html --=_aa8d0836ba0370d8efdf8758a7e3ea30 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

One perhaps important note!!


When this happens... almost all processes appear in top in the following= state:


txg state or

txg->

bio....


perhaps should the the vfs.zfs.dirty_data_max, vfs.zfs.txg.timeout, vfs= =2Ezfs.vdev.async_write_active_max_dirty_percent be increased, decreased.= =2E.. I'm afraid of doing some chage ana finally ending up with an inestabl= e server.... I'm not an expert in handling these values....


Any recommendation?.


Best regards,

 


El 2022-04-06 16:36, egoitz@ramattack.net escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Hi Rainer!


Thank you so much for your help :) :)

Well I assume they are in a datacenter and should not be a power outage= =2E...

About dataset size... yes... our ones are big... they can be 3-4 TB easi= ly each dataset.....

We bought them, because as they are for mailboxes and mailboxes grow and= grow.... for having space for hosting them...

We knew they had some speed issues, but those speed issues, we thought (= as Samsung explains in the QVO site) they started after exceeding the speed= ing buffer this disks have. We though that meanwhile you didn't exceed it's= capacity (the capacity of the speeding buffer) no speed problem arises. Pe= rhaps we were wrong?.


Best regards,



El 2022-04-06 14:56, Rainer Duffner escribió:



Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net:

I don't really know if, perhaps the QVO technolo= gy could be the guilty here.... because... they say are desktop computers d= isks... but later.

 
Yeah, they are.
 
Most likely, they don't have some sort of super-cap.
 
A power-failure might totally toast the filesystem.
 
These disks are - IMO -  designed to accelerate read-operations= =2E Their sustained write-performance is usually mediocre, at best.
 
They might work well for small data-sets - because that is really writ= ten to some cache and the firmware just claims it's „written", but on= ce the data-set becomes big enough, they are about as fast as a fast SATA-d= isk.
 
 
 
 
--=_aa8d0836ba0370d8efdf8758a7e3ea30-- From nobody Wed Apr 6 15:43:27 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0B3581A873E2; Wed, 6 Apr 2022 15:43:37 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYTLw164tz4Rt7; Wed, 6 Apr 2022 15:43:36 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649259816; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=DszpBHls3d9k0db5g8HTfayx6XUbGeuJVLcEKqu7X00=; b=Gc5xuom5FY9xOpw9pbd1F6xAo9h6fFjjX6ZZa0srj87yA97Uu0xMLJwlwn29DiJqmS9lUW 6rBc9B/LUBjAL9JHluoyLecZG7WPTnLnLEPPGAvYvf3YpF6hdPZtLdyJnIacTrcTWqZecc jGl7MrQSGn3OkOQyrus9vri9gEPhUe698IJAZIKrSzcwCtA9Q78KvAXoAIRSu88kvfGct8 BeknFduPoU5/w4PknQGlUiHqCOszLY2/XqhVi2EZFXmUCMgfXRKj8tWsSxjC1cu0WihEtp 1PpW9FVAy00CMNWFZgSnHOoRBHw3G/TVcikzZf6ozAsF+20TZoWPEDas69Z0Lw== Received: from [IPV6:2003:cd:5f22:6f00:a5c2:9043:ac1c:2c06] (p200300cd5f226f00a5c29043ac1c2c06.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:a5c2:9043:ac1c:2c06]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id C2DF02234; Wed, 6 Apr 2022 15:43:32 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: Date: Wed, 6 Apr 2022 17:43:27 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> From: Stefan Esser In-Reply-To: <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------xWEDst9IZgYvLPukN2ga6r9b" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649259816; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=DszpBHls3d9k0db5g8HTfayx6XUbGeuJVLcEKqu7X00=; b=aN4rR0ArnFTHAcbxMwgavfJPkS5+OKQlPfEt1Et1uxmcF+JlZXt0XA3/T7la/p1horP/zj WOseXuHjUAkNWnLPN2aeh5cq+TTuB3/9XrhmOF3NDjuj59dF5ikvm0pvAhqZ6GfbWNxFTD zIPeu0BwVtRLTujVxtYvsWhk9syiPIrVfmjaL40GxcnIuwocG2gMs0ygkn9P5okXCX+ZTy ztX0bnRWvrPKSQjztLOY6TiTSagOw8H6L9InjiPlXdF3TsJxxuK+LRecN9+90HbGQRHzxb 8lyj0IQtmdFmSoZI7o0sHk0TkiBus9KSDJ1ITSaYRKyPkCiw3BZ9TQDw2YHISQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649259816; a=rsa-sha256; cv=none; b=Kh0/OSy2P0jg8Ud2tGvmRxYZEOwkXWAVZpjm83vZci17DkOsyBf8dW34XMZ5BukYz2EVBV ogoweL4BZh0pL34FGqJ8cL0/CioGC8N/qydaux+MobxVFKyvDfX8fTOlR6QOclh225o63Z ubUAOVUytF5H+3ku//KvSceootMPYY1/UOOjPImCZsAjTiWXyz54Y2gKSyfAF0J7LG4bf0 fCiWAbNWnTWYlEfcUGE3SRnKQrPk+htaTT2APKWkRX5jGvDxlO3EYzHcQU7ie+qjRv8EuX 4kAmnhFgsgOiYSoCB2OSqti+/Y3ux1IFIZ5OV8+vv0n1muQusDn97SPRphb9Mw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------xWEDst9IZgYvLPukN2ga6r9b Content-Type: multipart/mixed; boundary="------------gUL8upCKsfSinXvRen5NU9ab"; protected-headers="v1" From: Stefan Esser To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Message-ID: Subject: Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> In-Reply-To: <0ef282aee34b441f1991334e2edbcaec@ramattack.net> --------------gUL8upCKsfSinXvRen5NU9ab Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: > Hi Rainer! >=20 > Thank you so much for your help :) :) >=20 > Well I assume they are in a datacenter and should not be a power outage= =2E... >=20 > About dataset size... yes... our ones are big... they can be 3-4 TB eas= ily each > dataset..... >=20 > We bought them, because as they are for mailboxes and mailboxes grow an= d > grow.... for having space for hosting them... Which mailbox format (e.g. mbox, maildir, ...) do you use? > We knew they had some speed issues, but those speed issues, we thought = (as > Samsung explains in the QVO site) they started after exceeding the spee= ding > buffer this disks have. We though that meanwhile you didn't exceed it's= > capacity (the capacity of the speeding buffer) no speed problem arises.= Perhaps > we were wrong?. These drives are meant for small loads in a typical PC use case, i.e. some installations of software in the few GB range, else only files of a few MB being written, perhaps an import of media files that range from tens to a few hundred MB at a time, but less often than once a day. As the SSD fills, the space available for the single level write cache gets smaller (on many SSDs, I have no numbers for this particular device), and thus the amount of data that can be written at single cell speed shrinks as the SSD gets full. I have just looked up the size of the SLC cache, it is specified to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB version, smaller models will have a smaller SLC cache). But after writing those few GB at a speed of some 500 MB/s (i.e. after 12 to 150 seconds), the drive will need several minutes to transfer those writes to the quad-level cells, and will operate at a fraction of the nominal performance during that time. (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the 2 TB model.) And cheap SSDs often have no RAM cache (not checked, but I'd be surprised if the QVO had one) and thus cannot keep bookkeeping date in such a cache, further limiting the performance under load. And the resilience (max. amount of data written over its lifetime) is also quite low - I hope those drives are used in some kind of RAID configuration. The 870 QVO is specified for 370 full capacity writes, i.e. 370 TB for the 1 TB model. That's still a few hundred GB a day - but only if the write amplification stays in a reasonable range ... --------------gUL8upCKsfSinXvRen5NU9ab-- --------------xWEDst9IZgYvLPukN2ga6r9b Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJNtR8FAwAAAAAACgkQR+u171r99UQX jggAh1PLi41CMsG6xbRvf9KA3JRSYjHGSCr3soAi5Su5VZmVNts3ocVUONOfR4yoTj/JGZ0HYvwi iQm4PxPLS7Fj69joQnernx6Dhem6yg8hJSwrU3HDZQ4lIDSQ2B220+uz9MrqImu21JvDxIRzmgH+ kQ7Q3+ZoxCi0BJX83yL8sh0wMA5tLrV1e8IKrpBR/mLiwQZRoaOPKXKx29eP4Q8St57UySGfGL13 O33jTgM8sAAGkImgAa2JzXRhYQ2KY5QnplYv1cxk6Zbpuq1TgovqGm3pzak0i1kTiK95K3tWYhMh 2ne2gmnXcO6CGu+QeUapXJN10sefE8gRNrBDLzpjJg== =HKc2 -----END PGP SIGNATURE----- --------------xWEDst9IZgYvLPukN2ga6r9b-- From nobody Wed Apr 6 15:48:31 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AEEFF1A8A975; Wed, 6 Apr 2022 15:56:47 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYTf621Wdz4W0C; Wed, 6 Apr 2022 15:56:44 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id 1F6F860C6A8; Wed, 6 Apr 2022 17:48:31 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_a4ce21118f18db79ad9328c5f2cebb5a" Date: Wed, 06 Apr 2022 17:48:31 +0200 From: egoitz@ramattack.net To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Cc: owner-freebsd-fs@freebsd.org Subject: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> Message-ID: <29f0eee5b502758126bf4cfa2d8e3517@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYTf621Wdz4W0C X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_a4ce21118f18db79ad9328c5f2cebb5a Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 I have been thinking and.... I got the following tunables now : vfs.zfs.arc_meta_strategy: 0 vfs.zfs.arc_meta_limit: 17179869184 kstat.zfs.misc.arcstats.arc_meta_min: 4294967296 kstat.zfs.misc.arcstats.arc_meta_max: 19386809344 kstat.zfs.misc.arcstats.arc_meta_limit: 17179869184 kstat.zfs.misc.arcstats.arc_meta_used: 16870668480 vfs.zfs.arc_max: 68719476736 and top sais : ARC: 19G Total, 1505M MFU, 12G MRU, 6519K Anon, 175M Header, 5687M Other When using even 128GB of vfs.zfs.arc_max (instead of 64GB I have now set) the ARC wasn't approximating to it's max usable size.... Can perhaps that could have something to do with that fact that arc meta values are almost at the limit set?. Perhaps increasing vfs.zfs.arc_meta_limit or kstat.zfs.misc.arcstats.arc_meta_limit (I suppose the first one is the one to increase) could cause a better performance and perhaps a better usage and better take advantage of having 64GB max of ARC set?. I say it because now it doesn't use more than 19GB in total ARC memory.... As always said, any opinion or idea would be very highly appreciated. Cheers, El 2022-04-06 17:30, egoitz@ramattack.net escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > One perhaps important note!! > > When this happens... almost all processes appear in top in the following state: > > txg state or > > txg-> > > bio.... > > perhaps should the the vfs.zfs.dirty_data_max, vfs.zfs.txg.timeout, vfs.zfs.vdev.async_write_active_max_dirty_percent be increased, decreased.... I'm afraid of doing some chage ana finally ending up with an inestable server.... I'm not an expert in handling these values.... > > Any recommendation?. > > Best regards, > > El 2022-04-06 16:36, egoitz@ramattack.net escribió: > > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Hi Rainer! > > Thank you so much for your help :) :) > > Well I assume they are in a datacenter and should not be a power outage.... > > About dataset size... yes... our ones are big... they can be 3-4 TB easily each dataset..... > > We bought them, because as they are for mailboxes and mailboxes grow and grow.... for having space for hosting them... > > We knew they had some speed issues, but those speed issues, we thought (as Samsung explains in the QVO site) they started after exceeding the speeding buffer this disks have. We though that meanwhile you didn't exceed it's capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps we were wrong?. > > Best regards, > > El 2022-04-06 14:56, Rainer Duffner escribió: > > Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net: > I don't really know if, perhaps the QVO technology could be the guilty here.... because... they say are desktop computers disks... but later. > > Yeah, they are. > > Most likely, they don't have some sort of super-cap. > > A power-failure might totally toast the filesystem. > > These disks are - IMO - designed to accelerate read-operations. Their sustained write-performance is usually mediocre, at best. > > They might work well for small data-sets - because that is really written to some cache and the firmware just claims it's „written", but once the data-set becomes big enough, they are about as fast as a fast SATA-disk. > > https://www.tomshardware.com/reviews/samsung-970-evo-plus-ssd,5608.html --=_a4ce21118f18db79ad9328c5f2cebb5a Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

I have been thinking and.... I got the following tunables now :

vfs.zfs.arc_meta_strategy: 0
vfs.zfs.arc_meta_limit: 17179869184kstat.zfs.misc.arcstats.arc_meta_min: 4294967296
kstat.zfs.misc.arc= stats.arc_meta_max: 19386809344
kstat.zfs.misc.arcstats.arc_meta_limit= : 17179869184
kstat.zfs.misc.arcstats.arc_meta_used: 16870668480
= vfs.zfs.arc_max: 68719476736

and top sais :

ARC: 19G Total, 1505M MFU, 12G MRU, 6519K Anon, 175M Header, 5687M Other=


When using even 128GB of vfs.zfs.arc_max (instead of 64GB I have now set= ) the ARC wasn't approximating to it's max usable size.... Can perhaps that= could have something to do with that fact that arc meta values are almost = at the limit set?. Perhaps increasing vfs.zfs.arc_meta_limit or kstat.zfs= =2Emisc.arcstats.arc_meta_limit (I suppose the first one is the one to incr= ease) could cause a better performance and perhaps a better usage and bette= r take advantage of having 64GB max of ARC set?. I say it because now it do= esn't use more than 19GB in total ARC memory....


As always said, any opinion or idea would be very highly appreciated.


Cheers,


 


El 2022-04-06 17:30, egoitz@ramattack.net escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

One perhaps important note!!


When this happens... almost all processes appear in top in the following= state:


txg state or

txg->

bio....


perhaps should the the vfs.zfs.dirty_data_max, vfs.zfs.txg.timeout, vfs= =2Ezfs.vdev.async_write_active_max_dirty_percent be increased, decreased.= =2E.. I'm afraid of doing some chage ana finally ending up with an inestabl= e server.... I'm not an expert in handling these values....


Any recommendation?.


Best regards,

 


El 2022-04-06 16:36, egoitz@ramattack.net escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Hi Rainer!


Thank you so much for your help :) :)

Well I assume they are in a datacenter and should not be a power outage= =2E...

About dataset size... yes... our ones are big... they can be 3-4 TB easi= ly each dataset.....

We bought them, because as they are for mailboxes and mailboxes grow and= grow.... for having space for hosting them...

We knew they had some speed issues, but those speed issues, we thought (= as Samsung explains in the QVO site) they started after exceeding the speed= ing buffer this disks have. We though that meanwhile you didn't exceed it's= capacity (the capacity of the speeding buffer) no speed problem arises. Pe= rhaps we were wrong?.


Best regards,



El 2022-04-06 14:56, Rainer Duffner escribió:



Am 06.04.2022 um 13:15 schrieb egoitz@ramattack.net:

I don't really know if, perhaps the QVO technolo= gy could be the guilty here.... because... they say are desktop computers d= isks... but later.

 
Yeah, they are.
 
Most likely, they don't have some sort of super-cap.
 
A power-failure might totally toast the filesystem.
 
These disks are - IMO -  designed to accelerate read-operations= =2E Their sustained write-performance is usually mediocre, at best.
 
They might work well for small data-sets - because that is really writ= ten to some cache and the firmware just claims it's „written", but on= ce the data-set becomes big enough, they are about as fast as a fast SATA-d= isk.
 
 
 
 
--=_a4ce21118f18db79ad9328c5f2cebb5a-- From nobody Wed Apr 6 16:34:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 94E3B1A93BAB; Wed, 6 Apr 2022 16:35:01 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYVVC4tX0z4ftP; Wed, 6 Apr 2022 16:34:59 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 4B1C660C60B; Wed, 6 Apr 2022 18:34:56 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_9e84ea9eb28b05e81541398ce76d2803" Date: Wed, 06 Apr 2022 18:34:56 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYVVC4tX0z4ftP X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_9e84ea9eb28b05e81541398ce76d2803 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Stefan! Thank you so much for your answer!!. I do answer below in green bold for instance... for a better distinction.... Very thankful for all your comments Stefan!!! :) :) :) Cheers!! El 2022-04-06 17:43, Stefan Esser escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: > >> Hi Rainer! >> >> Thank you so much for your help :) :) >> >> Well I assume they are in a datacenter and should not be a power outage.... >> >> About dataset size... yes... our ones are big... they can be 3-4 TB easily each >> dataset..... >> >> We bought them, because as they are for mailboxes and mailboxes grow and >> grow.... for having space for hosting them... > > Which mailbox format (e.g. mbox, maildir, ...) do you use? > > I'M RUNNING CYRUS IMAP SO SORT OF MAILDIR... TOO MANY LITTLE FILES NORMALLY..... SOMETIMES DIRECTORIES WITH TONS OF LITTLE FILES.... > >> We knew they had some speed issues, but those speed issues, we thought (as >> Samsung explains in the QVO site) they started after exceeding the speeding >> buffer this disks have. We though that meanwhile you didn't exceed it's >> capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps >> we were wrong?. > > These drives are meant for small loads in a typical PC use case, > i.e. some installations of software in the few GB range, else only > files of a few MB being written, perhaps an import of media files > that range from tens to a few hundred MB at a time, but less often > than once a day. > > WE MOVE, YOU KNOW... LOTS OF LITTLE FILES... AND LOT'S OF DIFFERENT CONCURRENT MODIFICATIONS BY 1500-2000 CONCURRENT IMAP CONNECTIONS WE HAVE... > > As the SSD fills, the space available for the single level write > cache gets smaller > > THE SINGLE LEVEL WRITE CACHE IS THE CACHE THESE SSD DRIVERS HAVE, FOR COMPENSATING THE SPEED ISSUES THEY HAVE DUE TO USING QLC MEMORY?. DO YOU REFER TO THAT?. SORRY I DON'T UNDERSTAND WELL THIS PARAGRAPH. > > (on many SSDs, I have no numbers for this > particular device), and thus the amount of data that can be > written at single cell speed shrinks as the SSD gets full. > > I have just looked up the size of the SLC cache, it is specified > to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB > version, smaller models will have a smaller SLC cache). > > ASSUMING YOU WERE TALKING ABOUT THE CACHE FOR COMPENSATING SPEED WE PREVIOUSLY COMMENTED, I SHOULD SAY THESE ARE THE 870 QVO BUT THE 8TB VERSION. SO THEY SHOULD HAVE THE BIGGEST CACHE FOR COMPENSATING THE SPEED ISSUES... > > But after writing those few GB at a speed of some 500 MB/s (i.e. > after 12 to 150 seconds), the drive will need several minutes to > transfer those writes to the quad-level cells, and will operate > at a fraction of the nominal performance during that time. > (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the > 2 TB model.) > > WELL WE ARE IN THE 8TB MODEL. I THINK I HAVE UNDERSTOOD WHAT YOU WROTE IN PREVIOUS PARAGRAPH. YOU SAID THEY CAN BE FAST BUT NOT CONSTANTLY, BECAUSE LATER THEY HAVE TO WRITE ALL THAT TO THEIR PERPETUAL STORAGE FROM THE CACHE. AND THAT'S SLOW. AM I WRONG?. EVEN IN THE 8TB MODEL YOU THINK STEFAN?. > > THE MAIN PROBLEM WE ARE FACING IS THAT IN SOME PEAK MOMENTS, WHEN THE MACHINE SERVES CONNECTIONS FOR ALL THE INSTANCES IT HAS, AND ONLY AS SAID IN SOME PEAK MOMENTS... LIKE THE 09AM OR THE 11AM.... IT SEEMS THE MACHINE BECOMES SLOWER... AND LIKE IF THE DISKS WEREN'T ABLE TO SERVE ALL THEY HAVE TO SERVE.... IN THESE MOMENTS, NO BIG FILES ARE MOVED... BUT AS WE HAVE 1800-2000 CONCURRENT IMAP CONNECTIONS... NORMALLY THEY ARE DOING EACH ONE... LITTLE CHANGES IN THEIR MAILBOX. DO YOU THINK PERHAPS THIS DISKS THEN ARE NOT APPROPRIATE FOR THIS KIND OF USAGE?- > > And cheap SSDs often have no RAM cache (not checked, but I'd be > surprised if the QVO had one) and thus cannot keep bookkeeping date > in such a cache, further limiting the performance under load. > > THIS BROCHURE (HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/BROCHURE/870_SERIES_BROCHURE.PDF AND THE DATASHEET HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/DATA-SHEET/SAMSUNG_SSD_870_QVO_DATA_SHEET_REV1.1.PDF) SAIS IF I HAVE READ PROPERLY, THE 8TB DRIVE HAS 8GB OF RAM?. I ASSUME THAT IS WHAT THEY CALL THE TURBO WRITE CACHE?. > > And the resilience (max. amount of data written over its lifetime) > is also quite low - I hope those drives are used in some kind of > RAID configuration. > > YEP WE USE RAIDZ-2 > > The 870 QVO is specified for 370 full capacity > writes, i.e. 370 TB for the 1 TB model. That's still a few hundred > GB a day - but only if the write amplification stays in a reasonable > range ... > > WELL YES... 2880TB IN OUR CASE....NOT BAD.. ISN'T IT? --=_9e84ea9eb28b05e81541398ce76d2803 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Stefan!


Thank you so much for your answer!!. I do answer below in green bold for= instance... for a better distinction....


Very thankful for all your comments Stefan!!! :) :) :)


Cheers!!

 


El 2022-04-06 17:43, Stefan Esser escribió:

= ATENCION
ATENCION
ATENCION!!! Este correo se ha enviado desde f= uera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no= ser que reconozca el remitente y sepa que el contenido es seguro.
Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net:
Hi Rainer!

Thank you so much for your hel= p :) :)

Well I assume they are in a datacenter and should not = be a power outage....

About dataset size... yes... our ones ar= e big... they can be 3-4 TB easily each
dataset.....

We = bought them, because as they are for mailboxes and mailboxes grow and
= grow.... for having space for hosting them...

Which mailbox format (e.g. mbox, maildir, ...) do you use?
=  
= I'm running Cyrus imap so sort of M= aildir... too many little files normally..... Sometimes directories with to= ns of little files....

We knew they had some speed issues, but those speed is= sues, we thought (as
Samsung explains in the QVO site) they started a= fter exceeding the speeding
buffer this disks have. We though that me= anwhile you didn't exceed it's
capacity (the capacity of the speeding= buffer) no speed problem arises. Perhaps
we were wrong?.
These drives are meant for small loads in a typical PC use case,
i.e. some installations of software in the few GB range, else only
= files of a few MB being written, perhaps an import of media files
th= at range from tens to a few hundred MB at a time, but less often
than= once a day.
=  
= We move, you know... lots of little= files... and lot's of different concurrent modifications by 1500-2000 conc= urrent imap connections we have...
=
As the SSD fills, the space available for the single level write
cache gets smaller
=  
= The single level write cache is the= cache these ssd drivers have, for compensating the speed issues they have = due to using qlc memory?. Do you refer to that?. Sorry I don't understand w= ell this paragraph.
=  
= (on many SSDs, I have no numbers for this
particular device), and thu= s the amount of data that can be
written at single cell speed shrinks= as the SSD gets full.
=  
=

I have just looked up the size of the SLC cache, it is specif= ied
to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB=
version, smaller models will have a smaller SLC cache).
=  
= Assuming you were talking about the= cache for compensating speed we previously commented, I should say these a= re the 870 QVO but the 8TB version. So they should have the biggest cache f= or compensating the speed issues...
=  
=

But after writing those few GB at a speed of some 500 MB/s (i= =2Ee.
after 12 to 150 seconds), the drive will need several minutes t= o
transfer those writes to the quad-level cells, and will operate
at a fraction of the nominal performance during that time.
(QLC wr= ites max out at 80 MB/s for the 1 TB model, 160 MB/s for the
2 TB mod= el.)
=  
= Well we are in the 8TB model. I thi= nk I have understood what you wrote in previous paragraph. You said they ca= n be fast but not constantly, because later they have to write all that to = their perpetual storage from the cache. And that's slow. Am I wrong?. Even = in the 8TB model you think Stefan?.
=  
= The main problem we are facing is t= hat in some peak moments, when the machine serves connections for all the i= nstances it has, and only as said in some peak moments... like the 09am or = the 11am.... it seems the machine becomes slower... and like if the disks w= eren't able to serve all they have to serve.... In these moments, no big fi= les are moved... but as we have 1800-2000 concurrent imap connections... no= rmally they are doing each one... little changes in their mailbox. Do you t= hink perhaps this disks then are not appropriate for this kind of usage?-

And cheap SSDs often have no RAM cache (not che= cked, but I'd be
surprised if the QVO had one) and thus cannot keep b= ookkeeping date
in such a cache, further limiting the performance und= er load.
=  
= This brochure (https://semiconductor.samsung.com/resources/brochure/87= 0_Series_Brochure.pdf and the datasheet https://semiconductor.samsung= =2Ecom/resources/data-sheet/Samsung_SSD_870_QVO_Data_Sheet_Rev1.1.pdf) sais= if I have read properly, the 8TB drive has 8GB of ram?. I assume that is w= hat they call the turbo write cache?.

And the = resilience (max. amount of data written over its lifetime)
is also qu= ite low - I hope those drives are used in some kind of
RAID configura= tion.
=  
= Yep we use raidz-2<= /div>
=  
= The 870 QVO is specified for 370 full capacity
writes, i.e. 370 TB fo= r the 1 TB model. That's still a few hundred
GB a day - but only if t= he write amplification stays in a reasonable
range ...
=  
= Well yes... 2880TB in our case...= =2Enot bad.. isn't it?
--=_9e84ea9eb28b05e81541398ce76d2803-- From nobody Wed Apr 6 16:51:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 437DE1A983A4; Wed, 6 Apr 2022 16:51:55 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYVsk0NY1z4lVF; Wed, 6 Apr 2022 16:51:52 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id 027BD60C6BF; Wed, 6 Apr 2022 18:51:49 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_be6199b7d5e868a9b11faca98e7631c5" Date: Wed, 06 Apr 2022 18:51:49 +0200 From: egoitz@ramattack.net To: Eugene Grosbein Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> Message-ID: <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYVsk0NY1z4lVF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_be6199b7d5e868a9b11faca98e7631c5 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Eugene!!! Thank you so much really again mate :) :) :) About your recommendations... Eugene, if some of them wouldn't be working as expected, could we revert some or all of them or perhaps some of your recommendations below need to be definitive?. I do answer below in green bold for better distinction :) :) El 2022-04-06 18:14, Eugene Grosbein escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > 06.04.2022 22:30, egoitz@ramattack.net пишет: > >> One perhaps important note!! >> >> When this happens... almost all processes appear in top in the following state: >> >> txg state or >> >> txg-> >> >> bio.... >> >> perhaps should the the vfs.zfs.dirty_data_max, vfs.zfs.txg.timeout, vfs.zfs.vdev.async_write_active_max_dirty_percent be increased, decreased.... I'm afraid of doing some chage ana finally ending up with an inestable server.... I'm not an expert in handling these values.... >> >> Any recommendation?. > > 1) Make sure the pool has enough free space because ZFS can became crawling slow otherwise. > > THIS IS JUST AN EXAMPLE... BUT YOU CAN SEE ALL SIMILARLY.... > > ZPOOL LIST > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > ZROOT 448G 2.27G 446G - - 1% 0% 1.00X ONLINE - > MAIL_DATASET 58.2T 19.4T 38.8T - - 32% 33% 1.00X ONLINE - > > 2) Increase recordsize upto 1MB for file systems located in the pool > so ZFS is allowed to use bigger request sizes for read/write operations > > WE HAVE THE DEFAULT... SO 128K... > > 3) If you use compression, look if achieved compressratio worth it and > if not (<1.4 f.e.) then better disable compression to avoid its overhead; > > WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... > > WE SHOULD SAY WE HAVE LOTS OF CPU... > > 4) try "zfs set redundant_metadata=most" to decrease amount of small writes to the file systems; > > OK.... > > 5) If you have good power supply and stable (non-crashing) OS, try increasing > sysctl vfs.zfs.txg.timeout from defaule 5sec, but do not be extreme (f.e. upto 10sec). > Maybe it will increase amount of long writes and decrease amount of short writes, that is good. > > WELL I HAVE SYNC IN DISABLED IN THE DATASETS... DO YOU STILL THINK IT'S GOOD TO CHANGE IT?. JUST A QUESTION OF PERSON WANTING TO LEARN :) . > > WHAT ABOUT THE VFS.ZFS.DIRTY_DATA_MAX AND THE VFS.ZFS.DIRTY_DATA_MAX_MAX, WOULD YOU INCREASE THEM FROM 4GB IT'S SET NOW?. > > THANKS A LOT EUGENE!!!! > CHEERS!! --=_be6199b7d5e868a9b11faca98e7631c5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Eugene!!!


Thank you so much really again mate  :) :) :)


About your recommendations... Eugene, if some of them wouldn't be workin= g as expected, could we revert some or all of them or perhaps some of your = recommendations below need to be definitive?.


I do answer below in green bold for better distinction :) :)



 


El 2022-04-06 18:14, Eugene Grosbein escribió:

= ATENCION
ATENCION
ATENCION!!! Este correo se ha enviado desde f= uera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no= ser que reconozca el remitente y sepa que el contenido es seguro.
06.04.2022 22:30, egoitz@ramat= tack.net =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
One perhaps important note!!


When = this happens... almost all processes appear in top in the following state:<= br />

txg state or

txg->

bio..= =2E.


perhaps should the the vfs.zfs.dirty_data_max, vfs= =2Ezfs.txg.timeout, vfs.zfs.vdev.async_write_active_max_dirty_percent be in= creased, decreased.... I'm afraid of doing some chage ana finally ending up= with an inestable server.... I'm not an expert in handling these values.= =2E..


Any recommendation?.

1) Make sure the pool has enough free space because ZFS can became c= rawling slow otherwise.
=  
= This is just an example... but you = can see all similarly....
=  
= zpool list
NAME     &nbs= p;       SIZE  ALLOC   FREE&nb= sp; CKPOINT  EXPANDSZ   FRAG    CAP  DED= UP  HEALTH  ALTROOT
zroot          = ;   448G  2.27G   446G    &nbs= p;   -         - &nb= sp;   1%     0%  1.00x  ONLINE = ; -
mail_datas= et  58.2T  19.4T  38.8T      &= nbsp; -         -   = 32%    33%  1.00x  ONLINE  -=


2) Increase recordsize upto 1MB for file systems locate= d in the pool
so ZFS is allowed to use bigger request sizes for read/= write operations
=  
= We have the default... so 128K...

3) If you use compression, look if achieved com= pressratio worth it and
if not (<1.4 f.e.) then better disable com= pression to avoid its overhead;
=  
= We don't use compression as it's no= t set by default. Some people say you should have it enabled.... but.... ju= st for avoid having some data compressed some other not (in case you enable= and later disable) and finally for avoid accessing to information with dif= ferent cpu costs of handling... we have not touched compression....<= /strong>
=  
= We should say we have lots of CPU= =2E..
=

4) try "zfs set redundant_metadata=3Dmost" to decrease amount= of small writes to the file systems;
=  
= Ok....
=

5) If you have good power supply and stable (non-crashing) OS= , try increasing
sysctl vfs.zfs.txg.timeout from defaule 5sec, but do= not be extreme (f.e. upto 10sec).
Maybe it will increase amount of l= ong writes and decrease amount of short writes, that is good.
=  
= Well I have sync in disabled in the= datasets... do you still think it's good to change it?. Just a question of= person wanting to learn :) .
=  
= What about the vfs.zfs.dirty_data_m= ax and the vfs.zfs.dirty_data_max_max, would you increase them from 4GB it'= s set now?.
=  
=  
=  
=  
=  
=  
=  
=  
=  
=  
=  
=  
= Thanks a lot Eugene!!!!
= Cheers!!
--=_be6199b7d5e868a9b11faca98e7631c5-- From nobody Wed Apr 6 20:18:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 756761A8C823; Wed, 6 Apr 2022 20:19:04 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYbSh1LCwz4YgS; Wed, 6 Apr 2022 20:18:56 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id 236KIn7c011211; Wed, 6 Apr 2022 15:18:50 -0500 (CDT) Date: Wed, 6 Apr 2022 15:18:49 -0500 (CDT) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: egoitz@ramattack.net cc: freebsd-fs@FreeBSD.org, freebsd-hackers@FreeBSD.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS In-Reply-To: <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> Message-ID: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> User-Agent: Alpine 2.20 (GSO 67 2015-01-07) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Wed, 06 Apr 2022 15:18:50 -0500 (CDT) X-Rspamd-Queue-Id: 4KYbSh1LCwz4YgS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bfriesen@simple.dallas.tx.us designates 65.66.246.90 as permitted sender) smtp.mailfrom=bfriesen@simple.dallas.tx.us X-Spamd-Result: default: False [-3.22 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.978]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dallas.tx.us]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.941]; MLMMJ_DEST(0.00)[freebsd-performance,freebsd-hackers,freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: >> >> WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... There seems to be a problem with your caps-lock key. Since it seems that you said that you are using maildir for your mail server, it is likely very useful if you do enable even rather mild compression (e.g. lz4) since this will reduce the write work-load and even short files will be stored more efficiently. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt From nobody Wed Apr 6 20:43:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 612D21A94AD9; Wed, 6 Apr 2022 20:44:01 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYc1X2RkDz4gKb; Wed, 6 Apr 2022 20:44:00 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 236KhqDK072088 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 6 Apr 2022 16:43:52 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:434:73cd:9d42:28ad] ([IPv6:2607:f3e0:0:4:434:73cd:9d42:28ad]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 236Khnm3007273 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 6 Apr 2022 16:43:49 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Wed, 6 Apr 2022 16:43:49 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: Bob Friesenhahn , egoitz@ramattack.net Cc: freebsd-fs@FreeBSD.org, freebsd-hackers@FreeBSD.org, Freebsd performance References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> From: mike tancsa In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KYc1X2RkDz4gKb X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.18 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.78)[-0.782]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 4/6/2022 4:18 PM, Bob Friesenhahn wrote: > On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: >>> >>> WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY >>> YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME >>> DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER >>> DISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH >>> DIFFERENT CPU COSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... > > There seems to be a problem with your caps-lock key. > > Since it seems that you said that you are using maildir for your mail > server, it is likely very useful if you do enable even rather mild > compression (e.g. lz4) since this will reduce the write work-load and > even short files will be stored more efficiently. > FYI, a couple of our big zfs  mailspools sees a 1.24x and 1.23x compress ratio with lz4.  We use Maildir format as well.  They are not RELENG_13 so not sure how zstd would fair.     ---Mike From nobody Wed Apr 6 21:49:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4B1871AA6E8B; Wed, 6 Apr 2022 21:49:21 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYdSx1J3Rz3BqT; Wed, 6 Apr 2022 21:49:21 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649281761; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=NTQDA7AmEiqtZXUltjZC6r1zqKWrWLTuqyQu/QurDx8=; b=gb/sw9et6KM9TPLK36zERnOOE6ihAh7FHW0Z5Fgu10FhytX/Y4J4Pnd4u2AlvMSr8DL7Kg iRDaVGq2tiA5Yz7RzmwkeTQxw3flBHgJmswMtg8EOC1gl/L6SIqgBKMVJ4ICBWBxc95STj fSxZCei8tWY+Pwm4+qpUrzivT6+QMaMMm2ig9Wlk6oFlv+yEKwmxiHaqhQpVVpPCqystKX 1MPoTCNvMJgUU7gyYkTGWICu5UvV4fBq9gtF1ErEGXDeqCQ1w3ENkbV79lPsZ6knddmHRz 6YK0Vv0o6WEPzjboA8bpJY6rC5cS6KIfq81o7l4IM/VRAkx566gjymcWXm8a9g== Received: from [IPV6:2003:cd:5f22:6f00:953e:7ee1:500e:87a1] (p200300cd5f226f00953e7ee1500e87a1.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:953e:7ee1:500e:87a1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 176914D30; Wed, 6 Apr 2022 21:49:19 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: Date: Wed, 6 Apr 2022 23:49:15 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> From: Stefan Esser In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------Lic1usorjc8S7FifC6L0nUmq" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649281761; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=NTQDA7AmEiqtZXUltjZC6r1zqKWrWLTuqyQu/QurDx8=; b=v5/9q0D36uM6by3oYOW443+rDA3y21ugXHLeseeuzJs6uALdA6p7lQNGhL/K5PLN0SncDG Ze2s0aAILCb2FaUJDRp5csshI8Bd9nT+L5jXZJrOKJ7L4RHetAoNVXCj2/Onql93fRJft7 0IIaiCTwWEkQWgpWvpqm8VhLvNkr1LlxW5Ml6Oh7uxJgefQH/r0Y5jKry+tmSeRtIvNAdc 2kaZJrECFKqL+zOJeb5qObc1ss0F4ViPi/wrPL3DXSGn6Cc2J/hdU6A18B4fGGMJEtVOeJ +Ln/wIfCbLW+CMB3b86IlBeIF6YaestXttvguHQa68/IgnQl+mCKQ9TkFYvjqw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649281761; a=rsa-sha256; cv=none; b=KT9L8BUHeIW4nZrivqVSEpnzwZ2veeKiP2ovXRvBoh2v+loi8Ts72fDcwkndPNSnqlNzPQ CD1E9/NP2epXmB33xK+oL9fJN1k0ZbmLf9uC8jasQwU77EQM7jKDKbuLu1rSHhNC2Avw3r Q+0lAxAyhzDjMAoF4MoAND7D7RAMkOLMeRvKMjRnYKV4FMCLtN+LTtXs2bLcr+j+hQ74Rv D1mKpI60anTgLJDuSxe0ScgthHQ1MpvgjLUTRFPuB/g1Bz10QS/jTP/IAWKkWua97/6hQV PCaznQuyUuI+N+IFFpJ2JhW1zuQfJUgJMP3Vt4tzVxYuM1WPzVcSeYA0EMUtRA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------Lic1usorjc8S7FifC6L0nUmq Content-Type: multipart/mixed; boundary="------------OGljiRSjG08yilMHhaNFyDtW"; protected-headers="v1" From: Stefan Esser To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Message-ID: Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> In-Reply-To: --------------OGljiRSjG08yilMHhaNFyDtW Content-Type: multipart/alternative; boundary="------------ASZf2V7VPlu8lceG03SodTv5" --------------ASZf2V7VPlu8lceG03SodTv5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 06.04.22 um 18:34 schrieb egoitz@ramattack.net: > Hi Stefan! > > Thank you so much for your answer!!. I do answer below in green bold fo= r > instance... for a better distinction.... > > Very thankful for all your comments Stefan!!! :) :) :) > > Cheers!! > Hi, glad to hear that it is useful information - I'll add comments below ... > El 2022-04-06 17:43, Stefan Esser escribi=C3=B3: > >> ATENCION >> ATENCION >> ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. = No >> pinche en los enlaces ni abra los adjuntos a no ser que reconozca el >> remitente y sepa que el contenido es seguro. >> >> Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: >>> Hi Rainer! >>> >>> Thank you so much for your help :) :) >>> >>> Well I assume they are in a datacenter and should not be a power outa= ge.... >>> >>> About dataset size... yes... our ones are big... they can be 3-4 TB e= asily each >>> dataset..... >>> >>> We bought them, because as they are for mailboxes and mailboxes grow = and >>> grow.... for having space for hosting them... >> >> Which mailbox format (e.g. mbox, maildir, ...) do you use? >> =C2=A0 >> *I'm running Cyrus imap so sort of Maildir... too many little files >> normally..... Sometimes directories with tons of little files....* Assuming that many mails are much smaller than the erase block size of th= e SSD, this may cause issues. (You may know the following ...) For example, if you have message sizes of 8 KB and an erase block size of= 64 KB (just guessing), then 8 mails will be in an erase block. If half the mail= s are deleted, then the erase block will still occupy 64 KB, but only hold 32 K= B of useful data (and the SSD will only be aware of this fact if TRIM has sign= aled which data is no longer relevant). The SSD will copy several partially fi= lled erase blocks together in a smaller number of free blocks, which then are = fully utilized. Later deletions will repeat this game, and your data will be co= pied multiple times until it has aged (and the user is less likely to delete f= urther messages). This leads to "write amplification" - data is internally moved= around and thus written multiple times. Larger mails are less of an issue since they span multiple erase blocks, = which will be completely freed when such a message is deleted. Samsung has a lot of experience and generally good strategies to deal wit= h such a situation, but SSDs specified for use in storage systems might be much = better suited for that kind of usage profile. >>> We knew they had some speed issues, but those speed issues, we though= t (as >>> Samsung explains in the QVO site) they started after exceeding the sp= eeding >>> buffer this disks have. We though that meanwhile you didn't exceed it= 's >>> capacity (the capacity of the speeding buffer) no speed problem arise= s. Perhaps >>> we were wrong?. >> >> These drives are meant for small loads in a typical PC use case, >> i.e. some installations of software in the few GB range, else only >> files of a few MB being written, perhaps an import of media files >> that range from tens to a few hundred MB at a time, but less often >> than once a day. >> =C2=A0 >> *We move, you know... lots of little files... and lot's of different >> concurrent modifications by 1500-2000 concurrent imap connections we h= ave...* I do not expect the read load to be a problem (except possibly when the S= SD is moving data from SLC to QLC blocks, but even then reads will get priority= ). But writes and trims might very well overwhelm the SSD, especially when its g= etting full. Keeping a part of the SSD unused (excluded from the partitions crea= ted) will lead to a large pool of unused blocks. This will reduce the write amplification - there are many free blocks in the "unpartitioned part" of= the SSD, and thus there is less urgency to compact partially filled blocks. (= E.g. if you include only 3/4 of the SSD capacity in a partition used for the Z= POOL, then 1/4 of each erase block could be free due to deletions/TRIM without = any compactions required to hold all this data.) Keeping a significant percentage of the SSD unallocated is a good strateg= y to improve its performance and resilience. >> As the SSD fills, the space available for the single level write >> cache gets smaller >> =C2=A0 >> *The single level write cache is the cache these ssd drivers have, for= >> compensating the speed issues they have due to using qlc memory?. Do y= ou >> refer to that?. Sorry I don't understand well this paragraph.* Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC c= ache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as 24 = GB of data in QLC mode. A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (600= GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells). Therefore, the fraction of the cells used as an SLC cache is reduced when= it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cells).= And with less SLC cells available for short term storage of data the probability of data being copied to QLC cells before the irrelevant messa= ges have been deleted is significantly increased. And that will again lead to= many more blocks with "holes" (deleted messages) in them, which then need to b= e copied possibly multiple times to compact them. >> (on many SSDs, I have no numbers for this >> particular device), and thus the amount of data that can be >> written at single cell speed shrinks as the SSD gets full. >> =C2=A0 >> >> >> I have just looked up the size of the SLC cache, it is specified >> to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB >> version, smaller models will have a smaller SLC cache). >> =C2=A0 >> *Assuming you were talking about the cache for compensating speed we >> previously commented, I should say these are the 870 QVO but the 8TB >> version. So they should have the biggest cache for compensating the sp= eed >> issues...* I have looked up the data: the larger versions of the 870 QVO have the sa= me SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB more = if there are enough free blocks. >> But after writing those few GB at a speed of some 500 MB/s (i.e. >> after 12 to 150 seconds), the drive will need several minutes to >> transfer those writes to the quad-level cells, and will operate >> at a fraction of the nominal performance during that time. >> (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the >> 2 TB model.) >> =C2=A0 >> *Well we are in the 8TB model. I think I have understood what you wrot= e in >> previous paragraph. You said they can be fast but not constantly, beca= use >> later they have to write all that to their perpetual storage from the = cache. >> And that's slow. Am I wrong?. Even in the 8TB model you think Stefan?.= * The controller in the SSD supports a given number of channels (e.g 4), ea= ch of which can access a Flash chip independently of the others. Small SSDs oft= en have less Flash chips than there are channels (and thus a lower throughpu= t, especially for writes), but the larger models often have more chips than channels and thus the performance is capped. In the case of the 870 QVO, the controller supports 8 channels, which all= ows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has only = 4 Flash chips and is thus limited to 80 MB/s in that situation, while the l= arger versions have 8, 16, or 32 chips. But due to the limited number of channe= ls, the write rate is limited to 160 MB/s even for the 8 TB model. If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in this= limit. >> *The main problem we are facing is that in some peak moments, when the= >> machine serves connections for all the instances it has, and only as s= aid in >> some peak moments... like the 09am or the 11am.... it seems the machin= e >> becomes slower... and like if the disks weren't able to serve all they= have >> to serve.... In these moments, no big files are moved... but as we hav= e >> 1800-2000 concurrent imap connections... normally they are doing each = one... >> little changes in their mailbox. Do you think perhaps this disks then = are >> not appropriate for this kind of usage?-* I'd guess that the drives get into a state in which they have to recycle = lots of partially free blocks (i.e. perform kind of a garbage collection) and = then three kinds of operations are competing with each other: 1. reads (generally prioritized) 2. writes (filling the SLC cache up to its maximum size) 3. compactions of partially filled blocks (required to make free blocks available for re-use) Writes can only proceed if there are sufficient free blocks, which on a f= illed SSD with partially filled erase blocks means that operations of type 3. n= eed to be performed with priority to not stall all writes. My assumption is that this is what you are observing under peak load. >> And cheap SSDs often have no RAM cache (not checked, but I'd be >> surprised if the QVO had one) and thus cannot keep bookkeeping date >> in such a cache, further limiting the performance under load. >> =C2=A0 >> *This brochure >> (https://semiconductor.samsung.com/resources/brochure/870_Series_Broch= ure.pdf >> and the datasheet >> https://semiconductor.samsung.com/resources/data-sheet/Samsung_SSD_870= _QVO_Data_Sheet_Rev1.1.pdf) >> sais if I have read properly, the 8TB drive has 8GB of ram?. I assume = that >> is what they call the turbo write cache?.* No, the turbo write cache consists of the cells used in SLC mode (which c= an be any cells, not only cells in a specific area of the flash chip). The RAM is needed for fast lookup of the position of data for reads and o= f free blocks for writes. There is no simple relation between SSD "block number" (in the sense of a= disk block on some track of a magnetic disk) and its storage location on the F= lash chip. If an existing "data block" (what would be a sector on a hard disk = drive) is overwritten, it is instead written at the end of an "open" erase block= , and a pointer from that "block number" to the location on the chip is stored = in an index. This index is written to Flash storage and could be read from it, = but it is much faster to have a RAM with these pointers that can be accessed independently of the Flash chips. This RAM is required for high transacti= on rates (especially random reads), but it does not really help speed up wri= tes. >> And the resilience (max. amount of data written over its lifetime) >> is also quite low - I hope those drives are used in some kind of >> RAID configuration. >> =C2=A0 >> *Yep we use raidz-2* Makes sense ... But you know that you multiply the amount of data written= due to the redundancy. If a single 8 KB block is written, for example, 3 * 8 KB will written if = you take the 2 redundant copies into account. >> The 870 QVO is specified for 370 full capacity >> writes, i.e. 370 TB for the 1 TB model. That's still a few hundred >> GB a day - but only if the write amplification stays in a reasonable >> range ... >> =C2=A0 >> *Well yes... 2880TB in our case....not bad.. isn't it?* I assume that 2880 TB is your total storage capacity? That's not too bad,= in fact. ;-) This would be 360 * 8 TB ... Even at 160 MB/s per 8 TB SSD this would allow for more than 50 GB/s of w= rite throughput (if all writes were evenly distributed). Taking all odds into account, I'd guess that at least 10 GB/s can be continuously written (if supported by the CPUs and controllers). But this may not be true if the drive is simultaneously reading, trimming= , and writing ... I have seen advice to not use compression in a high load scenario in some= other reply. I tend to disagree: Since you seem to be limited when the SLC cache is exhausted, you should get better performance if you compress your data. I= have found that zstd-2 works well for me (giving a significant overall reducti= on of size at reasonable additional CPU load). Since ZFS allows to switch compressions algorithms at any time, you can experiment with different algorithms and levels. One advantage of ZFS compression is that it applies to the ARC, too. And = a compression factor of 2 should easily be achieved when storing mail (not = for =2Edocx, .pdf, .jpg files though). Having more data in the ARC will reduc= e the read pressure on the SSDs and will give them more cycles for garbage collections (which are performed in the background and required to always= have a sufficient reserve of free flash blocks for writes). I'd give it a try - and if it reduces your storage requirements by 10% on= ly, then keep 10% of each SSD unused (not assigned to any partition). That wi= ll greatly improve the resilience of your SSDs, reduce the write-amplificati= on, will allow the SLC cache to stay at its large value, and may make a large= difference to the effective performance under high load. Regards, STefan ** --------------ASZf2V7VPlu8lceG03SodTv5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Am 06.04.22 um 18:34 schrieb egoitz@ramattack.net:

Hi Stefan!

Thank you so much for your answer!!. I do answer below in green bold for instance... for a better distinction....

Very thankful for all your comments Stefan!!! :) :) :)

Cheers!!

Hi,

glad to hear that it is useful information - I'll add comments below ...

El 2022-04-06 17:43, Stefan Esser escribi=C3=B3:

ATENCION
ATENCION
ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro.

Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net:
Hi Rainer!

Thank you so much for your help :) :)

Well I assume they are in a datacenter and should not be a power outage....

About dataset size... yes... our ones are big... they can be 3-4 TB easily each
dataset.....

We bought them, because as they are for mailboxes and mailboxes grow and
grow.... for having space for hosting them...

Which mailbox format (e.g. mbox, maildir, ...) do you use?
=C2=A0
I'm running Cyrus imap so sort of Maildir... too many little files normally..... Sometimes directories with tons of little files....

Assuming that many mails are much smaller than the erase block size of the SSD, this may cause issues. (You may know the following ...)

For example, if you have message sizes of 8 KB and an erase block size of 64 KB (just guessing), then 8 mails will be in an erase block. If half the mails are deleted, then the erase block will still occupy 64 KB, but only hold 32 KB of useful data (and the SSD will only be aware of this fact if TRIM has signaled which data is no longer relevant). The SSD will copy several partially filled erase blocks together in a smaller number of free blocks, which then are fully utilized. Later deletions will repeat this game, and your data will be copied multiple times until it has aged (and the user is less likely to delete further messages). This leads to "write amplification" - data is internally moved around and thus written multiple times.

Larger mails are less of an issue since they span multiple erase blocks, which will be completely freed when such a message is deleted.

Samsung has a lot of experience and generally good strategies to deal with such a situation, but SSDs specified for use in storage systems might be much better suited for that kind of usage profile.

We knew they had some speed issues, but those speed issues, we thought (as
Samsung explains in the QVO site) they started after exceeding the speeding
buffer this disks have. We though that meanwhile you didn't exceed it's
capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps
we were wrong?.

These drives are meant for small loads in a typical PC use case,
i.e. some installations of software in the few GB range, else only
files of a few MB being written, perhaps an import of media files
that range from tens to a few hundred MB at a time, but less often
than once a day.
=C2=A0
We move, you= know... lots of little files... and lot's of different concurrent modifications by 1500-2000 concurrent imap connections we have...

I do not expect the read load to be a problem (except possibly when the SSD is moving data from SLC to QLC blocks, but even then reads will get priority). But writes and trims might very well overwhelm the SSD, especially when its getting full. Keeping a part of the SSD unused (excluded from the partitions created) will lead to a large pool of unused blocks. This will reduce the write amplification - there are many free blocks in the "unpartitioned part" of the SSD, and thus there is less urgency to compact partially filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a partition used for the ZPOOL, then 1/4 of each erase block could be free due to deletions/TRIM without any compactions required to hold all this data.)

Keeping a significant percentage of the SSD unallocated is a good strategy to improve its performance and resilience.

As the SSD fills, the space available for the single level write
cache gets smaller
=C2=A0
The single level write cache is the cache these ssd drivers have, for compensating the speed issues they have due to using qlc memory?. Do you refer to that?. Sorry I don't understand well this paragraph.

Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as 24 GB of data in QLC mode.

A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (600 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells).

Therefore, the fraction of the cells used as an SLC cache is reduced when it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cells).

And with less SLC cells available for short term storage of data the probability of data being copied to QLC cells before the irrelevant messages have been deleted is significantly increased. And that will again lead to many more blocks with "holes" (deleted messages) in them, which then need to be copied possibly multiple times to compact them.

(on many SSDs, I have no numbers for this
particular device), and thus the amount of data that can be
written at single cell speed shrinks as the SSD gets full.
=C2=A0


I have just looked up the size of the SLC cache, it is specified
to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB
version, smaller models will have a smaller SLC cache).
=C2=A0
Assuming you= were talking about the cache for compensating speed we previously commented, I should say these are the 870 QVO but the 8TB version. So they should have the biggest cache for compensating the speed issues...

I have looked up the data: the larger versions of the 870 QVO have the same SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB more if there are enough free blocks.

But after writing those few GB at a speed of some 500 MB/s (i.e.
after 12 to 150 seconds), the drive will need several minutes to
transfer those writes to the quad-level cells, and will operate
at a fraction of the nominal performance during that time.
(QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the
2 TB model.)
=C2=A0
Well we are in the 8TB model. I think I have understood what you wrote in previous paragraph. You said they can be fast but not constantly, because later they have to write all that to their perpetual storage from the cache. And that's slow. Am I wrong?. Even in the 8TB model you think Stefan?.

The controller in the SSD supports a given number of channels (e.g 4), each of which can access a Flash chip independently of the others. Small SSDs often have less Flash chips than there are channels (and thus a lower throughput, especially for writes), but the larger models often have more chips than channels and thus the performance is capped.

In the case of the 870 QVO, the controller supports 8 channels, which allows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has only 4 Flash chips and is thus limited to 80 MB/s in that situation, while the larger versions have 8, 16, or 32 chips. But due to the limited number of channels, the write rate is limited to 160 MB/s even for the 8 TB model.

If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in this limit.

The main problem we are facing is that in some peak moments, when the machine serves connections for all the instances it has, and only as said in some peak moments... like the 09am or the 11am.... it seems the machine becomes slower... and like if the disks weren't able to serve all they have to serve.... In these moments, no big files are moved... but as we have 1800-2000 concurrent imap connections... normally they are doing each one... little changes in their mailbox. Do you think perhaps this disks then are not appropriate for this kind of usage?-<= /span>

I'd guess that the drives get into a state in which they have to recycle lots of partially free blocks (i.e. perform kind of a garbage collection) and then three kinds of operations are competing with each other:

  1. reads (generally prioritized)
  2. writes (filling the SLC cache up to its maximum size)
  3. compactions of partially filled blocks (required to make free blocks available for re-use)

Writes can only proceed if there are sufficient free blocks, which on a filled SSD with partially filled erase blocks means that operations of type 3. need to be performed with priority to not stall all writes.

My assumption is that this is what you are observing under peak load.

And cheap SSDs often have no RAM cache (not checked, but I'd be
surprised if the QVO had one) and thus cannot keep bookkeeping date
in such a cache, further limiting the performance under load.
=C2=A0
This brochur= e (= https://semiconductor.samsung.com/resources/brochure/870_Series_Brochure.= pdf and the datasheet https= ://semiconductor.samsung.com/resources/data-sheet/Samsung_SSD_870_QVO_Dat= a_Sheet_Rev1.1.pdf) sais if I have read properly, the 8TB drive has 8GB of ram?. I assume that is what they call the turbo write cache?.

No, the turbo write cache consists of the cells used in SLC mode (which can be any cells, not only cells in a specific area of the flash chip).

The RAM is needed for fast lookup of the position of data for reads and of free blocks for writes.

There is no simple relation between SSD "block number" (in the sense of a disk block on some track of a magnetic disk) and its storage location on the Flash chip. If an existing "data block" (what would be a sector on a hard disk drive) is overwritten, it is instead written at the end of an "open" erase block, and a pointer from that "block number" to the location on the chip is stored in an index. This index is written to Flash storage and could be read from it, but it is much faster to have a RAM with these pointers that can be accessed independently of the Flash chips. This RAM is required for high transaction rates (especially random reads), but it does not really help speed up writes.

And the resilience (max. amount of data written over its lifetime)
is also quite low - I hope those drives are used in some kind of
RAID configuration.
=C2=A0
Yep we use raidz-2

Makes sense ... But you know that you multiply the amount of data written due to the redundancy.

If a single 8 KB block is written, for example, 3 * 8 KB will written if you take the 2 redundant copies into account.

The 870 QVO is specified for 370 full capacity
writes, i.e. 370 TB for the 1 TB model. That's still a few hundred
GB a day - but only if the write amplification stays in a reasonable
range ...
=C2=A0
Well yes... 2880TB in our case....not bad.. isn't it?

I assume that 2880 TB is your total storage capacity? That's not too bad, in fact. ;-)

This would be 360 * 8 TB ...

Even at 160 MB/s per 8 TB SSD this would allow for more than 50 GB/s of write throughput (if all writes were evenly distributed).

Taking all odds into account, I'd guess that at least 10 GB/s can be continuously written (if supported by the CPUs and controllers).

But this may not be true if the drive is simultaneously reading, trimming, and writing ...


I have seen advice to not use compression in a high load scenario in some other reply.

I tend to disagree: Since you seem to be limited when the SLC cache is exhausted, you should get better performance if you compress your data. I have found that zstd-2 works well for me (giving a significant overall reduction of size at reasonable additional CPU load). Since ZFS allows to switch compressions algorithms at any time, you can experiment with different algorithms and levels.

One advantage of ZFS compression is that it applies to the ARC, too. And a compression factor of 2 should easily be achieved when storing mail (not for .docx, .pdf, .jpg files though). Having more data in the ARC will reduce the read pressure on the SSDs and will give them more cycles for garbage collections (which are performed in the background and required to always have a sufficient reserve of free flash blocks for writes).

I'd give it a try - and if it reduces your storage requirements by 10% only, then keep 10% of each SSD unused (not assigned to any partition). That will greatly improve the resilience of your SSDs, reduce the write-amplification, will allow the SLC cache to stay at its large value, and may make a large difference to the effective performance under high load.

Regards, STefan

--------------ASZf2V7VPlu8lceG03SodTv5-- --------------OGljiRSjG08yilMHhaNFyDtW-- --------------Lic1usorjc8S7FifC6L0nUmq Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJOCtsFAwAAAAAACgkQR+u171r99USt jAf+Jqn2i8WZUDjj7wNiYznxQzyyjhsmvUb2d7NygsZaC0lcdNuEpjkhWG+Cn7tc5mPuWkbP2nz0 HGpERxnAnf+6chQw6E/3ZXVKCBM+HdiVw1HpmnX91K5FiLecnPC8aD5VlFsrGg7LpTtKBLCwgwls ssSPRqJvI5wYZEsiGydp/nMcaJeruVOXpjwH7kUDy5HvANKOdtM3X2JJMxHbwPsqtbwo8nGAiE9r NaNLI9hO0Ljfud4rgCaHo0dWq9sD9zAKOvbmDbSGgQbgVXxgh2Oz+lVmfHfC6MMGcM57K1HJ+LnH QXhvEcKQif+HVq2LNpwkTRjJdY4a0ajeGSIFS5FXuA== =LAcb -----END PGP SIGNATURE----- --------------Lic1usorjc8S7FifC6L0nUmq-- From nobody Wed Apr 6 21:51:46 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1F4201A80E1B for ; Wed, 6 Apr 2022 21:51:56 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.133.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYdWr2TZfz3DG3 for ; Wed, 6 Apr 2022 21:51:52 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-438-uxGsQlFPNYqyaUv-mwsGsw-1; Wed, 06 Apr 2022 17:51:48 -0400 X-MC-Unique: uxGsQlFPNYqyaUv-mwsGsw-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.28; Wed, 6 Apr 2022 17:51:47 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.028; Wed, 6 Apr 2022 17:51:47 -0400 From: "Michael Jung (USER)" To: freebsd-fs Subject: RE: DRAID - Expansion and other issues Thread-Topic: DRAID - Expansion and other issues Thread-Index: AdhJtcngdXkAOXWiT1GRYc8ck+wOogAJ+eAAAAVKRrA= Date: Wed, 6 Apr 2022 21:51:46 +0000 Message-ID: <445f86785851483bb3400b63d4c654eb@MAIL-HUB.pai.local> References: In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_445f86785851483bb3400b63d4c654ebMAILHUBpailocal_" X-Rspamd-Queue-Id: 4KYdWr2TZfz3DG3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.133.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.75 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.957]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.133.197:from]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.997]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_445f86785851483bb3400b63d4c654ebMAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 QSBiaWcgdGhhbmsgeW91IHRvbyBSaWNoIGZvciBmaW5hbGx5IGxldHRpbmcgbWUgaGF2ZSBteSBK aW1teSBOZXV0cm9uIG1vbWVudCBvZmYgbGlzdC4NCg0KenBvb2xjb25jZXB0cyg3KSAoZnJvbSBj dXJyZW50LTE0KQ0KQSBkUkFJRCB3aXRoIE4gZGlza3Mgb2Ygc2l6ZSBYLCBEIGRhdGEgZGlza3Mg cGVyIHJlZHVuZGFuY3kgZ3JvdXAsIFAgcGFyaXR5IGxldmVsLCBhbmQgUw0KZGlzdHJpYnV0ZWQg aG90IHNwYXJlcyBjYW4gaG9sZCBhcHByb3hpbWF0ZWx5IChOLVMpKihELyhEK1ApKSpYIGJ5dGVz IGFuZCBjYW4gd2l0aHN0YW5kIFANCmRldmljZXMgZmFpbGluZyB3aXRob3V0IGxvc2luZyBkYXRh Lg0KDQpTbywgaWYgTiBpcyAxMCwgRCBpcyAyLCBQIGlzIDIsIFMgaXMgMCwgYW5kIFggaXMgMVQs IHdlIGdldDoNCg0KKDEwLTApICogKCgyLygyKzIpKSAqIDFUKQ0KPSAxMCAqICgyLzQpICogMVQN Cj0gNVQgZWZmZWN0aXZlIHN0b3JhZ2UgcGVyIHZkZXYuDQoNCiMjIFJBSURaMiBmb3IgY29tcGFy aXNvbg0KDQpyb290QGRyYWlkOi8gIyB6cG9vbCBkZXN0cm95IHRhbmsNCnJvb3RAZHJhaWQ6LyAj IHpwb29sIGNyZWF0ZSB0YW5rIHJhaWR6MiAvZGV2L2RhMTFwMSAvZGV2L2RhMTJwMSAvZGV2L2Rh MTNwMSAvZGV2L2RhMTRwMSAvZGV2L2RhMTVwMSAvZGV2L2RhMTZwMSAvZGV2L2RhMTdwMSAvZGV2 L2RhMThwMSAvZGV2L2RhMTlwMSAvZGV2L2RhMjBwMSAvZGV2L2RhMzZwMSAvZGV2L2RhMzdwMSAv ZGV2L2RhMzhwMSAvZGV2L2RhMzlwMSAvZGV2L2RhNDBwMSAvZGV2L2RhNDFwMSAvZGV2L2RhNDJw MSAvZGV2L2RhNDNwMSAvZGV2L2RhNDRwMSAvZGV2L2RhNDVwMQ0Kcm9vdEBkcmFpZDovICMgenBv b2wgYWRkIHRhbmsgc3BhcmUgL2Rldi9kYTQ2cDEgL2Rldi9kYTQ3cDENCm90QGRyYWlkOi8gIyBk ZiAtaCAvdGFuaw0KRmlsZXN5c3RlbSAgICBTaXplICAgIFVzZWQgICBBdmFpbCBDYXBhY2l0eSAg TW91bnRlZCBvbg0KdGFuayAgICAgICAgICAgMTZUICAgIDI1NksgICAgIDE2VCAgICAgMCUgICAg L3RhbmsgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDwtLS0tIDE2VEINCnJvb3RAZHJh aWQ6LyAjDQpyb290QGRyYWlkOi8gIyB6cG9vbCBsaXN0IC12IHRhbmsNCk5BTUUgICAgICAgICBT SVpFICBBTExPQyAgIEZSRUUgIENLUE9JTlQgIEVYUEFORFNaICAgRlJBRyAgICBDQVAgIERFRFVQ ICAgIEhFQUxUSCAgQUxUUk9PVA0KdGFuayAgICAgICAgMTguMVQgIDEuNjVNICAxOC4xVCAgICAg ICAgLSAgICAgICAgIC0gICAgIDAlICAgICAwJSAgMS4wMHggICAgT05MSU5FICAtDQogIHJhaWR6 Mi0wICAxOC4xVCAgMS42NU0gIDE4LjFUICAgICAgICAtICAgICAgICAgLSAgICAgMCUgIDAuMDAl ICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTExcDEgICAgICAtICAgICAgLSAgICAgIC0gICAgICAg IC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMTJwMSAg ICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg IC0gICAgT05MSU5FDQogICAgZGExM3AxICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAg ICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE0cDEgICAgICAt ICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAg IE9OTElORQ0KICAgIGRhMTVwMSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAg IC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGExNnAxICAgICAgLSAgICAg IC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJ TkUNCiAgICBkYTE3cDEgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAg ICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMThwMSAgICAgIC0gICAgICAtICAg ICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQog ICAgZGExOXAxICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTIwcDEgICAgICAtICAgICAgLSAgICAgIC0g ICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRh MzZwMSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAg LSAgICAgIC0gICAgT05MSU5FDQogICAgZGEzN3AxICAgICAgLSAgICAgIC0gICAgICAtICAgICAg ICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTM4cDEg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGRhMzlwMSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAg ICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0MHAxICAgICAg LSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAg ICBPTkxJTkUNCiAgICBkYTQxcDEgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhNDJwMSAgICAgIC0gICAg ICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05M SU5FDQogICAgZGE0M3AxICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAg ICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQ0cDEgICAgICAtICAgICAgLSAg ICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0K ICAgIGRhNDVwMSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQpzcGFyZSAgICAgICAgICAgLSAgICAgIC0gICAgICAt ICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgIC0NCiAgZGE0 NnAxICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAg IC0gICAgICAtICAgICBBVkFJTA0KICBkYTQ3cDEgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg ICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgIEFWQUlMDQpyb290QGRyYWlk Oi8gIw0KDQojIyBEcmFpZCBleHBhbnNpb24gd2l0aCBEaXN0cmlidXRlZCBzcGFyZXMNCg0KW3Jv b3RAZHJhaWQgL10jIHpwb29sIGNyZWF0ZSB0YW5rIGRyYWlkMjo4ZDoxMGM6MHMgL2Rldi9kYTEx cDEgL2Rldi9kYTEycDEgL2Rldi9kYTEzcDEgL2Rldi9kYTE0cDEgL2Rldi9kYTE1cDEgL2Rldi9k YTE2cDEgL2Rldi9kYTE3cDEgL2Rldi9kYTE4cDEgL2Rldi9kYTE5cDEgL2Rldi9kYTIwcDENClty b290QGRyYWlkIC9dIyB6cG9vbCBhZGQgdGFuayAgICBkcmFpZDI6OGQ6MTBjOjBzIC9kZXYvZGEz NnAxIC9kZXYvZGEzN3AxIC9kZXYvZGEzOHAxIC9kZXYvZGEzOXAxIC9kZXYvZGE0MHAxIC9kZXYv ZGE0MXAxIC9kZXYvZGE0MnAxIC9kZXYvZGE0M3AxIC9kZXYvZGE0NHAxIC9kZXYvZGE0NXAxDQpb cm9vdEBkcmFpZCAvXSMgenBvb2wgYWRkIHRhbmsgc3BhcmUgL2Rldi9kYTQ2cDEgL2Rldi9kYTQ3 cDENCltyb290QGRyYWlkIC9dIyBkZiAtaCAvdGFuaw0KRmlsZXN5c3RlbSAgICBTaXplICAgIFVz ZWQgICBBdmFpbCBDYXBhY2l0eSAgTW91bnRlZCBvbg0KdGFuayAgICAgICAgICAgMTRUICAgIDc2 N0sgICAgIDE0VCAgICAgMCUgICAgL3RhbmsgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IDwtLS0tIDE0VA0KW3Jvb3RAZHJhaWQgL10jIHpwb29sIGxpc3QgLXYgdGFuaw0KTkFNRSAgICAg ICAgICAgICAgICAgU0laRSAgQUxMT0MgICBGUkVFICBDS1BPSU5UICBFWFBBTkRTWiAgIEZSQUcg ICAgQ0FQICBERURVUCAgICBIRUFMVEggIEFMVFJPT1QNCnRhbmsgICAgICAgICAgICAgICAgMTgu MVQgIDcuNjJNICAxOC4xVCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAgICAwJSAgMS4wMHgg ICAgT05MSU5FICAtDQogIGRyYWlkMjo4ZDoxMGM6MHMtMCAgOS4wM1QgIDYuMDlNICA5LjAzVCAg ICAgICAgLSAgICAgICAgIC0gICAgIDAlICAwLjAwJSAgICAgIC0gICAgT05MSU5FDQogICAgZGEx MXAxICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMTJwMSAgICAgICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJ TkUNCiAgICBkYTEzcDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGExNHAxICAgICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGRhMTVwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE2 cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGExN3AxICAgICAgICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElO RQ0KICAgIGRhMThwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAg ICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE5cDEgICAgICAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg IC0gICAgT05MSU5FDQogICAgZGEyMHAxICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICBkcmFpZDI6 OGQ6MTBjOjBzLTEgIDkuMDNUICAxLjUyTSAgOS4wM1QgICAgICAgIC0gICAgICAgICAtICAgICAw JSAgMC4wMCUgICAgICAtICAgIE9OTElORQ0KICAgIGRhMzZwMSAgICAgICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJ TkUNCiAgICBkYTM3cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGEzOHAxICAgICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGRhMzlwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQw cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICBkYTQxcDEgICAgICAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5F DQogICAgZGE0MnAxICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhNDNwMSAgICAgICAgICAg ICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAg LSAgICBPTkxJTkUNCiAgICBkYTQ0cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg ICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0NXAx ICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAg ICAgIC0gICAgICAtICAgIE9OTElORQ0Kc3BhcmUgICAgICAgICAgICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgIC0N CiAgZGE0NnAxICAgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAg IC0gICAgICAtICAgICAgLSAgICAgIC0gICAgIEFWQUlMDQogIGRhNDdwMSAgICAgICAgICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAt ICAgICBBVkFJTA0KW3Jvb3RAZHJhaWQgL10jDQoNCiMjIyAgT25lIFBvb2wgd2l0aCBEaXN0cmli dXRlZCBzcGFyZXMNCg0KW3Jvb3RAZHJhaWQgL10jIHpwb29sIGNyZWF0ZSB0YW5rIGRyYWlkMjox OGQ6MjBjOjBzIC9kZXYvZGExMXAxIC9kZXYvZGExMnAxIC9kZXYvZGExM3AxIC9kZXYvZGExNHAx IC9kZXYvZGExNXAxIC9kZXYvZGExNnAxIC9kZXYvZGExN3AxIC9kZXYvZGExOHAxIC9kZXYvZGEx OXAxIC9kZXYvZGEyMHAxIC9kZXYvZGEzNnAxIC9kZXYvZGEzN3AxIC9kZXYvZGEzOHAxIC9kZXYv ZGEzOXAxIC9kZXYvZGE0MHAxIC9kZXYvZGE0MXAxIC9kZXYvZGE0MnAxIC9kZXYvZGE0M3AxIC9k ZXYvZGE0NHAxIC9kZXYvZGE0NXAxDQpbcm9vdEBkcmFpZCAvXSMgenBvb2wgYWRkIHRhbmsgc3Bh cmUgL2Rldi9kYTQ2cDEgL2Rldi9kYTQ3cDENCltyb290QGRyYWlkIC9dIyBkZiAtaCAvdGFuaw0K RmlsZXN5c3RlbSAgICBTaXplICAgIFVzZWQgICBBdmFpbCBDYXBhY2l0eSAgTW91bnRlZCBvbg0K dGFuayAgICAgICAgICAgMTRUICAgIDEuNU0gICAgIDE0VCAgICAgMCUgICAgL3RhbmsgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgIDwtLS0tIDE0VA0KW3Jvb3RAZHJhaWQgL10jIHpwb29s IGxpc3QgLXYgdGFuaw0KTkFNRSAgICAgICAgICAgICAgICAgIFNJWkUgIEFMTE9DICAgRlJFRSAg Q0tQT0lOVCAgRVhQQU5EU1ogICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRIICBBTFRST09U DQp0YW5rICAgICAgICAgICAgICAgICAxOC4xVCAgOS42MU0gIDE4LjFUICAgICAgICAtICAgICAg ICAgLSAgICAgMCUgICAgIDAlICAxLjAweCAgICBPTkxJTkUgIC0NCiAgZHJhaWQyOjE4ZDoyMGM6 MHMtMCAgMTguMVQgIDkuNjFNICAxOC4xVCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAwLjAw JSAgICAgIC0gICAgT05MSU5FDQogICAgZGExMXAxICAgICAgICAgICAgICAgLSAgICAgIC0gICAg ICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAg ICBkYTEycDEgICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAt ICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMTNwMSAgICAgICAgICAgICAg IC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0g ICAgT05MSU5FDQogICAgZGExNHAxICAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAg ICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE1cDEg ICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAg ICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMTZwMSAgICAgICAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5F DQogICAgZGExN3AxICAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAg ICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTE4cDEgICAgICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgIE9OTElORQ0KICAgIGRhMTlwMSAgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAg ICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGEy MHAxICAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTM2cDEgICAgICAgICAgICAgICAtICAg ICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9O TElORQ0KICAgIGRhMzdwMSAgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAg ICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGEzOHAxICAgICAg ICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAt ICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTM5cDEgICAgICAgICAgICAgICAtICAgICAgLSAgICAg IC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAg IGRhNDBwMSAgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0g ICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0MXAxICAgICAgICAgICAgICAg LSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAg ICBPTkxJTkUNCiAgICBkYTQycDEgICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAg IC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhNDNwMSAg ICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAg ICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0NHAxICAgICAgICAgICAgICAgLSAgICAgIC0g ICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUN CiAgICBkYTQ1cDEgICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAg ICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0Kc3BhcmUgICAgICAgICAgICAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAg IC0gICAgICAgICAtDQogIGRhNDZwMSAgICAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICAgQVZBSUwNCiAgZGE0N3Ax ICAgICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAtICAgICBBVkFJTA0KW3Jvb3RAZHJhaWQgL10jDQoNCg0KDQpGcm9tOiBS aWNoIFttYWlsdG86cmluY2VicmFpbkBnbWFpbC5jb21dDQpTZW50OiBXZWRuZXNkYXksIEFwcmls IDYsIDIwMjIgOTo0MyBBTQ0KVG86IE1pY2hhZWwgSnVuZyAoVVNFUikgPG1pa2VqQHBheW1lbnRh bGxpYW5jZWludGwuY29tPg0KU3ViamVjdDogUmU6IERSQUlEIC0gRXhwYW5zaW9uIGFuZCBvdGhl ciBpc3N1ZXMNCg0KSSdtIG5vdCBhbiBleHBlcnQgb24gZHJhaWQsIGJ1dCB5b3UgYXBwZWFyIHRv IGhhdmUgZGVmaW5lZCB0d28gZHJhaWQgdmRldnMgd2l0aCBhIHJhdGlvIG9mIDIgZGF0YSBkaXNr cyB0byAyIHBhcml0eSBkaXNrcyBmb3IgdGhlIGludGVybmFsICJyZWR1bmRhbmN5IGdyb3VwcyIs IHNvIDUwJSBvdmVyaGVhZCBzZWVtcyBwYXIgZm9yIHRoZSBjb3Vyc2UsIG11Y2ggbGlrZSBpZiB5 b3UgaGFkIGRlZmluZWQgNC1kaXNrIHJhaWR6MiB2ZGV2cy4NCg0KLSBSaWNoDQoNCk9uIFdlZCwg QXByIDYsIDIwMjIgYXQgOToyMiBBTSBNaWNoYWVsIEp1bmcgKFVTRVIpIDxtaWtlakBwYXltZW50 YWxsaWFuY2VpbnRsLmNvbTxtYWlsdG86bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5jb20+PiB3 cm90ZToNCkhpIQ0KDQpJIHN0YXJ0ZWQgcGxheWluZyB3aXRoIGRyYWlkIHNvbWUgbW9udGhzIGFn byBhbmQgSSBoYXZlIGEgcHJvYmxlbSBJIGNhbm5vdCBmaWd1cmUgb3V0Lg0KDQpJIHN0YXJ0ZWQg b3V0IHdpdGggYSBzaW5nbGUgZHJhaWQyOjJkOjEwYzowcyBhbmQgbGlmZSB3YXMgZ29vZC4gIFJh biBzb21lIHRlc3RzLCBhZGRlZA0KYSBzcGVjaWFsIGRldmljZSBhbmQgbGlmZSB3YXMgYmV0dGVy LiBUaGVuIEkgZXhwYW5kZWQgdGhlIHBvb2wgYnkgYWRkaW5nIGFub3RoZXINCmRyYWlkMjoyZDox MGM6MHMuICBOb3cgdGhlIHByb2JsZW06IHRoZSBwb29sIHNheXMgaXQgaGFzIH4xOFRCIHdvcnRo IG9mIHNwYWNlLCB0aGUNCmZpbGUgc3lzdGVtIG9ubHkgc2hvd3MgfjlUQi4gSXQgZGlkIG5vdCBh dXRvLWV4cGFuZC4NCg0KSeKAmW0gY3VycmVudGx5IG9uIG1haW4tbjI1Mzg3NS04ZTcyZjQ1OGM2 ZDogYnV0IEkgaW5pdGlhbGx5IHNwdW4gdGhpcyB1cCBqdXN0IGFmdGVyDQpEUkFJRCB3YXMgYnJv dWdodCBJbnRvIHRoZSB0cmVlLCBhdCBsZWFzdCB3aGVuIEkgYmVjYW1lIGF3YXJlIG9mIGl0LiBJ IGhhdmUgdHJpZWQNCmluZGl2aWR1YWxseSBvbiBsaW5pbmcgZGV2aWNlcyBpbiB0aGUgcG9vbCB3 aXRoIOKAnC1l4oCdLCBleHBvcnRpbmcvaW1wb3J0aW5nIHRoZSBwb29sIGV0Yy4NCmFuZCBiYXNp Y2FsbHkgZXZlcnkgc3VnZ2VzdGlvbiBteSDigJxnb29nbGUgZm9v4oCdIHdvdWxkIGxlYWQgbWUg dG8uDQoNCkkgaGF2ZSBubyB1c2VmdWwgZGF0YSBvbiB0aGlzIHBvb2wgYW5kIEkgY2FuIGRlc3Ry b3kgYW5kIHJlLWNyZWF0ZSBpdCBidXQgSSB3b3VsZA0KbGlrZSB0byBzYXZlIHNvbWUgdGltZSBh bmQgZ2V0IG9waW5pb25zIG9yIGZhY3Qgb246DQoNCkNhbiBhIGRyYWlkIHBvb2wgYmUgZXhwYW5k ZWQgYWZ0ZXIgYSBzcGVjaWFsIGRldmljZSBoYXMgYmVlbiBhZGRlZD8gIEl0IHdvdWxkIHNlZW0g c28NCmJ1dCB0aGUgZmlsZXN5c3RlbSBkb2VzIG5vdCByZWZsZWN0IHRoYXQuPw0KDQpXaGF0IGF0 IGlzIHRoZSBjb3JyZWN0IHdheSB0byB3aXJlIGRvd24gdGhlIGZvbGxvd2luZyDigJMgSSBoYWQg cHJvYmxlbXMgYWZ0ZXIgbm90IGRvaW5nDQp0aGlzIHNpbmNlIHRoZSAyLnggZGF5cyBhbmQgd291 bGQgcmVhbGx5IHdhbnQgdG8gd2lyZSBkb3duIG15IGRyYWlkIGRldmljZXMgbm93DQp0aGF0IEkg aGF2ZSBvdGhlciBwb29scy4NCg0KSSBoYXZlIHBvb2wgY29uc3RydWN0aW9uIGFsbCBzY3JpcHRl ZCBidXQgb2YgY291cnNlIEkgd2FudCBwaHlzaWNhbCBkaXNrIGRhPHg+IHRvIGFsd2F5cyBiZQ0K Y29uc2lzdGVudC4gVGhlbiBJIGVhc2lseSB0ZXN0IGFueSBjb25zdHJ1Y3Qgc29tZW9uZSBjb21l cyB1cCB3aXRoLg0KDQpyb290QGRyYWlkOi9ob21lL21pa2VqICMgY2FtY29udHJvbCBkZXZsaXN0 IC1iDQpzY2J1czAgb24gYXRhMCBidXMgMA0Kc2NidXMxIG9uIGF0YTEgYnVzIDANCnNjYnVzMiBv biBtcHQwIGJ1cyAwDQpzY2J1czMgb24gbXBzMCBidXMgMCAgIDwtLQ0Kc2NidXM0IG9uIGNhbXNp bTAgYnVzIDANCnNjYnVzLTEgb24geHB0MCBidXMgMA0Kcm9vdEBkcmFpZDovaG9tZS9taWtlaiAj DQoNCg0KPGRtZXNnPg0KbXBzMDogPEF2YWdvIFRlY2hub2xvZ2llcyAoTFNJKSBTQVMyMDA4PiBw b3J0IDB4NTAwMC0weDUwZmYgbWVtIDB4ZmQ0ZmMwMDAtMHhmZDRmZmZmZiwweGZkNDgwMDAwLTB4 ZmQ0YmZmZmYgaXJxIDE5IGF0IGRldmljZSAwLjAgb24gcGNpNA0KbXBzMDogRmlybXdhcmU6IDIw LjAwLjA0LjAwLCBEcml2ZXI6IDIxLjAyLjAwLjAwLWZic2QNCm1wczA6IElPQ0NhcGFiaWxpdGll czogMTI4NWM8U2NzaVRhc2tGdWxsLERpYWdUcmFjZSxTbmFwQnVmLEVFRFAsVHJhbnNSZXRyeSxF dmVudFJlcGxheSxIb3N0RGlzYz4NCg0KPGNhbWNvbnRyb2w+DQo8U0VBR0FURSBTVDkxMDAwNjQw U1MgQVMwOT4gICAgICAgIGF0IHNjYnVzMyB0YXJnZXQgNjMgbHVuIDAgKGRhNDIscGFzczM1KQ0K PFNFQUdBVEUgU1Q5MTAwMDY0MFNTIEFTMDk+ICAgICAgICBhdCBzY2J1czMgdGFyZ2V0IDY3IGx1 biAwIChkYTQ2LHBhc3MzOSkNCjxTRUFHQVRFIFNUOTEwMDA2NDBTUyBBUzA4PiAgICAgICAgYXQg c2NidXMzIHRhcmdldCA2OCBsdW4gMCAoZGE0NyxwYXNzNDApDQoNCkVYQU1QTEU6IElzIHRoaXMg Y29ycmVjdD8NCg0KaGludC5zY2J1cy4zLmF0PGh0dHA6Ly9oaW50LnNjYnVzLjMuYXQ+PeKAnW1w czDigJ0NCg0KaGludC5kYS40Mi5hdDxodHRwOi8vaGludC5kYS40Mi5hdD494oCdc2NidXMz4oCd DQpoaW50LmRhLjQyLnRhcmdldD3igJ02M+KAnQ0KaGludC5kYS40Mi51bml0PeKAnTDigJ0NCg0K aGludC5kYS40Ni5hdDxodHRwOi8vaGludC5kYS40Ni5hdD494oCdc2NidXMz4oCdDQpoaW50LmRh LjQ2LnRhcmdldD3igJ02N+KAnQ0KaGludC5kYS40Ni51bml0PeKAnTDigJ0NCg0KaGludC5kYS40 Ny5hdDxodHRwOi8vaGludC5kYS40Ny5hdD494oCdc2NidXMz4oCdDQpoaW50LmRhLjQ3LnRhcmdl dD3igJ02OOKAnQ0KaGludC5kYS40Ny51bml0PeKAnTAiDQoNCkkgd2lsbCB0cnkgYWdhaW4sIGJ1 dCB0aGlzIGRpZCBub3Qgc2VlbSB0byB3b3JrIGZvciBtZS4gIFRoaXMgaXMgbXkgaG9tZSBsYWIg YnV0IGl04oCZcw0Kbm93IHBhaW5mdWwgdG8gc3BpbiBkb3duIHRoaXMgaG9zdCBhcyBpdOKAmXMg YSBpU0NTSSB0YXJnZXQgZm9yIHNldmVyYWwgbWFjaGluZXMgZm9yIGENCkVTWGkgcHJvamVjdCBJ 4oCZbSB3b3JraW5nIG9uIHNvIEkgd291bGQgbGlrZSB0byBwdXQgd2lyZWQgZG93biBTQ1NJIGRl dmljZXMgdG8gcmVzdC4NCg0KQW5kIHllcywgSSBoYXZlIHNjaGVkdWxlZCBWTSBiYWNrdXBzIGZv ciBteSBwcm9qZWN0IHRvIGFub3RoZXIgZGF0YSBzdG9yZSB0aGF0IGlzIG5vdA0KdGhpcyBib3gg Oy0pDQoNCkl04oCZcyBhbHNvIG9kZCwgdGhhdCBJIGRpZCBub3QgZ2V0IGFsbCBHUFQgbGFiZWxz IGluIHRoZSB6cG9vbC4gQWxsIGRpc2tzIGhhdmUgR1BUIGxhYmVscy4NCg0KSSBoYXZlIGFkZGVk IGZvciB0aGUgbmV4dCByZWJvb3QgdG8gbG9hZGVyLmNvbmYuDQoNCmtlcm4uZ2VvbS5sYWJlbC5k aXNrX2lkZW50LmVuYWJsZT0iMCINCmtlcm4uZ2VvbS5sYWJlbC5ncHRpZC5lbmFibGU9IjENCg0K VGhpcyBpcyBhbiBvbGQgRGVsbCBNRC0xMDAwIHNoZWxmIEkgaGFkIGxheWluZyBhcm91bmQgd2l0 aCBhIGJ1bmNoIG9mIDFUQiBkcml2ZXMNCndoaWNoIEkgdGhvdWdodCB3b3VsZCBiZSBwZXJmZWN0 IGZvciBwbGF5aW5nIGFyb3VuZCB3aXRoIGRyYWlkLg0KDQptaWtlakBkcmFpZDp+ICQgenBvb2wg Z2V0IGFsbCB0YW5rIHwgZ3JlcCBleHBhbmQNCnRhbmsgIGF1dG9leHBhbmQgICAgICAgICAgICAg ICAgICAgICBvbiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbG9jYWwNCnRhbmsgIGV4cGFu ZHNpemUgICAgICAgICAgICAgICAgICAgICAtICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg LQ0KbWlrZWpAZHJhaWQ6fiAkIHpwb29sIGxpc3QgLXYgdGFuaw0KTkFNRSAgICAgICAgICAgICAg ICAgU0laRSAgQUxMT0MgICBGUkVFICBDS1BPSU5UICBFWFBBTkRTWiAgIEZSQUcgICAgQ0FQICBE RURVUCAgICBIRUFMVEggIEFMVFJPT1QNCnRhbmsgICAgICAgICAgICAgICAgMTguNVQgIDguMDJU ICAxMC40VCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAgIDQzJSAgMS4wMHggICAgT05MSU5F ICAtDQogIGRyYWlkMjoyZDoxMGM6MHMtMCAgOS4wM1QgIDQuMDZUICA0Ljk3VCAgICAgICAgLSAg ICAgICAgIC0gICAgIDAlICA0NC45JSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L2RhMHAxICAg ICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0g ICAgICAtICAgIE9OTElORQ0KICAgIGdwdC9kMTBwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAt ICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBk YTM5cDEgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAg ICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZGE0MHAxICAgICAgICAgICAgICAtICAg ICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9O TElORQ0KICAgIGRhNDFwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAg ICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQzcDEgICAgICAg ICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAg ICAgIC0gICAgT05MSU5FDQogICAgZGE0NHAxICAgICAgICAgICAgICAtICAgICAgLSAgICAgIC0g ICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRh NDJwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBkYTQ1cDEgICAgICAgICAgICAgIC0gICAg ICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05M SU5FDQogICAgZ3B0L2QxOXAxICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICBkcmFpZDI6MmQ6MTBjOjBz LTEgIDkuMDNUICAzLjk2VCAgNS4wN1QgICAgICAgIC0gICAgICAgICAtICAgICAwJSAgNDMuOCUg ICAgICAtICAgIE9OTElORQ0KICAgIGRhNDZwMSAgICAgICAgICAgICAgLSAgICAgIC0gICAgICAt ICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBn cHQvZDExcDEgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAg ICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L2QxMnAxICAgICAgICAgICAtICAg ICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9O TElORQ0KICAgIGdwdC9kMTNwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAg ICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBncHQvZDE0cDEgICAg ICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAg ICAgIC0gICAgT05MSU5FDQogICAgZ3B0L2QxNXAxICAgICAgICAgICAtICAgICAgLSAgICAgIC0g ICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGdw dC9kMTZwMSAgICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgLSAgICBPTkxJTkUNCiAgICBncHQvZDE3cDEgICAgICAgICAgIC0gICAg ICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05M SU5FDQogICAgZ3B0L2QxOHAxICAgICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElORQ0KICAgIGRhMThwMSAgICAgICAg ICAgICAgLSAgICAgIC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAg ICAgLSAgICBPTkxJTkUNCnNwZWNpYWwgICAgICAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAg ICAgICAgLSAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgICAgICAtDQogIG1pcnJv ci0zICAgICAgICAgICAzOThHICAyLjg2RyAgIDM5NUcgICAgICAgIC0gICAgICAgICAtICAgICAw JSAgMC43MSUgICAgICAtICAgIE9OTElORQ0KICAgIGdwdC9zcGVjaWFsMCAgICAgICAgLSAgICAg IC0gICAgICAtICAgICAgICAtICAgICAgICAgLSAgICAgIC0gICAgICAtICAgICAgLSAgICBPTkxJ TkUNCiAgICBncHQvc3BlY2lhbDEgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAg ICAgIC0gICAgICAtICAgICAgLSAgICAgIC0gICAgT05MSU5FDQpsb2dzICAgICAgICAgICAgICAg ICAgICAtICAgICAgLSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAg ICAtICAgICAgICAgLQ0KICBtaXJyb3ItMiAgICAgICAgICAxNS41RyAgIDI1NksgIDE1LjVHICAg ICAgICAtICAgICAgICAgLSAgICAgMCUgIDAuMDAlICAgICAgLSAgICBPTkxJTkUNCiAgICBncHQv c2xvZzAgICAgICAgICAgIC0gICAgICAtICAgICAgLSAgICAgICAgLSAgICAgICAgIC0gICAgICAt ICAgICAgLSAgICAgIC0gICAgT05MSU5FDQogICAgZ3B0L3Nsb2cxICAgICAgICAgICAtICAgICAg LSAgICAgIC0gICAgICAgIC0gICAgICAgICAtICAgICAgLSAgICAgIC0gICAgICAtICAgIE9OTElO RQ0KDQptaWtlakBkcmFpZDp+ICQgemZzIGdldCBtb3VudHBvaW50IHRhbmsNCk5BTUUgIFBST1BF UlRZICAgIFZBTFVFICAgICAgIFNPVVJDRQ0KdGFuayAgbW91bnRwb2ludCAgL3RhbmsgICAgICAg ZGVmYXVsdA0KDQoNCm1pa2VqQGRyYWlkOn4gJCBkZiAvdGFuaw0KRmlsZXN5c3RlbSAgMUstYmxv Y2tzICAgICAgIFVzZWQgICAgICBBdmFpbCBDYXBhY2l0eSAgTW91bnRlZCBvbg0KdGFuayAgICAg ICA5NTU4ODkyMDA0IDQzMDEzMTAyMjQgNTI1NzU4MTc4MCAgICA0NSUgICAgL3RhbmsgICA8LS0g fjlUQiBub3QgMThUQg0KbWlrZWpAZHJhaWQ6fiAkDQoNCm1pa2VqQGRyYWlkOn4gJCB6cG9vbCBs aXN0DQpOQU1FICAgICAgICAgIFNJWkUgIEFMTE9DICAgRlJFRSAgQ0tQT0lOVCAgRVhQQU5EU1og ICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRIICBBTFRST09UDQpjY2FjaGUgICAgICAgOS41 MEcgIDkuMTBHICAgNDA2TSAgICAgICAgLSAgICAgICAgIC0gICAgODklICAgIDk1JSAgMS4wMHgg ICAgT05MSU5FICAtDQpyYWlkLTU0MDAtMSAgNi4yOFQgIDEuMTlUICA1LjA5VCAgICAgICAgLSAg ICAgICAgIC0gICAgIDYlICAgIDE5JSAgMS4wMHggICAgT05MSU5FICAtDQp0YW5rICAgICAgICAg MTguNVQgIDguMDJUICAxMC40VCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAgIDQzJSAgMS4w MHggICAgT05MSU5FICAtICAgICAgICAgICA8LS0NCnpmc3Jvb3QgICAgICAgMTAzRyAgMzIuNkcg IDcwLjRHICAgICAgICAtICAgICAgICAgLSAgICAyNSUgICAgMzElICAxLjAweCAgICBPTkxJTkUg IC0NCm1pa2VqQGRyYWlkOn4gJA0KDQpUaGFua3MgaW4gYWR2YW5jZSBmb3IgYW55IGNvbW1lbnRz IG9yIHN1Z2Vzc3Rpb25zLg0KDQotLW1pa2VqDQoNCg0KDQoNCkNPTkZJREVOVElBTElUWSBOT1RF OiBUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVzZQ0Kb2YgdGhlIGluZGl2 aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBtYXkNCmNvbnRhaW4g aW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBjb25maWRlbnRpYWwsIGFuZA0KZXhlbXB0 IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYgdGhlIHJlYWRlcg0Kb2Yg dGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVi eQ0Kbm90aWZpZWQgdGhhdCBhbnkgZGlzc2VtaW5hdGlvbiwgZGlzdHJpYnV0aW9uIG9yIGNvcHlp bmcNCm9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkLiBJZiB5b3Ug aGF2ZQ0KcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3IsIHBsZWFzZSBub3RpZnkg dXMgYnkNCnRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAwMCBvciBub3RpZnkgdXMgYXQ6IFBBSSwg RGVwdC4gOTksDQoyMTAxIEhpZ2ggV2lja2hhbSBQbGFjZSwgU3VpdGUgMTAxLCBMb3Vpc3ZpbGxl LCBLWSA0MDI0NQ0KDQoNCg0KDQpEaXNjbGFpbWVyDQoNClRoZSBpbmZvcm1hdGlvbiBjb250YWlu ZWQgaW4gdGhpcyBjb21tdW5pY2F0aW9uIGZyb20gdGhlIHNlbmRlciBpcyBjb25maWRlbnRpYWwu IEl0IGlzIGludGVuZGVkIHNvbGVseSBmb3IgdXNlIGJ5IHRoZSByZWNpcGllbnQgYW5kIG90aGVy cyBhdXRob3JpemVkIHRvIHJlY2VpdmUgaXQuIElmIHlvdSBhcmUgbm90IHRoZSByZWNpcGllbnQs IHlvdSBhcmUgaGVyZWJ5IG5vdGlmaWVkIHRoYXQgYW55IGRpc2Nsb3N1cmUsIGNvcHlpbmcsIGRp c3RyaWJ1dGlvbiBvciB0YWtpbmcgYWN0aW9uIGluIHJlbGF0aW9uIG9mIHRoZSBjb250ZW50cyBv ZiB0aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQgYW5kIG1heSBiZSB1bmxh d2Z1bC4NCg0KVGhpcyBlbWFpbCBoYXMgYmVlbiBzY2FubmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3 YXJlLCBhbmQgbWF5IGhhdmUgYmVlbiBhdXRvbWF0aWNhbGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0 LCBhIGxlYWRlciBpbiBlbWFpbCBzZWN1cml0eSBhbmQgY3liZXIgcmVzaWxpZW5jZS4gTWltZWNh c3QgaW50ZWdyYXRlcyBlbWFpbCBkZWZlbnNlcyB3aXRoIGJyYW5kIHByb3RlY3Rpb24sIHNlY3Vy aXR5IGF3YXJlbmVzcyB0cmFpbmluZywgd2ViIHNlY3VyaXR5LCBjb21wbGlhbmNlIGFuZCBvdGhl ciBlc3NlbnRpYWwgY2FwYWJpbGl0aWVzLiBNaW1lY2FzdCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFu ZCBzbWFsbCBvcmdhbml6YXRpb25zIGZyb20gbWFsaWNpb3VzIGFjdGl2aXR5LCBodW1hbiBlcnJv ciBhbmQgdGVjaG5vbG9neSBmYWlsdXJlOyBhbmQgdG8gbGVhZCB0aGUgbW92ZW1lbnQgdG93YXJk IGJ1aWxkaW5nIGEgbW9yZSByZXNpbGllbnQgd29ybGQuIFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0 IG91ciB3ZWJzaXRlLg0KDQpEaXNjbGFpbWVyDQoNClRoZSBpbmZvcm1hdGlvbiBjb250YWluZWQg aW4gdGhpcyBjb21tdW5pY2F0aW9uIGZyb20gdGhlIHNlbmRlciBpcyBjb25maWRlbnRpYWwuIEl0 IGlzIGludGVuZGVkIHNvbGVseSBmb3IgdXNlIGJ5IHRoZSByZWNpcGllbnQgYW5kIG90aGVycyBh dXRob3JpemVkIHRvIHJlY2VpdmUgaXQuIElmIHlvdSBhcmUgbm90IHRoZSByZWNpcGllbnQsIHlv dSBhcmUgaGVyZWJ5IG5vdGlmaWVkIHRoYXQgYW55IGRpc2Nsb3N1cmUsIGNvcHlpbmcsIGRpc3Ry aWJ1dGlvbiBvciB0YWtpbmcgYWN0aW9uIGluIHJlbGF0aW9uIG9mIHRoZSBjb250ZW50cyBvZiB0 aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQgYW5kIG1heSBiZSB1bmxhd2Z1 bC4NCg0KVGhpcyBlbWFpbCBoYXMgYmVlbiBzY2FubmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3YXJl LCBhbmQgbWF5IGhhdmUgYmVlbiBhdXRvbWF0aWNhbGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0LCBh IGxlYWRlciBpbiBlbWFpbCBzZWN1cml0eSBhbmQgY3liZXIgcmVzaWxpZW5jZS4gTWltZWNhc3Qg aW50ZWdyYXRlcyBlbWFpbCBkZWZlbnNlcyB3aXRoIGJyYW5kIHByb3RlY3Rpb24sIHNlY3VyaXR5 IGF3YXJlbmVzcyB0cmFpbmluZywgd2ViIHNlY3VyaXR5LCBjb21wbGlhbmNlIGFuZCBvdGhlciBl c3NlbnRpYWwgY2FwYWJpbGl0aWVzLiBNaW1lY2FzdCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFuZCBz bWFsbCBvcmdhbml6YXRpb25zIGZyb20gbWFsaWNpb3VzIGFjdGl2aXR5LCBodW1hbiBlcnJvciBh bmQgdGVjaG5vbG9neSBmYWlsdXJlOyBhbmQgdG8gbGVhZCB0aGUgbW92ZW1lbnQgdG93YXJkIGJ1 aWxkaW5nIGEgbW9yZSByZXNpbGllbnQgd29ybGQuIFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0IG91 ciB3ZWJzaXRlLg0K --_000_445f86785851483bb3400b63d4c654ebMAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+DQo8bWV0YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRl eHQvaHRtbDsgY2hhcnNldD11dGYtOCI+DQo8bWV0YSBuYW1lPSJHZW5lcmF0b3IiIGNvbnRlbnQ9 Ik1pY3Jvc29mdCBXb3JkIDE1IChmaWx0ZXJlZCBtZWRpdW0pIj4NCjxzdHlsZT48IS0tDQovKiBG b250IERlZmluaXRpb25zICovDQpAZm9udC1mYWNlDQoJe2ZvbnQtZmFtaWx5OldpbmdkaW5nczsN CglwYW5vc2UtMTo1IDAgMCAwIDAgMCAwIDAgMCAwO30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1p bHk6IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9u dC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJcGFub3NlLTE6MiAxNSA1IDIgMiAyIDQg MyAyIDQ7fQ0KQGZvbnQtZmFjZQ0KCXtmb250LWZhbWlseTpWZXJkYW5hOw0KCXBhbm9zZS0xOjIg MTEgNiA0IDMgNSA0IDQgMiA0O30NCi8qIFN0eWxlIERlZmluaXRpb25zICovDQpwLk1zb05vcm1h bCwgbGkuTXNvTm9ybWFsLCBkaXYuTXNvTm9ybWFsDQoJe21hcmdpbjowaW47DQoJbWFyZ2luLWJv dHRvbTouMDAwMXB0Ow0KCWZvbnQtc2l6ZToxMi4wcHQ7DQoJZm9udC1mYW1pbHk6IlRpbWVzIE5l dyBSb21hbiIsc2VyaWY7fQ0KYTpsaW5rLCBzcGFuLk1zb0h5cGVybGluaw0KCXttc28tc3R5bGUt cHJpb3JpdHk6OTk7DQoJY29sb3I6Ymx1ZTsNCgl0ZXh0LWRlY29yYXRpb246dW5kZXJsaW5lO30N CmE6dmlzaXRlZCwgc3Bhbi5Nc29IeXBlcmxpbmtGb2xsb3dlZA0KCXttc28tc3R5bGUtcHJpb3Jp dHk6OTk7DQoJY29sb3I6cHVycGxlOw0KCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQ0KcA0K CXttc28tc3R5bGUtcHJpb3JpdHk6OTk7DQoJbXNvLW1hcmdpbi10b3AtYWx0OmF1dG87DQoJbWFy Z2luLXJpZ2h0OjBpbjsNCgltc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0bzsNCgltYXJnaW4tbGVm dDowaW47DQoJZm9udC1zaXplOjEyLjBwdDsNCglmb250LWZhbWlseToiVGltZXMgTmV3IFJvbWFu IixzZXJpZjt9DQpzcGFuLkVtYWlsU3R5bGUxOA0KCXttc28tc3R5bGUtdHlwZTpwZXJzb25hbC1y ZXBseTsNCglmb250LWZhbWlseToiQ2FsaWJyaSIsc2Fucy1zZXJpZjsNCgljb2xvcjojMUY0OTdE O30NCi5Nc29DaHBEZWZhdWx0DQoJe21zby1zdHlsZS10eXBlOmV4cG9ydC1vbmx5Ow0KCWZvbnQt ZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmO30NCkBwYWdlIFdvcmRTZWN0aW9uMQ0KCXtzaXpl OjguNWluIDExLjBpbjsNCgltYXJnaW46MS4waW4gMS4waW4gMS4waW4gMS4waW47fQ0KZGl2Lldv cmRTZWN0aW9uMQ0KCXtwYWdlOldvcmRTZWN0aW9uMTt9DQotLT48L3N0eWxlPjwhLS1baWYgZ3Rl IG1zbyA5XT48eG1sPg0KPG86c2hhcGVkZWZhdWx0cyB2OmV4dD0iZWRpdCIgc3BpZG1heD0iMTAy NiIgLz4NCjwveG1sPjwhW2VuZGlmXS0tPjwhLS1baWYgZ3RlIG1zbyA5XT48eG1sPg0KPG86c2hh cGVsYXlvdXQgdjpleHQ9ImVkaXQiPg0KPG86aWRtYXAgdjpleHQ9ImVkaXQiIGRhdGE9IjEiIC8+ DQo8L286c2hhcGVsYXlvdXQ+PC94bWw+PCFbZW5kaWZdLS0+DQo8c3R5bGUgdHlwZT0idGV4dC9j c3MiPi5zdHlsZTEge2ZvbnQtZmFtaWx5OiAiVGltZXMgTmV3IFJvbWFuIjt9PC9zdHlsZT48L2hl YWQ+PGJvZHkgbGFuZz0iRU4tVVMiIGxpbms9ImJsdWUiIHZsaW5rPSJwdXJwbGUiPg0KPGRpdiBj bGFzcz0iV29yZFNlY3Rpb24xIj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkEgYmln IHRoYW5rIHlvdSB0b28gUmljaCBmb3IgZmluYWxseSBsZXR0aW5nIG1lIGhhdmUgbXkgSmltbXkg TmV1dHJvbiBtb21lbnQgb2ZmIGxpc3QuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+enBvb2xjb25jZXB0cyg3KSAoZnJvbSBjdXJyZW50LTE0 KTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPjxv OnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkEgZFJB SUQgd2l0aCBOIGRpc2tzIG9mIHNpemUgWCwgRCBkYXRhIGRpc2tzIHBlciByZWR1bmRhbmN5IGdy b3VwLCBQIHBhcml0eSBsZXZlbCwgYW5kIFMNCjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmRpc3RyaWJ1dGVkIGhvdCBzcGFyZXMgY2FuIGhvbGQg YXBwcm94aW1hdGVseSAoTi1TKSooRC8oRCYjNDM7UCkpKlggYnl0ZXMgYW5kIGNhbiB3aXRoc3Rh bmQgUA0KPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90 OyI+ZGV2aWNlcyBmYWlsaW5nIHdpdGhvdXQgbG9zaW5nIGRhdGEuPG86cD48L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PG86cD4mbmJzcDs8L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+U28sIGlmIE4gaXMgMTAsIEQg aXMgMiwgUCBpcyAyLCBTIGlzIDAsIGFuZCBYIGlzIDFULCB3ZSBnZXQ6PG86cD48L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PG86cD4mbmJzcDs8L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+KDEwLTApICogKCgyLygy JiM0MzsyKSkgKiAxVCk8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij49IDEwICogKDIvNCkgKiAxVDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPj0gNVQgZWZmZWN0aXZlIHN0b3JhZ2UgcGVyIHZkZXYu PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PG86 cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ IyMgUkFJRFoyIGZvciBjb21wYXJpc29uDQo8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5yb290QGRyYWlkOi8gIyB6cG9vbCBkZXN0cm95IHRh bms8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5y b290QGRyYWlkOi8gIyB6cG9vbCBjcmVhdGUgdGFuayByYWlkejIgL2Rldi9kYTExcDEgL2Rldi9k YTEycDEgL2Rldi9kYTEzcDEgL2Rldi9kYTE0cDEgL2Rldi9kYTE1cDEgL2Rldi9kYTE2cDEgL2Rl di9kYTE3cDEgL2Rldi9kYTE4cDEgL2Rldi9kYTE5cDEgL2Rldi9kYTIwcDEgL2Rldi9kYTM2cDEg L2Rldi9kYTM3cDENCiAvZGV2L2RhMzhwMSAvZGV2L2RhMzlwMSAvZGV2L2RhNDBwMSAvZGV2L2Rh NDFwMSAvZGV2L2RhNDJwMSAvZGV2L2RhNDNwMSAvZGV2L2RhNDRwMSAvZGV2L2RhNDVwMQ0KPG86 cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+cm9vdEBk cmFpZDovICMgenBvb2wgYWRkIHRhbmsgc3BhcmUgL2Rldi9kYTQ2cDEgL2Rldi9kYTQ3cDE8bzpw PjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9u dC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5vdEBkcmFp ZDovICMgZGYgLWggL3Rhbms8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij5GaWxlc3lzdGVtJm5ic3A7Jm5ic3A7Jm5ic3A7IFNpemUmbmJzcDsmbmJz cDsmbmJzcDsgVXNlZCZuYnNwOyZuYnNwOyBBdmFpbCBDYXBhY2l0eSZuYnNwOyBNb3VudGVkIG9u PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFu ayZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAxNlQmbmJzcDsmbmJzcDsmbmJzcDsgMjU2SyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAx NlQmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsmbmJzcDsmbmJzcDsgL3RhbmsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgJmx0Oy0tLS0gMTZUQjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPnJvb3RAZHJhaWQ6LyAjJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7DQo8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij5yb290QGRyYWlkOi8gIyB6cG9vbCBsaXN0IC12IHRhbms8bzpwPjwvbzpw Pjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXpl OjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5OQU1FJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IFNJWkUmbmJzcDsgQUxMT0Mm bmJzcDsmbmJzcDsgRlJFRSZuYnNwOyBDS1BPSU5UJm5ic3A7IEVYUEFORFNaJm5ic3A7Jm5ic3A7 IEZSQUcmbmJzcDsmbmJzcDsmbmJzcDsgQ0FQJm5ic3A7IERFRFVQJm5ic3A7Jm5ic3A7Jm5ic3A7 IEhFQUxUSCZuYnNwOyBBTFRST09UPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAxOC4xVCZuYnNwOyAxLjY1TSZuYnNwOyAxOC4xVCZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgMCUmbmJzcDsgMS4wMHgmbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FJm5ic3A7 IC08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4m bmJzcDsgcmFpZHoyLTAmbmJzcDsgMTguMVQmbmJzcDsgMS42NU0mbmJzcDsgMTguMVQmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDAl Jm5ic3A7IDAuMDAlJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMTFwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05M SU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMTJwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48 L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5i c3A7Jm5ic3A7IGRhMTNwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7 IGRhMTRwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMTVwMSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMTZwMSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7ICZuYnNwOyZuYnNwOyZuYnNwOy0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVy IE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMTdwMSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsg T05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90 OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMThwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86 cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7 Jm5ic3A7Jm5ic3A7IGRhMTlwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5i c3A7IGRhMjBwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzZw MSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzdwMSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05v cm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzhwMSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzlwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5F PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5i c3A7Jm5ic3A7Jm5ic3A7IGRhNDBwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286 cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7 Jm5ic3A7IGRhNDFwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRh NDJwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWls eTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDNwMSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyAmbmJzcDsmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDRwMSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDVwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05M SU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ c3BhcmUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgZGE0NnAxJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyBBVkFJTDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyBkYTQ3cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IEFWQUlMPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+cm9vdEBkcmFpZDovICM8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8bzpwPjwvbzpwPjwvc3Bhbj48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQt ZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4jIyBEcmFpZCBleHBhbnNpb24gd2l0aCBE aXN0cmlidXRlZCBzcGFyZXM8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv dXJpZXIgTmV3JnF1b3Q7Ij5bcm9vdEBkcmFpZCAvXSMgenBvb2wgY3JlYXRlIHRhbmsgZHJhaWQy OjhkOjEwYzowcyAvZGV2L2RhMTFwMSAvZGV2L2RhMTJwMSAvZGV2L2RhMTNwMSAvZGV2L2RhMTRw MSAvZGV2L2RhMTVwMSAvZGV2L2RhMTZwMSAvZGV2L2RhMTdwMSAvZGV2L2RhMThwMSAvZGV2L2Rh MTlwMSAvZGV2L2RhMjBwMTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll ciBOZXcmcXVvdDsiPltyb290QGRyYWlkIC9dIyB6cG9vbCBhZGQgdGFuayZuYnNwOyZuYnNwOyZu YnNwOyBkcmFpZDI6OGQ6MTBjOjBzIC9kZXYvZGEzNnAxIC9kZXYvZGEzN3AxIC9kZXYvZGEzOHAx IC9kZXYvZGEzOXAxIC9kZXYvZGE0MHAxIC9kZXYvZGE0MXAxIC9kZXYvZGE0MnAxIC9kZXYvZGE0 M3AxIC9kZXYvZGE0NHAxIC9kZXYvZGE0NXAxPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+W3Jvb3RAZHJhaWQgL10jIHpwb29sIGFkZCB0YW5rIHNw YXJlIC9kZXYvZGE0NnAxIC9kZXYvZGE0N3AxPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+W3Jvb3RAZHJhaWQgL10jIGRmIC1oIC90YW5rPG86cD48 L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+RmlsZXN5c3Rl bSZuYnNwOyZuYnNwOyZuYnNwOyBTaXplJm5ic3A7Jm5ic3A7Jm5ic3A7IFVzZWQmbmJzcDsmbmJz cDsgQXZhaWwgQ2FwYWNpdHkmbmJzcDsgTW91bnRlZCBvbjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRhbmsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMTRUJm5ic3A7Jm5ic3A7Jm5i c3A7IDc2N0smbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMTRUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IDAlJm5ic3A7Jm5ic3A7Jm5ic3A7IC90YW5rJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7ICZsdDstLS0tIDE0 VDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPlty b290QGRyYWlkIC9dIyB6cG9vbCBsaXN0IC12IHRhbms8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5OQU1FJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IFNJWkUmbmJzcDsgQUxMT0MmbmJzcDsmbmJzcDsgRlJFRSZuYnNwOyBD S1BPSU5UJm5ic3A7IEVYUEFORFNaJm5ic3A7Jm5ic3A7IEZSQUcmbmJzcDsmbmJzcDsmbmJzcDsg Q0FQJm5ic3A7IERFRFVQJm5ic3A7Jm5ic3A7Jm5ic3A7IEhFQUxUSCZuYnNwOyBBTFRST09UPG86 cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxOC4xVCZuYnNwOyA3LjYyTSZuYnNwOyAx OC4xVCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgMCUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsgMS4wMHgmbmJzcDsm bmJzcDsmbmJzcDsgT05MSU5FJm5ic3A7IC08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgZHJhaWQyOjhkOjEwYzowcy0wJm5ic3A7IDku MDNUJm5ic3A7IDYuMDlNJm5ic3A7IDkuMDNUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAwJSZuYnNwOyAwLjAwJSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+ PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZu YnNwOyBkYTExcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSAmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDstJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTEycDEmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTEzcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNw OyZuYnNwOyBkYTE0cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOy0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxw IGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE1cDEmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE2cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+ PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZu YnNwOyZuYnNwOyBkYTE3cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE4cDEm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll ciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE5cDEmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxv OnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNw OyZuYnNwOyZuYnNwOyBkYTIwcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyBkcmFpZDI6OGQ6MTBjOjBz LTEmbmJzcDsgOS4wM1QmbmJzcDsgMS41Mk0mbmJzcDsgOS4wM1QmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDAlJm5ic3A7IDAuMDAl Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5F PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5i c3A7Jm5ic3A7Jm5ic3A7IGRhMzZwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRh MzdwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzhwMSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05M SU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMzlwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7ICZuYnNwOyZuYnNw O2RhNDBwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7IGRhNDFwMSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5F PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5i c3A7Jm5ic3A7Jm5ic3A7IGRhNDJwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7ICZuYnNwOy0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRh NDNwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDRwMSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05M SU5FPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDVwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPG86cD48L286cD48L3Nw YW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+c3BhcmUmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC08bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4m bmJzcDsgZGE0NnAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsgJm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBBVkFJTDxvOnA+PC9vOnA+ PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyBkYTQ3cDEm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IEFWQUlMPG86cD48L286cD48L3NwYW4+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+W3Jvb3RAZHJhaWQgL10jPG86cD48L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PG86cD48L286 cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+IyMjJm5ic3A7IE9u ZSBQb29sIHdpdGggRGlzdHJpYnV0ZWQgc3BhcmVzPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWls eTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PG86cD48L286cD48L3NwYW4+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZh bWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+W3Jvb3RAZHJhaWQgL10jIHpwb29sIGNyZWF0 ZSB0YW5rIGRyYWlkMjoxOGQ6MjBjOjBzIC9kZXYvZGExMXAxIC9kZXYvZGExMnAxIC9kZXYvZGEx M3AxIC9kZXYvZGExNHAxIC9kZXYvZGExNXAxIC9kZXYvZGExNnAxIC9kZXYvZGExN3AxIC9kZXYv ZGExOHAxIC9kZXYvZGExOXAxIC9kZXYvZGEyMHAxIC9kZXYvZGEzNnAxDQogL2Rldi9kYTM3cDEg L2Rldi9kYTM4cDEgL2Rldi9kYTM5cDEgL2Rldi9kYTQwcDEgL2Rldi9kYTQxcDEgL2Rldi9kYTQy cDEgL2Rldi9kYTQzcDEgL2Rldi9kYTQ0cDEgL2Rldi9kYTQ1cDE8bzpwPjwvbzpwPjwvc3Bhbj48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5bcm9vdEBkcmFpZCAvXSMgenBvb2wg YWRkIHRhbmsgc3BhcmUgL2Rldi9kYTQ2cDEgL2Rldi9kYTQ3cDE8bzpwPjwvbzpwPjwvc3Bhbj48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5bcm9vdEBkcmFpZCAvXSMgZGYgLWgg L3Rhbms8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7 Ij5GaWxlc3lzdGVtJm5ic3A7Jm5ic3A7Jm5ic3A7IFNpemUmbmJzcDsmbmJzcDsmbmJzcDsgVXNl ZCZuYnNwOyZuYnNwOyBBdmFpbCBDYXBhY2l0eSZuYnNwOyBNb3VudGVkIG9uPG86cD48L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxNFQmbmJz cDsmbmJzcDsmbmJzcDsgMS41TSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxNFQmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsmbmJzcDsmbmJzcDsgL3RhbmsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg Jmx0Oy0tLS0gMTRUPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+W3Jvb3RAZHJhaWQgL10jIHpwb29sIGxpc3QgLXYgdGFuazxvOnA+PC9vOnA+PC9z cGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4w cHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPk5BTUUmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgU0laRSZuYnNwOyBBTExPQyZuYnNwOyZu YnNwOyBGUkVFJm5ic3A7IENLUE9JTlQmbmJzcDsgRVhQQU5EU1ombmJzcDsmbmJzcDsgRlJBRyZu YnNwOyZuYnNwOyZuYnNwOyBDQVAmbmJzcDsgREVEVVAmbmJzcDsmbmJzcDsmbmJzcDsgSEVBTFRI Jm5ic3A7IEFMVFJPT1Q8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij50YW5rJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDE4 LjFUJm5ic3A7IDkuNjFNJm5ic3A7IDE4LjFUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAwJSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAwJSZuYnNwOyAxLjAweCZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkUmbmJzcDsgLTxvOnA+PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyBkcmFp ZDI6MThkOjIwYzowcy0wJm5ic3A7IDE4LjFUJm5ic3A7IDkuNjFNJm5ic3A7IDE4LjFUJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAw JSZuYnNwOyAwLjAwJSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTExcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7 LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElO RTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZu YnNwOyZuYnNwOyZuYnNwOyBkYTEycDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+ PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZu YnNwOyBkYTEzcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE0cDEm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyAmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDstJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE1cDEmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE2cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxv OnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNw OyZuYnNwOyZuYnNwOyBkYTE3cDEgJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7LSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9z cGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4w cHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNw OyBkYTE4cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxw IGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTE5cDEmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29O b3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTIwcDEmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTM2cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+ PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZu YnNwOyZuYnNwOyBkYTM3cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFu PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBk YTM4cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTM5cDEmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll ciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQwcDEmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9O TElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsi PiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQxcDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNw OyZuYnNwOyBkYTQycDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSAmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQz cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQ0cDEmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7IE9OTElORTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQ1cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDstJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElO RTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnNw YXJlJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7IGRhNDZwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgQVZBSUw8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgZGE0N3AxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyBBVkFJTDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPltyb290QGRyYWlkIC9dIzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDs7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJzcDs8L286cD48 L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PGI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmIj5Gcm9t Ojwvc3Bhbj48L2I+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmIj4gUmljaCBbbWFpbHRvOnJpbmNlYnJhaW5AZ21h aWwuY29tXQ0KPGJyPg0KPGI+U2VudDo8L2I+IFdlZG5lc2RheSwgQXByaWwgNiwgMjAyMiA5OjQz IEFNPGJyPg0KPGI+VG86PC9iPiBNaWNoYWVsIEp1bmcgKFVTRVIpICZsdDttaWtlakBwYXltZW50 YWxsaWFuY2VpbnRsLmNvbSZndDs8YnI+DQo8Yj5TdWJqZWN0OjwvYj4gUmU6IERSQUlEIC0gRXhw YW5zaW9uIGFuZCBvdGhlciBpc3N1ZXM8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwvcD4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj5JJ20gbm90IGFuIGV4cGVydCBvbiBkcmFpZCwgYnV0IHlvdSBhcHBlYXIgdG8gaGF2ZSBk ZWZpbmVkIHR3byBkcmFpZCB2ZGV2cyB3aXRoIGEgcmF0aW8gb2YgMiBkYXRhIGRpc2tzIHRvIDIg cGFyaXR5IGRpc2tzIGZvciB0aGUgaW50ZXJuYWwgJnF1b3Q7cmVkdW5kYW5jeSBncm91cHMmcXVv dDssIHNvIDUwJSBvdmVyaGVhZCBzZWVtcyBwYXIgZm9yIHRoZSBjb3Vyc2UsIG11Y2ggbGlrZSBp ZiB5b3UgaGFkIGRlZmluZWQgNC1kaXNrDQogcmFpZHoyIHZkZXZzLjxvOnA+PC9vOnA+PC9wPg0K PGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxvOnA+Jm5ic3A7PC9vOnA+PC9wPg0KPC9kaXY+ DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+LSBSaWNoPG86cD48L286cD48L3A+DQo8L2Rp dj4NCjwvZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8 ZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPk9uIFdlZCwgQXByIDYsIDIwMjIgYXQg OToyMiBBTSBNaWNoYWVsIEp1bmcgKFVTRVIpICZsdDs8YSBocmVmPSJtYWlsdG86bWlrZWpAcGF5 bWVudGFsbGlhbmNlaW50bC5jb20iPm1pa2VqQHBheW1lbnRhbGxpYW5jZWludGwuY29tPC9hPiZn dDsgd3JvdGU6PG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxibG9ja3F1b3RlIHN0eWxlPSJib3Jk ZXI6bm9uZTtib3JkZXItbGVmdDpzb2xpZCAjQ0NDQ0NDIDEuMHB0O3BhZGRpbmc6MGluIDBpbiAw aW4gNi4wcHQ7bWFyZ2luLWxlZnQ6NC44cHQ7bWFyZ2luLXJpZ2h0OjBpbiI+DQo8ZGl2Pg0KPGRp dj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+SGkhPC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkkgc3RhcnRlZCBwbGF5 aW5nIHdpdGggZHJhaWQgc29tZSBtb250aHMgYWdvIGFuZCBJIGhhdmUgYSBwcm9ibGVtIEkgY2Fu bm90IGZpZ3VyZSBvdXQuPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPkkgc3RhcnRlZCBvdXQgd2l0aCBhIHNpbmdsZSBkcmFpZDI6MmQ6 MTBjOjBzIGFuZCBsaWZlIHdhcyBnb29kLiZuYnNwOyBSYW4gc29tZSB0ZXN0cywgYWRkZWQNCjwv c3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFy Z2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+YSBz cGVjaWFsIGRldmljZSBhbmQgbGlmZSB3YXMgYmV0dGVyLiBUaGVuIEkgZXhwYW5kZWQgdGhlIHBv b2wgYnkgYWRkaW5nIGFub3RoZXINCjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+ZHJhaWQyOjJkOjEwYzowcy4mbmJzcDsgTm93IHRoZSBwcm9i bGVtOiB0aGUgcG9vbCBzYXlzIGl0IGhhcyB+MThUQiB3b3J0aCBvZiBzcGFjZSwgdGhlDQo8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmZpbGUg c3lzdGVtIG9ubHkgc2hvd3MgfjlUQi4gSXQgZGlkIG5vdCBhdXRvLWV4cGFuZC48L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+SeKAmW0g Y3VycmVudGx5IG9uIG1haW4tbjI1Mzg3NS04ZTcyZjQ1OGM2ZDogYnV0IEkgaW5pdGlhbGx5IHNw dW4gdGhpcyB1cCBqdXN0IGFmdGVyDQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0 b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPkRSQUlEIHdhcyBicm91Z2h0IEludG8gdGhlIHRyZWUsIGF0 IGxlYXN0IHdoZW4gSSBiZWNhbWUgYXdhcmUgb2YgaXQuIEkgaGF2ZSB0cmllZA0KPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5pbmRpdmlkdWFs bHkgb24gbGluaW5nIGRldmljZXMgaW4gdGhlIHBvb2wgd2l0aCDigJwtZeKAnSwgZXhwb3J0aW5n L2ltcG9ydGluZyB0aGUgcG9vbCBldGMuPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5hbmQgYmFzaWNhbGx5IGV2ZXJ5IHN1Z2dlc3Rpb24gbXkg 4oCcZ29vZ2xlIGZvb+KAnSB3b3VsZCBsZWFkIG1lIHRvLjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5JIGhhdmUgbm8gdXNlZnVsIGRh dGEgb24gdGhpcyBwb29sIGFuZCBJIGNhbiBkZXN0cm95IGFuZCByZS1jcmVhdGUgaXQgYnV0IEkg d291bGQNCjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+bGlrZSB0byBzYXZlIHNvbWUgdGltZSBhbmQgZ2V0IG9waW5pb25zIG9yIGZhY3Qgb246 PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4m bmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPkNhbiBhIGRyYWlkIHBvb2wgYmUgZXhwYW5kZWQgYWZ0ZXIgYSBzcGVjaWFsIGRldmljZSBo YXMgYmVlbiBhZGRlZD8mbmJzcDsgSXQgd291bGQgc2VlbSBzbzwvc3Bhbj48bzpwPjwvbzpwPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+YnV0IHRoZSBmaWxlc3lzdGVtIGRv ZXMgbm90IHJlZmxlY3QgdGhhdC4/PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9t LWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90 O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPldoYXQgYXQgaXMgdGhlIGNvcnJlY3Qgd2F5IHRvIHdp cmUgZG93biB0aGUgZm9sbG93aW5nIOKAkyBJIGhhZCBwcm9ibGVtcyBhZnRlciBub3QgZG9pbmc8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRo aXMgc2luY2UgdGhlIDIueCBkYXlzIGFuZCB3b3VsZCByZWFsbHkgd2FudCB0byB3aXJlIGRvd24g bXkgZHJhaWQgZGV2aWNlcyBub3cNCjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+dGhhdCBJIGhhdmUgb3RoZXIgcG9vbHMuJm5ic3A7DQo8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNw Ozwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ SSBoYXZlIHBvb2wgY29uc3RydWN0aW9uIGFsbCBzY3JpcHRlZCBidXQgb2YgY291cnNlIEkgd2Fu dCBwaHlzaWNhbCBkaXNrIGRhJmx0O3gmZ3Q7IHRvIGFsd2F5cyBiZQ0KPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjgu MHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5jb25zaXN0ZW50LiBUaGVu IEkgZWFzaWx5IHRlc3QgYW55IGNvbnN0cnVjdCBzb21lb25lIGNvbWVzIHVwIHdpdGguPC9zcGFu PjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4t dG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9u dC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxl PSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnJv b3RAZHJhaWQ6L2hvbWUvbWlrZWogIyBjYW1jb250cm9sIGRldmxpc3QgLWI8L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnNjYnVzMCBvbiBhdGEw IGJ1cyAwPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij5zY2J1czEgb24gYXRhMSBidXMgMDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+c2NidXMyIG9uIG1wdDAgYnVzIDA8L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnNjYnVzMyBvbiBtcHMw IGJ1cyAwJm5ic3A7Jm5ic3A7DQo8L3NwYW4+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTpXaW5nZGluZ3MiPsOfPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5zY2J1czQgb24gY2Ftc2ltMCBidXMgMDwvc3Bhbj48bzpw PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+c2NidXMtMSBvbiB4 cHQwIGJ1cyAwPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5 bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48 c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3 JnF1b3Q7Ij5yb290QGRyYWlkOi9ob21lL21pa2VqICM8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG87bWFyZ2luLWxlZnQ6LjVpbiI+DQo8c3BhbiBzdHlsZT0iZm9u dC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8 L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1h cmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG87bWFyZ2luLWxlZnQ6 LjVpbiI+DQo8c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv dXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0 b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q291cmllciBOZXcmcXVvdDsiPiZsdDtkbWVzZyZndDs8L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPm1wczA6ICZsdDtBdmFnbyBUZWNobm9s b2dpZXMgKExTSSkgU0FTMjAwOCZndDsgcG9ydCAweDUwMDAtMHg1MGZmIG1lbSAweGZkNGZjMDAw LTB4ZmQ0ZmZmZmYsMHhmZDQ4MDAwMC0weGZkNGJmZmZmIGlycSAxOSBhdCBkZXZpY2UNCiAwLjAg b24gcGNpNDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+bXBzMDogRmlybXdhcmU6IDIwLjAwLjA0LjAwLCBEcml2ZXI6IDIxLjAyLjAwLjAwLWZi c2Q8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNv LW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsi Pm1wczA6IElPQ0NhcGFiaWxpdGllczogMTI4NWMmbHQ7U2NzaVRhc2tGdWxsLERpYWdUcmFjZSxT bmFwQnVmLEVFRFAsVHJhbnNSZXRyeSxFdmVudFJlcGxheSxIb3N0RGlzYyZndDs8L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jmx0O2Nh bWNvbnRyb2wmZ3Q7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij4mbHQ7U0VBR0FURSBTVDkxMDAwNjQwU1MgQVMwOSZndDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgYXQgc2NidXMzIHRhcmdldCA2MyBsdW4gMCAo ZGE0MixwYXNzMzUpPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij4mbHQ7U0VBR0FURSBTVDkxMDAwNjQwU1MgQVMwOSZndDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgYXQgc2NidXMzIHRhcmdldCA2NyBsdW4gMCAo ZGE0NixwYXNzMzkpPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij4mbHQ7U0VBR0FURSBTVDkxMDAwNjQwU1MgQVMwOCZndDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgYXQgc2NidXMzIHRhcmdldCA2OCBsdW4gMCAo ZGE0NyxwYXNzNDApPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIg TmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPkVYQU1QTEU6IElzIHRoaXMgY29ycmVjdD88L3NwYW4+PG86cD48L286 cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1 dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4w cHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpw PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PGEgaHJlZj0iaHR0 cDovL2hpbnQuc2NidXMuMy5hdCIgdGFyZ2V0PSJfYmxhbmsiPmhpbnQuc2NidXMuMy5hdDwvYT49 4oCdbXBzMOKAnTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij48YSBocmVmPSJodHRwOi8vaGludC5kYS40Mi5hdCIgdGFyZ2V0PSJfYmxh bmsiPmhpbnQuZGEuNDIuYXQ8L2E+PeKAnXNjYnVzM+KAnTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+aGludC5kYS40Mi50YXJnZXQ94oCdNjPi gJ08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNv LW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsi PmhpbnQuZGEuNDIudW5pdD3igJ0w4oCdPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp bi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPjxhIGhyZWY9Imh0dHA6Ly9oaW50LmRhLjQ2LmF0 IiB0YXJnZXQ9Il9ibGFuayI+aGludC5kYS40Ni5hdDwvYT494oCdc2NidXMz4oCdPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5oaW50LmRhLjQ2 LnRhcmdldD3igJ02N+KAnTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6 YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3Vy aWVyIE5ldyZxdW90OyI+aGludC5kYS40Ni51bml0PeKAnTDigJ08L3NwYW4+PG86cD48L286cD48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87 bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwv bzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6 YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+PGEgaHJlZj0iaHR0cDov L2hpbnQuZGEuNDcuYXQiIHRhcmdldD0iX2JsYW5rIj5oaW50LmRhLjQ3LmF0PC9hPj3igJ1zY2J1 czPigJ08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFu IHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVv dDsiPmhpbnQuZGEuNDcudGFyZ2V0PeKAnTY44oCdPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJn aW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFt aWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5oaW50LmRhLjQ3LnVuaXQ94oCdMCZxdW90Ozwv c3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFy Z2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5i c3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7 Ij5JIHdpbGwgdHJ5IGFnYWluLCBidXQgdGhpcyBkaWQgbm90IHNlZW0gdG8gd29yayBmb3IgbWUu Jm5ic3A7IFRoaXMgaXMgbXkgaG9tZSBsYWIgYnV0IGl04oCZczwvc3Bhbj48bzpwPjwvbzpwPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+bm93IHBhaW5mdWwgdG8gc3BpbiBk b3duIHRoaXMgaG9zdCBhcyBpdOKAmXMgYSBpU0NTSSB0YXJnZXQgZm9yIHNldmVyYWwgbWFjaGlu ZXMgZm9yIGE8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPkVTWGkgcHJvamVjdCBJ4oCZbSB3b3JraW5nIG9uIHNvIEkgd291bGQgbGlrZSB0byBw dXQgd2lyZWQgZG93biBTQ1NJIGRldmljZXMgdG8gcmVzdC48L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpw PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0 bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+QW5kIHllcywgSSBoYXZlIHNj aGVkdWxlZCBWTSBiYWNrdXBzIGZvciBteSBwcm9qZWN0IHRvIGFub3RoZXIgZGF0YSBzdG9yZSB0 aGF0IGlzIG5vdDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+dGhpcyBib3ggOy0pPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9t LWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90 O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkl04oCZcyBhbHNvIG9kZCwgdGhhdCBJIGRpZCBub3Qg Z2V0IGFsbCBHUFQgbGFiZWxzIGluIHRoZSB6cG9vbC4gQWxsIGRpc2tzIGhhdmUgR1BUIGxhYmVs cy4mbmJzcDsNCjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij5JIGhhdmUgYWRkZWQgZm9yIHRoZSBuZXh0IHJlYm9vdCB0byBsb2FkZXIu Y29uZi4mbmJzcDsNCjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi IHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0 byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVy IE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05v cm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFs dDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv dXJpZXIgTmV3JnF1b3Q7Ij5rZXJuLmdlb20ubGFiZWwuZGlza19pZGVudC5lbmFibGU9JnF1b3Q7 MCZxdW90Ozwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+a2Vybi5nZW9tLmxhYmVsLmdwdGlkLmVuYWJsZT0mcXVvdDsxPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjgu MHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDs8L3NwYW4+PG86 cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3At YWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNp emU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPlRoaXMgaXMgYW4g b2xkIERlbGwgTUQtMTAwMCBzaGVsZiBJIGhhZCBsYXlpbmcgYXJvdW5kIHdpdGggYSBidW5jaCBv ZiAxVEIgZHJpdmVzDQo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1 dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll ciBOZXcmcXVvdDsiPndoaWNoIEkgdGhvdWdodCB3b3VsZCBiZSBwZXJmZWN0IGZvciBwbGF5aW5n IGFyb3VuZCB3aXRoIGRyYWlkLjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29O b3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1h bHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtD b3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5taWtlakBkcmFpZDp+ICQgenBvb2wgZ2V0IGFsbCB0YW5r IHwgZ3JlcCBleHBhbmQ8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1 dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll ciBOZXcmcXVvdDsiPnRhbmsmbmJzcDsgYXV0b2V4cGFuZCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBvbiZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBsb2NhbDwvc3Bhbj48bzpw PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyBl eHBhbmRzaXplJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkIHpwb29sIGxpc3QgLXYgdGFuazwv c3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFy Z2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+TkFN RSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBTSVpFJm5ic3A7IEFMTE9D Jm5ic3A7Jm5ic3A7IEZSRUUmbmJzcDsgQ0tQT0lOVCZuYnNwOyBFWFBBTkRTWiZuYnNwOyZuYnNw OyBGUkFHJm5ic3A7Jm5ic3A7Jm5ic3A7IENBUCZuYnNwOyBERURVUCZuYnNwOyZuYnNwOyZuYnNw OyBIRUFMVEgmbmJzcDsgQUxUUk9PVDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAxOC41VCZuYnNwOyA4LjAyVCZuYnNwOyAxMC40VCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMCUmbmJzcDsmbmJzcDsmbmJzcDsg NDMlJm5ic3A7IDEuMDB4Jm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORSZuYnNwOyAtPC9zcGFuPjxv OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1z aXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgZHJh aWQyOjJkOjEwYzowcy0wJm5ic3A7IDkuMDNUJm5ic3A7IDQuMDZUJm5ic3A7IDQuOTdUJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAw JSZuYnNwOyA0NC45JSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi IHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0 byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVy IE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9kYTBwMSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtICZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOy0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsg Z3B0L2QxMHAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz cGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcm cXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTM5cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48 bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5i c3A7Jm5ic3A7IGRhNDBwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0K PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1t YXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQt ZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZGE0MXAx Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQzcDEmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElO RTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDRwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjgu MHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJz cDsgZGE0MnAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBkYTQ1cDEmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7ICZuYnNwOyZuYnNwOy0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0 eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5l dyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9kMTlwMSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21z by1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2Zv bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgZHJhaWQyOjJkOjEwYzow cy0xJm5ic3A7IDkuMDNUJm5ic3A7IDMuOTZUJm5ic3A7IDUuMDdUJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAwJSZuYnNwOyA0My44 JSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElO RTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhNDZwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDstJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9v OnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDph dXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjgu MHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJz cDsgZ3B0L2QxMXAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i PjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBO ZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQvZDEycDEmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwv cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtm b250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdw dC9kMTNwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsg T05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZ3B0L2QxNHAxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1m YW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOyZuYnNwOyZuYnNwOyBncHQvZDE1 cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElO RTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9kMTZwMSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDstJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t Ym90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsgZ3B0L2QxN3AxJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNw OyZuYnNwOyZuYnNwOyBncHQvZDE4cDEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5i c3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv bS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVv dDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRhMThwMSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsg T05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij5zcGVjaWFsJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAtPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph dXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJp ZXIgTmV3JnF1b3Q7Ij4mbmJzcDsgbWlycm9yLTMmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMzk4RyZuYnNwOyAyLjg2RyZuYnNwOyZu YnNwOyAzOTVHJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAwJSZuYnNwOyAwLjcxJSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyAtICZuYnNwOyZuYnNwOyZuYnNwO09OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2lu LWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWls eTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9zcGVjaWFs MCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFuPjxvOnA+PC9vOnA+ PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsmbmJzcDsmbmJzcDsg Z3B0L3NwZWNpYWwxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+ PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10 b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPmxvZ3MmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC0gJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7LSZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IC08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0 OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291 cmllciBOZXcmcXVvdDsiPiZuYnNwOyBtaXJyb3ItMiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxNS41RyZuYnNwOyZuYnNwOyAyNTZLJm5ic3A7 IDE1LjVHJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyAwJSZuYnNwOyAwLjAwJSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7IE9OTElORTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGdwdC9zbG9nMCZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAt Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FPC9zcGFu PjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4t dG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9u dC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4mbmJzcDsm bmJzcDsmbmJzcDsgZ3B0L3Nsb2cxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsg LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7LSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAtJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyBPTkxJTkU8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t YWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+bWlrZWpAZHJhaWQ6fiAkIHpmcyBnZXQgbW91bnRwb2lu dCB0YW5rPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij5OQU1FJm5ic3A7IFBST1BFUlRZJm5ic3A7Jm5ic3A7Jm5ic3A7IFZBTFVFJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IFNPVVJDRTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250 LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyBtb3VudHBvaW50Jm5i c3A7IC90YW5rJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGRlZmF1bHQ8L3Nw YW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJm b250LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNw Ozwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+ Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9 Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh biBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1 b3Q7Ij5taWtlakBkcmFpZDp+ICQgZGYgL3Rhbms8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp bi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPkZpbGVzeXN0ZW0mbmJzcDsgMUstYmxvY2tzJm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IFVzZWQmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgQXZhaWwgQ2FwYWNpdHkmbmJzcDsgTW91bnRlZCBvbjwvc3Bhbj48bzpwPjwv bzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6 YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+dGFuayZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyA5NTU4ODkyMDA0IDQzMDEzMTAyMjQgNTI1NzU4MTc4 MCZuYnNwOyZuYnNwOyZuYnNwOyA0NSUmbmJzcDsmbmJzcDsmbmJzcDsgL3RhbmsmbmJzcDsmbmJz cDsNCjwvc3Bhbj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5Oldpbmdk aW5ncyI+w588L3NwYW4+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+IH45VEIgbm90IDE4VEI8L3NwYW4+PG86cD48L286cD48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87 bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPm1pa2VqQGRyYWlkOn4gJDwvc3Bh bj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2lu LXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+Jm5ic3A7 PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5t aWtlakBkcmFpZDp+ICQgenBvb2wgbGlzdDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv dHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTom cXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+TkFNRSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBTSVpFJm5ic3A7IEFMTE9DJm5ic3A7Jm5ic3A7IEZS RUUmbmJzcDsgQ0tQT0lOVCZuYnNwOyBFWFBBTkRTWiZuYnNwOyZuYnNwOyBGUkFHJm5ic3A7Jm5i c3A7Jm5ic3A7IENBUCZuYnNwOyBERURVUCZuYnNwOyZuYnNwOyZuYnNwOyBIRUFMVEgmbmJzcDsg QUxUUk9PVDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx dW90OyI+Y2NhY2hlJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDkuNTBHJm5i c3A7IDkuMTBHJm5ic3A7Jm5ic3A7IDQwNk0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyAtJm5ic3A7Jm5ic3A7Jm5ic3A7IDg5JSZuYnNwOyZuYnNwOyZuYnNwOyA5NSUmbmJzcDsg MS4wMHgmbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FJm5ic3A7IC08L3NwYW4+PG86cD48L286cD48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87 bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnJhaWQtNTQwMC0xJm5ic3A7IDYu MjhUJm5ic3A7IDEuMTlUJm5ic3A7IDUuMDlUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyA2JSZuYnNwOyZuYnNwOyZuYnNwOyAxOSUm bmJzcDsgMS4wMHgmbmJzcDsmbmJzcDsmbmJzcDsgT05MSU5FJm5ic3A7IC08L3NwYW4+PG86cD48 L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0 OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 OC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPnRhbmsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgMTguNVQmbmJzcDsgOC4wMlQm bmJzcDsgMTAuNFQmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbmJzcDsmbmJzcDstJm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IDAlJm5ic3A7Jm5ic3A7Jm5ic3A7IDQzJSZuYnNwOyAxLjAweCZuYnNw OyZuYnNwOyZuYnNwOyBPTkxJTkUmbmJzcDsgLSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOw0KPC9zcGFuPjxzcGFuIHN0eWxlPSJmb250 LXNpemU6OC4wcHQ7Zm9udC1mYW1pbHk6V2luZ2RpbmdzIj7Dnzwvc3Bhbj48c3BhbiBzdHlsZT0i Zm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij4NCjwv c3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFy Z2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZTo4LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+emZz cm9vdCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxMDNHJm5ic3A7IDMyLjZH Jm5ic3A7IDcwLjRHJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IC0m bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgLSZuYnNwOyZu YnNwOyZuYnNwOyAyNSUmbmJzcDsmbmJzcDsmbmJzcDsgMzElJm5ic3A7IDEuMDB4Jm5ic3A7Jm5i c3A7Jm5ic3A7IE9OTElORSZuYnNwOyAtPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90 dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O0NvdXJpZXIgTmV3JnF1b3Q7Ij5taWtlakBkcmFpZDp+ICQ8L3NwYW4+PG86cD48L286cD48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87 bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7 Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwv bzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6 YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4 LjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+VGhhbmtzIGluIGFkdmFu Y2UgZm9yIGFueSBjb21tZW50cyBvciBzdWdlc3N0aW9ucy48L3NwYW4+PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6OC4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDsiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpw PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0 bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBw dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyI+LS1taWtlajwvc3Bhbj48bzpw PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+Jm5ic3A7PG86cD48L286cD48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8 ZGl2Pg0KPHA+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 QXJpYWwmcXVvdDssc2Fucy1zZXJpZiI+Jm5ic3A7PG86cD48L286cD48L3NwYW4+PC9wPg0KPGRp diBzdHlsZT0iYm9yZGVyLXRvcDpzb2xpZCAjNjY2NjY2IDEuMHB0O2JvcmRlci1sZWZ0Om5vbmU7 Ym9yZGVyLWJvdHRvbTpzb2xpZCAjNjY2NjY2IDEuMHB0O2JvcmRlci1yaWdodDpub25lO3BhZGRp bmc6NC4wcHQgMGluIDQuMHB0IDBpbiI+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFy Z2luLWJvdHRvbToxMi4wcHQiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6Ny41cHQ7Zm9udC1mYW1p bHk6JnF1b3Q7VmVyZGFuYSZxdW90OyxzYW5zLXNlcmlmIj5DT05GSURFTlRJQUxJVFkgTk9URTog VGhpcyBtZXNzYWdlIGlzIGludGVuZGVkIG9ubHkgZm9yIHRoZSB1c2U8YnI+DQpvZiB0aGUgaW5k aXZpZHVhbCBvciBlbnRpdHkgdG8gd2hvbSBpdCBpcyBhZGRyZXNzZWQgYW5kIG1heSA8YnI+DQpj b250YWluIGluZm9ybWF0aW9uIHRoYXQgaXMgcHJpdmlsZWdlZCwgY29uZmlkZW50aWFsLCBhbmQg PGJyPg0KZXhlbXB0IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYgdGhl IHJlYWRlciA8YnI+DQpvZiB0aGlzIG1lc3NhZ2UgaXMgbm90IHRoZSBpbnRlbmRlZCByZWNpcGll bnQsIHlvdSBhcmUgaGVyZWJ5IDxicj4NCm5vdGlmaWVkIHRoYXQgYW55IGRpc3NlbWluYXRpb24s IGRpc3RyaWJ1dGlvbiBvciBjb3B5aW5nIDxicj4NCm9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBz dHJpY3RseSBwcm9oaWJpdGVkLiBJZiB5b3UgaGF2ZSA8YnI+DQpyZWNlaXZlZCB0aGlzIHRyYW5z bWlzc2lvbiBpbiBlcnJvciwgcGxlYXNlIG5vdGlmeSB1cyBieSA8YnI+DQp0ZWxlcGhvbmUgYXQg KDUwMikgMjEyLTQwMDAgb3Igbm90aWZ5IHVzIGF0OiBQQUksIERlcHQuIDk5LCA8YnI+DQoyMTAx IEhpZ2ggV2lja2hhbSBQbGFjZSwgU3VpdGUgMTAxLCBMb3Vpc3ZpbGxlLCBLWSA0MDI0NTxicj4N Cjxicj4NCjxicj4NCjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjwvZGl2Pg0KPC9kaXY+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWJvdHRvbToxMi4wcHQiPjxvOnA+Jm5ic3A7 PC9vOnA+PC9wPg0KPHA+PGI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7VmVyZGFuYSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiM2NjY2NjYiPkRpc2NsYWlt ZXI8L3NwYW4+PC9iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFtaWx5OiZx dW90O1ZlcmRhbmEmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojNjY2NjY2Ij48bzpwPjwvbzpwPjwv c3Bhbj48L3A+DQo8cD48c3BhbiBzdHlsZT0iZm9udC1zaXplOjguMHB0O2ZvbnQtZmFtaWx5OiZx dW90O1ZlcmRhbmEmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojNjY2NjY2Ij5UaGUgaW5mb3JtYXRp b24gY29udGFpbmVkIGluIHRoaXMgY29tbXVuaWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29u ZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50 IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byByZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdA0KIHRo ZSByZWNpcGllbnQsIHlvdSBhcmUgaGVyZWJ5IG5vdGlmaWVkIHRoYXQgYW55IGRpc2Nsb3N1cmUs IGNvcHlpbmcsIGRpc3RyaWJ1dGlvbiBvciB0YWtpbmcgYWN0aW9uIGluIHJlbGF0aW9uIG9mIHRo ZSBjb250ZW50cyBvZiB0aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQgYW5k IG1heSBiZSB1bmxhd2Z1bC48YnI+DQo8YnI+DQpUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5uZWQg Zm9yIHZpcnVzZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2FsbHkg YXJjaGl2ZWQgYnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBjeWJl ciByZXNpbGllbmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGggYnJh bmQgcHJvdGVjdGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJpdHks DQogY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFiaWxpdGllcy4gTWltZWNhc3Qg aGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0aW9ucyBmcm9tIG1hbGljaW91 cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxl YWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUgcmVzaWxpZW50IHdvcmxkLiBU byBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+ DQo8L2Rpdj4NCjwvYmxvY2txdW90ZT4NCjwvZGl2Pg0KPC9kaXY+DQoNCg0KPGJyPjxicj48cCBz dHlsZT0iZm9udC1mYW1pbHk6IFZlcmRhbmE7IGZvbnQtc2l6ZToxMHB0OyBjb2xvcjojNjY2NjY2 OyI+PGI+RGlzY2xhaW1lcjwvYj48L3A+PHAgc3R5bGU9ImZvbnQtZmFtaWx5OiBWZXJkYW5hOyBm b250LXNpemU6OHB0OyBjb2xvcjojNjY2NjY2OyI+VGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBp biB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUgc2VuZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQg aXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkgdGhlIHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1 dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91IGFyZSBub3QgdGhlIHJlY2lwaWVudCwgeW91 IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkgZGlzY2xvc3VyZSwgY29weWluZywgZGlzdHJp YnV0aW9uIG9yIHRha2luZyBhY3Rpb24gaW4gcmVsYXRpb24gb2YgdGhlIGNvbnRlbnRzIG9mIHRo aXMgaW5mb3JtYXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVs Ljxicj48YnI+VGhpcyBlbWFpbCBoYXMgYmVlbiBzY2FubmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3 YXJlLCBhbmQgbWF5IGhhdmUgYmVlbiBhdXRvbWF0aWNhbGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0 LCBhIGxlYWRlciBpbiBlbWFpbCBzZWN1cml0eSBhbmQgY3liZXIgcmVzaWxpZW5jZS4gTWltZWNh c3QgaW50ZWdyYXRlcyBlbWFpbCBkZWZlbnNlcyB3aXRoIGJyYW5kIHByb3RlY3Rpb24sIHNlY3Vy aXR5IGF3YXJlbmVzcyB0cmFpbmluZywgd2ViIHNlY3VyaXR5LCBjb21wbGlhbmNlIGFuZCBvdGhl ciBlc3NlbnRpYWwgY2FwYWJpbGl0aWVzLiBNaW1lY2FzdCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFu ZCBzbWFsbCBvcmdhbml6YXRpb25zIGZyb20gbWFsaWNpb3VzIGFjdGl2aXR5LCBodW1hbiBlcnJv ciBhbmQgdGVjaG5vbG9neSBmYWlsdXJlOyBhbmQgdG8gbGVhZCB0aGUgbW92ZW1lbnQgdG93YXJk IGJ1aWxkaW5nIGEgbW9yZSByZXNpbGllbnQgd29ybGQuIFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0 IG91ciB3ZWJzaXRlLjwvcD48L2JvZHk+PC9odG1sPg0K --_000_445f86785851483bb3400b63d4c654ebMAILHUBpailocal_-- From nobody Wed Apr 6 21:59:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 928531A82E25; Wed, 6 Apr 2022 21:59:54 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYdj63FN7z3GN9; Wed, 6 Apr 2022 21:59:54 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649282394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=xS37a09f2j+D6oXvbNy3JpSp355g06Zi0IFCWDhLayM=; b=codISLKMW2nW2y3AwW5BRK1iehmBlyuvYdeaV45nRx3GMHJmC4sceWUpcsJ+Zns+6Afwy5 s5wx3XGj9OIFWP1TdhEMbEBQ94UGRi3HBGA4B6QbqTZOJ210JlHKNxvG2a35h9FuNrCA10 xsGKmNE0XyRpflCnBt6oOtkus3oJTFYPQobA+Z35sogdsmyZboLBz8j8XWMzv9WdD2y4nq kL+hxgzidxJ+TXqxE4aVD492T8K6Cax9tUW7vMYIXmrR33UAbCMiTZlTBfBu1I8IKdvjHn lzpqtbtUQzI32m4mymNrmM5QEhbxV/1mh/DjK0uOLy6XmAaeAVfGZMPE5xdK6A== Received: from [IPV6:2003:cd:5f22:6f00:953e:7ee1:500e:87a1] (p200300cd5f226f00953e7ee1500e87a1.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:953e:7ee1:500e:87a1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 9F8A35E79; Wed, 6 Apr 2022 21:59:52 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: <0702dc56-28ba-7e99-d599-1036634d79e3@FreeBSD.org> Date: Wed, 6 Apr 2022 23:59:50 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: mike tancsa , Bob Friesenhahn , egoitz@ramattack.net Cc: freebsd-fs@FreeBSD.org, freebsd-hackers@FreeBSD.org, Freebsd performance References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> From: Stefan Esser In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------2AmGM1Q6OeFqsRTohjQ1sr1u" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649282394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=xS37a09f2j+D6oXvbNy3JpSp355g06Zi0IFCWDhLayM=; b=LG0qHNBBEyPUrLC60qVGeR9xgTyLM5oZFNXhLwMLBBaRPMu69owI+TFY1SLZAQA+fKffIw Ap0T6ghK7ux71ilX8YdGf3JJJXQIxFHcUg57naKbEahuMjvJIyn/QJjlkdpfaLrJOnAvAY +Puxtjkjf5qsVCc/B8kruuj1F9auIA6BGnWMWK4R8eMD7bnENKrLwdtgen9Cn3yfT7Wf0Q ocAwgNhSQcQX2hVPSCfVMkslG+FoArobAVf+h4n605/Hos15KBw6k2f8bYnncNhrKR1clJ 4CAbni3TBA0HwoGgNe5jvSwAg7QjkFB39EXY1OHN92k11DrcTO/rGWM5mrXttw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649282394; a=rsa-sha256; cv=none; b=lc/d+Wp/isGygaYGCYvCBC5sW1+xGOXpnqBgsIIz8g3DE8mMdvkZXn42D4kKR8k5lBH+E5 qUoRfRm5H963+2IunYSSl12gbgpopEe409ATzxTktT7W3shhY5cfy+598s6S5tXahWI948 vi0Py1nJLg5OwaT/Dw1iRM9En3Vd7+fdfZH94d3mftlfszzC5NQkmfZrKjyBSt64MWfLC8 6xKUQpfKBhU6LGXOLZz9NCo/ebgFjjjE/RLQSnVtH6qqxfT00obfsnm+iPT+91ivxUkUgF s8GCA0Kcs90NNQG31zGDSxWEBPw896Yfcyx824EMvtFhYVYuoFzarg9G0U0QBg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------2AmGM1Q6OeFqsRTohjQ1sr1u Content-Type: multipart/mixed; boundary="------------lhrXooAciDl05L70ht5xs4WV"; protected-headers="v1" From: Stefan Esser To: mike tancsa , Bob Friesenhahn , egoitz@ramattack.net Cc: freebsd-fs@FreeBSD.org, freebsd-hackers@FreeBSD.org, Freebsd performance Message-ID: <0702dc56-28ba-7e99-d599-1036634d79e3@FreeBSD.org> Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> In-Reply-To: --------------lhrXooAciDl05L70ht5xs4WV Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 06.04.22 um 22:43 schrieb mike tancsa: > On 4/6/2022 4:18 PM, Bob Friesenhahn wrote: >> On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: >>>> >>>> WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY= YOU >>>> SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA >>>> COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AND= >>>> FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS = OF >>>> HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... >> >> There seems to be a problem with your caps-lock key. >> >> Since it seems that you said that you are using maildir for your mail = server, >> it is likely very useful if you do enable even rather mild compression= (e.g. >> lz4) since this will reduce the write work-load and even short files w= ill be >> stored more efficiently. >> > FYI, a couple of our big zfs=C2=A0 mailspools sees a 1.24x and 1.23x co= mpress ratio > with lz4.=C2=A0 We use Maildir format as well.=C2=A0 They are not RELEN= G_13 so not sure > how zstd would fair. I have got much better compression at same or less load by use of zstd-2 compared to lz4. Perhaps not typical, since this is a dovecot mdbox formatted mail pool holding mostly plain text messages without large attachments: $ df /var/mdbox Filesystem 1K-blocks Used Avail Capacity Mounted on system/var/mdbox 7234048944 9170888 7224878056 0% /var/mdbox $ zfs get compression,compressratio,used,logicalused system/var/mdbox NAME PROPERTY VALUE SOURCE system/var/mdbox compression zstd-2 inherited from system/va= r system/var/mdbox compressratio 2.29x - system/var/mdbox used 8.76G - system/var/mdbox logicalused 20.0G - Regards, STefan --------------lhrXooAciDl05L70ht5xs4WV-- --------------2AmGM1Q6OeFqsRTohjQ1sr1u Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJODVYFAwAAAAAACgkQR+u171r99UQH 3ggAjrm6XN5FfQ0OjamthevN4N2u/LyQAdJtTxB2Ta2BHBMDSrH969d/Ed7zHbpATNmtiGCDEVGS 5P93HzFDeE9dZRIp2yvIPOKhm1xuNlaK6anw31yMOhuTs+HkFZrW85/lqtkUyJgga82We9r7yTl7 JWsuLlNrBR6PmVLyi4GztB7wEF9JOd4oTCIye+001uP8OHtto4h5mX5APubPEaqZKk0mTCenfptZ ZVG+9q8xVj04jRp2Gia87XeODZ/Cvx1KsGzz5r+o2QBPxGKyO8Y7AaHWrRiJT4Rj6HW8T4F2ooNn x7rBKOwEUvnIQqDu7Pz8fQtIMVdv2Atc+SizWpARRA== =YgKS -----END PGP SIGNATURE----- --------------2AmGM1Q6OeFqsRTohjQ1sr1u-- From nobody Thu Apr 7 07:59:27 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 05C4C1A97DC7; Thu, 7 Apr 2022 07:59:35 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYv126R78z3KyW; Thu, 7 Apr 2022 07:59:34 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649318375; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=m2HUVrbEq7o9ase+zDUCti07l48rJ+nU2EpdAQMDQ38=; b=NMnF19bzpHf2nHHVB1YxAjcApV7iALDxLIvW6idngan6XSg0GeYmvFdpcwm2/zvQ/+Ga4J 7ek0Evu1q19J1y6m+FT/veoZWm7xFnz6pm8EKkXfay5gVNWeCpyihq0zFetyPVKrEXXYR8 yHcEibj27FCtdbcevPD3Huzq+9UgVKon1u8uPyO8MCPaqO52ZV5LU72ERviW6LSs80ewxK eYIs9tydKw1vh2ZQY/fd8lGOv4pJXhIThInO1WiOFFXkK60CWjIuLkJ9Vqh9KQYrWVbkBx Jel3ssLOEUyAw+tVxjCASoU6//o3kZdel7elQKdv7Ei/vNs+k/mySkoWbINFMQ== Received: from [IPV6:2003:cd:5f22:6f00:34ed:cacb:3b28:daf] (p200300cd5f226f0034edcacb3b280daf.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:34ed:cacb:3b28:daf]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id D6D7EA066; Thu, 7 Apr 2022 07:59:33 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: <49f43af5-e145-c793-959d-ab1596421d81@FreeBSD.org> Date: Thu, 7 Apr 2022 09:59:27 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: egoitz@ramattack.net References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> From: Stefan Esser Cc: Jan Bramkamp , performance@freebsd.org, "freebsd-fs@freebsd.org" , FreeBSD Hackers In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------o4K5Sngmd3lLPnmlzLRzMtEK" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649318374; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=m2HUVrbEq7o9ase+zDUCti07l48rJ+nU2EpdAQMDQ38=; b=IWML0cH5d0UJDKTcEQqANYFGYOX7ABIcJAQ+YDeHZ4QAbaUZSpBJrCNxrZZsrvCAkwnMTY K74KzXtXJVTxHPp78gm2hLlPomWFSHeFMV3VJPRXJ+PFFuX4SA+nhQcOh28iO9JCM7hyJX PLLdH0kXGvvIq2o0ovvwQ0Liy7kQTp0BKz19FyYcMsGRzHAg7kzduV535q1Pw7JFIHoR2T IYbeGPMhAXrLbNSZyxLz6AKgw95LS8srBqWqkSKFmlr22ZpoEjXdnYCUy2EnPz/7WON5RX RxN3OqalkAJKygy71QOovZXkBhNZUej5Mwz4dAaEzOaAOJDe5HgTWrD17kqW+Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649318374; a=rsa-sha256; cv=none; b=rApmUo+lAfX/P6o4SLQ68AGoD/Sx5BGrWCkFyCWD0/bXXVIBQWGs+Pi6shFlSIB6ZB5gIj ElK74KW/VSc62QR/K6s27Ji9I9iZy36zaE+AviLY5VURhHI0tyjl2jAF/AjsHaQQj0zqoh qNk++uhsi7umP6jnoQXI0DIXi8k98Jx48smYnExyveQfodOG60etpx2AgF/fT50iwOCtVQ bYbSc2Q5JFOBf4CRadmSUa8EMDNTVBnWlrJK6FGjN6mzMkisWg+s+N+S7z0ZK+jxMyXyAH NDvOmGPsf+5g3aWQz7Y5dNLIGe8PsGQ1Yx4n6FftSPBRddbI0b5akns9ejNw3w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------o4K5Sngmd3lLPnmlzLRzMtEK Content-Type: multipart/mixed; boundary="------------ce4Isv9Wdp6yhBkTY0YsttW0"; protected-headers="v1" From: Stefan Esser To: egoitz@ramattack.net Cc: Jan Bramkamp , performance@freebsd.org, "freebsd-fs@freebsd.org" , FreeBSD Hackers Message-ID: <49f43af5-e145-c793-959d-ab1596421d81@FreeBSD.org> Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> In-Reply-To: --------------ce4Isv9Wdp6yhBkTY0YsttW0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 06.04.22 um 23:19 schrieb Jan Bramkamp: > On 06.04.22 22:43, mike tancsa wrote: >> On 4/6/2022 4:18 PM, Bob Friesenhahn wrote: >>> On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: >>>>> >>>>> WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SA= Y YOU >>>>> SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA >>>>> COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AN= D >>>>> FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS= OF >>>>> HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... >>> >>> There seems to be a problem with your caps-lock key. >>> >>> Since it seems that you said that you are using maildir for your mail= >>> server, it is likely very useful if you do enable even rather mild >>> compression (e.g. lz4) since this will reduce the write work-load and= even >>> short files will be stored more efficiently. >>> >> FYI, a couple of our big zfs=C2=A0 mailspools sees a 1.24x and 1.23x c= ompress >> ratio with lz4.=C2=A0 We use Maildir format as well.=C2=A0 They are no= t RELENG_13 so >> not sure how zstd would fair. > I've found that Dovecot's mdbox format compresses a lot better than Mai= ldir (or > sdbox), because it stores multiple messages per file resulting in files= large > enough to contain enough exploitable reduncancy to compress down to the= next > smaller blocksize. In a corporate or education environment where users = tend to > send the same medium to large attachments multiple times to multiple re= cipients > on the same server Dovecot's single instance storage is a game changer.= It > reduced my IMAP storage requirements by a *factor* of 4.7 which allowed= me to > get rid of spinning disks for the mail servers instead of playing losin= g games > with hybrid storage. Dovecot also supports zlib compression in the appl= ication > instead of punting it to the file system. I don't know if Cyrus IMAP of= fers > similar features, but if it does I would recommend evaluating them inst= ead of > compressing or deduplicating at the file system level. I have not compared dovecot's zlib compression with zstd-2 on the file sy= stem, but since I use the latter on all my ZFS file systems (excepts those that= exclusively hold compressed files and media), I'm using it for Dovecot md= box files, too. I get a compression ratio of 2,29 with ZFS zstd-2, maybe I sh= ould copy the files over into a zlib compressed mdbox for comparison ... One large advantage of the mdbox format in the context of the mail server= set-up at the start of this thread is that deletions are only registered = in an index file (while mbox needs a rewrite of potentially large parts of t= he mail folder and mdir immediately deletes files (TRIM) and updates inodes = and directory entries, causing multiple writes per deleted message). With mdbox you can delay all "expensive" file system operations to the point of least load each day, for example. Such a compression run is also= well suited for SSDs, since it does not perform random updates that punch= holes in a large number of erase blocks (which then will need to be garba= ge collected, causing write amplification to put further load and stress on the SSD). --------------ce4Isv9Wdp6yhBkTY0YsttW0-- --------------o4K5Sngmd3lLPnmlzLRzMtEK Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJOmd8FAwAAAAAACgkQR+u171r99UQz fQgAj/0scy7zAbl1SoRPExnKQSTSk320RX81cVGflFCk2hDHRKeF9bScO22aZil0nYKaCKPR1Mps kyujxrmFpTgWjrjhNe7noHe5sz3LlGplXB7YNMKr0eujF1VC9YrlSvQLGTDFJeJyIRcI7EjSAgoy 8aLZjMG8rI7XCiMo1y+bpJqyWsElxYFoiomi2h2fkZ5MFZtWfyqPNaCFd2e4YHW6x6WYS9/H9ZDc k3E6GoFUaoRIuHC5dw2HbeUxBr72TYRLZgSH5pMBlk0cN60QNHkOBiBahbyzPVA/U1IJqCSVTWJP 7ZUNURO6nTn71io0o148Jho31IitSdxA4cuaJOOIVg== =DqKu -----END PGP SIGNATURE----- --------------o4K5Sngmd3lLPnmlzLRzMtEK-- From nobody Thu Apr 7 08:49:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 388251AA426B; Thu, 7 Apr 2022 08:49:21 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYw6R6nMZz3k6B; Thu, 7 Apr 2022 08:49:19 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id DADEA60C641; Thu, 7 Apr 2022 10:49:15 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_85ed0b4a49488ec1a940cb1f7fed0376" Date: Thu, 07 Apr 2022 10:49:15 +0200 From: egoitz@ramattack.net To: Eugene Grosbein Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> Message-ID: <55000f00fb64510e8ef6b8ad858d8855@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYw6R6nMZz3k6B X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_85ed0b4a49488ec1a940cb1f7fed0376 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Good morning Eugene!! Thank you so much for your help mate :) :) really :) :) Ok I take good notes of all you have replied me below :) :) Very very thankful for your help really :) Cheers, El 2022-04-06 20:10, Eugene Grosbein escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > 06.04.2022 23:51, egoitz@ramattack.net wrote: > >> About your recommendations... Eugene, if some of them wouldn't be working as expected, >> could we revert some or all of them > > Yes, it all can be reverted. > Just write down original sysctl values if you are going to change it. > >> 1) Make sure the pool has enough free space because ZFS can became crawling slow otherwise. >> >> *This is just an example... but you can see all similarly....* >> >> *zpool list* >> *NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT* >> *zroot 448G 2.27G 446G - - 1% 0% 1.00x ONLINE -* >> *mail_dataset 58.2T 19.4T 38.8T - - 32% 33% 1.00x ONLINE -* > > It's all right. > >> 2) Increase recordsize upto 1MB for file systems located in the pool >> so ZFS is allowed to use bigger request sizes for read/write operations >> >> *We have the default... so 128K...* > > It will not hurt increasing it upto 1MB. > >> 5) If you have good power supply and stable (non-crashing) OS, try increasing >> sysctl vfs.zfs.txg.timeout from defaule 5sec, but do not be extreme (f.e. upto 10sec). >> Maybe it will increase amount of long writes and decrease amount of short writes, that is good. >> >> *Well I have sync in disabled in the datasets... do you still think it's good to change it? > > Yes, try it. Disabling sync makes sense if you have lots of fsync() operations > but other small writes are not affected unless you raise vfs.zfs.txg.timeout > >> *What about the vfs.zfs.dirty_data_max and the vfs.zfs.dirty_data_max_max, would you increase them from 4GB it's set now?.* > > Never tried that and cannot tell. --=_85ed0b4a49488ec1a940cb1f7fed0376 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Good morning Eugene!!


Thank you so much for your help mate :) :) really :) :)


Ok I take good notes of all you have replied me below :) :)


Very very thankful for your help really :)


Cheers,

 


El 2022-04-06 20:10, Eugene Grosbein escribió:

= ATENCION
ATENCION
ATENCION!!! Este correo se ha enviado desde f= uera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no= ser que reconozca el remitente y sepa que el contenido es seguro.
06.04.2022 23:51, egoitz@ramat= tack.net wrote:

About your recommendations... Eugene, if some of them = wouldn't be working as expected,
could we revert some or all of them<= /blockquote>
Yes, it all can be reverted.
Just write down original sysctl v= alues if you are going to change it.

1) Make sure the pool has enough free space because ZF= S can became crawling slow otherwise.
 
*This is just an e= xample... but you can see all similarly....*
 
*zpool list= *
*NAME           &= nbsp; SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ &= nbsp; FRAG    CAP  DEDUP  HEALTH  ALTROO= T*
*zroot           = ;  448G  2.27G   446G     &nbs= p;  -         -  &nb= sp;  1%     0%  1.00x  ONLINE  = ;-*
*mail_dataset  58.2T  19.4T  38.8T   &nb= sp;    -        &nbs= p;-    32%    33%  1.00x  ONLINE &n= bsp;-*

It's all right.

2) Increase recordsize upto 1MB for file systems locat= ed in the pool
so ZFS is allowed to use bigger request sizes for read= /write operations
 
*We have the default... so 128K...*
It will not hurt increasing it upto 1MB.

5) If you have good power supply and stable (non-crash= ing) OS, try increasing
sysctl vfs.zfs.txg.timeout from defaule 5sec,= but do not be extreme (f.e. upto 10sec).
Maybe it will increase amou= nt of long writes and decrease amount of short writes, that is good.
=  
*Well I have sync in disabled in the datasets... do you still = think it's good to change it?

Yes, try it. Disabling sync makes sense if you have lots of fsync() = operations
but other small writes are not affected unless you raise v= fs.zfs.txg.timeout

*What about the vfs.zfs.dirty_data_max and the vfs.zfs= =2Edirty_data_max_max, would you increase them from 4GB it's set now?.*
Never tried that and cannot tell.
--=_85ed0b4a49488ec1a940cb1f7fed0376-- From nobody Thu Apr 7 08:56:26 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C741A1AA6C09; Thu, 7 Apr 2022 08:56:30 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYwGj2cvcz3mnC; Thu, 7 Apr 2022 08:56:28 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 6808A60C149; Thu, 7 Apr 2022 10:56:26 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_d38b5728c4674c13e58315ae3b5e7d2c" Date: Thu, 07 Apr 2022 10:56:26 +0200 From: egoitz@ramattack.net To: Bob Friesenhahn Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance , owner-freebsd-fs@freebsd.org Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYwGj2cvcz3mnC X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_d38b5728c4674c13e58315ae3b5e7d2c Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Bob! Thank you so much really for your comments :) :) Wow! I wouldn't have wanted to write in capital letters.... I would have sworn not to have done.... Apologies for that really ..... Note taking mate. We didn't changed almost nothing than the sync param, for avoid modifying the most we could the default config of ZFS. We thought it could perhaps be the most stable config and we have not disk space problems so... Apart of that, for avoid load coming from compression/decompression.... although we have lots of cpu too..... Thanks a lot Bob :) Cheers, El 2022-04-06 22:18, Bob Friesenhahn escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: > WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... There seems to be a problem with your caps-lock key. Since it seems that you said that you are using maildir for your mail server, it is likely very useful if you do enable even rather mild compression (e.g. lz4) since this will reduce the write work-load and even short files will be stored more efficiently. Bob --=_d38b5728c4674c13e58315ae3b5e7d2c Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Bob!


Thank you so much really for your comments :) :)


Wow! I wouldn't have wanted to write in capital letters.... I would have= sworn not to have done.... Apologies for that really .....


Note taking mate. We didn't changed almost nothing than the sync param, = for avoid modifying the most we could the default config of ZFS. We thought= it could perhaps be the most stable config and we have not disk space prob= lems so... Apart of that, for avoid load coming from compression/decompress= ion.... although we have lots of cpu too.....


Thanks a lot Bob :)


Cheers,

 


El 2022-04-06 22:18, Bob Friesenhahn escribió:

= ATENCION
ATENCION
ATENCION= !!! Este correo se ha enviado desde fuer= a de la organizacion. No pinche en los&n= bsp;enlaces ni abra los adjuntos a no se= r que reconozca el remitente y sepa que&= nbsp;el contenido es seguro.

On Wed, 6 Apr 2022, egoitz@ramattack.net wrote:

WE DO= N'T USE COMPRESSION AS IT'S NOT SET BY&n= bsp;DEFAULT. SOME PEOPLE SAY YOU SHOULD HAVE&= nbsp;IT ENABLED.... BUT.... JUST FOR AVOID HA= VING SOME DATA COMPRESSED SOME OTHER NOT = ;(IN CASE YOU ENABLE AND LATER DISABLE) = AND FINALLY FOR AVOID ACCESSING TO INFORMATIO= N WITH DIFFERENT CPU COSTS OF HANDLING...&nbs= p;WE HAVE NOT TOUCHED COMPRESSION....

There seems to b= e a problem with your caps-lock key.
Since it seems that you said that you are using maildir for you= r mail server, it is likely very useful if you do enable even rather mild c= ompression (e.g. lz4) since this will reduce the write work-load and even s= hort files will be stored more efficiently.

Bob
--=_d38b5728c4674c13e58315ae3b5e7d2c-- From nobody Thu Apr 7 08:59:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 901611A80E64; Thu, 7 Apr 2022 08:59:53 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYwLc4b9Kz3pb3; Thu, 7 Apr 2022 08:59:52 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id A23F660C6A9; Thu, 7 Apr 2022 10:59:50 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_c2807b764a57b09883b960b84ffbc8e7" Date: Thu, 07 Apr 2022 10:59:50 +0200 From: egoitz@ramattack.net To: mike tancsa Cc: Bob Friesenhahn , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> Message-ID: <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KYwLc4b9Kz3pb3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24:c]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_c2807b764a57b09883b960b84ffbc8e7 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Mike! Thanks a lot for your comment. I see. As said before, we didn't really enable compression because we just keep the config as FreeBSD leaves by default. Apart from that, having tons of disk space and well... for avoiding the load of compress/decompress... The main reason was it was not enabled by default really and not to have seen a real reason for it.... was not more than that.... I appreciate your comments really :) Cheers, El 2022-04-06 22:43, mike tancsa escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > On 4/6/2022 4:18 PM, Bob Friesenhahn wrote: On Wed, 6 Apr 2022, egoitz@ramattack.net wrote: > WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEFAULT. SOME PEOPLE SAY YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID HAVING SOME DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER DISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU COSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION.... There seems to be a problem with your caps-lock key. Since it seems that you said that you are using maildir for your mail server, it is likely very useful if you do enable even rather mild compression (e.g. lz4) since this will reduce the write work-load and even short files will be stored more efficiently. FYI, a couple of our big zfs mailspools sees a 1.24x and 1.23x compress ratio with lz4. We use Maildir format as well. They are not RELENG_13 so not sure how zstd would fair. ---Mike --=_c2807b764a57b09883b960b84ffbc8e7 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Mike!


Thanks a lot for your comment. I see. As said before, we didn't really e= nable compression because we just keep the config as FreeBSD leaves by defa= ult. Apart from that, having tons of disk space and well... for avoiding th= e load of compress/decompress... The main reason was it was not enabled by = default really and not to have seen a real reason for it.... was not more t= han that....


I appreciate your comments really :)


Cheers,

 


El 2022-04-06 22:43, mike tancsa escribió:

= ATENCION
ATENCION
ATENCION= !!! Este correo se ha enviado desde fuer= a de la organizacion. No pinche en los&n= bsp;enlaces ni abra los adjuntos a no se= r que reconozca el remitente y sepa que&= nbsp;el contenido es seguro.

On 4/6/2022 4:18 PM, Bob = ;Friesenhahn wrote:
On Wed, = ;6 Apr 2022, egoitz@= ramattack.net wrote:

WE DON'T USE COMPRESSION AS IT'S NOT SET BY DEF= AULT. SOME PEOPLE SAY YOU SHOULD HAVE IT ENABLED.... BUT.... JUST FOR AVOID= HAVING SOME DATA COMPRESSED SOME OTHER NOT (IN CASE YOU ENABLE AND LATER D= ISABLE) AND FINALLY FOR AVOID ACCESSING TO INFORMATION WITH DIFFERENT CPU C= OSTS OF HANDLING... WE HAVE NOT TOUCHED COMPRESSION....

There seems to b= e a problem with your caps-lock key.
Since it seems that you said that you are using maildir for you= r mail server, it is likely very useful if you do enable even rather mild c= ompression (e.g. lz4) since this will reduce the write work-load and even s= hort files will be stored more efficiently.
FYI, a couple of our big zfs  mailspools sees a 1.24x and 1.23x compre= ss ratio with lz4.  We use Maildir format as well.  They are not = RELENG_13 so not sure how zstd would fair.

    ---Mike

--=_c2807b764a57b09883b960b84ffbc8e7-- From nobody Thu Apr 7 10:05:42 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6937A1A9104B; Thu, 7 Apr 2022 10:05:46 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYxpf1mgPz4VgL; Thu, 7 Apr 2022 10:05:46 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649325946; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=5VyYb2yVup9mr10ClzHwP1P7qCT1D6ac9qjMWMQpYPk=; b=J9AwR7QGgnmSa3A7RyFhNZlz+Dxw2twvndSx8IPIRNsDTVooRRHtoZ7h1+gMQOh0VEb9r1 lV84OzxPP0ykzqwJsFRlsPDVTItjJQK0q1yLpWMK6p1bKkkEgFNLQ81K4P3LUFIiMClYvp +/fme73HUjV1rrWZqai8D1vqbGTfryPa3J+UdAaiwDx2440i0uBtb1g8RxtGbOAoiU42ro q7ZvA62+gwZ2bF8X3LMFFE5pLaKmQi4cDzfATAkWsjMEO74+N7QG0rU1Oj/s8S0YRkWj/M 7G5MkwcilTG0mFsIJx1CbCU/lCrqqNotRBGp2lagrbX7F6pW1AlyW0DViyMAKQ== Received: from [IPV6:2003:cd:5f22:6f00:34ed:cacb:3b28:daf] (p200300cd5f226f0034edcacb3b280daf.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:34ed:cacb:3b28:daf]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 57989B868; Thu, 7 Apr 2022 10:05:45 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: <4ef109e8-bd7b-1398-2bc9-191e261d5c06@FreeBSD.org> Date: Thu, 7 Apr 2022 12:05:42 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS Content-Language: en-US From: Stefan Esser To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------R8ub0be6TPBsoV0UvSwjPqsv" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649325946; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=5VyYb2yVup9mr10ClzHwP1P7qCT1D6ac9qjMWMQpYPk=; b=RWVkDqf8CQrXjJevQVFL0cShsK6iSZaO1jgE2Bi17Mnlp9ugcTH7ulNWb7xwGAtQUp37P7 w3iX6N9imCTlq1qr1VW74CVMGcRRhHJMty/o6myH3BBue0yalPYyhPeo8tZPooYkkYXV92 TMnvXkls2R8OOcsMCvywiIn1ZKIihEhBaZn1db4MLOUe05VMrCvPXgyBsgE6hrtxLVcJzL jK0v5ylRXmKuP9f2iFcfPVYjbyReNcRsCRifFXziero9bJLodjprmIBgBGhRe0KrQqckia cJgbD/ILyDZGJFRbK9NP8Je+Yy5abeS1DhYGSR8qPgD361vy44hLJEqC8qSOWQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649325946; a=rsa-sha256; cv=none; b=lPlxEMv0z3Ynd/DOBaq3/QIOwZxMQwY6ptua//2UhvaqXxm++Pu4qtZzIYesl0IM0/C9t6 X0vcIGvQVRC0QYFKC1MXPnLTiLaIy8o2CwyLOMqALay/wYBwKj1aa4jTYKPiD5DUNNOMdP 9NbMeoWpU4VjsfaJy4iEk45Rtmv1ndzwr/jp6AcGne1bY8ELaAloPZ+yLTAqK77r+k1TeF hmmTFElyuRL7pk/YgQGpin+ZczqnQeqyCn4TnpR9XxB2afGIP70VXOR/O8tA58kVN96Hda pWpqinjZuhwvX1miJwCsFB6wwdC4vk8QSdFbW0ivMT3aEKdZznYQtV/d63+s9A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------R8ub0be6TPBsoV0UvSwjPqsv Content-Type: multipart/mixed; boundary="------------MH3UBEk8xxTm08glzsqFwYDD"; protected-headers="v1" From: Stefan Esser To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Message-ID: <4ef109e8-bd7b-1398-2bc9-191e261d5c06@FreeBSD.org> Subject: Re: {* 05.00 *}Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> In-Reply-To: --------------MH3UBEk8xxTm08glzsqFwYDD Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 06.04.22 um 23:49 schrieb Stefan Esser: > Am 06.04.22 um 18:34 schrieb egoitz@ramattack.net: >=20 >>> The 870 QVO is specified for 370 full capacity >>> writes, i.e. 370 TB for the 1 TB model. That's still a few hundred >>> GB a day - but only if the write amplification stays in a reasonable >>> range ... >>> =C2=A0 >>> *Well yes... 2880TB in our case....not bad.. isn't it?* >=20 > I assume that 2880 TB is your total storage capacity? That's not too ba= d, in > fact. ;-) I just noticed that this is not the extreme total size of a ZFS pool (should have noticed this while answering late at night ...) And no, a specified life-time of 2880 TB written is not much, it is at the absolute lower end of currently available SSDs at 360 TB per 1 TB of capacity. This is equivalent to 360 total capacity writes, but given the high amount of write amplification that can be assumed to occur in your use case, I'd heavily over-provision a system with such SSDs ... (or rather: strictly avoid them in a non-consumer setting). --------------MH3UBEk8xxTm08glzsqFwYDD-- --------------R8ub0be6TPBsoV0UvSwjPqsv Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJOt3YFAwAAAAAACgkQR+u171r99USG 4AgAqvLdjcqRhYzJHDNPIR+8TN0JKwMia2AI7dwFi/edSRFtjP50d/sbgxhP7xkf6a13LuLypubc UK2ldNCHlczP/9m5+uG2MTb9E24Pc1bpX4o459oFzx7MGRyRksMmMKnNyidiVIx4W/ihfZa0b/5K ICbgTmE79RIc3tX8cn77Kp8W8asjABCE2vgqTLtyJpfuhBSg60flkjMAOoBwsyXDNKvEDWWuR3zU U4kxS00DZ2Cb8EHMmi5yiyH+GqoJWRH55BYl0bw3ppDubbQuEZWJojcMZ2eWFJYcC29LkYvCUDrc YgesfZGPQ9eTk1cbKq01ZOCk4zOsgt2PcmFla759oQ== =GJ82 -----END PGP SIGNATURE----- --------------R8ub0be6TPBsoV0UvSwjPqsv-- From nobody Thu Apr 7 11:25:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1DE191A86A2A; Thu, 7 Apr 2022 11:25:52 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KYzb31Xn5z4mwN; Thu, 7 Apr 2022 11:25:51 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 237BPnGI010096 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 7 Apr 2022 07:25:49 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:434:73cd:9d42:28ad] ([IPv6:2607:f3e0:0:4:434:73cd:9d42:28ad]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 237BPlhB073256 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 7 Apr 2022 07:25:48 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Thu, 7 Apr 2022 07:25:47 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS Content-Language: en-US To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> From: mike tancsa In-Reply-To: <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KYzb31Xn5z4mwN X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-2.75 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.35)[-0.349]; FREEFALL_USER(0.00)[mike]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 4/7/2022 4:59 AM, egoitz@ramattack.net wrote: > > Hi Mike! > > Thanks a lot for your comment. I see. As said before, we didn't really > enable compression because we just keep the config as FreeBSD leaves > by default. Apart from that, having tons of disk space and well... for > avoiding the load of compress/decompress... The main reason was it was > not enabled by default really and not to have seen a real reason for > it.... was not more than that....I appreciate your comments really :) Hi,     With respect to compression, I think there is a sweet spot somewhere, where compression makes things faster if your disk IO is the limiting factor and you have spare CPU capacity.  I have a separate 13.x zfs server with ztsd enabled and I get compression rations of 15:1 as it stores a lot of giant JSON txt files. Think of the extreme case where you do something like dd if=/dev/zero of=/tank/junk.bin bs=1m count=10000 as this is a 20G file that takes just a few hundred bytes of write IO on a compressed system. Obviously, as the compress ratio reduces in the real world the benefits become less.  Where that diminishing return is, not sure.  But something to keep in mind     ---Mike From nobody Thu Apr 7 12:30:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 679491A9AAC5; Thu, 7 Apr 2022 12:31:00 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ12B28vFz3M2k; Thu, 7 Apr 2022 12:30:57 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id 35B5A60C4C4; Thu, 7 Apr 2022 14:30:48 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_ccf36dab3b44229808a0a46435736314" Date: Thu, 07 Apr 2022 14:30:47 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Subject: Re: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ12B28vFz3M2k X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_ccf36dab3b44229808a0a46435736314 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Stefan, An extremely interesting answer and email. Extremely thankful for all your deep explatanations...... They are like gold for us really.... I answer below and in blue bold for better distinction between your lines and mine ones... El 2022-04-06 23:49, Stefan Esser escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Am 06.04.22 um 18:34 schrieb egoitz@ramattack.net: > >> Hi Stefan! >> >> Thank you so much for your answer!!. I do answer below in green bold for instance... for a better distinction.... >> >> Very thankful for all your comments Stefan!!! :) :) :) >> >> Cheers!! > > Hi, > > glad to hear that it is useful information - I'll add comments below ... > > EXTREMELY HELPFUL INFORMATION REALLY! THANK YOU SO MUCH STEFFAN REALLY. VERY VERY THANKFUL FOR YOUR NICE HELP!. > > El 2022-04-06 17:43, Stefan Esser escribió: > > Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: Hi Rainer! > > Thank you so much for your help :) :) > > Well I assume they are in a datacenter and should not be a power outage.... > > About dataset size... yes... our ones are big... they can be 3-4 TB easily each > dataset..... > > We bought them, because as they are for mailboxes and mailboxes grow and > grow.... for having space for hosting them... > Which mailbox format (e.g. mbox, maildir, ...) do you use? > > I'M RUNNING CYRUS IMAP SO SORT OF MAILDIR... TOO MANY LITTLE FILES NORMALLY..... SOMETIMES DIRECTORIES WITH TONS OF LITTLE FILES.... Assuming that many mails are much smaller than the erase block size of the SSD, this may cause issues. (You may know the following ...) For example, if you have message sizes of 8 KB and an erase block size of 64 KB (just guessing), then 8 mails will be in an erase block. If half the mails are deleted, then the erase block will still occupy 64 KB, but only hold 32 KB of useful data (and the SSD will only be aware of this fact if TRIM has signaled which data is no longer relevant). The SSD will copy several partially filled erase blocks together in a smaller number of free blocks, which then are fully utilized. Later deletions will repeat this game, and your data will be copied multiple times until it has aged (and the user is less likely to delete further messages). This leads to "write amplification" - data is internally moved around and thus written multiple times. STEFAN!! YOU ARE NICE!! I THINK THIS COULD EXPLAIN ALL OUR PROBLEM. SO, WHY WE ARE HAVING THE MOST RANDOMNESS IN OUR PERFORMANCE DEGRADATION AND THAT DOES NOT NECESSARILY HAS TO MATCH WITH THE MOST IO PEAK HOURS... THAT I COULD CAUSE THAT PERFORMANCE DEGRADATION JUST BY DELETING A COUPLE OF HUGE (PERHAPS 200.000 MAILS) MAIL FOLDERS IN A MIDDLE TRAFFIC HOUR TIME!! THE PROBLEM IS THAT BY WHAT I KNOW, ERASE BLOCK SIZE OF AN SSD DISK IS SOMETHING FIXED IN THE DISK FIRMWARE. I DON'T REALLY KNOW IF PERHAPS IT COULD BE MODIFIED WITH SAMSUNG MAGICIAN OR THOSE KIND OF TOOL OF SAMSUNG.... ELSE I DON'T REALLY SEE THE MANNER OF IMPROVING IT... BECAUSE APART FROM THAT, YOU ARE DELETING A FILE IN RAIDZ-2 ARRAY... NO JUST IN A DISK... I ASSUME ALIGNING CHUNK SIZE, WITH RECORD SIZE AND WITH THE "SECRET" ERASE SIZE OF THE SSD, PERHAPS COULD BE SLIGHTLY COMPENSATED?. Larger mails are less of an issue since they span multiple erase blocks, which will be completely freed when such a message is deleted. I SEE I SEE STEFAN... Samsung has a lot of experience and generally good strategies to deal with such a situation, but SSDs specified for use in storage systems might be much better suited for that kind of usage profile. YES... AND THE DISKS FOR OUR PURPOSE... PERHAPS WEREN'T QVOS.... > We knew they had some speed issues, but those speed issues, we thought (as > Samsung explains in the QVO site) they started after exceeding the speeding > buffer this disks have. We though that meanwhile you didn't exceed it's > capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps > we were wrong?. > These drives are meant for small loads in a typical PC use case, > i.e. some installations of software in the few GB range, else only > files of a few MB being written, perhaps an import of media files > that range from tens to a few hundred MB at a time, but less often > than once a day. > > WE MOVE, YOU KNOW... LOTS OF LITTLE FILES... AND LOT'S OF DIFFERENT CONCURRENT MODIFICATIONS BY 1500-2000 CONCURRENT IMAP CONNECTIONS WE HAVE... I do not expect the read load to be a problem (except possibly when the SSD is moving data from SLC to QLC blocks, but even then reads will get priority). But writes and trims might very well overwhelm the SSD, especially when its getting full. Keeping a part of the SSD unused (excluded from the partitions created) will lead to a large pool of unused blocks. This will reduce the write amplification - there are many free blocks in the "unpartitioned part" of the SSD, and thus there is less urgency to compact partially filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a partition used for the ZPOOL, then 1/4 of each erase block could be free due to deletions/TRIM without any compactions required to hold all this data.) Keeping a significant percentage of the SSD unallocated is a good strategy to improve its performance and resilience. WELL, WE HAVE ALLOCATED ALL THE DISK SPACE... BUT NOT USED... JUST ALLOCATED.... YOU KNOW... WE DO A ZPOOL CREATE WITH THE WHOLE DISKS..... >> As the SSD fills, the space available for the single level write >> cache gets smaller >> >> THE SINGLE LEVEL WRITE CACHE IS THE CACHE THESE SSD DRIVERS HAVE, FOR COMPENSATING THE SPEED ISSUES THEY HAVE DUE TO USING QLC MEMORY?. DO YOU REFER TO THAT?. SORRY I DON'T UNDERSTAND WELL THIS PARAGRAPH. Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as 24 GB of data in QLC mode. OK, TRUE.... YES.... A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (600 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells). AHH! YOU MEAN THAT SLC CAPACITY FOR SPEEDING UP THE QLC DISKS, IS OBTAINED FROM EACH SINGLE LAYER OF THE QLC?. Therefore, the fraction of the cells used as an SLC cache is reduced when it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cells). SORRY I DON'T GET THIS LAST SENTENCE... DON'T UNDERSTAND IT BECAUSE I DON'T REALLY KNOW THE MEANING OF TN... BUT I THINK I'M GETTING THE IDEA IF YOU SAY THAT EACH QLC LAYER, HAS IT'S OWN SLC CACHE OBTAINED FROM THE DISK SPACE AVAIABLE FOR EACH QLC LAYER.... And with less SLC cells available for short term storage of data the probability of data being copied to QLC cells before the irrelevant messages have been deleted is significantly increased. And that will again lead to many more blocks with "holes" (deleted messages) in them, which then need to be copied possibly multiple times to compact them. IF I CORRECT ABOVE, I THINK I GOT THE IDEA YES.... >> (on many SSDs, I have no numbers for this >> particular device), and thus the amount of data that can be >> written at single cell speed shrinks as the SSD gets full. >> >> I have just looked up the size of the SLC cache, it is specified >> to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB >> version, smaller models will have a smaller SLC cache). >> >> ASSUMING YOU WERE TALKING ABOUT THE CACHE FOR COMPENSATING SPEED WE PREVIOUSLY COMMENTED, I SHOULD SAY THESE ARE THE 870 QVO BUT THE 8TB VERSION. SO THEY SHOULD HAVE THE BIGGEST CACHE FOR COMPENSATING THE SPEED ISSUES... I have looked up the data: the larger versions of the 870 QVO have the same SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB more if there are enough free blocks. OURS ONE IS THE 8TB MODEL SO I ASSUME IT COULD HAVE BIGGER LIMITS. THE DISKS ARE MOSTLY EMPTY, REALLY.... SO... FOR INSTANCE.... ZPOOL LIST NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT ROOT_DATASET 448G 2.29G 446G - - 1% 0% 1.00X ONLINE - MAIL_DATASET 58.2T 11.8T 46.4T - - 26% 20% 1.00X ONLINE - I SUPPOSE FRAGMENTATION AFFECTS TOO.... >> But after writing those few GB at a speed of some 500 MB/s (i.e. >> after 12 to 150 seconds), the drive will need several minutes to >> transfer those writes to the quad-level cells, and will operate >> at a fraction of the nominal performance during that time. >> (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the >> 2 TB model.) >> >> WELL WE ARE IN THE 8TB MODEL. I THINK I HAVE UNDERSTOOD WHAT YOU WROTE IN PREVIOUS PARAGRAPH. YOU SAID THEY CAN BE FAST BUT NOT CONSTANTLY, BECAUSE LATER THEY HAVE TO WRITE ALL THAT TO THEIR PERPETUAL STORAGE FROM THE CACHE. AND THAT'S SLOW. AM I WRONG?. EVEN IN THE 8TB MODEL YOU THINK STEFAN?. The controller in the SSD supports a given number of channels (e.g 4), each of which can access a Flash chip independently of the others. Small SSDs often have less Flash chips than there are channels (and thus a lower throughput, especially for writes), but the larger models often have more chips than channels and thus the performance is capped. THIS IS TOTALLY LOGICAL. IF A QVO DISK WOULD OUTPERFORM BEST OR SIMILAR THAN AN INTEL WITHOUT CONSEQUENCES.... WHO WAS GOING TO BUY A EXPENSIVE INTEL ENTERPRISE?. In the case of the 870 QVO, the controller supports 8 channels, which allows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has only 4 Flash chips and is thus limited to 80 MB/s in that situation, while the larger versions have 8, 16, or 32 chips. But due to the limited number of channels, the write rate is limited to 160 MB/s even for the 8 TB model. TOTALLY LOGICAL STEFAN... If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in this limit. >> THE MAIN PROBLEM WE ARE FACING IS THAT IN SOME PEAK MOMENTS, WHEN THE MACHINE SERVES CONNECTIONS FOR ALL THE INSTANCES IT HAS, AND ONLY AS SAID IN SOME PEAK MOMENTS... LIKE THE 09AM OR THE 11AM.... IT SEEMS THE MACHINE BECOMES SLOWER... AND LIKE IF THE DISKS WEREN'T ABLE TO SERVE ALL THEY HAVE TO SERVE.... IN THESE MOMENTS, NO BIG FILES ARE MOVED... BUT AS WE HAVE 1800-2000 CONCURRENT IMAP CONNECTIONS... NORMALLY THEY ARE DOING EACH ONE... LITTLE CHANGES IN THEIR MAILBOX. DO YOU THINK PERHAPS THIS DISKS THEN ARE NOT APPROPRIATE FOR THIS KIND OF USAGE?- I'd guess that the drives get into a state in which they have to recycle lots of partially free blocks (i.e. perform kind of a garbage collection) and then three kinds of operations are competing with each other: * reads (generally prioritized) * writes (filling the SLC cache up to its maximum size) * compactions of partially filled blocks (required to make free blocks available for re-use) Writes can only proceed if there are sufficient free blocks, which on a filled SSD with partially filled erase blocks means that operations of type 3. need to be performed with priority to not stall all writes. My assumption is that this is what you are observing under peak load. IT COULD BE ALTHOUGH THE DISKS ARE NOT FILLED.... THE POOL ARE AT 20 OR 30% OF CAPACITY AND FRAGMENTATION FROM 20%-30% (AS ZPOOL LIST STATES). >> And cheap SSDs often have no RAM cache (not checked, but I'd be >> surprised if the QVO had one) and thus cannot keep bookkeeping date >> in such a cache, further limiting the performance under load. >> >> THIS BROCHURE (HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/BROCHURE/870_SERIES_BROCHURE.PDF AND THE DATASHEET HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/DATA-SHEET/SAMSUNG_SSD_870_QVO_DATA_SHEET_REV1.1.PDF) SAIS IF I HAVE READ PROPERLY, THE 8TB DRIVE HAS 8GB OF RAM?. I ASSUME THAT IS WHAT THEY CALL THE TURBO WRITE CACHE?. No, the turbo write cache consists of the cells used in SLC mode (which can be any cells, not only cells in a specific area of the flash chip). I SEE I SEE.... The RAM is needed for fast lookup of the position of data for reads and of free blocks for writes. OUR ONES... SEEM TO HAVE 8GB LPDDR4 OF RAM.... AS DATASHEET STATES.... There is no simple relation between SSD "block number" (in the sense of a disk block on some track of a magnetic disk) and its storage location on the Flash chip. If an existing "data block" (what would be a sector on a hard disk drive) is overwritten, it is instead written at the end of an "open" erase block, and a pointer from that "block number" to the location on the chip is stored in an index. This index is written to Flash storage and could be read from it, but it is much faster to have a RAM with these pointers that can be accessed independently of the Flash chips. This RAM is required for high transaction rates (especially random reads), but it does not really help speed up writes. I SEE... I SEE.... I GOT IT... >> And the resilience (max. amount of data written over its lifetime) >> is also quite low - I hope those drives are used in some kind of >> RAID configuration. >> >> YEP WE USE RAIDZ-2 Makes sense ... But you know that you multiply the amount of data written due to the redundancy. If a single 8 KB block is written, for example, 3 * 8 KB will written if you take the 2 redundant copies into account. I SEE I SEE.... >> The 870 QVO is specified for 370 full capacity >> writes, i.e. 370 TB for the 1 TB model. That's still a few hundred >> GB a day - but only if the write amplification stays in a reasonable >> range ... >> >> WELL YES... 2880TB IN OUR CASE....NOT BAD.. ISN'T IT? I assume that 2880 TB is your total storage capacity? That's not too bad, in fact. ;-) NO... THE TOTAL NUMBER OF WRITES YOU CAN DO....BEFORE THE DISK "BREAKS".... LOL :) :) ... WE ARE HAVING STORAGES OF 50TB DUE TO 8 DISKS OF 8TB IN RAIDZ-2.... This would be 360 * 8 TB ... Even at 160 MB/s per 8 TB SSD this would allow for more than 50 GB/s of write throughput (if all writes were evenly distributed). Taking all odds into account, I'd guess that at least 10 GB/s can be continuously written (if supported by the CPUs and controllers). But this may not be true if the drive is simultaneously reading, trimming, and writing ... I SEE.... IT'S EXTREMELY MISLEADING YOU KNOW... BECAUSE... YOU CAN COPY FIVE MAILBOXES OF 50GB CONCURRENTLY FOR INSTANCE.... AND YOU FLOOD A GIGABIT INTERFACE COPYING (OBVIOUSLY BECAUSE DISKS CAN KEEP THAT THROUGHPUT)... BUT LATER.... YOU SEE... YOU ARE IN AN HOUR THAT YESTERDAY, AND EVEN 4 DAYS BEFORE YOU HAVE NOT HAD ANY ISSUES... AND THAT DAY... YOU SEE THE COMMENTED ISSUE... EVEN NOT BEING EXACTLY AT A PEAK HOUR (PERHAPS IS TWO HOURS LATER THE PEAK HOUR EVEN)... OR... BUT I WASN'T NOTICING ABOUT ALL THINGS YOU SAY IN THIS EMAIL.... I have seen advice to not use compression in a high load scenario in some other reply. I tend to disagree: Since you seem to be limited when the SLC cache is exhausted, you should get better performance if you compress your data. I have found that zstd-2 works well for me (giving a significant overall reduction of size at reasonable additional CPU load). Since ZFS allows to switch compressions algorithms at any time, you can experiment with different algorithms and levels. I SEE... YOU SAY COMPRESSION SHOULD BE ENABLED.... THE MAIN REASON BECAUSE WE HAVE NOT ENABLED IT YET, IS FOR KEEPING THE SYSTEM THE MOST NEAR POSSIBLE TO CONFIG DEFAULTS... YOU KNOW... FOR LATER BEING ABLE TO ASK IN THIS MAILING LISTS IF WE HAVE AN ISSUE... BECAUSE YOU KNOW... IT WOULD BE FAR MORE EASIER TO ASK ABOUT SOMETHING STRANGE YOU ARE SEEING WHEN THAT STRANGE THING IS NEAR TO A WELL TESTED CONFIG, LIKE THE CONFIG BY DEFAULT.... BUT NOW YOU SAY STEFAN... IF YOU SWITCH BETWEEN COMPRESSION ALGORITHMS YOU WILL END UP WITH A MIX OF DIFFERENT FILES COMPRESSED IN A DIFFERENT MANNER... THAT IS NOT A BIT DISASTER LATER?. DOESN'T AFFECT PERFORMANCE IN SOME MANNER?. One advantage of ZFS compression is that it applies to the ARC, too. And a compression factor of 2 should easily be achieved when storing mail (not for .docx, .pdf, .jpg files though). Having more data in the ARC will reduce the read pressure on the SSDs and will give them more cycles for garbage collections (which are performed in the background and required to always have a sufficient reserve of free flash blocks for writes). WE WOULD USE I ASSUME THE LZ4... WHICH IS THE LESS "EXPENSIVE" COMPRESSION ALGORITHM FOR THE CPU... AND I ASSUME TOO FOR AVOIDING DELAY ACCESSING DATA... DO YOU RECOMMEND ANOTHER ONE?. DO YOU ALWAYS RECOMMEND COMPRESSION THEN?. I'd give it a try - and if it reduces your storage requirements by 10% only, then keep 10% of each SSD unused (not assigned to any partition). That will greatly improve the resilience of your SSDs, reduce the write-amplification, will allow the SLC cache to stay at its large value, and may make a large difference to the effective performance under high load. BUT WHEN YOU ENABLE COMPRESSION... ONLY GETS COMPRESSED THE NEW DATA MODIFIED OR ENTERED. AM I WRONG?. BY THE WAY, WE HAVE MORE OR LESS 1/4 OF EACH DISK USED (12 TB ALLOCATED IN A POLL STATED BY ZPOOL LIST, DIVIDED BETWEEN 8 DISKS OF 8TB...)... DO YOU THINK WE COULD BE SUFFERING ON WRITE AMPLIFICATION AND SO... HAVING A SO LITTLE DISK SPACE USED IN EACH DISK?. Regards, STefan HEY MATE, YOUR MAIL IS INCREDIBLE. IT HAS HELPED AS A LOT. CAN WE INVITE YOU A CUP OF COFFEE OR A BEER THROUGH PAYPAL OR SIMILAR?. CAN I HELP YOU IN SOME MANNER?. CHEERS! --=_ccf36dab3b44229808a0a46435736314 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Stefan,


An extremely interesting answer and email. Extremely thankful for all yo= ur deep explatanations...... They are like gold for us really....


I answer below and in blue bold for better distinction between your line= s and mine ones...

 


El 2022-04-06 23:49, Stefan Esser escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Am 06.04.22 um 18:34 schrieb egoitz@ramattack.net:

Hi Stefan!

Thank you so much for your answer!!. I do answer below in green bold for= instance... for a better distinction....

Very thankful for all your comments Stefan!!! :) :) :)

Cheers!!

Hi,

glad to hear that it is useful information - I'll add comments below .= =2E.


Extremely helpful information re= ally! Thank you so much Steffan really. Very very thankful for your nice he= lp!.


El 2022-04-06 17:43, Stefan Esser escribió:



Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net:
Hi Rainer!

Thank you so much for your help :) :)
=
Well I assume they are in a datacenter and should not be a power ou= tage....

About dataset size... yes... our ones are big... they= can be 3-4 TB easily each
dataset.....

We bought them, = because as they are for mailboxes and mailboxes grow and
grow.... for= having space for hosting them...

Which mailbox format (e.g. mbox, maildir, ...) do you use?
 
I'm running Cyrus imap so sort of = Maildir... too many little files normally..... Sometimes directories with t= ons of little files....

Assuming that many mails are much smaller than the erase block size of t= he SSD, this may cause issues. (You may know the following ...)

For example, if you have message sizes of 8 KB and an erase block size o= f 64 KB (just guessing), then 8 mails will be in an erase block. If half th= e mails are deleted, then the erase block will still occupy 64 KB, but only= hold 32 KB of useful data (and the SSD will only be aware of this fact if = TRIM has signaled which data is no longer relevant). The SSD will copy seve= ral partially filled erase blocks together in a smaller number of free bloc= ks, which then are fully utilized. Later deletions will repeat this game, a= nd your data will be copied multiple times until it has aged (and the user = is less likely to delete further messages). This leads to "write amplificat= ion" - data is internally moved around and thus written multiple times.


Stefan!! you are nice!! I think = this could explain all our problem. So, why we are having the most randomne= ss in our performance degradation and that does not necessarily has to matc= h with the most io peak hours... That I could cause that performance degrad= ation just by deleting a couple of huge (perhaps 200.000 mails) mail folder= s in a middle traffic hour time!!


The problem is that by what I kn= ow, erase block size of an SSD disk is something fixed in the disk firmware= =2E I don't really know if perhaps it could be modified with Samsung magici= an or those kind of tool of Samsung.... else I don't really see the manner = of improving it... because apart from that, you are deleting a file in raid= z-2 array... no just in a disk... I assume aligning chunk size, with record= size and with the "secret" erase size of the ssd, perhaps could be slightl= y compensated?.

Larger mails are less of an issue since they span multiple erase blocks,= which will be completely freed when such a message is deleted.

I see I see Stefan...

Samsung has a lot of experience and generally good strategies to deal wi= th such a situation, but SSDs specified for use in storage systems might be= much better suited for that kind of usage profile.

Yes... and the disks for our pur= pose... perhaps weren't QVOs....


We knew they had some speed issues, but those speed issues, we thou= ght (as
Samsung explains in the QVO site) they started after exceedin= g the speeding
buffer this disks have. We though that meanwhile you d= idn't exceed it's
capacity (the capacity of the speeding buffer) no s= peed problem arises. Perhaps
we were wrong?.

These drives are meant for small loads in a typical PC use case,
i.e. some installations of software in the few GB range, else only
= files of a few MB being written, perhaps an import of media files
th= at range from tens to a few hundred MB at a time, but less often
than= once a day.
 
We move, you know... lots of littl= e files... and lot's of different concurrent modifications by 1500-2000 con= current imap connections we have...

I do not expect the read load to be a problem (except possibly when the = SSD is moving data from SLC to QLC blocks, but even then reads will get pri= ority). But writes and trims might very well overwhelm the SSD, especially = when its getting full. Keeping a part of the SSD unused (excluded from the = partitions created) will lead to a large pool of unused blocks. This will r= educe the write amplification - there are many free blocks in the "unpartit= ioned part" of the SSD, and thus there is less urgency to compact partially= filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a part= ition used for the ZPOOL, then 1/4 of each erase block could be free due to= deletions/TRIM without any compactions required to hold all this data.)

Keeping a significant percentage of the SSD unallocated is a good strate= gy to improve its performance and resilience.

Well, we have allocated all the = disk space... but not used... just allocated.... you know... we do a zpool = create with the whole disks.....

As the SSD fills, the space available for the single level write
cac= he gets smaller
 
The single level write cache is th= e cache these ssd drivers have, for compensating the speed issues they have= due to using qlc memory?. Do you refer to that?. Sorry I don't understand = well this paragraph.

Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC = cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as= 24 GB of data in QLC mode.

Ok, true.... yes....

A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (60= 0 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells).

Ahh! you mean that SLC capacity = for speeding up the QLC disks, is obtained from each single layer of the QL= C?.

Therefore, the fraction of the cells used as an SLC cache is reduced whe= n it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cell= s).

Sorry I don't get this last sent= ence... don't understand it because I don't really know the meaning of tn= =2E..

but I think I'm getting the idea= if you say that each QLC layer, has it's own SLC cache obtained from the d= isk space avaiable for each QLC layer....

And with less SLC cells available for short term storage of data the pro= bability of data being copied to QLC cells before the irrelevant messages h= ave been deleted is significantly increased. And that will again lead to ma= ny more blocks with "holes" (deleted messages) in them, which then need to = be copied possibly multiple times to compact them.

If I correct above, I think I go= t the idea yes....

(on many SSDs, I have no numbers for this
particular device), and thus the amount of data that can be
written = at single cell speed shrinks as the SSD gets full.
 


I have just looked up the size of the SLC cache, it is speci= fied
to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 T= B
version, smaller models will have a smaller SLC cache).
 
Assuming you were talking about th= e cache for compensating speed we previously commented, I should say these = are the 870 QVO but the 8TB version. So they should have the biggest cache = for compensating the speed issues...

I have looked up the data: the larger versions of the 870 QVO have the s= ame SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB= more if there are enough free blocks.

Ours one is the 8TB model so I a= ssume it could have bigger limits. The disks are mostly empty, really.... s= o... for instance....

zpool list
= NAME     &= nbsp;       SIZE  ALLOC   FREE=   CKPOINT  EXPANDSZ   FRAG    CAP  = DEDUP  HEALTH  ALTROOT
root_dataset        = ;     448G  2.29G   446G  &nbs= p;     -        = ; -     1%     0%  1.00x = ONLINE  -
I suppose fragmentation affects = too....

But after writing those few GB at a speed of some 500 MB/s (i.e.
aft= er 12 to 150 seconds), the drive will need several minutes to
transfe= r those writes to the quad-level cells, and will operate
at a fractio= n of the nominal performance during that time.
(QLC writes max out at= 80 MB/s for the 1 TB model, 160 MB/s for the
2 TB model.)
 
Well we are in the 8TB model. I th= ink I have understood what you wrote in previous paragraph. You said they c= an be fast but not constantly, because later they have to write all that to= their perpetual storage from the cache. And that's slow. Am I wrong?. Even= in the 8TB model you think Stefan?.

The controller in the SSD supports a given number of channels (e.g 4), e= ach of which can access a Flash chip independently of the others. Small SSD= s often have less Flash chips than there are channels (and thus a lower thr= oughput, especially for writes), but the larger models often have more chip= s than channels and thus the performance is capped.

This is totally logical. If a QV= O disk would outperform best or similar than an Intel without consequences= =2E... who was going to buy a expensive Intel enterprise?.<= /p>

In the case of the 870 QVO, the controller supports 8 channels, which al= lows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has= only 4 Flash chips and is thus limited to 80 MB/s in that situation, while= the larger versions have 8, 16, or 32 chips. But due to the limited number= of channels, the write rate is limited to 160 MB/s even for the 8 TB model= =2E

Totally logical Stefan...=

If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in thi= s limit.

The main problem we are facing is = that in some peak moments, when the machine serves connections for all the = instances it has, and only as said in some peak moments... like the 09am or= the 11am.... it seems the machine becomes slower... and like if the disks = weren't able to serve all they have to serve.... In these moments, no big f= iles are moved... but as we have 1800-2000 concurrent imap connections... n= ormally they are doing each one... little changes in their mailbox. Do you = think perhaps this disks then are not appropriate for this kind of usage?-<= /strong>

I'd guess that the drives get into a state in which they have to recycle= lots of partially free blocks (i.e. perform kind of a garbage collection) = and then three kinds of operations are competing with each other:

  1. reads (generally prioritized)
  2. writes (filling the SLC cache up to its maximum size)
  3. compactions of partially filled blocks (required to make free blocks av= ailable for re-use)

Writes can only proceed if there are sufficient free blocks, which on a = filled SSD with partially filled erase blocks means that operations of type= 3. need to be performed with priority to not stall all writes.

My assumption is that this is what you are observing under peak load.

It could be although the disks a= re not filled.... the pool are at 20 or 30% of capacity and fragmentation f= rom 20%-30% (as zpool list states).

And cheap SSDs often have no RAM cache (not checked, but I'd be
surp= rised if the QVO had one) and thus cannot keep bookkeeping date
in su= ch a cache, further limiting the performance under load.
 
This brochure (https://semiconductor.samsung.com/resources/brochu= re/870_Series_Brochure.pdf and the datasheet https://semiconductor.samsung.com/resources/data-sheet/Samsung_S= SD_870_QVO_Data_Sheet_Rev1.1.pdf) sais if I have read properly, the 8TB= drive has 8GB of ram?. I assume that is what they call the turbo write cac= he?.

No, the turbo write cache consists of the cells used in SLC mode (which = can be any cells, not only cells in a specific area of the flash chip).

I see I see....<= /p>

The RAM is needed for fast lookup of the position of data for reads and = of free blocks for writes.

Our ones... seem to have 8GB LPD= DR4 of ram.... as datasheet states....

There is no simple relation between SSD "block number" (in the sense of = a disk block on some track of a magnetic disk) and its storage location on = the Flash chip. If an existing "data block" (what would be a sector on a ha= rd disk drive) is overwritten, it is instead written at the end of an "open= " erase block, and a pointer from that "block number" to the location on th= e chip is stored in an index. This index is written to Flash storage and co= uld be read from it, but it is much faster to have a RAM with these pointer= s that can be accessed independently of the Flash chips. This RAM is requir= ed for high transaction rates (especially random reads), but it does not re= ally help speed up writes.

I see... I see.... I got it...


And the resilience (max. amount of data written over its lifetime)
i= s also quite low - I hope those drives are used in some kind of
RAID = configuration.
 
Yep we use raidz-2=

Makes sense ... But you know that you multiply the amount of data writte= n due to the redundancy.

If a single 8 KB block is written, for example, 3 * 8 KB will written if= you take the 2 redundant copies into account.

I see I see....<= /p>


The 870 QVO is specified for 370 full capacity
writes, i.e. 370 TB f= or the 1 TB model. That's still a few hundred
GB a day - but only if = the write amplification stays in a reasonable
range ...
 
Well yes... 2880TB in our case..= =2E.not bad.. isn't it?

I assume that 2880 TB is your total storage capacity? That's not too bad= , in fact. ;-)

No... the total number of writes= you can do....before the disk "breaks"....


lol :) :)  ... we are havin= g storages of 50TB due to 8 disks of 8TB in raidz-2....


This would be 360 * 8 TB ...

Even at 160 MB/s per 8 TB SSD this would allow for more than 50 GB/s of = write throughput (if all writes were evenly distributed).

Taking all odds into account, I'd guess that at least 10 GB/s can be con= tinuously written (if supported by the CPUs and controllers).

But this may not be true if the drive is simultaneously reading, trimmin= g, and writing ...

I see.... It's extremely mislead= ing you know... because... you can copy five mailboxes of 50GB concurrently= for instance.... and you flood a gigabit interface copying (obviously beca= use disks can keep that throughput)... but later.... you see... you are in = an hour that yesterday, and even 4 days before you have not had any issues= =2E.. and that day... you see the commented issue... even not being exactly= at a peak hour (perhaps is two hours later the peak hour even)... or... bu= t I wasn't noticing about all things you say in this email....

I have seen advice to not use compression in a high load scenario in som= e other reply.

I tend to disagree: Since you seem to be limited when the SLC cache is e= xhausted, you should get better performance if you compress your data. I ha= ve found that zstd-2 works well for me (giving a significant overall reduct= ion of size at reasonable additional CPU load). Since ZFS allows to switch = compressions algorithms at any time, you can experiment with different algo= rithms and levels.

I see... you say compression sho= uld be enabled.... The main reason because we have not enabled it yet, is f= or keeping the system the most near possible to config defaults... you know= =2E.. for later being able to ask in this mailing lists if we have an issue= =2E.. because you know... it would be far more easier to ask about somethin= g strange you are seeing when that strange thing is near to a well tested c= onfig, like the config by default....

But now you say Stefan... if you= switch between compression algorithms you will end up with a mix of differ= ent files compressed in a different manner... that is not a bit disaster la= ter?. Doesn't affect performance in some manner?.

One advantage of ZFS compression is that it applies to the ARC, too. And= a compression factor of 2 should easily be achieved when storing mail (not= for .docx, .pdf, .jpg files though). Having more data in the ARC will redu= ce the read pressure on the SSDs and will give them more cycles for garbage= collections (which are performed in the background and required to always = have a sufficient reserve of free flash blocks for writes).

We would use I assume the lz4.= =2E. which is the less "expensive" compression algorithm for the CPU... and= I assume too for avoiding delay accessing data... do you recommend another= one?. Do you always recommend compression then?.

I'd give it a try - and if it reduces your storage requirements by 10% o= nly, then keep 10% of each SSD unused (not assigned to any partition). That= will greatly improve the resilience of your SSDs, reduce the write-amplifi= cation, will allow the SLC cache to stay at its large value, and may make a= large difference to the effective performance under high load.

But when you enable compression= =2E.. only gets compressed the new data modified or entered. Am I wrong?.

By the way, we have more or less= 1/4 of each disk used (12 TB allocated in a poll stated by zpool list, div= ided between 8 disks of 8TB...)... do you think we could be suffering on wr= ite amplification and so... having a so little disk space used in each disk= ?.

Regards, STefan

Hey mate, your mail is incredibl= e. It has helped as a lot. Can we invite you a cup of coffee or a beer thro= ugh Paypal or similar?. Can I help you in some manner?.


Cheers!


--=_ccf36dab3b44229808a0a46435736314-- From nobody Thu Apr 7 13:39:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 003991A8A500; Thu, 7 Apr 2022 13:40:04 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu01208b.smtpx.saremail.com (cu01208b.smtpx.saremail.com [195.16.151.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ2Yt5pt4z4TQY; Thu, 7 Apr 2022 13:40:01 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend01.sarenet.es (Postfix) with ESMTPA id AA01060C45C; Thu, 7 Apr 2022 15:39:58 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_cc796372be3f66b49dc427201012caa6" Date: Thu, 07 Apr 2022 15:39:58 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: mike tancsa , Bob Friesenhahn , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <0702dc56-28ba-7e99-d599-1036634d79e3@FreeBSD.org> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <0702dc56-28ba-7e99-d599-1036634d79e3@FreeBSD.org> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ2Yt5pt4z4TQY X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.151.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_cc796372be3f66b49dc427201012caa6 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Stefan!!, Thank you so much. I can't be more thankful. I answer below in bold blue for instance... for better seeing my answers.... El 2022-04-06 23:59, Stefan Esser escribió: > I have got much better compression at same or less load by use of zstd-2 > compared to lz4. > > I ASSUME PEOPLE WOULD NORMALLY USES LZOP DUE TO IT'S KNOWN LIGHT CPU LOAD NEEDED... > I TAKE NOT TOO OF ZSTD-2.... > > Perhaps not typical, since this is a dovecot mdbox formatted mail pool > holding mostly plain text messages without large attachments: > > $ df /var/mdbox > Filesystem 1K-blocks Used Avail Capacity Mounted on > system/var/mdbox 7234048944 9170888 7224878056 0% /var/mdbox > > $ zfs get compression,compressratio,used,logicalused system/var/mdbox > NAME PROPERTY VALUE SOURCE > system/var/mdbox compression zstd-2 inherited from system/var > system/var/mdbox compressratio 2.29x - > system/var/mdbox used 8.76G - > system/var/mdbox logicalused 20.0G - > > Regards, STefan > > NICE TO KNOW STEFAN, NICE TO KNOW!, > > CHEERS, --=_cc796372be3f66b49dc427201012caa6 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Stefan!!,


Thank you so much. I can't be more thankful.


I answer below in bold blue for instance... for better seeing my answers= =2E...

 


El 2022-04-06 23:59, Stefan Esser escribió:

=
I have got much better compression at same or less load by use of zs= td-2
compared to lz4.
=  
= I assume people would normally uses= lzop due to it's known light cpu load needed...
= I take not too of zstd-2....=
=

Perhaps not typical, since this is a dovecot mdbox formatted = mail pool
holding mostly plain text messages without large attachment= s:

$ df /var/mdbox
Filesystem     &n= bsp;  1K-blocks    Used     &n= bsp;Avail Capacity  Mounted on
system/var/mdbox 7234048944 91708= 88 7224878056     0%    /var/mdbox
=
$ zfs get compression,compressratio,used,logicalused system/var/mdb= ox
NAME           &= nbsp;  PROPERTY       VALUE  &= nbsp;        SOURCE
system/va= r/mdbox  compression    zstd-2     =      inherited from system/var
system/var/md= box  compressratio  2.29x       &nb= sp;   -
system/var/mdbox  used    =        8.76G     &nb= sp;     -
system/var/mdbox  logicalused=    20.0G         &n= bsp; -

Regards, STefan
=  
= Nice to know Stefan, nice to know!,=
=  
= Cheers,
--=_cc796372be3f66b49dc427201012caa6-- From nobody Thu Apr 7 13:43:29 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5F6141A8C3C4; Thu, 7 Apr 2022 13:43:32 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ2dv4Jvmz4WyC; Thu, 7 Apr 2022 13:43:31 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 237DhUu3068410 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Thu, 7 Apr 2022 09:43:30 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:434:73cd:9d42:28ad] ([IPv6:2607:f3e0:0:4:434:73cd:9d42:28ad]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 237DhTQ2017476 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 7 Apr 2022 09:43:30 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <217020e3-0092-b269-96e4-dd77bdcde110@sentex.net> Date: Thu, 7 Apr 2022 09:43:29 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS Content-Language: en-US From: mike tancsa To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KZ2dv4Jvmz4WyC X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.27 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.87)[-0.869]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 4/7/2022 7:25 AM, mike tancsa wrote: > On 4/7/2022 4:59 AM, egoitz@ramattack.net wrote: >> >> Hi Mike! >> >> Thanks a lot for your comment. I see. As said before, we didn't >> really enable compression because we just keep the config as FreeBSD >> leaves by default. Apart from that, having tons of disk space and >> well... for avoiding the load of compress/decompress... The main >> reason was it was not enabled by default really and not to have seen >> a real reason for it.... was not more than that....I appreciate your >> comments really :) > > > Think of the extreme case where you do something like > > dd if=/dev/zero of=/tank/junk.bin bs=1m count=10000 > > as this is a 20G file that takes just a few hundred bytes of write IO > on a compressed system. Obviously, as the compress ratio reduces in > the real world the benefits become less.  Where that diminishing > return is, not sure.  But something to keep in mind > > You might also want to have a look at this article which I found quite helpful https://klarasystems.com/articles/openzfs1-understanding-transparent-compression/     ---Mike From nobody Thu Apr 7 13:53:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 240921A90AA1; Thu, 7 Apr 2022 13:53:17 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ2s80CnXz4bfR; Thu, 7 Apr 2022 13:53:14 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 5746F60C4A4; Thu, 7 Apr 2022 15:53:06 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_9966c949ad7be3a0f79023829a1cf786" Date: Thu, 07 Apr 2022 15:53:06 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: Jan Bramkamp , performance@freebsd.org, freebsd-fs@freebsd.org, FreeBSD Hackers Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <49f43af5-e145-c793-959d-ab1596421d81@FreeBSD.org> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <49f43af5-e145-c793-959d-ab1596421d81@FreeBSD.org> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ2s80CnXz4bfR X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_9966c949ad7be3a0f79023829a1cf786 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Stefan, Thanks a lot again, mate. Answering below in bold blue... El 2022-04-07 09:59, Stefan Esser escribió: > I have not compared dovecot's zlib compression with zstd-2 on the file system, > but since I use the latter on all my ZFS file systems (excepts those that > exclusively hold compressed files and media), I'm using it for Dovecot mdbox > files, too. I get a compression ratio of 2,29 with ZFS zstd-2, maybe I should > copy the files over into a zlib compressed mdbox for comparison ... > > WE ARE RUNNING CYRUS HERE... ALTHOUGH THAT CHECK SOUNDS INTERESTING... > > One large advantage of the mdbox format in the context of the mail server > set-up at the start of this thread is that deletions are only registered in > an index file (while mbox needs a rewrite of potentially large parts of the > mail folder and mdir immediately deletes files (TRIM) and updates inodes and > directory entries, causing multiple writes per deleted message). > > I SEE... REALLY SAID... I LOVE CYRUS... IT'S REPLICATION IS EXTREMELY RELIABLE... > > SOME TIME NOW... DOVECOT DIDN'T HAD REPLICATION... AND WE HAVE SOME DEVELOPMENTS DONE FROM SOME TIME NOW FOR CYRUS IMAP... > > BUT GOOD TO KNOW TO ABOUT OTHER SOFTWARE'S ADVANTAGES... > > With mdbox you can delay all "expensive" file system operations to the > point of least load each day, for example. Such a compression run is also > well suited for SSDs, since it does not perform random updates that punch > holes in a large number of erase blocks (which then will need to be garbage > collected, causing write amplification to put further load and stress on > the SSD). > > WE DON'T DELETE MAIL DURING DAY HOURS. WE USE A FEATURE OF CYRUS CALLED EXPUNGE DELAYED. THE DELETED EMAIL IS DELETED FROM DISK AT 04AM (UNTIL THAT MOMENT IS JUST TAGGED AS DELETED IN A CYRUS DATABASE). THE EXCEPTION HAPPENS WHEN YOU RENAME A FOLDER OR DELETE AN ENTIRE FOLDER. IF YOU DELETE AN ENTIRE FOLDER, I THINK IT GETS COPIED TO A DELETED/..WHATEVER.. FOLDER AND THEN YES... IT COPIES AND LATER DELETES... > > APART FROM THAT, CYRUS DOES A LOT OF DATABASE CHECKPOINTING, CAUSING DATABASES TO BE COPIED TO A NEW CREATED ONE AND THE OLD ONE TO BE DELETED. THIS ARE THE ONLY REMOVALS WE DO DURING DAY TIME. THE REST IS DONE FROM 04AM TO 05AM, WHEN THERE'S NO LOAD. > > CHEERS!!! --=_9966c949ad7be3a0f79023829a1cf786 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Stefan,


Thanks a lot again, mate. Answering below in bold blue...

 


El 2022-04-07 09:59, Stefan Esser escribió:

=
I have not compared dovecot's zlib compression with zstd-2 on the fi= le system,
but since I use the latter on all my ZFS file systems (exc= epts those that
exclusively hold compressed files and media), I'm usi= ng it for Dovecot mdbox
files, too. I get a compression ratio of 2,29= with ZFS zstd-2, maybe I should
copy the files over into a zlib comp= ressed mdbox for comparison ...
=  
= We are running Cyrus here... althou= gh that check sounds interesting...

One large = advantage of the mdbox format in the context of the mail server
set-u= p at the start of this thread is that deletions are only registered in
an index file (while mbox needs a rewrite of potentially large parts of t= he
mail folder and mdir immediately deletes files (TRIM) and updates = inodes and
directory entries, causing multiple writes per deleted mes= sage).
=  
= I see... really said... I love Cyru= s... it's replication is extremely reliable...
=  
= Some time now... Dovecot didn't had= replication... and we have some developments done from some time now for C= yrus IMAP...
=  
= But good to know to about other sof= tware's advantages...

With mdbox you can delay= all "expensive" file system operations to the
point of least load ea= ch day, for example. Such a compression run is also
well suited for S= SDs, since it does not perform random updates that punch
holes in a l= arge number of erase blocks (which then will need to be garbage
colle= cted, causing write amplification to put further load and stress on
t= he SSD).
=  
= We don't delete mail during day hou= rs. We use a feature of Cyrus called expunge delayed. The deleted email is = deleted from disk at 04am (until that moment is just tagged as deleted in a= Cyrus database). The exception happens when you rename a folder or delete = an entire folder. If you delete an entire folder, I think it gets copied to= a DELETED/..whatever.. folder and then yes... it copies and later deletes= =2E..
=  
= Apart from that, Cyrus does a lot o= f database checkpointing, causing databases to be copied to a new created o= ne and the old one to be deleted. This are the only removals we do during d= ay time. The rest is done from 04am to 05am, when there's no load.
=  
= Cheers!!!
--=_9966c949ad7be3a0f79023829a1cf786-- From nobody Thu Apr 7 13:57:33 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8B1721A931A5; Thu, 7 Apr 2022 13:57:37 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ2y807fRz4dhJ; Thu, 7 Apr 2022 13:57:36 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id F221A60C10A; Thu, 7 Apr 2022 15:57:33 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_49ce93a42b87a5e038a30c28c67e0d83" Date: Thu, 07 Apr 2022 15:57:33 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Subject: Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <4ef109e8-bd7b-1398-2bc9-191e261d5c06@FreeBSD.org> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <4ef109e8-bd7b-1398-2bc9-191e261d5c06@FreeBSD.org> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ2y807fRz4dhJ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24:c]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_49ce93a42b87a5e038a30c28c67e0d83 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi!! Thanks ;) really man :) Answering below in bold blue... El 2022-04-07 12:05, Stefan Esser escribió: > I just noticed that this is not the extreme total size of a ZFS pool > (should have noticed this while answering late at night ...) > > And no, a specified life-time of 2880 TB written is not much, it is > at the absolute lower end of currently available SSDs at 360 TB per > 1 TB of capacity. > > YEP THAT'S IT... > > This is equivalent to 360 total capacity writes, but given the high > amount of write amplification that can be assumed to occur in your > use case, I'd heavily over-provision a system with such SSDs ... > (or rather: strictly avoid them in a non-consumer setting). > > It's slightly late for over-provisioning... you know... we have done the zpool create with the whole disk..not just a slice.... > > WE CAN TRY TO BE SLIGHTLY FAR FROM THE 80% CAPACITY LIMIT BUT.... NOT POSSIBLE NOW... AT LEAST FOR THIS GROUP OF SERVERS... > > CHEERS! --=_49ce93a42b87a5e038a30c28c67e0d83 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi!!


Thanks ;) really man :)


Answering below in bold blue...

 


El 2022-04-07 12:05, Stefan Esser escribió:

=

I just noticed that this is not the extreme total size of a ZF= S pool
(should have noticed this while answering late at night ...)
And no, a specified life-time of 2880 TB written is not much, i= t is
at the absolute lower end of currently available SSDs at 360 TB = per
1 TB of capacity.
=  
= Yep that's it...
This is equivalent to 360 total capacity writes, but given the h= igh
amount of write amplification that can be assumed to occur in you= r
use case, I'd heavily over-provision a system with such SSDs ... (or rather: strictly avoid them in a non-consumer setting).
=  
= It's slightly late for over-provisioning... you know... we have done the zp= ool create with the whole disk..not just a slice....
=  
= We can try to be slightly far from = the 80% capacity limit but.... not possible now... at least for this group = of servers...
=  
= Cheers!
--=_49ce93a42b87a5e038a30c28c67e0d83-- From nobody Thu Apr 7 14:01:04 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F299B1A9499D; Thu, 7 Apr 2022 14:01:07 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ32B4GXpz4gtl; Thu, 7 Apr 2022 14:01:06 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id A4C8160C00B; Thu, 7 Apr 2022 16:01:04 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_74b7e4b05962e4b9793f3fbab21fa2c0" Date: Thu, 07 Apr 2022 16:01:04 +0200 From: egoitz@ramattack.net To: mike tancsa Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> Message-ID: <1c114208ae8387fc7c4291d1cc66227e@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ32B4GXpz4gtl X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_74b7e4b05962e4b9793f3fbab21fa2c0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Mike! Thanks a lot for your answer :) :) and your time :) :) Answering below in blue bold... El 2022-04-07 13:25, mike tancsa escribió: > On 4/7/2022 4:59 AM, egoitz@ramattack.net wrote: > >> > Hi, > > With respect to compression, I think there is a sweet spot somewhere, where compression makes things faster if your disk IO is the limiting factor and you have spare CPU capacity. I have a separate 13.x zfs server with ztsd enabled and I get compression rations of 15:1 as it stores a lot of giant JSON txt files. > > ZTSD OR ZTSD-2 AS IN SOME MAIL PREVIOUS STEFAN STATED?. I ASSUME ARE NOT THE SAME... ARE THEY?. > > Think of the extreme case where you do something like > > dd if=/dev/zero of=/tank/junk.bin bs=1m count=10000 > > as this is a 20G file that takes just a few hundred bytes of write IO on a compressed system. Obviously, as the compress ratio reduces in the real world the benefits become less. Where that diminishing return is, not sure. But something to keep in mind > > TOTALLY TRUE AND TOTALLY AGREE MIKE!! > CHEERS!! --=_74b7e4b05962e4b9793f3fbab21fa2c0 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Mike!


Thanks a lot for your answer :) :) and your time :) :)


Answering below in blue bold...

 


El 2022-04-07 13:25, mike tancsa escribió:

=
On 4/7/2022 4:59 = ;AM, egoitz@ramattack.net&= nbsp;wrote:

Hi,

  &n= bsp; With respect to compression, I think there is a sweet spot somewhere, = where compression makes things faster if your disk IO is the limiting facto= r and you have spare CPU capacity.  I have a separate 13.x zfs server = with ztsd enabled and I get compression rations of 15:1 as it stores a lot = of giant JSON txt files.
=  
= ztsd or ztsd-2 as in some mail prev= ious Stefan stated?. I assume are not the same... are they?.

Think of the&= nbsp;extreme case where you do something like=

dd if=3D/dev= /zero of=3D/tank/junk.bin bs=3D1m count=3D10000
=  
= as this is a 20G file that takes just a few hundred bytes of write IO on a = compressed system. Obviously, as the compress ratio reduces in the real wor= ld the benefits become less.  Where that diminishing return is, not su= re.  But something to keep in mind
=  
= Totally true and totally agree Mike= !!
=  
Cheers!! --=_74b7e4b05962e4b9793f3fbab21fa2c0-- From nobody Thu Apr 7 14:02:16 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 42EBC1A956E8; Thu, 7 Apr 2022 14:02:21 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZ33b5367z4hm4; Thu, 7 Apr 2022 14:02:19 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id E0F1060C82E; Thu, 7 Apr 2022 16:02:16 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_14f3bd38668fdecfedfad3f860fc22f3" Date: Thu, 07 Apr 2022 16:02:16 +0200 From: egoitz@ramattack.net To: mike tancsa Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, Freebsd performance Subject: Re: {* 05.00 *}Re: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: <217020e3-0092-b269-96e4-dd77bdcde110@sentex.net> References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <28e11d7ec0ac5dbea45f9f271fc28f06@ramattack.net> <7aa95cb4bf1fd38b3fce93bc26826042@ramattack.net> <609373d106c2244a8a2a3e2ca5e6eb73@ramattack.net> <217020e3-0092-b269-96e4-dd77bdcde110@sentex.net> Message-ID: X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZ33b5367z4hm4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24:c]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_14f3bd38668fdecfedfad3f860fc22f3 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Sure!!! good to know mate!!! Thanks Mike!! El 2022-04-07 15:43, mike tancsa escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > On 4/7/2022 7:25 AM, mike tancsa wrote: On 4/7/2022 4:59 AM, egoitz@ramattack.net wrote: > Hi Mike! > > Thanks a lot for your comment. I see. As said before, we didn't really enable compression because we just keep the config as FreeBSD leaves by default. Apart from that, having tons of disk space and well... for avoiding the load of compress/decompress... The main reason was it was not enabled by default really and not to have seen a real reason for it.... was not more than that....I appreciate your comments really :) > > Think of the extreme case where you do something like > > dd if=/dev/zero of=/tank/junk.bin bs=1m count=10000 > > as this is a 20G file that takes just a few hundred bytes of write IO on a compressed system. Obviously, as the compress ratio reduces in the real world the benefits become less. Where that diminishing return is, not sure. But something to keep in mind You might also want to have a look at this article which I found quite helpful https://klarasystems.com/articles/openzfs1-understanding-transparent-compression/ ---Mike --=_14f3bd38668fdecfedfad3f860fc22f3 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Sure!!! good to know mate!!!


Thanks Mike!!

 


El 2022-04-07 15:43, mike tancsa escribió:

= ATENCION
ATENCION
ATENCION= !!! Este correo se ha enviado desde fuer= a de la organizacion. No pinche en los&n= bsp;enlaces ni abra los adjuntos a no se= r que reconozca el remitente y sepa que&= nbsp;el contenido es seguro.

On 4/7/2022 7:25 AM, mike&nbs= p;tancsa wrote:
On 4/7/2022&= nbsp;4:59 AM, egoitz@rama= ttack.net wrote:

Hi Mi= ke!

Thanks a lot for your comment. I see. As said befor= e, we didn't really enable compression because we just keep the config as F= reeBSD leaves by default. Apart from that, having tons of disk space and we= ll... for avoiding the load of compress/decompress... The main reason was i= t was not enabled by default really and not to have seen a real reason for = it.... was not more than that....I appreciate your comments really :)

Think of the&n= bsp;extreme case where you do something like<= /span>

dd if=3D/dev/= zero of=3D/tank/junk.bin bs=3D1m count=3D10000
=
as this is a 20G file that takes just a few hundred bytes of write I= O on a compressed system. Obviously, as the compress ratio reduces in the r= eal world the benefits become less.  Where that diminishing return is,= not sure.  But something to keep in mind

You might also want to have a look at this article which I found quite help= ful


https://klarasystems.com= /articles/openzfs1-understanding-transparent-compression/
=

    = ---Mike

--=_14f3bd38668fdecfedfad3f860fc22f3-- From nobody Thu Apr 7 20:02:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 660F61A905DB; Thu, 7 Apr 2022 20:02:54 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-ej1-x631.google.com (mail-ej1-x631.google.com [IPv6:2a00:1450:4864:20::631]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZC3d25QJz3Fx1; Thu, 7 Apr 2022 20:02:53 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: by mail-ej1-x631.google.com with SMTP id i27so13094297ejd.9; Thu, 07 Apr 2022 13:02:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to:cc; bh=iEKptgaYpUnOO67t7UZ8Yg1/49jS1d6Us3VWd7IOOdU=; b=eNM0exi6dJC9wV1oyEyZGIAQzTuKiuCYUg0+s4DxdGdKVHqBw3aU+DEdX3QuYhYZnb cqMfUAIsRWScuBrNCz6uJ2gjzJPjEoCasSzF3n4grJWWcodkMGkisSGAmeRH21/FUEpH E9UPU6P6Yq+UpXsBkSMFv9M+h0Dhf/ea/YM9agFSYStJibJ8+CKAt6oD06BSBV9rqAH8 84IZmPg53WLItEffS2aq0YupJiWtnyDYcATTjy2tViOimQ0vT9YAlL0tYLpgnHhRgxGs tbGBjy50FQ89E0saHl8AHCUFfeSXErOoQ/mTxuKdBqN9JWX5IJoAzSJiyxemnm//enIf sinA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=iEKptgaYpUnOO67t7UZ8Yg1/49jS1d6Us3VWd7IOOdU=; b=umPTJWofq0pvV+AN+UlNRrnvgPzxWBSSmqWI0iPVIrj8jhKpas3wUOnJ8usfFzB2p3 Tidv5i0BZXNfm6KzxOWFYuscDnJ4NbIBUB9ZjNaQyUY+Hqh/Zqh2pSt5dRjN4rEaPxyU clEay0KBx8oDuU8AS7SIPOMIofmRUmzNSewwsEASthkWckGnyhy3wUDGISm2RqM4Fx9o cQQq264ZSH7aSC63b6NAp6yQ9QmLBLp949fXr72uP6CzkkkO8Qdx4rVFh2rTyHkclLeQ xYMzlP7/IafMWh/InGQoxASj9spnW5yS8PtiKgKPjrdDWN+q2r1GdbpOb9yMZpq14LHm XvBA== X-Gm-Message-State: AOAM530u3JGHS6QBCbrrgOVgucHkRMf2d+Y5zdThm31ZUIIglTchSQbH eyqJhvSU7ZVtsV1vNqaIBYEhe7mwzqxh1I98ou0WMNqTErX/NnLU4qU= X-Google-Smtp-Source: ABdhPJx2gY2F0XaL8l+lpntvd6jQN1lCsA1mmXkepsIayYVv5vrTucMcC8rwnrNMEdOKxoKOThF6uS9LAj+i0NvUZjw= X-Received: by 2002:a17:907:7286:b0:6df:f778:2585 with SMTP id dt6-20020a170907728600b006dff7782585mr14422472ejc.244.1649361765912; Thu, 07 Apr 2022 13:02:45 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:ab4:9c81:0:0:0:0:0 with HTTP; Thu, 7 Apr 2022 13:02:45 -0700 (PDT) From: grarpamp Date: Thu, 7 Apr 2022 16:02:45 -0400 Message-ID: Subject: List Mail Formatting Netiquette [ie: 870 QVO] To: freebsd-hackers@freebsd.org Cc: freebsd-fs@freebsd.org, freebsd-performance@freebsd.org, freebsd-questions@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KZC3d25QJz3Fx1 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=eNM0exi6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2a00:1450:4864:20::631 as permitted sender) smtp.mailfrom=grarpamp@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::631:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-hackers,freebsd-fs,freebsd-performance,freebsd-questions]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 4/7/22, egoitz@ramattack.net wrote: > I answer below in bold blue for instance... > for better seeing my answers.... While you may think that helps people, in reality it does not, and it actually makes peoples mails much worse for the proper text based email using world, and sits among other random formats that randoms try to stuff down other peoples mailboxes, and they might not even show up in search engines, archives, onscreen, phones, etc. Read up on classic proper email formatting netiquette where, for very good reasons, it tells everyone to... turn off HTML mail, and to quit top posting and quit bulk quoting, and to trim what you're replying to down to only the relevant minimum context while writing your replies underneath that, and to delete addressees already present within list addresses, and to quit SHOUTING ALL CAPS, and to wrap non-code lines at around 68 chars, and to not break header threading (in-reply-to and references) when replying. This reminder actually for all lists and senders. Clean... https://docs.freebsd.org/cgi/getmsg.cgi?fetch=1514528+0+current/freebsd-hackers vs Chaos... https://docs.freebsd.org/cgi/getmsg.cgi?fetch=3049898+0+current/freebsd-hackers https://docs.freebsd.org/cgi/getmsg.cgi?fetch=3049898+0+current/freebsd-hackers+raw https://lists.freebsd.org/archives/freebsd-hackers/2022-April/000975.html https://lists.freebsd.org/archives/freebsd-hackers/2022-April/000975.txt Import the raw archives into your MUA to see even worse unreadably formatted things, and nice clean things too... rsync -nHaxi bit0.us-west.freebsd.org::FreeBSD-mailarchive/ Use the clean habit mailiquette rules to make reading the world better for everyone :) From nobody Fri Apr 8 11:14:24 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5F68D1A89133; Fri, 8 Apr 2022 11:14:29 +0000 (UTC) (envelope-from se@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZbHT1nGhz4rdQ; Fri, 8 Apr 2022 11:14:29 +0000 (UTC) (envelope-from se@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649416469; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=JlfXsy1DWMiP2fVpvEdmDICcRyZdKcm3477CxCwciNE=; b=Y6LhFNt3WUDToCHPlXDod+JjjeS2FY/J2jIloPEnNhXOV9FDKr9cJQb1V++NRzEM1UERTp jI23Rprjxa1V0rrGYBlwm49iE2X/ja2I9Tf+UNWb9RozDIXpiR8zByltboDcpJjWZ6HEm5 A1HDlxji4iJcsf+8tJyvvTDqdZ3c+z5SJnwe+Y4DrNBcmLfZgvUyt4EUc2nNR8F3BWKNFn SXbRNwJQ9xPxhM/1N09ifCmQbafAsF9TaxYC4dNjoUaTq/S8sSK39JO/xwx0b6Hj4ZwZYZ DWg4RiRmnKngl/ks1Gv4qlx9ZZqsnCALJnGPihWjcsO11kvxvdIk+n1GFzytCA== Received: from [IPV6:2003:cd:5f22:6f00:acb8:ea4e:7d58:95d3] (p200300cd5f226f00acb8ea4e7d5895d3.dip0.t-ipconnect.de [IPv6:2003:cd:5f22:6f00:acb8:ea4e:7d58:95d3]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 3446729D1D; Fri, 8 Apr 2022 11:14:28 +0000 (UTC) (envelope-from se@FreeBSD.org) Message-ID: Date: Fri, 8 Apr 2022 13:14:24 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 From: Stefan Esser Subject: Re: Desperate with 870 QVO and ZFS To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Content-Language: en-US In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------TD2ASvjzfpo4JyxrFz8JyiVP" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649416469; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=JlfXsy1DWMiP2fVpvEdmDICcRyZdKcm3477CxCwciNE=; b=IXz5kNfN6/gK87Bf0RxfSqtmz2VZjPDhepICW9REQpiljoVUgpcckFjxx47bHN2L0BqifB 9cpYwYl9Eh97xYJzhb1MdamL03nz0HGWR+gY8fCgqy97CzrJmmY3RdkOOI4Zq0Yz2MGDCe CD7IAVJSWSiB8Sw+eyj/FzCM6UjIwdrtunr83VoWu7WvBA1tKJo3TxAjySFQLR1w3Usi2u BpzvrBGOI9M/1snImXDynjsDnraMcyfdAgTJ4sHmkadfFxDRd+veqPWJlOLpPtlTwd/9Ia MN3n6hgFCcr7fGs+9e3YUjikKCmzg0r8bN4/G1RmxPKv2D9kpTCziUufYrcUuA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649416469; a=rsa-sha256; cv=none; b=NyzkQYnw9EkFAz5oOmjM4k+WMKdyljH4w9H3KOYLL3/lSfbdOwfMsk9/9sfaLQ9U6QlwbB TZRXIV3oCBtIYl6Jgy9kwMrDXMd0yzA9TuXp7CtdeIyMAlvIxHRdj2/TkBbYzGf9+TUe5F tbUnzJbaWHKGZlEqtrVxOGwU5eI/y2CeTWuUVBVXiMkTTuMYdCXEM1uopIx0/omBCdMwH2 W12zvrJ634Fd037bWR/5gP+AYWjxKzGmYbV3roX0QPVmKWD76tz587NCuXJEcRwZon1lkR 9gO9p5BqVEax7ZkE+2Uxi1hknhkT+le2uRMD9pPvvK7B+8GSHDmOvYbwpyRrpg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------TD2ASvjzfpo4JyxrFz8JyiVP Content-Type: multipart/mixed; boundary="------------O0ssWPEiEQcQgZRJEKUGD0ko"; protected-headers="v1" From: Stefan Esser To: egoitz@ramattack.net Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Message-ID: Subject: Re: Desperate with 870 QVO and ZFS References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> In-Reply-To: --------------O0ssWPEiEQcQgZRJEKUGD0ko Content-Type: multipart/alternative; boundary="------------5zqkLuBRyXvluXGRQjtNvCUK" --------------5zqkLuBRyXvluXGRQjtNvCUK Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 07.04.22 um 14:30 schrieb egoitz@ramattack.net: > El 2022-04-06 23:49, Stefan Esser escribi=C3=B3: >>> >>> El 2022-04-06 17:43, Stefan Esser escribi=C3=B3: >>> >>> >>> Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: >>> >>> Hi Rainer! >>> >>> Thank you so much for your help :) :) >>> >>> Well I assume they are in a datacenter and should not be a po= wer >>> outage.... >>> >>> About dataset size... yes... our ones are big... they can be = 3-4 TB >>> easily each >>> dataset..... >>> >>> We bought them, because as they are for mailboxes and mailbox= es >>> grow and >>> grow.... for having space for hosting them... >>> >>> >>> Which mailbox format (e.g. mbox, maildir, ...) do you use? >>> =C2=A0 >>> *I'm running Cyrus imap so sort of Maildir... too many little fil= es >>> normally..... Sometimes directories with tons of little files....= * >>> >> Assuming that many mails are much smaller than the erase block size of= the >> SSD, this may cause issues. (You may know the following ...) >> >> For example, if you have message sizes of 8 KB and an erase block size= of 64 >> KB (just guessing), then 8 mails will be in an erase block. If half th= e >> mails are deleted, then the erase block will still occupy 64 KB, but o= nly >> hold 32 KB of useful data (and the SSD will only be aware of this fact= if >> TRIM has signaled which data is no longer relevant). The SSD will copy= >> several partially filled erase blocks together in a smaller number of = free >> blocks, which then are fully utilized. Later deletions will repeat thi= s >> game, and your data will be copied multiple times until it has aged (a= nd the >> user is less likely to delete further messages). This leads to "write >> amplification" - data is internally moved around and thus written mult= iple >> times. >> >> >> *Stefan!! you are nice!! I think this could explain all our problem. S= o, why >> we are having the most randomness in our performance degradation and t= hat >> does not necessarily has to match with the most io peak hours... That = I >> could cause that performance degradation just by deleting a couple of = huge >> (perhaps 200.000 mails) mail folders in a middle traffic hour time!!* >> Yes, if deleting large amounts of data triggers performance issues (and t= he disk does not have a deficient TRIM implementation), then the issue is li= kely to be due to internal garbage collections colliding with other operations= =2E >> >> *The problem is that by what I know, erase block size of an SSD disk i= s >> something fixed in the disk firmware. I don't really know if perhaps i= t >> could be modified with Samsung magician or those kind of tool of Samsu= ng.... >> else I don't really see the manner of improving it... because apart fr= om >> that, you are deleting a file in raidz-2 array... no just in a disk...= I >> assume aligning chunk size, with record size and with the "secret" era= se >> size of the ssd, perhaps could be slightly compensated?.* >> The erase block size is a fixed hardware feature of each flash chip. Ther= e is a block size for writes (e.g. 8 KB) and many such blocks are combined in on= e erase block (of e.g. 64 KB, probably larger in todays SSDs), they can onl= y be returned to the free block pool all together. And if some of these writab= le blocks hold live data, they must be preserved by collecting them in newly= allocated free blocks. An example of what might happen, showing a simplified layout of files 1, = 2, 3 (with writable blocks 1a, 1b, ..., 2a, 2b, ... and "--" for stale data of= deleted files, ".." for erased/writable flash blocks) in an SSD might be:= erase block 1: |1a|1b|--|--|2a|--|--|3a| erase block 2; |--|--|--|2b|--|--|--|1c| erase block 3; |2c|1d|3b|3c|--|--|--|--| erase block 4; |..|..|..|..|..|..|..|..| This is just a random example how data could be laid out on the physical storage array. It is assumed that the 3 erase blocks once were completely= occupied In this example, 10 of 32 writable blocks are occupied, and only one free= erase block exists. This situation must not persist, since the SSD needs more empty erase blo= cks. 10/32 of the capacity is used for data, but 3/4 of the blocks are occupie= d and not immediately available for new data. The garbage collection might combine erase blocks 1 and 3 into a currentl= y free one, e.g. erase block 4: erase block 1; |..|..|..|..|..|..|..|..| erase block 2; |--|--|--|2b|--|--|--|1c| erase block 3; |..|..|..|..|..|..|..|..| erase block 4: |1a|1b|2a|3a|2c|1d|3b|3c| Now only 2/4 of the capacity is not available for new data (which is stil= l a lot more than 10/32, but better than before). Now assume file 2 is deleted: erase block 1; |..|..|..|..|..|..|..|..| erase block 2; |--|--|--|--|--|--|--|1c| erase block 3; |..|..|..|..|..|..|..|..| erase block 4: |1a|1b|--|3a|--|1d|3b|3c| There is now a new sparsely used erase block 4, and it will soon need to = be garbage collected, too - in fact it could be combined with the live data = from erase block 2, but this may be delayed until there is demand for more era= sed blocks (since e.g. file 1 or 3 might also have been deleted by then). The garbage collection does not know which data blocks belong to which fi= le, and therefore it cannot collect the data belonging to a file into a singl= e erase block. Blocks are allocated as data comes in (as long as enough SLC= cells are available in this area, else directly in QLC cells). Your many parall= el updates will cause fractions of each larger file to be spread out over ma= ny erase blocks. As you can see, a single file that is deleted may affect many erase block= s, and you have to take redundancy into consideration, which will multiply the e= ffect by a factor of up to 3 for small files (one ZFS allocation block). And remember: deleting a message in mdir format will free the data blocks, bu= t will also remove the directory entry, causing additional meta-data writes (aga= in multiplied by the raid redundancy). A consumer SSD would normally see only very few parallel writes, and sequ= ential writes of full files will have a high chance to put the data of each file= contiguously in the minimum number of erase blocks, allowing to free mult= iple complete erase blocks when such a file is deleted and thus obviating the = need for many garbage collection copies (that occur if data from several indep= endent files is in one erase block). Actual SSDs have many more cells than advertised. Some 10% to 20% may be = kept as a reserve for aging blocks that e.g. may have failed kind of a "read-after-write test" (implemented in the write function, which adds ch= arges to the cells until they return the correct read-outs). BTW: Having an ashift value that is lower than the internal write block s= ize may also lead to higher write amplification values, but a large ashift ma= y lead to more wasted capacity, which may become an issue if typical file length= are much smaller than the allocation granularity that results from the ashift= value. >> Larger mails are less of an issue since they span multiple erase block= s, >> which will be completely freed when such a message is deleted. >> >> *I see I see Stefan...* >> >> Samsung has a lot of experience and generally good strategies to deal = with >> such a situation, but SSDs specified for use in storage systems might = be >> much better suited for that kind of usage profile. >> >> *Yes... and the disks for our purpose... perhaps weren't QVOs....* >> You should have got (much more expensive) server grade SSDs, IMHO. But even 4 * 2 TB QVO (or better EVO) drives per each 8 TB QVO drive woul= d result in better performance (but would need a lot of extra SATA ports). In fact, I'm not sure whether rotating media and a reasonable L2ARC consi= sting of a fast M.2 SSD plus a mirror of small SSDs for a LOG device would not = be a better match for your use case. Reading the L2ARC would be very fast, wri= tes would be purely sequential and relatively slow, you could choose a suitab= le L2ARC strategy (caching of file data vs. meta data), and the LOG device w= ould support fast fsync() operations required for reliable mail systems (which= confirm data is on stable storage before acknowledging the reception to t= he sender). >>> We knew they had some speed issues, but those speed issues, w= e >>> thought (as >>> Samsung explains in the QVO site) they started after exceedin= g the >>> speeding >>> buffer this disks have. We though that meanwhile you didn't e= xceed it's >>> capacity (the capacity of the speeding buffer) no speed probl= em >>> arises. Perhaps >>> we were wrong?. >>> >>> >>> These drives are meant for small loads in a typical PC use case, >>> i.e. some installations of software in the few GB range, else onl= y >>> files of a few MB being written, perhaps an import of media files= >>> that range from tens to a few hundred MB at a time, but less ofte= n >>> than once a day. >>> =C2=A0 >>> *We move, you know... lots of little files... and lot's of differ= ent >>> concurrent modifications by 1500-2000 concurrent imap connections= we >>> have...* >>> >> I do not expect the read load to be a problem (except possibly when th= e SSD >> is moving data from SLC to QLC blocks, but even then reads will get >> priority). But writes and trims might very well overwhelm the SSD, >> especially when its getting full. Keeping a part of the SSD unused (ex= cluded >> from the partitions created) will lead to a large pool of unused block= s. >> This will reduce the write amplification - there are many free blocks = in the >> "unpartitioned part" of the SSD, and thus there is less urgency to com= pact >> partially filled blocks. (E.g. if you include only 3/4 of the SSD capa= city >> in a partition used for the ZPOOL, then 1/4 of each erase block could = be >> free due to deletions/TRIM without any compactions required to hold al= l this >> data.) >> >> Keeping a significant percentage of the SSD unallocated is a good stra= tegy >> to improve its performance and resilience. >> >> *Well, we have allocated all the disk space... but not used... just >> allocated.... you know... we do a zpool create with the whole disks...= =2E.* >> I think the only chance for a solution that does not require new hardware= is to make sure, only some 80% of the SSDs are used (i.e. allocate only 80% for= ZFS, leave 20% unallocated). This will significantly reduce the rate of garbag= e collections and thus reduce the load they cause. I'd use a fast encryption algorithm (zstd - choose a level that does not overwhelm the CPU, there are benchmark results for ZFS with zstd, and I f= ound zstd-2 to be best for my use case). This will more than make up for the s= pace you left unallocated on the SSDs. A different mail box format might help, too - I'm happy with dovecot's md= box format, which is as fast but much more efficient than mdir. >>> As the SSD fills, the space available for the single level write >>> cache gets smaller >>> =C2=A0 >>> *The single level write cache is the cache these ssd drivers have= , for >>> compensating the speed issues they have due to using qlc memory?.= Do >>> you refer to that?. Sorry I don't understand well this paragraph.= * >>> >> Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SL= C >> cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cel= ls as >> 24 GB of data in QLC mode. >> >> *Ok, true.... yes....* >> >> A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (= 600 GB >> in 150 tn QLC cells plus 100 GB in 100 tn SLC cells). >> >> *Ahh! you mean that SLC capacity for speeding up the QLC disks, is obt= ained >> from each single layer of the QLC?.* >> There are no specific SLC cells. A fraction of the QLC capable cells is o= nly written with only 1 instead of 4 bits. This is a much simpler process, si= nce there are only 2 charge levels per cell that are used, while QLC uses 16 = charge levels, and you can only add charge (must not overshoot), therefore only = small increments are added until the correct value can be read out). But since SLC cells take away specified capacity (which is calculated ass= uming all cells hold 4 bits each, not only 1 bit), their number is limited and shrinks as demand for QLC cells grows. The advantage of the SLC cache is fast writes, but also that data in it m= ay have become stale (trimmed) and thus will never be copied over into a QLC= block. But as the SSD fills and the size of the SLC cache shrinks, this capability will be mostly lost, and lots of very short lived data is stor= ed in QLC cells, which will quickly become partially stale and thus needing compaction as explained above. >> Therefore, the fraction of the cells used as an SLC cache is reduced w= hen it >> gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cell= s). >> >> *Sorry I don't get this last sentence... don't understand it because I= don't >> really know the meaning of tn... * >> >> *but I think I'm getting the idea if you say that each QLC layer, has = it's >> own SLC cache obtained from the disk space avaiable for each QLC layer= =2E...* >> >> And with less SLC cells available for short term storage of data the >> probability of data being copied to QLC cells before the irrelevant me= ssages >> have been deleted is significantly increased. And that will again lead= to >> many more blocks with "holes" (deleted messages) in them, which then n= eed to >> be copied possibly multiple times to compact them. >> >> *If I correct above, I think I got the idea yes....* >> >>> (on many SSDs, I have no numbers for this >>> particular device), and thus the amount of data that can be >>> written at single cell speed shrinks as the SSD gets full. >>> =C2=A0 >>> >>> I have just looked up the size of the SLC cache, it is specified >>> to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB= >>> version, smaller models will have a smaller SLC cache). >>> =C2=A0 >>> *Assuming you were talking about the cache for compensating speed= we >>> previously commented, I should say these are the 870 QVO but the = 8TB >>> version. So they should have the biggest cache for compensating t= he >>> speed issues...* >>> >> I have looked up the data: the larger versions of the 870 QVO have the= same >> SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 G= B more >> if there are enough free blocks. >> >> *Ours one is the 8TB model so I assume it could have bigger limits. Th= e >> disks are mostly empty, really.... so... for instance....* >> >> *zpool list* >> *NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 SIZE=C2=A0 ALLOC=C2=A0=C2=A0 FREE=C2=A0 CKPOINT=C2=A0 EXPANDSZ=C2=A0= =C2=A0 FRAG=C2=A0=C2=A0=C2=A0 CAP=C2=A0 >> DEDUP=C2=A0 HEALTH=C2=A0 ALTROOT* >> *root_dataset=C2=A0 448G=C2=A0 2.29G=C2=A0=C2=A0 446G=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0 1%=C2=A0=C2=A0=C2=A0=C2=A0 0%=C2=A0 1.00x=C2=A0= >> ONLINE=C2=A0 -* >> *mail_dataset=C2=A0 58.2T=C2=A0 11.8T=C2=A0 46.4T=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -= =C2=A0=C2=A0=C2=A0 26%=C2=A0=C2=A0=C2=A0 20%=C2=A0 1.00x=C2=A0 >> ONLINE=C2=A0 -* >> Ok, seems you have got 10 * 8 TB in a raidz2 configuration. Only 20% of the mail dataset is in use, the situation will become much wo= rse when the pool will fill up! >> *I suppose fragmentation affects too....* >> On magnetic media fragmentation means that a file is spread out over the = disk in a non-optimal way, causing access latencies due to seeks and rotationa= l delay. That kind of fragmentation is not really relevant for SSDs, which = allow for fast random access to the cells. And the FRAG value shown by the "zpool list" command is not about fragmen= tation of files at all, it is about the structure of free space. Anyway less rel= evant for SSDs than for classic hard disk drives. >>> But after writing those few GB at a speed of some 500 MB/s (i.e. >>> after 12 to 150 seconds), the drive will need several minutes to >>> transfer those writes to the quad-level cells, and will operate >>> at a fraction of the nominal performance during that time. >>> (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for t= he >>> 2 TB model.) >>> =C2=A0 >>> *Well we are in the 8TB model. I think I have understood what you= wrote >>> in previous paragraph. You said they can be fast but not constant= ly, >>> because later they have to write all that to their perpetual stor= age >>> from the cache. And that's slow. Am I wrong?. Even in the 8TB mod= el you >>> think Stefan?.* >>> >> The controller in the SSD supports a given number of channels (e.g 4),= each >> of which can access a Flash chip independently of the others. Small SS= Ds >> often have less Flash chips than there are channels (and thus a lower >> throughput, especially for writes), but the larger models often have m= ore >> chips than channels and thus the performance is capped. >> >> *This is totally logical. If a QVO disk would outperform best or simil= ar >> than an Intel without consequences.... who was going to buy a expensiv= e >> Intel enterprise?.* >> The QVO is bandwidth limited due to the SATA data rate of 6 Mbit/s anyway= , and it is optimized for reads (which are not significantly slower than offere= d by the TLC models). This is a viable concept for a consumer PC, but not for = a server. >> >> In the case of the 870 QVO, the controller supports 8 channels, which = allows >> it to write 160 MB/s into the QLC cells. The 1 TB model apparently has= only >> 4 Flash chips and is thus limited to 80 MB/s in that situation, while = the >> larger versions have 8, 16, or 32 chips. But due to the limited number= of >> channels, the write rate is limited to 160 MB/s even for the 8 TB mode= l. >> >> *Totally logical Stefan...* >> >> If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in t= his limit. >> >>> *The main problem we are facing is that in some peak moments, whe= n the >>> machine serves connections for all the instances it has, and only= as >>> said in some peak moments... like the 09am or the 11am.... it see= ms the >>> machine becomes slower... and like if the disks weren't able to s= erve >>> all they have to serve.... In these moments, no big files are mov= ed... >>> but as we have 1800-2000 concurrent imap connections... normally = they >>> are doing each one... little changes in their mailbox. Do you thi= nk >>> perhaps this disks then are not appropriate for this kind of usag= e?-* >>> >> I'd guess that the drives get into a state in which they have to recyc= le >> lots of partially free blocks (i.e. perform kind of a garbage collecti= on) >> and then three kinds of operations are competing with each other: >> >> 1. reads (generally prioritized) >> 2. writes (filling the SLC cache up to its maximum size) >> 3. compactions of partially filled blocks (required to make free bloc= ks >> available for re-use) >> >> Writes can only proceed if there are sufficient free blocks, which on = a >> filled SSD with partially filled erase blocks means that operations of= type >> 3. need to be performed with priority to not stall all writes. >> >> My assumption is that this is what you are observing under peak load. >> >> *It could be although the disks are not filled.... the pool are at 20 = or 30% >> of capacity and fragmentation from 20%-30% (as zpool list states).* >> Yes, and that means that your issues will become much more critical over = time when the free space shrinks and garbage collections will be required at a= n even faster rate, with the SLC cache becoming less and less effective to weed = out short lived files as an additional factor that will increase write amplif= ication. >>> >>> And cheap SSDs often have no RAM cache (not checked, but I'd be >>> surprised if the QVO had one) and thus cannot keep bookkeeping da= te >>> in such a cache, further limiting the performance under load. >>> =C2=A0 >>> *This brochure >>> (https://semiconductor.samsung.com/resources/brochure/870_Series_= Brochure.pdf >>> and the datasheet >>> https://semiconductor.samsung.com/resources/data-sheet/Samsung_SS= D_870_QVO_Data_Sheet_Rev1.1.pdf) >>> sais if I have read properly, the 8TB drive has 8GB of ram?. I as= sume >>> that is what they call the turbo write cache?.* >>> >> No, the turbo write cache consists of the cells used in SLC mode (whic= h can >> be any cells, not only cells in a specific area of the flash chip). >> >> *I see I see....* >> >> The RAM is needed for fast lookup of the position of data for reads an= d of >> free blocks for writes. >> >> *Our ones... seem to have 8GB LPDDR4 of ram.... as datasheet states...= =2E* >> Yes, and it makes sense that the RAM size is proportional to the capacity= since a few bytes are required per addressable data block. If the block size was 8 KB the RAM could hold 8 bytes (e.g. a pointer and= some status flags) for each logically addressable block. But there is no infor= mation about the actual internal structure of the QVO that I know of. [...] >> >> *I see.... It's extremely misleading you know... because... you can co= py >> five mailboxes of 50GB concurrently for instance.... and you flood a g= igabit >> interface copying (obviously because disks can keep that throughput)..= =2E but >> later.... you see... you are in an hour that yesterday, and even 4 day= s >> before you have not had any issues... and that day... you see the comm= ented >> issue... even not being exactly at a peak hour (perhaps is two hours l= ater >> the peak hour even)... or... but I wasn't noticing about all things yo= u say >> in this email....* >> >> I have seen advice to not use compression in a high load scenario in s= ome >> other reply. >> >> I tend to disagree: Since you seem to be limited when the SLC cache is= >> exhausted, you should get better performance if you compress your data= =2E I >> have found that zstd-2 works well for me (giving a significant overall= >> reduction of size at reasonable additional CPU load). Since ZFS allows= to >> switch compressions algorithms at any time, you can experiment with >> different algorithms and levels. >> >> *I see... you say compression should be enabled.... The main reason be= cause >> we have not enabled it yet, is for keeping the system the most near po= ssible >> to config defaults... you know... for later being able to ask in this >> mailing lists if we have an issue... because you know... it would be f= ar >> more easier to ask about something strange you are seeing when that st= range >> thing is near to a well tested config, like the config by default....*= >> >> *But now you say Stefan... if you switch between compression algorithm= s you >> will end up with a mix of different files compressed in a different >> manner... that is not a bit disaster later?. Doesn't affect performanc= e in >> some manner?.* >> The compression used is stored in the per file information, each file in = a dataset could have been written with a different compression method and l= evel. Blocks are independently compressed - a file level compression may be mor= e effective. Large mail files will contain incompressible attachments (alre= ady compressed), but in base64 encoding. This should allow a compression rati= o of ~1,3. Small files will be plain text or HTML, offering much better compre= ssion factors. >> >> One advantage of ZFS compression is that it applies to the ARC, too. A= nd a >> compression factor of 2 should easily be achieved when storing mail (n= ot for >> .docx, .pdf, .jpg files though). Having more data in the ARC will redu= ce the >> read pressure on the SSDs and will give them more cycles for garbage >> collections (which are performed in the background and required to alw= ays >> have a sufficient reserve of free flash blocks for writes). >> >> *We would use I assume the lz4... which is the less "expensive" compre= ssion >> algorithm for the CPU... and I assume too for avoiding delay accessing= >> data... do you recommend another one?. Do you always recommend compres= sion >> then?.* >> I'd prefer zstd over lz4 since it offers a much higher compression ratio.= Zstd offers higher compression ratios than lz4 at similar or better decompression speed, but may be somewhat slower compressing the data. But= in my opinion this is outweighed by the higher effective amount of data in the ARC/L2ARC possible with zstd. For some benchmarks of different compression algorithms available for ZFS= and compared to uncompressed mode see the extensive results published by Jude= Allan: https://docs.google.com/spreadsheets/d/1TvCAIDzFsjuLuea7124q-1UtMd0C9amTg= nXm2yPtiUQ/edit?usp=3Dsharing The SQL benchmarks might best resemble your use case - but remember that = a significant reduction of the amount of data being written to the SSDs m= ight be more important than the highest transaction rate, since your SSDs= put a low upper limit on that when highly loaded. >> I'd give it a try - and if it reduces your storage requirements by 10%= only, >> then keep 10% of each SSD unused (not assigned to any partition). That= will >> greatly improve the resilience of your SSDs, reduce the write-amplific= ation, >> will allow the SLC cache to stay at its large value, and may make a la= rge >> difference to the effective performance under high load. >> >> *But when you enable compression... only gets compressed the new data >> modified or entered. Am I wrong?.* >> Compression is per file system data block (at most 1 MB if you set the blocksize to that value). Each such block is compressed independently of = all others, to not require more than 1 block to be read and decompressed when= randomly reading a file. If a block does not shrink when compressed (it m= ay contain compressed file data) the block is written to disk as-is (uncompr= essed). >> >> ** >> >> *By the way, we have more or less 1/4 of each disk used (12 TB allocat= ed in >> a poll stated by zpool list, divided between 8 disks of 8TB...)... do = you >> think we could be suffering on write amplification and so... having a = so >> little disk space used in each disk?.* >> Your use case will cause a lot of garbage collections and this particular= high write amplification values. >> >> Regards, STefan >> >> *Hey mate, your mail is incredible. It has helped as a lot. Can we inv= ite >> you a cup of coffee or a beer through Paypal or similar?. Can I help y= ou in >> some manner?.* >> Thanks, I'm glad to help, and I'd appreciate to hear whether you get your= setup optimized for the purpose (and how well it holds up when you approach the= capacity limits of your drives). I'm always interested in experience of users with different use cases tha= n I have (just being a developer with too much archived mail and media collec= ted over a few decades). Regards, STefan --------------5zqkLuBRyXvluXGRQjtNvCUK Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Am 07.04.22 um 14:30 schrieb egoitz@ramattack.net:
El 2022-04-06 23:49, Stefan Esser escribi=C3=B3:

El 2022-04-06 17:43, Stefan Esser escribi=C3=B3:


Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net:
Hi Rainer!

Thank you so much for your help :) :)

Well I assume they are in a datacenter and should not be a power outage....

About dataset size... yes... our ones are big... they can be 3-4 TB easily each
dataset.....

We bought them, because as they are for mailboxes and mailboxes grow and
grow.... for having space for hosting them...
Which mailbox format (e.g. mbox, maildir, ...) do you use?<= /div>
=C2=A0
I'm running Cyrus imap so sort of Maildir... too many little files normally..... Sometimes directories with tons of little files....

Assuming that many mails are much smaller than the erase block size of the SSD, this may cause issues. (You may know the following ...)

For example, if you have message sizes of 8 KB and an erase block size of 64 KB (just guessing), then 8 mails will be in an erase block. If half the mails are deleted, then the erase block will still occupy 64 KB, but only hold 32 KB of useful data (and the SSD will only be aware of this fact if TRIM has signaled which data is no longer relevant). The SSD will copy several partially filled erase blocks together in a smaller number of free blocks, which then are fully utilized. Later deletions will repeat this game, and your data will be copied multiple times until it has aged (and the user is less likely to delete further messages). This leads to "write amplification" - data is internally moved around and thus written multiple times.


Stefan!! you are nice!= ! I think this could explain all our problem. So, why we are having the most randomness in our performance degradation and that does not necessarily has to match with the most io peak hours... That I could cause that performance degradation just by deleting a couple of huge (perhaps 200.000 mails) mail folders in a middle traffic hour time!!

Yes, if deleting large amounts of data triggers performance issues (and the disk does not have a deficient TRIM implementation), then the issue is likely to be due to internal garbage collections colliding with other operations.

The problem is that by= what I know, erase block size of an SSD disk is something fixed in the disk firmware. I don't really know if perhaps it could be modified with Samsung magician or those kind of tool of Samsung.... else I don't really see the manner of improving it... because apart from that, you are deleting a file in raidz-2 array... no just in a disk... I assume aligning chunk size, with record size and with the "secret" erase size of the ssd, perhaps could be slightly compensated?.

The erase block size is a fixed hardware feature of each flash chip. There is a block size for writes (e.g. 8 KB) and many such blocks are combined in one erase block (of e.g. 64 KB, probably larger in todays SSDs), they can only be returned to the free block pool all together. And if some of these writable blocks hold live data, they must be preserved by collecting them in newly allocated free blocks.

An example of what might happen, showing a simplified layout of files 1, 2, 3 (with writable blocks 1a, 1b, ..., 2a, 2b, ... and "--" for stale data of deleted files, ".." for erased/writable flash blocks) in an SSD might be:

erase block 1: |1a|1b|--|--|2a|--|--|3a|<= /font>

erase block 2; |--|--|--|2b|--|--|--|1c|<= /font>

erase block 3; |2c|1d|3b|3c|--|--|--|--|<= /font>

erase block 4; |..|..|..|..|..|..|..|..|<= /font>

This is just a random example how data could be laid out on the physical storage array. It is assumed that the 3 erase blocks once were completely occupied

In this example, 10 of 32 writable blocks are occupied, and only one free erase block exists.

This situation must not persist, since the SSD needs more empty erase blocks. 10/32 of the capacity is used for data, but 3/4 of the blocks are occupied and not immediately available for new data.

The garbage collection might combine erase blocks 1 and 3 into a currently free one, e.g. erase block 4:

erase block 1; |..|..|..|..|..|..|..|..|

erase block 2; |--|--|--|2b|--|--|--|1c|<= /font>

erase block 3; |..|..|..|..|..|..|..|..|<= /font>

erase block 4: |1a|1b|2a|3a|2c|1d|3b|3c|<= /font>

Now only 2/4 of the capacity is not available for new data (which is still a lot more than 10/32, but better than before).

Now assume file 2 is deleted:

erase block 1; |..|..|..|..|..|..|..|..| =

erase block 2; |--|--|--|--|--|--|--|1c|<= /font>

erase block 3; |..|..|..|..|..|..|..|..|<= /font>

erase block 4: |1a|1b|--|3a|--|1d|3b|3c|<= /font>

There is now a new sparsely used erase block 4, and it will soon need to be garbage collected, too - in fact it could be combined with the live data from erase block 2, but this may be delayed until there is demand for more erased blocks (since e.g. file 1 or 3 might also have been deleted by then).

The garbage collection does not know which data blocks belong to which file, and therefore it cannot collect the data belonging to a file into a single erase block. Blocks are allocated as data comes in (as long as enough SLC cells are available in this area, else directly in QLC cells). Your many parallel updates will cause fractions of each larger file to be spread out over many erase blocks.

As you can see, a single file that is deleted may affect many erase blocks, and you have to take redundancy into consideration, which will multiply the effect by a factor of up to 3 for small files (one ZFS allocation block). And remember: deleting a message in mdir format will free the data blocks, but will also remove the directory entry, causing additional meta-data writes (again multiplied by the raid redundancy).

A consumer SSD would normally see only very few parallel writes, and sequential writes of full files will have a high chance to put the data of each file contiguously in the minimum number of erase blocks, allowing to free multiple complete erase blocks when such a file is deleted and thus obviating the need for many garbage collection copies (that occur if data from several independent files is in one erase block).

Actual SSDs have many more cells than advertised. Some 10% to 20% may be kept as a reserve for aging blocks that e.g. may have failed kind of a "read-after-write test" (implemented in the write function, which adds charges to the cells until they return the correct read-outs).

BTW: Having an ashift value that is lower than the internal write block size may also lead to higher write amplification values, but a large ashift may lead to more wasted capacity, which may become an issue if typical file length are much smaller than the allocation granularity that results from the ashift value.

Larger mails are less of an issue since they span multiple erase blocks, which will be completely freed when such a message is deleted.

I see I see Stefan...<= /span>

Samsung has a lot of experience and generally good strategies to deal with such a situation, but SSDs specified for use in storage systems might be much better suited for that kind of usage profile.

Yes... and the disks for our purpose... perhaps weren't QVOs....=

You should have got (much more expensive) server grade SSDs, IMHO.

But even 4 * 2 TB QVO (or better EVO) drives per each 8 TB QVO drive would result in better performance (but would need a lot of extra SATA ports).

In fact, I'm not sure whether rotating media and a reasonable L2ARC consisting of a fast M.2 SSD plus a mirror of small SSDs for a LOG device would not be a better match for your use case. Reading the L2ARC would be very fast, writes would be purely sequential and relatively slow, you could choose a suitable L2ARC strategy (caching of file data vs. meta data), and the LOG device would support fast fsync() operations required for reliable mail systems (which confirm data is on stable storage before acknowledging the reception to the sender).

We knew they had some speed issues, but those speed issues, we thought (as
Samsung explains in the QVO site) they started after exceeding the speeding
buffer this disks have. We though that meanwhile you didn't exceed it's
capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps
we were wrong?.

These drives are meant for small loads in a typical PC use case,
i.e. some installations of software in the few GB range, else only
files of a few MB being written, perhaps an import of media files
that range from tens to a few hundred MB at a time, but less often
than once a day.
=C2=A0
We move= , you know... lots of little files... and lot's of different concurrent modifications by 1500-2000 concurrent imap connections we have...<= /div>

I do not expect the read load to be a problem (except possibly when the SSD is moving data from SLC to QLC blocks, but even then reads will get priority). But writes and trims might very well overwhelm the SSD, especially when its getting full. Keeping a part of the SSD unused (excluded from the partitions created) will lead to a large pool of unused blocks. This will reduce the write amplification - there are many free blocks in the "unpartitioned part" of the SSD, and thus there is less urgency to compact partially filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a partition used for the ZPOOL, then 1/4 of each erase block could be free due to deletions/TRIM without any compactions required to hold all this data.)

Keeping a significant percentage of the SSD unallocated is a good strategy to improve its performance and resilience.

Well, we have allocate= d all the disk space... but not used... just allocated.... you know... we do a zpool create with the whole disks.....<= /span>

I think the only chance for a solution that does not require new hardware is to make sure, only some 80% of the SSDs are used (i.e. allocate only 80% for ZFS, leave 20% unallocated). This will significantly reduce the rate of garbage collections and thus reduce the load they cause.

I'd use a fast encryption algorithm (zstd - choose a level that does not overwhelm the CPU, there are benchmark results for ZFS with zstd, and I found zstd-2 to be best for my use case). This will more than make up for the space you left unallocated on the SSDs.

A different mail box format might help, too - I'm happy with dovecot's mdbox format, which is as fast but much more efficient than mdir.

As the SSD fills, the space available for the single level write
cache gets smaller
=C2=A0
The single level write cache is the cache these ssd drivers have, for compensating the speed issues they have due to using qlc memory?. Do you refer to that?. Sorry I don't understand well this paragraph.

Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as 24 GB of data in QLC mode.

Ok, true.... yes....

A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (600 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells).

Ahh! you mean that SLC= capacity for speeding up the QLC disks, is obtained from each single layer of the QLC?.

There are no specific SLC cells. A fraction of the QLC capable cells is only written with only 1 instead of 4 bits. This is a much simpler process, since there are only 2 charge levels per cell that are used, while QLC uses 16 charge levels, and you can only add charge (must not overshoot), therefore only small increments are added until the correct value can be read out).

But since SLC cells take away specified capacity (which is calculated assuming all cells hold 4 bits each, not only 1 bit), their number is limited and shrinks as demand for QLC cells grows.<= /p>

The advantage of the SLC cache is fast writes, but also that data in it may have become stale (trimmed) and thus will never be copied over into a QLC block. But as the SSD fills and the size of the SLC cache shrinks, this capability will be mostly lost, and lots of very short lived data is stored in QLC cells, which will quickly become partially stale and thus needing compaction as explained above.

Therefore, the fraction of the cells used as an SLC cache is reduced when it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cells).

Sorry I don't get this= last sentence... don't understand it because I don't really know the meaning of tn...

but I think I'm gettin= g the idea if you say that each QLC layer, has it's own SLC cache obtained from the disk space avaiable for each QLC layer....

And with less SLC cells available for short term storage of data the probability of data being copied to QLC cells before the irrelevant messages have been deleted is significantly increased. And that will again lead to many more blocks with "holes" (deleted messages) in them, which then need to be copied possibly multiple times to compact them.

If I correct above, I think I got the idea yes....

(on many SSDs, I have no numbers for this
particular device), and thus the amount of data that can be
written at single cell speed shrinks as the SSD gets full.<= /div>
=C2=A0

I have just looked up the size of the SLC cache, it is specified
to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB
version, smaller models will have a smaller SLC cache).
=C2=A0
Assumin= g you were talking about the cache for compensating speed we previously commented, I should say these are the 870 QVO but the 8TB version. So they should have the biggest cache for compensating the speed issues...<= /span>

I have looked up the data: the larger versions of the 870 QVO have the same SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB more if there are enough free blocks.

Ours one is the 8TB model so I assume it could have bigger limits. The disks are mostly empty, really.... so... for instance....<= /strong>

zpool list
NAME=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 SIZE=C2=A0 ALLOC=C2=A0=C2=A0 FREE=C2=A0 CKPOINT=C2=A0 EXPANDSZ=C2=A0=C2= =A0 FRAG=C2=A0=C2=A0=C2=A0 CAP=C2=A0 DEDUP=C2=A0 HEALTH=C2=A0 ALTROOT
root_dataset=C2=A0 448G= =C2=A0 2.29G=C2=A0=C2=A0 446G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0 1%=C2=A0=C2=A0=C2=A0=C2=A0 0%=C2=A0 1.00x=C2=A0 ONLINE=C2=A0 -
mail_dataset=C2=A0 58.2= T=C2=A0 11.8T=C2=A0 46.4T=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0 26= %=C2=A0=C2=A0=C2=A0 20%=C2=A0 1.00x=C2=A0 ONLINE=C2=A0 -

Ok, seems you have got 10 * 8 TB in a raidz2 configuration.

Only 20% of the mail dataset is in use, the situation will become much worse when the pool will fill up!

I suppose fragmentatio= n affects too....

On magnetic media fragmentation means that a file is spread out over the disk in a non-optimal way, causing access latencies due to seeks and rotational delay. That kind of fragmentation is not really relevant for SSDs, which allow for fast random access to the cells.

And the FRAG value shown by the "zpool list" command is not about fragmentation of files at all, it is about the structure of free space. Anyway less relevant for SSDs than for classic hard disk drives.

But after writing those few GB at a speed of some 500 MB/s (i.e.
after 12 to 150 seconds), the drive will need several minutes to
transfer those writes to the quad-level cells, and will operate
at a fraction of the nominal performance during that time.<= br> (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the
2 TB model.)
=C2=A0
Well we= are in the 8TB model. I think I have understood what you wrote in previous paragraph. You said they can be fast but not constantly, because later they have to write all that to their perpetual storage from the cache. And that's slow. Am I wrong?. Even in the 8TB model you think Stefan?.

The controller in the SSD supports a given number of channels (e.g 4), each of which can access a Flash chip independently of the others. Small SSDs often have less Flash chips than there are channels (and thus a lower throughput, especially for writes), but the larger models often have more chips than channels and thus the performance is capped.

This is totally logical. If a QVO disk would outperform best or similar than an Intel without consequences.... who was going to buy a expensive Intel enterprise?.

The QVO is bandwidth limited due to the SATA data rate of 6 Mbit/s anyway, and it is optimized for reads (which are not significantly slower than offered by the TLC models). This is a viable concept for a consumer PC, but not for a server.

In the case of the 870 QVO, the controller supports 8 channels, which allows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has only 4 Flash chips and is thus limited to 80 MB/s in that situation, while the larger versions have 8, 16, or 32 chips. But due to the limited number of channels, the write rate is limited to 160 MB/s even for the 8 TB model.

Totally logical Stefan...

If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in this limit.

The mai= n problem we are facing is that in some peak moments, when the machine serves connections for all the instances it has, and only as said in some peak moments... like the 09am or the 11am.... it seems the machine becomes slower... and like if the disks weren't able to serve all they have to serve.... In these moments, no big files are moved... but as we have 1800-2000 concurrent imap connections... normally they are doing each one... little changes in their mailbox. Do you think perhaps this disks then are not appropriate for this kind of usage?-

I'd guess that the drives get into a state in which they have to recycle lots of partially free blocks (i.e. perform kind of a garbage collection) and then three kinds of operations are competing with each other:

  1. reads (generally prioritized)
  2. writes (filling the SLC cache up to its maximum size)
  3. compactions of partially filled blocks (required to make free blocks available for re-use)

Writes can only proceed if there are sufficient free blocks, which on a filled SSD with partially filled erase blocks means that operations of type 3. need to be performed with priority to not stall all writes.

My assumption is that this is what you are observing under peak load.

It could be although the disks are not filled.... the pool are at 20 or 30% of capacity and fragmentation from 20%-30% (as zpool list states).

Yes, and that means that your issues will become much more critical over time when the free space shrinks and garbage collections will be required at an even faster rate, with the SLC cache becoming less and less effective to weed out short lived files as an additional factor that will increase write amplification.
And cheap SSDs often have no RAM cache (not checked, but I'd be
surprised if the QVO had one) and thus cannot keep bookkeeping date
in such a cache, further limiting the performance under load.
=C2=A0
This brochure (https://semiconductor.samsun= g.com/resources/brochure/870_Series_Brochure.pdf and the datasheet https://semiconductor.samsun= g.com/resources/data-sheet/Samsung_SSD_870_QVO_Data_Sheet_Rev1.1.pdf)= sais if I have read properly, the 8TB drive has 8GB of ram?. I assume that is what they call the turbo write cache?.

No, the turbo write cache consists of the cells used in SLC mode (which can be any cells, not only cells in a specific area of the flash chip).

I see I see....=

The RAM is needed for fast lookup of the position of data for reads and of free blocks for writes.

Our ones... seem to have 8GB LPDDR4 of ram.... as datasheet states....

Yes, and it makes sense that the RAM size is proportional to the capacity since a few bytes are required per addressable data block.

If the block size was 8 KB the RAM could hold 8 bytes (e.g. a pointer and some status flags) for each logically addressable block. But there is no information about the actual internal structure of the QVO that I know of.

[...]

I see.... It's extremely misleading you know... because... you can copy five mailboxes of 50GB concurrently for instance.... and you flood a gigabit interface copying (obviously because disks can keep that throughput)... but later.... you see... you are in an hour that yesterday, and even 4 days before you have not had any issues... and that day... you see the commented issue... even not being exactly at a peak hour (perhaps is two hours later the peak hour even)... or... but I wasn't noticing about all things you say in this email....

I have seen advice to not use compression in a high load scenario in some other reply.

I tend to disagree: Since you seem to be limited when the SLC cache is exhausted, you should get better performance if you compress your data. I have found that zstd-2 works well for me (giving a significant overall reduction of size at reasonable additional CPU load). Since ZFS allows to switch compressions algorithms at any time, you can experiment with different algorithms and levels.

I see... you say compression should be enabled.... The main reason because we have not enabled it yet, is for keeping the system the most near possible to config defaults... you know... for later being able to ask in this mailing lists if we have an issue... because you know... it would be far more easier to ask about something strange you are seeing when that strange thing is near to a well tested config, like the config by default....

But now you say Stefan... if you switch between compression algorithms you will end up with a mix of different files compressed in a different manner... that is not a bit disaster later?. Doesn't affect performance in some manner?.=

The compression used is stored in the per file information, each file in a dataset could have been written with a different compression method and level. Blocks are independently compressed - a file level compression may be more effective. Large mail files will contain incompressible attachments (already compressed), but in base64 encoding. This should allow a compression ratio of ~1,3. Small files will be plain text or HTML, offering much better compression factors.

One advantage of ZFS compression is that it applies to the ARC, too. And a compression factor of 2 should easily be achieved when storing mail (not for .docx, .pdf, .jpg files though). Having more data in the ARC will reduce the read pressure on the SSDs and will give them more cycles for garbage collections (which are performed in the background and required to always have a sufficient reserve of free flash blocks for writes).

We would use I assume the lz4... which is the less "expensive" compression algorithm for the CPU... and I assume too for avoiding delay accessing data... do you recommend another one?. Do you always recommend compression then?.

=

I'd prefer zstd over lz4 since it offers a much higher compression ratio.

Zstd offers higher compression ratios than lz4 at similar or better decompression speed, but may be somewhat slower compressing the data. But in my opinion this is outweighed by the higher effective amount of data in the ARC/L2ARC possible with zstd.

For some benchmarks of different compression algorithms available for ZFS and compared to uncompressed mode see the extensive results published by Jude Allan:

https://docs.google.com/sprea=
dsheets/d/1TvCAIDzFsjuLuea7124q-1UtMd0C9amTgnXm2yPtiUQ/edit?usp=3Dsharing=


The SQL benchmarks might best resemble your use case - but remember that =
a significant reduction of the amount of data being written to the SSDs m=
ight be more important than the highest transaction rate, since your SSDs=
 put a low upper limit on that when highly loaded.

I'd give it a try - and if it reduces your storage requirements by 10% only, then keep 10% of each SSD unused (not assigned to any partition). That will greatly improve the resilience of your SSDs, reduce the write-amplification, will allow the SLC cache to stay at its large value, and may make a large difference to the effective performance under high load.<= /p>

But when you enable compression... only gets compressed the new data modified or entered. Am I wrong?.

Compression is per file system data block (at most 1 MB if you set the blocksize to that value). Each such block is compressed independently of all others, to not require more than 1 block to be read and decompressed when randomly reading a file. If a block does not shrink when compressed (it may contain compressed file data) the block is written to disk as-is (uncompressed).

By the way, we have more or less 1/4 of each disk used (12 TB allocated in a poll stated by zpool list, divided between 8 disks of 8TB...)... do you think we could be suffering on write amplification and so... having a so little disk space used in each disk?.

Your use case will cause a lot of garbage collections and this particular high write amplification values.

Regards, STefan

Hey mate, your mail is= incredible. It has helped as a lot. Can we invite you a cup of coffee or a beer through Paypal or similar?. Can I help you in some manner?.

Thanks, I'm glad to help, and I'd appreciate to hear whether you get your setup optimized for the purpose (and how well it holds up when you approach the capacity limits of your drives).

I'm always interested in experience of users with different use cases than I have (just being a developer with too much archived mail and media collected over a few decades).

Regards, STefan

--------------5zqkLuBRyXvluXGRQjtNvCUK-- --------------O0ssWPEiEQcQgZRJEKUGD0ko-- --------------TD2ASvjzfpo4JyxrFz8JyiVP Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmJQGRAFAwAAAAAACgkQR+u171r99UTJ 4gf6A4flCtMFuYpldXh1g1ln+Nio4LQGooOn69VSJw4KhihTBqy5ZR8scfhKetf8/miSx/0Akvsc WqZA9bEy67LXbUCekfbuUXQdO8ikXY1H64fecl4ZQZwItnIacKKD6TEIuBDe5sda0N+S2n7mNE/N d3EhNEyQTBOVvOx4vHdQaz+xAR6FFXstc14bs6BaSjROUndk21zO2IE8KMXkxH4RiWqoRuny3Po7 Uz3q0/+rcPSe9GHLw3BOHbvo89NdCFwlgBv5CXDMnEqqeW7ECdZiHn14XL/F30L8zCi2c3eTbD4Q AJeoKbBsmzSaud3opYrv2oCr8UOWiSLEJOkYAyvJeA== =tDUQ -----END PGP SIGNATURE----- --------------TD2ASvjzfpo4JyxrFz8JyiVP-- From nobody Fri Apr 8 17:41:11 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E838E1A879CD; Fri, 8 Apr 2022 17:41:22 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZlss2FNpz3j5J; Fri, 8 Apr 2022 17:41:20 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id A585B60C13A; Fri, 8 Apr 2022 19:41:11 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_fe85fe2db536d584a8585a29da09a2df" Date: Fri, 08 Apr 2022 19:41:11 +0200 From: egoitz@ramattack.net To: Stefan Esser Cc: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner Subject: Re: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> Message-ID: <3d24c87110b4a155e3f14d53a9309c61@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KZlss2FNpz3j5J X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_fe85fe2db536d584a8585a29da09a2df Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Stefan, Again extremely grateful. It's an absolute honor to receive your help.. really.... I have read this mail now but I need to read it slower and in a more relaxed way.... When I do that I'll answer you (during the weekend or on Monday at most). Don't worry I will keep you updated with news :) :) . I promise :) :) Cheers! El 2022-04-08 13:14, Stefan Esser escribió: > ATENCION: Este correo se ha enviado desde fuera de la organización. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Am 07.04.22 um 14:30 schrieb egoitz@ramattack.net: El 2022-04-06 23:49, Stefan Esser escribió: > > El 2022-04-06 17:43, Stefan Esser escribió: > > Am 06.04.22 um 16:36 schrieb egoitz@ramattack.net: Hi Rainer! > > Thank you so much for your help :) :) > > Well I assume they are in a datacenter and should not be a power outage.... > > About dataset size... yes... our ones are big... they can be 3-4 TB easily each > dataset..... > > We bought them, because as they are for mailboxes and mailboxes grow and > grow.... for having space for hosting them... > Which mailbox format (e.g. mbox, maildir, ...) do you use? > > I'M RUNNING CYRUS IMAP SO SORT OF MAILDIR... TOO MANY LITTLE FILES NORMALLY..... SOMETIMES DIRECTORIES WITH TONS OF LITTLE FILES.... Assuming that many mails are much smaller than the erase block size of the SSD, this may cause issues. (You may know the following ...) For example, if you have message sizes of 8 KB and an erase block size of 64 KB (just guessing), then 8 mails will be in an erase block. If half the mails are deleted, then the erase block will still occupy 64 KB, but only hold 32 KB of useful data (and the SSD will only be aware of this fact if TRIM has signaled which data is no longer relevant). The SSD will copy several partially filled erase blocks together in a smaller number of free blocks, which then are fully utilized. Later deletions will repeat this game, and your data will be copied multiple times until it has aged (and the user is less likely to delete further messages). This leads to "write amplification" - data is internally moved around and thus written multiple times. STEFAN!! YOU ARE NICE!! I THINK THIS COULD EXPLAIN ALL OUR PROBLEM. SO, WHY WE ARE HAVING THE MOST RANDOMNESS IN OUR PERFORMANCE DEGRADATION AND THAT DOES NOT NECESSARILY HAS TO MATCH WITH THE MOST IO PEAK HOURS... THAT I COULD CAUSE THAT PERFORMANCE DEGRADATION JUST BY DELETING A COUPLE OF HUGE (PERHAPS 200.000 MAILS) MAIL FOLDERS IN A MIDDLE TRAFFIC HOUR TIME!! Yes, if deleting large amounts of data triggers performance issues (and the disk does not have a deficient TRIM implementation), then the issue is likely to be due to internal garbage collections colliding with other operations. >> THE PROBLEM IS THAT BY WHAT I KNOW, ERASE BLOCK SIZE OF AN SSD DISK IS SOMETHING FIXED IN THE DISK FIRMWARE. I DON'T REALLY KNOW IF PERHAPS IT COULD BE MODIFIED WITH SAMSUNG MAGICIAN OR THOSE KIND OF TOOL OF SAMSUNG.... ELSE I DON'T REALLY SEE THE MANNER OF IMPROVING IT... BECAUSE APART FROM THAT, YOU ARE DELETING A FILE IN RAIDZ-2 ARRAY... NO JUST IN A DISK... I ASSUME ALIGNING CHUNK SIZE, WITH RECORD SIZE AND WITH THE "SECRET" ERASE SIZE OF THE SSD, PERHAPS COULD BE SLIGHTLY COMPENSATED?. The erase block size is a fixed hardware feature of each flash chip. There is a block size for writes (e.g. 8 KB) and many such blocks are combined in one erase block (of e.g. 64 KB, probably larger in todays SSDs), they can only be returned to the free block pool all together. And if some of these writable blocks hold live data, they must be preserved by collecting them in newly allocated free blocks. An example of what might happen, showing a simplified layout of files 1, 2, 3 (with writable blocks 1a, 1b, ..., 2a, 2b, ... and "--" for stale data of deleted files, ".." for erased/writable flash blocks) in an SSD might be: erase block 1: |1a|1b|--|--|2a|--|--|3a| erase block 2; |--|--|--|2b|--|--|--|1c| erase block 3; |2c|1d|3b|3c|--|--|--|--| erase block 4; |..|..|..|..|..|..|..|..| This is just a random example how data could be laid out on the physical storage array. It is assumed that the 3 erase blocks once were completely occupied In this example, 10 of 32 writable blocks are occupied, and only one free erase block exists. This situation must not persist, since the SSD needs more empty erase blocks. 10/32 of the capacity is used for data, but 3/4 of the blocks are occupied and not immediately available for new data. The garbage collection might combine erase blocks 1 and 3 into a currently free one, e.g. erase block 4: erase block 1; |..|..|..|..|..|..|..|..| erase block 2; |--|--|--|2b|--|--|--|1c| erase block 3; |..|..|..|..|..|..|..|..| erase block 4: |1a|1b|2a|3a|2c|1d|3b|3c| Now only 2/4 of the capacity is not available for new data (which is still a lot more than 10/32, but better than before). Now assume file 2 is deleted: erase block 1; |..|..|..|..|..|..|..|..| erase block 2; |--|--|--|--|--|--|--|1c| erase block 3; |..|..|..|..|..|..|..|..| erase block 4: |1a|1b|--|3a|--|1d|3b|3c| There is now a new sparsely used erase block 4, and it will soon need to be garbage collected, too - in fact it could be combined with the live data from erase block 2, but this may be delayed until there is demand for more erased blocks (since e.g. file 1 or 3 might also have been deleted by then). The garbage collection does not know which data blocks belong to which file, and therefore it cannot collect the data belonging to a file into a single erase block. Blocks are allocated as data comes in (as long as enough SLC cells are available in this area, else directly in QLC cells). Your many parallel updates will cause fractions of each larger file to be spread out over many erase blocks. As you can see, a single file that is deleted may affect many erase blocks, and you have to take redundancy into consideration, which will multiply the effect by a factor of up to 3 for small files (one ZFS allocation block). And remember: deleting a message in mdir format will free the data blocks, but will also remove the directory entry, causing additional meta-data writes (again multiplied by the raid redundancy). A consumer SSD would normally see only very few parallel writes, and sequential writes of full files will have a high chance to put the data of each file contiguously in the minimum number of erase blocks, allowing to free multiple complete erase blocks when such a file is deleted and thus obviating the need for many garbage collection copies (that occur if data from several independent files is in one erase block). Actual SSDs have many more cells than advertised. Some 10% to 20% may be kept as a reserve for aging blocks that e.g. may have failed kind of a "read-after-write test" (implemented in the write function, which adds charges to the cells until they return the correct read-outs). BTW: Having an ashift value that is lower than the internal write block size may also lead to higher write amplification values, but a large ashift may lead to more wasted capacity, which may become an issue if typical file length are much smaller than the allocation granularity that results from the ashift value. >> Larger mails are less of an issue since they span multiple erase blocks, which will be completely freed when such a message is deleted. >> >> I SEE I SEE STEFAN... >> >> Samsung has a lot of experience and generally good strategies to deal with such a situation, but SSDs specified for use in storage systems might be much better suited for that kind of usage profile. >> >> YES... AND THE DISKS FOR OUR PURPOSE... PERHAPS WEREN'T QVOS.... You should have got (much more expensive) server grade SSDs, IMHO. But even 4 * 2 TB QVO (or better EVO) drives per each 8 TB QVO drive would result in better performance (but would need a lot of extra SATA ports). In fact, I'm not sure whether rotating media and a reasonable L2ARC consisting of a fast M.2 SSD plus a mirror of small SSDs for a LOG device would not be a better match for your use case. Reading the L2ARC would be very fast, writes would be purely sequential and relatively slow, you could choose a suitable L2ARC strategy (caching of file data vs. meta data), and the LOG device would support fast fsync() operations required for reliable mail systems (which confirm data is on stable storage before acknowledging the reception to the sender). > We knew they had some speed issues, but those speed issues, we thought (as > Samsung explains in the QVO site) they started after exceeding the speeding > buffer this disks have. We though that meanwhile you didn't exceed it's > capacity (the capacity of the speeding buffer) no speed problem arises. Perhaps > we were wrong?. > These drives are meant for small loads in a typical PC use case, > i.e. some installations of software in the few GB range, else only > files of a few MB being written, perhaps an import of media files > that range from tens to a few hundred MB at a time, but less often > than once a day. > > WE MOVE, YOU KNOW... LOTS OF LITTLE FILES... AND LOT'S OF DIFFERENT CONCURRENT MODIFICATIONS BY 1500-2000 CONCURRENT IMAP CONNECTIONS WE HAVE... I do not expect the read load to be a problem (except possibly when the SSD is moving data from SLC to QLC blocks, but even then reads will get priority). But writes and trims might very well overwhelm the SSD, especially when its getting full. Keeping a part of the SSD unused (excluded from the partitions created) will lead to a large pool of unused blocks. This will reduce the write amplification - there are many free blocks in the "unpartitioned part" of the SSD, and thus there is less urgency to compact partially filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a partition used for the ZPOOL, then 1/4 of each erase block could be free due to deletions/TRIM without any compactions required to hold all this data.) Keeping a significant percentage of the SSD unallocated is a good strategy to improve its performance and resilience. WELL, WE HAVE ALLOCATED ALL THE DISK SPACE... BUT NOT USED... JUST ALLOCATED.... YOU KNOW... WE DO A ZPOOL CREATE WITH THE WHOLE DISKS..... I think the only chance for a solution that does not require new hardware is to make sure, only some 80% of the SSDs are used (i.e. allocate only 80% for ZFS, leave 20% unallocated). This will significantly reduce the rate of garbage collections and thus reduce the load they cause. I'd use a fast encryption algorithm (zstd - choose a level that does not overwhelm the CPU, there are benchmark results for ZFS with zstd, and I found zstd-2 to be best for my use case). This will more than make up for the space you left unallocated on the SSDs. A different mail box format might help, too - I'm happy with dovecot's mdbox format, which is as fast but much more efficient than mdir. > As the SSD fills, the space available for the single level write > cache gets smaller > > THE SINGLE LEVEL WRITE CACHE IS THE CACHE THESE SSD DRIVERS HAVE, FOR COMPENSATING THE SPEED ISSUES THEY HAVE DUE TO USING QLC MEMORY?. DO YOU REFER TO THAT?. SORRY I DON'T UNDERSTAND WELL THIS PARAGRAPH. Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as 24 GB of data in QLC mode. OK, TRUE.... YES.... A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (600 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells). AHH! YOU MEAN THAT SLC CAPACITY FOR SPEEDING UP THE QLC DISKS, IS OBTAINED FROM EACH SINGLE LAYER OF THE QLC?. There are no specific SLC cells. A fraction of the QLC capable cells is only written with only 1 instead of 4 bits. This is a much simpler process, since there are only 2 charge levels per cell that are used, while QLC uses 16 charge levels, and you can only add charge (must not overshoot), therefore only small increments are added until the correct value can be read out). But since SLC cells take away specified capacity (which is calculated assuming all cells hold 4 bits each, not only 1 bit), their number is limited and shrinks as demand for QLC cells grows. The advantage of the SLC cache is fast writes, but also that data in it may have become stale (trimmed) and thus will never be copied over into a QLC block. But as the SSD fills and the size of the SLC cache shrinks, this capability will be mostly lost, and lots of very short lived data is stored in QLC cells, which will quickly become partially stale and thus needing compaction as explained above. > Therefore, the fraction of the cells used as an SLC cache is reduced when it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cells). > > SORRY I DON'T GET THIS LAST SENTENCE... DON'T UNDERSTAND IT BECAUSE I DON'T REALLY KNOW THE MEANING OF TN... > > BUT I THINK I'M GETTING THE IDEA IF YOU SAY THAT EACH QLC LAYER, HAS IT'S OWN SLC CACHE OBTAINED FROM THE DISK SPACE AVAIABLE FOR EACH QLC LAYER.... > > And with less SLC cells available for short term storage of data the probability of data being copied to QLC cells before the irrelevant messages have been deleted is significantly increased. And that will again lead to many more blocks with "holes" (deleted messages) in them, which then need to be copied possibly multiple times to compact them. > > IF I CORRECT ABOVE, I THINK I GOT THE IDEA YES.... (on many SSDs, I have no numbers for this > particular device), and thus the amount of data that can be > written at single cell speed shrinks as the SSD gets full. > > I have just looked up the size of the SLC cache, it is specified > to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB > version, smaller models will have a smaller SLC cache). > > ASSUMING YOU WERE TALKING ABOUT THE CACHE FOR COMPENSATING SPEED WE PREVIOUSLY COMMENTED, I SHOULD SAY THESE ARE THE 870 QVO BUT THE 8TB VERSION. SO THEY SHOULD HAVE THE BIGGEST CACHE FOR COMPENSATING THE SPEED ISSUES... I have looked up the data: the larger versions of the 870 QVO have the same SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB more if there are enough free blocks. OURS ONE IS THE 8TB MODEL SO I ASSUME IT COULD HAVE BIGGER LIMITS. THE DISKS ARE MOSTLY EMPTY, REALLY.... SO... FOR INSTANCE.... ZPOOL LIST NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT ROOT_DATASET 448G 2.29G 446G - - 1% 0% 1.00X ONLINE - MAIL_DATASET 58.2T 11.8T 46.4T - - 26% 20% 1.00X ONLINE - Ok, seems you have got 10 * 8 TB in a raidz2 configuration. Only 20% of the mail dataset is in use, the situation will become much worse when the pool will fill up! >> I SUPPOSE FRAGMENTATION AFFECTS TOO.... On magnetic media fragmentation means that a file is spread out over the disk in a non-optimal way, causing access latencies due to seeks and rotational delay. That kind of fragmentation is not really relevant for SSDs, which allow for fast random access to the cells. And the FRAG value shown by the "zpool list" command is not about fragmentation of files at all, it is about the structure of free space. Anyway less relevant for SSDs than for classic hard disk drives. > But after writing those few GB at a speed of some 500 MB/s (i.e. > after 12 to 150 seconds), the drive will need several minutes to > transfer those writes to the quad-level cells, and will operate > at a fraction of the nominal performance during that time. > (QLC writes max out at 80 MB/s for the 1 TB model, 160 MB/s for the > 2 TB model.) > > WELL WE ARE IN THE 8TB MODEL. I THINK I HAVE UNDERSTOOD WHAT YOU WROTE IN PREVIOUS PARAGRAPH. YOU SAID THEY CAN BE FAST BUT NOT CONSTANTLY, BECAUSE LATER THEY HAVE TO WRITE ALL THAT TO THEIR PERPETUAL STORAGE FROM THE CACHE. AND THAT'S SLOW. AM I WRONG?. EVEN IN THE 8TB MODEL YOU THINK STEFAN?. The controller in the SSD supports a given number of channels (e.g 4), each of which can access a Flash chip independently of the others. Small SSDs often have less Flash chips than there are channels (and thus a lower throughput, especially for writes), but the larger models often have more chips than channels and thus the performance is capped. THIS IS TOTALLY LOGICAL. IF A QVO DISK WOULD OUTPERFORM BEST OR SIMILAR THAN AN INTEL WITHOUT CONSEQUENCES.... WHO WAS GOING TO BUY A EXPENSIVE INTEL ENTERPRISE?. The QVO is bandwidth limited due to the SATA data rate of 6 Mbit/s anyway, and it is optimized for reads (which are not significantly slower than offered by the TLC models). This is a viable concept for a consumer PC, but not for a server. > In the case of the 870 QVO, the controller supports 8 channels, which allows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has only 4 Flash chips and is thus limited to 80 MB/s in that situation, while the larger versions have 8, 16, or 32 chips. But due to the limited number of channels, the write rate is limited to 160 MB/s even for the 8 TB model. > > TOTALLY LOGICAL STEFAN... > > If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in this limit. > THE MAIN PROBLEM WE ARE FACING IS THAT IN SOME PEAK MOMENTS, WHEN THE MACHINE SERVES CONNECTIONS FOR ALL THE INSTANCES IT HAS, AND ONLY AS SAID IN SOME PEAK MOMENTS... LIKE THE 09AM OR THE 11AM.... IT SEEMS THE MACHINE BECOMES SLOWER... AND LIKE IF THE DISKS WEREN'T ABLE TO SERVE ALL THEY HAVE TO SERVE.... IN THESE MOMENTS, NO BIG FILES ARE MOVED... BUT AS WE HAVE 1800-2000 CONCURRENT IMAP CONNECTIONS... NORMALLY THEY ARE DOING EACH ONE... LITTLE CHANGES IN THEIR MAILBOX. DO YOU THINK PERHAPS THIS DISKS THEN ARE NOT APPROPRIATE FOR THIS KIND OF USAGE?- I'd guess that the drives get into a state in which they have to recycle lots of partially free blocks (i.e. perform kind of a garbage collection) and then three kinds of operations are competing with each other: * reads (generally prioritized) * writes (filling the SLC cache up to its maximum size) * compactions of partially filled blocks (required to make free blocks available for re-use) Writes can only proceed if there are sufficient free blocks, which on a filled SSD with partially filled erase blocks means that operations of type 3. need to be performed with priority to not stall all writes. My assumption is that this is what you are observing under peak load. IT COULD BE ALTHOUGH THE DISKS ARE NOT FILLED.... THE POOL ARE AT 20 OR 30% OF CAPACITY AND FRAGMENTATION FROM 20%-30% (AS ZPOOL LIST STATES). Yes, and that means that your issues will become much more critical over time when the free space shrinks and garbage collections will be required at an even faster rate, with the SLC cache becoming less and less effective to weed out short lived files as an additional factor that will increase write amplification. > And cheap SSDs often have no RAM cache (not checked, but I'd be > surprised if the QVO had one) and thus cannot keep bookkeeping date > in such a cache, further limiting the performance under load. > > THIS BROCHURE (HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/BROCHURE/870_SERIES_BROCHURE.PDF AND THE DATASHEET HTTPS://SEMICONDUCTOR.SAMSUNG.COM/RESOURCES/DATA-SHEET/SAMSUNG_SSD_870_QVO_DATA_SHEET_REV1.1.PDF) SAIS IF I HAVE READ PROPERLY, THE 8TB DRIVE HAS 8GB OF RAM?. I ASSUME THAT IS WHAT THEY CALL THE TURBO WRITE CACHE?. No, the turbo write cache consists of the cells used in SLC mode (which can be any cells, not only cells in a specific area of the flash chip). I SEE I SEE.... The RAM is needed for fast lookup of the position of data for reads and of free blocks for writes. OUR ONES... SEEM TO HAVE 8GB LPDDR4 OF RAM.... AS DATASHEET STATES.... Yes, and it makes sense that the RAM size is proportional to the capacity since a few bytes are required per addressable data block. If the block size was 8 KB the RAM could hold 8 bytes (e.g. a pointer and some status flags) for each logically addressable block. But there is no information about the actual internal structure of the QVO that I know of. [...] >> I SEE.... IT'S EXTREMELY MISLEADING YOU KNOW... BECAUSE... YOU CAN COPY FIVE MAILBOXES OF 50GB CONCURRENTLY FOR INSTANCE.... AND YOU FLOOD A GIGABIT INTERFACE COPYING (OBVIOUSLY BECAUSE DISKS CAN KEEP THAT THROUGHPUT)... BUT LATER.... YOU SEE... YOU ARE IN AN HOUR THAT YESTERDAY, AND EVEN 4 DAYS BEFORE YOU HAVE NOT HAD ANY ISSUES... AND THAT DAY... YOU SEE THE COMMENTED ISSUE... EVEN NOT BEING EXACTLY AT A PEAK HOUR (PERHAPS IS TWO HOURS LATER THE PEAK HOUR EVEN)... OR... BUT I WASN'T NOTICING ABOUT ALL THINGS YOU SAY IN THIS EMAIL.... >> >> I have seen advice to not use compression in a high load scenario in some other reply. >> >> I tend to disagree: Since you seem to be limited when the SLC cache is exhausted, you should get better performance if you compress your data. I have found that zstd-2 works well for me (giving a significant overall reduction of size at reasonable additional CPU load). Since ZFS allows to switch compressions algorithms at any time, you can experiment with different algorithms and levels. >> >> I SEE... YOU SAY COMPRESSION SHOULD BE ENABLED.... THE MAIN REASON BECAUSE WE HAVE NOT ENABLED IT YET, IS FOR KEEPING THE SYSTEM THE MOST NEAR POSSIBLE TO CONFIG DEFAULTS... YOU KNOW... FOR LATER BEING ABLE TO ASK IN THIS MAILING LISTS IF WE HAVE AN ISSUE... BECAUSE YOU KNOW... IT WOULD BE FAR MORE EASIER TO ASK ABOUT SOMETHING STRANGE YOU ARE SEEING WHEN THAT STRANGE THING IS NEAR TO A WELL TESTED CONFIG, LIKE THE CONFIG BY DEFAULT.... >> >> BUT NOW YOU SAY STEFAN... IF YOU SWITCH BETWEEN COMPRESSION ALGORITHMS YOU WILL END UP WITH A MIX OF DIFFERENT FILES COMPRESSED IN A DIFFERENT MANNER... THAT IS NOT A BIT DISASTER LATER?. DOESN'T AFFECT PERFORMANCE IN SOME MANNER?. The compression used is stored in the per file information, each file in a dataset could have been written with a different compression method and level. Blocks are independently compressed - a file level compression may be more effective. Large mail files will contain incompressible attachments (already compressed), but in base64 encoding. This should allow a compression ratio of ~1,3. Small files will be plain text or HTML, offering much better compression factors. >> One advantage of ZFS compression is that it applies to the ARC, too. And a compression factor of 2 should easily be achieved when storing mail (not for .docx, .pdf, .jpg files though). Having more data in the ARC will reduce the read pressure on the SSDs and will give them more cycles for garbage collections (which are performed in the background and required to always have a sufficient reserve of free flash blocks for writes). >> >> WE WOULD USE I ASSUME THE LZ4... WHICH IS THE LESS "EXPENSIVE" COMPRESSION ALGORITHM FOR THE CPU... AND I ASSUME TOO FOR AVOIDING DELAY ACCESSING DATA... DO YOU RECOMMEND ANOTHER ONE?. DO YOU ALWAYS RECOMMEND COMPRESSION THEN?. I'd prefer zstd over lz4 since it offers a much higher compression ratio. Zstd offers higher compression ratios than lz4 at similar or better decompression speed, but may be somewhat slower compressing the data. But in my opinion this is outweighed by the higher effective amount of data in the ARC/L2ARC possible with zstd. For some benchmarks of different compression algorithms available for ZFS and compared to uncompressed mode see the extensive results published by Jude Allan: https://docs.google.com/spreadsheets/d/1TvCAIDzFsjuLuea7124q-1UtMd0C9amTgnXm2yPtiUQ/edit?usp=sharing The SQL benchmarks might best resemble your use case - but remember that a significant reduction of the amount of data being written to the SSDs might be more important than the highest transaction rate, since your SSDs put a low upper limit on that when highly loaded. >> I'd give it a try - and if it reduces your storage requirements by 10% only, then keep 10% of each SSD unused (not assigned to any partition). That will greatly improve the resilience of your SSDs, reduce the write-amplification, will allow the SLC cache to stay at its large value, and may make a large difference to the effective performance under high load. >> >> BUT WHEN YOU ENABLE COMPRESSION... ONLY GETS COMPRESSED THE NEW DATA MODIFIED OR ENTERED. AM I WRONG?. Compression is per file system data block (at most 1 MB if you set the blocksize to that value). Each such block is compressed independently of all others, to not require more than 1 block to be read and decompressed when randomly reading a file. If a block does not shrink when compressed (it may contain compressed file data) the block is written to disk as-is (uncompressed). >> BY THE WAY, WE HAVE MORE OR LESS 1/4 OF EACH DISK USED (12 TB ALLOCATED IN A POLL STATED BY ZPOOL LIST, DIVIDED BETWEEN 8 DISKS OF 8TB...)... DO YOU THINK WE COULD BE SUFFERING ON WRITE AMPLIFICATION AND SO... HAVING A SO LITTLE DISK SPACE USED IN EACH DISK?. Your use case will cause a lot of garbage collections and this particular high write amplification values. >> Regards, STefan >> >> HEY MATE, YOUR MAIL IS INCREDIBLE. IT HAS HELPED AS A LOT. CAN WE INVITE YOU A CUP OF COFFEE OR A BEER THROUGH PAYPAL OR SIMILAR?. CAN I HELP YOU IN SOME MANNER?. Thanks, I'm glad to help, and I'd appreciate to hear whether you get your setup optimized for the purpose (and how well it holds up when you approach the capacity limits of your drives). I'm always interested in experience of users with different use cases than I have (just being a developer with too much archived mail and media collected over a few decades). Regards, STefan --=_fe85fe2db536d584a8585a29da09a2df Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Stefan,


Again extremely grateful. It's an absolute honor to receive your help.= =2E really....


I have read this mail now but I need to read it slower and in a more rel= axed way.... When I do that I'll answer you (during the weekend or on Monda= y at most).


Don't worry I will keep you updated with news :) :) . I promise :) :)


Cheers!

 


El 2022-04-08 13:14, Stefan Esser escribió:


ATENCION: Este correo se ha enviado = desde fuera de la organización. No pinche en los enlaces ni abra los= adjuntos a no ser que reconozca el remitente y sepa que el contenido es se= guro.

Am 07.04.22 um 14:30 schrieb egoitz@ramattack.net:
El 2022-04-06 23:49, Stefan Esser escribió:

El 2022-04-06 17:43, Stefan Esser escribió:


Am 06.04.22 um 16:36 schrieb egoitz@ramattack= =2Enet:
Hi Rainer!

Thank you so much for your help :) :)
=
Well I assume they are in a datacenter and should not be a power ou= tage....

About dataset size... yes... our ones are big... they= can be 3-4 TB easily each
dataset.....

We bought them, = because as they are for mailboxes and mailboxes grow and
grow.... for= having space for hosting them...

Which mailbox format (e.g. mbox, maildir, ...) do you use?
 
I'm running Cyrus imap so sort of = Maildir... too many little files normally..... Sometimes directories with t= ons of little files....

Assuming that many mails are much smaller than the erase block size of t= he SSD, this may cause issues. (You may know the following ...)

For example, if you have message sizes of 8 KB and an erase block size o= f 64 KB (just guessing), then 8 mails will be in an erase block. If half th= e mails are deleted, then the erase block will still occupy 64 KB, but only= hold 32 KB of useful data (and the SSD will only be aware of this fact if = TRIM has signaled which data is no longer relevant). The SSD will copy seve= ral partially filled erase blocks together in a smaller number of free bloc= ks, which then are fully utilized. Later deletions will repeat this game, a= nd your data will be copied multiple times until it has aged (and the user = is less likely to delete further messages). This leads to "write amplificat= ion" - data is internally moved around and thus written multiple times.


Stefan!! you are nice!! I think = this could explain all our problem. So, why we are having the most randomne= ss in our performance degradation and that does not necessarily has to matc= h with the most io peak hours... That I could cause that performance degrad= ation just by deleting a couple of huge (perhaps 200.000 mails) mail folder= s in a middle traffic hour time!!

Yes, if deleting large amounts of data triggers performance issues (and the= disk does not have a deficient TRIM implementation), then the issue is lik= ely to be due to internal garbage collections colliding with other operatio= ns.

The problem is that by what I kn= ow, erase block size of an SSD disk is something fixed in the disk firmware= =2E I don't really know if perhaps it could be modified with Samsung magici= an or those kind of tool of Samsung.... else I don't really see the manner = of improving it... because apart from that, you are deleting a file in raid= z-2 array... no just in a disk... I assume aligning chunk size, with record= size and with the "secret" erase size of the ssd, perhaps could be slightl= y compensated?.

The erase block size is a fixed hardware feature of each flash chip. The= re is a block size for writes (e.g. 8 KB) and many such blocks are combined= in one erase block (of e.g. 64 KB, probably larger in todays SSDs), they c= an only be returned to the free block pool all together. And if some of the= se writable blocks hold live data, they must be preserved by collecting the= m in newly allocated free blocks.

An example of what might happen, showing a simplified layout of files 1,= 2, 3 (with writable blocks 1a, 1b, ..., 2a, 2b, ... and "--" for stale dat= a of deleted files, ".." for erased/writable flash blocks) in an SSD might = be:

erase block 1: |1a|1b|--|--|2a|-= -|--|3a|

erase block 2; |--|--|--|2b|--|-= -|--|1c|

erase block 3; |2c|1d|3b|3c|--|-= -|--|--|

erase block 4; |..|..|..|..|..|= =2E.|..|..|

This is just a random example how data could be laid out on the physical= storage array. It is assumed that the 3 erase blocks once were completely = occupied

In this example, 10 of 32 writable blocks are occupied, and only one fre= e erase block exists.

This situation must not persist, since the SSD needs more empty erase bl= ocks. 10/32 of the capacity is used for data, but 3/4 of the blocks are occ= upied and not immediately available for new data.

The garbage collection might combine erase blocks 1 and 3 into a current= ly free one, e.g. erase block 4:

erase block 1; |..|..|..|..|..|..|= =2E.|..|

erase block 2; |--|--|--|2b|--|-= -|--|1c|

erase block 3; |..|..|..|..|..|= =2E.|..|..|

erase block 4: |1a|1b|2a|3a|2c|1= d|3b|3c|

Now only 2/4 of the capacity is not available for new data (which is sti= ll a lot more than 10/32, but better than before).

Now assume file 2 is deleted:

erase block 1; |..|..|..|..|..|= =2E.|..|..|

erase block 2; |--|--|--|--|--|-= -|--|1c|

erase block 3; |..|..|..|..|..|= =2E.|..|..|

erase block 4: |1a|1b|--|3a|--|1= d|3b|3c|

There is now a new sparsely used erase block 4, and it will soon need to= be garbage collected, too - in fact it could be combined with the live dat= a from erase block 2, but this may be delayed until there is demand for mor= e erased blocks (since e.g. file 1 or 3 might also have been deleted by the= n).

The garbage collection does not know which data blocks belong to which f= ile, and therefore it cannot collect the data belonging to a file into a si= ngle erase block. Blocks are allocated as data comes in (as long as enough = SLC cells are available in this area, else directly in QLC cells). Your man= y parallel updates will cause fractions of each larger file to be spread ou= t over many erase blocks.

As you can see, a single file that is deleted may affect many erase bloc= ks, and you have to take redundancy into consideration, which will multiply= the effect by a factor of up to 3 for small files (one ZFS allocation bloc= k). And remember: deleting a message in mdir format will free the data bloc= ks, but will also remove the directory entry, causing additional meta-data = writes (again multiplied by the raid redundancy).


A consumer SSD would normally see only very few parallel writes, and seq= uential writes of full files will have a high chance to put the data of eac= h file contiguously in the minimum number of erase blocks, allowing to free= multiple complete erase blocks when such a file is deleted and thus obviat= ing the need for many garbage collection copies (that occur if data from se= veral independent files is in one erase block).

Actual SSDs have many more cells than advertised. Some 10% to 20% may be= kept as a reserve for aging blocks that e.g. may have failed kind of a "re= ad-after-write test" (implemented in the write function, which adds charges= to the cells until they return the correct read-outs).

BTW: Having an ashift value that is lower than the internal write block = size may also lead to higher write amplification values, but a large ashift= may lead to more wasted capacity, which may become an issue if typical fil= e length are much smaller than the allocation granularity that results from= the ashift value.


Larger mails are less of an issue since they span multiple erase blocks,= which will be completely freed when such a message is deleted.

I see I see Stefan...

Samsung has a lot of experience and generally good strategies to deal wi= th such a situation, but SSDs specified for use in storage systems might be= much better suited for that kind of usage profile.

Yes... and the disks for our pur= pose... perhaps weren't QVOs....

You should have got (much more expensive) server grade SSDs, IMHO.

But even 4 * 2 TB QVO (or better EVO) drives per each 8 TB QVO drive wou= ld result in better performance (but would need a lot of extra SATA ports)= =2E

In fact, I'm not sure whether rotating media and a reasonable L2ARC cons= isting of a fast M.2 SSD plus a mirror of small SSDs for a LOG device would= not be a better match for your use case. Reading the L2ARC would be very f= ast, writes would be purely sequential and relatively slow, you could choos= e a suitable L2ARC strategy (caching of file data vs. meta data), and the L= OG device would support fast fsync() operations required for reliable mail = systems (which confirm data is on stable storage before acknowledging the r= eception to the sender).

We knew they had some speed issues, but those speed issues, we thou= ght (as
Samsung explains in the QVO site) they started after exceedin= g the speeding
buffer this disks have. We though that meanwhile you d= idn't exceed it's
capacity (the capacity of the speeding buffer) no s= peed problem arises. Perhaps
we were wrong?.

These drives are meant for small loads in a typical PC use case,
i.e. some installations of software in the few GB range, else only
= files of a few MB being written, perhaps an import of media files
th= at range from tens to a few hundred MB at a time, but less often
than= once a day.
 
We move, you know... lots of littl= e files... and lot's of different concurrent modifications by 1500-2000 con= current imap connections we have...

I do not expect the read load to be a problem (except possibly when the = SSD is moving data from SLC to QLC blocks, but even then reads will get pri= ority). But writes and trims might very well overwhelm the SSD, especially = when its getting full. Keeping a part of the SSD unused (excluded from the = partitions created) will lead to a large pool of unused blocks. This will r= educe the write amplification - there are many free blocks in the "unpartit= ioned part" of the SSD, and thus there is less urgency to compact partially= filled blocks. (E.g. if you include only 3/4 of the SSD capacity in a part= ition used for the ZPOOL, then 1/4 of each erase block could be free due to= deletions/TRIM without any compactions required to hold all this data.)

Keeping a significant percentage of the SSD unallocated is a good strate= gy to improve its performance and resilience.

Well, we have allocated all the = disk space... but not used... just allocated.... you know... we do a zpool = create with the whole disks.....

I think the only chance for a solution that does not require new hardwar= e is to make sure, only some 80% of the SSDs are used (i.e. allocate only 8= 0% for ZFS, leave 20% unallocated). This will significantly reduce the rate= of garbage collections and thus reduce the load they cause.

I'd use a fast encryption algorithm (zstd - choose a level that does not= overwhelm the CPU, there are benchmark results for ZFS with zstd, and I fo= und zstd-2 to be best for my use case). This will more than make up for the= space you left unallocated on the SSDs.

A different mail box format might help, too - I'm happy with dovecot's m= dbox format, which is as fast but much more efficient than mdir.

As the SSD fills, the space available for the single level write
cac= he gets smaller
 
The single level write cache is th= e cache these ssd drivers have, for compensating the speed issues they have= due to using qlc memory?. Do you refer to that?. Sorry I don't understand = well this paragraph.

Yes, the SSD is specified to hold e.g. 1 TB at 4 bits per cell. The SLC = cache has only 1 bit per cell, thus a 6 GB SLC cache needs as many cells as= 24 GB of data in QLC mode.

Ok, true.... yes....

A 100 GB SLC cache would reduce the capacity of a 1 TB SSD to 700 GB (60= 0 GB in 150 tn QLC cells plus 100 GB in 100 tn SLC cells).

Ahh! you mean that SLC capacity = for speeding up the QLC disks, is obtained from each single layer of the QL= C?.

There are no specific SLC cells. A fraction of the QLC capable cells is = only written with only 1 instead of 4 bits. This is a much simpler process,= since there are only 2 charge levels per cell that are used, while QLC use= s 16 charge levels, and you can only add charge (must not overshoot), there= fore only small increments are added until the correct value can be read ou= t).

But since SLC cells take away specified capacity (which is calculated as= suming all cells hold 4 bits each, not only 1 bit), their number is limited= and shrinks as demand for QLC cells grows.

The advantage of the SLC cache is fast writes, but also that data in it = may have become stale (trimmed) and thus will never be copied over into a Q= LC block. But as the SSD fills and the size of the SLC cache shrinks, this = capability will be mostly lost, and lots of very short lived data is stored= in QLC cells, which will quickly become partially stale and thus needing c= ompaction as explained above.

Therefore, the fraction of the cells used as an SLC cache is reduced whe= n it gets full (e.g. ~1 TB in ~250 tn QLC cells, plus 6 GB in 6 tn SLC cell= s).

Sorry I don't get this last sent= ence... don't understand it because I don't really know the meaning of tn= =2E..

but I think I'm getting the idea= if you say that each QLC layer, has it's own SLC cache obtained from the d= isk space avaiable for each QLC layer....

And with less SLC cells available for short term storage of data the pro= bability of data being copied to QLC cells before the irrelevant messages h= ave been deleted is significantly increased. And that will again lead to ma= ny more blocks with "holes" (deleted messages) in them, which then need to = be copied possibly multiple times to compact them.

If I correct above, I think I go= t the idea yes....

(on many SSDs, I have no nu= mbers for this
particular device), and thus the amount of data that can be
written = at single cell speed shrinks as the SSD gets full.
 

I have just looked up the size of the SLC cache, it is specified to be 78 GB for the empty SSD, 6 GB when it is full (for the 2 TB
= version, smaller models will have a smaller SLC cache).
 
Assuming you were talking about th= e cache for compensating speed we previously commented, I should say these = are the 870 QVO but the 8TB version. So they should have the biggest cache = for compensating the speed issues...

I have looked up the data: the larger versions of the 870 QVO have the s= ame SLC cache configuration as the 2 TB model, 6 GB minimum and up to 72 GB= more if there are enough free blocks.

Ours one is the 8TB model so I a= ssume it could have bigger limits. The disks are mostly empty, really.... s= o... for instance....

zpool list
= NAME     =         SIZE  ALLOC   FRE= E  CKPOINT  EXPANDSZ   FRAG    CAP = DEDUP  HEALTH  ALTROOT
root_dataset  448G  2.29G   446G&n= bsp;       -     &nb= sp;   -     1%     0%&nbs= p; 1.00x  ONLINE  -
mail_dataset  58.2T  11.8T  46.4T &nbs= p;      -       = ;  -    26%    20%  1.00x  ONL= INE  -

Ok, seems you have got 10 * 8 TB in a raidz2 configuration.

Only 20% of the mail dataset is in use, the situation will become much w= orse when the pool will fill up!

I suppose fragmentation affects = too....

On magnetic media fragmentation means that a file is spread out over the= disk in a non-optimal way, causing access latencies due to seeks and rotat= ional delay. That kind of fragmentation is not really relevant for SSDs, wh= ich allow for fast random access to the cells.

And the FRAG value shown by the "zpool list" command is not about fragme= ntation of files at all, it is about the structure of free space. Anyway le= ss relevant for SSDs than for classic hard disk drives.

But after writing those few GB at a speed of some 500 MB/s (i.e.
aft= er 12 to 150 seconds), the drive will need several minutes to
transfe= r those writes to the quad-level cells, and will operate
at a fractio= n of the nominal performance during that time.
(QLC writes max out at= 80 MB/s for the 1 TB model, 160 MB/s for the
2 TB model.)
 
Well we are in the 8TB model. I th= ink I have understood what you wrote in previous paragraph. You said they c= an be fast but not constantly, because later they have to write all that to= their perpetual storage from the cache. And that's slow. Am I wrong?. Even= in the 8TB model you think Stefan?.

The controller in the SSD supports a given number of channels (e.g 4), e= ach of which can access a Flash chip independently of the others. Small SSD= s often have less Flash chips than there are channels (and thus a lower thr= oughput, especially for writes), but the larger models often have more chip= s than channels and thus the performance is capped.

This is totally logical. If a QV= O disk would outperform best or similar than an Intel without consequences= =2E... who was going to buy a expensive Intel enterprise?.<= /p>

The QVO is bandwidth limited due to the SATA data rate of 6 Mbit/s anyway, = and it is optimized for reads (which are not significantly slower than offe= red by the TLC models). This is a viable concept for a consumer PC, but not= for a server.

In the case of the 870 QVO, the controller supports 8 channels, which al= lows it to write 160 MB/s into the QLC cells. The 1 TB model apparently has= only 4 Flash chips and is thus limited to 80 MB/s in that situation, while= the larger versions have 8, 16, or 32 chips. But due to the limited number= of channels, the write rate is limited to 160 MB/s even for the 8 TB model= =2E

Totally logical Stefan...=

If you had 4 * 2 TB instead, the throughput would be 4 * 160 MB/s in thi= s limit.

The main problem we are facing is = that in some peak moments, when the machine serves connections for all the = instances it has, and only as said in some peak moments... like the 09am or= the 11am.... it seems the machine becomes slower... and like if the disks = weren't able to serve all they have to serve.... In these moments, no big f= iles are moved... but as we have 1800-2000 concurrent imap connections... n= ormally they are doing each one... little changes in their mailbox. Do you = think perhaps this disks then are not appropriate for this kind of usage?-<= /strong>

I'd guess that the drives get into a state in which they have to recycle= lots of partially free blocks (i.e. perform kind of a garbage collection) = and then three kinds of operations are competing with each other:

  1. reads (generally prioritized)
  2. writes (filling the SLC cache up to its maximum size)
  3. compactions of partially filled blocks (required to make free blocks av= ailable for re-use)

Writes can only proceed if there are sufficient free blocks, which on a = filled SSD with partially filled erase blocks means that operations of type= 3. need to be performed with priority to not stall all writes.

My assumption is that this is what you are observing under peak load.

It could be although the disks a= re not filled.... the pool are at 20 or 30% of capacity and fragmentation f= rom 20%-30% (as zpool list states).

Yes, and that means that your issues will become much more critical over ti= me when the free space shrinks and garbage collections will be required at = an even faster rate, with the SLC cache becoming less and less effective to= weed out short lived files as an additional factor that will increase writ= e amplification.
And cheap SSDs often have no RAM cache (not checked, but I'd be
surp= rised if the QVO had one) and thus cannot keep bookkeeping date
in su= ch a cache, further limiting the performance under load.
 
This brochure (https://semiconductor.samsung.com/resources/brochu= re/870_Series_Brochure.pdf and the datasheet https://semiconductor.samsung.com/resources/data-sheet/Samsung_S= SD_870_QVO_Data_Sheet_Rev1.1.pdf) sais if I have read properly, the 8TB= drive has 8GB of ram?. I assume that is what they call the turbo write cac= he?.

No, the turbo write cache consists of the cells used in SLC mode (which = can be any cells, not only cells in a specific area of the flash chip).

I see I see....<= /p>

The RAM is needed for fast lookup of the position of data for reads and = of free blocks for writes.

Our ones... seem to have 8GB LPD= DR4 of ram.... as datasheet states....

Yes, and it makes sense that the RAM size is proportional to the capacit= y since a few bytes are required per addressable data block.

If the block size was 8 KB the RAM could hold 8 bytes (e.g. a pointer an= d some status flags) for each logically addressable block. But there is no = information about the actual internal structure of the QVO that I know of= =2E

[...]

I see.... It's extremely mislead= ing you know... because... you can copy five mailboxes of 50GB concurrently= for instance.... and you flood a gigabit interface copying (obviously beca= use disks can keep that throughput)... but later.... you see... you are in = an hour that yesterday, and even 4 days before you have not had any issues= =2E.. and that day... you see the commented issue... even not being exactly= at a peak hour (perhaps is two hours later the peak hour even)... or... bu= t I wasn't noticing about all things you say in this email....

I have seen advice to not use compression in a high load scenario in som= e other reply.

I tend to disagree: Since you seem to be limited when the SLC cache is e= xhausted, you should get better performance if you compress your data. I ha= ve found that zstd-2 works well for me (giving a significant overall reduct= ion of size at reasonable additional CPU load). Since ZFS allows to switch = compressions algorithms at any time, you can experiment with different algo= rithms and levels.

I see... you say compression sho= uld be enabled.... The main reason because we have not enabled it yet, is f= or keeping the system the most near possible to config defaults... you know= =2E.. for later being able to ask in this mailing lists if we have an issue= =2E.. because you know... it would be far more easier to ask about somethin= g strange you are seeing when that strange thing is near to a well tested c= onfig, like the config by default....

But now you say Stefan... if you= switch between compression algorithms you will end up with a mix of differ= ent files compressed in a different manner... that is not a bit disaster la= ter?. Doesn't affect performance in some manner?.

The compression used is stored in the per file information, each file in a = dataset could have been written with a different compression method and lev= el. Blocks are independently compressed - a file level compression may be m= ore effective. Large mail files will contain incompressible attachments (al= ready compressed), but in base64 encoding. This should allow a compression = ratio of ~1,3. Small files will be plain text or HTML, offering much better= compression factors.

One advantage of ZFS compression is that it applies to the ARC, too. And= a compression factor of 2 should easily be achieved when storing mail (not= for .docx, .pdf, .jpg files though). Having more data in the ARC will redu= ce the read pressure on the SSDs and will give them more cycles for garbage= collections (which are performed in the background and required to always = have a sufficient reserve of free flash blocks for writes).

We would use I assume the lz4.= =2E. which is the less "expensive" compression algorithm for the CPU... and= I assume too for avoiding delay accessing data... do you recommend another= one?. Do you always recommend compression then?.

I'd prefer zstd over lz4 since it offers a much higher compression ratio= =2E

Zstd offers higher compression ratios than lz4 at similar or better deco= mpression speed, but may be somewhat slower compressing the data. But in my= opinion this is outweighed by the higher effective amount of data in the A= RC/L2ARC possible with zstd.

For some benchmarks of different compression algorithms available for ZF= S and compared to uncompressed mode see the extensive results published by = Jude Allan:

htt=
ps://docs.google.com/spreadsheets/d/1TvCAIDzFsjuLuea7124q-1UtMd0C9amTgnXm2y=
PtiUQ/edit?usp=3Dsharing

The SQL benchmarks might best resemble your use case - but remember that a =
significant reduction of the amount of data being written to the SSDs might=
 be more important than the highest transaction rate, since your SSDs put a=
 low upper limit on that when highly loaded.

I'd give it a try - and if it reduces your storage requirements by 10% o= nly, then keep 10% of each SSD unused (not assigned to any partition). That= will greatly improve the resilience of your SSDs, reduce the write-amplifi= cation, will allow the SLC cache to stay at its large value, and may make a= large difference to the effective performance under high load.

But when you enable compression= =2E.. only gets compressed the new data modified or entered. Am I wrong?.

Compression is per file system data block (at most 1 MB if you set the bloc= ksize to that value). Each such block is compressed independently of all ot= hers, to not require more than 1 block to be read and decompressed when ran= domly reading a file. If a block does not shrink when compressed (it may co= ntain compressed file data) the block is written to disk as-is (uncompresse= d).


By the way, we have more or less= 1/4 of each disk used (12 TB allocated in a poll stated by zpool list, div= ided between 8 disks of 8TB...)... do you think we could be suffering on wr= ite amplification and so... having a so little disk space used in each disk= ?.

Your use case will cause a lot of garbage collections and this particular h= igh write amplification values.

Regards, STefan

Hey mate, your mail is incredibl= e. It has helped as a lot. Can we invite you a cup of coffee or a beer thro= ugh Paypal or similar?. Can I help you in some manner?.

Thanks, I'm glad to help, and I'd appreciate to hear whether you get you= r setup optimized for the purpose (and how well it holds up when you approa= ch the capacity limits of your drives).

I'm always interested in experience of users with different use cases th= an I have (just being a developer with too much archived mail and media col= lected over a few decades).

Regards, STefan

--=_fe85fe2db536d584a8585a29da09a2df-- From nobody Fri Apr 8 19:02:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 232A51A9CAC3 for ; Fri, 8 Apr 2022 19:02:41 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from us-smtp-delivery-147.mimecast.com (us-smtp-delivery-147.mimecast.com [170.10.133.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KZngh08m0z4SZ1 for ; Fri, 8 Apr 2022 19:02:39 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from PHOTON.sldomain.com (192.30.190.15 [192.30.190.15]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id us-mta-596-cwE7qe9JNXu_L2CsdLb8bw-1; Fri, 08 Apr 2022 15:02:37 -0400 X-MC-Unique: cwE7qe9JNXu_L2CsdLb8bw-1 Received: from isotope.sldomain.com (192.168.200.20) by PHOTON.sldomain.com (192.168.200.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Fri, 8 Apr 2022 13:02:49 -0600 Received: from isotope.sldomain.com ([fe80::5567:5b08:1164:d2ee]) by isotope.sldomain.com ([fe80::5567:5b08:1164:d2ee%6]) with mapi id 15.01.2375.018; Fri, 8 Apr 2022 13:02:49 -0600 From: Dave Baukus To: "freebsd-fs@FreeBSD.org" Subject: ZFS: OoM with very large kmem_cache_create("abd_chunk", ...) USED count Thread-Topic: OoM with very large kmem_cache_create("abd_chunk", ...) USED count Thread-Index: AQHYS3s9955Y1OcClUCaYNYlRHPN0g== Date: Fri, 8 Apr 2022 19:02:49 +0000 Message-ID: <0b29483d-114f-c48c-343d-b25e6374290d@spectralogic.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: spectralogic.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_0b29483d114fc48c343db25e6374290dspectralogiccom_" X-Rspamd-Queue-Id: 4KZngh08m0z4SZ1 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of daveb@spectralogic.com designates 170.10.133.147 as permitted sender) smtp.mailfrom=daveb@spectralogic.com X-Spamd-Result: default: False [-2.22 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[spectralogic.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; RWL_MAILSPIKE_EXCELLENT(0.00)[170.10.133.147:from]; NEURAL_HAM_SHORT(-0.92)[-0.920]; MIME_BASE64_TEXT(0.10)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.147:from] X-ThisMailContainsUnwantedMimeParts: N --_000_0b29483d114fc48c343db25e6374290dspectralogiccom_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 T24gRnJlZUJTRF9zdGFibGUxMyBJJ20gc2VlaW5nIG11bHRpcGxlIE9vTSBjcmFzaCBkdW1wcyB3 aXRoIHZlcnkgbGFyZ2UgYWRiX2NodW5rDQp1c2VkIGNvdW50IGFzIHJlcG9ydGVkIGJ5IHZtc3Rh dCAteiAtTSA8Y3Jhc2ggZHVtcD4gLU4gPGtlcm4+Og0KDQpGb3IgZXhhbXBsZSBvbiBhIHN5c3Rl bSB3aXRoIDEyOEcgbWVtb3J5Og0Kdm1zdGF0IC16IC1NIDxjcmFzaCBkdW1wPiAtTiA8a2Vybj5t IHJlcG9ydHM6DQoNCklURU0gICAgICAgICAgICAgICAgICAgU0laRSAgTElNSVQgICAgIFVTRUQg ICAgIEZSRUUgICAgICBSRVEgICAgIEZBSUxTTEVFUCBYRE9NQUlODQouLi4NCmFiZF9jaHVuazog ICAgICAgICAgICAgNDA5NiwgICAgICAwLDIyOTY3ODE3LCAgICA1NjU3LDc3Mzc2MjMwMDUsICAg MCwgICAwLDMzNDUzNDg0NTQNCi4uLg0KDQpNZWFud2hpbGUgQVJDIHN0YXRzIGFyZSByZWFzb25h YmxlOg0KYXJjX3N0YXRzLmFyY3N0YXRfc2l6ZTogIDY4OTU1ODQyMjI0DQphcmNfc3RhdHMuYXJj c3RhdF9jOiAgICAgNjgxMDc2MjI5OTINCmFyY19zdGF0cy5hcmNzdGF0X2NfbWF4OiA2ODY0Mzkw MzQ4OA0KDQpCdXQsIGFkYnN0YXRfc3RydWN0X3NpemUgaXMgaW1wb3NzaWJseSBsYXJnZToNCg0K ICBhYmRzdGF0X3N0cnVjdF9zaXplID0gew0KICAgIG5hbWUgPSAic3RydWN0X3NpemUiLCAnXDAw MCcgPHJlcGVhdHMgMjQzIHRpbWVzPiwNCiAgICBkYXRhX3R5cGUgPSA0ICdcMDA0JywNCiAgICB2 YWx1ZSA9IHsNCiAgICAgIHVpNjQgPSAyMDcxNjI5NDE1NTIsDQogICAgICBsID0gMjA3MTYyOTQx NTUyLA0KICAgICAgdWwgPSAyMDcxNjI5NDE1NTIsDQogICAgfQ0KICB9LA0KICBhYmRzdGF0X3Nj YXR0ZXJfY250ID0gew0KICAgIG5hbWUgPSAic2NhdHRlcl9jbnQiLCAnXDAwMCcgPHJlcGVhdHMg MjQzIHRpbWVzPiwNCiAgICBkYXRhX3R5cGUgPSA0ICdcMDA0JywNCiAgICB2YWx1ZSA9IHsNCiAg ICAgIHVpNjQgPSA3Njc4NiwNCiAgICAgIGwgPSA3Njc4NiwNCiAgICB9DQogIH0sDQogIGFiZHN0 YXRfc2NhdHRlcl9kYXRhX3NpemUgPSB7DQogICAgbmFtZSA9ICJzY2F0dGVyX2RhdGFfc2l6ZSIs ICdcMDAwJyA8cmVwZWF0cyAyMzcgdGltZXM+LA0KICAgIGRhdGFfdHlwZSA9IDQgJ1wwMDQnLA0K ICAgIHZhbHVlID0gew0KICAgICAgdWk2NCA9IDY1NzM0NDEwNzUyLA0KICAgICAgbCA9IDY1NzM0 NDEwNzUyLA0KICAgIH0NCiAgfSwNCiAgYWJkc3RhdF9zY2F0dGVyX2NodW5rX3dhc3RlID0gew0K ICAgIG5hbWUgPSAic2NhdHRlcl9jaHVua193YXN0ZSIsICdcMDAwJyA8cmVwZWF0cyAyMzUgdGlt ZXM+LA0KICAgIGRhdGFfdHlwZSA9IDQgJ1wwMDQnLA0KICAgIHZhbHVlID0gew0KICAgICAgdWk2 NCA9IDQ4MjgxNiwNCiAgICAgIGwgPSA0ODI4MTYsDQogICAgfQ0KICB9LA0KICBhYmRzdGF0X2xp bmVhcl9jbnQgPSB7DQogICAgbmFtZSA9ICJsaW5lYXJfY250IiwgJ1wwMDAnIDxyZXBlYXRzIDI0 NCB0aW1lcz4sDQogICAgZGF0YV90eXBlID0gNCAnXDAwNCcsDQogICAgdmFsdWUgPSB7DQogICAg ICBsID0gOTgyMiwNCiAgICAgIHVsID0gOTgyMiwNCiAgICB9DQogIH0sDQogIGFiZHN0YXRfbGlu ZWFyX2RhdGFfc2l6ZSA9IHsNCiAgICBuYW1lID0gImxpbmVhcl9kYXRhX3NpemUiLCAnXDAwMCcg PHJlcGVhdHMgMjM4IHRpbWVzPiwNCiAgICBkYXRhX3R5cGUgPSA0ICdcMDA0JywNCiAgICB2YWx1 ZSA9IHsNCiAgICAgIHVpNjQgPSAzNDk3MzY5NiwNCiAgICAgIGwgPSAzNDk3MzY5NiwNCiAgICB9 DQogIH0NCg0KPT09PT09PT09DQoNCmFueW9uZSBzZWVuIGFueXRoaW5nIHNpbWlsYXIgPw0KLS0N Cg0KRGF2ZSBCYXVrdXMNCg0K --_000_0b29483d114fc48c343db25e6374290dspectralogiccom_ Content-Type: text/html; charset=UTF-8 Content-ID: Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5Pg0KPGZvbnQgZmFjZT0i bW9ub3NwYWNlIj5PbiBGcmVlQlNEX3N0YWJsZTEzIEknbSBzZWVpbmcgbXVsdGlwbGUgT29NIGNy YXNoIGR1bXBzIHdpdGggdmVyeSBsYXJnZSBhZGJfY2h1bms8YnI+DQp1c2VkIGNvdW50IGFzIHJl cG9ydGVkIGJ5IHZtc3RhdCAteiAtTSAmbHQ7Y3Jhc2ggZHVtcCZndDsgLU4gJmx0O2tlcm4mZ3Q7 Ojxicj4NCjxicj4NCkZvciBleGFtcGxlIG9uIGEgc3lzdGVtIHdpdGggMTI4RyBtZW1vcnk6PGJy Pg0KPC9mb250Pjxmb250IGZhY2U9Im1vbm9zcGFjZSI+PGZvbnQgZmFjZT0ibW9ub3NwYWNlIj52 bXN0YXQgLXogLU0gJmx0O2NyYXNoIGR1bXAmZ3Q7IC1OICZsdDtrZXJuJmd0O20gcmVwb3J0czo8 YnI+DQo8YnI+DQo8L2ZvbnQ+SVRFTSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyBTSVpFJm5ic3A7IExJTUlUJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IFVTRUQmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgRlJFRSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyBSRVEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgRkFJTFNMRUVQIFhET01BSU48YnI+ DQouLi48YnI+DQphYmRfY2h1bms6Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDQwOTYsJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IDAsMjI5Njc4MTcsJm5ic3A7Jm5ic3A7Jm5ic3A7IDU2NTcsNzczNzYy MzAwNSwmbmJzcDsmbmJzcDsgMCwmbmJzcDsmbmJzcDsgMCwzMzQ1MzQ4NDU0PGJyPg0KLi4uPGJy Pg0KPGJyPg0KTWVhbndoaWxlIEFSQyBzdGF0cyBhcmUgcmVhc29uYWJsZTo8YnI+DQphcmNfc3Rh dHMuYXJjc3RhdF9zaXplOiZuYnNwOyA2ODk1NTg0MjIyNDxicj4NCmFyY19zdGF0cy5hcmNzdGF0 X2M6Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDY4MTA3NjIyOTkyPGJyPg0KYXJjX3N0YXRzLmFy Y3N0YXRfY19tYXg6IDY4NjQzOTAzNDg4PGJyPg0KPGJyPg0KQnV0LCBhZGJzdGF0X3N0cnVjdF9z aXplIGlzIGltcG9zc2libHkgbGFyZ2U6PGJyPg0KPGJyPg0KJm5ic3A7IGFiZHN0YXRfc3RydWN0 X3NpemUgPSB7PGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7IG5hbWUgPSAmcXVvdDtzdHJ1Y3Rfc2l6 ZSZxdW90OywgJ1wwMDAnICZsdDtyZXBlYXRzIDI0MyB0aW1lcyZndDssPGJyPg0KJm5ic3A7Jm5i c3A7Jm5ic3A7IGRhdGFfdHlwZSA9IDQgJ1wwMDQnLDxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyB2 YWx1ZSA9IHs8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgdWk2NCA9IDIwNzE2 Mjk0MTU1Miw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgbCA9IDIwNzE2Mjk0 MTU1Miw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgdWwgPSAyMDcxNjI5NDE1 NTIsPGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7IH08YnI+DQombmJzcDsgfSw8YnI+DQombmJzcDsg YWJkc3RhdF9zY2F0dGVyX2NudCA9IHs8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgbmFtZSA9ICZx dW90O3NjYXR0ZXJfY250JnF1b3Q7LCAnXDAwMCcgJmx0O3JlcGVhdHMgMjQzIHRpbWVzJmd0Oyw8 YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgZGF0YV90eXBlID0gNCAnXDAwNCcsPGJyPg0KJm5ic3A7 Jm5ic3A7Jm5ic3A7IHZhbHVlID0gezxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyB1aTY0ID0gNzY3ODYsPGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGwgPSA3 Njc4Niw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgfTxicj4NCiZuYnNwOyB9LDxicj4NCiZuYnNw OyBhYmRzdGF0X3NjYXR0ZXJfZGF0YV9zaXplID0gezxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyBu YW1lID0gJnF1b3Q7c2NhdHRlcl9kYXRhX3NpemUmcXVvdDssICdcMDAwJyAmbHQ7cmVwZWF0cyAy MzcgdGltZXMmZ3Q7LDxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyBkYXRhX3R5cGUgPSA0ICdcMDA0 Jyw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgdmFsdWUgPSB7PGJyPg0KJm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7IHVpNjQgPSA2NTczNDQxMDc1Miw8YnI+DQombmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsgbCA9IDY1NzM0NDEwNzUyLDxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyB9 PGJyPg0KJm5ic3A7IH0sPGJyPg0KJm5ic3A7IGFiZHN0YXRfc2NhdHRlcl9jaHVua193YXN0ZSA9 IHs8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgbmFtZSA9ICZxdW90O3NjYXR0ZXJfY2h1bmtfd2Fz dGUmcXVvdDssICdcMDAwJyAmbHQ7cmVwZWF0cyAyMzUgdGltZXMmZ3Q7LDxicj4NCiZuYnNwOyZu YnNwOyZuYnNwOyBkYXRhX3R5cGUgPSA0ICdcMDA0Jyw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsg dmFsdWUgPSB7PGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IHVpNjQgPSA0ODI4 MTYsPGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGwgPSA0ODI4MTYsPGJyPg0K Jm5ic3A7Jm5ic3A7Jm5ic3A7IH08YnI+DQombmJzcDsgfSw8YnI+DQombmJzcDsgYWJkc3RhdF9s aW5lYXJfY250ID0gezxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyBuYW1lID0gJnF1b3Q7bGluZWFy X2NudCZxdW90OywgJ1wwMDAnICZsdDtyZXBlYXRzIDI0NCB0aW1lcyZndDssPGJyPg0KJm5ic3A7 Jm5ic3A7Jm5ic3A7IGRhdGFfdHlwZSA9IDQgJ1wwMDQnLDxicj4NCiZuYnNwOyZuYnNwOyZuYnNw OyB2YWx1ZSA9IHs8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgbCA9IDk4MjIs PGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IHVsID0gOTgyMiw8YnI+DQombmJz cDsmbmJzcDsmbmJzcDsgfTxicj4NCiZuYnNwOyB9LDxicj4NCiZuYnNwOyBhYmRzdGF0X2xpbmVh cl9kYXRhX3NpemUgPSB7PGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7IG5hbWUgPSAmcXVvdDtsaW5l YXJfZGF0YV9zaXplJnF1b3Q7LCAnXDAwMCcgJmx0O3JlcGVhdHMgMjM4IHRpbWVzJmd0Oyw8YnI+ DQombmJzcDsmbmJzcDsmbmJzcDsgZGF0YV90eXBlID0gNCAnXDAwNCcsPGJyPg0KJm5ic3A7Jm5i c3A7Jm5ic3A7IHZhbHVlID0gezxicj4NCiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyB1 aTY0ID0gMzQ5NzM2OTYsPGJyPg0KJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGwgPSAz NDk3MzY5Niw8YnI+DQombmJzcDsmbmJzcDsmbmJzcDsgfTxicj4NCiZuYnNwOyB9PGJyPg0KPGJy Pg0KPT09PT09PT09PGJyPg0KPGJyPg0KYW55b25lIHNlZW4gYW55dGhpbmcgc2ltaWxhciA/PGJy Pg0KPC9mb250Pi0tDQo8cHJlIGNsYXNzPSJtb3otc2lnbmF0dXJlIiBjb2xzPSIxMDAwMCI+RGF2 ZSBCYXVrdXMNCjwvcHJlPg0KPC9ib2R5Pg0KPC9odG1sPg0K --_000_0b29483d114fc48c343db25e6374290dspectralogiccom_-- From nobody Sat Apr 9 08:33:57 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C76AB1A80E32; Sat, 9 Apr 2022 08:34:05 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kb7gw5wCBz4jpD; Sat, 9 Apr 2022 08:34:04 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2398XvjJ033282; Sat, 9 Apr 2022 09:33:57 +0100 (BST) (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2398XvGX033279; Sat, 9 Apr 2022 09:33:57 +0100 (BST) (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Sat, 9 Apr 2022 09:33:57 +0100 (BST) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: grarpamp cc: freebsd-hackers@freebsd.org, freebsd-fs@freebsd.org, freebsd-performance@freebsd.org, freebsd-questions@freebsd.org Subject: Re: List Mail Formatting Netiquette [ie: 870 QVO] In-Reply-To: Message-ID: References: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4Kb7gw5wCBz4jpD X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of andy@time-domain.co.uk designates 62.3.122.138 as permitted sender) smtp.mailfrom=andy@time-domain.co.uk X-Spamd-Result: default: False [-1.32 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[andy]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:62.3.122.136/29]; NEURAL_HAM_LONG(-0.89)[-0.890]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[time-domain.co.uk]; NEURAL_SPAM_MEDIUM(0.81)[0.813]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.95)[-0.946]; MLMMJ_DEST(0.00)[freebsd-hackers,freebsd-fs,freebsd-performance,freebsd-questions]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Thu, 7 Apr 2022, grarpamp wrote: > On 4/7/22, egoitz@ramattack.net wrote: >> I answer below in bold blue for instance... >> for better seeing my answers.... > > While you may think that helps people, in reality it does > not, and it actually makes peoples mails much worse for the > proper text based email using world, and sits among other > random formats that randoms try to stuff down other peoples > mailboxes, and they might not even show up in search engines, > archives, onscreen, phones, etc. Read up on classic proper > email formatting netiquette where, for very good reasons, > it tells everyone to... turn off HTML mail, and to quit top > posting and quit bulk quoting, and to trim what you're > replying to down to only the relevant minimum context while > writing your replies underneath that, and to delete addressees > already present within list addresses, and to quit SHOUTING > ALL CAPS, and to wrap non-code lines at around 68 chars, > and to not break header threading (in-reply-to and references) > when replying. This reminder actually for all lists and senders. Hear, hear! Well said: I mainly work for a largely Windows-centric organisation who has outsourced its email to the Microsoft Office 365 cloud-based services. I'm rather fed up with getting emails from colleagues and having query "what's underlined in blue?", "where's this text you've highlighted in red?", etc since I use Alpine as my MUA. Andy ---------------------------- Andy Thomas, Time Domain Systems Tel: +44 (0)7866 556626 http://www.time-domain.co.uk From nobody Sat Apr 9 11:47:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CD2A81A8358E; Sat, 9 Apr 2022 11:47:57 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:300:2185:123::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4KbCzd01Dgz3nH4; Sat, 9 Apr 2022 11:47:56 +0000 (UTC) (envelope-from jamie@catflap.org) X-Catflap-Envelope-From: X-Catflap-Envelope-To: freebsd-fs@FreeBSD.org Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [104.207.135.49]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 239BloSI006666; Sat, 9 Apr 2022 12:47:50 +0100 (BST) (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 239BlncJ006665; Sat, 9 Apr 2022 12:47:49 +0100 (BST) (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202204091147.239BlncJ006665@donotpassgo.dyslexicfish.net> Date: Sat, 09 Apr 2022 12:47:49 +0100 Organization: Dyslexic Fish To: grarpamp@gmail.com, freebsd-hackers@FreeBSD.org Cc: freebsd-questions@FreeBSD.org, freebsd-performance@FreeBSD.org, freebsd-fs@FreeBSD.org Subject: Re: List Mail Formatting Netiquette [ie: 870 QVO] References: In-Reply-To: User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [104.207.135.49]); Sat, 09 Apr 2022 12:47:50 +0100 (BST) X-Rspamd-Queue-Id: 4KbCzd01Dgz3nH4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=catflap.org; spf=pass (mx1.freebsd.org: domain of jamie@catflap.org designates 2001:19f0:300:2185:123::1 as permitted sender) smtp.mailfrom=jamie@catflap.org X-Spamd-Result: default: False [-3.53 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FREEFALL_USER(0.00)[jamie]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:dyslexicfish.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.83)[-0.834]; DMARC_POLICY_ALLOW(-0.50)[catflap.org,none]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance,freebsd-questions]; FREEMAIL_TO(0.00)[gmail.com,FreeBSD.org]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20473, ipnet:2001:19f0::/38, country:US]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N grarpamp wrote: > Use the clean habit mailiquette rules to make reading > the world better for everyone :) Whilst I agree entirely, the issue has been raised before, and nothing happens. The sort of posting styles that used to get people kicked off lists are ignored. No-one cares any more. P.S. I gave up trying to decypher the "replies in blue" messages - the whole thing is in white-on-black on this terminal! P.P.S. We're probably both guilty of crossposting, but as I said, no-one cares! P.P.P.S. Maybe I should just have replied, quoting your whole message with just "me too" added to the top :-) Cheers, Jamie From nobody Sun Apr 10 21:00:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 265F51A94675 for ; Sun, 10 Apr 2022 21:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kc4C76cbbz3hpY for ; Sun, 10 Apr 2022 21:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3F937157DF for ; Sun, 10 Apr 2022 21:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23AL0pbY019778 for ; Sun, 10 Apr 2022 21:00:51 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23AL0plX019777 for fs@FreeBSD.org; Sun, 10 Apr 2022 21:00:51 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202204102100.23AL0plX019777@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 10 Apr 2022 21:00:51 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16496244512.BD02dA.17147" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649624452; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=/xC72hRIrrJe8Rg5r05Gy+GrG4U9mvJNPdZzZox5F5M=; b=xIDHWp7Iol+F+gDaz9J68rmWqJXuwvXlX5Vh4nBbc4QkvPKtNXmdpsHvU0+ZIjPq1o3STF Ql8gaMDvEc5UmU37zrtkVUgNrrEqRlE3Ms6OBTr5rxXxKMavYiYQudtBO89wUdQsQod8Td keIznEN2yGnppdyamQuSOKDlThvCNWrCUA8aXvKG14NV0cLihZp082LiPbmRklwQn4LIOa thg5ef/4oqPV9KRK0ioOjqzwsAS4nPAsYaA81iFuw1RmcG6GvSMOQy0XwQxymDJUuNyzvc kmEkB9lzmXCt9YREUCokUwoy2j7KeoSarRHjQty11+R03pzT5+QJynwrsnfshw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649624452; a=rsa-sha256; cv=none; b=tznYCYVdGs9uagkTgH+QxI3jhl29Q2BEh7W+FTg7csXURecgwdulf/TWjKnsV3NBclV13t KXLKjg1RYZdSKmLtHVkabZDAI0pwbXLwwXZej1XNs5zikC6Pdij+TnKSeLOpUl6Ln5BJnx S3QjfZ2+dWEw8/z9Kpe9XSko73cY0uLXWmZCuSQXKtplrFpJA5TNDanZlsIHhSW/d85cat IQRyDyPMWP8rVswhxFEjeogtz90WPaVkDfuoVivWGumkZdz79D1cYUUU9N6gly/2F0g/xy j4P3Y1OpUvuBIXGo9CK2XsfrO2HKdnpFYRDF8fy/+psqqXuns8T0lo/eBFrCPw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16496244512.BD02dA.17147 Date: Sun, 10 Apr 2022 21:00:51 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16496244512.BD02dA.17147 Date: Sun, 10 Apr 2022 21:00:51 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16496244512.BD02dA.17147-- From nobody Tue Apr 12 10:49:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A8C211A84DC1 for ; Tue, 12 Apr 2022 10:49:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kd2YD3h04z4TRN for ; Tue, 12 Apr 2022 10:49:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1F88515B54 for ; Tue, 12 Apr 2022 10:49:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23CAnqZG026355 for ; Tue, 12 Apr 2022 10:49:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23CAnqx4026354 for fs@FreeBSD.org; Tue, 12 Apr 2022 10:49:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 237637] ZFS kernel panic after removing a vdev Date: Tue, 12 Apr 2022 10:49:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: thalunil@kallisti.at X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649760593; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=T8IQUpWXFMlgTlVgdCKI76UTF/UAD1qK4AgmNVUpTWU=; b=RMzmIw4+2VDFc4Tr1w77sUu/9eBFq0zqpCt2Qgv3vGCNa26YB3JB9LGQCHDzn9rXYbx5ku MQ26JVhYYcB/85aehH7t0d1Zq/zya0vMabZJ2xDC4WE7UW69Za4p+TDvsOg02Vm0Zn8Hit 7yMS1SJtpx5+7d1NAMFsmu+RfaJ6xYxoQWsaKV68+VpaG4zIhsgvld15XnC2/3bzDA+SWh nnvb9HrAQ2h+G7ZmkpJqoaw75uA0iSso/IOvIDxoMPHacydC75/9cxQtIXkUEUDUBC+YKF 6W+DJWoP7SP+WCCE23aF4f0AicBeSVSRK0dM3vPFvxMQi54xk258dj78L/McCA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649760593; a=rsa-sha256; cv=none; b=MD9bsMKJC8J9WFya1d3gX8TDOOv6M7rqneIAZyRxrrUDrpx0KDZdAoAIHjEyGsvUnXFmwv T7bJqs/slltrdVCMD6VOXRfaxLqBu6xPGVXkqS7rTsP8rcWxa2+TZ1r+ux4YwOzdEUUG75 Qb8zXQ17GFnujPABcTzKw4iZwJJkaMdHc61dP9Q6jS6IAr4xXjh3G3ymot09UkJqeC6CqO yRJIIeD3tKiwiyFnVhdp+bmfd7bYAh1C3VEgTJt/s2olXs+0HTD+fCpRZrP9UTIiJtK2ix 7WhmDldpLZWdatHBspcR2Sa4DP2qL0Y+wP4V/UllXd/nML5dpm4770EXpdpIcw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237637 Alex Bihlmaier changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Overcome By Events --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Apr 13 17:04:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 878991B311D5 for ; Wed, 13 Apr 2022 17:04:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kdppc18ypz5081 for ; Wed, 13 Apr 2022 17:04:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CED9A7E2B for ; Wed, 13 Apr 2022 17:04:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23DH478f078302 for ; Wed, 13 Apr 2022 17:04:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23DH470U078301 for fs@FreeBSD.org; Wed, 13 Apr 2022 17:04:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259607] prometheus_sysctl_exporter: Need better encoding support for sysctl OIDs Date: Wed, 13 Apr 2022 17:04:06 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: delphij@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649869448; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dUnw0OmM7hHBgOotU7maTDFODTY1JQ/i7Lsg7hcY/lY=; b=VdsWqicjmNGQdhFmmG+h1N/tj0SyCbx5jnUXGhItJ5p16zqDvPNLtDzMF4cp7Ehl2NPbMN HxOShwxt3+w5vgO6nGLgFW2e9Zh45EG77vdyoLtPRzA03xf7rM84K3WGSINqnbS7BFmFAp V1hm7tWqKbIzdsQHoo1XB2qoTYNLMUqK9/swd2S5ZlylH7iou89xy7DgN3IRtW0jPBa15b iW4ZSxXg6qCJMukqu4q6rA2q6u6YyqNsPqCbOxacdVunv0ASqqfWLtljlQGfhJI73V7FD1 lvtvI9Uz5Njm5uYxQ6HkoRWlrbQ8Evz1tTsjU+Hln3o5tMtxhKutH+OvvUMCbA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649869448; a=rsa-sha256; cv=none; b=RmfgK4J7leJ+AaQ6zNBQOcyT5FLR9BwEaM6zHw/AlOjbgeDt7SzDwuXUX2U2QGe5Tjc4j1 er5lNbB3Ke5IHJaXIWEBAkShiWENnx9hOrYoWOV1D2E59k1LfkL7IC4m3b7CAWuGW9Ubdy Jgu0nsKthAHw2sGeE3t8t62aV4/ugkPRvy/2HvUZmlPbLMHCvlpxLkcVIuyMlbGnsz3VGa xjzZ+kG2GDk4glqOYCYEr51BWlM4sqRWdF9y/n1n+zD5D4cypSAbeaPbR07iWJvQLju3np TBiVyK0LW6foGY13dOYC+RytzqQ9ZCs8OTodQWWAa+KrAwJdiYZ8t1z7Q3UtRA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259607 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |devinrsmith@protonmail.com --- Comment #3 from Alan Somers --- *** Bug 253862 has been marked as a duplicate of this bug. *** --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed Apr 13 21:04:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 234061B4C9B8 for ; Wed, 13 Apr 2022 21:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kdw7d2r5sz4QxZ for ; Wed, 13 Apr 2022 21:04:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0F32B135BF for ; Wed, 13 Apr 2022 21:04:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23DL4C3D006753 for ; Wed, 13 Apr 2022 21:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23DL4CdT006752 for fs@FreeBSD.org; Wed, 13 Apr 2022 21:04:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256511] UFS assertion failure when shutting down from single-user mode Date: Wed, 13 Apr 2022 21:04:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649883853; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1Vl32rWgfdNUX9awlNLNd6qGJYOIXDnrO6+Z4hYV2fM=; b=XLIvcV7HwRs5EnVDeIzsWwgAjvaFPfFaNifWkrvTub/zXiXJOd+V7YSlVDsiIdqq0NnFi+ i45UzZc5F5ss2muCyIyTNrUI1Hnrs7PSRbKGyiakzPmRvCdWtIk3YpEFkXMzpIVqme3uoI hPSPK9t+Rjvfdrx3B8wu2od1PNeaVb/Psmz9TBzCXI27I72BeMBpQwT7e7JUXgMJkaENmI 0x77WV/7ZBh1AlEIpjuBmNzFRgabgs3iElSkCIZSSCgYx/cT7iEaKTw3p4N7kJuSc4Z2Q2 x9Us/HyExllPlWKQTZlv+8CVE3RicEE2vgI2+35HMP9wlYD7c6kShlY9S2j0CQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649883853; a=rsa-sha256; cv=none; b=WeU3/gC/FfCcQCSW3rMeLEBfNVFt7H4QfbI5RkP1yp87jrvG0MAI1CevJveEWhCE7A4dRv I4g3soZ7ws9F1l89aoiah4uliCdtgqb//KUaFqK9jm8YTaJB4FHvWBkTfpe/HEppz112vG gluHYhIhPa+CGY/qKTiPIjRedEdYF9zRFBz7fBlKs2SIhbs4x2Oc9LI70FHUvRY6xRXeeE 3ttJblPVzyJ8GIunF+hgbU1p1/Lk/+/wnY5w4PMRlNrB1AWraQ/WvsXazKpPTSuYG5HHk5 CX9E7euQXQVuFgdb9A/dmPb6KIHCYwB7kgO6xBqg84sT7rYskI9z0cxpo0E9cg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256511 --- Comment #8 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dd7d8cc9891507ec3d2dcd9334be2afade= 1ed9d0b commit d7d8cc9891507ec3d2dcd9334be2afade1ed9d0b Author: Robert Wing AuthorDate: 2022-03-07 19:18:03 +0000 Commit: Robert Wing CommitDate: 2022-04-13 20:59:12 +0000 ffs_mount(): return early if namei() fails to lookup disk device With soft updates enabled, an INVARIANTS panic is hit in ffs_unmount(). The problem occurs in ffs_mount() when upgrading a mount from ro->rw. During a mount update, the soft update code gets set up but doesn't get cleaned up if namei() fails when looking up the disk device. Avoid this scenario by looking up the disk device first and bail early if the namei() lookup fails. PR: 256511 Reviewed by: mckusick, kib Differential Revision: https://reviews.freebsd.org/D30870 (cherry picked from commit 0455cc7104ec8e8dd54b3f44049112a5a8ca329c) sys/ufs/ffs/ffs_vfsops.c | 148 +++++++++++++++++++++++--------------------= ---- 1 file changed, 72 insertions(+), 76 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Apr 13 21:05:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 041D61B4D47F for ; Wed, 13 Apr 2022 21:05:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kdw8z4Hlpz4RcF for ; Wed, 13 Apr 2022 21:05:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6FE32138FB for ; Wed, 13 Apr 2022 21:05:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23DL5NMm006983 for ; Wed, 13 Apr 2022 21:05:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23DL5Nno006982 for fs@FreeBSD.org; Wed, 13 Apr 2022 21:05:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256511] UFS assertion failure when shutting down from single-user mode Date: Wed, 13 Apr 2022 21:05:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rew@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649883923; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/8u5qN4R1nHyAqe9qkr5IFFGVMRjlh1OEGZai3284Ho=; b=g13Tj15ulg+cO7fknjqN8Srd6eTX8lAWlEjj6u77AceVnZLHc1BVJLuonRS1shuHJVjebT f9OyzDqhw9wga/E6r48vxJm0vkM9JDkeovVdkouk4KuGI4rdE/+mLKZOYwzcKgYpoyTTnP W0ekSZaPXLVozBGd9F7PaB5BFVQh3yf9dXSJATIeniCFxnRtaOIqNYgJfi/7EhXwXqUR/s wDrqD1i3kAwF1PXrDp4n5/JakuT6yL5H3lRUaWASZ+Yeky8mKtbIbpQBKXwm+7fcVZNPCv cH0KVlY5qnrePhAr+pqRV7mF30R0kUcRw9/8J3t3Eadbbu2sDNEu1HmDYTxAow== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649883923; a=rsa-sha256; cv=none; b=pvHDuZIfwHmM480JJ9GWnNxgs1KOWqnoLpxl4huaw1hG6M8PXD0C/0Mhx9GFSYBlcaWrBS VRZTl3iax0LUGRRMtIUSdM045ItsB8inaDkw1jEF4QiVIdDm15Gx0hy4WfzL1PynHcvWKY C7TadKUV3awNgG/v5wc4qSq7NBpjQrNbuCeIfUgqw+TXMe6Luj2UjLUBRzBUZXYgoJUIlp WmYJvlEncVji4HOuZGKastb+r22mtULJ4GVuUXrcXgSphROAQbSpysSkRAa+3ZWu8BEjic z8i9xWN2y1QRc7M6OAJoVdWrexIMftcjkvds2Z1M5KnDoKSz/oTzpo3908B33Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256511 Robert Wing changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Apr 14 10:06:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5DDA21B3E7F2 for ; Thu, 14 Apr 2022 10:06:55 +0000 (UTC) (envelope-from zedupsys@gmail.com) Received: from mail-lf1-x132.google.com (mail-lf1-x132.google.com [IPv6:2a00:1450:4864:20::132]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KfFVk1y1Dz3jMs for ; Thu, 14 Apr 2022 10:06:54 +0000 (UTC) (envelope-from zedupsys@gmail.com) Received: by mail-lf1-x132.google.com with SMTP id p10so8164914lfa.12 for ; Thu, 14 Apr 2022 03:06:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=reply-to:to:cc:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=17ErmlYZWm67AosXkFx8xcbRBU0XQ89bgQt2HvSAZRI=; b=PY+rBUWiysG75qkvBPelC186iHD/2AwVFQFJel1nCGdPylliIen7dAMM661ta4mY2g h9E7EAc0BIt1A2i4nQHVBxDMpvwxJxR0i0thF6GYgGvp52zxSR3bm7JoJV4JM3oP7NB1 sa5HyFmfXHUfOC5kHrKpjyr0RRdjOmrVN4jfoet226cs9oRe6ou99qO2gEUI+6qS6n9z Zl76sbMxOnXCN7VOQs8FDWRMsAyjkp9p9nNelku1w+fdTNCLRtrjW1oLhafjRQJ0YVea 6n5UVpJm1gNphTDbMmZ9wKj7oXwYMtxeraOtlbKOHjWPuxJl5VMgMMXJZfRdIMNao38Q EqVw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:reply-to:to:cc:from:subject:message-id:date :user-agent:mime-version:content-language:content-transfer-encoding; bh=17ErmlYZWm67AosXkFx8xcbRBU0XQ89bgQt2HvSAZRI=; b=iwQjSsCZnkATjwpt7BV58Me8NZxw2boG/RUr50jMyXsXf+2aGnIOSsRIMlOaYz2i6G i7mSbruTK5pLCtS2bnrY4tW9hddDiThecgSe4Y7pM0A7pewAdAAI6/CctFaoPejrXYgR zgpENLWh+nwnQHG89EJE/qqPjnCpEG7BFTrG79lrXPLUg5BuC3mfoo7xTOcVe69tT9q+ TIUuo6cuAKFvXQ6f1I+Ap4XUy+85zkd0OndFdabqcU7I7JRmSR6q3qJtm7J/WfG37x7P K8eG6WHByzWcWeOQNvd8tGeh8Tp9VTSpfb6PyE/v/jpWtvNZsvTmlzMXrnL7PolKwrZM ETYA== X-Gm-Message-State: AOAM530QuNk6tiu+yg5JDH1/IR0XNWTClO59lj/NdUKMCGvTNtWkSNIp Nb156Rdyr0F4OJcOoFQ5x6mhmRsDN2Y= X-Google-Smtp-Source: ABdhPJwUfsD17emEklh0pZdr751q5MhjQzoDt0piKRWjmDgPaCgEStnp9vdQssJwwke7nooyFHjUag== X-Received: by 2002:ac2:4c51:0:b0:44a:34b8:fd72 with SMTP id o17-20020ac24c51000000b0044a34b8fd72mr1433208lfk.360.1649930812791; Thu, 14 Apr 2022 03:06:52 -0700 (PDT) Received: from [10.3.0.1] ([213.110.65.3]) by smtp.googlemail.com with ESMTPSA id f3-20020a056512322300b0046bbce218f2sm190184lfe.79.2022.04.14.03.06.51 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 14 Apr 2022 03:06:52 -0700 (PDT) Reply-To: zedupsys@gmail.com To: freebsd-fs@freebsd.org Cc: roger.pau@citrix.com From: Ze Dupsys Subject: ZFS, kernel panic due to unconditional NULL de-reference for (v)db Message-ID: <741ca49e-9ebd-be92-1389-4ab2227e6cb7@gmail.com> Date: Thu, 14 Apr 2022 13:06:50 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.12.0 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4KfFVk1y1Dz3jMs X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=PY+rBUWi; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of zedupsys@gmail.com designates 2a00:1450:4864:20::132 as permitted sender) smtp.mailfrom=zedupsys@gmail.com X-Spamd-Result: default: False [-2.58 / 15.00]; HAS_REPLYTO(0.00)[zedupsys@gmail.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.96)[-0.959]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.38)[0.377]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::132:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello everyone, In RELEASE-13.0 source, /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:4456, dbuf_write_children_ready(zio_t *zio, arc_buf_t *buf, void *vdb) .. dmu_buf_impl_t *db = vdb; .. ASSERT3U(db->db_level, >, 0); .. for (i = 0, bp = db->db.db_data; i < 1ULL << epbs; i++, bp++) { If vdb == NULL, this function panics. And this is what kgdb backtrace shows. #9 0xffffffff821dc99d in dbuf_write_children_ready (zio=, buf=, vdb=0x0) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:4642 We do not know the internals of ZFS and kgdb backtrace is somewhat imprecise, thus the question is, in which scenarios call to dbuf_write_children_ready could have vdb pointer set to NULL? Any hints, ideas? FWIW, more often than not this happens when machine is powered down, so maybe some data structure is "half-freed". The call into ZFS code happens through (*dev_data->csw->d_strategy)(bios[bio_idx]), at the moment we suspect that there might be something wrong with data provided to d_strategy, but have no clue what could cause vdb to be NULL in the code above. Panic info below. Thanks. Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 06 fault virtual address = 0x68 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff821dc99d stack pointer = 0x28:0xfffffe00c6b497d0 frame pointer = 0x28:0xfffffe00c6b49870 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (xbbd26 taskq) trap number = 12 panic: page fault cpuid = 3 time = 1649915274 KDB: stack backtrace: #0 0xffffffff80c57385 at kdb_backtrace+0x65 #1 0xffffffff80c09d61 at vpanic+0x181 #2 0xffffffff80c09bd3 at panic+0x43 #3 0xffffffff8108b187 at trap+0xbc7 #4 0xffffffff8108b1df at trap+0xc1f #5 0xffffffff8108a83d at trap+0x27d #6 0xffffffff81061818 at calltrap+0x8 #7 0xffffffff821c035a at dmu_read+0x2a #8 0xffffffff8218da3a at zvol_geom_bio_strategy+0x2aa #9 0xffffffff80a7f074 at xbd_instance_create+0xa3d4 #10 0xffffffff80a7b00a at xbd_instance_create+0x636a #11 0xffffffff80c6b021 at taskqueue_run+0x2a1 #12 0xffffffff80c6c33c at taskqueue_thread_loop+0xac #13 0xffffffff80bc7c9e at fork_exit+0x7e #14 0xffffffff8106289e at fork_trampoline+0xe cat panic.log| sed -Ee 's/^#[0-9]* //' -e 's/ .*//' | xargs addr2line -e /usr/lib/debug/boot/kernel/kernel.debug /usr/src/sys/kern/subr_bus.c:2410 /usr/src/sys/kern/kern_racct.c:632 /usr/src/sys/kern/kern_racct.c:617 /usr/src/sys/dev/isci/isci_sysctl.c:92 /usr/src/sys/dev/isci/isci_sysctl.c:0 /usr/src/sys/dev/isci/isci_oem_parameters.c:130 /usr/src/sys/dev/hyperv/input/hv_kbd.c:540 ??:0 ??:0 /usr/src/sys/dev/xen/blkback/blkback.c:3083 /usr/src/sys/xen/xenbus/xenbusvar.h:96 /usr/src/sys/kern/subr_kobj.c:145 /usr/src/sys/kern/subr_module.c:255 /usr/src/sys/kern/kern_event.c:0 /usr/src/sys/dev/hyperv/pcib/vmbus_pcib.c:1158 (kgdb) backtrace #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c09956 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:486 #3 0xffffffff80c09dd0 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:919 #4 0xffffffff80c09bd3 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:843 #5 0xffffffff8108b187 in trap_fatal (frame=0xfffffe00c6b49710, eva=104) at /usr/src/sys/amd64/amd64/trap.c:915 #6 0xffffffff8108b1df in trap_pfault (frame=frame@entry=0xfffffe00c6b49710, usermode=false, signo=, signo@entry=0x0, ucode=, ucode@entry=0x0) at /usr/src/sys/amd64/amd64/trap.c:732 #7 0xffffffff8108a83d in trap (frame=0xfffffe00c6b49710) at /usr/src/sys/amd64/amd64/trap.c:398 #8 #9 0xffffffff821dc99d in dbuf_write_children_ready (zio=, buf=, vdb=0x0) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:4642 #10 0xffffffff821c035a in arc_evict_impl (state=, spa=, bytes=, type=) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:4377 #11 arc_evict_meta_balanced (meta_used=) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:4443 #12 arc_evict_meta (meta_used=) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:4533 #13 arc_evict () at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:4627 #14 arc_evict_cb (arg=, zthr=) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:4938 #15 0xffffffff8218da3a in zfs_deleteextattr (ap=0x1430f6000) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:5592 #16 0xffffffff80a7f074 in xbb_dispatch_dev (xbb=0xfffff8011a6ff800, reqlist=, operation=, bio_flags=0) at /usr/src/sys/dev/xen/blkback/blkback.c:2207 #17 0xffffffff80a7b00a in xbb_dispatch_io (xbb=0xfffff8011a6ff800, reqlist=) at /usr/src/sys/dev/xen/blkback/blkback.c:1767 #18 xbb_run_queue (context=0xfffff8011a6ff800, pending=) at /usr/src/sys/dev/xen/blkback/blkback.c:1987 #19 0xffffffff80c6b021 in taskqueue_run_locked (queue=queue@entry=0xfffff8011a9f1e00) at /usr/src/sys/kern/subr_taskqueue.c:476 #20 0xffffffff80c6c33c in taskqueue_thread_loop (arg=, arg@entry=0xfffff8011a6ff800) at /usr/src/sys/kern/subr_taskqueue.c:793 #21 0xffffffff80bc7c9e in fork_exit (callout=0xffffffff80c6c290 , arg=0xfffff8011a6ff800, frame=0xfffffe00c6b49c00) at /usr/src/sys/kern/kern_fork.c:1069 #22 From nobody Fri Apr 15 00:21:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 88E631B3020E for ; Fri, 15 Apr 2022 00:21:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KfcSZ2kZ8z4QwQ for ; Fri, 15 Apr 2022 00:21:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3F16227E6 for ; Fri, 15 Apr 2022 00:21:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23F0LIxE081927 for ; Fri, 15 Apr 2022 00:21:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23F0LIL7081926 for fs@FreeBSD.org; Fri, 15 Apr 2022 00:21:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 212168] [panic] [UFS] use-after-free panic (0xdeadc0dedeadc0de) Date: Fri, 15 Apr 2022 00:21:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RC1 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1649982078; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OEeEnrBs5PlLmmCrP2ZTDplm3+918STlGWjapow08DY=; b=teCx51t9WYPVuWrNudBerlmrPJyOYBA13sJM7a46ytRuVXJiuG/Ntk1+Tpp0GucCXgtImj aGOM5bSINqP5ytsHkF7Aophv/IuMamW6E9MX/gZmolJVB6P3NEHItY2UxQaPHhMX+5yYHd 4qloEH0H3ikbXAOpaV9rL0YHGecT369eRED/q7f7AEhBCx+imeG7BcbBINB3kfbht6BW/P TnNRzxWk5itVsKazVXJdjDHKLqiJyRSQO2RH2DWHKXcwQlkjhACoI9P0myQ9VqyCfDhgw/ 1eBGhmqZ3n4Sdl7nV5ajGpXSpkchtX5AqN0PYM2L2c56sn57PcwKFPKK6UEbDQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1649982078; a=rsa-sha256; cv=none; b=FkgVNswnIL8A5zSzxStsEdwQ9GmvZ7v2SFz25Z4ipZlKKBx0qw+5jeXMwRTpfmIEpph9rL yeXltJXQ98u6FNvkkepLYPkk7B7Zi6x9O8i/WYArxNuQFF6iv3OGavlFwsdROmrHxvyAQK 7wMNQcQUYnBlAi4PLv8Vhg3GJBWuYB1HT8IHMyO2D6YZNGSCkEeEHHbI5sNTmm9tQYE+1F H6q3DPn8jLjoWmGSpOr3jUAOW1WA0s2P5qCt52TPqTOpGE9WXcNyysVZjqdt2r29p29ZyX OKIgDB02nLSfYem2J+2keMkYXznl42hGCudi7t17Aaw8wJ0IZ6L1sMZ1aMuC+A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212168 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --- Comment #21 from Kirk McKusick --- This problem affects only arm64 and was fixed as described in comment 14. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Apr 16 17:35:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 045675D31DC; Sat, 16 Apr 2022 17:35:20 +0000 (UTC) (envelope-from sodynet1@gmail.com) Received: from mail-qk1-x72f.google.com (mail-qk1-x72f.google.com [IPv6:2607:f8b0:4864:20::72f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KggMC0F8nz4glq; Sat, 16 Apr 2022 17:35:19 +0000 (UTC) (envelope-from sodynet1@gmail.com) Received: by mail-qk1-x72f.google.com with SMTP id e10so8654836qka.6; Sat, 16 Apr 2022 10:35:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=HP5PasgGQbzzrashq1dEqKENbn43mG5cgWA0aDrFJvo=; b=eNObM+EqTfUbvxxCgT3UtYDRILEbjTf42NH6zWNu+XnjydOXgrwzKa/LN8F0U7nSD2 ozg1/AaFwzfyYudE1GLsIl+MS0fTycd39DKXdMFHAK9U9lo5B0ETEaEYW+FyjzNG+qn2 wRkMlYsE1LDHXOH3KDhAZASmybKeybvJ9aE7NeGuqyby63yoiyqHcCCyjCpWGwVlt6Ow Y51R3w4917ULNtc/BlRqCrinXJ2gFigBb8JCUEizUWDx3yYrBbOPDqn98bZCDYoNapP1 mbF2zwDZiv8xcwAT4a0LTibbE2nnRLjRVzoEhIeHEl8ar1U5Wz2bKZIMgGk1YIOYBpkg 2/dg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=HP5PasgGQbzzrashq1dEqKENbn43mG5cgWA0aDrFJvo=; b=1Elc5+vhuifCIhSTW6mlVN67floUk2A3TColiRkEcfjKqrmM+uFKYi9+xdp8LqnObC Z+pV3fG/5+4lQmFj+hD5KF3xK3sa5RPp5SwczRFPOUkFHVUZ0zjK0urLbxR3Z9S6EIsc pEkvgW2b9SPDLUbgfifWC79iCdHAyvcZYmbaR1bp8Q46Q8Rn0uE9GElVjKCx0J3cY4Fh DPhnlqloZnnMgwBum39ZWYJDAVFlwauojyDjtc8Iu/f6ZuWC+OVQgp7rB+gunaIJjguZ JXjbJTIyEWtjPUchvA+d+49+8p/T14Uzhekib7lwteNOZ9xRgXes5LaoVwlfo59WPVyd nxHg== X-Gm-Message-State: AOAM533DT43WwoJbIhiAPCOQpgCYRJmu5EKpTP/bVxmYdnWZ2q4Zydxd /Hv2gGObj1Wp45OnAGokLhYM2kjetAdRMgrIdS8= X-Google-Smtp-Source: ABdhPJxNJfRPaHbgrCvCd0HGhLq3MOw7pzHIuvO7H4oYXIMMGjgBL51fJnHBMavGcnUqXcldoZ6m1Sb63o4Rb23OaI0= X-Received: by 2002:a05:620a:2586:b0:680:f3c1:9d4a with SMTP id x6-20020a05620a258600b00680f3c19d4amr2496105qko.619.1650130511303; Sat, 16 Apr 2022 10:35:11 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <202204161625.23GGPn6j049380@fire.js.berklix.net> In-Reply-To: <202204161625.23GGPn6j049380@fire.js.berklix.net> From: Sami Halabi Date: Sat, 16 Apr 2022 20:35:00 +0300 Message-ID: Subject: Re: recover deleted file To: "Julian H. Stacey" , freebsd-fs@freebsd.org Cc: FreeBSD Current , mckusick@mckusick.com Content-Type: multipart/alternative; boundary="000000000000f5978305dcc8f272" X-Rspamd-Queue-Id: 4KggMC0F8nz4glq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=eNObM+Eq; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of sodynet1@gmail.com designates 2607:f8b0:4864:20::72f as permitted sender) smtp.mailfrom=sodynet1@gmail.com X-Spamd-Result: default: False [-2.15 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_MEDIUM(0.85)[0.845]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72f:from]; NEURAL_HAM_SHORT(-0.99)[-0.994]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-current]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000f5978305dcc8f272 Content-Type: text/plain; charset="UTF-8" Hi, thanks for your response. Would someone from the foundation step in and put it in GSOC ideas? kirk@ - would it be possible for you to do it ? :) Sami On Sat, Apr 16, 2022 at 7:26 PM Julian H. Stacey wrote: > > okay... > > all seems very time consuming operations!! > > Yes > > > There should be an os "undelete" as happens in NTFS for example.. which > is > > very fast and can be done also with extra tools without a hassle. > > A WIBNI (Wouldnt It Be Nice If) for Unix FS's for as long as I can remember > (decades) but no one's ever done it. > > Ways to get it done: > Get it listed as a Google Summer Of Code project for FreeBSD, Or > > Get your employer to help pay for it, eg chip in with other BSD > user companies to pay some money to FreeBSD Foundation, & get > them to pay for it to be developed. > > Or hire are an individual freelance BSD Consultant to do it, > There's a global index here http://berklix.com/consultants/ > > & a mail list that's moderated jobs@freebsd > > Some author(s) of BSD FFS are on list fs@, Kirk is one name springs > to mind ? Some freelancers on fs@ I recall. > > IMO Would be a fun job if funded :-) > > > > > for now I got backup from last day .. caused me a lot of troubles, not > say > > legal ones, but I passed the point to hold the machine down. > > > > any advice? > > > > Maybe UFS developer would do a rework so latest deleted inodes would put > in > > a "recycle bin" (maybe with a sysctl or whatever) for say one day (or any > > other configurable sysctl) and allow to recover quickly or "force delete > / > > empty recycle bin" , rather than delete and give back space immediately > for > > use and destroy possibility to restore. > > > > my 2 cents. > > > > Sami > > Cheers, > -- > Julian Stacey http://berklix.com/jhs/ http://StolenVotes.UK > Kill / remove Putin to stop him killing & provoking world war. > -- Sami Halabi Information Systems Engineer NMS Projects Expert, FreeBSD SysAdmin Expert Asterisk Expert --000000000000f5978305dcc8f272 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,
thanks for your response.

Would someone from the foundation step in and put it in GSOC ideas?
<= div>
kirk@ - would it be possible for you to do it ? :)
=

Sami


On Sat, Apr 16, 2022 at 7:26 P= M Julian H. Stacey <jhs@berklix.com> wrote:
&g= t; okay...
> all seems very time consuming operations!!

Yes

> There should be an os "undelete" as happens in NTFS for exam= ple.. which is
> very fast and can be done also with extra tools without a hassle.

A WIBNI (Wouldnt It Be Nice If) for Unix FS's for as long as I can reme= mber
(decades) but no one's ever done it.

Ways to get it done:
=C2=A0 Get it listed as a Google Summer Of Code project for FreeBSD, Or

=C2=A0 Get your employer to help pay for it, eg chip in with other BSD
=C2=A0 user companies to pay some money to FreeBSD Foundation, & get =C2=A0 them to pay for it to be developed.

=C2=A0 Or hire are an individual freelance BSD Consultant to do it,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 There's a global index here http://be= rklix.com/consultants/

=C2=A0 & a mail list that's moderated jobs@freebsd

=C2=A0 Some author(s) of BSD FFS are on list fs@, Kirk is one name springs<= br> =C2=A0 to mind ? Some freelancers on fs@ I recall.

=C2=A0 IMO Would be a fun job if funded :-)

>
> for now I got backup from last day .. caused me a lot of troubles, not= say
> legal ones, but I passed the point to hold the machine down.
>
> any advice?
>
> Maybe UFS developer would do a rework so latest deleted inodes would p= ut in
> a "recycle bin" (maybe with a sysctl or whatever) for say on= e day (or any
> other configurable sysctl) and allow to recover quickly or "force= delete /
> empty recycle bin" , rather than delete and give back space immed= iately for
> use and destroy possibility to restore.
>
> my 2 cents.
>
> Sami

Cheers,
--
Julian Stacey=C2=A0 http://berklix.com/jhs/ http://StolenVotes.UK=C2=A0 <= br> Kill / remove Putin to stop him killing & provoking world war.


--
Sami Hala= bi
Information Systems Engineer
NMS Projects Expert,=C2=A0FreeBSD SysAdmin Expert
Aste= risk Expert
--000000000000f5978305dcc8f272-- From nobody Sat Apr 16 17:40:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B79E85D576E; Sat, 16 Apr 2022 17:41:11 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KggTz4jVwz4jsQ; Sat, 16 Apr 2022 17:41:11 +0000 (UTC) (envelope-from kevans@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650130871; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=XsCroXMuIiJZlntanAJGYBKpRDzhh0TGHnbcy7sIVXk=; b=Vd+rZJ5HmDy0zKvNk9MlsIs3wcNuRRjhlZatY/hqtOXsa4+g+VqB2ZwlQ4X5EAU2OFubDW cdhixDlZF/FOwGbubqUMKNBhhXgVG+8kKR1mDuQ8eKS2nVtzwuU2lIGiddAriuNwfkbQBk xAA05z30hadyQZBRiVVOst/XoCVm2ivXfq6ynQe/Cv2T0qzotD8dnsBfP9vcyKnxYVa7+A Rmp2ncoh57tgXnTr1h94/EXzc0k1u6IDBFU70AM4Dx4Ay+9/B+vnQznm0TW/xYYZSRIuuF kvhDj/uFpKQ+/4mLcAwhvkwIMdTV0s9ksce2+JZUQ5UfnpCdDl2RLj6MSmKM4A== Received: from mail-lf1-f51.google.com (mail-lf1-f51.google.com [209.85.167.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 7C27C5152; Sat, 16 Apr 2022 17:41:11 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-lf1-f51.google.com with SMTP id u19so18489582lff.4; Sat, 16 Apr 2022 10:41:11 -0700 (PDT) X-Gm-Message-State: AOAM5318J1CwuVqYezxIK/ywSmGAuq6VQFG2WBdhdu98c1fzKwUn0QUC da0b09loeDySToAQ8QWFm70G9XY9ymcrlKMA8ao= X-Google-Smtp-Source: ABdhPJw4h4aRK5P+vgpLgLODNpyuGR1vob7Rvw1C8LcfLsGVYOqA6vmaOHMCfXLW4B+NiziF7g0GA83wQC49KQlOL9I= X-Received: by 2002:a19:7b17:0:b0:46e:cb82:fe24 with SMTP id w23-20020a197b17000000b0046ecb82fe24mr2934276lfc.194.1650130869930; Sat, 16 Apr 2022 10:41:09 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <202204161625.23GGPn6j049380@fire.js.berklix.net> In-Reply-To: From: Kyle Evans Date: Sat, 16 Apr 2022 12:40:58 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: recover deleted file To: Sami Halabi Cc: "Julian H. Stacey" , freebsd-fs , FreeBSD Current , Kirk McKusick Content-Type: text/plain; charset="UTF-8" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650130871; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=XsCroXMuIiJZlntanAJGYBKpRDzhh0TGHnbcy7sIVXk=; b=a5NtZba45eDyk3fsefuqgIt28a2rwH2SSdBqNVzGSUJaKTbfAvWqEDN3Wmoy44Sg0kdVOP CYrYmTqwrzrRLDVJE4xmCzNfJ1pCHpdLM7xToyTYC/B6WGx8HVZoDYOU1ShWwAnNBNG3MT /CDDJGhnxHpks8nUo8fFPNvALCre4lOx+Ojr1X050KxK8PftCS1MEH852o92Qkjd61r+5L XVozASUBBWStwzeZS60E3Ef+pG1aYZ2CAuZTlfEW3ZUyyAks9p44G5Xs4to78LLXPjtyFI vB4MdsPWKKCHm3qdQvuxcxhkHwWXyUT+Ym7Luqzq1r5b9ljNBCZOxtCt+kQDtQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650130871; a=rsa-sha256; cv=none; b=fE7Lfq84ht5SbC4a56Uakc6QAVlBdotiO4McihYfrsghxbY0W/7y20OvELrjNVhGPqER7X OxQRLz3pzEbd+YHFktVj1K0tnxlRN20PATMqSPFRUkSxUlu8rPOHSxTnvEEHjhc4TKPF33 8oUVJDjpKzKewAP9H/XrRsG0Eg0e+TLEafetz9kxvttw6w3crR1uR5Aizypcub6liBO7Ap S3bkA9HUUcXhbAb4TySdT5YbY13JgZvXVKPBR5SdB2lUwaJoVc8a37iUFuy/Tz1Ev62zGh HQHwRd/aj9aZcJey0FeJzxFaLgPwURzngrC9i7ii1SNFGBHTZaVUONi1NEjGEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On Sat, Apr 16, 2022 at 12:36 PM Sami Halabi wrote: > > Hi, > thanks for your response. > > Would someone from the foundation step in and put it in GSOC ideas? > > kirk@ - would it be possible for you to do it ? :) > Anyone with wiki access is able to add ideas, any student eligible for GSoC is able to propose ideas (regardless of whether we've pitched the ideas on our wiki or not). Thanks, Kyle Evans > > On Sat, Apr 16, 2022 at 7:26 PM Julian H. Stacey wrote: >> >> > okay... >> > all seems very time consuming operations!! >> >> Yes >> >> > There should be an os "undelete" as happens in NTFS for example.. which is >> > very fast and can be done also with extra tools without a hassle. >> >> A WIBNI (Wouldnt It Be Nice If) for Unix FS's for as long as I can remember >> (decades) but no one's ever done it. >> >> Ways to get it done: >> Get it listed as a Google Summer Of Code project for FreeBSD, Or >> >> Get your employer to help pay for it, eg chip in with other BSD >> user companies to pay some money to FreeBSD Foundation, & get >> them to pay for it to be developed. >> >> Or hire are an individual freelance BSD Consultant to do it, >> There's a global index here http://berklix.com/consultants/ >> >> & a mail list that's moderated jobs@freebsd >> >> Some author(s) of BSD FFS are on list fs@, Kirk is one name springs >> to mind ? Some freelancers on fs@ I recall. >> >> IMO Would be a fun job if funded :-) >> >> > >> > for now I got backup from last day .. caused me a lot of troubles, not say >> > legal ones, but I passed the point to hold the machine down. >> > >> > any advice? >> > >> > Maybe UFS developer would do a rework so latest deleted inodes would put in >> > a "recycle bin" (maybe with a sysctl or whatever) for say one day (or any >> > other configurable sysctl) and allow to recover quickly or "force delete / >> > empty recycle bin" , rather than delete and give back space immediately for >> > use and destroy possibility to restore. >> > >> > my 2 cents. >> > >> > Sami >> >> Cheers, >> -- >> Julian Stacey http://berklix.com/jhs/ http://StolenVotes.UK >> Kill / remove Putin to stop him killing & provoking world war. > > > > -- > Sami Halabi > Information Systems Engineer > NMS Projects Expert, FreeBSD SysAdmin Expert > Asterisk Expert From nobody Sun Apr 17 00:29:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1E92DCFFD34; Sun, 17 Apr 2022 00:30:04 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:300:2185:123::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4KgrYl2vXQz4Ynv; Sun, 17 Apr 2022 00:30:03 +0000 (UTC) (envelope-from jamie@catflap.org) X-Catflap-Envelope-From: X-Catflap-Envelope-To: freebsd-current@FreeBSD.org Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [104.207.135.49]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 23H0TtdR047310; Sun, 17 Apr 2022 01:29:55 +0100 (BST) (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 23H0Tsr4047309; Sun, 17 Apr 2022 01:29:54 +0100 (BST) (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202204170029.23H0Tsr4047309@donotpassgo.dyslexicfish.net> Date: Sun, 17 Apr 2022 01:29:54 +0100 Organization: Dyslexic Fish To: sodynet1@gmail.com, jhs@berklix.com, freebsd-fs@FreeBSD.org Cc: mckusick@mckusick.com, freebsd-current@FreeBSD.org Subject: Re: recover deleted file References: <202204161625.23GGPn6j049380@fire.js.berklix.net> In-Reply-To: User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [104.207.135.49]); Sun, 17 Apr 2022 01:29:55 +0100 (BST) X-Rspamd-Queue-Id: 4KgrYl2vXQz4Ynv X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=catflap.org; spf=pass (mx1.freebsd.org: domain of jamie@catflap.org designates 2001:19f0:300:2185:123::1 as permitted sender) smtp.mailfrom=jamie@catflap.org X-Spamd-Result: default: False [-1.51 / 15.00]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[jamie]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:dyslexicfish.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_FIVE(0.00)[5]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.81)[-0.805]; DMARC_POLICY_ALLOW(-0.50)[catflap.org,none]; MLMMJ_DEST(0.00)[freebsd-current,freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,berklix.com,FreeBSD.org]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20473, ipnet:2001:19f0::/38, country:US]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Sami Halabi wrote: > Hi, > thanks for your response. > > Would someone from the foundation step in and put it in GSOC ideas? > > kirk@ - would it be possible for you to do it ? :) > How would you handle file modifications? Backup every original too, or just deal with literal deletions? If you are just concerned with user accidental deletions, you can easily modify your view of "rm" to point to something that instead stores the file somewhere safe.. Jamie From nobody Sun Apr 17 02:08:28 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 95AFE5D485C for ; Sun, 17 Apr 2022 02:08:31 +0000 (UTC) (envelope-from verm@darkbeer.org) Received: from mx.coeval.ca (mx.coeval.ca [184.75.211.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KgtlM0Wszz4m8Y for ; Sun, 17 Apr 2022 02:08:31 +0000 (UTC) (envelope-from verm@darkbeer.org) Received: from mx.darkbeer.org (unknown [192.168.211.20]) by mx.coeval.ca (Postfix) with ESMTP id E01D743605C for ; Sun, 17 Apr 2022 02:08:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=darkbeer.org; s=mail; t=1650161308; bh=F4yR3OmGIoBn8Yh3klpZpr/InPT7AVTbU7D/YmIjdVY=; h=Date:From:To:Subject; b=gTLFz9r9x+OHFsi+tWVSqLuHWRCmUPDxCywTyog852PQySQfcqXdi+DjZIpJnv2mW ysC9svTYGxgjry/vk3r96gV15COrznGlZLoszr9TRlAPkg7mrzp3Pef3YTSP93HGFU h/7KfGbGLr6tNBQEWuLMol9nwssby+jkXSP2v1u4= Received: by mx.darkbeer.org (Postfix, from userid 1001) id D92FA470B40; Sun, 17 Apr 2022 02:08:28 +0000 (UTC) Date: Sun, 17 Apr 2022 02:08:28 +0000 From: Amar Takhar To: freebsd-fs@FreeBSD.org Subject: Intel Ader Lake i9 12900KF UFS corruption / kernel panics. Message-ID: <20220417020828.GB84240@darkbeer.org> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4KgtlM0Wszz4m8Y X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=darkbeer.org header.s=mail header.b=gTLFz9r9; dmarc=none; spf=pass (mx1.freebsd.org: domain of verm@darkbeer.org designates 184.75.211.21 as permitted sender) smtp.mailfrom=verm@darkbeer.org X-Spamd-Result: default: False [-1.50 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[darkbeer.org:s=mail]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:184.75.211.21:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[darkbeer.org]; DKIM_TRACE(0.00)[darkbeer.org:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:32489, ipnet:184.75.211.0/24, country:CA]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N I'll try to be as concise as possible. There is a bug report here with someone that has the exact same issue. Disabling the E cores fixes the problem. See #261169 Something that may be of note I could not install using UEFI I had to enable CSM in the BIOS in order to get 13.2 to install. Otherwise I got a blank screen with a solid white cursor in the upper left and a movable mouse pointer. This is using a GTX 3060. The 'KF' models of CPUs have the internal GPU deactivated. 12.3 gave me a screen with garbled text I did not try with CSM enabled. The symptoms are slightly different than in the bug report. While I did get random checksum errors I also got quite a few kernel panics. In the primary terminal I would get UFS hash errors as well. Some of the kernel panics were in softdep_deallocate_dependencies: dangling deps and ffs_blkfree_cg: freeing free block. I didn't think to offload the crashdumps as I was randomly testing and didn't expect disabling the E cores to work so I quickly reinstalled. I'm not sure where to go from here I couldn't find much on the issue. I did catch quite a few about the garbled text / blank screen on install but only that bug report about UFS corruption. I was unable to grab any of the crashdumps as I would always end up with some kind of panic until later I figured out disabling the E cores fixes the issue. If I enabled them I could collect some if required it's very easy to trigger. Thank you. Amar. From nobody Sun Apr 17 21:00:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 01BAF7EADC1 for ; Sun, 17 Apr 2022 21:00:46 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KhMsl59n6z3KvY for ; Sun, 17 Apr 2022 21:00:43 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B870625368 for ; Sun, 17 Apr 2022 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23HL0gdZ020210 for ; Sun, 17 Apr 2022 21:00:42 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23HL0gg6020209 for fs@FreeBSD.org; Sun, 17 Apr 2022 21:00:42 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202204172100.23HL0gg6020209@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 17 Apr 2022 21:00:42 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16502292428.632fDC.17539" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650229244; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=N5QsaWMM/63tPEShWPVTxPcq+5pkeOOt80KNs6clJUM=; b=xkxU4KMI5YpJPCqLQXZ8JZgVVCTnCr86AM4dFFWqgG/gdaG6Ttyd8usRHh3N+6+kLCj10k p+tHP7BYwFoU+PLJUFYVfIL1lgUR638Xse9tWWK1KIc/mkMH1Xp+zGUaltnuOs+066L9mg VUsaMWDDagEVApgJfg+FLiJUiGECQJ3bwpFVCZ7b/bXq39LiRuVRbmlCvNrEaDyyKb32xT gh9ZYghAeSJsv1NG/A8s+Rrb3M+5l4VJEtCsy92SwcreM7Kb6OwFYsXET1ENtjk7Dmt8r1 jFZKWhSJzphryYHdjG2H4JM6hF0ooA5+Fy+y3uOsZJOkeGuTasw6LyNG1TFJdA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650229244; a=rsa-sha256; cv=none; b=rX02SsCffqr4gRSj/7s2+7Rh+hYwhctJP4SsuVGwCsawnNBL7H0hfOj6GWnk2UoAjMIAkR pi1Y+Q90TRf5xRQusLNR743M4ONYBNTnKN/Xm04emfM9W80R6+K83ZRzZHfjWvLoRJ72Ai 3yM8TMCvtH8iiCxOIHuBwEp9z+FdvybqLtHSNxt4SsmYf+lo5RNywvtqZjJcuuPXUW2Rvk vtgZPlBZnd1q8HXTOC6yaWnVSJ0oKArF2C7DnW7vl0dXWXe73ZFvLixjI5ZGHAKm2fsJiZ QmrayxcHF/kgqvBsE8gMCJWx9CB/BHrqHRQnn0X89loX9mm19KlGrcjdS0+izQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16502292428.632fDC.17539 Date: Sun, 17 Apr 2022 21:00:42 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16502292428.632fDC.17539 Date: Sun, 17 Apr 2022 21:00:42 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16502292428.632fDC.17539-- From nobody Tue Apr 19 12:57:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0293311D4874 for ; Tue, 19 Apr 2022 12:57:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KjP3K5z2Zz4ZMm for ; Tue, 19 Apr 2022 12:57:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AD917275C4 for ; Tue, 19 Apr 2022 12:57:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23JCvXol036927 for ; Tue, 19 Apr 2022 12:57:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23JCvXBC036926 for fs@FreeBSD.org; Tue, 19 Apr 2022 12:57:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259607] prometheus_sysctl_exporter: Need better encoding support for sysctl OIDs Date: Tue, 19 Apr 2022 12:57:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: delphij@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650373053; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kJd1Br4MhuaWH905l4v2zT3mOcM2pjQjjxxyqAheGs8=; b=YpqaKqPyO4Eme07nQr7kynT0BIpZWZPFvn8hg39MoHNE/l54SrbHi0847B/W73Vpl9/hYm 9Jip2j1PR/+GkWEPrWTbwGcQA3MzafuA9CujACgo9q/cZXfma2S25/3391j+JTUtf2D4LE 2gTKm60ktTOf6ToudmrbSjxfA7bUye4hnceaspqt2YyXKiP8WWOCgBWBqRIffFLOQ17N0H u+/FMqNaXEXBcFb/wDvaxE8z31zMY/tiZBpoac4O1oITQ9XTjKDKHos0T8kzzjw3rXZgDX Reay+E4vSy1IMQIA1XgFN/3ZhWgmW0440bhz+3/qXv4Byz2wE/OFpTDUE7iebQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650373053; a=rsa-sha256; cv=none; b=XuLz1yT2Xmtq46S+/UX4PVQ33UAhZNtXY0BaN/c89u/NVUZl24ddr/28ui8fTLCqiNwuQg bBjrvusJ0LlRt+U8ru58eG3Yh7AGdLeVA9VTX7MKeA4jaaZMx5dRScyq1gOfMxjofXMzYa tlbyZ004gp9jHXXND4V3vO2nEe31GP9OToOdcVc+FGgHRzh7WHhaweHTSKRNvr4VdV+VRG RBKUS0gnzdGvcjxYvUkPRhZEw2cZOVIWajOPCaqzZpZGzccLkPoIVS3k/e+QyyjmpLoatf hsCpY6Sf9pjM2b1IPv9OGA74NdQOpNORqYjD4q6Q185PopXjM37WEYe8RatROA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259607 --- Comment #4 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D8c47d8f53854825d8e8591ccd06e32b2c= 798f81c commit 8c47d8f53854825d8e8591ccd06e32b2c798f81c Author: Alan Somers AuthorDate: 2022-04-18 21:29:37 +0000 Commit: Alan Somers CommitDate: 2022-04-19 12:56:39 +0000 prometheus_sysctl_exporter: fix metric aliasing When exporting sysctls to Prometheus, the exporter replaces "." with "_". This caused several metrics to alias, confusing the Prometheus server. Fix it by: * Renaming the "tcp_log_bucket" UMA zone to "tcp_log_id_bucket". Also, rename "tcp_log_node" to "tcp_log_id_node" for consistency. * Not exporting sysctls with "(LEGACY)" in the description. That is used by ZFS sysctls that have been replaced by others, many of which alias to the same Prometheus metric name (like "vfs.zfs.arc_max" and "vfs.zfs.arc.max"). PR: 259607 Reported by: delphij MFC after: 2 weeks Sponsored by: Axcient Reviewed by: delphij,rew,thj Differential Revision: https://reviews.freebsd.org/D34952 sys/netinet/tcp_log_buf.c | 33 +++++++++++-------= ---- .../prometheus_sysctl_exporter.c | 11 ++++++-- 2 files changed, 26 insertions(+), 18 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Apr 21 17:00:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C79FA198813F for ; Thu, 21 Apr 2022 17:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KkkLh2bWWz3vwb for ; Thu, 21 Apr 2022 17:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3511E46C5 for ; Thu, 21 Apr 2022 17:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23LH0STd043794 for ; Thu, 21 Apr 2022 17:00:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23LH0SfI043793 for fs@FreeBSD.org; Thu, 21 Apr 2022 17:00:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 226141] "zpool remove" causes panic: solaris assert: zio->io_type == ZIO_TYPE_WRITE (0x3 == 0x2) Date: Thu, 21 Apr 2022 17:00:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pstef@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650560428; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=myJNz5S7xt9gW41APdYKGWuWwu2QkcvJBurT+pHHk9Q=; b=Ygj3S2kXKVRhfRhoth3/P5ulEdo1s+k1Wa04Q20NJsRmNb/2lc1NTW5nyeUzdyxfRShPll 5nMB6uaRzNlhyoaMnxeT/kEF4r3PLulLFjFom5Qg0Oyv3dm2rvqSZdEaxFBpDCPNM2igJC Um0i97Ee3jg7DefPeiYHi0jC+6A9rySktGNY4J1ESIt8GNtUtJgx7uWu7VU5ADJKkRY1Rz GYfec+tN6XuzF0sszAP3zFYkflnIJO1Gg6RPtQ8mLrzOdPhyYWFJoyY6/Fx+v13e0LcXbc 1V/H7gPdnsYD+NbOL+GZRvc6eJJXqvJmocD3RxlOB7tX34t9OR6x69O0Kx4QMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650560428; a=rsa-sha256; cv=none; b=p3BTXmniXU9rFBEm3wAmy7J4AOEUC3pPGCU0ElNH7PjAhkFfb82SyjqQ8Yk/toZ45DKGyS VeE0Ggm6HeFftjEYBIrpN6vYDjQsFZWYO9ZiTOfUUGxw4Z0MCCXsHqEnoeWuRsvK9+AVGc tR+vBz3x7I+on/qLqTdQapHuWV2NJoG9ldJhXZ194Wjx9qh9dnjjO7qDXK7thTBB7DmpcN f+Mh7mZL9QR71wtnOZC3VwlIjVk/PN+djmgZEWTte5fXm4/PjCjEoVqLWziCzSJWcHbg8t bqqIpfKNBhKDZewEzfzixEAL5y1RfzmoBflVvV1A9Wk2xrt8MD7taWH3FV9+aw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226141 Piotr Pawel Stefaniak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pstef@freebsd.org --- Comment #2 from Piotr Pawel Stefaniak --- I don't get a panic, but: : root@thinkpad:/tmp # zpool remove meh md0 load: 0.17 cmd: zpool 685 [spa_namespace_lock] 41.78r 0.00u 0.00s 0% 6288k mi_switch+0xbf _sx_xlock_hard+0x3d1 spa_open_common+0x3ac zfs_ioc_log_history+0x63 zfsdev_ioctl_common+0x503 zfsdev_ioctl+0x143 devfs_ioctl+0xc5 vn_ioctl+0x1a4 devfs_ioctl_f+0x1e kern_ioctl+0x25b sys_ioctl+0xf1 amd64_syscall+0x10c fast_syscall_common+0xf8 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Apr 21 18:03:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 69BE411CD06D for ; Thu, 21 Apr 2022 18:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kkll80F8Fz4n8W for ; Thu, 21 Apr 2022 18:03:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DD3365915 for ; Thu, 21 Apr 2022 18:03:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23LI3FSn078835 for ; Thu, 21 Apr 2022 18:03:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23LI3FDZ078834 for fs@FreeBSD.org; Thu, 21 Apr 2022 18:03:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 226141] "zpool remove" causes panic: solaris assert: zio->io_type == ZIO_TYPE_WRITE (0x3 == 0x2) Date: Thu, 21 Apr 2022 18:03:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pstef@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650564196; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8sNqD6OZJM/UZdL/htBXqQ5X0AMVjqsqPvHDD56J7PM=; b=ElaKqvUDSmptR6CtmWm1daazJ8u2cCBOBQgwXRmedcD5mwUfOdMv15ICqiLUqZMATfRkXm 9TpxB06UfgNFSASv4UvTAwNVK4SzcIdIwXifMv6TskppkJGkvrKxWzI6UBi4DLLn4MqXtN KQQv8rKEIO84HnGG2cseJdems6QuFIyMc/Wdoy63jFMbkoQ2QUqZOzM9kFF4IJJEBzvssA JQfKA/30blys/8oBSI6t3/Z3I89qXipO4iOaofHv2VNtrTV7Qh+fHoZR0qKTr8aRIi6dEV 8OG99swdaXzk/CMqAtGkYBSsmWb0azaopYgI3hnuEj2F34bIK1lLsfLbocKQvQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650564196; a=rsa-sha256; cv=none; b=ZLgFx6f+zI3Q5/+MFiPWbvEjUxRU8uGYycSHqJcn0TG0nPklbOARMwZKdpMEXvfp/DAa8S veS3TRLiHKDZtweMiH6CFHQN1d4C3BtBD6dXpnDX39/NO9Avq/Rq/C7znQ1oLQaxzhsvys MfWadM8w6w4rlL/WBfkkHZdPO1jDPxJTkxtW5ASiBTonFHg9H6MMBPayb5qUC/bFqasMjG aDAz5MIHXClhoc3qq6V9WfwZDixBed+gKiVsvvjyG7y2Pw0KBkbdn8ChYTHfYQpsOmYgPW gYgLvOFE+vkUEvWqT2Z394kYGeAc47CE6pSJUpxYd21u7Bpf1LptxolqvgTu9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226141 --- Comment #3 from Piotr Pawel Stefaniak --- (In reply to Piotr Pawel Stefaniak from comment #2) After a while: # zpool status meh pool: meh state: ONLINE remove: Removal of vdev 0 copied 47.5K in 1h0m, completed on Thu Apr 21 19:58:42 2022 144 memory used for removed device mappings config: NAME STATE READ WRITE CKSUM meh ONLINE 0 0 0 md1 ONLINE 0 0 0 errors: No known data errors --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Apr 21 19:20:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1C8B61997345 for ; Thu, 21 Apr 2022 19:20:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KknSD6gsQz3GjM for ; Thu, 21 Apr 2022 19:20:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C68366B7B for ; Thu, 21 Apr 2022 19:20:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23LJKS5Y018893 for ; Thu, 21 Apr 2022 19:20:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23LJKSAB018892 for fs@FreeBSD.org; Thu, 21 Apr 2022 19:20:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 172092] [zfs] [panic] zfs import panics kernel Date: Thu, 21 Apr 2022 19:20:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pstef@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650568829; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pv8Xo3M7yoNwmFH62ooGEKnshEi3o1KfRQOAx1pIfEQ=; b=GU7u7GA42fKYxyMYWGD3b+iE3k/5I+WRrw/neoocrHE0hamR2OluPxuhNOT62FzNtVr8gx pk3S0uGoEqn5HmRgdSjUXRXlkeis+wOzmzaIUkFkOQa1O0LpEylP4oKOdkDIkHW1JIRGXN JIJkTGIMCDRCoKBlKloCrVRVFlUhWf1udD+D3PDYLEC5YXWb6XTIBon1jcS820ev8rivtJ 3INFH84DmS/Jr9toZG/20c0PrUcGvL48bGnPfs4irZ5VPvl7qgv8F7qHgpvhTpIEqHCoy5 poPyxJNY8CyilSHps9YCWgo/7XJJnFEGOmZOPMo/Y8OFmr+mBfCy7Lu+ozINGw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650568829; a=rsa-sha256; cv=none; b=vKg9F6HkS4AYEPuHVA+oSbqlAl3BF4wDrPG1+Uyio5uVEKWDBb3UE7UhI6Yo1NkOcokfW6 ghQNN5hrf483reIUbGhO2DTSsllWanptkB1NQtczKdUrEpCxcGr/i59a48/+tSHFRXS766 4aGylKmXwdIPpb43H1SNlC49mz+yZ+uwtheqvcO+xoxDHMHlluKbQq42YldcjIkWgRAN38 yHw3uTxkZDAKBJa7hxuWZmZn264UaQDD/S5MTRp0sIaeKMvuXCZff+YOReDWq3X2F815o1 T5dR8PJj2uK8wrg8me995i3jAgvXF94fysHrZs09M71/oC0awZxlJBY53GbaaQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D172092 Piotr Pawel Stefaniak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pstef@freebsd.org --- Comment #6 from Piotr Pawel Stefaniak --- Does this still happen after the switch to OpenZFS? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Apr 21 20:27:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9BA6D1A0EAF9 for ; Thu, 21 Apr 2022 20:27:56 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.133.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kkpy36ZNzz3hNx for ; Thu, 21 Apr 2022 20:27:55 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-110-0h67UqB1M56WaGdQEJ7xng-1; Thu, 21 Apr 2022 16:27:46 -0400 X-MC-Unique: 0h67UqB1M56WaGdQEJ7xng-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Thu, 21 Apr 2022 16:27:45 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.033; Thu, 21 Apr 2022 16:27:45 -0400 From: Michael Jung To: freebsd-fs Subject: ZFS reservations for type=volume Thread-Topic: ZFS reservations for type=volume Thread-Index: AdhVu5cQcIQitTxvR6aGtLet26Jbwg== Date: Thu, 21 Apr 2022 20:27:45 +0000 Message-ID: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_" X-Rspamd-Queue-Id: 4Kkpy36ZNzz3hNx X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.133.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-2.42 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.133.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_SPAM_SHORT(0.48)[0.477]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.132.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.133.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an iscsi= target and that works great. I have set a reservation on that block device equal to its size so that is not sparse and thus while= I could over provision guests on the provided LUN, the storage presented as the LUN capacity will always be available. At lea= st this is what I want to achieve. What I find strange is that the reservation does not seem to be applied to = the ZFS pool 'raid-5400-1'. Do you really need to set your maximum reservation at the pool level, and then apply reservati= ons to all datasets on that volume? And if so I would assume you could never set reservations for datasets totaling more = than what was reserved for the pool 'raid-5400-1'. I could build out a test environment and figure out constraints but I'd rea= lly like to know the "how it is supposed to work" not the "how I find it to work". Thanks in advance. FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d: (this is a raidz2 pool - not my draid pool) root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,rati= o,compression,reservation,refreservation,volsize raid-5400-1 NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV = VOLSIZE raid-5400-1 filesystem 18.0T 2.08T 1.36x on none = none - <- no reservation @pool root@draid:/usr/src/contrib/bearssl # root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,rati= o,compression,reservation,refreservation,volsize raid-5400-1/esxi-store1 NAME TYPE USED AVAIL RATIO COMPRESS RESERV = REFRESERV VOLSIZE raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15.6= T 16.9T 15.6T <- reservation @dataset root@draid:/usr/src/contrib/bearssl # zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT ccache 9.50G 9.10G 406M - - 88% 95% 1.00x = ONLINE - raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x = ONLINE - <- Free does not reflect reservation @pool tank 18.5T 605G 17.9T - - 0% 3% 1.00x = ONLINE - zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x = ONLINE - root@draid:/usr/src/contrib/bearssl # CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, 2101 High Wickham Place, Suite 101, Louisville, KY 40245 Disclaimer The information contained in this communication from the sender is confiden= tial. It is intended solely for use by the recipient and others authorized = to receive it. If you are not the recipient, you are hereby notified that a= ny disclosure, copying, distribution or taking action in relation of the co= ntents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been auto= matically archived by Mimecast, a leader in email security and cyber resili= ence. Mimecast integrates email defenses with brand protection, security aw= areness training, web security, compliance and other essential capabilities= . Mimecast helps protect large and small organizations from malicious activ= ity, human error and technology failure; and to lead the movement toward bu= ilding a more resilient world. To find out more, visit our website. --_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <= /head>

I have a zfs block dataset raid-5400-1/esxi-store1 t= hat I share as an iscsi target and that works great.  I have set a res= ervation

on that block device equal to its size so that is no= t sparse and thus while I could over provision guests on the provided LUN,<= o:p>

the storage presented as the LUN capacity will alway= s be available.  At least this is what I want to achieve.

 

What I find strange is that the reservation does not= seem to be applied to the ZFS pool ‘raid-5400-1’.  Do you= really need

to set your maximum reservation at the pool level, a= nd then apply reservations to all datasets on that volume?  And if so<= o:p>

I would assume you could never set reservations for = datasets totaling more than what was reserved for the pool ‘raid-5400= -1’.

 

I could build out a test environment and figure out = constraints but I’d really like to know the “how it is supposed= to work”

not the “how I find it to work”.

 

Thanks in advance.

 

FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d:

 

(this is a raidz2 pool – not my draid pool)

 

 

root@draid:/usr/src/contrib/bearssl # zfs list -o na= me,type,used,avail,ratio,compression,reservation,refreservation,volsize rai= d-5400-1

NAME        = TYPE   USED  AVAIL  RATIO  COMPRESS  &n= bsp;     RESERV  REFRESERV  VOLSIZE

raid-5400-1  filesystem  18.0T  2.08T=   1.36x  on          = ;      none     &nbs= p; none        -    =            <- no reser= vation @pool

root@draid:/usr/src/contrib/bearssl #

 

root@draid:/usr/src/contrib/bearssl # zfs list -o na= me,type,used,avail,ratio,compression,reservation,refreservation,volsize rai= d-5400-1/esxi-store1

NAME        =              TY= PE   USED  AVAIL  RATIO  COMPRESS   = ;     RESERV  REFRESERV  VOLSIZE

raid-5400-1/esxi-store1  volume  16.9T&nbs= p; 18.5T  1.78x  zstd       &n= bsp;     15.6T      16.9T = ;   15.6T        <- reserva= tion @dataset

 

root@draid:/usr/src/contrib/bearssl # zpool list

NAME        =   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ =   FRAG    CAP  DEDUP    HEALTH = ; ALTROOT

ccache       9.50G&nbs= p; 9.10G   406M        - =         -    88% &nb= sp;  95%  1.00x    ONLINE  -

raid-5400-1  24.6T  1.52T  23.1T = ;       -      =    -     2%     6%  = 1.00x    ONLINE  -      &= nbsp;           &nbs= p;  <- Free does not reflect reservation @pool

tank        = 18.5T   605G  17.9T      &nbs= p; -         -   &nb= sp; 0%     3%  1.00x    ONLINE = ; -

zfsroot       103G&nbs= p; 33.3G  69.7G        -  = ;       -    31%   &= nbsp;32%  1.00x    ONLINE  -

root@draid:/usr/src/contrib/bearssl #

 

 

CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245





<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--_000_94c10113c3964b1bbd3f4ddf934c23cdMAILHUBpailocal_-- From nobody Thu Apr 21 20:40:29 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ED7D711D9F54 for ; Thu, 21 Apr 2022 20:40:48 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f182.google.com (mail-oi1-f182.google.com [209.85.167.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KkqDw0RZ9z3lVY for ; Thu, 21 Apr 2022 20:40:48 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f182.google.com with SMTP id w194so6841820oiw.11 for ; Thu, 21 Apr 2022 13:40:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=6YWD3gS/TNgs+nVy2tr81/fsURtYIiGc68shZe2WnbU=; b=tNHr+z1BhkWVhcpW0ngxeCyWdhMKpASJqOJCVaoH9b9gK5nC9rj8uUi/3Yk39cc12j umDOrCOc5aWrasPo6IVabns9CBJybds7rnVl5WhPTVZiETyl6Hyxym6V5m4i2g5UAivC dOkoBnOaA69nmjnSpRRk/wPVXxFXlQIRFpw/bGh+K/0rjCcp745Bt/IhdM0akyk06j8U ttcJsnmeoLBRxOJRjBNv/eUPEqD3rl44Bg4Gd/FBQrM+QQITyQuUci9gCdlBb5uDaYPR mNMnjHictCAe92kqsTV7u6wtiRxKKoJV1xHk1UZ5PTUy2M19sg9fVydgCGWJYTFGeAKQ qk7Q== X-Gm-Message-State: AOAM531vSMN3XJfjdcgkX78fW3miAc5St6ZEMdiClk3kWlWCUlXkcV3Q KwTFGqkjDkPLm7l8fy6IDc/X3ZEtWD63BDu2TI8= X-Google-Smtp-Source: ABdhPJwBS4PZ8acc8Rqx98dy3keV4pv40lSUbMHXg0ug4nHuQe4xAzQfY65GKsMz4Fp2xxPCBPVN5nOaVQwStkw1cmo= X-Received: by 2002:a05:6808:2123:b0:322:79b9:9c1 with SMTP id r35-20020a056808212300b0032279b909c1mr4890969oiw.222.1650573640876; Thu, 21 Apr 2022 13:40:40 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> From: Alan Somers Date: Thu, 21 Apr 2022 14:40:29 -0600 Message-ID: Subject: Re: ZFS reservations for type=volume To: Michael Jung Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4KkqDw0RZ9z3lVY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.182 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.69 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.69)[-0.691]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.182:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.182:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N A dataset's reservation is local. It doesn't contribute to its parent's reservation. Otherwise, you wouldn't be able to separately set a reservation on the parent. But it _does_ contribute to the parent's "used" value. In that way, you're prevented from reserving too much data on the parent's children. -Alan On Thu, Apr 21, 2022 at 2:28 PM Michael Jung wrote: > > I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an isc= si target and that works great. I have set a reservation > > on that block device equal to its size so that is not sparse and thus whi= le I could over provision guests on the provided LUN, > > the storage presented as the LUN capacity will always be available. At l= east this is what I want to achieve. > > > > What I find strange is that the reservation does not seem to be applied t= o the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you really need > > to set your maximum reservation at the pool level, and then apply reserva= tions to all datasets on that volume? And if so > > I would assume you could never set reservations for datasets totaling mor= e than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99. > > > > I could build out a test environment and figure out constraints but I=E2= =80=99d really like to know the =E2=80=9Chow it is supposed to work=E2=80= =9D > > not the =E2=80=9Chow I find it to work=E2=80=9D. > > > > Thanks in advance. > > > > FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d: > > > > (this is a raidz2 pool =E2=80=93 not my draid pool) > > > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,ra= tio,compression,reservation,refreservation,volsize raid-5400-1 > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV= VOLSIZE > > raid-5400-1 filesystem 18.0T 2.08T 1.36x on none = none - <- no reservation @pool > > root@draid:/usr/src/contrib/bearssl # > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o name,type,used,avail,ra= tio,compression,reservation,refreservation,volsize raid-5400-1/esxi-store1 > > NAME TYPE USED AVAIL RATIO COMPRESS RESER= V REFRESERV VOLSIZE > > raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15= .6T 16.9T 15.6T <- reservation @dataset > > > > root@draid:/usr/src/contrib/bearssl # zpool list > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT > > ccache 9.50G 9.10G 406M - - 88% 95% 1.00x = ONLINE - > > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x = ONLINE - <- Free does not reflect reservation @pool > > tank 18.5T 605G 17.9T - - 0% 3% 1.00x = ONLINE - > > zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x = ONLINE - > > root@draid:/usr/src/contrib/bearssl # > > > > > > CONFIDENTIALITY NOTE: This message is intended only for the use > of the individual or entity to whom it is addressed and may > contain information that is privileged, confidential, and > exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby > notified that any dissemination, distribution or copying > of this communication is strictly prohibited. If you have > received this transmission in error, please notify us by > telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, > 2101 High Wickham Place, Suite 101, Louisville, KY 40245 > > > > > > Disclaimer > > The information contained in this communication from the sender is confid= ential. It is intended solely for use by the recipient and others authorize= d to receive it. If you are not the recipient, you are hereby notified that= any disclosure, copying, distribution or taking action in relation of the = contents of this information is strictly prohibited and may be unlawful. > > This email has been scanned for viruses and malware, and may have been au= tomatically archived by Mimecast, a leader in email security and cyber resi= lience. Mimecast integrates email defenses with brand protection, security = awareness training, web security, compliance and other essential capabiliti= es. Mimecast helps protect large and small organizations from malicious act= ivity, human error and technology failure; and to lead the movement toward = building a more resilient world. To find out more, visit our website. From nobody Thu Apr 21 20:56:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C91F011DF20B for ; Thu, 21 Apr 2022 20:56:26 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KkqZx6Pldz3p29 for ; Thu, 21 Apr 2022 20:56:25 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-HUB.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-393-Bu9LdJvgPCiwVX5DLW24hQ-1; Thu, 21 Apr 2022 16:56:16 -0400 X-MC-Unique: Bu9LdJvgPCiwVX5DLW24hQ-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-HUB.pai.local (10.10.0.250) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Thu, 21 Apr 2022 16:56:15 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.033; Thu, 21 Apr 2022 16:56:15 -0400 From: Michael Jung To: Alan Somers CC: freebsd-fs Subject: RE: ZFS reservations for type=volume Thread-Topic: ZFS reservations for type=volume Thread-Index: AdhVu5cQcIQitTxvR6aGtLet26JbwgAJfmSAAAgCV9A= Date: Thu, 21 Apr 2022 20:56:14 +0000 Message-ID: References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Type: multipart/alternative; boundary="MCBoundary=_12204211656173051" X-Rspamd-Queue-Id: 4KkqZx6Pldz3p29 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-3.78 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.984]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:~,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.129.197:from] X-ThisMailContainsUnwantedMimeParts: N --MCBoundary=_12204211656173051 Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 T2sgdGhhdCBtYWtlcyBzZW5zZS4uLiBzbyBldmVuIHRob3VnaCBydW5uaW5nIFpGUyBzaW5jZSA5 LnggSSdsbCBhc2sgdGhlIG5ld2JpZSBxdWVzdGlvbi4uDQoNCklmIGl0IGNvbnRyaWJ1dGVzIHRv IHRoZSBwYXJlbnRzICJ1c2VkIiB2YWx1ZSB3aHkgaXMgbm90IHJlZmxlY3RlZCBoZXJlIGluICJV U0VEIiBvciBpbiAiQVZBSUwiPw0KDQpJIHdvdWxkIGV4cGVjdCBVU0VEIHRvIGJlIG15IHJlc2Vy dmF0aW9uIGFtb3VudCBvZiAxNS42VCArIHdoYXRldmVyIHNwYWNlIHdhcw0KYmVpbmcgdXNlZCBi eSBvdGhlciB0aGluZ3Mgb24gdGhlIHBvb2wuICAiVVNFRCIgc3RpbGwgc2l0cyBhdCAxLjUyVC4N Cg0KTkFNRSAgICAgICAgIFRZUEUgICBVU0VEICBBVkFJTCAgUkFUSU8gIENPTVBSRVNTICAgICAg ICBSRVNFUlYgIFJFRlJFU0VSViAgVk9MU0laRQ0KcmFpZC01NDAwLTEgIDI0LjZUICAxLjUyVCAg MjMuMVQgICAgICAgIC0gICAgICAgICAtICAgICAyJSAgICAgNiUgIDEuMDB4ICAgIE9OTElORQ0K DQpUaGFua3MgYWdhaW4uDQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9tOiBBbGFu IFNvbWVycyBbbWFpbHRvOmFzb21lcnNAZnJlZWJzZC5vcmddDQpTZW50OiBUaHVyc2RheSwgQXBy aWwgMjEsIDIwMjIgNDo0MCBQTQ0KVG86IE1pY2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlh bmNlaW50bC5jb20+DQpDYzogZnJlZWJzZC1mcyA8ZnJlZWJzZC1mc0BmcmVlYnNkLm9yZz4NClN1 YmplY3Q6IFJlOiBaRlMgcmVzZXJ2YXRpb25zIGZvciB0eXBlPXZvbHVtZQ0KDQpBIGRhdGFzZXQn cyByZXNlcnZhdGlvbiBpcyBsb2NhbC4gIEl0IGRvZXNuJ3QgY29udHJpYnV0ZSB0byBpdHMgcGFy ZW50J3MgcmVzZXJ2YXRpb24uICBPdGhlcndpc2UsIHlvdSB3b3VsZG4ndCBiZSBhYmxlIHRvIHNl cGFyYXRlbHkgc2V0IGEgcmVzZXJ2YXRpb24gb24gdGhlIHBhcmVudC4gIEJ1dCBpdCBfZG9lc18g Y29udHJpYnV0ZSB0byB0aGUgcGFyZW50J3MgInVzZWQiIHZhbHVlLiAgSW4gdGhhdCB3YXksIHlv dSdyZSBwcmV2ZW50ZWQgZnJvbSByZXNlcnZpbmcgdG9vIG11Y2ggZGF0YSBvbiB0aGUgcGFyZW50 J3MgY2hpbGRyZW4uDQotQWxhbg0KDQpPbiBUaHUsIEFwciAyMSwgMjAyMiBhdCAyOjI4IFBNIE1p Y2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5jb20+IHdyb3RlOg0KPg0KPiBJ IGhhdmUgYSB6ZnMgYmxvY2sgZGF0YXNldCByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMSB0aGF0IEkg c2hhcmUgYXMgYW4NCj4gaXNjc2kgdGFyZ2V0IGFuZCB0aGF0IHdvcmtzIGdyZWF0LiAgSSBoYXZl IHNldCBhIHJlc2VydmF0aW9uDQo+DQo+IG9uIHRoYXQgYmxvY2sgZGV2aWNlIGVxdWFsIHRvIGl0 cyBzaXplIHNvIHRoYXQgaXMgbm90IHNwYXJzZSBhbmQgdGh1cw0KPiB3aGlsZSBJIGNvdWxkIG92 ZXIgcHJvdmlzaW9uIGd1ZXN0cyBvbiB0aGUgcHJvdmlkZWQgTFVOLA0KPg0KPiB0aGUgc3RvcmFn ZSBwcmVzZW50ZWQgYXMgdGhlIExVTiBjYXBhY2l0eSB3aWxsIGFsd2F5cyBiZSBhdmFpbGFibGUu ICBBdCBsZWFzdCB0aGlzIGlzIHdoYXQgSSB3YW50IHRvIGFjaGlldmUuDQo+DQo+DQo+DQo+IFdo YXQgSSBmaW5kIHN0cmFuZ2UgaXMgdGhhdCB0aGUgcmVzZXJ2YXRpb24gZG9lcyBub3Qgc2VlbSB0 byBiZQ0KPiBhcHBsaWVkIHRvIHRoZSBaRlMgcG9vbCDigJhyYWlkLTU0MDAtMeKAmS4gIERvIHlv dSByZWFsbHkgbmVlZA0KPg0KPiB0byBzZXQgeW91ciBtYXhpbXVtIHJlc2VydmF0aW9uIGF0IHRo ZSBwb29sIGxldmVsLCBhbmQgdGhlbiBhcHBseQ0KPiByZXNlcnZhdGlvbnMgdG8gYWxsIGRhdGFz ZXRzIG9uIHRoYXQgdm9sdW1lPyAgQW5kIGlmIHNvDQo+DQo+IEkgd291bGQgYXNzdW1lIHlvdSBj b3VsZCBuZXZlciBzZXQgcmVzZXJ2YXRpb25zIGZvciBkYXRhc2V0cyB0b3RhbGluZyBtb3JlIHRo YW4gd2hhdCB3YXMgcmVzZXJ2ZWQgZm9yIHRoZSBwb29sIOKAmHJhaWQtNTQwMC0x4oCZLg0KPg0K Pg0KPg0KPiBJIGNvdWxkIGJ1aWxkIG91dCBhIHRlc3QgZW52aXJvbm1lbnQgYW5kIGZpZ3VyZSBv dXQgY29uc3RyYWludHMgYnV0IEnigJlkIHJlYWxseSBsaWtlIHRvIGtub3cgdGhlIOKAnGhvdyBp dCBpcyBzdXBwb3NlZCB0byB3b3Jr4oCdDQo+DQo+IG5vdCB0aGUg4oCcaG93IEkgZmluZCBpdCB0 byB3b3Jr4oCdLg0KPg0KPg0KPg0KPiBUaGFua3MgaW4gYWR2YW5jZS4NCj4NCj4NCj4NCj4gRnJl ZUJTRCAxNC4wLUNVUlJFTlQgIzQgbWFpbi1uMjUzODc1LThlNzJmNDU4YzZkOg0KPg0KPg0KPg0K PiAodGhpcyBpcyBhIHJhaWR6MiBwb29sIOKAkyBub3QgbXkgZHJhaWQgcG9vbCkNCj4NCj4NCj4N Cj4NCj4NCj4gcm9vdEBkcmFpZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIyB6ZnMgbGlzdCAt bw0KPiBuYW1lLHR5cGUsdXNlZCxhdmFpbCxyYXRpbyxjb21wcmVzc2lvbixyZXNlcnZhdGlvbixy ZWZyZXNlcnZhdGlvbix2b2xzDQo+IGl6ZSByYWlkLTU0MDAtMQ0KPg0KPiBOQU1FICAgICAgICAg VFlQRSAgIFVTRUQgIEFWQUlMICBSQVRJTyAgQ09NUFJFU1MgICAgICAgIFJFU0VSViAgUkVGUkVT RVJWICBWT0xTSVpFDQo+DQo+IHJhaWQtNTQwMC0xICBmaWxlc3lzdGVtICAxOC4wVCAgMi4wOFQg IDEuMzZ4ICBvbiAgICAgICAgICAgICAgICBub25lICAgICAgIG5vbmUgICAgICAgIC0gICAgICAg ICAgICAgICA8LSBubyByZXNlcnZhdGlvbiBAcG9vbA0KPg0KPiByb290QGRyYWlkOi91c3Ivc3Jj L2NvbnRyaWIvYmVhcnNzbCAjDQo+DQo+DQo+DQo+IHJvb3RAZHJhaWQ6L3Vzci9zcmMvY29udHJp Yi9iZWFyc3NsICMgemZzIGxpc3QgLW8NCj4gbmFtZSx0eXBlLHVzZWQsYXZhaWwscmF0aW8sY29t cHJlc3Npb24scmVzZXJ2YXRpb24scmVmcmVzZXJ2YXRpb24sdm9scw0KPiBpemUgcmFpZC01NDAw LTEvZXN4aS1zdG9yZTENCj4NCj4gTkFNRSAgICAgICAgICAgICAgICAgICAgIFRZUEUgICBVU0VE ICBBVkFJTCAgUkFUSU8gIENPTVBSRVNTICAgICAgICBSRVNFUlYgIFJFRlJFU0VSViAgVk9MU0la RQ0KPg0KPiByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMSAgdm9sdW1lICAxNi45VCAgMTguNVQgIDEu Nzh4ICB6c3RkICAgICAgICAgICAgIDE1LjZUICAgICAgMTYuOVQgICAgMTUuNlQgICAgICAgIDwt IHJlc2VydmF0aW9uIEBkYXRhc2V0DQo+DQo+DQo+DQo+IHJvb3RAZHJhaWQ6L3Vzci9zcmMvY29u dHJpYi9iZWFyc3NsICMgenBvb2wgbGlzdA0KPg0KPiBOQU1FICAgICAgICAgIFNJWkUgIEFMTE9D ICAgRlJFRSAgQ0tQT0lOVCAgRVhQQU5EU1ogICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRI ICBBTFRST09UDQo+DQo+IGNjYWNoZSAgICAgICA5LjUwRyAgOS4xMEcgICA0MDZNICAgICAgICAt ICAgICAgICAgLSAgICA4OCUgICAgOTUlICAxLjAweCAgICBPTkxJTkUgIC0NCj4NCj4gcmFpZC01 NDAwLTEgIDI0LjZUICAxLjUyVCAgMjMuMVQgICAgICAgIC0gICAgICAgICAtICAgICAyJSAgICAg NiUgIDEuMDB4ICAgIE9OTElORSAgLSAgICAgICAgICAgICAgICAgICAgIDwtIEZyZWUgZG9lcyBu b3QgcmVmbGVjdCByZXNlcnZhdGlvbiBAcG9vbA0KPg0KPiB0YW5rICAgICAgICAgMTguNVQgICA2 MDVHICAxNy45VCAgICAgICAgLSAgICAgICAgIC0gICAgIDAlICAgICAzJSAgMS4wMHggICAgT05M SU5FICAtDQo+DQo+IHpmc3Jvb3QgICAgICAgMTAzRyAgMzMuM0cgIDY5LjdHICAgICAgICAtICAg ICAgICAgLSAgICAzMSUgICAgMzIlICAxLjAweCAgICBPTkxJTkUgIC0NCj4NCj4gcm9vdEBkcmFp ZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIw0KPg0KPg0KPg0KPg0KPg0KPiBDT05GSURFTlRJ QUxJVFkgTk9URTogVGhpcyBtZXNzYWdlIGlzIGludGVuZGVkIG9ubHkgZm9yIHRoZSB1c2Ugb2Yg dGhlDQo+IGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBt YXkgY29udGFpbg0KPiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVnZWQsIGNvbmZpZGVudGlh bCwgYW5kIGV4ZW1wdCBmcm9tDQo+IGRpc2Nsb3N1cmUgdW5kZXIgYXBwbGljYWJsZSBsYXcuIElm IHRoZSByZWFkZXIgb2YgdGhpcyBtZXNzYWdlIGlzIG5vdA0KPiB0aGUgaW50ZW5kZWQgcmVjaXBp ZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueQ0KPiBkaXNzZW1pbmF0aW9uLCBk aXN0cmlidXRpb24gb3IgY29weWluZyBvZiB0aGlzIGNvbW11bmljYXRpb24gaXMNCj4gc3RyaWN0 bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUgcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4g ZXJyb3IsDQo+IHBsZWFzZSBub3RpZnkgdXMgYnkgdGVsZXBob25lIGF0ICg1MDIpIDIxMi00MDAw IG9yIG5vdGlmeSB1cyBhdDogUEFJLA0KPiBEZXB0LiA5OSwNCj4gMjEwMSBIaWdoIFdpY2toYW0g UGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kgNDAyNDUNCj4NCj4NCj4NCj4NCj4NCj4g RGlzY2xhaW1lcg0KPg0KPiBUaGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29tbXVu aWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBz b2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byBy ZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBu b3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFr aW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlv biBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQo+DQo+IFRoaXMg ZW1haWwgaGFzIGJlZW4gc2Nhbm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBo YXZlIGJlZW4gYXV0b21hdGljYWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4g ZW1haWwgc2VjdXJpdHkgYW5kIGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMg ZW1haWwgZGVmZW5zZXMgd2l0aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3Mg dHJhaW5pbmcsIHdlYiBzZWN1cml0eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNh cGFiaWxpdGllcy4gTWltZWNhc3QgaGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5p emF0aW9ucyBmcm9tIG1hbGljaW91cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xv Z3kgZmFpbHVyZTsgYW5kIHRvIGxlYWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1v cmUgcmVzaWxpZW50IHdvcmxkLiBUbyBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4N Cg0KDQoNCg0KQ09ORklERU5USUFMSVRZIE5PVEU6IFRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBv bmx5IGZvciB0aGUgdXNlDQpvZiB0aGUgaW5kaXZpZHVhbCBvciBlbnRpdHkgdG8gd2hvbSBpdCBp cyBhZGRyZXNzZWQgYW5kIG1heQ0KY29udGFpbiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVn ZWQsIGNvbmZpZGVudGlhbCwgYW5kDQpleGVtcHQgZnJvbSBkaXNjbG9zdXJlIHVuZGVyIGFwcGxp Y2FibGUgbGF3LiBJZiB0aGUgcmVhZGVyDQpvZiB0aGlzIG1lc3NhZ2UgaXMgbm90IHRoZSBpbnRl bmRlZCByZWNpcGllbnQsIHlvdSBhcmUgaGVyZWJ5DQpub3RpZmllZCB0aGF0IGFueSBkaXNzZW1p bmF0aW9uLCBkaXN0cmlidXRpb24gb3IgY29weWluZw0Kb2YgdGhpcyBjb21tdW5pY2F0aW9uIGlz IHN0cmljdGx5IHByb2hpYml0ZWQuIElmIHlvdSBoYXZlDQpyZWNlaXZlZCB0aGlzIHRyYW5zbWlz c2lvbiBpbiBlcnJvciwgcGxlYXNlIG5vdGlmeSB1cyBieQ0KdGVsZXBob25lIGF0ICg1MDIpIDIx Mi00MDAwIG9yIG5vdGlmeSB1cyBhdCBQQUksIERlcHQuIDk5LA0KMjEwMSBIaWdoIFdpY2toYW0g UGxhY2UsIFN1aXRlIDEwMSwgTG91aXN2aWxsZSwgS1kgNDAyNDUNCg0KRGlzY2xhaW1lcg0KDQpU aGUgaW5mb3JtYXRpb24gY29udGFpbmVkIGluIHRoaXMgY29tbXVuaWNhdGlvbiBmcm9tIHRoZSBz ZW5kZXIgaXMgY29uZmlkZW50aWFsLiBJdCBpcyBpbnRlbmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0 aGUgcmVjaXBpZW50IGFuZCBvdGhlcnMgYXV0aG9yaXplZCB0byByZWNlaXZlIGl0LiBJZiB5b3Ug YXJlIG5vdCB0aGUgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueSBk aXNjbG9zdXJlLCBjb3B5aW5nLCBkaXN0cmlidXRpb24gb3IgdGFraW5nIGFjdGlvbiBpbiByZWxh dGlvbiBvZiB0aGUgY29udGVudHMgb2YgdGhpcyBpbmZvcm1hdGlvbiBpcyBzdHJpY3RseSBwcm9o aWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdmdWwuDQoNClRoaXMgZW1haWwgaGFzIGJlZW4gc2Nhbm5l ZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBoYXZlIGJlZW4gYXV0b21hdGljYWxs eSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4gZW1haWwgc2VjdXJpdHkgYW5kIGN5 YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMgZW1haWwgZGVmZW5zZXMgd2l0aCBi cmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3MgdHJhaW5pbmcsIHdlYiBzZWN1cml0 eSwgY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFiaWxpdGllcy4gTWltZWNhc3Qg aGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0aW9ucyBmcm9tIG1hbGljaW91 cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxl YWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUgcmVzaWxpZW50IHdvcmxkLiBU byBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS4NCg== --MCBoundary=_12204211656173051 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8 Ok that makes sense... so even though running ZFS s= ince 9.x I'll ask the newbie question..

If it contributes to the parents "used" value why is not reflecte= d here in "USED" or in "AVAIL"?

I would expect USED to be my reservation amount of 15.6T + whatever space w= as
being used by other things on the pool. "USED" still sits at 1.5= 2T.

NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV = VOLSIZE
raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x = ONLINE

Thanks again.

-----Original Message-----
From: Alan Somers [mailto:asomers@freebsd.org]
Sent: Thursday, April 21, 2022 4:40 PM
To: Michael Jung <mikej@paymentallianceintl.com>
Cc: freebsd-fs <freebsd-fs@freebsd.org>
Subject: Re: ZFS reservations for type=3Dvolume

A dataset's reservation is local. It doesn't contribute to its parent's re= servation. Otherwise, you wouldn't be able to separately set a reservation= on the parent. But it _does_ contribute to the parent's "used" = value. In that way, you're prevented from reserving too much data on the p= arent's children.
-Alan

On Thu, Apr 21, 2022 at 2:28 PM Michael Jung <mikej@paymentallianceintl.= com> wrote:
>
> I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an<= BR> > iscsi target and that works great. I have set a reservation
>
> on that block device equal to its size so that is not sparse and thus<= BR> > while I could over provision guests on the provided LUN,
>
> the storage presented as the LUN capacity will always be available. A= t least this is what I want to achieve.
>
>
>
> What I find strange is that the reservation does not seem to be
> applied to the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you really = need
>
> to set your maximum reservation at the pool level, and then apply
> reservations to all datasets on that volume? And if so
>
> I would assume you could never set reservations for datasets totaling = more than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99.
>
>
>
> I could build out a test environment and figure out constraints but I= =E2=80=99d really like to know the =E2=80=9Chow it is supposed to work=E2= =80=9D
>
> not the =E2=80=9Chow I find it to work=E2=80=9D.
>
>
>
> Thanks in advance.
>
>
>
> FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d:
>
>
>
> (this is a raidz2 pool =E2=80=93 not my draid pool)
>
>
>
>
>
> root@draid:/usr/src/contrib/bearssl # zfs list -o
> name,type,used,avail,ratio,compression,reservation,refreservation,vols=
> ize raid-5400-1
>
> NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRES= ERV VOLSIZE
>
> raid-5400-1 filesystem 18.0T 2.08T 1.36x on none = none - <- no reservation @pool
>
> root@draid:/usr/src/contrib/bearssl #
>
>
>
> root@draid:/usr/src/contrib/bearssl # zfs list -o
> name,type,used,avail,ratio,compression,reservation,refreservation,vols=
> ize raid-5400-1/esxi-store1
>
> NAME TYPE USED AVAIL RATIO COMPRESS RE= SERV REFRESERV VOLSIZE
>
> raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd = 15.6T 16.9T 15.6T <- reservation @dataset
>
>
>
> root@draid:/usr/src/contrib/bearssl # zpool list
>
> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DED= UP HEALTH ALTROOT
>
> ccache 9.50G 9.10G 406M - - 88% 95% 1.0= 0x ONLINE -
>
> raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.0= 0x ONLINE - <- Free does not reflect reservation= @pool
>
> tank 18.5T 605G 17.9T - - 0% 3% 1.0= 0x ONLINE -
>
> zfsroot 103G 33.3G 69.7G - - 31% 32% 1.0= 0x ONLINE -
>
> root@draid:/usr/src/contrib/bearssl #
>
>
>
>
>
> CONFIDENTIALITY NOTE: This message is intended only for the use of the=
> individual or entity to whom it is addressed and may contain
> information that is privileged, confidential, and exempt from
> disclosure under applicable law. If the reader of this message is not<= BR> > the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication is
> strictly prohibited. If you have received this transmission in error,<= BR> > please notify us by telephone at (502) 212-4000 or notify us at: PAI,<= BR> > Dept. 99,
> 2101 High Wickham Place, Suite 101, Louisville, KY 40245
>
>
>
>
>
> Disclaimer
>
> The information contained in this communication from the sender is con= fidential. It is intended solely for use by the recipient and others author= ized to receive it. If you are not the recipient, you are hereby notified t= hat any disclosure, copying, distribution or taking action in relation of t= he contents of this information is strictly prohibited and may be unlawful.=
>
> This email has been scanned for viruses and malware, and may have been= automatically archived by Mimecast, a leader in email security and cyber r= esilience. Mimecast integrates email defenses with brand protection, securi= ty awareness training, web security, compliance and other essential capabil= ities. Mimecast helps protect large and small organizations from malicious = activity, human error and technology failure; and to lead the movement towa= rd building a more resilient world. To find out more, visit our website.



CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245


<= b>Disclaimer

The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.

This email has been scanned for viruses and malware, and may h= ave been automatically archived by Mimecast, a leader in email security and= cyber resilience. Mimecast integrates email defenses with brand protection= , security awareness training, web security, compliance and other essential= capabilities. Mimecast helps protect large and small organizations from ma= licious activity, human error and technology failure; and to lead the movem= ent toward building a more resilient world. To find out more, visit our web= site.

--MCBoundary=_12204211656173051-- From nobody Thu Apr 21 21:45:25 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EB0A0198BB01 for ; Thu, 21 Apr 2022 21:45:43 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oa1-f42.google.com (mail-oa1-f42.google.com [209.85.160.42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kkrgp4Z5Kz3v9J for ; Thu, 21 Apr 2022 21:45:42 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oa1-f42.google.com with SMTP id 586e51a60fabf-e2fa360f6dso6727316fac.2 for ; Thu, 21 Apr 2022 14:45:42 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=4abzgOgCiajSE9zNAfSyM2h/NlA9BbTJnwqvuSu0e64=; b=nhWv/phWQIU3r2vMOa83M3OKTJpaV6xYANPRGi2WJtXWONURGx3V7uCdbiiilX6CKm PUTZ9WHIsR+evgeiHNNjwSJdDh2Z7ALcR2YB4ZCbyhrS4tVm3U/KWOhd9wu3cG4N7YTT F8cTAz67OXu69cL5SMy+1qPehXOHcT28E/bYpYpoblHnnc98FKULltW5VMY038Lob6zk EvOMeJ04p90MsaseSg6VWKTl2aqbSuxvpBvz/Bqtxn3+/AwM3F8tS3JTA/nNQaQcqoaJ TGFillg0G+JXiojGxQiWg8rKewz9wiEA0uLq1MRc4Sny3+evvGwSxkUUA8LLAG2Gdtj2 5RHQ== X-Gm-Message-State: AOAM532hjlh8HYZrs4JmUtVBpERAkXNMlVVtZIWJcnF2LMyaI6yldYke jQvvR5ZMoQpENCncqpsk2zApfBhBm6juWAi9qQaBbWrx X-Google-Smtp-Source: ABdhPJzfFrk5VrFvMU0VmB6HmS2UF9mkDJ4kZ2un3WK5LKBIb2xVOn6YLUWsZqOcfXkjRLlXu6z+o89BSnzKWmPIW+U= X-Received: by 2002:a05:6870:a2d2:b0:d7:60ca:5065 with SMTP id w18-20020a056870a2d200b000d760ca5065mr4853696oak.72.1650577536136; Thu, 21 Apr 2022 14:45:36 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: From: Alan Somers Date: Thu, 21 Apr 2022 15:45:25 -0600 Message-ID: Subject: Re: ZFS reservations for type=volume To: Michael Jung Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Kkrgp4Z5Kz3v9J X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.160.42 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.85 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.958]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.160.42:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.996]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.42:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Isn't 1.52T the "AVAIL" value, and 24.6T is the "USED"? On Thu, Apr 21, 2022 at 2:56 PM Michael Jung wrote: > > Ok that makes sense... so even though running ZFS since 9.x I'll ask the = newbie question.. > > If it contributes to the parents "used" value why is not reflected here i= n "USED" or in "AVAIL"? > > I would expect USED to be my reservation amount of 15.6T + whatever space= was > being used by other things on the pool. "USED" still sits at 1.52T. > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE > > Thanks again. > > -----Original Message----- > From: Alan Somers [mailto:asomers@freebsd.org] > Sent: Thursday, April 21, 2022 4:40 PM > To: Michael Jung > Cc: freebsd-fs > Subject: Re: ZFS reservations for type=3Dvolume > > A dataset's reservation is local. It doesn't contribute to its parent's r= eservation. Otherwise, you wouldn't be able to separately set a reservation= on the parent. But it _does_ contribute to the parent's "used" value. In t= hat way, you're prevented from reserving too much data on the parent's chil= dren. > -Alan > > On Thu, Apr 21, 2022 at 2:28 PM Michael Jung wrote: > > > > I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an > > iscsi target and that works great. I have set a reservation > > > > on that block device equal to its size so that is not sparse and thus > > while I could over provision guests on the provided LUN, > > > > the storage presented as the LUN capacity will always be available. At = least this is what I want to achieve. > > > > > > > > What I find strange is that the reservation does not seem to be > > applied to the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you really ne= ed > > > > to set your maximum reservation at the pool level, and then apply > > reservations to all datasets on that volume? And if so > > > > I would assume you could never set reservations for datasets totaling m= ore than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99. > > > > > > > > I could build out a test environment and figure out constraints but I= =E2=80=99d really like to know the =E2=80=9Chow it is supposed to work=E2= =80=9D > > > > not the =E2=80=9Chow I find it to work=E2=80=9D. > > > > > > > > Thanks in advance. > > > > > > > > FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d: > > > > > > > > (this is a raidz2 pool =E2=80=93 not my draid pool) > > > > > > > > > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o > > name,type,used,avail,ratio,compression,reservation,refreservation,vols > > ize raid-5400-1 > > > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > > > > raid-5400-1 filesystem 18.0T 2.08T 1.36x on none none - <- no reservati= on @pool > > > > root@draid:/usr/src/contrib/bearssl # > > > > > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o > > name,type,used,avail,ratio,compression,reservation,refreservation,vols > > ize raid-5400-1/esxi-store1 > > > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > > > > raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15.6T 16.9T 15.6T= <- reservation @dataset > > > > > > > > root@draid:/usr/src/contrib/bearssl # zpool list > > > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > > > > ccache 9.50G 9.10G 406M - - 88% 95% 1.00x ONLINE - > > > > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE - <- Free does not= reflect reservation @pool > > > > tank 18.5T 605G 17.9T - - 0% 3% 1.00x ONLINE - > > > > zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x ONLINE - > > > > root@draid:/usr/src/contrib/bearssl # > > > > > > > > > > > > CONFIDENTIALITY NOTE: This message is intended only for the use of the > > individual or entity to whom it is addressed and may contain > > information that is privileged, confidential, and exempt from > > disclosure under applicable law. If the reader of this message is not > > the intended recipient, you are hereby notified that any > > dissemination, distribution or copying of this communication is > > strictly prohibited. If you have received this transmission in error, > > please notify us by telephone at (502) 212-4000 or notify us at: PAI, > > Dept. 99, > > 2101 High Wickham Place, Suite 101, Louisville, KY 40245 > > > > > > > > > > > > Disclaimer > > > > The information contained in this communication from the sender is conf= idential. It is intended solely for use by the recipient and others authori= zed to receive it. If you are not the recipient, you are hereby notified th= at any disclosure, copying, distribution or taking action in relation of th= e contents of this information is strictly prohibited and may be unlawful. > > > > This email has been scanned for viruses and malware, and may have been = automatically archived by Mimecast, a leader in email security and cyber re= silience. Mimecast integrates email defenses with brand protection, securit= y awareness training, web security, compliance and other essential capabili= ties. Mimecast helps protect large and small organizations from malicious a= ctivity, human error and technology failure; and to lead the movement towar= d building a more resilient world. To find out more, visit our website. > > > > > CONFIDENTIALITY NOTE: This message is intended only for the use > of the individual or entity to whom it is addressed and may > contain information that is privileged, confidential, and > exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby > notified that any dissemination, distribution or copying > of this communication is strictly prohibited. If you have > received this transmission in error, please notify us by > telephone at (502) 212-4000 or notify us at PAI, Dept. 99, > 2101 High Wickham Place, Suite 101, Louisville, KY 40245 > > > Disclaimer > > The information contained in this communication from the sender is confid= ential. It is intended solely for use by the recipient and others authorize= d to receive it. If you are not the recipient, you are hereby notified that= any disclosure, copying, distribution or taking action in relation of the = contents of this information is strictly prohibited and may be unlawful. > > This email has been scanned for viruses and malware, and may have been au= tomatically archived by Mimecast, a leader in email security and cyber resi= lience. Mimecast integrates email defenses with brand protection, security = awareness training, web security, compliance and other essential capabiliti= es. Mimecast helps protect large and small organizations from malicious act= ivity, human error and technology failure; and to lead the movement toward = building a more resilient world. To find out more, visit our website. From nobody Thu Apr 21 21:58:34 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CB8EC198E2AC for ; Thu, 21 Apr 2022 21:58:42 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-ua1-x936.google.com (mail-ua1-x936.google.com [IPv6:2607:f8b0:4864:20::936]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kkryn6ZrGz3wLl; Thu, 21 Apr 2022 21:58:41 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: by mail-ua1-x936.google.com with SMTP id b11so2308650uaq.2; Thu, 21 Apr 2022 14:58:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=lATVujw8CpuVgxuYeFdXPHsLZJA8F+0EsO7Ldqobcaw=; b=hBeKwEdwAZPJgjxjRXhxGkJn/J/KgSjF9Xafpq9zay+n93g8wYuJVbKo6kGXm0FkRL saeNAe+xFNNya2l/ioN0//m6kUdOjVOsyA8dJXxtRtjG6E2kQ7csjmSgu5FVOwitV+8g DKunaRXeXe5SJQFpZZFtHcHbhDCam0XluyJj4MxsNj1sW9f9MSI2FfuwuD2QRMzd6t7h 9Hry6PfEsk4VWJAvJw0kRcLqZfLRj5dms/VUD4HcY/RJxUPFJQf7aqkEH6h8tn8mG5I2 0dKrCxx8T0pGVHJN/LxoojVpbP23qfGNBv7+eiLoZLsu9SYATzfFazPyYnjL7jyBpjiv K0kw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=lATVujw8CpuVgxuYeFdXPHsLZJA8F+0EsO7Ldqobcaw=; b=FRi8vvoFVROg50eHASJnDhCxLZYhqQPbmiiLfOm6BNNGbTr3fO6tnhhC1UuWVd03fR ge6O/eej26Pea6oTCRfSOa//sJxXF7k4gX2HWpKeqp85nkt1Pju0Q+lgn56Yluq7QgUF BksHYsdIpWsZEyHB+ML07olk22XdQegbogSTIavEGP2Qsmp+kA60LyAvTswLMb1GVfAq UHnFbhWvMQtvG+THSqiMWFP7XLrEbeXcy3CZsRt1Mf9DaJ2fs+QUzfK5J+48bf6zrjis PJEOFcApuVN7YRZhQx3HTzEWjd+EA5XnyVR8thxmRYVpjHVcWRU8zqGpjbBgBiMuXWIh pGzQ== X-Gm-Message-State: AOAM530XGtM/6Yy4Xo6SJvpo4rt1HLnrBH/6Ae06WvEsZulk18zDCBUV 3iEtQGGCZio5WY6lgt06bc6ceftOaDq9UadzB5hVTVG3VXs= X-Google-Smtp-Source: ABdhPJzijzo6ioS00wuiKABO8yIqAdnY++PvFY2VVoyDibH6mUISnEn2S3M0UFH97YKrzta/9OtNm9nXyxcfDWYs2xQ= X-Received: by 2002:a9f:35f0:0:b0:34c:2205:fe50 with SMTP id u45-20020a9f35f0000000b0034c2205fe50mr635787uad.2.1650578321144; Thu, 21 Apr 2022 14:58:41 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: From: Rich Date: Thu, 21 Apr 2022 17:58:34 -0400 Message-ID: Subject: Re: ZFS reservations for type=volume To: Alan Somers Cc: Michael Jung , freebsd-fs Content-Type: multipart/alternative; boundary="00000000000081810c05dd313637" X-Rspamd-Queue-Id: 4Kkryn6ZrGz3wLl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=hBeKwEdw; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rincebrain@gmail.com designates 2607:f8b0:4864:20::936 as permitted sender) smtp.mailfrom=rincebrain@gmail.com X-Spamd-Result: default: False [-2.74 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_MEDIUM(0.21)[0.211]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::936:from]; MLMMJ_DEST(0.00)[freebsd-fs]; NEURAL_HAM_SHORT(-0.95)[-0.953]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000081810c05dd313637 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable (My FBSD dev env isn't booted, but Linux and FBSD are the same in this regard...) # zpool list workspace NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT workspace 35.4T 12.9T 22.5T - - 3% 36% 1.00x DEGRADED - # zfs create workspace/testme # zfs list workspace workspace/testme NAME USED AVAIL REFER MOUNTPOINT workspace 13.0T 21.5T 48.9G /workspace workspace/testme 96K 21.5T 96K /workspace/testme # df -h /workspace/testme /workspace/ Filesystem Size Used Avail Use% Mounted on workspace/testme 22T 128K 22T 1% /workspace/testme workspace 22T 49G 22T 1% /workspace # zfs set reservation=3D1T workspace/testme # zpool list workspace NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT workspace 35.4T 12.9T 22.5T - - 3% 36% 1.00x DEGRADED - # zfs list workspace NAME USED AVAIL REFER MOUNTPOINT workspace 14.0T 20.5T 48.9G /workspace workspace/testme 96K 21.5T 96K /workspace/testme # df -h /workspace/testme /workspace/ Filesystem Size Used Avail Use% Mounted on workspace/testme 22T 128K 22T 1% /workspace/testme workspace 21T 49G 21T 1% /workspace # That is, AIUI, reservation counts against the USED/AVAIL/FREE shown by "zfs list" or "df" of everything not the reservation-holder , not against the "ALLOC" shown by zpool list...unless it's actually allocated, of course. - Rich On Thu, Apr 21, 2022 at 5:46 PM Alan Somers wrote: > Isn't 1.52T the "AVAIL" value, and 24.6T is the "USED"? > > On Thu, Apr 21, 2022 at 2:56 PM Michael Jung > wrote: > > > > Ok that makes sense... so even though running ZFS since 9.x I'll ask th= e > newbie question.. > > > > If it contributes to the parents "used" value why is not reflected here > in "USED" or in "AVAIL"? > > > > I would expect USED to be my reservation amount of 15.6T + whatever > space was > > being used by other things on the pool. "USED" still sits at 1.52T. > > > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE > > > > Thanks again. > > > > -----Original Message----- > > From: Alan Somers [mailto:asomers@freebsd.org] > > Sent: Thursday, April 21, 2022 4:40 PM > > To: Michael Jung > > Cc: freebsd-fs > > Subject: Re: ZFS reservations for type=3Dvolume > > > > A dataset's reservation is local. It doesn't contribute to its parent's > reservation. Otherwise, you wouldn't be able to separately set a > reservation on the parent. But it _does_ contribute to the parent's "used= " > value. In that way, you're prevented from reserving too much data on the > parent's children. > > -Alan > > > > On Thu, Apr 21, 2022 at 2:28 PM Michael Jung < > mikej@paymentallianceintl.com> wrote: > > > > > > I have a zfs block dataset raid-5400-1/esxi-store1 that I share as an > > > iscsi target and that works great. I have set a reservation > > > > > > on that block device equal to its size so that is not sparse and thus > > > while I could over provision guests on the provided LUN, > > > > > > the storage presented as the LUN capacity will always be available. A= t > least this is what I want to achieve. > > > > > > > > > > > > What I find strange is that the reservation does not seem to be > > > applied to the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you really = need > > > > > > to set your maximum reservation at the pool level, and then apply > > > reservations to all datasets on that volume? And if so > > > > > > I would assume you could never set reservations for datasets totaling > more than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99. > > > > > > > > > > > > I could build out a test environment and figure out constraints but > I=E2=80=99d really like to know the =E2=80=9Chow it is supposed to work= =E2=80=9D > > > > > > not the =E2=80=9Chow I find it to work=E2=80=9D. > > > > > > > > > > > > Thanks in advance. > > > > > > > > > > > > FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d: > > > > > > > > > > > > (this is a raidz2 pool =E2=80=93 not my draid pool) > > > > > > > > > > > > > > > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o > > > name,type,used,avail,ratio,compression,reservation,refreservation,vol= s > > > ize raid-5400-1 > > > > > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > > > > > > raid-5400-1 filesystem 18.0T 2.08T 1.36x on none none - <- no > reservation @pool > > > > > > root@draid:/usr/src/contrib/bearssl # > > > > > > > > > > > > root@draid:/usr/src/contrib/bearssl # zfs list -o > > > name,type,used,avail,ratio,compression,reservation,refreservation,vol= s > > > ize raid-5400-1/esxi-store1 > > > > > > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE > > > > > > raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15.6T 16.9T > 15.6T <- reservation @dataset > > > > > > > > > > > > root@draid:/usr/src/contrib/bearssl # zpool list > > > > > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > > > > > > ccache 9.50G 9.10G 406M - - 88% 95% 1.00x ONLINE - > > > > > > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE - <- Free does > not reflect reservation @pool > > > > > > tank 18.5T 605G 17.9T - - 0% 3% 1.00x ONLINE - > > > > > > zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x ONLINE - > > > > > > root@draid:/usr/src/contrib/bearssl # > > > > > > > > > > > > > > > > > > CONFIDENTIALITY NOTE: This message is intended only for the use of th= e > > > individual or entity to whom it is addressed and may contain > > > information that is privileged, confidential, and exempt from > > > disclosure under applicable law. If the reader of this message is not > > > the intended recipient, you are hereby notified that any > > > dissemination, distribution or copying of this communication is > > > strictly prohibited. If you have received this transmission in error, > > > please notify us by telephone at (502) 212-4000 or notify us at: PAI, > > > Dept. 99, > > > 2101 High Wickham Place, Suite 101, Louisville, KY 40245 > > > > > > > > > > > > > > > > > > Disclaimer > > > > > > The information contained in this communication from the sender is > confidential. It is intended solely for use by the recipient and others > authorized to receive it. If you are not the recipient, you are hereby > notified that any disclosure, copying, distribution or taking action in > relation of the contents of this information is strictly prohibited and m= ay > be unlawful. > > > > > > This email has been scanned for viruses and malware, and may have bee= n > automatically archived by Mimecast, a leader in email security and cyber > resilience. Mimecast integrates email defenses with brand protection, > security awareness training, web security, compliance and other essential > capabilities. Mimecast helps protect large and small organizations from > malicious activity, human error and technology failure; and to lead the > movement toward building a more resilient world. To find out more, visit > our website. > > > > > > > > > > CONFIDENTIALITY NOTE: This message is intended only for the use > > of the individual or entity to whom it is addressed and may > > contain information that is privileged, confidential, and > > exempt from disclosure under applicable law. If the reader > > of this message is not the intended recipient, you are hereby > > notified that any dissemination, distribution or copying > > of this communication is strictly prohibited. If you have > > received this transmission in error, please notify us by > > telephone at (502) 212-4000 or notify us at PAI, Dept. 99, > > 2101 High Wickham Place, Suite 101, Louisville, KY 40245 > > > > > > Disclaimer > > > > The information contained in this communication from the sender is > confidential. It is intended solely for use by the recipient and others > authorized to receive it. If you are not the recipient, you are hereby > notified that any disclosure, copying, distribution or taking action in > relation of the contents of this information is strictly prohibited and m= ay > be unlawful. > > > > This email has been scanned for viruses and malware, and may have been > automatically archived by Mimecast, a leader in email security and cyber > resilience. Mimecast integrates email defenses with brand protection, > security awareness training, web security, compliance and other essential > capabilities. Mimecast helps protect large and small organizations from > malicious activity, human error and technology failure; and to lead the > movement toward building a more resilient world. To find out more, visit > our website. > > --00000000000081810c05dd313637 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
(My FBSD dev env isn't booted, but Linux and FBSD= =C2=A0are the same in this regard...)

# zpool list work= space
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE =C2=A0ALLOC =C2=A0 FREE =C2= =A0CKPOINT =C2=A0EXPANDSZ =C2=A0 FRAG =C2=A0 =C2=A0CAP =C2=A0DEDUP =C2=A0 = =C2=A0HEALTH =C2=A0ALTROOT
workspace =C2=A035.4T =C2=A012.9T =C2=A022.5T= =C2=A0 =C2=A0 =C2=A0 =C2=A0- =C2=A0 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 =C2=A0 3= % =C2=A0 =C2=A036% =C2=A01.00x =C2=A0DEGRADED =C2=A0-
# zfs create works= pace/testme
# zfs list workspace workspace/testme
NAME =C2=A0 =C2=A0 = =C2=A0 =C2=A0USED =C2=A0AVAIL =C2=A0 =C2=A0 REFER =C2=A0MOUNTPOINT
works= pace =C2=A013.0T =C2=A021.5T =C2=A0 =C2=A0 48.9G =C2=A0/workspace
works= pace/testme =C2=A0 =C2=A096K =C2=A021.5T =C2=A0 =C2=A0 =C2=A0 96K =C2=A0/wo= rkspace/testme
# df -h /workspace/testme /workspace/
Filesystem =C2= =A0 =C2=A0 =C2=A0 =C2=A0Size =C2=A0Used Avail Use% Mounted on
workspace/= testme =C2=A0 22T =C2=A0128K =C2=A0 22T =C2=A0 1% /workspace/testme
work= space =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A022T =C2=A0 49G =C2=A0 22T =C2=A0 1%= /workspace
# zfs set reservation=3D1T workspace/testme
# zpool = list workspace
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0SIZE =C2=A0ALLOC =C2=A0 F= REE =C2=A0CKPOINT =C2=A0EXPANDSZ =C2=A0 FRAG =C2=A0 =C2=A0CAP =C2=A0DEDUP = =C2=A0 =C2=A0HEALTH =C2=A0ALTROOT
workspace =C2=A035.4T =C2=A012.9T =C2= =A022.5T =C2=A0 =C2=A0 =C2=A0 =C2=A0- =C2=A0 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 = =C2=A0 3% =C2=A0 =C2=A036% =C2=A01.00x =C2=A0DEGRADED =C2=A0-
# zfs= list workspace
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0USED =C2=A0AVAIL =C2=A0 = =C2=A0 REFER =C2=A0MOUNTPOINT
workspace =C2=A014.0T =C2=A020.5T =C2=A0 = =C2=A0 48.9G =C2=A0/workspace
workspace/testme =C2=A0 =C2=A096K = =C2=A021.5T =C2=A0 =C2=A0 =C2=A0 96K =C2=A0/workspace/testme
# df -h /wo= rkspace/testme /workspace/
Filesystem =C2=A0 =C2=A0 =C2=A0 =C2=A0Size = =C2=A0Used Avail Use% Mounted on
workspace/testme =C2=A0 22T =C2=A0128K = =C2=A0 22T =C2=A0 1% /workspace/testme
workspace =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A021T =C2=A0 49G =C2=A0 21T =C2=A0 1% /workspace
#
=
That is, AIUI, reservation counts against the USED/AVAIL/FRE= E shown by "zfs list" or "df" of everything not the res= ervation-holder , not against the "ALLOC" shown by zpool list...u= nless it's actually allocated, of course.

- Ri= ch

On Thu, Apr 21, 2022 at 5:46 PM Alan Somers <asomers@freebsd.org> wrote:
Isn't 1.52T the &quo= t;AVAIL" value, and 24.6T is the "USED"?

On Thu, Apr 21, 2022 at 2:56 PM Michael Jung
<mike= j@paymentallianceintl.com> wrote:
>
> Ok that makes sense... so even though running ZFS since 9.x I'll a= sk the newbie question..
>
> If it contributes to the parents "used" value why is not ref= lected here in "USED" or in "AVAIL"?
>
> I would expect USED to be my reservation amount of 15.6T + whatever sp= ace was
> being used by other things on the pool. "USED" still sits at= 1.52T.
>
> NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE
> raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE
>
> Thanks again.
>
> -----Original Message-----
> From: Alan Somers [mailto:asomers@freebsd.org]
> Sent: Thursday, April 21, 2022 4:40 PM
> To: Michael Jung <mikej@paymentallianceintl.com>
> Cc: freebsd-fs <freebsd-fs@freebsd.org>
> Subject: Re: ZFS reservations for type=3Dvolume
>
> A dataset's reservation is local. It doesn't contribute to its= parent's reservation. Otherwise, you wouldn't be able to separatel= y set a reservation on the parent. But it _does_ contribute to the parent&#= 39;s "used" value. In that way, you're prevented from reservi= ng too much data on the parent's children.
> -Alan
>
> On Thu, Apr 21, 2022 at 2:28 PM Michael Jung <mikej@paymentallianceintl.com= > wrote:
> >
> > I have a zfs block dataset raid-5400-1/esxi-store1 that I share a= s an
> > iscsi target and that works great. I have set a reservation
> >
> > on that block device equal to its size so that is not sparse and = thus
> > while I could over provision guests on the provided LUN,
> >
> > the storage presented as the LUN capacity will always be availabl= e. At least this is what I want to achieve.
> >
> >
> >
> > What I find strange is that the reservation does not seem to be > > applied to the ZFS pool =E2=80=98raid-5400-1=E2=80=99. Do you rea= lly need
> >
> > to set your maximum reservation at the pool level, and then apply=
> > reservations to all datasets on that volume? And if so
> >
> > I would assume you could never set reservations for datasets tota= ling more than what was reserved for the pool =E2=80=98raid-5400-1=E2=80=99= .
> >
> >
> >
> > I could build out a test environment and figure out constraints b= ut I=E2=80=99d really like to know the =E2=80=9Chow it is supposed to work= =E2=80=9D
> >
> > not the =E2=80=9Chow I find it to work=E2=80=9D.
> >
> >
> >
> > Thanks in advance.
> >
> >
> >
> > FreeBSD 14.0-CURRENT #4 main-n253875-8e72f458c6d:
> >
> >
> >
> > (this is a raidz2 pool =E2=80=93 not my draid pool)
> >
> >
> >
> >
> >
> > root@draid:/usr/src/contrib/bearssl # zfs list -o
> > name,type,used,avail,ratio,compression,reservation,refreservation= ,vols
> > ize raid-5400-1
> >
> > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE
> >
> > raid-5400-1 filesystem 18.0T 2.08T 1.36x on none none - <- no = reservation @pool
> >
> > root@draid:/usr/src/contrib/bearssl #
> >
> >
> >
> > root@draid:/usr/src/contrib/bearssl # zfs list -o
> > name,type,used,avail,ratio,compression,reservation,refreservation= ,vols
> > ize raid-5400-1/esxi-store1
> >
> > NAME TYPE USED AVAIL RATIO COMPRESS RESERV REFRESERV VOLSIZE
> >
> > raid-5400-1/esxi-store1 volume 16.9T 18.5T 1.78x zstd 15.6T 16.9T= 15.6T <- reservation @dataset
> >
> >
> >
> > root@draid:/usr/src/contrib/bearssl # zpool list
> >
> > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTRO= OT
> >
> > ccache 9.50G 9.10G 406M - - 88% 95% 1.00x ONLINE -
> >
> > raid-5400-1 24.6T 1.52T 23.1T - - 2% 6% 1.00x ONLINE - <- Free= does not reflect reservation @pool
> >
> > tank 18.5T 605G 17.9T - - 0% 3% 1.00x ONLINE -
> >
> > zfsroot 103G 33.3G 69.7G - - 31% 32% 1.00x ONLINE -
> >
> > root@draid:/usr/src/contrib/bearssl #
> >
> >
> >
> >
> >
> > CONFIDENTIALITY NOTE: This message is intended only for the use o= f the
> > individual or entity to whom it is addressed and may contain
> > information that is privileged, confidential, and exempt from
> > disclosure under applicable law. If the reader of this message is= not
> > the intended recipient, you are hereby notified that any
> > dissemination, distribution or copying of this communication is > > strictly prohibited. If you have received this transmission in er= ror,
> > please notify us by telephone at (502) 212-4000 or notify us at: = PAI,
> > Dept. 99,
> > 2101 High Wickham Place, Suite 101, Louisville, KY 40245
> >
> >
> >
> >
> >
> > Disclaimer
> >
> > The information contained in this communication from the sender i= s confidential. It is intended solely for use by the recipient and others a= uthorized to receive it. If you are not the recipient, you are hereby notif= ied that any disclosure, copying, distribution or taking action in relation= of the contents of this information is strictly prohibited and may be unla= wful.
> >
> > This email has been scanned for viruses and malware, and may have= been automatically archived by Mimecast, a leader in email security and cy= ber resilience. Mimecast integrates email defenses with brand protection, s= ecurity awareness training, web security, compliance and other essential ca= pabilities. Mimecast helps protect large and small organizations from malic= ious activity, human error and technology failure; and to lead the movement= toward building a more resilient world. To find out more, visit our websit= e.
>
>
>
>
> CONFIDENTIALITY NOTE: This message is intended only for the use
> of the individual or entity to whom it is addressed and may
> contain information that is privileged, confidential, and
> exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby
> notified that any dissemination, distribution or copying
> of this communication is strictly prohibited. If you have
> received this transmission in error, please notify us by
> telephone at (502) 212-4000 or notify us at PAI, Dept. 99,
> 2101 High Wickham Place, Suite 101, Louisville, KY 40245
>
>
> Disclaimer
>
> The information contained in this communication from the sender is con= fidential. It is intended solely for use by the recipient and others author= ized to receive it. If you are not the recipient, you are hereby notified t= hat any disclosure, copying, distribution or taking action in relation of t= he contents of this information is strictly prohibited and may be unlawful.=
>
> This email has been scanned for viruses and malware, and may have been= automatically archived by Mimecast, a leader in email security and cyber r= esilience. Mimecast integrates email defenses with brand protection, securi= ty awareness training, web security, compliance and other essential capabil= ities. Mimecast helps protect large and small organizations from malicious = activity, human error and technology failure; and to lead the movement towa= rd building a more resilient world. To find out more, visit our website.
--00000000000081810c05dd313637-- From nobody Thu Apr 21 23:39:55 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 79468198D1F3 for ; Thu, 21 Apr 2022 23:40:26 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from us-smtp-delivery-197.mimecast.com (us-smtp-delivery-197.mimecast.com [170.10.129.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mimecast.com", Issuer "DigiCert TLS RSA SHA256 2020 CA1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KkvD952NJz4jYD for ; Thu, 21 Apr 2022 23:40:25 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from MAIL-DR.pai.local (175.158.26.216.gopai.com [216.26.158.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id us-mta-605-adTbiCjPOPS57bewajk_4A-1; Thu, 21 Apr 2022 19:40:20 -0400 X-MC-Unique: adTbiCjPOPS57bewajk_4A-1 Received: from MAIL-HUB.pai.local (10.10.0.250) by MAIL-DR.pai.local (10.10.0.251) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Thu, 21 Apr 2022 19:39:55 -0400 Received: from MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8]) by MAIL-HUB.pai.local ([fe80::a02e:93c2:c16a:6af8%15]) with mapi id 15.00.1497.033; Thu, 21 Apr 2022 19:39:55 -0400 From: Michael Jung To: Rich , Alan Somers CC: freebsd-fs Subject: RE: ZFS reservations for type=volume Thread-Topic: ZFS reservations for type=volume Thread-Index: AdhVu5cQcIQitTxvR6aGtLet26JbwgAJfmSAAAgCV9D//9IRgIAAA60AgABALYA= Date: Thu, 21 Apr 2022 23:39:55 +0000 Message-ID: <6311b99b55e54237940e64b5c51be65c@MAIL-HUB.pai.local> References: <94c10113c3964b1bbd3f4ddf934c23cd@MAIL-HUB.pai.local> In-Reply-To: Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.250.0.59] x-c2processedorg: 474f336e-f930-49ec-9717-e3226b5b6e6e List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: paymentallianceintl.com Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_6311b99b55e54237940e64b5c51be65cMAILHUBpailocal_" X-Rspamd-Queue-Id: 4KkvD952NJz4jYD X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=paymentallianceintl.com; spf=pass (mx1.freebsd.org: domain of mikej@paymentallianceintl.com designates 170.10.129.197 as permitted sender) smtp.mailfrom=mikej@paymentallianceintl.com X-Spamd-Result: default: False [-1.90 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:170.10.129.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_SPAM_SHORT(0.90)[0.901]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[paymentallianceintl.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:30031, ipnet:170.10.128.0/23, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[170.10.129.197:from] X-ThisMailContainsUnwantedMimeParts: N --_000_6311b99b55e54237940e64b5c51be65cMAILHUBpailocal_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 VGhhbmsgeW91IFJpY2gsIGFuZCBBbGxhbiBJIHNob3VsZCBoYXZlIHBhaWQgY2xvc2VyIGF0dGVu dGlvbiBhbmQgdGhvdWdodCBhYm91dCBpdCBqdXN0IGEgbGl0dGxlIG1vcmUuDQoNCmRmIGRvZXMg bm90IGhlbHAgb24gdHlwZT12b2x1bWUgYXMgdGhhdCBpcyBub3JtYWxseSBub3QgYSBaRlMgbW91 bnRlZCBmaWxlc3lzdGVtIGp1c3QgYSBibG9jayBkZXZpY2UgYnV0IGl0IGNhbiBiZSAoc2VlIGJl bG93KQ0KDQpIb3BlZnVsbHkgdGhpcyB3aWxsIGhlbHAgc29tZW9uZSBlbHNlLg0KDQpyb290QGRy YWlkOi91c3Ivc3JjL3N0YW5kL2xpYnNhL3pmcyAjIHpmcyBsaXN0IC1vIHVzZWQgIHJhaWQtNTQw MC0xDQpVU0VEDQoxOC4wVA0Kcm9vdEBkcmFpZDovdXNyL3NyYy9zdGFuZC9saWJzYS96ZnMgIyB6 ZnMgbGlzdCAtbyB1c2VkICByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMQ0KVVNFRA0KMTYuOVQgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICA8LSBNeSByZXNlcnZhdGlvbiBhbW91bnQNCnJvb3RAZHJhaWQ6L3Vzci9zcmMvc3Rh bmQvbGlic2EvemZzICMNCg0KDQoNCnJvb3RAZHJhaWQ6L3Vzci9zcmMvc3RhbmQvbGlic2EvemZz ICMgemZzIGxpc3QgLW8gYXZhaWwgIHJhaWQtNTQwMC0xDQpBVkFJTA0KMi4wOFQNCnJvb3RAZHJh aWQ6L3Vzci9zcmMvc3RhbmQvbGlic2EvemZzICMgemZzIGxpc3QgLW8gYXZhaWwgIHJhaWQtNTQw MC0xL2VzeGktc3RvcmUxDQpBVkFJTA0KMTguNVQNCg0KSSBndWVzcyBhcyBNci4gT2J2aW91cyB3 b3VsZCBzYXkg4oCcWkZTIDxjb21tYW5kPiDigJwgaXMgdGhlIGRhdGFzZXQg4oCTIOKAnFpwb29s IDxjb21tYW5kPuKAnSBpcyB0aGUgcG9vbC4NCg0Kcm9vdEBkcmFpZDovdXNyL3NyYy9zdGFuZC9s aWJzYS96ZnMgIyB6ZnMgbGlzdA0KTkFNRSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICBVU0VEICBBVkFJTCAgUkVGRVIgIE1PVU5UUE9JTlQNCnJhaWQtNTQwMC0xICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDE4LjBUICAyLjA4VCAgIDIzNksgIC9yYWlk LTU0MDAtMSAgICAgICAgPC0gUG9vbA0KcmFpZC01NDAwLTEvZXN4aS1zdG9yZTEgICAgICAgICAg MTYuOVQgIDE4LjVUICAgNTIyRyAgLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDwtIHR5 cGU9dm9sdW1lIHdpdGggcmVzZXJ2YXRpb24NCnJhaWQtNTQwMC0xL3VuaXRyZW5kczEgICAgICAg ICAgIDEuMDhUICAyLjQzVCAgIDc1MkcgIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICA8 LSB0eXBlPXZvbHVtZSB3aXRob3V0IHJlc2VydmF0aW9uDQoNCk5vdGU6IEkgaGF2ZSBzaW1wbHkg bm90IHJlc2VydmVkIGFsbCAxOC41VCB5ZXQgb2YgcmFpZC01NDAwLTEvZXN4aS1zdG9yZTEgYnV0 IEkgYW0gZG9pbmcgdGhhdCBub3cg4oCTIG5ldmVyIGhhZCBhIHJlYXNvbiB0byB1c2UgcmVzZXJ2 YXRpb25zIGluIHRoZSBwYXN0IGJ1dCBJIGhhdmUgYSB0ZXN0IGxhYiBAaG9tZSB3aXRoIGEgbG90 IG9mIHZpc3VhbGl6YXRpb24gYWxsIGJlaW5nIG1pZ3JhdGVkIHRvIElTQ1NJIHRhcmdldHMgYW5k IEkgY2VydGFpbmx5IGRvbuKAmXQgd2FudCB0byBoYXZlIHRvIHdvcnJ5IGFib3V0IHRoaW4gPHBp Y2sgeW91IGd1ZXN0IHR5cGU+IG9uIHRvcCBvZiB0aGluIExVTlMgc28gSeKAmW0gc3RhcnRpbmcg d2l0aCBzb21lIGRpc3Bvc2FibGUgcG9vbHMgdG8gbGVhcm4uICBXaGVuIEkgc3RhcnQgc2h1ZmZs aW5nIHRoZSByZWFsIGRhdGEgYXJvdW5kICh+NTBUQispIEkgZG9u4oCZdCB3YW50IHVuZm9yZXNl ZW4gaXNzdWVzIDstKSDigJMgTm8gYmFja3VwcyBmb3IgZXZlcnl0aGluZyAkJCQgIGJ1dCBpdHMg Y2xvc2UgZW5vdWdoIOKYug0KDQotLW1pa2VqDQoNCg0KDQoNCkNPTkZJREVOVElBTElUWSBOT1RF OiBUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVzZQ0Kb2YgdGhlIGluZGl2 aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBtYXkNCmNvbnRhaW4g aW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBjb25maWRlbnRpYWwsIGFuZA0KZXhlbXB0 IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYgdGhlIHJlYWRlcg0Kb2Yg dGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVi eQ0Kbm90aWZpZWQgdGhhdCBhbnkgZGlzc2VtaW5hdGlvbiwgZGlzdHJpYnV0aW9uIG9yIGNvcHlp bmcNCm9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkLiBJZiB5b3Ug aGF2ZQ0KcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3IsIHBsZWFzZSBub3RpZnkg dXMgYnkNCnRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAwMCBvciBub3RpZnkgdXMgYXQ6IFBBSSwg RGVwdC4gOTksDQoyMTAxIEhpZ2ggV2lja2hhbSBQbGFjZSwgU3VpdGUgMTAxLCBMb3Vpc3ZpbGxl LCBLWSA0MDI0NQ0KDQoNCg0KRnJvbTogUmljaCBbbWFpbHRvOnJpbmNlYnJhaW5AZ21haWwuY29t XQ0KU2VudDogVGh1cnNkYXksIEFwcmlsIDIxLCAyMDIyIDU6NTkgUE0NClRvOiBBbGFuIFNvbWVy cyA8YXNvbWVyc0BmcmVlYnNkLm9yZz4NCkNjOiBNaWNoYWVsIEp1bmcgPG1pa2VqQHBheW1lbnRh bGxpYW5jZWludGwuY29tPjsgZnJlZWJzZC1mcyA8ZnJlZWJzZC1mc0BmcmVlYnNkLm9yZz4NClN1 YmplY3Q6IFJlOiBaRlMgcmVzZXJ2YXRpb25zIGZvciB0eXBlPXZvbHVtZQ0KDQooTXkgRkJTRCBk ZXYgZW52IGlzbid0IGJvb3RlZCwgYnV0IExpbnV4IGFuZCBGQlNEIGFyZSB0aGUgc2FtZSBpbiB0 aGlzIHJlZ2FyZC4uLikNCg0KIyB6cG9vbCBsaXN0IHdvcmtzcGFjZQ0KTkFNRSAgICAgICAgU0la RSAgQUxMT0MgICBGUkVFICBDS1BPSU5UICBFWFBBTkRTWiAgIEZSQUcgICAgQ0FQICBERURVUCAg ICBIRUFMVEggIEFMVFJPT1QNCndvcmtzcGFjZSAgMzUuNFQgIDEyLjlUICAyMi41VCAgICAgICAg LSAgICAgICAgIC0gICAgIDMlICAgIDM2JSAgMS4wMHggIERFR1JBREVEICAtDQojIHpmcyBjcmVh dGUgd29ya3NwYWNlL3Rlc3RtZQ0KIyB6ZnMgbGlzdCB3b3Jrc3BhY2Ugd29ya3NwYWNlL3Rlc3Rt ZQ0KTkFNRSAgICAgICAgVVNFRCAgQVZBSUwgICAgIFJFRkVSICBNT1VOVFBPSU5UDQp3b3Jrc3Bh Y2UgIDEzLjBUICAyMS41VCAgICAgNDguOUcgIC93b3Jrc3BhY2UNCndvcmtzcGFjZS90ZXN0bWUg ICAgOTZLICAyMS41VCAgICAgICA5NksgIC93b3Jrc3BhY2UvdGVzdG1lDQojIGRmIC1oIC93b3Jr c3BhY2UvdGVzdG1lIC93b3Jrc3BhY2UvDQpGaWxlc3lzdGVtICAgICAgICBTaXplICBVc2VkIEF2 YWlsIFVzZSUgTW91bnRlZCBvbg0Kd29ya3NwYWNlL3Rlc3RtZSAgIDIyVCAgMTI4SyAgIDIyVCAg IDElIC93b3Jrc3BhY2UvdGVzdG1lDQp3b3Jrc3BhY2UgICAgICAgICAgMjJUICAgNDlHICAgMjJU ICAgMSUgL3dvcmtzcGFjZQ0KIyB6ZnMgc2V0IHJlc2VydmF0aW9uPTFUIHdvcmtzcGFjZS90ZXN0 bWUNCiMgenBvb2wgbGlzdCB3b3Jrc3BhY2UNCk5BTUUgICAgICAgIFNJWkUgIEFMTE9DICAgRlJF RSAgQ0tQT0lOVCAgRVhQQU5EU1ogICBGUkFHICAgIENBUCAgREVEVVAgICAgSEVBTFRIICBBTFRS T09UDQp3b3Jrc3BhY2UgIDM1LjRUICAxMi45VCAgMjIuNVQgICAgICAgIC0gICAgICAgICAtICAg ICAzJSAgICAzNiUgIDEuMDB4ICBERUdSQURFRCAgLQ0KIyB6ZnMgbGlzdCB3b3Jrc3BhY2UNCk5B TUUgICAgICAgIFVTRUQgIEFWQUlMICAgICBSRUZFUiAgTU9VTlRQT0lOVA0Kd29ya3NwYWNlICAx NC4wVCAgMjAuNVQgICAgIDQ4LjlHICAvd29ya3NwYWNlDQp3b3Jrc3BhY2UvdGVzdG1lICAgIDk2 SyAgMjEuNVQgICAgICAgOTZLICAvd29ya3NwYWNlL3Rlc3RtZQ0KIyBkZiAtaCAvd29ya3NwYWNl L3Rlc3RtZSAvd29ya3NwYWNlLw0KRmlsZXN5c3RlbSAgICAgICAgU2l6ZSAgVXNlZCBBdmFpbCBV c2UlIE1vdW50ZWQgb24NCndvcmtzcGFjZS90ZXN0bWUgICAyMlQgIDEyOEsgICAyMlQgICAxJSAv d29ya3NwYWNlL3Rlc3RtZQ0Kd29ya3NwYWNlICAgICAgICAgIDIxVCAgIDQ5RyAgIDIxVCAgIDEl IC93b3Jrc3BhY2UNCiMNCg0KVGhhdCBpcywgQUlVSSwgcmVzZXJ2YXRpb24gY291bnRzIGFnYWlu c3QgdGhlIFVTRUQvQVZBSUwvRlJFRSBzaG93biBieSAiemZzIGxpc3QiIG9yICJkZiIgb2YgZXZl cnl0aGluZyBub3QgdGhlIHJlc2VydmF0aW9uLWhvbGRlciAsIG5vdCBhZ2FpbnN0IHRoZSAiQUxM T0MiIHNob3duIGJ5IHpwb29sIGxpc3QuLi51bmxlc3MgaXQncyBhY3R1YWxseSBhbGxvY2F0ZWQs IG9mIGNvdXJzZS4NCg0KLSBSaWNoDQoNCk9uIFRodSwgQXByIDIxLCAyMDIyIGF0IDU6NDYgUE0g QWxhbiBTb21lcnMgPGFzb21lcnNAZnJlZWJzZC5vcmc8bWFpbHRvOmFzb21lcnNAZnJlZWJzZC5v cmc+PiB3cm90ZToNCklzbid0IDEuNTJUIHRoZSAiQVZBSUwiIHZhbHVlLCBhbmQgMjQuNlQgaXMg dGhlICJVU0VEIj8NCg0KT24gVGh1LCBBcHIgMjEsIDIwMjIgYXQgMjo1NiBQTSBNaWNoYWVsIEp1 bmcNCjxtaWtlakBwYXltZW50YWxsaWFuY2VpbnRsLmNvbTxtYWlsdG86bWlrZWpAcGF5bWVudGFs bGlhbmNlaW50bC5jb20+PiB3cm90ZToNCj4NCj4gT2sgdGhhdCBtYWtlcyBzZW5zZS4uLiBzbyBl dmVuIHRob3VnaCBydW5uaW5nIFpGUyBzaW5jZSA5LnggSSdsbCBhc2sgdGhlIG5ld2JpZSBxdWVz dGlvbi4uDQo+DQo+IElmIGl0IGNvbnRyaWJ1dGVzIHRvIHRoZSBwYXJlbnRzICJ1c2VkIiB2YWx1 ZSB3aHkgaXMgbm90IHJlZmxlY3RlZCBoZXJlIGluICJVU0VEIiBvciBpbiAiQVZBSUwiPw0KPg0K PiBJIHdvdWxkIGV4cGVjdCBVU0VEIHRvIGJlIG15IHJlc2VydmF0aW9uIGFtb3VudCBvZiAxNS42 VCArIHdoYXRldmVyIHNwYWNlIHdhcw0KPiBiZWluZyB1c2VkIGJ5IG90aGVyIHRoaW5ncyBvbiB0 aGUgcG9vbC4gIlVTRUQiIHN0aWxsIHNpdHMgYXQgMS41MlQuDQo+DQo+IE5BTUUgVFlQRSBVU0VE IEFWQUlMIFJBVElPIENPTVBSRVNTIFJFU0VSViBSRUZSRVNFUlYgVk9MU0laRQ0KPiByYWlkLTU0 MDAtMSAyNC42VCAxLjUyVCAyMy4xVCAtIC0gMiUgNiUgMS4wMHggT05MSU5FDQo+DQo+IFRoYW5r cyBhZ2Fpbi4NCj4NCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCj4gRnJvbTogQWxhbiBT b21lcnMgW21haWx0bzphc29tZXJzQGZyZWVic2Qub3JnPG1haWx0bzphc29tZXJzQGZyZWVic2Qu b3JnPl0NCj4gU2VudDogVGh1cnNkYXksIEFwcmlsIDIxLCAyMDIyIDQ6NDAgUE0NCj4gVG86IE1p Y2hhZWwgSnVuZyA8bWlrZWpAcGF5bWVudGFsbGlhbmNlaW50bC5jb208bWFpbHRvOm1pa2VqQHBh eW1lbnRhbGxpYW5jZWludGwuY29tPj4NCj4gQ2M6IGZyZWVic2QtZnMgPGZyZWVic2QtZnNAZnJl ZWJzZC5vcmc8bWFpbHRvOmZyZWVic2QtZnNAZnJlZWJzZC5vcmc+Pg0KPiBTdWJqZWN0OiBSZTog WkZTIHJlc2VydmF0aW9ucyBmb3IgdHlwZT12b2x1bWUNCj4NCj4gQSBkYXRhc2V0J3MgcmVzZXJ2 YXRpb24gaXMgbG9jYWwuIEl0IGRvZXNuJ3QgY29udHJpYnV0ZSB0byBpdHMgcGFyZW50J3MgcmVz ZXJ2YXRpb24uIE90aGVyd2lzZSwgeW91IHdvdWxkbid0IGJlIGFibGUgdG8gc2VwYXJhdGVseSBz ZXQgYSByZXNlcnZhdGlvbiBvbiB0aGUgcGFyZW50LiBCdXQgaXQgX2RvZXNfIGNvbnRyaWJ1dGUg dG8gdGhlIHBhcmVudCdzICJ1c2VkIiB2YWx1ZS4gSW4gdGhhdCB3YXksIHlvdSdyZSBwcmV2ZW50 ZWQgZnJvbSByZXNlcnZpbmcgdG9vIG11Y2ggZGF0YSBvbiB0aGUgcGFyZW50J3MgY2hpbGRyZW4u DQo+IC1BbGFuDQo+DQo+IE9uIFRodSwgQXByIDIxLCAyMDIyIGF0IDI6MjggUE0gTWljaGFlbCBK dW5nIDxtaWtlakBwYXltZW50YWxsaWFuY2VpbnRsLmNvbTxtYWlsdG86bWlrZWpAcGF5bWVudGFs bGlhbmNlaW50bC5jb20+PiB3cm90ZToNCj4gPg0KPiA+IEkgaGF2ZSBhIHpmcyBibG9jayBkYXRh c2V0IHJhaWQtNTQwMC0xL2VzeGktc3RvcmUxIHRoYXQgSSBzaGFyZSBhcyBhbg0KPiA+IGlzY3Np IHRhcmdldCBhbmQgdGhhdCB3b3JrcyBncmVhdC4gSSBoYXZlIHNldCBhIHJlc2VydmF0aW9uDQo+ ID4NCj4gPiBvbiB0aGF0IGJsb2NrIGRldmljZSBlcXVhbCB0byBpdHMgc2l6ZSBzbyB0aGF0IGlz IG5vdCBzcGFyc2UgYW5kIHRodXMNCj4gPiB3aGlsZSBJIGNvdWxkIG92ZXIgcHJvdmlzaW9uIGd1 ZXN0cyBvbiB0aGUgcHJvdmlkZWQgTFVOLA0KPiA+DQo+ID4gdGhlIHN0b3JhZ2UgcHJlc2VudGVk IGFzIHRoZSBMVU4gY2FwYWNpdHkgd2lsbCBhbHdheXMgYmUgYXZhaWxhYmxlLiBBdCBsZWFzdCB0 aGlzIGlzIHdoYXQgSSB3YW50IHRvIGFjaGlldmUuDQo+ID4NCj4gPg0KPiA+DQo+ID4gV2hhdCBJ IGZpbmQgc3RyYW5nZSBpcyB0aGF0IHRoZSByZXNlcnZhdGlvbiBkb2VzIG5vdCBzZWVtIHRvIGJl DQo+ID4gYXBwbGllZCB0byB0aGUgWkZTIHBvb2wg4oCYcmFpZC01NDAwLTHigJkuIERvIHlvdSBy ZWFsbHkgbmVlZA0KPiA+DQo+ID4gdG8gc2V0IHlvdXIgbWF4aW11bSByZXNlcnZhdGlvbiBhdCB0 aGUgcG9vbCBsZXZlbCwgYW5kIHRoZW4gYXBwbHkNCj4gPiByZXNlcnZhdGlvbnMgdG8gYWxsIGRh dGFzZXRzIG9uIHRoYXQgdm9sdW1lPyBBbmQgaWYgc28NCj4gPg0KPiA+IEkgd291bGQgYXNzdW1l IHlvdSBjb3VsZCBuZXZlciBzZXQgcmVzZXJ2YXRpb25zIGZvciBkYXRhc2V0cyB0b3RhbGluZyBt b3JlIHRoYW4gd2hhdCB3YXMgcmVzZXJ2ZWQgZm9yIHRoZSBwb29sIOKAmHJhaWQtNTQwMC0x4oCZ Lg0KPiA+DQo+ID4NCj4gPg0KPiA+IEkgY291bGQgYnVpbGQgb3V0IGEgdGVzdCBlbnZpcm9ubWVu dCBhbmQgZmlndXJlIG91dCBjb25zdHJhaW50cyBidXQgSeKAmWQgcmVhbGx5IGxpa2UgdG8ga25v dyB0aGUg4oCcaG93IGl0IGlzIHN1cHBvc2VkIHRvIHdvcmvigJ0NCj4gPg0KPiA+IG5vdCB0aGUg 4oCcaG93IEkgZmluZCBpdCB0byB3b3Jr4oCdLg0KPiA+DQo+ID4NCj4gPg0KPiA+IFRoYW5rcyBp biBhZHZhbmNlLg0KPiA+DQo+ID4NCj4gPg0KPiA+IEZyZWVCU0QgMTQuMC1DVVJSRU5UICM0IG1h aW4tbjI1Mzg3NS04ZTcyZjQ1OGM2ZDoNCj4gPg0KPiA+DQo+ID4NCj4gPiAodGhpcyBpcyBhIHJh aWR6MiBwb29sIOKAkyBub3QgbXkgZHJhaWQgcG9vbCkNCj4gPg0KPiA+DQo+ID4NCj4gPg0KPiA+ DQo+ID4gcm9vdEBkcmFpZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIyB6ZnMgbGlzdCAtbw0K PiA+IG5hbWUsdHlwZSx1c2VkLGF2YWlsLHJhdGlvLGNvbXByZXNzaW9uLHJlc2VydmF0aW9uLHJl ZnJlc2VydmF0aW9uLHZvbHMNCj4gPiBpemUgcmFpZC01NDAwLTENCj4gPg0KPiA+IE5BTUUgVFlQ RSBVU0VEIEFWQUlMIFJBVElPIENPTVBSRVNTIFJFU0VSViBSRUZSRVNFUlYgVk9MU0laRQ0KPiA+ DQo+ID4gcmFpZC01NDAwLTEgZmlsZXN5c3RlbSAxOC4wVCAyLjA4VCAxLjM2eCBvbiBub25lIG5v bmUgLSA8LSBubyByZXNlcnZhdGlvbiBAcG9vbA0KPiA+DQo+ID4gcm9vdEBkcmFpZDovdXNyL3Ny Yy9jb250cmliL2JlYXJzc2wgIw0KPiA+DQo+ID4NCj4gPg0KPiA+IHJvb3RAZHJhaWQ6L3Vzci9z cmMvY29udHJpYi9iZWFyc3NsICMgemZzIGxpc3QgLW8NCj4gPiBuYW1lLHR5cGUsdXNlZCxhdmFp bCxyYXRpbyxjb21wcmVzc2lvbixyZXNlcnZhdGlvbixyZWZyZXNlcnZhdGlvbix2b2xzDQo+ID4g aXplIHJhaWQtNTQwMC0xL2VzeGktc3RvcmUxDQo+ID4NCj4gPiBOQU1FIFRZUEUgVVNFRCBBVkFJ TCBSQVRJTyBDT01QUkVTUyBSRVNFUlYgUkVGUkVTRVJWIFZPTFNJWkUNCj4gPg0KPiA+IHJhaWQt NTQwMC0xL2VzeGktc3RvcmUxIHZvbHVtZSAxNi45VCAxOC41VCAxLjc4eCB6c3RkIDE1LjZUIDE2 LjlUIDE1LjZUIDwtIHJlc2VydmF0aW9uIEBkYXRhc2V0DQo+ID4NCj4gPg0KPiA+DQo+ID4gcm9v dEBkcmFpZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIyB6cG9vbCBsaXN0DQo+ID4NCj4gPiBO QU1FIFNJWkUgQUxMT0MgRlJFRSBDS1BPSU5UIEVYUEFORFNaIEZSQUcgQ0FQIERFRFVQIEhFQUxU SCBBTFRST09UDQo+ID4NCj4gPiBjY2FjaGUgOS41MEcgOS4xMEcgNDA2TSAtIC0gODglIDk1JSAx LjAweCBPTkxJTkUgLQ0KPiA+DQo+ID4gcmFpZC01NDAwLTEgMjQuNlQgMS41MlQgMjMuMVQgLSAt IDIlIDYlIDEuMDB4IE9OTElORSAtIDwtIEZyZWUgZG9lcyBub3QgcmVmbGVjdCByZXNlcnZhdGlv biBAcG9vbA0KPiA+DQo+ID4gdGFuayAxOC41VCA2MDVHIDE3LjlUIC0gLSAwJSAzJSAxLjAweCBP TkxJTkUgLQ0KPiA+DQo+ID4gemZzcm9vdCAxMDNHIDMzLjNHIDY5LjdHIC0gLSAzMSUgMzIlIDEu MDB4IE9OTElORSAtDQo+ID4NCj4gPiByb290QGRyYWlkOi91c3Ivc3JjL2NvbnRyaWIvYmVhcnNz bCAjDQo+ID4NCj4gPg0KPiA+DQo+ID4NCj4gPg0KPiA+IENPTkZJREVOVElBTElUWSBOT1RFOiBU aGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVzZSBvZiB0aGUNCj4gPiBpbmRp dmlkdWFsIG9yIGVudGl0eSB0byB3aG9tIGl0IGlzIGFkZHJlc3NlZCBhbmQgbWF5IGNvbnRhaW4N Cj4gPiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVnZWQsIGNvbmZpZGVudGlhbCwgYW5kIGV4 ZW1wdCBmcm9tDQo+ID4gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYgdGhlIHJl YWRlciBvZiB0aGlzIG1lc3NhZ2UgaXMgbm90DQo+ID4gdGhlIGludGVuZGVkIHJlY2lwaWVudCwg eW91IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkNCj4gPiBkaXNzZW1pbmF0aW9uLCBkaXN0 cmlidXRpb24gb3IgY29weWluZyBvZiB0aGlzIGNvbW11bmljYXRpb24gaXMNCj4gPiBzdHJpY3Rs eSBwcm9oaWJpdGVkLiBJZiB5b3UgaGF2ZSByZWNlaXZlZCB0aGlzIHRyYW5zbWlzc2lvbiBpbiBl cnJvciwNCj4gPiBwbGVhc2Ugbm90aWZ5IHVzIGJ5IHRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAw MCBvciBub3RpZnkgdXMgYXQ6IFBBSSwNCj4gPiBEZXB0LiA5OSwNCj4gPiAyMTAxIEhpZ2ggV2lj a2hhbSBQbGFjZSwgU3VpdGUgMTAxLCBMb3Vpc3ZpbGxlLCBLWSA0MDI0NQ0KPiA+DQo+ID4NCj4g Pg0KPiA+DQo+ID4NCj4gPiBEaXNjbGFpbWVyDQo+ID4NCj4gPiBUaGUgaW5mb3JtYXRpb24gY29u dGFpbmVkIGluIHRoaXMgY29tbXVuaWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50 aWFsLiBJdCBpcyBpbnRlbmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBv dGhlcnMgYXV0aG9yaXplZCB0byByZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBp ZW50LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5n LCBkaXN0cmlidXRpb24gb3IgdGFraW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVu dHMgb2YgdGhpcyBpbmZvcm1hdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUg dW5sYXdmdWwuDQo+ID4NCj4gPiBUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5uZWQgZm9yIHZpcnVz ZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2FsbHkgYXJjaGl2ZWQg YnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBjeWJlciByZXNpbGll bmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGggYnJhbmQgcHJvdGVj dGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJpdHksIGNvbXBsaWFu Y2UgYW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMuIE1pbWVjYXN0IGhlbHBzIHByb3Rl Y3QgbGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJvbSBtYWxpY2lvdXMgYWN0aXZpdHks IGh1bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7IGFuZCB0byBsZWFkIHRoZSBtb3Zl bWVudCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVudCB3b3JsZC4gVG8gZmluZCBvdXQg bW9yZSwgdmlzaXQgb3VyIHdlYnNpdGUuDQo+DQo+DQo+DQo+DQo+IENPTkZJREVOVElBTElUWSBO T1RFOiBUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVzZQ0KPiBvZiB0aGUg aW5kaXZpZHVhbCBvciBlbnRpdHkgdG8gd2hvbSBpdCBpcyBhZGRyZXNzZWQgYW5kIG1heQ0KPiBj b250YWluIGluZm9ybWF0aW9uIHRoYXQgaXMgcHJpdmlsZWdlZCwgY29uZmlkZW50aWFsLCBhbmQN Cj4gZXhlbXB0IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxlIGxhdy4gSWYgdGhlIHJl YWRlcg0KPiBvZiB0aGlzIG1lc3NhZ2UgaXMgbm90IHRoZSBpbnRlbmRlZCByZWNpcGllbnQsIHlv dSBhcmUgaGVyZWJ5DQo+IG5vdGlmaWVkIHRoYXQgYW55IGRpc3NlbWluYXRpb24sIGRpc3RyaWJ1 dGlvbiBvciBjb3B5aW5nDQo+IG9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJpY3RseSBwcm9o aWJpdGVkLiBJZiB5b3UgaGF2ZQ0KPiByZWNlaXZlZCB0aGlzIHRyYW5zbWlzc2lvbiBpbiBlcnJv ciwgcGxlYXNlIG5vdGlmeSB1cyBieQ0KPiB0ZWxlcGhvbmUgYXQgKDUwMikgMjEyLTQwMDAgb3Ig bm90aWZ5IHVzIGF0IFBBSSwgRGVwdC4gOTksDQo+IDIxMDEgSGlnaCBXaWNraGFtIFBsYWNlLCBT dWl0ZSAxMDEsIExvdWlzdmlsbGUsIEtZIDQwMjQ1DQo+DQo+DQo+IERpc2NsYWltZXINCj4NCj4g VGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUg c2VuZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkg dGhlIHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91 IGFyZSBub3QgdGhlIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkg ZGlzY2xvc3VyZSwgY29weWluZywgZGlzdHJpYnV0aW9uIG9yIHRha2luZyBhY3Rpb24gaW4gcmVs YXRpb24gb2YgdGhlIGNvbnRlbnRzIG9mIHRoaXMgaW5mb3JtYXRpb24gaXMgc3RyaWN0bHkgcHJv aGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVsLg0KPg0KPiBUaGlzIGVtYWlsIGhhcyBiZWVuIHNj YW5uZWQgZm9yIHZpcnVzZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRp Y2FsbHkgYXJjaGl2ZWQgYnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFu ZCBjeWJlciByZXNpbGllbmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdp dGggYnJhbmQgcHJvdGVjdGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2Vj dXJpdHksIGNvbXBsaWFuY2UgYW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMuIE1pbWVj YXN0IGhlbHBzIHByb3RlY3QgbGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJvbSBtYWxp Y2lvdXMgYWN0aXZpdHksIGh1bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7IGFuZCB0 byBsZWFkIHRoZSBtb3ZlbWVudCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVudCB3b3Js ZC4gVG8gZmluZCBvdXQgbW9yZSwgdmlzaXQgb3VyIHdlYnNpdGUuDQoNCkRpc2NsYWltZXINCg0K VGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUg c2VuZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkg dGhlIHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91 IGFyZSBub3QgdGhlIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkg ZGlzY2xvc3VyZSwgY29weWluZywgZGlzdHJpYnV0aW9uIG9yIHRha2luZyBhY3Rpb24gaW4gcmVs YXRpb24gb2YgdGhlIGNvbnRlbnRzIG9mIHRoaXMgaW5mb3JtYXRpb24gaXMgc3RyaWN0bHkgcHJv aGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVsLg0KDQpUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5u ZWQgZm9yIHZpcnVzZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2Fs bHkgYXJjaGl2ZWQgYnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBj eWJlciByZXNpbGllbmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGgg YnJhbmQgcHJvdGVjdGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJp dHksIGNvbXBsaWFuY2UgYW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMuIE1pbWVjYXN0 IGhlbHBzIHByb3RlY3QgbGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJvbSBtYWxpY2lv dXMgYWN0aXZpdHksIGh1bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7IGFuZCB0byBs ZWFkIHRoZSBtb3ZlbWVudCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVudCB3b3JsZC4g VG8gZmluZCBvdXQgbW9yZSwgdmlzaXQgb3VyIHdlYnNpdGUuDQo= --_000_6311b99b55e54237940e64b5c51be65cMAILHUBpailocal_ Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+DQo8bWV0YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRl eHQvaHRtbDsgY2hhcnNldD11dGYtOCI+DQo8bWV0YSBuYW1lPSJHZW5lcmF0b3IiIGNvbnRlbnQ9 Ik1pY3Jvc29mdCBXb3JkIDE1IChmaWx0ZXJlZCBtZWRpdW0pIj4NCjxzdHlsZT48IS0tDQovKiBG b250IERlZmluaXRpb25zICovDQpAZm9udC1mYWNlDQoJe2ZvbnQtZmFtaWx5OldpbmdkaW5nczsN CglwYW5vc2UtMTo1IDAgMCAwIDAgMCAwIDAgMCAwO30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1p bHk6IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9u dC1mYWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJcGFub3NlLTE6MiAxNSA1IDIgMiAyIDQg MyAyIDQ7fQ0KLyogU3R5bGUgRGVmaW5pdGlvbnMgKi8NCnAuTXNvTm9ybWFsLCBsaS5Nc29Ob3Jt YWwsIGRpdi5Nc29Ob3JtYWwNCgl7bWFyZ2luOjBpbjsNCgltYXJnaW4tYm90dG9tOi4wMDAxcHQ7 DQoJZm9udC1zaXplOjEyLjBwdDsNCglmb250LWZhbWlseToiVGltZXMgTmV3IFJvbWFuIixzZXJp Zjt9DQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5rDQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsN Cgljb2xvcjpibHVlOw0KCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQ0KYTp2aXNpdGVkLCBz cGFuLk1zb0h5cGVybGlua0ZvbGxvd2VkDQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xv cjpwdXJwbGU7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQpzcGFuLkVtYWlsU3R5bGUx Nw0KCXttc28tc3R5bGUtdHlwZTpwZXJzb25hbC1yZXBseTsNCglmb250LWZhbWlseToiQ2FsaWJy aSIsc2Fucy1zZXJpZjsNCgljb2xvcjojMUY0OTdEO30NCi5Nc29DaHBEZWZhdWx0DQoJe21zby1z dHlsZS10eXBlOmV4cG9ydC1vbmx5Ow0KCWZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlm O30NCkBwYWdlIFdvcmRTZWN0aW9uMQ0KCXtzaXplOjguNWluIDExLjBpbjsNCgltYXJnaW46MS4w aW4gMS4waW4gMS4waW4gMS4waW47fQ0KZGl2LldvcmRTZWN0aW9uMQ0KCXtwYWdlOldvcmRTZWN0 aW9uMTt9DQotLT48L3N0eWxlPjwhLS1baWYgZ3RlIG1zbyA5XT48eG1sPg0KPG86c2hhcGVkZWZh dWx0cyB2OmV4dD0iZWRpdCIgc3BpZG1heD0iMTAyNiIgLz4NCjwveG1sPjwhW2VuZGlmXS0tPjwh LS1baWYgZ3RlIG1zbyA5XT48eG1sPg0KPG86c2hhcGVsYXlvdXQgdjpleHQ9ImVkaXQiPg0KPG86 aWRtYXAgdjpleHQ9ImVkaXQiIGRhdGE9IjEiIC8+DQo8L286c2hhcGVsYXlvdXQ+PC94bWw+PCFb ZW5kaWZdLS0+DQo8c3R5bGUgdHlwZT0idGV4dC9jc3MiPi5zdHlsZTEge2ZvbnQtZmFtaWx5OiAi VGltZXMgTmV3IFJvbWFuIjt9PC9zdHlsZT48L2hlYWQ+PGJvZHkgbGFuZz0iRU4tVVMiIGxpbms9 ImJsdWUiIHZsaW5rPSJwdXJwbGUiPg0KPGRpdiBjbGFzcz0iV29yZFNlY3Rpb24xIj4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj5UaGFuayB5b3Ug UmljaCwgYW5kIEFsbGFuIEkgc2hvdWxkIGhhdmUgcGFpZCBjbG9zZXIgYXR0ZW50aW9uIGFuZCB0 aG91Z2h0IGFib3V0IGl0IGp1c3QgYSBsaXR0bGUgbW9yZS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+ DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250 LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86 cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5z LXNlcmlmO2NvbG9yOiMxRjQ5N0QiPmRmIGRvZXMgbm90IGhlbHAgb24gdHlwZT12b2x1bWUgYXMg dGhhdCBpcyBub3JtYWxseSBub3QgYSBaRlMgbW91bnRlZCBmaWxlc3lzdGVtIGp1c3QgYSBibG9j ayBkZXZpY2UgYnV0IGl0IGNhbiBiZSAoc2VlIGJlbG93KTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4N CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQt ZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpw PiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMt c2VyaWY7Y29sb3I6IzFGNDk3RCI+SG9wZWZ1bGx5IHRoaXMgd2lsbCBoZWxwIHNvbWVvbmUgZWxz ZS48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls ZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMt c2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPnJvb3RAZHJhaWQ6 L3Vzci9zcmMvc3RhbmQvbGlic2EvemZzICMgemZzIGxpc3QgLW8gdXNlZCZuYnNwOyByYWlkLTU0 MDAtMTxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fu cy1zZXJpZjtjb2xvcjojMUY0OTdEIj5VU0VEPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xh c3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6 JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPjE4LjBUPG86cD48 L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQt c2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2Nv bG9yOiMxRjQ5N0QiPnJvb3RAZHJhaWQ6L3Vzci9zcmMvc3RhbmQvbGlic2EvemZzICMgemZzIGxp c3QgLW8gdXNlZCZuYnNwOyByYWlkLTU0MDAtMS9lc3hpLXN0b3JlMTxvOnA+PC9vOnA+PC9zcGFu PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0 O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdE Ij5VU0VEPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90Oyxz YW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPjE2LjlUJm5ic3A7ICZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAmbHQ7LSBNeSByZXNlcnZhdGlvbiBh bW91bnQ8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNh bnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+cm9vdEBkcmFpZDovdXNyL3NyYy9zdGFuZC9saWJzYS96 ZnMgIzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fu cy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWls eTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJz cDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlm O2NvbG9yOiMxRjQ5N0QiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90 O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj5yb290QGRyYWlkOi91c3Iv c3JjL3N0YW5kL2xpYnNhL3pmcyAjIHpmcyBsaXN0IC1vIGF2YWlsJm5ic3A7IHJhaWQtNTQwMC0x PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9 ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNl cmlmO2NvbG9yOiMxRjQ5N0QiPkFWQUlMPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1 b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPjIuMDhUPG86cD48L286 cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9y OiMxRjQ5N0QiPnJvb3RAZHJhaWQ6L3Vzci9zcmMvc3RhbmQvbGlic2EvemZzICMgemZzIGxpc3Qg LW8gYXZhaWwmbmJzcDsgcmFpZC01NDAwLTEvZXN4aS1zdG9yZTE8bzpwPjwvbzpwPjwvc3Bhbj48 L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtm b250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+ QVZBSUw8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNh bnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+MTguNVQ8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWls eTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJz cDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlm O2NvbG9yOiMxRjQ5N0QiPkkgZ3Vlc3MgYXMgTXIuIE9idmlvdXMgd291bGQgc2F5IOKAnFpGUyAm bHQ7Y29tbWFuZCZndDsg4oCcIGlzIHRoZSBkYXRhc2V0IOKAkyDigJxacG9vbCAmbHQ7Y29tbWFu ZCZndDvigJ0gaXMgdGhlIHBvb2wuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7 Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPjxvOnA+Jm5ic3A7PC9vOnA+ PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6 MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjoj MUY0OTdEIj5yb290QGRyYWlkOi91c3Ivc3JjL3N0YW5kL2xpYnNhL3pmcyAjIHpmcyBsaXN0PG86 cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlm O2NvbG9yOiMxRjQ5N0QiPk5BTUUmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7ICZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1VTRUQmbmJzcDsgQVZBSUwm bmJzcDsgUkVGRVImbmJzcDsgTU9VTlRQT0lOVDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNs YXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5 OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj5yYWlkLTU0MDAt MSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyAmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7MTguMFQmbmJzcDsgMi4wOFQmbmJzcDsmbmJzcDsgMjM2 SyZuYnNwOyAvcmFpZC01NDAwLTEmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsgJmx0Oy0gUG9vbDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt YWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGli cmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj5yYWlkLTU0MDAtMS9lc3hpLXN0b3Jl MSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAx Ni45VCZuYnNwOyAxOC41VCZuYnNwOyZuYnNwOyA1MjJHJm5ic3A7IC0mbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgJmx0Oy0gdHlwZT12 b2x1bWUgd2l0aCByZXNlcnZhdGlvbjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90 O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj5yYWlkLTU0MDAtMS91bml0 cmVuZHMxJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7IDEuMDhUJm5ic3A7IDIuNDNUJm5ic3A7Jm5ic3A7IDc1MkcmbmJzcDsgLSZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAm bHQ7LSB0eXBlPXZvbHVtZSB3aXRob3V0IHJlc2VydmF0aW9uPG86cD48L286cD48L3NwYW4+PC9w Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9u dC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPjxv OnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fu cy1zZXJpZjtjb2xvcjojMUY0OTdEIj5Ob3RlOiBJIGhhdmUgc2ltcGx5IG5vdCByZXNlcnZlZCBh bGwgMTguNVQgeWV0IG9mIHJhaWQtNTQwMC0xL2VzeGktc3RvcmUxIGJ1dCBJIGFtIGRvaW5nIHRo YXQgbm93IOKAkyBuZXZlciBoYWQgYSByZWFzb24gdG8gdXNlIHJlc2VydmF0aW9ucyBpbiB0aGUg cGFzdCBidXQgSSBoYXZlDQogYSB0ZXN0IGxhYiBAaG9tZSB3aXRoIGEgbG90IG9mIHZpc3VhbGl6 YXRpb24gYWxsIGJlaW5nIG1pZ3JhdGVkIHRvIElTQ1NJIHRhcmdldHMgYW5kIEkgY2VydGFpbmx5 IGRvbuKAmXQgd2FudCB0byBoYXZlIHRvIHdvcnJ5IGFib3V0IHRoaW4gJmx0O3BpY2sgeW91IGd1 ZXN0IHR5cGUmZ3Q7IG9uIHRvcCBvZiB0aGluIExVTlMgc28gSeKAmW0gc3RhcnRpbmcgd2l0aCBz b21lIGRpc3Bvc2FibGUgcG9vbHMgdG8gbGVhcm4uJm5ic3A7IFdoZW4gSSBzdGFydCBzaHVmZmxp bmcgdGhlDQogcmVhbCBkYXRhIGFyb3VuZCAofjUwVEImIzQzOykgSSBkb27igJl0IHdhbnQgdW5m b3Jlc2VlbiBpc3N1ZXMgOy0pIOKAkyBObyBiYWNrdXBzIGZvciBldmVyeXRoaW5nICQkJCAmbmJz cDtidXQgaXRzIGNsb3NlIGVub3VnaA0KPC9zcGFuPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEu MHB0O2ZvbnQtZmFtaWx5OldpbmdkaW5ncztjb2xvcjojMUY0OTdEIj5KPC9zcGFuPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fu cy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0i TXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVv dDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJzcDs8L286 cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6 ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmO2NvbG9y OiMxRjQ5N0QiPi0tbWlrZWo8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxp YnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+PG86cD4mbmJzcDs8L286cD48L3Nw YW4+PC9wPg0KPGRpdj4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHQ7IEZPTlQtRkFNSUxZOiBB cmlhbCI+Jm5ic3A7PC9wPg0KPGRpdiBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBCT1JERVItVE9Q OiAjNjY2NjY2IDFweCBzb2xpZDsgRk9OVC1GQU1JTFk6IFZlcmRhbmE7IFdJRFRIOiA0MTBweDsg Qk9SREVSLUJPVFRPTTogIzY2NjY2NiAxcHggc29saWQ7IFBBRERJTkctQk9UVE9NOiA1cHg7IFBB RERJTkctVE9QOiA1cHg7IFBBRERJTkctTEVGVDogNXB4OyBQQURESU5HLVJJR0hUOiA1cHgiPg0K Q09ORklERU5USUFMSVRZIE5PVEU6IFRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0 aGUgdXNlPGJyPg0Kb2YgdGhlIGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRk cmVzc2VkIGFuZCBtYXkgPGJyPg0KY29udGFpbiBpbmZvcm1hdGlvbiB0aGF0IGlzIHByaXZpbGVn ZWQsIGNvbmZpZGVudGlhbCwgYW5kIDxicj4NCmV4ZW1wdCBmcm9tIGRpc2Nsb3N1cmUgdW5kZXIg YXBwbGljYWJsZSBsYXcuIElmIHRoZSByZWFkZXIgPGJyPg0Kb2YgdGhpcyBtZXNzYWdlIGlzIG5v dCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSA8YnI+DQpub3RpZmllZCB0 aGF0IGFueSBkaXNzZW1pbmF0aW9uLCBkaXN0cmlidXRpb24gb3IgY29weWluZyA8YnI+DQpvZiB0 aGlzIGNvbW11bmljYXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUgPGJy Pg0KcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3IsIHBsZWFzZSBub3RpZnkgdXMg YnkgPGJyPg0KdGVsZXBob25lIGF0ICg1MDIpIDIxMi00MDAwIG9yIG5vdGlmeSB1cyBhdDogUEFJ LCBEZXB0LiA5OSwgPGJyPg0KMjEwMSBIaWdoIFdpY2toYW0gUGxhY2UsIFN1aXRlIDEwMSwgTG91 aXN2aWxsZSwgS1kgNDAyNDU8YnI+DQo8YnI+DQo8YnI+DQo8YnI+DQo8cCBzdHlsZT0iRk9OVC1T SVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0la RTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6 IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAx MHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBw eDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7 IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBG T05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9O VC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQt RkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZB TUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1J TFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZ OiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTog VmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZl cmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJk YW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFu YSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEi PjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48 L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9w Pg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4N CjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8 cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAg c3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0 eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHls ZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9 IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJG T05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9O VC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQt U0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJ WkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpF OiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTog MTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEw cHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4 OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsg Rk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZP TlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05U LUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1G QU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFN SUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlM WTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6 IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBW ZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVy ZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRh bmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5h Ij48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+ PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwv cD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+ DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0K PHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxw IHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBz dHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5 bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxl PSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0i Rk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZP TlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05U LVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1T SVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0la RTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6 IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAx MHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBw eDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7 IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBG T05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9O VC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQt RkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZB TUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1J TFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZ OiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTog VmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZl cmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJk YW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFu YSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEi PjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48 L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9w Pg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4N CjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8 cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAg c3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0 eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHls ZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9 IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJG T05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9O VC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQt U0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJ WkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpF OiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTog MTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEw cHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4 OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsg Rk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZP TlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05U LUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1G QU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFN SUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlM WTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6 IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBW ZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVy ZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRh bmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5h Ij48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+ PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwv cD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+ DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0K PHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxw IHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBz dHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5 bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxl PSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0i Rk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZP TlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05U LVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1T SVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0la RTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6 IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAx MHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBw eDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7 IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBG T05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9O VC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQt RkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZB TUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1J TFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZ OiBWZXJkYW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTog VmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZl cmRhbmEiPjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJk YW5hIj48L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFu YSI+PC9wPg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEi PjwvcD4NCjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48 L3A+DQo8cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9w Pg0KPHAgc3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4N CjxwIHN0eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8 cCBzdHlsZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAg c3R5bGU9IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjxwIHN0 eWxlPSJGT05ULVNJWkU6IDEwcHg7IEZPTlQtRkFNSUxZOiBWZXJkYW5hIj48L3A+DQo8cCBzdHls ZT0iRk9OVC1TSVpFOiAxMHB4OyBGT05ULUZBTUlMWTogVmVyZGFuYSI+PC9wPg0KPHAgc3R5bGU9 IkZPTlQtU0laRTogMTBweDsgRk9OVC1GQU1JTFk6IFZlcmRhbmEiPjwvcD4NCjwvZGl2Pg0KPC9k aXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48Yj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBw dDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWYiPkZyb206PC9zcGFu PjwvYj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZhbWlseTomcXVvdDtDYWxp YnJpJnF1b3Q7LHNhbnMtc2VyaWYiPiBSaWNoIFttYWlsdG86cmluY2VicmFpbkBnbWFpbC5jb21d DQo8YnI+DQo8Yj5TZW50OjwvYj4gVGh1cnNkYXksIEFwcmlsIDIxLCAyMDIyIDU6NTkgUE08YnI+ DQo8Yj5Ubzo8L2I+IEFsYW4gU29tZXJzICZsdDthc29tZXJzQGZyZWVic2Qub3JnJmd0Ozxicj4N CjxiPkNjOjwvYj4gTWljaGFlbCBKdW5nICZsdDttaWtlakBwYXltZW50YWxsaWFuY2VpbnRsLmNv bSZndDs7IGZyZWVic2QtZnMgJmx0O2ZyZWVic2QtZnNAZnJlZWJzZC5vcmcmZ3Q7PGJyPg0KPGI+ U3ViamVjdDo8L2I+IFJlOiBaRlMgcmVzZXJ2YXRpb25zIGZvciB0eXBlPXZvbHVtZTxvOnA+PC9v OnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxvOnA+Jm5ic3A7PC9vOnA+PC9w Pg0KPGRpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj4oTXkgRkJTRCBkZXYgZW52IGlz bid0IGJvb3RlZCwgYnV0IExpbnV4IGFuZCBGQlNEJm5ic3A7YXJlIHRoZSBzYW1lIGluIHRoaXMg cmVnYXJkLi4uKTxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05v cm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi PiMgenBvb2wgbGlzdCB3b3Jrc3BhY2U8YnI+DQpOQU1FICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwO1NJWkUgJm5ic3A7QUxMT0MgJm5ic3A7IEZSRUUgJm5ic3A7Q0tQT0lOVCAmbmJzcDtFWFBB TkRTWiAmbmJzcDsgRlJBRyAmbmJzcDsgJm5ic3A7Q0FQICZuYnNwO0RFRFVQICZuYnNwOyAmbmJz cDtIRUFMVEggJm5ic3A7QUxUUk9PVDxicj4NCndvcmtzcGFjZSAmbmJzcDszNS40VCAmbmJzcDsx Mi45VCAmbmJzcDsyMi41VCAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDstICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAtICZuYnNwOyAmbmJzcDsgMyUgJm5ic3A7ICZuYnNwOzM2JSAmbmJz cDsxLjAweCAmbmJzcDtERUdSQURFRCAmbmJzcDstPGJyPg0KIyB6ZnMgY3JlYXRlIHdvcmtzcGFj ZS90ZXN0bWU8YnI+DQojIHpmcyBsaXN0IHdvcmtzcGFjZSB3b3Jrc3BhY2UvdGVzdG1lPGJyPg0K TkFNRSAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDtVU0VEICZuYnNwO0FWQUlMICZuYnNwOyAm bmJzcDsgUkVGRVIgJm5ic3A7TU9VTlRQT0lOVDxicj4NCndvcmtzcGFjZSAmbmJzcDsxMy4wVCAm bmJzcDsyMS41VCAmbmJzcDsgJm5ic3A7IDQ4LjlHICZuYnNwOy93b3Jrc3BhY2U8bzpwPjwvbzpw PjwvcD4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj53b3Jrc3BhY2UvdGVzdG1lICZuYnNw OyAmbmJzcDs5NksgJm5ic3A7MjEuNVQgJm5ic3A7ICZuYnNwOyAmbmJzcDsgOTZLICZuYnNwOy93 b3Jrc3BhY2UvdGVzdG1lPGJyPg0KIyBkZiAtaCAvd29ya3NwYWNlL3Rlc3RtZSAvd29ya3NwYWNl Lzxicj4NCkZpbGVzeXN0ZW0gJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7U2l6ZSAmbmJzcDtV c2VkIEF2YWlsIFVzZSUgTW91bnRlZCBvbjxicj4NCndvcmtzcGFjZS90ZXN0bWUgJm5ic3A7IDIy VCAmbmJzcDsxMjhLICZuYnNwOyAyMlQgJm5ic3A7IDElIC93b3Jrc3BhY2UvdGVzdG1lPGJyPg0K d29ya3NwYWNlICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsyMlQgJm5ic3A7IDQ5 RyAmbmJzcDsgMjJUICZuYnNwOyAxJSAvd29ya3NwYWNlPG86cD48L286cD48L3A+DQo8ZGl2Pg0K PHAgY2xhc3M9Ik1zb05vcm1hbCI+IyB6ZnMgc2V0IHJlc2VydmF0aW9uPTFUIHdvcmtzcGFjZS90 ZXN0bWU8YnI+DQojIHpwb29sIGxpc3Qgd29ya3NwYWNlPGJyPg0KTkFNRSAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDtTSVpFICZuYnNwO0FMTE9DICZuYnNwOyBGUkVFICZuYnNwO0NLUE9JTlQg Jm5ic3A7RVhQQU5EU1ogJm5ic3A7IEZSQUcgJm5ic3A7ICZuYnNwO0NBUCAmbmJzcDtERURVUCAm bmJzcDsgJm5ic3A7SEVBTFRIICZuYnNwO0FMVFJPT1Q8YnI+DQp3b3Jrc3BhY2UgJm5ic3A7MzUu NFQgJm5ic3A7MTIuOVQgJm5ic3A7MjIuNVQgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7LSAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgLSAmbmJzcDsgJm5ic3A7IDMlICZuYnNwOyAmbmJz cDszNiUgJm5ic3A7MS4wMHggJm5ic3A7REVHUkFERUQgJm5ic3A7LTxvOnA+PC9vOnA+PC9wPg0K PGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPiMgemZzIGxpc3Qgd29ya3NwYWNlPGJyPg0KTkFN RSAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDtVU0VEICZuYnNwO0FWQUlMICZuYnNwOyAmbmJz cDsgUkVGRVIgJm5ic3A7TU9VTlRQT0lOVDxicj4NCndvcmtzcGFjZSAmbmJzcDsxNC4wVCAmbmJz cDsyMC41VCAmbmJzcDsgJm5ic3A7IDQ4LjlHICZuYnNwOy93b3Jrc3BhY2U8bzpwPjwvbzpwPjwv cD4NCjwvZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPndvcmtzcGFjZS90ZXN0bWUg Jm5ic3A7ICZuYnNwOzk2SyAmbmJzcDsyMS41VCAmbmJzcDsgJm5ic3A7ICZuYnNwOyA5NksgJm5i c3A7L3dvcmtzcGFjZS90ZXN0bWU8YnI+DQojIGRmIC1oIC93b3Jrc3BhY2UvdGVzdG1lIC93b3Jr c3BhY2UvPGJyPg0KRmlsZXN5c3RlbSAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDtTaXplICZu YnNwO1VzZWQgQXZhaWwgVXNlJSBNb3VudGVkIG9uPGJyPg0Kd29ya3NwYWNlL3Rlc3RtZSAmbmJz cDsgMjJUICZuYnNwOzEyOEsgJm5ic3A7IDIyVCAmbmJzcDsgMSUgL3dvcmtzcGFjZS90ZXN0bWU8 YnI+DQp3b3Jrc3BhY2UgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOzIxVCAmbmJz cDsgNDlHICZuYnNwOyAyMVQgJm5ic3A7IDElIC93b3Jrc3BhY2U8YnI+DQojPG86cD48L286cD48 L3A+DQo8L2Rpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpw PjwvcD4NCjwvZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPlRoYXQgaXMsIEFJVUks IHJlc2VydmF0aW9uIGNvdW50cyBhZ2FpbnN0IHRoZSBVU0VEL0FWQUlML0ZSRUUgc2hvd24gYnkg JnF1b3Q7emZzIGxpc3QmcXVvdDsgb3IgJnF1b3Q7ZGYmcXVvdDsgb2YgZXZlcnl0aGluZyBub3Qg dGhlIHJlc2VydmF0aW9uLWhvbGRlciAsIG5vdCBhZ2FpbnN0IHRoZSAmcXVvdDtBTExPQyZxdW90 OyBzaG93biBieSB6cG9vbCBsaXN0Li4udW5sZXNzIGl0J3MgYWN0dWFsbHkgYWxsb2NhdGVkLCBv ZiBjb3Vyc2UuPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9y bWFsIj48bzpwPiZuYnNwOzwvbzpwPjwvcD4NCjwvZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29O b3JtYWwiPi0gUmljaDxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9k aXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwvcD4NCjxkaXY+DQo8 ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+T24gVGh1LCBBcHIgMjEsIDIwMjIgYXQgNTo0NiBQ TSBBbGFuIFNvbWVycyAmbHQ7PGEgaHJlZj0ibWFpbHRvOmFzb21lcnNAZnJlZWJzZC5vcmciPmFz b21lcnNAZnJlZWJzZC5vcmc8L2E+Jmd0OyB3cm90ZTo8bzpwPjwvbzpwPjwvcD4NCjwvZGl2Pg0K PGJsb2NrcXVvdGUgc3R5bGU9ImJvcmRlcjpub25lO2JvcmRlci1sZWZ0OnNvbGlkICNDQ0NDQ0Mg MS4wcHQ7cGFkZGluZzowaW4gMGluIDBpbiA2LjBwdDttYXJnaW4tbGVmdDo0LjhwdDttYXJnaW4t cmlnaHQ6MGluIj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEy LjBwdCI+SXNuJ3QgMS41MlQgdGhlICZxdW90O0FWQUlMJnF1b3Q7IHZhbHVlLCBhbmQgMjQuNlQg aXMgdGhlICZxdW90O1VTRUQmcXVvdDs/PGJyPg0KPGJyPg0KT24gVGh1LCBBcHIgMjEsIDIwMjIg YXQgMjo1NiBQTSBNaWNoYWVsIEp1bmc8YnI+DQombHQ7PGEgaHJlZj0ibWFpbHRvOm1pa2VqQHBh eW1lbnRhbGxpYW5jZWludGwuY29tIiB0YXJnZXQ9Il9ibGFuayI+bWlrZWpAcGF5bWVudGFsbGlh bmNlaW50bC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+DQomZ3Q7PGJyPg0KJmd0OyBPayB0aGF0IG1h a2VzIHNlbnNlLi4uIHNvIGV2ZW4gdGhvdWdoIHJ1bm5pbmcgWkZTIHNpbmNlIDkueCBJJ2xsIGFz ayB0aGUgbmV3YmllIHF1ZXN0aW9uLi48YnI+DQomZ3Q7PGJyPg0KJmd0OyBJZiBpdCBjb250cmli dXRlcyB0byB0aGUgcGFyZW50cyAmcXVvdDt1c2VkJnF1b3Q7IHZhbHVlIHdoeSBpcyBub3QgcmVm bGVjdGVkIGhlcmUgaW4gJnF1b3Q7VVNFRCZxdW90OyBvciBpbiAmcXVvdDtBVkFJTCZxdW90Oz88 YnI+DQomZ3Q7PGJyPg0KJmd0OyBJIHdvdWxkIGV4cGVjdCBVU0VEIHRvIGJlIG15IHJlc2VydmF0 aW9uIGFtb3VudCBvZiAxNS42VCAmIzQzOyB3aGF0ZXZlciBzcGFjZSB3YXM8YnI+DQomZ3Q7IGJl aW5nIHVzZWQgYnkgb3RoZXIgdGhpbmdzIG9uIHRoZSBwb29sLiAmcXVvdDtVU0VEJnF1b3Q7IHN0 aWxsIHNpdHMgYXQgMS41MlQuPGJyPg0KJmd0Ozxicj4NCiZndDsgTkFNRSBUWVBFIFVTRUQgQVZB SUwgUkFUSU8gQ09NUFJFU1MgUkVTRVJWIFJFRlJFU0VSViBWT0xTSVpFPGJyPg0KJmd0OyByYWlk LTU0MDAtMSAyNC42VCAxLjUyVCAyMy4xVCAtIC0gMiUgNiUgMS4wMHggT05MSU5FPGJyPg0KJmd0 Ozxicj4NCiZndDsgVGhhbmtzIGFnYWluLjxicj4NCiZndDs8YnI+DQomZ3Q7IC0tLS0tT3JpZ2lu YWwgTWVzc2FnZS0tLS0tPGJyPg0KJmd0OyBGcm9tOiBBbGFuIFNvbWVycyBbbWFpbHRvOjxhIGhy ZWY9Im1haWx0bzphc29tZXJzQGZyZWVic2Qub3JnIiB0YXJnZXQ9Il9ibGFuayI+YXNvbWVyc0Bm cmVlYnNkLm9yZzwvYT5dPGJyPg0KJmd0OyBTZW50OiBUaHVyc2RheSwgQXByaWwgMjEsIDIwMjIg NDo0MCBQTTxicj4NCiZndDsgVG86IE1pY2hhZWwgSnVuZyAmbHQ7PGEgaHJlZj0ibWFpbHRvOm1p a2VqQHBheW1lbnRhbGxpYW5jZWludGwuY29tIiB0YXJnZXQ9Il9ibGFuayI+bWlrZWpAcGF5bWVu dGFsbGlhbmNlaW50bC5jb208L2E+Jmd0Ozxicj4NCiZndDsgQ2M6IGZyZWVic2QtZnMgJmx0Ozxh IGhyZWY9Im1haWx0bzpmcmVlYnNkLWZzQGZyZWVic2Qub3JnIiB0YXJnZXQ9Il9ibGFuayI+ZnJl ZWJzZC1mc0BmcmVlYnNkLm9yZzwvYT4mZ3Q7PGJyPg0KJmd0OyBTdWJqZWN0OiBSZTogWkZTIHJl c2VydmF0aW9ucyBmb3IgdHlwZT12b2x1bWU8YnI+DQomZ3Q7PGJyPg0KJmd0OyBBIGRhdGFzZXQn cyByZXNlcnZhdGlvbiBpcyBsb2NhbC4gSXQgZG9lc24ndCBjb250cmlidXRlIHRvIGl0cyBwYXJl bnQncyByZXNlcnZhdGlvbi4gT3RoZXJ3aXNlLCB5b3Ugd291bGRuJ3QgYmUgYWJsZSB0byBzZXBh cmF0ZWx5IHNldCBhIHJlc2VydmF0aW9uIG9uIHRoZSBwYXJlbnQuIEJ1dCBpdCBfZG9lc18gY29u dHJpYnV0ZSB0byB0aGUgcGFyZW50J3MgJnF1b3Q7dXNlZCZxdW90OyB2YWx1ZS4gSW4gdGhhdCB3 YXksIHlvdSdyZSBwcmV2ZW50ZWQgZnJvbSByZXNlcnZpbmcNCiB0b28gbXVjaCBkYXRhIG9uIHRo ZSBwYXJlbnQncyBjaGlsZHJlbi48YnI+DQomZ3Q7IC1BbGFuPGJyPg0KJmd0Ozxicj4NCiZndDsg T24gVGh1LCBBcHIgMjEsIDIwMjIgYXQgMjoyOCBQTSBNaWNoYWVsIEp1bmcgJmx0OzxhIGhyZWY9 Im1haWx0bzptaWtlakBwYXltZW50YWxsaWFuY2VpbnRsLmNvbSIgdGFyZ2V0PSJfYmxhbmsiPm1p a2VqQHBheW1lbnRhbGxpYW5jZWludGwuY29tPC9hPiZndDsgd3JvdGU6PGJyPg0KJmd0OyAmZ3Q7 PGJyPg0KJmd0OyAmZ3Q7IEkgaGF2ZSBhIHpmcyBibG9jayBkYXRhc2V0IHJhaWQtNTQwMC0xL2Vz eGktc3RvcmUxIHRoYXQgSSBzaGFyZSBhcyBhbjxicj4NCiZndDsgJmd0OyBpc2NzaSB0YXJnZXQg YW5kIHRoYXQgd29ya3MgZ3JlYXQuIEkgaGF2ZSBzZXQgYSByZXNlcnZhdGlvbjxicj4NCiZndDsg Jmd0Ozxicj4NCiZndDsgJmd0OyBvbiB0aGF0IGJsb2NrIGRldmljZSBlcXVhbCB0byBpdHMgc2l6 ZSBzbyB0aGF0IGlzIG5vdCBzcGFyc2UgYW5kIHRodXM8YnI+DQomZ3Q7ICZndDsgd2hpbGUgSSBj b3VsZCBvdmVyIHByb3Zpc2lvbiBndWVzdHMgb24gdGhlIHByb3ZpZGVkIExVTiw8YnI+DQomZ3Q7 ICZndDs8YnI+DQomZ3Q7ICZndDsgdGhlIHN0b3JhZ2UgcHJlc2VudGVkIGFzIHRoZSBMVU4gY2Fw YWNpdHkgd2lsbCBhbHdheXMgYmUgYXZhaWxhYmxlLiBBdCBsZWFzdCB0aGlzIGlzIHdoYXQgSSB3 YW50IHRvIGFjaGlldmUuPGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAm Z3Q7PGJyPg0KJmd0OyAmZ3Q7IFdoYXQgSSBmaW5kIHN0cmFuZ2UgaXMgdGhhdCB0aGUgcmVzZXJ2 YXRpb24gZG9lcyBub3Qgc2VlbSB0byBiZTxicj4NCiZndDsgJmd0OyBhcHBsaWVkIHRvIHRoZSBa RlMgcG9vbCDigJhyYWlkLTU0MDAtMeKAmS4gRG8geW91IHJlYWxseSBuZWVkPGJyPg0KJmd0OyAm Z3Q7PGJyPg0KJmd0OyAmZ3Q7IHRvIHNldCB5b3VyIG1heGltdW0gcmVzZXJ2YXRpb24gYXQgdGhl IHBvb2wgbGV2ZWwsIGFuZCB0aGVuIGFwcGx5PGJyPg0KJmd0OyAmZ3Q7IHJlc2VydmF0aW9ucyB0 byBhbGwgZGF0YXNldHMgb24gdGhhdCB2b2x1bWU/IEFuZCBpZiBzbzxicj4NCiZndDsgJmd0Ozxi cj4NCiZndDsgJmd0OyBJIHdvdWxkIGFzc3VtZSB5b3UgY291bGQgbmV2ZXIgc2V0IHJlc2VydmF0 aW9ucyBmb3IgZGF0YXNldHMgdG90YWxpbmcgbW9yZSB0aGFuIHdoYXQgd2FzIHJlc2VydmVkIGZv ciB0aGUgcG9vbCDigJhyYWlkLTU0MDAtMeKAmS48YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZn dDs8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgSSBjb3VsZCBidWlsZCBvdXQgYSB0ZXN0 IGVudmlyb25tZW50IGFuZCBmaWd1cmUgb3V0IGNvbnN0cmFpbnRzIGJ1dCBJ4oCZZCByZWFsbHkg bGlrZSB0byBrbm93IHRoZSDigJxob3cgaXQgaXMgc3VwcG9zZWQgdG8gd29ya+KAnTxicj4NCiZn dDsgJmd0Ozxicj4NCiZndDsgJmd0OyBub3QgdGhlIOKAnGhvdyBJIGZpbmQgaXQgdG8gd29ya+KA nS48YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7 ICZndDsgVGhhbmtzIGluIGFkdmFuY2UuPGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJy Pg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IEZyZWVCU0QgMTQuMC1DVVJSRU5UICM0IG1haW4t bjI1Mzg3NS04ZTcyZjQ1OGM2ZDo8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+DQom Z3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgKHRoaXMgaXMgYSByYWlkejIgcG9vbCDigJMgbm90IG15 IGRyYWlkIHBvb2wpPGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7 PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IHJvb3RAZHJhaWQ6 L3Vzci9zcmMvY29udHJpYi9iZWFyc3NsICMgemZzIGxpc3QgLW88YnI+DQomZ3Q7ICZndDsgbmFt ZSx0eXBlLHVzZWQsYXZhaWwscmF0aW8sY29tcHJlc3Npb24scmVzZXJ2YXRpb24scmVmcmVzZXJ2 YXRpb24sdm9sczxicj4NCiZndDsgJmd0OyBpemUgcmFpZC01NDAwLTE8YnI+DQomZ3Q7ICZndDs8 YnI+DQomZ3Q7ICZndDsgTkFNRSBUWVBFIFVTRUQgQVZBSUwgUkFUSU8gQ09NUFJFU1MgUkVTRVJW IFJFRlJFU0VSViBWT0xTSVpFPGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IHJhaWQtNTQw MC0xIGZpbGVzeXN0ZW0gMTguMFQgMi4wOFQgMS4zNnggb24gbm9uZSBub25lIC0gJmx0Oy0gbm8g cmVzZXJ2YXRpb24gQHBvb2w8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgcm9vdEBkcmFp ZDovdXNyL3NyYy9jb250cmliL2JlYXJzc2wgIzxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsgJmd0 Ozxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsgJmd0OyByb290QGRyYWlkOi91c3Ivc3JjL2NvbnRy aWIvYmVhcnNzbCAjIHpmcyBsaXN0IC1vPGJyPg0KJmd0OyAmZ3Q7IG5hbWUsdHlwZSx1c2VkLGF2 YWlsLHJhdGlvLGNvbXByZXNzaW9uLHJlc2VydmF0aW9uLHJlZnJlc2VydmF0aW9uLHZvbHM8YnI+ DQomZ3Q7ICZndDsgaXplIHJhaWQtNTQwMC0xL2VzeGktc3RvcmUxPGJyPg0KJmd0OyAmZ3Q7PGJy Pg0KJmd0OyAmZ3Q7IE5BTUUgVFlQRSBVU0VEIEFWQUlMIFJBVElPIENPTVBSRVNTIFJFU0VSViBS RUZSRVNFUlYgVk9MU0laRTxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsgJmd0OyByYWlkLTU0MDAt MS9lc3hpLXN0b3JlMSB2b2x1bWUgMTYuOVQgMTguNVQgMS43OHggenN0ZCAxNS42VCAxNi45VCAx NS42VCAmbHQ7LSByZXNlcnZhdGlvbiBAZGF0YXNldDxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsg Jmd0Ozxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsgJmd0OyByb290QGRyYWlkOi91c3Ivc3JjL2Nv bnRyaWIvYmVhcnNzbCAjIHpwb29sIGxpc3Q8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsg TkFNRSBTSVpFIEFMTE9DIEZSRUUgQ0tQT0lOVCBFWFBBTkRTWiBGUkFHIENBUCBERURVUCBIRUFM VEggQUxUUk9PVDxicj4NCiZndDsgJmd0Ozxicj4NCiZndDsgJmd0OyBjY2FjaGUgOS41MEcgOS4x MEcgNDA2TSAtIC0gODglIDk1JSAxLjAweCBPTkxJTkUgLTxicj4NCiZndDsgJmd0Ozxicj4NCiZn dDsgJmd0OyByYWlkLTU0MDAtMSAyNC42VCAxLjUyVCAyMy4xVCAtIC0gMiUgNiUgMS4wMHggT05M SU5FIC0gJmx0Oy0gRnJlZSBkb2VzIG5vdCByZWZsZWN0IHJlc2VydmF0aW9uIEBwb29sPGJyPg0K Jmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IHRhbmsgMTguNVQgNjA1RyAxNy45VCAtIC0gMCUgMyUg MS4wMHggT05MSU5FIC08YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgemZzcm9vdCAxMDNH IDMzLjNHIDY5LjdHIC0gLSAzMSUgMzIlIDEuMDB4IE9OTElORSAtPGJyPg0KJmd0OyAmZ3Q7PGJy Pg0KJmd0OyAmZ3Q7IHJvb3RAZHJhaWQ6L3Vzci9zcmMvY29udHJpYi9iZWFyc3NsICM8YnI+DQom Z3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDs8YnI+ DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgQ09ORklERU5USUFMSVRZIE5PVEU6IFRoaXMgbWVz c2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0aGUgdXNlIG9mIHRoZTxicj4NCiZndDsgJmd0OyBp bmRpdmlkdWFsIG9yIGVudGl0eSB0byB3aG9tIGl0IGlzIGFkZHJlc3NlZCBhbmQgbWF5IGNvbnRh aW48YnI+DQomZ3Q7ICZndDsgaW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBjb25maWRl bnRpYWwsIGFuZCBleGVtcHQgZnJvbTxicj4NCiZndDsgJmd0OyBkaXNjbG9zdXJlIHVuZGVyIGFw cGxpY2FibGUgbGF3LiBJZiB0aGUgcmVhZGVyIG9mIHRoaXMgbWVzc2FnZSBpcyBub3Q8YnI+DQom Z3Q7ICZndDsgdGhlIGludGVuZGVkIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90aWZpZWQg dGhhdCBhbnk8YnI+DQomZ3Q7ICZndDsgZGlzc2VtaW5hdGlvbiwgZGlzdHJpYnV0aW9uIG9yIGNv cHlpbmcgb2YgdGhpcyBjb21tdW5pY2F0aW9uIGlzPGJyPg0KJmd0OyAmZ3Q7IHN0cmljdGx5IHBy b2hpYml0ZWQuIElmIHlvdSBoYXZlIHJlY2VpdmVkIHRoaXMgdHJhbnNtaXNzaW9uIGluIGVycm9y LDxicj4NCiZndDsgJmd0OyBwbGVhc2Ugbm90aWZ5IHVzIGJ5IHRlbGVwaG9uZSBhdCAoNTAyKSAy MTItNDAwMCBvciBub3RpZnkgdXMgYXQ6IFBBSSw8YnI+DQomZ3Q7ICZndDsgRGVwdC4gOTksPGJy Pg0KJmd0OyAmZ3Q7IDIxMDEgSGlnaCBXaWNraGFtIFBsYWNlLCBTdWl0ZSAxMDEsIExvdWlzdmls bGUsIEtZIDQwMjQ1PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7 PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IERpc2NsYWltZXI8 YnI+DQomZ3Q7ICZndDs8YnI+DQomZ3Q7ICZndDsgVGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBp biB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUgc2VuZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQg aXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkgdGhlIHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1 dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91IGFyZSBub3QgdGhlIHJlY2lwaWVudCwgeW91 IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkgZGlzY2xvc3VyZSwgY29weWluZywgZGlzdHJp YnV0aW9uDQogb3IgdGFraW5nIGFjdGlvbiBpbiByZWxhdGlvbiBvZiB0aGUgY29udGVudHMgb2Yg dGhpcyBpbmZvcm1hdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkIGFuZCBtYXkgYmUgdW5sYXdm dWwuPGJyPg0KJmd0OyAmZ3Q7PGJyPg0KJmd0OyAmZ3Q7IFRoaXMgZW1haWwgaGFzIGJlZW4gc2Nh bm5lZCBmb3IgdmlydXNlcyBhbmQgbWFsd2FyZSwgYW5kIG1heSBoYXZlIGJlZW4gYXV0b21hdGlj YWxseSBhcmNoaXZlZCBieSBNaW1lY2FzdCwgYSBsZWFkZXIgaW4gZW1haWwgc2VjdXJpdHkgYW5k IGN5YmVyIHJlc2lsaWVuY2UuIE1pbWVjYXN0IGludGVncmF0ZXMgZW1haWwgZGVmZW5zZXMgd2l0 aCBicmFuZCBwcm90ZWN0aW9uLCBzZWN1cml0eSBhd2FyZW5lc3MgdHJhaW5pbmcsIHdlYiBzZWN1 cml0eSwNCiBjb21wbGlhbmNlIGFuZCBvdGhlciBlc3NlbnRpYWwgY2FwYWJpbGl0aWVzLiBNaW1l Y2FzdCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFuZCBzbWFsbCBvcmdhbml6YXRpb25zIGZyb20gbWFs aWNpb3VzIGFjdGl2aXR5LCBodW1hbiBlcnJvciBhbmQgdGVjaG5vbG9neSBmYWlsdXJlOyBhbmQg dG8gbGVhZCB0aGUgbW92ZW1lbnQgdG93YXJkIGJ1aWxkaW5nIGEgbW9yZSByZXNpbGllbnQgd29y bGQuIFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0IG91ciB3ZWJzaXRlLjxicj4NCiZndDs8YnI+DQom Z3Q7PGJyPg0KJmd0Ozxicj4NCiZndDs8YnI+DQomZ3Q7IENPTkZJREVOVElBTElUWSBOT1RFOiBU aGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIHVzZTxicj4NCiZndDsgb2YgdGhl IGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRkcmVzc2VkIGFuZCBtYXk8YnI+ DQomZ3Q7IGNvbnRhaW4gaW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBjb25maWRlbnRp YWwsIGFuZDxicj4NCiZndDsgZXhlbXB0IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxl IGxhdy4gSWYgdGhlIHJlYWRlcjxicj4NCiZndDsgb2YgdGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUg aW50ZW5kZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieTxicj4NCiZndDsgbm90aWZpZWQgdGhh dCBhbnkgZGlzc2VtaW5hdGlvbiwgZGlzdHJpYnV0aW9uIG9yIGNvcHlpbmc8YnI+DQomZ3Q7IG9m IHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJpY3RseSBwcm9oaWJpdGVkLiBJZiB5b3UgaGF2ZTxi cj4NCiZndDsgcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24gaW4gZXJyb3IsIHBsZWFzZSBub3Rp ZnkgdXMgYnk8YnI+DQomZ3Q7IHRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAwMCBvciBub3RpZnkg dXMgYXQgUEFJLCBEZXB0LiA5OSw8YnI+DQomZ3Q7IDIxMDEgSGlnaCBXaWNraGFtIFBsYWNlLCBT dWl0ZSAxMDEsIExvdWlzdmlsbGUsIEtZIDQwMjQ1PGJyPg0KJmd0Ozxicj4NCiZndDs8YnI+DQom Z3Q7IERpc2NsYWltZXI8YnI+DQomZ3Q7PGJyPg0KJmd0OyBUaGUgaW5mb3JtYXRpb24gY29udGFp bmVkIGluIHRoaXMgY29tbXVuaWNhdGlvbiBmcm9tIHRoZSBzZW5kZXIgaXMgY29uZmlkZW50aWFs LiBJdCBpcyBpbnRlbmRlZCBzb2xlbHkgZm9yIHVzZSBieSB0aGUgcmVjaXBpZW50IGFuZCBvdGhl cnMgYXV0aG9yaXplZCB0byByZWNlaXZlIGl0LiBJZiB5b3UgYXJlIG5vdCB0aGUgcmVjaXBpZW50 LCB5b3UgYXJlIGhlcmVieSBub3RpZmllZCB0aGF0IGFueSBkaXNjbG9zdXJlLCBjb3B5aW5nLCBk aXN0cmlidXRpb24NCiBvciB0YWtpbmcgYWN0aW9uIGluIHJlbGF0aW9uIG9mIHRoZSBjb250ZW50 cyBvZiB0aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQgYW5kIG1heSBiZSB1 bmxhd2Z1bC48YnI+DQomZ3Q7PGJyPg0KJmd0OyBUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5uZWQg Zm9yIHZpcnVzZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2FsbHkg YXJjaGl2ZWQgYnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBjeWJl ciByZXNpbGllbmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGggYnJh bmQgcHJvdGVjdGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJpdHks DQogY29tcGxpYW5jZSBhbmQgb3RoZXIgZXNzZW50aWFsIGNhcGFiaWxpdGllcy4gTWltZWNhc3Qg aGVscHMgcHJvdGVjdCBsYXJnZSBhbmQgc21hbGwgb3JnYW5pemF0aW9ucyBmcm9tIG1hbGljaW91 cyBhY3Rpdml0eSwgaHVtYW4gZXJyb3IgYW5kIHRlY2hub2xvZ3kgZmFpbHVyZTsgYW5kIHRvIGxl YWQgdGhlIG1vdmVtZW50IHRvd2FyZCBidWlsZGluZyBhIG1vcmUgcmVzaWxpZW50IHdvcmxkLiBU byBmaW5kIG91dCBtb3JlLCB2aXNpdCBvdXIgd2Vic2l0ZS48bzpwPjwvbzpwPjwvcD4NCjwvYmxv Y2txdW90ZT4NCjwvZGl2Pg0KPC9kaXY+DQoNCg0KPGJyPjxicj48cCBzdHlsZT0iZm9udC1mYW1p bHk6IFZlcmRhbmE7IGZvbnQtc2l6ZToxMHB0OyBjb2xvcjojNjY2NjY2OyI+PGI+RGlzY2xhaW1l cjwvYj48L3A+PHAgc3R5bGU9ImZvbnQtZmFtaWx5OiBWZXJkYW5hOyBmb250LXNpemU6OHB0OyBj b2xvcjojNjY2NjY2OyI+VGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmlj YXRpb24gZnJvbSB0aGUgc2VuZGVyIGlzIGNvbmZpZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29s ZWx5IGZvciB1c2UgYnkgdGhlIHJlY2lwaWVudCBhbmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVj ZWl2ZSBpdC4gSWYgeW91IGFyZSBub3QgdGhlIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90 aWZpZWQgdGhhdCBhbnkgZGlzY2xvc3VyZSwgY29weWluZywgZGlzdHJpYnV0aW9uIG9yIHRha2lu ZyBhY3Rpb24gaW4gcmVsYXRpb24gb2YgdGhlIGNvbnRlbnRzIG9mIHRoaXMgaW5mb3JtYXRpb24g aXMgc3RyaWN0bHkgcHJvaGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVsLjxicj48YnI+VGhpcyBl bWFpbCBoYXMgYmVlbiBzY2FubmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3YXJlLCBhbmQgbWF5IGhh dmUgYmVlbiBhdXRvbWF0aWNhbGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0LCBhIGxlYWRlciBpbiBl bWFpbCBzZWN1cml0eSBhbmQgY3liZXIgcmVzaWxpZW5jZS4gTWltZWNhc3QgaW50ZWdyYXRlcyBl bWFpbCBkZWZlbnNlcyB3aXRoIGJyYW5kIHByb3RlY3Rpb24sIHNlY3VyaXR5IGF3YXJlbmVzcyB0 cmFpbmluZywgd2ViIHNlY3VyaXR5LCBjb21wbGlhbmNlIGFuZCBvdGhlciBlc3NlbnRpYWwgY2Fw YWJpbGl0aWVzLiBNaW1lY2FzdCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFuZCBzbWFsbCBvcmdhbml6 YXRpb25zIGZyb20gbWFsaWNpb3VzIGFjdGl2aXR5LCBodW1hbiBlcnJvciBhbmQgdGVjaG5vbG9n eSBmYWlsdXJlOyBhbmQgdG8gbGVhZCB0aGUgbW92ZW1lbnQgdG93YXJkIGJ1aWxkaW5nIGEgbW9y ZSByZXNpbGllbnQgd29ybGQuIFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0IG91ciB3ZWJzaXRlLjwv cD48L2JvZHk+PC9odG1sPg0K --_000_6311b99b55e54237940e64b5c51be65cMAILHUBpailocal_-- From nobody Sat Apr 23 05:37:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 714BA1A929FE for ; Sat, 23 Apr 2022 05:37:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Klg5b0blsz4pHG for ; Sat, 23 Apr 2022 05:37:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E6F4F3CAC for ; Sat, 23 Apr 2022 05:37:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23N5bMLo092986 for ; Sat, 23 Apr 2022 05:37:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23N5bMeZ092985 for fs@FreeBSD.org; Sat, 23 Apr 2022 05:37:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 90815] [smbfs] [patch] SMBFS with character conversions sometimes hangs Date: Sat, 23 Apr 2022 05:37:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 6.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: junchoon@dec.sakura.ne.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650692243; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9By3HvoOLsNR2QvPKZlXoXcipOmN5th1U0Navi68HEs=; b=k7+N3j1eViaYWYTXtMRB0vWouirSDOTEOeZABnAUkUPwom5wjrauq750TUBrJsXuI9p+Cy AnngCuaQ8iBpPLONt4rdrc1fcKwe3hSwrib7rr0mPK0q/UByslQg4/rxY7mA5IY957iRia a0WFepv5BEag6rKNkNZA4/CY5ISOGg67ztllYq/r7cLNzfgVH8MLlP3yaFBrc1bY/6hPGF uYkQJypyr60ceovaleNOV5K4mfkenvFQjkcc4+Fh2Hrmv1Qg9bx4xGy5o5cAaghKGpP8rb a1+RjjH1/vu9AiVMV0korfCWl2ofyk/WAAjGwff4FdTcoscFjz4GGj/rQZorEg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650692243; a=rsa-sha256; cv=none; b=gV26kmQfIgVg+IV2hsSsF4CRbw2csQuH/gfxS9bLwQBFWWsRcLPDTbziKTO3mbJymKU38I mMBMd5whaShAaRZBIAbiLmYsRn6xIWC94W7+apkwDX7YeeA8o26LaVRhF9f96cBZWfSk6Y pPuJf58G33trdu13O3gyvteagm3iW52+HCyRljweAMyyZJDgz9jyuefYchoDgz5muHGcgk mro6NMnDJ7JDned22sQ/Z+N6XfRz1xLpUTlDyA4lnB2HIU3Ki8Je19zzGDmjUXlOJvcUkJ oRviIo7LFNaK/yDVsM7HD1CS3GbBn7s4+rKASrbZyBnympdYTImBmMfVwmaaKA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D90815 Tomoaki AOKI changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #175826|0 |1 is obsolete| | --- Comment #10 from Tomoaki AOKI --- Created attachment 233412 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D233412&action= =3Dedit Fix build Andrey's patch at and after main git 8b83d7e0ee54416b0ee58bd85f9c0ae7fb3357a1 At main git 8b83d7e0ee54416b0ee58bd85f9c0ae7fb3357a1, unused-but-set-variab= les are no longer allowed. This breaks kernel build with Andrey's patch applied. Fix this by deleting variable "error" definition and avoid setting "error" = by casting function iconv_conv() as void inside function smb_copy_iconv(). No functional change intended. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Apr 24 21:00:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B862B199BFF5 for ; Sun, 24 Apr 2022 21:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KmgWy0DjDz4wlD for ; Sun, 24 Apr 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ABF745928 for ; Sun, 24 Apr 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23OL0DUk000797 for ; Sun, 24 Apr 2022 21:00:13 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23OL0D2c000796 for fs@FreeBSD.org; Sun, 24 Apr 2022 21:00:13 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202204242100.23OL0D2c000796@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 24 Apr 2022 21:00:13 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16508340136.E59FD.99744" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650834014; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=+pYHKnrLsZ+O11Z9XXFwTlJVJa0IS8hUUUu1SCFBXHE=; b=eT/gcQiEl5tJzUImo7t2vXHQC1SUi0LW/tYuRhQZS4L/9qSXeiurHwkqbHwsZrB96XTIPS buo9ECpGioUytmv1rCJpA05I9rqAqg1JiG5RTLIzvIgRaMAxAShMc6OXrvH2RLIsCImiHa kwB4kQKYnNuCupcj8EVIos03GAAgOF6iAhSWpRHetDb6Mk8yu9zgLcfNr9vOU5hBCDvMKd TrT3jz1WOLy+ewIRLHRWN9fg6xO2q45+I7p+j+VilCGpyPm3W518HLdHq/pgJyEL6zJ8Pl 2e43lWohGYvKw8Fj2fgB/dvAbHxsZvkkmCJJyZB0yEwx1bdDOKMXyW5sn/XaOw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650834014; a=rsa-sha256; cv=none; b=OAq09uJG6LHDOOs2jfBM6BC06K3jJRBNzIRH7p4LEVrzFtspeR3t+yEYc8Z4juK6xxwX/B jgDGgIxAhRJFw1CSe79nxPbwumNWgsmVxdIxu+UKtwbzyWL0BNEOwlqAaMGpJaBo21HlZQ kXAXwmsUh8wfqKTgdjH6fBZe/uJ0AmiWW+bWZjW//otn91hiT4gR+4/TrTSTFf+6zs/iKC QQcGnO668T8AT3+AKkkSurcxtjti0lYqrWmei9F3w4a61N+iMx0dnmPjfyn+ysBHlQCl4n idQxGHzcrqU8qU/8dR/OTQ3YZJJw16tEkP63GnWWKKCXaLJQU9zWz8d5LMQaFg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16508340136.E59FD.99744 Date: Sun, 24 Apr 2022 21:00:13 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16508340136.E59FD.99744 Date: Sun, 24 Apr 2022 21:00:13 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16508340136.E59FD.99744-- From nobody Mon Apr 25 08:56:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8697C19968DF for ; Mon, 25 Apr 2022 08:56:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KmzQF4VRvz3jn0 for ; Mon, 25 Apr 2022 08:56:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 709D0179F9 for ; Mon, 25 Apr 2022 08:56:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 23P8uLXw084353 for ; Mon, 25 Apr 2022 08:56:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 23P8uLRt084352 for fs@FreeBSD.org; Mon, 25 Apr 2022 08:56:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 25 Apr 2022 08:56:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1650876982; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NK0GhfdOCW2ulnHHLTXvLb/NgOr8shp7sB244X5ZJwk=; b=L1sKymR7hQ5wiKtgCRWO2KGEHL2QiGh4qk15hukmFTlSyNl1jY2uLoAaCHYPwWf7rm4ZC1 DLotV/2KAc9hZHllZHArHd2P07qKVhTMn6vIh/GhWYVLn82C9uuVymN0EzlLai18kNHTRx 9K5CfsS3CtjoVJTlU7W/Mb/B03CwqzWptXLlr8dagGdHP9ClSpE/oXGe2aqEQGkmxOC64k PlbTUvvzz5cet+2h7vluR8+IA+zCvsuWpdrJqn1ez/qgqSpxFFUk9bx59Awp52np2M/Ts0 BSdMm0+nRbHo2Tw1ahVbXj19beJNtOyDSc3lgk4mEDxcdY9MK/KDvBkOdovHLw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1650876982; a=rsa-sha256; cv=none; b=AiRXzI+tpIlSxJiuRH10+ymrjkBBnmtFvG/fgR0gzhdKl75ceQxi12BDycaSyDPpbLSvJE pjGFW5aqx9/tBUzcPGmqiCuexEAxXbzNze1+h1Xm0wnMpyeq0tE+wVK1QXV2sUVqfz1e5B J7BH1QzBjaAdNVStNyB22i61sxtyjUkWjkKkxTAh8gxZnGWXZNpN+irmgeuEZJtwsUntZn DXOhNlLTSjvBL5YRX+NjlmCtqe7QLr5Ddb3wFoESEFjEF1tGOmQo9M+sGfn+CkoUfzCZlQ nUYfMQtQYWAenCnxzRkxZygoqmikRoSabxI6NgT02DnN0Dzd8QLS0QzE2mpkZg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 1 21:00:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 88D021999EC3 for ; Sun, 1 May 2022 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KrzBj45lcz4RFp for ; Sun, 1 May 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2E51C1C768 for ; Sun, 1 May 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 241L0Dj0020299 for ; Sun, 1 May 2022 21:00:13 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 241L0DKj020298 for fs@FreeBSD.org; Sun, 1 May 2022 21:00:13 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202205012100.241L0DKj020298@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 1 May 2022 21:00:13 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16514388131.0798.19341" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651438814; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=VolSwlQjFibsdYXjHZoCCWZqNSUbx45z3jhGQ3fQ8RU=; b=YmHm6jxIuEIcQ6GuaD67NhVfZGEqHTDLeElh3nJ+Jjq8WWqFSDgCbyrSxa6XzawZhPYJzJ 1J8FRv8mC7pkJwapwR48atoLOuTIoN1QquQAxtqB1jLFRZmAdp1QmUDd/GbQZd6DZhFpDj Ps+6/wHd+rSf5FEVJBZJTGEGFHkyhWgkB5FbEU/jr0HVg1b5KYJYgIRqDz2/FMKRB1Of6P 19ehS6o+2U91P6azlxOT7JRs+Y6nYeLqcCrkZzuGQii3Mff7DXkrWAvi6n/jLJVUBS7+jU f5TAIm46A7TnWJKiSHlLn9pZq6BMiQNWpAz90fp1cSYX+pOlKxyk04KKGRXCjQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651438814; a=rsa-sha256; cv=none; b=t7PVSCDbwww2WLenAi+G3XOP6nSzcg3ax3ox6NpjqTOAvUvD2ssQ55bsy8QTXxGi3trLMw oOwceC0D4bG+ARZzzGFGliUXZLt49jGezXKJBM4NXRhzTcc38x4IVJVE+m1DjrcwBM5LHu GEJVy8FOHd/Wfd5BQ7UHjffoqDbN6LKeuC4kM+h0wgg4geDk41Sd0JULaV6QgPgn+oo1dp dJycjqEuLMKE+k4oxLCreBU3qzPiQ9hRs/rv5jmjItkkAQ9e5Fka8tXkGHy2waPApHghSH 6jkV4/pXaISgqoEq/dDobthN7MsnXan6DszhqZG3pmKCGSyYDZJrYXXfALKCJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16514388131.0798.19341 Date: Sun, 1 May 2022 21:00:13 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16514388131.0798.19341 Date: Sun, 1 May 2022 21:00:13 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16514388131.0798.19341-- From nobody Mon May 2 12:49:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 76ED3199AA55 for ; Mon, 2 May 2022 12:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KsNFd2GDSz3NPY for ; Mon, 2 May 2022 12:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2AA81201C for ; Mon, 2 May 2022 12:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 242Cn9bK033507 for ; Mon, 2 May 2022 12:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 242Cn9df033506 for fs@FreeBSD.org; Mon, 2 May 2022 12:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253890] [zfs] panic: Assertion lock == sq->sq_lock when sending ZFS snapshot Date: Mon, 02 May 2022 12:49:09 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651495749; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=S+a3n7x3iuMFAs4SEJb997yG7GCmmkzfAYJe2S2waAc=; b=riuj+Hw0KY6vr/Bqdu16/+3f1wRtf1heUwzW68dO259ivEn42uQCMyhXpP4tbL7ynzW568 PAh0U1X7loiVc33iLX02WyYcaGo/MSUE+j1sl9lyPSiyzYXkyZyxMnK/F+bzHdIEIC473p xN8RZtS7GHqt6Vqb/WaHwu+uIkVlYWMzVkd93Cz1XSYFMLHix+VFJ8nbwu6I8gzHstbxE0 l8dVBPZ4e16LwG7B399Vycvcu9F+D52+6SPsQER49EzsItBiBTjYnIzCNvr+nfxd8Xthul 8CpPdMwZgeYt9pZJlX8N2xb1UTb8DlFuGnalDvBo7g108znq7SVHtyO22Dg5XQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651495749; a=rsa-sha256; cv=none; b=MH6nVNX4jW5obBwT3nH3hO+JzhPK95SAohaia6juU2Cl+Tmug2QqadUrB+iJ5Oe5LJSzQt ldk04hnCCucTrZE+hCfVEcZZdMS/tZcWkSWU8YT9x3WyId8nOgWXhb9v6RF1mZNsXIWZPK nEChd8ijylCbpfiv+Arq7JfZruG0IZrzmfsR1FExSzGxHOJWhTuKGjIXXvc43jM7T5dZVm eelSEEVWY1nLsv2w0m5b1jJpsXj6H9gsVINY0m7Zxf9h4Nort/QALm5ULZ7W1XNPIVjBUz yp5tTqZbu5hwc5NLFNFB4oMRvqMHCbm+RAYYQ3Dg82HmtHaDApdj1T/CsGFHJw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253890 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |asomers@FreeBSD.org --- Comment #2 from Alan Somers --- I just experienced the same panic, though with a different stack trace. In= my case I was using a build based on stable/13 from September-2021 panic: Assertion lock =3D=3D sq->sq_lock failed at /usr/home/asomers/src/github/Axcient/freebsd-src/sys/kern/subr_sleepqueue.c= :371 cpuid =3D 21 time =3D 1651466741 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xfffffe0a7468a= d20 vpanic() at vpanic+0x1cc/frame 0xfffffe0a7468ad80 panic() at panic+0x43/frame 0xfffffe0a7468ade0 sleepq_add() at sleepq_add+0x4ae/frame 0xfffffe0a7468ae40 _sleep() at _sleep+0x2b0/frame 0xfffffe0a7468aee0 taskqueue_quiesce() at taskqueue_quiesce+0x1f3/frame 0xfffffe0a7468af50 dmu_objset_sync() at dmu_objset_sync+0x57a/frame 0xfffffe0a7468b030 dsl_dataset_sync() at dsl_dataset_sync+0x218/frame 0xfffffe0a7468b080 dsl_pool_sync() at dsl_pool_sync+0x17f/frame 0xfffffe0a7468b110 spa_sync() at spa_sync+0x15ee/frame 0xfffffe0a7468b350 txg_sync_thread() at txg_sync_thread+0x346/frame 0xfffffe0a7468b430 fork_exit() at fork_exit+0xb3/frame 0xfffffe0a7468b470 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0a7468b470 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- KDB: enter: panic --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 2 13:13:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F3B111AA8D21 for ; Mon, 2 May 2022 13:13:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KsNnW5kz2z3hBq for ; Mon, 2 May 2022 13:13:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A560024E5 for ; Mon, 2 May 2022 13:13:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 242DDJJo049521 for ; Mon, 2 May 2022 13:13:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 242DDJVY049520 for fs@FreeBSD.org; Mon, 2 May 2022 13:13:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253890] [zfs] panic: Assertion lock == sq->sq_lock when sending ZFS snapshot Date: Mon, 02 May 2022 13:13:19 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651497199; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q6hgSeZOHeVwt7jv1xmcRkY8VBLWAiEkrRfqz68eMTI=; b=MQnJrDQ0hcYEeelhoAPMQknIqze/mN6bzUqbWVZxL+TAZEMeFruHkk2hhPTtPO8LgPCi/h jzXJAFEp9bmiTIwOvQ0iUzUfbdb3blw3pe4GkWz/02lZBGxXrGCUT9MXBJzXMeXW4mu1DC cN2iE03+z2J5Lc98YNKaHuOG/20fM8u53Mld+1A1Xdb9EI8Bk3uO8g0BobnCNMSLbQlR4V hXjgLQ5tke7e2Yzb6idsIWfB5mny5osaFmp8NtjgyGJVlGp2woWaG2jP5c8OlmKokmHvIf poumKlE5Lo6acxM4pkHe8NCQlwqJkyHQAYbRAa2Nvoz1icoALD8YVxB55ZKDAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651497199; a=rsa-sha256; cv=none; b=mw69f+FMTafjE1g7WWjxlfJt9ThYbn07h/+nVy7fjZiARozOuGXszEQaBshiTox6MRiSyU 0twGkhfOts/JK+s6Brlcn+SfzNk/iiuNr74zmiNeVCMHkP+o9kIZ/qI2xySRoKR/Lzlpd1 rV5TVLtke4t/QZf1wfoPXaffeJj6YHBXo9b/tUf/rE/MQEi3DBaS6JFOD6giw4E37nyVmu 76M73z0kyCsCIfBT50R0xyUdVocETwbRCvTRmDubc99/so5ktzlOsKxcGnVJ9LLcRsTtY+ GlQ/Hha6xUH/PKaS+EiCF62cmq027b/irMhxYu8ibmqT47I29Y1OiRQTlJsgkg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253890 --- Comment #3 from Mark Johnston --- (In reply to Alan Somers from comment #2) Were you able to get a kernel dump? It would useful to see the contents of *sq->sq_lock from the sleepq_add() frame. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 2 13:36:23 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 57E221AB0845; Mon, 2 May 2022 13:42:10 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from cu1208c.smtpx.saremail.com (cu1208c.smtpx.saremail.com [195.16.148.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KsPQm5j8cz3pJN; Mon, 2 May 2022 13:42:08 +0000 (UTC) (envelope-from egoitz@ramattack.net) Received: from www.saremail.com (unknown [194.30.0.183]) by sieve-smtp-backend02.sarenet.es (Postfix) with ESMTPA id 1365560C0D5; Mon, 2 May 2022 15:36:23 +0200 (CEST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_672a997159081f6af8e5fa01d8fde077" Date: Mon, 02 May 2022 15:36:23 +0200 From: egoitz@ramattack.net To: egoitz@ramattack.net Cc: Stefan Esser , freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org, Rainer Duffner , owner-freebsd-hackers@freebsd.org Subject: Re: Desperate with 870 QVO and ZFS In-Reply-To: References: <4e98275152e23141eae40dbe7ba5571f@ramattack.net> <665236B1-8F61-4B0E-BD9B-7B501B8BD617@ultra-secure.de> <0ef282aee34b441f1991334e2edbcaec@ramattack.net> <3d24c87110b4a155e3f14d53a9309c61@ramattack.net> Message-ID: <32cb580b30636082108a070ee009fdb9@ramattack.net> X-Sender: egoitz@ramattack.net User-Agent: Saremail webmail X-Rspamd-Queue-Id: 4KsPQm5j8cz3pJN X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=reject) header.from=ramattack.net; spf=pass (mx1.freebsd.org: domain of egoitz@ramattack.net designates 195.16.148.183 as permitted sender) smtp.mailfrom=egoitz@ramattack.net X-Spamd-Result: default: False [-3.79 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ramattack.net,reject]; RCPT_COUNT_SEVEN(0.00)[7]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs,freebsd-hackers,freebsd-performance]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --=_672a997159081f6af8e5fa01d8fde077 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hi Matthias, I apologize if these emails were annoying for reading or similar... due to the html, top posting etc... but... in a so large mail thread, how could one properly differ one answer from the other one.. how could you highlight some sentences for keeping attention between relevant parts and so... it's difficult.... Anyway, very very sorry for having caused some noise... Best regards, El 2022-04-08 20:00, Matthias Apitz escribió: > ATENCION > ATENCION > ATENCION!!! Este correo se ha enviado desde fuera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no ser que reconozca el remitente y sepa que el contenido es seguro. > > Hello egoitz@ramattack.net, > > Please be so kind and stop sending mails in HTML and stop top posting. > Thanks in advance > > matthias --=_672a997159081f6af8e5fa01d8fde077 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Hi Matthias,


I apologize if these emails were annoying for reading or similar... due = to the html, top posting etc... but... in a so large mail thread, how could= one properly differ one answer from the other one.. how could you highligh= t some sentences for keeping attention between relevant parts and so... it'= s difficult....


Anyway, very very sorry for having caused some noise...


Best regards,


El 2022-04-08 20:00, Matthias Apitz escribió:

= ATENCION
ATENCION
ATENCION!!! Este correo se ha enviado desde f= uera de la organizacion. No pinche en los enlaces ni abra los adjuntos a no= ser que reconozca el remitente y sepa que el contenido es seguro.

Hello egoitz@ramattack= =2Enet,

Please be so kind and stop sending mails in HTML a= nd stop top posting.
Thanks in advance

   = ; matthias
=  
--=_672a997159081f6af8e5fa01d8fde077-- From nobody Mon May 2 16:27:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 28CA81AC11BA for ; Mon, 2 May 2022 16:27:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KsT5r6fMKz4pCD for ; Mon, 2 May 2022 16:27:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C07C5517D for ; Mon, 2 May 2022 16:27:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 242GRi80057469 for ; Mon, 2 May 2022 16:27:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 242GRiRk057468 for fs@FreeBSD.org; Mon, 2 May 2022 16:27:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253890] [zfs] panic: Assertion lock == sq->sq_lock when sending ZFS snapshot Date: Mon, 02 May 2022 16:27:45 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651508865; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=66SRkUC6vz/CjYcmduCPvZbNsicHDrlVEfDbcMqd9mw=; b=TzqGl/NkwRMzSUdxcncBFc/1CGIj2wZPEnpX2mjNoh37NNdnDHoQ3/e2aj+ntEzuXvF/8y DI8JM8fzLe4QTOhwFqPCGHCxT1diJnBzHDknV0Oy59ZVVlv4OKS+Qbq81pk0OQ6UewBcaW tzpng/YWkWpzWuPyhRyue2Y8dEmMvOxuwIqPLyO5EYLuObheNd+JDD/hT+HS7hoV1ElQoZ bZ/wYwwFMuYyOkMVKNFtW/YU+RsCO0sGNFXJPDIQP3oGmGjyzfe9IDUDQZZReLh3AomcTP CrXvcjazAzqwfu2otzBk+M215Tlg5JlbAvJw7OX0MDnbhqxAuIKxtfQffy3H0w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651508865; a=rsa-sha256; cv=none; b=YPeLtJlyfvpIgqyYfScapHXSMBZN06bODbeTu2MuuhE9+94NeClEHlOXRk0vHKu9Lazm2O mEc08eFwwXDnlNk2FKasdWm7StP2BFUqg/JR7TwDjSBQSsczxEKOxqeZINJkFIpdRdpvE6 b3jiHZUXnp7YYtxgwH/suUF0VweN6zTXqQWEjfOpxw4IKt6XIn/NhaHZDSnUj1e0IzIlHz QT9cmT8+0NYO5zdqr2CX8Gd9okarYQfcbSVRRmRBrWXo5NvNj78Z6e77hu2Rf2fsiTwbRP jgJ5Hfkq3NqPpYDiUDQcvrCLHcnA9JlmCCkCTQaeCqvWhGIrg+Ko8qii3IDH8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253890 --- Comment #4 from Alan Somers --- (In reply to Mark Johnston from comment #3) I only got a text dump, unfortunately. I'm going to try again, this time w= ith full core dumps enabled. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed May 4 00:56:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2B5381ACD860 for ; Wed, 4 May 2022 00:56:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KtJL06BWPz4SZZ for ; Wed, 4 May 2022 00:56:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B0E33DA7 for ; Wed, 4 May 2022 00:56:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2440u8o6013366 for ; Wed, 4 May 2022 00:56:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2440u8RO013365 for fs@FreeBSD.org; Wed, 4 May 2022 00:56:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Wed, 04 May 2022 00:56:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651625768; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XObCZy0ZJ2Di7pYXa2A60I3DZufoLeV7Lsn33UUdPWw=; b=PQYmQdHWGDVJwtQXO1881jdC6yzBf6Mxvl1o4nmsNgEwPr0g1IcuPUVD1Efe0RjGpRkPss WQIFcSIoLUWDw4jGgj5F8uYGNCZG71zFEdGrnsQ6Sm1k1858csUBhSXFXhT8Ne0ucA88VT cdPHgifDIyEmjP3JH137AE3yKPE7/wYiY7S9LlLGBPqGBdj9RBCYQ9gchq6d0ZnH2U4tX8 Y9qmLk7JXQei3tX9vlI31wdjHfz1dExhnhrr+fjmvMC9vqGNMeVyy1qudm6QNSpVfjYmIX jz2pDpEM9SQKSJW3is6WTqy2bW6ZW02X0VvAkvOVpudvPbS3TxpALRBnoKLM/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651625768; a=rsa-sha256; cv=none; b=usE9vDhEurEys+fySjKZuBC/F05+ROEkYWuWqAy2r3oyu5rpyCQsl+MIM3m/7jtkzTjbu5 nq77MTbzyiMiCNIwEr2MvpDJCcPxvulGJK1eTc3GnwbRAfvGQIcEWrdwQ2V06C4u2ienVL jUSesvgeb7wau4CZwb7vdenuk+TzIizMMsetrziaU1Htg9iouYwq5kaTMYHI9yfkielOUn cQOkwLbKeqgvqpNYQQshW65DmFnRX6QDKbFO91ac9N6VFS+rK0ehsmhrZcvkN0eO10wbhs TkAEpfR6EoB27BGHxYEzCRmUt7dFREixcYT5hQ/kaJbBo+zLC1uY7C3CWmkRWA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |panic --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 5 00:01:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A1CFC1AC0BAE for ; Thu, 5 May 2022 00:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ktv421b2dz4vwh for ; Thu, 5 May 2022 00:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0B1941CB2F for ; Thu, 5 May 2022 00:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 245015Vh075030 for ; Thu, 5 May 2022 00:01:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 245015uR075029 for fs@FreeBSD.org; Thu, 5 May 2022 00:01:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Thu, 05 May 2022 00:01:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651708866; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qRakgrAaOaskEehQY72lGK02HdCZInDDCnqbca39YVY=; b=vkIxOZBYP1qUlPOmbmOp4Gu2Xj2Qs8TINSeNZIggFxac2WX2ki4Ej2EUmY6JwrBsL2tkMA ymfhnb/00rrYx1f8b1CzWQUogjzNFvZayI3PTKJsL69bxN5xOdYbNo1VTjNk0OvKNSmn+P 6XTkmeh1LBTnDiITMK2+wS4px4u1xfvCJNY04Rsu55SlYOG9Xmx/PjeFG/IcR7Tdv+XMkC /nEZfWVQVU68qM+s6t669r1ir/yaa+bBJygMY8qcMDslf9+ZkgiH7qba8VOUHZQklnvL+d u2D3hEGFfaSkFf1DRuyBUEz4xV+bbzo2UTxRIFsafwJHV5Ec6JlKcxu/ErCnRw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651708866; a=rsa-sha256; cv=none; b=q1JAi3PRhhDYt2AMU5/xYwrepRLdAon1jMBJC5ffxm04i/MlF/4G+CnIALNcDJIA0Cmjna /wDMdzpz100tsvqnMPGQc2PhbOXOMAUIuZf9oIgo3RQU6nIOqXcsAuO1PsDRFwQcYfcUQB kTFKz2UWmQUxZzhgTCqj+GVOja4oZ5aMHfeRgjyWHyAxL9zbQLLKwUZ8lVq5ja3THYzzkx O40PmOL2HWuOqn7tQngQLAtqLeoR94QyEl+7ilEFnJm2kgU5O3HO2fi1tZ7pwz/nK3zyyX lk8gdKgrh6OtBTId9NG/D4oT2XfQYsQDd0+0kNe2ByxXb2PHTfY9Bu8yTxZQ/Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org --- Comment #1 from Konstantin Belousov --- Are you having background fsck enabled? If fs_fmod is 1, which it should be after any alloc/free on the filesystem, then this is expected and even desirable outcome. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 5 00:31:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 890EB1AC8055 for ; Thu, 5 May 2022 00:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ktvl62bCKz3Hvf for ; Thu, 5 May 2022 00:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1C7C21D5B8 for ; Thu, 5 May 2022 00:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2450VU5V093887 for ; Thu, 5 May 2022 00:31:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2450VUd0093886 for fs@FreeBSD.org; Thu, 5 May 2022 00:31:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Thu, 05 May 2022 00:31:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651710690; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oyGQ5kO7HLusL495eYUQXoqzAoJWDRQY2aCujNfQmo8=; b=HEf8E35GTjYEhil1MVkaE0jnEFVm9/LwQ9/urQqO1K+QJQnok6EEEYaCYS5O0CIC9NNeUA F3SLkpsX4iNtMu9Lv2a6HqxV24HkBUjbWxJj4ef2vzOCyh/ZbzhDlSO0T+1uKBnbaRL9hC 7fetAeh3zkRoXSjD0+ldAB0dl1ZhC2truacZz0P7xXmQdNi6OQM8WvyehmbusjmUFESvzn jtP1G0MrwljedN5iOW8Utmj/Z+DnJlZw8Xuzab1zMoM6xEAylNDPioHTpYrxvTpFR8AW2r oWSjLApS4UxEp65DeUOQWvb8+lfIoCUoF2X7Im6ogF4tNof214AH87QDzRi3tg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651710690; a=rsa-sha256; cv=none; b=Q1VbzmbeGiSTnyyRXFPPdlMJiURPHV8ZFSoxDS70QKllZ42ggsVf6r1V+OA6IhiMVvy2YC vY44FkTLB3n1sKsND6uIQgN4A/DI+1F8ZP5UZd0LKQO1i0tbNJEd26O/CeXtAUwsC72A5C zowJSt9vjRJBQUyAMZvh1VPSkTJPOP2/Al19qWVGGGaSeBoU4hoGz9GBDScl7JOmLVHONT nNDajiizTn7Q3Gfm84IDDmhTen0w2VPxR+9kshd0DXDYqw0qQt0/6XAGNWF1UH9PSVco3a E2mj90ctM72SWbM3KjC3FcMsnBSAjLbqqddU6uWQAMhtENyRjARxllce1ugadg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #2 from Mark Johnston --- (In reply to Konstantin Belousov from comment #1) Background fsck is enabled. At the time of the panic, the filesystem is still mounted read-only.=20 fs->fs_fmod is set to 1 because the corresponding fmod flag was set in the on-disk superblock. So, somehow a superblock with fs->fs_fmod =3D 1 was wr= itten to disk, even though ffs_sbput() clears it, and after that the system always panics during boot. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 5 01:03:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 44D961ACF23D for ; Thu, 5 May 2022 01:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KtwS361D4z3PmG for ; Thu, 5 May 2022 01:03:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AF4461D8CB for ; Thu, 5 May 2022 01:03:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24513Vx0013120 for ; Thu, 5 May 2022 01:03:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24513VAd013119 for fs@FreeBSD.org; Thu, 5 May 2022 01:03:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Thu, 05 May 2022 01:03:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651712611; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qvrVolOTbBLO6cUSPHVeRmKGyClnkoOa2m17QSWcSOU=; b=FiVn68OPP7G5AJ1ImbnmLhSLKsGRr6qjR4lDAF/F5dG3MSUxfWq0mLqU+n3gWig43rtn/j cgG9QvWmMUkbGnazYxL0zLzXHKLcgSYVQBZLZ/crVtTd0/mjX3/Ey7mrvZdnNfWsM3d4K+ lGdCFd19oRh/u12Rt1wOGAfUc+NT5MMk158/jzJZht6FXjO7ohs8w6Iuorb/k7S6jlTMIU wY2jYAwXiepxtCu1xLjPD3YsZOLq9l38hkjmZiO9IMj+u2LJW2wmzlpCNpPWJyygUQyKvr Xx4RBdCAj0XpWcYsLM+ibM/HpepX53XDniSaBsJ765hDKyLhFYX8AewcEnSvDA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651712611; a=rsa-sha256; cv=none; b=GZ4XFpNGWOPvAQzN3ecx9tnRKtU4Aenmg2y8HJV+clndjlNf9p3Ta3wWN328yK9ny7lHxZ p/QUnjjqtgyiRzDZseO/1al8EQc3hAydcAQo2ouHV7JxeZpTOPwkelpv9mNJcOPGiclkB/ aRhEDNdkZWO2IKv6WTF37rfybQQ6pV70fKfXl4PHsPxIQynPDFWD83JGktn7nBcW7CVtI9 1hIWGBxEokUQKckIO6lmYS6S7k63NB6V5Xonfc2l3fKsip0XzGbFrTWntZXE2A2u1vRLff oy59+DNYzhu8stnAtjxNcTmW+UOBkbYLNMeRu9jnTAJfFs37OhoTIb/9bV60UA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #3 from Konstantin Belousov --- I see, ffs_sbput() indeed clears the flag, but nothing syncs it with updates to fs_fmod in ffs_alloc.c (just for example). As result, if a block or ino= de is allocated or freed after fs_fmod is cleared but before struct fs is copi= ed to the b_data of superblock in ffs_use_bwrite(), then we get fmod =3D=3D 1 = on disk. I am not sure, perhaps this could be considered a bug. If we really do not want to see fmod =3D=3D 1 on disk, then zeroing should be moved to the ffs_use_bwrite() function, right before recalculation of the checksum. More important, I believe, UFS mount lock should be taken around bcopy() in ffs_use_bwrite(), although there is probably not too many volatile fields which can be corrupted, if any. I believe that zeroing in ffs_sbput() must be left for userspace consumers? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 5 14:17:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6C8911AC6933 for ; Thu, 5 May 2022 14:17:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KvG496sFLz3GFM for ; Thu, 5 May 2022 14:17:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BC43DE1C for ; Thu, 5 May 2022 14:17:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 245EHTHX063148 for ; Thu, 5 May 2022 14:17:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 245EHTJU063147 for fs@FreeBSD.org; Thu, 5 May 2022 14:17:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Thu, 05 May 2022 14:17:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651760250; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=22ZudSX1yZ5wkayETGABa+QWIyqyazpnWLpUZhPp7rw=; b=PqLriQkfEyBwFa6ExHVQMbAl8VKdXjfOHjEyY/vmmjZLWlZJHusMh9+rAAHBDEcE3aU615 eM4TizwKoIoO5oV9Ee8Zlhc95zbjWnqrzVykmU4BdZNvx+ALAQiuSfxt66vXvwDtapmB0Q 3XbjR3CTU0MJ47sS4Js8zWM0caLoEXkkk+0jEISrrixeciy0grbEU42rpdS9vY3GJZhqCo CCcak0tBBQ0pz4O2gtuYCOIOykgDohc8WSxTJph93P1ngtRmGE6E6v48iRA46nUv3tKt8O gmEu/q5FeMRrp1VZZ2ex5Whe3xO5Lw2Z9CjwXp5oYT1ZEQTE4dAoxO3IhyQNFQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651760250; a=rsa-sha256; cv=none; b=s1pZSaabmAQzCUvxVoAdOYnZTu/kXrWvK3hlQWL6O0G+CkU/eeR7gH5iS4LURJG18qNyYt aYo/Nxf47oGY0Hr7J1Nl4mZOM80I4QyLdWWDWEFk39L/B81vUSIC6MN/kuHX5LhBN78kbV PyvGKhkgcLUT707NTgdMbTNlpIS4PCJuGA3Bxkt+2OcRkSFnRzP4KdbtVQhue1r9ZIiP1k V5+xNGEvEoUFE8RwM/MTuSXSKQnAYUAOWBP6V9KoIPD71k/HAUJvGumZjYDYPxkR4NjQIP qaoU8Q5eqSgmU0ET5rvf6WFIIavLfCQP8W6OAGJ60QL7SZcqTjQaZh588uSIPQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #4 from Mark Johnston --- (In reply to Konstantin Belousov from comment #3) Hmm, above the definition of fs_fmod we even have "/* these fields are clea= red at mount time */", but this is not respected. You're right, there is no synchronization for the fs_fmod field changes. So this is probably not a new bug, but I'm surprised that I never saw it befor= e. > More important, I believe, UFS mount lock should be taken around bcopy() in ffs_use_bwrite(), although there is probably not too many volatile fields which can be corrupted, if any. Such corruptions would presumably be detected by the superblock check hash. (It would be nice if makefs supported enabling check hashes.) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat May 7 19:29:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2361F1AD174A for ; Sat, 7 May 2022 19:29:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kwcvg4nwHz3DRm for ; Sat, 7 May 2022 19:29:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6FC01168CF for ; Sat, 7 May 2022 19:29:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 247JTpQe017709 for ; Sat, 7 May 2022 19:29:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 247JTpsb017708 for fs@FreeBSD.org; Sat, 7 May 2022 19:29:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Sat, 07 May 2022 19:29:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chris@cretaforce.gr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651951792; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iw4G0A1dJOJjyKl9y9kDG+0dNJ7uVgbgzOg75zOMGVE=; b=HjEUrteTVu7lTkygQCMOLWxLylDcEwzaBsEIav0slc0tvtORU4J7USz7w5SA7NOkKppTjz 18RhLvdhZzgrVlTjyQkWDHY3Ev87R6V4NaoGSAN3khec4wHGnQgoZrQKBNomoOGddef8Kd rlkK2NeKzdc5wVIN9BFc2Q0TaaGNez0FllN5WeJ3DoixvpvEYGoM4V5VRkEG8eIffBwy89 QSb/gWF1HQkTwJ/U+yddvsGdgdao8qx35B6iYW0NI+srJytiPmqTn6DEDRGIyw7qSl0peN X/W/4/M9F+skLzSEJPEuuOf3Z3W0g54ORQlG3Ms2+WlQf54vVSxyG+7rY0JooQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651951792; a=rsa-sha256; cv=none; b=NCUeiqbPoaQlMCNumWlrM9OV1jDhX+aCUz3z5+CbFAIhLA34m6ZuiKRZYwRcJHlRzBQYgX WfQxCyUq4/0co/M77p3iOyUpVRh8qLLsqCTx7qsHbUftRR0RFidW/BGQ5qUBK3KZhuvvqf +TIaTwgKZXqt/735Ez0KtmKm62bf1IE7qpIMIG5gaYACFtzINDcvEU/1e1JAyq0ChnMUfT lH/fhnsyG0PfkfXmqtjsHWavb9qKvs2Xv/OIbK1VI4Q2olNRwYv3qmPgneCK/mINftzk2M 3LwTrcZEoK2EwLvPTtBJNY/xHAts5fb3I0n+/ZqFXVpokiXplZJIei5RowOFGg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Christos Chatzaras changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |chris@cretaforce.gr --- Comment #7 from Christos Chatzaras --- After upgrading to 13.1-RC6, I notice "pid 12218 (zpool), jid 0, uid 0: exi= ted on signal 6" message in my logs too, but ZFS datasets mount correctly. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat May 7 19:35:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8CD131AD20D7 for ; Sat, 7 May 2022 19:35:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kwd2H0m2fz3DjH for ; Sat, 7 May 2022 19:35:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E759F168F6 for ; Sat, 7 May 2022 19:35:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 247JZYaN021222 for ; Sat, 7 May 2022 19:35:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 247JZYwb021221 for fs@FreeBSD.org; Sat, 7 May 2022 19:35:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252981] panic with ZFS encryption and QAT: VERIFY3(0 == spa_do_crypt_bad(... Date: Sat, 07 May 2022 19:35:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651952135; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bV1wcDk8Xmm6TG67oe3BRn/Y0dxUgHaXdvfiuB9mU0I=; b=AzQVyXmf8pDshU/MB3rAxJ4vKx+D2yTOREKTxRdhJVCwgJynp5xOD+QVYD2i2+q87VohHh Kyr0lKu+rva8rSjZ0CAvQifyeNGJuGLv0+YIpKAU34XvU+C7z/Jtb5q31RQmfeD9dasVN3 5UtZKjrKPRQ3iFS0H9ZveVzGXJsiX523GIE4h2EfNT0lrC2t/H9nCVLfN/hVaS/aVxw5KI XIv3HOdnQqh5oR18qgAJK2TrZFNG/TiHhsU23iTmo+k4SDgEmP4I4PIyPYvkZPkn4omhjw g/dWtAOU1SrltZVNhwgxj07R8ljO6MK2kfFQKaaY1CpXQD9dWgK4Q7uUgS4uEA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651952135; a=rsa-sha256; cv=none; b=Ue8tiJhUD/GAYDSLsymXNvHXD45+Tx+jXlt2IZ6E3vZBK4j14wrUa3mExSoeXDJ+4x0knh tnsDOHxbfKyG8wgmelnpoz/Tm5Lm1VpKKnVpt9p9jyZENAgAFFijPfwjOq4zIkgyeqM2vz hj5kcOL+7XPiCs0PrucMfc2YFUHGJxyCjjvbgKYsuzu6AUcheSLAWkyZUa4NsU3BXWOm8r jU+p6yubU6bvoA87OY6cP8eRFpydSsNZQzW29fv5MVCMHk7ykRrVl3KX+1SAA1kWTCtdr5 KreyN8HWC0qKAHGAwV3265Wl+/HLhm7nniSpsM4X5XPddXMxw+eoGAXNrID/Xw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252981 --- Comment #14 from John Baldwin --- Perhaps a smaller fix is to do what I did in ccr(4) recently to explicitly allocate a software session and punt requests that don't "work" to software= in the qat(4) driver itself. The ZFS change can then be reverted. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 8 01:25:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B5E4B1ACCA94 for ; Sun, 8 May 2022 01:25:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KwmnW60w0z4g5y for ; Sun, 8 May 2022 01:25:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A507E1B798 for ; Sun, 8 May 2022 01:25:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2481P3WX010668 for ; Sun, 8 May 2022 01:25:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2481P31x010667 for fs@FreeBSD.org; Sun, 8 May 2022 01:25:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] panic or hang in taste call to ffs_sbget() if not an FFS superblock Date: Sun, 08 May 2022 01:25:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651973104; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cPfg4YM1Opea96XcSJL32iBD5e4uCXiYayXdO9Q4oMo=; b=TeqGfKmXM4oXxIelq+JVMzS5AnmglXI19ts1+lN8DrPcK96CFOxZeoC/ZopDGhro0NMAMe 5mq66EoB9JtxAd4C/wz1Tgc1mV9OjrzJSLef3ZtyFsQARzQ9Cr+7bnEQvDO0TEzsAsFbCC Ycg7isC0RTcoQMspGReL6CuOvqAUIshhuo2OieBBkh4KKZFJZTZuP3mqtCqJ/99RF+lOY+ PxcW5O3vLKwNBLE5mBmAwBKViB6HtVI9wW18oiJBwqyOH1R0CSOJOO1MUqMJE3iPd/ilZI tSG6TRRb8hCgMbbPDUpTrq0eopGrDqO85E/Ua5E/4cNq+T8OA5Vr8OG9j8z/HQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651973104; a=rsa-sha256; cv=none; b=f5V1YrtipVBAAR7f28Oco94HQhKtp7LiTbG9nPd5dE9gvgSXiRgaYymK0sgy36+VVnFjiU QkVN7GqUDJ55LxaN2WzFNY5vdqy4bIdHyYvbzAmQmflh0fbQUEuPFVHd9o0LdVyoLFOULN 8vdJVYoao8lSvI207u0bwHVBqbepAQ9IkHWLBhJTRBQqIdcK073bB1xO+wGsZIdIcj7Vf8 SeI0TtFOnpC09jzH0wK6Qg7xz6l/5EYR6nviHvPPjkSza+l2DvWiuR5yLHFKd0bXQsDVUb L/d/KnxWDbJlzGl4w37kdyjg9VQ7cLGFMX9kiszbjZkiBp0j5O03rtYOjs+VHw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 8 01:25:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B52541ACCD39 for ; Sun, 8 May 2022 01:25:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kwmnk58Q4z4g8Y for ; Sun, 8 May 2022 01:25:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 205E51B799 for ; Sun, 8 May 2022 01:25:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2481PEXI010712 for ; Sun, 8 May 2022 01:25:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2481PEv9010711 for fs@FreeBSD.org; Sun, 8 May 2022 01:25:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] malicious USB memory stick can cause panic in FFS taste code Date: Sun, 08 May 2022 01:25:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651973115; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=W82lJeRdhYhU9dYOwnVdy4vykEiYhfxMyo4ojCCDSGg=; b=MLNtruIlwoLrKaa3GtNwYZKqMTN94lBGLSe+zgMz88uByTzctuFVL8CWVHvwptUJ89TA64 d+i6IFPPFZ9ZXJxHKSCt1u+FPQxCxk2HkbGDyFhuEvYCW0D04wQRwTPt0kYT5TCScI5Cat IPhoxx3GJiCoBM0Y9c6f3pUljVXNtLkpPASm6jUXFMuZAZNxcX1/ZTFYj8BIDWY+1xa2RF vCsNweRo3ebaB5tth6H7EJy8W+JtVzN8fs5Q7uYlXtHXY+7xwDyV5s9bU4tW4oZywpYyh5 OZ2JUNOuMxotYs02n2p7pHbdSTkUE6ziLl8GJzwQ1Qz1G3jznPl7w8+kJPtrXg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651973115; a=rsa-sha256; cv=none; b=LgxgKbuTuVbg8+73Gx8Q5QFVJIzFK/pf1RSij+j6ErauR7nXdPlx43GyZ6lnQ7xixXu0nN 3SE3nreF3QRc1BYfnKa9sbkC/Rgka+ks06OsYMuA5hhfX7CSvhUPCRB1NgjdISkomhhxmP W8QnLdt7lAD/80lIy5VB554smJ3H19HUIQ34RLqJ+CPuj52GymrvyVkusabPxVWtt/mP9I W5uFMJYuPMN6ffeeweAwAPKnDSvikBeRFIW85rc6fpXdIEDlMHxHgZol+ARbDmbk9OcV0P 3WLvfxv6YpwnAZbfIHlX+YTP+q8qOX3ZpTUCUf4nuTGJYam4EZmU/jEZCu+iwQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 8 14:06:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7CE851AC1EF1 for ; Sun, 8 May 2022 14:06:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kx5hc1G80z3D2x for ; Sun, 8 May 2022 14:06:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0BBFE261CB for ; Sun, 8 May 2022 14:06:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 248E6tqL027283 for ; Sun, 8 May 2022 14:06:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 248E6tHA027282 for fs@FreeBSD.org; Sun, 8 May 2022 14:06:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Sun, 08 May 2022 14:06:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652018816; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eMsYWxkSWlHLYovs/k9OKXaK17Ja8RYluKzoP3xXZN4=; b=MWgnuY/J2wSFYnLI23oCc1UDWr4ALVSNX+ldTMAykjWNfNzQGPEWKFPSFs1/XiyieV+bRb duO4MWfQ0nixaCE+dJ7ys15UeaSih8ZQUP9cU6JimhoP6kM5MhZu1hUxIWt0hpzsp6CpIB qNAfNjt0h7A9h+r6B1Vu1+kpgaHgJv9ZKdNDra5A3rmVsuhe7e1Ee1qxxEAbE4HQxizCiX xGNSp0fOUWhCe7vnbtiGJNkFcGhYLvg0VtK6KkhWfYAxG3NyyI6xXIqAKaB/eYdaAzUhVs UBYLOKPmE7xDQk+a7p1zKlen6eq5Qf0TL2gmLPuL1JDdKUzRsrSFG6fJDGEO8Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652018816; a=rsa-sha256; cv=none; b=aoI39TfjAXIXMA5rBRjp2QMbLTBaiNvGczudREh2UpUKaaRTRVV2O4Mq29R6aO8GBXPdOa 66mSZsqeJJvjC1XnU2lCul+U3+7K5JwbageoNhLhr7d0frysKIPbWPF02Bknfatm+4R/jM nfE6GwiqQVxEO5wvGOOa9Cuy57F+oBrmdUMcxYjCBb6MNZaXAMZ2CXgNC+eUg4e21DDSJm 0lbJGrIGN8SuxdWBF68Yxw4mknHrEWPKk/0bXt90GJBFbONnjRCzn+BXrKMgei0ZlnPP2g qLnGJBreKnx2prfT/lG63Xh2Jvigr9meUoh26KX6HAVKjlVfCjTfuXXECkPzXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #5 from Konstantin Belousov --- https://reviews.freebsd.org/D35149 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 8 21:00:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 431561ABC4AE for ; Sun, 8 May 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KxGtK4w7Qz4fMN for ; Sun, 8 May 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6C2352BF89 for ; Sun, 8 May 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 248L0vtR052511 for ; Sun, 8 May 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 248L0vki052510 for fs@FreeBSD.org; Sun, 8 May 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202205082100.248L0vki052510@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 8 May 2022 21:00:57 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16520436574.DCf7.50514" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652043657; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ur3WMNK+WopJ7GgplXCR/KqJzxRQmtptrg6u7N5jyLU=; b=UkRRvaaqev0dUcuqfOEMZj6ut1Hf+Jhe9mUzRb/U6cbYyzU1YYiUfivUjqV+gCTduZPBsH Yb+WUkI6Iw+mes376TN6NP7ovtz/vIAUFk45YgX3JZ7Fzlq9QcUrE8nxYqWWWyAGKudQPo pZVXj+VgNwkcx47t065W3RkiuBFj9z1K+jAtRvcv38gjeFfyPLPpf1EB1fy5+nhyffu/eR Ou5Rfr+Dw36k36+Tb6HxxxiHm9qxftJGOAQaRXOLIZI7/YY3p8mkspHDjDjootNdUBsTx1 +7opV/s1J1J3u6cX4r7W+Tjn7zMqL94LOzYLfoB0DvE+2UbMlpdGXKwJNUNG7g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652043657; a=rsa-sha256; cv=none; b=XIKDrN1xRIHJ4szWKCscZOneDZX7uKvDxLQJL0xnItas2yykpZgjZ+ZtxsgdAGiwwVOEK8 wkIXjfBYxpxSJSmgLy+sNnd7W/dBGX7fsmHgl8hYndUOY/U/ckR4raeW9ydNc2zHA8ofpg 3B1j2WjSSqHJyNIiL0Fo0bC4OPmzD4Ris23JdUvc2UWZKLGzIz+KOW/RwqhXJmNpGKjQxT DqZJzLI9UTjMO8QzobWT/GisGWS5bloIEh95VKqDdnXk/jI02iamXICff2s53LixJBRXQl dDTbilqL94yEaqoT+XISUTUY0ljrNfQ6qDOAMTXT6UVb+zKCttcPce83i3JxGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16520436574.DCf7.50514 Date: Sun, 8 May 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16520436574.DCf7.50514 Date: Sun, 8 May 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16520436574.DCf7.50514-- From nobody Mon May 9 09:33:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7BDA71ADE360 for ; Mon, 9 May 2022 09:33:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kxbb72Mlzz4pxy for ; Mon, 9 May 2022 09:33:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2BB9B66F4 for ; Mon, 9 May 2022 09:33:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2499Xthb060596 for ; Mon, 9 May 2022 09:33:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2499XtBW060595 for fs@FreeBSD.org; Mon, 9 May 2022 09:33:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 09 May 2022 09:33:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652088835; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ejeC4DIbtJx1isZkfGNkcmR65GAoXGwT2anvfABEyUM=; b=bR9NVAAcpqLHap1ypVxrJwy6DVrjUDO3slEGixq2Irb9dNG/eqiNsXigBhInNAJ8lXu5BP sMiLvg0wF1TwIUEIR+tpqgRU2HFOhgpPmJr4TO5eCg/u4bFN0WVcZcmTSAIVzDmzHeHrw7 k/oGGdkYwchRNRSmFBRIrU2yh1lht/JVjrlK7rD0JPiL/vyGWDe9OXk6ggZ1n0Ht/lTR8A QsMichU8fRI0iMIFUxbdOz9duIAHr/XhZpQLXK46lz/oC+D/Cll6iVK2+iFFjvtDGKp9jL NJLaWwvKXu8/662onMxQ907yTeEThSnENxcoLxxe2VDg9aB/6u13+qwqOI2uiA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652088835; a=rsa-sha256; cv=none; b=LOlLP5E/MaeW92gmDB0hxKHq7JN5OVZ49IQ7/jQXYTb4rxINsNngh/z2LAfxF5L4/SMEa0 MkKzDQg04z8YrTI01/PAqKBBenewJ3wnPqO/nM0XgKUnnpmfyeiuoDOzq7qPwv6EmcT+ja ZQvpm1J5ITTnz7ydHvsk5TshVsV+SqjfQzv1ain/44ELgIKm+7eWJzuTw68EeR2wuyI2VD xoN7LG3z5Z6WU+r6jA7Zx1K4ZOhB6ypii7OBNfejqpTwpusjX5CuOLV00pj9oB23gM3Arx PiuSxCgOx5Osay9UBVCI/qkiu725FFoyYdntebquM/fl560RcF9pC4577HxiBg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #8 from Andriy Gapon --- In my experience this may happen if zpool.cache has old / obsolete pool records. Normally, zpool command would not crash in such a case, but it seems to hap= pen when zpool.cache is on a read-only filesystem which is the case during the = boot because rc.d/zpool is run before rc.d/root. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 12:15:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 127F81AD620A for ; Mon, 9 May 2022 12:15:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kxg9x6M6Yz3QCq for ; Mon, 9 May 2022 12:15:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BB63510E38 for ; Mon, 9 May 2022 12:15:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249CFnPh046342 for ; Mon, 9 May 2022 12:15:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249CFnPE046341 for fs@FreeBSD.org; Mon, 9 May 2022 12:15:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 09 May 2022 12:15:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chris@cretaforce.gr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652098549; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YADHe/jV7PUzuhRz/LnQ8LhkcbRuExCAKY8lnFSEdiM=; b=qQsi/OmiQN47ZDR6nfFyMs8K7RRVJZsmoRnQemQVZwzQyndOA7wxRkaLyQWy+tGuvrhvei pjX4AxqQ5scXopUjG2F+HIrc45XvG89GU4GD7k0lzjZxYIt8IPLnJvQ8uRvKJO2GhcRB3j BEQAyHE/ip8dSvmcsrntjDBHWMQzrQ7NhLG4+I2R8JVzY10yKfyhKyUeZ6YWqH3kpSM1aZ HHTpaz1vUBnAlHmWS59+od6GPdXJgUU3rBG5lP3L2lMZIrRPC2K+TpqLpC9m7Jb8tgpJhG THtY8bYBmCkKVaHWmDR1ySJL9dqBw8UczIL6bV4nBStHhOyzE7L7BcB+LRK9hA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652098549; a=rsa-sha256; cv=none; b=B1pSld7EuyFlBBIKNIFsWk2z/T0I99Oyed08jVlMRcgZLWqVMi6WJB0zWfAl5jAuGjgybd SP1iSql/jZgk3oIunIiaq9wfL7xr9BGWvyfvGhJd/+8hL3TFzdnUIuv6yM2modS0uwU9we 14j2VxY9Hf6IjSqYsuNvsGMQ38EcTQ55KkvYg3kgz08mHkEJAcpkvnlWkB3gV2eKSp9nnM MZDpDwqx18+4bG8JI/bxjPhl5Nf4utJr/fk+XMDh4/LnfjlEnFY9yYMHwWHyHxbIhQHKsd lBqVeLXu+uKoXo0m6bo1nrgCEaSwojuodGOPn7ykPf+MPuc8JW3HonEWWtl47g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #9 from Christos Chatzaras --- (In reply to Andriy Gapon from comment #8) zpool get cachefile NAME PROPERTY VALUE SOURCE zroot cachefile - default zpool set cachefile=3D/boot/zfs/zpool.cache zroot But after a reboot: zpool get cachefile NAME PROPERTY VALUE SOURCE zroot cachefile - default Any idea why it doesn't keep the value? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 12:31:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 99BCF1AD8E23 for ; Mon, 9 May 2022 12:31:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KxgXX3GQWz3htW for ; Mon, 9 May 2022 12:31:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1F76C10CB2 for ; Mon, 9 May 2022 12:31:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249CVumE056536 for ; Mon, 9 May 2022 12:31:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249CVuIE056535 for fs@FreeBSD.org; Mon, 9 May 2022 12:31:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 09 May 2022 12:31:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chris@cretaforce.gr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652099516; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aUFXagAaHbZRyRmT6tWCrxEi2Qop0xCopdMt6Qm8kag=; b=bLBJ6bV/3/zfEoZpAxBQ0+Jc4k7bnIsSJRYJjx1EabPnlxQTj4b5sWPNSAwSrNvPIaKKte 0Mmdys09UGokXSLCWtoYT+lEJmfJs2I0U093ynsgzHD9Bi5BJHHqRtU4Xq0qJwEdoM+FWp iryHRO9LoT0nTY0dDZb64436B13Tj/IepEljuio9DifcstZSU1AW7p1v9tqPMU33Voxtj6 mhwqsmO7X1xX0xCTLy7b6enaq1ex0IJIEaUuEgWHx0Z0ZLI2ZDDm9ZplJKsicOKfJ19hYb JtSdVt8MgPfmBtnepZdS9l7k8y6kWSLJRUJGJ3fS5OJ0s4mosBkuOjUXE1iD9A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652099516; a=rsa-sha256; cv=none; b=E3QBJsTLM0+8f178kV4Qd8xMgbVDp2NPo+cETiz0xgOB3uGvCwJRndOuZYptL57BVn/sqh j8pTfDvf3vyU+hP/p9mIpwpCWQnoD3QzhFe+pywTGMdop2ia6DBqjIkFLmz6P+xVhC8J8X +FPartd8JaJDehANLb9DhNwdZ6bz1499veAM2ocffJwtNNyO91g3mLkgQIe6//AalmbLkp i5g+k8zk/6QBJFgaXyHwjeIQeLT4yw5B3hUABrJH2KtjN71Z3sYnnf8pZXM+E5/3EkvMFm jcgH41UASDkhtdeAgYjIXcXM+DfVPtTbio7FPUH8QAwDWS6l6iG6oSoo6GVtxg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #10 from Christos Chatzaras --- After adding vfs.root_mount_always_wait=3D1 the message "pid 12218 (zpool),= jid 0, uid 0: exited on signal 6" doesn't show up again after a reboot. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 13:01:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D47931ADF019 for ; Mon, 9 May 2022 13:01:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KxhBM2FFYz3n0g for ; Mon, 9 May 2022 13:01:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2D99611A03 for ; Mon, 9 May 2022 13:01:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249D1FBj067593 for ; Mon, 9 May 2022 13:01:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249D1FU1067592 for fs@FreeBSD.org; Mon, 9 May 2022 13:01:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 09 May 2022 13:01:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chris@cretaforce.gr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652101275; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hkzCFwboHgJUwMSpfCdqQV4aGi725OBlzb+adSjF7N8=; b=xbQP0xAaKP/4bGbpDI68Nbf5kOL4H4ngzcRTIpt964kUCcaZP2fGTvcJn0GO30iS/9EXfV +ffYZOWIf/xGgpNS1No0momzwIbeVkUs6OTAdj6gSK7O4MBzhj8cjD03kn/xQGaWSci2N7 8hGSM8t4T3juO7Gr1r78NSvQOnQRgG0ZL2WgPMXxDBgqrzdW0N7/kS6UEvR80nuP7f56Y+ 3y2nbzKCAMWVoO5Ank8wG1OgLGy4g84/oR280RXZcESHrF0AHcQOlQ5aungwem4GfR4xwm uhJky7D6tlJurg3+9hxyiZ7vXuqaxdNBpWa46OhY2V4/ZsVpVLvK05cSVhIeHA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652101275; a=rsa-sha256; cv=none; b=IeMfVExEhvKTjld56u8EO3g4wGiWjSTBsagc2raKCFCXNReHiUwioa1EMI+R1PiZDGeury AGDz+MkZDC2RJW1vKyMAnyf5C5/m5WMSEmAXNRUoAfMSF9e9QYHUBbMr3QD2h32w6qZ0YT FV7JtS8nGrvMTM9R+lYFIgSdKmhd/6jRAJakaUru9cFsLSPdWWj72tiWJUUUlnl/OvVYyo sOjYmdqBKnbve6O6aLqDIwuog9aeUx2PIPx0FaKZiD9V3RFRR3kOg3+JdDcfIu5FstGzqd Sm5hsdHinaXnO8SSJEnChrVllDF2DOFjNTX8j4YxzDzaa9/lr5boQhPtvWTmlg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #11 from Christos Chatzaras --- Finally what solve this was: zpool set cachefile=3D/boot/zfs/zpool.cache zroot which rebuild the zpool.cache (file already exist). --------- Looks like the "issue" was related to: zpool set cachefile=3D/mnt/boot/zfs/zpool.cache zroot which used during the initial remote installation using mfsBSD. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 21:11:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 203EE1AC1A1E for ; Mon, 9 May 2022 21:11:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kxv3f3v6sz3BrV for ; Mon, 9 May 2022 21:11:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4122517FD9 for ; Mon, 9 May 2022 21:11:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249LBADn040056 for ; Mon, 9 May 2022 21:11:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249LBAmc040055 for fs@FreeBSD.org; Mon, 9 May 2022 21:11:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Mon, 09 May 2022 21:11:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652130670; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uMqjprDeKoSq2NhXx3RsPlOGFmAc5W7fYzxpRiim+gI=; b=XL35Rc+FJBC3TV21KQ8A8cUU/mBZfui4lDvD+yMNxAveyXu3qk37VIScYN/nnyUJiDaxv9 FN2jw1LiJvH09HjbQx2nkntM8SZU9WU+SfANO71RzDIOJJlgaCKBEP3hEoZO+DZe2HhlU8 TK5/8UjDIoB9nyQ9AZicsYupgwfu3O2larOLIz+/PhMbOcTdgDNNmEFASBwFwe/BlZtLJe pSo6aXSKBDTyvIOpBn6kxQD072AbQUGF83GETY42SRNsBgehBYfP9TCen4t1WfNFXr+F3Y 1ZBS20yA0b44bQrZr0N5Z7gPiPdsQa/fxn8PfZQg5Au5sz7ykbLkMGlSYA8flw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652130670; a=rsa-sha256; cv=none; b=p30d5yn5VZxImLzHswgTWfRNWQ09xeIeYdc1Zyxw+fB8HNlxMygLhuiuhM7wiGwrhliD0S BOl/z0gcfatw8jAx8LOnQSopbNaEuPnv7UltcMTFpq/3DRIjppnQDGC0yQgFjsqGG7uQ6S FvozqCwe5ht3fcdKSOYjaEc9Vq8Tl5DEERhRH4CClFxJfVvKecO5Kx74ELGwztKqKdvlxk Id/rRIOx2dHapbTkrZP/n9IDP8ZA3Ly/qHiOS+AuRMq0a8q8EUP+WLoxbT2umlG5BIzSlN LK6QXTV8W7bM+MufrgNrIvxY+Gsgyjyojv9a3TBpP8SiXtiwaQn/Sx7w2g76Dg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dca7c2d2eedf690ae0c780451f53d9ce36= bb2c337 commit ca7c2d2eedf690ae0c780451f53d9ce36bb2c337 Author: Konstantin Belousov AuthorDate: 2022-05-09 20:46:05 +0000 Commit: Konstantin Belousov CommitDate: 2022-05-09 20:46:05 +0000 UFS: clear fs_fmod once more, in the buffer data copy. This is needed for in-kernel copy of the code, where allocation might happen after fs_fmod is cleared in ffs_sbput() but before the write. Reported by: markj Reviewed by: chs, markj PR: 263765 Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D35149 sys/ufs/ffs/ffs_vfsops.c | 1 + 1 file changed, 1 insertion(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 21:11:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B62811AC1A96 for ; Mon, 9 May 2022 21:11:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kxv3g3cHlz4vx6 for ; Mon, 9 May 2022 21:11:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2ED3F1817F for ; Mon, 9 May 2022 21:11:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249LBBld040076 for ; Mon, 9 May 2022 21:11:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249LBBv2040075 for fs@FreeBSD.org; Mon, 9 May 2022 21:11:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Mon, 09 May 2022 21:11:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652130671; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XLeeoiYXXY6Mw+S3BbHHTYOdhT+RFTqSBrd2SuTugaU=; b=b96llFe75qqkTGj0WwVhQEFCjb9lbRYeaD+nY5D3yq1bwM2wzKxNhXoV9izrjj2Z6iCvpS JjukR/2Gz8yF0ruCmZohifrDv8crvPly/ZA+Oz0/Ku1SN6UqXLD7a0HhY/0WCFsvr+otb2 S7qMwSxa9+rZfZef6IF80HivEp3mtyBJesOJwh18BsbrDGgNfCf3FB71yH4+CxP0ATPCrX pHWWov+4KGxnXWicMVc3k9ssfNBLUJGq++yw9z0womwCtnBHU7cBLKNj/Rk7utoc5ywtSA ZjgSjJvJM+fpMNGzG1+eMwwi0bPj68I9IcFoUaW88zFP7n8hjBtC4Zv/SblxNA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652130671; a=rsa-sha256; cv=none; b=cZQbLzwJPSSlhYGlgUiMU/GNE3JKFL2LrD+X98BAJnP0ke/IJ7sHHYYADa4cXfA7EIKyUZ hspp00fv5apieAPqyrcxEox0Ra11jrrVrCrs5FIiBv4MEqPm+EPr1vhgH5Tm5pp+BiQciD +aTFKZl4JqO7VhdK6oaSgO7wkAud2TKt4VkCtgVlTP7q79r6fD7b/O3twZpvJlPVEJQEXU 2MzSia+FLImSy/MspNrPAgFSKfnBS+NuYW5gppgboSdzJE19Y++oZYUVoBhEDRdewxX6Rz Bq/MqspisQj6VVfQjKcyl8UYeP282/CRObPmIdqVNz2+2HyeKSTdAubMXr454Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #7 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D4ac2df8f4cd91017c000543224204f823= 008f699 commit 4ac2df8f4cd91017c000543224204f823008f699 Author: Konstantin Belousov AuthorDate: 2022-05-08 14:00:37 +0000 Commit: Konstantin Belousov CommitDate: 2022-05-09 20:45:27 +0000 ffs_use_bwrite: make the superblock snapshot more consistent Copy in-memory struct fs to the superblock buffer under the UFS mutex. Reviewed by: chs, markj PR: 263765 Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D35149 sys/ufs/ffs/ffs_vfsops.c | 2 ++ 1 file changed, 2 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 9 23:01:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 560491ADF91B for ; Mon, 9 May 2022 23:01:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KxxVb114Pz4RxD for ; Mon, 9 May 2022 23:01:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 02D1119F57 for ; Mon, 9 May 2022 23:01:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 249N1AoA007695 for ; Mon, 9 May 2022 23:01:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 249N1ACe007694 for fs@FreeBSD.org; Mon, 9 May 2022 23:01:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Mon, 09 May 2022 23:01:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652137271; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WNwpIrkNoe5HrDMG/TmWd8WWptyuOUhBmYB8jnGQwxs=; b=H6G2RRifHx8LqpgSf2EUKcGYBPPkKWpFE8y89mNLF8QRa7owbgZ4dlcJfNOOkoY18PWTIP PyTrrPEXd2ct5jTFYO1hTh2ifQ5gfg1apDRDCA9c6Ihc/AupHe3xMwCrh3bFiGgkQ+CQZg mp+pK6Gv9N9Idqub9Hnno4msiD+3V7fBOk5EySq+GOVE/Fqa9MXI+1P9mk8q+zPpvNyT9k OWcSdprJwlXno7AIkml6OjR58rbLRJHWlI/P1PyLBEcJtYbQrTPlrYK3yMaaphUmcrnnRD B1A0p+ec/JlbtQ+SwF/gCbdIk2WV+099oXJg/iHQvGoe2dwsultMDdWdNYpS9Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652137271; a=rsa-sha256; cv=none; b=LCvrKXLUiJX/lQN4G4RlVJoi6rqxLTmeurvqGX7WoSQVGh89ImwIQmF05Fm2kErdPYP/KP 7GD1u7ahbEe+AKhj16Z2REWHoXGqbyfeFKiqloS+B0dBe5DQ4TVcUVhtHS11KEUor6XjSb zgnX1o161rrMB9KOKX+C7uN7JVDDOTWgd9Yj7ZYapyy43ABAQNd4kjWKTEqeBMwPwcHgUv EUZFfN1ii71Bp4WgiRa2MSyEIzhT99puE//TSay+iWPWY4wPYMLg8y6LNzAa4+G87Ce6AC ux0d7s7s+4qaOsBpAlNggdZBjyOP6ZR9RW17Y52kSzJ7KeCYmnLUTM/HiuBhvQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 12 11:46:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 04BDA1ACC7E8 for ; Thu, 12 May 2022 11:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KzVNh58xnz3tp1 for ; Thu, 12 May 2022 11:46:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8DDF854EB for ; Thu, 12 May 2022 11:46:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24CBkSNb038191 for ; Thu, 12 May 2022 11:46:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24CBkSeT038190 for fs@FreeBSD.org; Thu, 12 May 2022 11:46:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263934] buffer overflow in ffs_sbget() if superblock fields are broken Date: Thu, 12 May 2022 11:46:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652355988; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LRDHOiZ1ZRuJ9X9G7niZAjOBsIdOgSvQ4nljCYJ3yb4=; b=b5gqdNViG8GXjbE9fQXb8I1MVrKMBpgJAI4lQCvq4QQcju+dHYJ82fgBCQ38Ttj1u12jB2 MNSYq7R6LPya87KoQlb3mI3nba1mjvY1+95Not7DuuzHERA+U8/DQGpEiARDLG+Qw+3Lpw FbCou2iZIbrbpgfD4LWrNbhtnpJNltpAANjCSUfKupSPdS20QbBWUfFScHCd1pUSby2TXV iejgR2ayexlesrKVpFAnaVyiCMiAW/GKTrDpysshnq3HZfklMVuFEqC+SklJhIDFWUjK75 kghcpR7UhOqlaPwwmFSPJNpTeFPNLPo8pnWCBkxCZQc7K7LFTIXd0ExasfmfQw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652355988; a=rsa-sha256; cv=none; b=vP3HZII0DADhDR3wIX9Z9bMJmT9cIksgctOFTy+CiZAgCRS/ZPxzzFStMKN8Yb8U2U058h hLqjQsh+NUlBy1QMPI+61eoyXlEau1VLSun1V6WZkEER8R6aTsjFYpjSafpYgr8PFzumPZ MyjGW+iFgqZjvfMI/IQf33aPefmR327WJaRKzjeHaLXsoyL9y2Y086Tto+ZlC2/3IQ9b4e w8oQEY+6Toy4MUdcx1hqgCylzDeSy7kSnuC7DrmMZ0K5PSL2MT1m3tGjaZRvikHYWwmzhS fVzhUx1/jGvwcezBNOKDbERVIDGUNh4SnAbiCGVMHvy1kvOw5fTtdgD/2TC0uA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263934 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 12 16:20:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3BFDA1AD9E10 for ; Thu, 12 May 2022 16:20:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KzcTG0WcYz3GFN for ; Thu, 12 May 2022 16:20:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E1AFA11847 for ; Thu, 12 May 2022 16:20:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24CGKnAH093028 for ; Thu, 12 May 2022 16:20:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24CGKn0x093027 for fs@FreeBSD.org; Thu, 12 May 2022 16:20:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263934] buffer overflow in ffs_sbget() if superblock fields are broken Date: Thu, 12 May 2022 16:20:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652372450; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ThctUE0u5G67cqqRxNTNflomhB6JEK2tCcCJorzFF5w=; b=kad0EgnWqn0VJ83VQcb3yjobFeRa+OpIqIGpPOstByhwUezlJT7kYhmTNy2vnLchtO9Jfw W8HhXPjCLURv4HGiEx04+cVwVTm12aBgWkMG2WQ/hfzh7skiatABHhpxWe8wPUEKc7OQFd bghpLhN4eaEX+deUnDkKxMbAgOFsmfpYqJy4ZEVJPblIpsbpO1jHp19tUIVM69ajOlXeIz db3zxZGMHDPUbOGhHlLGoGGWC0CR+7BR8N8ekWOz+cvKI7gdS095iN6cZyIQv2Xkj3W9f8 wgLhNbOnySAJJmeWtFgCcUh7GkX6DWGhBZQ4ziCSMe+f/YQaNHJ+6mZdLW/cPg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652372450; a=rsa-sha256; cv=none; b=TAMI3605jrQw/30+OQs6qYA/F8OsZ/WCLKt+Qrw4ohOAEpS44bxYrxI717DKDkQ1dkmtPU s5Kw7dtSytnatK5SgsENpg9Ru0mwhLKeWZb1HjiYFRzvlwoqvvyGrPHGBQ9s8Iu8P/5pf6 ebJ6DRUYVaJ2mJkGgq9iOs357ffQweE31r9SvZfYVqhiZey/EEuKuD/15YthFnS8RpOTAx +6ZVrWWZQP7RAHjl8ABK2evL/vXoVm7jf3kND9PO/h6bJe0ZvAgg9y9kTN/F/mqpr6Huvl dYuBWNpaBLFGFqJ9LLhdQX1bi4yPYWxjnUAW3XwbBNT+pKQpl0IPWhepieV0+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263934 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- Created attachment 233874 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D233874&action= =3Dedit Proposed fix for bug 263934 Proposed fix --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 12 20:41:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4D0A51ACA073 for ; Thu, 12 May 2022 20:41:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KzkFX38xXz4hmH for ; Thu, 12 May 2022 20:41:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BB123152F6 for ; Thu, 12 May 2022 20:41:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24CKf3Lv034321 for ; Thu, 12 May 2022 20:41:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24CKf3an034320 for fs@FreeBSD.org; Thu, 12 May 2022 20:41:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259607] prometheus_sysctl_exporter: Need better encoding support for sysctl OIDs Date: Thu, 12 May 2022 20:41:04 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: delphij@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652388064; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dkudV58nMdomAET0UDxCFOzX4eEtqko4+27JHxRSGO4=; b=oT354P9Jo0lXsQNpzKY4P70Gtiane+s+RHYjuc8OeFBaZ3fqYky6+1uljrB824ikGspU/2 uNiQu+JuuRF5y5a1fxWKD2uIB8S2dIl9OZnD4RixE5eueBkluvIfxbxY43YRcNFVPrlvIp Pqpo/sxKfW7FYbddfUpD1Vz7k25tEl2CQvLeqbdAZzEXMaadhDtVzUzM6p3M2hKcjXm3tm IObY90kyfL4sw/HFJQeQTb1P6wUnjMM29k2AHMRCW1EKSmu/HUZXO+aIomyi5kXVB8rqNC 1I3tqM0i42aJnxHYmhwe4b35SPe+2puX3FyDyAQRKMvGHxyKN0u+Eq97j0AEJg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652388064; a=rsa-sha256; cv=none; b=MHx+O61SOZ+hwpjiXFeZnw+o21f4p1vtTVypiMg6L/Z/r5pV0iWBCB2O8OomTF/pBtq+lN b+PMaMFAidSZJvm3f/Xa8WqzwkFdRvwcpygclpxRHxLA0sAJomDbqyEZUszn7WZe0ggmNa Ys5C9kN7OeN9Wtik2H4R/kAXF2W9fQI3XPZ9oK6EG8oS6oAs4WWx6BtGO1RF7+IllSyAoI 7NRcig7ExT525q0BfC5Rf+ZsE4A1QWzLp9AZHZBg/NDOQT6Lj/fz+RiPTlXvROLQa92izh AZJhU6Rolb5BREJRItt5PhuS4Tj1MDcRryRWUlfqVyLOv/NJRqAeo2CJRI0C3Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259607 --- Comment #5 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3De4f508d5a211e99dd6179794b51fefa32= 9886be3 commit e4f508d5a211e99dd6179794b51fefa329886be3 Author: Alan Somers AuthorDate: 2022-04-18 21:29:37 +0000 Commit: Alan Somers CommitDate: 2022-05-12 20:40:05 +0000 prometheus_sysctl_exporter: fix metric aliasing When exporting sysctls to Prometheus, the exporter replaces "." with "_". This caused several metrics to alias, confusing the Prometheus server. Fix it by: * Renaming the "tcp_log_bucket" UMA zone to "tcp_log_id_bucket". Also, rename "tcp_log_node" to "tcp_log_id_node" for consistency. * Not exporting sysctls with "(LEGACY)" in the description. That is used by ZFS sysctls that have been replaced by others, many of which alias to the same Prometheus metric name (like "vfs.zfs.arc_max" and "vfs.zfs.arc.max"). PR: 259607 Reported by: delphij Sponsored by: Axcient Reviewed by: delphij,rew,thj Differential Revision: https://reviews.freebsd.org/D34952 (cherry picked from commit 8c47d8f53854825d8e8591ccd06e32b2c798f81c) sys/netinet/tcp_log_buf.c | 33 +++++++++++-------= ---- .../prometheus_sysctl_exporter.c | 11 ++++++-- 2 files changed, 26 insertions(+), 18 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu May 12 20:47:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CC3D91ACCC9E for ; Thu, 12 May 2022 20:47:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KzkNx4PkTz4lg1 for ; Thu, 12 May 2022 20:47:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7760C1590A for ; Thu, 12 May 2022 20:47:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24CKlTCg037465 for ; Thu, 12 May 2022 20:47:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24CKlT2U037464 for fs@FreeBSD.org; Thu, 12 May 2022 20:47:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259607] prometheus_sysctl_exporter: Need better encoding support for sysctl OIDs Date: Thu, 12 May 2022 20:47:29 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: delphij@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12- X-Bugzilla-Changed-Fields: resolution cc bug_status flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652388449; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=H/+JLrzabgJ9fyO0qYnemBkZtCsQjsOdNhSHUZ1C+AU=; b=eAoCYuiAC2oYSrZM7EgN69Hrm16X5FNMBItgQMZIc/0/PBYqxNNBzfeEOSvPDcVUX+g96L W1tlsNra2yV8isJagyf05D4hFUZPry/7D3oGTwCd+IXHVd7tL4IuOu+ETxrbv671Py67ma epdevFTS9/pdqulqrOkmAJqaCldHWOnf08JbNyntnYSOqHcZfFavuMAhnk8OlcmJ6QoxWx FfdvYHSr8ByzYYfSs1l72sGjG4xQAyq97nHynJi/yeJDqmdZBAfk3WS5H6Qxp9zi9WOgC7 OS72QIMQyYCd1FSv6VgljYZg82t4atXVJ6f8btSFtjS+gqt5r2ZHgNmrgEa0aA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652388449; a=rsa-sha256; cv=none; b=NjNtw/p3HLSgpbRfcMfbZ0RwPPkjfHhDZ5h7Hy0h0oPkshmtZcXQ71ud7xwCsUBcrHhrQm bFLg47SJNNRRVKN7QSeqIvWarqOcPcO8AGcnnjebEfO2jw9xI0uY/gtcB9MLcLQnNCXlH8 GO/kUaGL1Wo334ox3CO0M5RMPi85D8ePkOS7VSrKNte2wc7B7hdGOkKOZmogsXQdX/AoxE 0J4NIqTrU6qQoz81RkwIjT30PfjYPBmcaulGYL009rmUVKQPhv3xi2dqmDi1fFywAqI2bc ObDjz0J0MK8+K6AXZ7oFFdTKNsTF5rjaj8WIrlFDzpZZTiRVdtbnhzyavj1HVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259607 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED CC| |asomers@FreeBSD.org Status|In Progress |Closed Flags| |mfc-stable13+, | |mfc-stable12- --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat May 14 13:34:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BBBED1AE36DE for ; Sat, 14 May 2022 13:34:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L0mhw3Tqsz4hdL for ; Sat, 14 May 2022 13:34:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 58A0B17CF5 for ; Sat, 14 May 2022 13:34:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24EDYu4K014957 for ; Sat, 14 May 2022 13:34:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24EDYuot014956 for fs@FreeBSD.org; Sat, 14 May 2022 13:34:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] malicious superblock can cause buffer overflow during tasting Date: Sat, 14 May 2022 13:34:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652535296; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=45SKLMFr/Mj2kNJxtN7lGZQ+bpQnIrmg36lnxNaX06w=; b=axEYx15NEFVS8oH58gl5Ly9bdEl27L5c80ohxtVrt1Bc+jtPb/cuTD9xBzexJzu+D8PyEb WTeEaHMndcGFMyGFX1QnNJxedU+Z45h16QTfVGw9unca/i7/rjXZJFPtkWvBDJUOd7cb55 aX0xNpjBama4FWngfvJIx+f6YAKLPYcb2IDxsY+ehBafgKRt0ievjnCvvPfbAAAQioMjOB oHV1OrhJSVkeYDFZINjiVVUJ1JT74y1biV8mlWds7eD9DqotgI3DTMgR/+dYcwgO2lRHzO jE2GrAPxwyonCqBec1yV1Mcze3GLswbO9Oclc/U6ez32L7Ux9pATf27DA1XGFg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652535296; a=rsa-sha256; cv=none; b=dzugysW+yRe3/pvRkTIpiTcRMYPf0QIqi9XrJLlrc1mtks9A87BjH/5eNRkDCuqnd+TRKB cOAqcznQcZG53dEyVUwJzVUyiAHsKWTDGajksZjocPHONaGeyJcUas5Dw5VGjuhkjpewZ9 tZQYto2JjsXrIivuWdXMzlrSr1y8FQGHNc3bwhFixbEVMsqzDSG/+GUoMZba4VxVZCWtKC T9iTfEmRc+ttQi1LhyBsY7rm2FaHT69wRz3m/cBLFX/Cy3wIlYggStkxg7Uw/vae6Dw59/ RxQtpa9y0zZgsUvI7JwGwKsmb9NHw2rIk16k6F0VEHvTWq21ZkSBaWB7dRDEzA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 01:52:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A0EF91ADB99C for ; Sun, 15 May 2022 01:52:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L153h37h3z3R93 for ; Sun, 15 May 2022 01:52:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4C99822878 for ; Sun, 15 May 2022 01:52:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F1qGqO079703 for ; Sun, 15 May 2022 01:52:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F1qGo8079702 for fs@FreeBSD.org; Sun, 15 May 2022 01:52:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] panic or hang in taste call to ffs_sbget() if not an FFS superblock Date: Sun, 15 May 2022 01:52:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: see_also bug_status keywords flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652579536; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=z8tMonvpMYeXVYT+l9SEwOtdnyJD3E8THxjB7EG5omA=; b=DqV/enxCQwG5L4nPFmoYQaRqIFC8yCbabUOrnO2jj3BQyQLj7wIYpR7P6kI9bw2Ku2Pf/s AE32KQiV5yLj9dk3v/aw7AhlckW9WnqrxiJm9eIlgI1ZC95DszERDBSxNrZSDBnSd92L/D lFGH4MZQwmiWird3Dg8CE8kqQaBriPoOfbIH+XL6/yeBqA0itdvhSM61hUgWYNK7M58wCa E3r+cJBhA9DSj2ugFWJ2/wN2V4pJu0tk+hT4AxWaHl7RdTE1XuCpdAhlX+SrMr0uVX9VQD wDVY4ANxhoBySXioZdupdb4Fajt5rnRcTZweLbdzpRWUkv2eGmZCy98N6Mywbw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652579536; a=rsa-sha256; cv=none; b=xmfqAdd/TypFHzr44Rjh4prutArMLk9N05f3Aj9cB1vfc6oxB0ucNOK+w9zSfxmN6RqOO0 mqcj+rVY+5yf5EnzoRyKuUAz/oNN7wsepu4p+C0qv71AHzHkrNfFMHFkpN8dw1HwD2PxH3 fD00q0yZsuCCRp8Xuu+fZdaU8k51JP9WWlAjVQcdVYiHVGPbm1SK4Cg303Mt6kSiQYRFVI YW6WA3JHlN9ZteadurjJxwdgfDwgGv20xAic0CZNYrB4gvm5newhdpUT0um7DxKpZI593S pxw035dJbA4+vYFtKxdA748CwgB5hGsFK3KzlJLISRRbRsPFRbYWgBb2uFAfFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 443 | |42 Status|New |Open Keywords| |crash, needs-qa Flags| |mfc-stable13?, | |mfc-stable12? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 01:53:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 677CB1ADC020 for ; Sun, 15 May 2022 01:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L154c1jkxz3hdt for ; Sun, 15 May 2022 01:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1BB3D2273A for ; Sun, 15 May 2022 01:53:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F1r49A079949 for ; Sun, 15 May 2022 01:53:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F1r4Q2079948 for fs@FreeBSD.org; Sun, 15 May 2022 01:53:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253617] ffs_sbget: panic: Unregistered use of FPU in kernel Date: Sun, 15 May 2022 01:53:03 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: arichardson@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_file_loc assigned_to keywords cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652579584; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ur6v7LdoEw0Iy7W+YY3K/wCMV7w9AFev5agyClgR7xA=; b=sSOw2Su2CRxltLzrJQG5ghPX6AiF18LwGLp5P3NDi1m80JSo5yGQreEa72ULLhdmmMSSAe LU3RF9DjpaXzx9opio0ARZIZ2SM/mo+kSsfWskmaQ5iOGmsGE4pS4CGQzMGHTj6tOAMY/u 5QxavM2EaKSsa2N7y/u0t7dTTp5OdQDmZ7UpBweiDVlvQZ4P4X5VsjKxLUw6PaQsXosyC+ gL2rSUq+QeucN4XxYeVUPvBPvYAl8poltQimLB9L19iy4e0qH1DEjYky4pHgG/feQEV7Dx IuaPXysPO3d/zIS7SrcST/1KN4K6ihaKf90e9VvcCDNMm+PyzMEETmIJ3Jo2sg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652579584; a=rsa-sha256; cv=none; b=myw353ZjIYBSwoGdwrudveX5PQRKhphqfTByyiI+478IqjDPEK0tYsBjFVsrrgZUK/2qjS FQVXp048NQGczLQtdOszCHzHL0mrl46J7YG525O3yZwKw8LtoYB+ja5zaMqEN9EAR0q2zu lmXcY3rUu5b4FB2N1jt439aqmQhdsZNqsuaAIY7MYpb2FLU/MfVRzdrG14hZ6EpUHkPm2Z JE4tHN6TVM8CfY/e3efuvJ05K1IIKpUYlye3JFYQbiTCcjMbpVyirRc7l9xcJa49V4S8p7 SAsH6mSQvKQYT2cBjphKBxLJwjAyZrUexvx5XVKwed6oSupWw5tslV7V15afZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253617 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |https://bugs.launchpad.net/ | |qemu/+bug/1916269 Assignee|fs@FreeBSD.org |arichardson@FreeBSD.org Keywords|panic |crash CC| |fs@FreeBSD.org --- Comment #7 from Kubilay Kocak --- ^Triage: Assign to committer that resolved --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 01:54:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B6FF71ADC83F for ; Sun, 15 May 2022 01:54:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L156b44RXz3j4V for ; Sun, 15 May 2022 01:54:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6CA142287C for ; Sun, 15 May 2022 01:54:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F1slv8080366 for ; Sun, 15 May 2022 01:54:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F1slBg080365 for fs@FreeBSD.org; Sun, 15 May 2022 01:54:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] disk with garbage can cause crash in taste ffs crc32 code: crc32c_sb8_64_bit() at crc32c_sb8_64_bit+0xcc Date: Sun, 15 May 2022 01:54:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc bug_status cc assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652579687; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cFnTEhCf7nZMojFmrOtQUkEGm6P6dBe5Uvv0H+H5MbQ=; b=OzuAOlTOqi+n/DO8DUvx5qun71iMhrX0sbmKNi5xSiXQk3Gi5OGaLOuQonksELovu08f6X t33xA8M4ztDu1/6Ta7tTjLmcOgScYg+xaOOgdlRYO5nHbWzvntf4iHORRU0XKfHkQ0GfaY KwtJnnYOqlahvhMycEC5Dl+fKOZFwDChTsRZHXQ79Ida28aBC/gLOJujoNx0Stlzqpb5lT CQDfmesro/8hdu+cN7QAmvKO29ih1rMv5F2mxls8uSJww5d/QahTfzyN2geSSmzo6fvfob ZIOpanpRWcgUzROz4gWvSwogOiLcgZsDoSRm1VHT7btPmYCKVUEACKIu7sw3qg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652579687; a=rsa-sha256; cv=none; b=MycBx1crIM2SvD9g9tJuvZipnRsPlkiIIylm3PsQVOtbEepUDupzrmosjq7IXsBc4bF7i8 2BkOQM6oWR8dCY13SSn1w36pcx6wO8uMrhKGPc2aXXYgYypKhP5dsWQiUMcjTt1mz1ExC4 SIGVAAoORC8gbRUQpw94rTRW95oMeGqEcHZt3XquFb3VW6OPmQzvaKgL56X6B0wBC1KVIi Lup09KQ6h6rXwRAZIGQ3U4ChngupwMu0uuTc/CgopLG/zulG1yt2yqhCG/X86VMoilmJHa jPc+W66X4pIivUUvDqmXuJRndyswA5oz612mCqn61gRDe5yg/RmnWVb0HLszaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|disk with garbage can cause |disk with garbage can cause |crash in taste ffs crc32 |crash in taste ffs crc32 |code |code: crc32c_sb8_64_bit() | |at crc32c_sb8_64_bit+0xcc Status|New |Open CC| |fs@FreeBSD.org Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |crash, needs-qa --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 01:58:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 97B8F1ADE18F for ; Sun, 15 May 2022 01:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15CN38Fcz3kHj for ; Sun, 15 May 2022 01:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 43B4C229D0 for ; Sun, 15 May 2022 01:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F1wuPb081076 for ; Sun, 15 May 2022 01:58:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F1wujA081075 for fs@FreeBSD.org; Sun, 15 May 2022 01:58:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Sun, 15 May 2022 01:58:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: version keywords short_desc flagtypes.name cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652579936; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3t30yh2tFOZC09AdQefJLkpPMMtA4NpoM1ngzK25fmM=; b=uVWafV6HoOfq2i35WHa+jamNmeWKofMfcyabF3Y6csjM4WvjHKZOrBgtMDf6D/DFZblrVb ASHkwqGsyE3gXqcWe0zgDfTdrAqecnPXaJ7n/Dpz0QGaOpDi0cNGWOYw6MhJABbhxgEjlu 0I3MMw6i53ur9PWWlABD6Ws48UzbfSQ2Ylc7zLawxuuvlDd03kqK1R0cU73fj0ZLsGSr0/ GFJ2mahSrIE66DllRfP2mRCR5ZEscgrRCbxQq/32/TanfG0orXuZ2PhwVKJ834WtPGKqm/ OZzR6Semr/M3SoyOyj5YFLn8d94P8OPBJ+/tsGDEOGwOAH3GyuPDkjQcrJNoPA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652579936; a=rsa-sha256; cv=none; b=gOg0cXAXMA4tHUe1NoXt8MprCTYCLzgV4C1nx/anYxBLmJlFq/vwvjeS5RZNSlgo8KgJfV MuERXmR8mMeYdTv/jpBCoi+6Fp+tXOJZJfYu1hvPp68pK3bu/hGdidv6iJZd7rz1W8TFp7 kj8pctairLyKbuGkq+rr7NY1gk5uSFrWx/cNG/GSUqnlR/JXjA2zwTqrQi5dIdzFq4tsnr +38zKVr3Uu3eumZzX/7XqpUNs6PjLMfk5+/KDqGKkSNF9VWxcfI0EDzFMbiTaE8+9Asz8j oqmkLXWd8U2FrOmmH4K78bjJfasp//YvLxSXG9O7J3TvLcaKvYtBE+cIboXPwA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Version|CURRENT |12.2-RELEASE Keywords| |crash, needs-qa Summary|[2] Kernel panic observed |geom(4): Panic plugging in |while plugging the UFS USB |UFS USB drive: Memory |drive on FreeBSD13-CURRENT, |modified after free |FreeBSD 12.1-RELEASE |0xfffffe003a559000(65528) |r354233 and FreeBSD |val=3D4 @ 0xfffffe003a5590= 00 |12.1-STABLE r358121 |(13-CURRENT, 12.1-RELEASE | |r354233, 12.1-STABLE | |r358121) Flags| |mfc-stable13?, | |mfc-stable12? CC| |fs@FreeBSD.org, | |geom@FreeBSD.org Status|New |Open --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:05:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 562F01ADF0F1 for ; Sun, 15 May 2022 02:05:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Lc0z52z3lNM for ; Sun, 15 May 2022 02:05:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 017E5229FF for ; Sun, 15 May 2022 02:05:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F25Bq5085365 for ; Sun, 15 May 2022 02:05:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F25BGc085364 for fs@FreeBSD.org; Sun, 15 May 2022 02:05:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: anic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Sun, 15 May 2022 02:05:11 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc short_desc bug_status keywords flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580312; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ODCASETpFdzdYeJ+xLDRzYBBlQfxU/uR77HrBkzHgyU=; b=PU7sUVgpMtF99omiQJ3MKeKMqJe/f0emkaV4M/KcCVr7IFgesLOh37bJ187qEo5KHhyTEQ rawKYAcZIl8F0VklpMYDdF1vXJyJGecDkhTjD4uTYRUD0lzbD74yz5jzgsyjG9yW/LxsCt mjgK2gZxaa78tlXKNesLk/vdCYLfB+eeulm6o5RymUdWtwxfW8dHsVZkaJagGtj779QETe CB6NZ4QJaKyjXJT34ds+qa1aaoKd2o+KeoH3J/P2bn6rFCcMX5SIz78c0iA8UTtSfetL8z tdgA66fUyilhdgEdrlBCm/IZFWjC86PmPnG/jW+TagtJH9RDAcoak7cK7QoNpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580312; a=rsa-sha256; cv=none; b=ZOJckLKFXugH2a0TLtxVeeEO9KnpRt9lhJK9bcWIfZyArRXcntNLkQc2mDyzm3eEpJZIv6 r+2oiuTmGAM0s0egBdCeQGCtzrfKRXb/llYCLzCqmPneBBnBwNrrXVIjq2yDbdUB9AvS4H S3R4q3bt04ocM2qDIpc/l3FXKvVh1zT+8CM/BTsVMZqt4GvHLYyJhcT/+OKDC7mIAc+r8O BCVaBdfTwiRv2c0oYqdk0UENR6sNnUtql2dEPseJjP8/o2IxF5OTEsVHkYvyc6lCSOIv04 ePIVYN2vpFbUy/kfXbPMCXuJzFpbGaX08mCJtzPrlam5c2NDVhW/p9fY0Yhd6Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org, | |mckusick@FreeBSD.org, | |ports-secteam@FreeBSD.org Summary|malicious superblock can |ffs: malicious superblock |cause buffer overflow |can cause buffer overflow |during tasting |during tasting: anic: | |vm_fault_lookup: fault on | |nofault entry, addr: | |0xffffffc07cb67000 Status|New |Open Keywords| |crash, needs-qa Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org), | |maintainer-feedback?(ports- | |secteam@FreeBSD.org), | |mfc-stable13?, | |mfc-stable12? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:07:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 00ED51ADFA46 for ; Sun, 15 May 2022 02:07:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Nk5mxQz3lrS for ; Sun, 15 May 2022 02:07:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A7B2222DA0 for ; Sun, 15 May 2022 02:07:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F272QG085591 for ; Sun, 15 May 2022 02:07:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F272t4085590 for fs@FreeBSD.org; Sun, 15 May 2022 02:07:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Sun, 15 May 2022 02:07:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc flagtypes.name short_desc bug_status keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580422; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZmQk6AmjPCFwIMmopxhcdYkOgZu1LtzSUZP6QQGUKEQ=; b=UzkjuZpCBjZ07n+UyTwzmE9ZviEmgGUAtks7GYr9NKYrTI45628KYeQkegC//DzoZ01IGY XdZiEh5X9Jpxl2pfkz8EFJuotdtR93l1oW9fKY0LtPynlvK/6C8K9XJdOYtCPaITApnYpw bUnTNNTi6Lsxvy1pHfPXuiAoixcOeLsywXisZN6B4wngK4JXDjRB6iqAWD9g/kVT/oCH/W TGx3klEyflcSjdxkQdoceG3nIOhebDlTPldvg8LV8+Usmuj3QHmkwd/CZoRIpLE0o2S2Ti 3wjIWbx7ulsqytT1XWxbW4asVywEH2CBcg66J5dGmuzTsD8VIY30c1nk6LuO7A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580422; a=rsa-sha256; cv=none; b=jhcf1gHdRuk/Ht8HwvEz8OEwZ+8rU59HOD8WGIvh4Fz5YHuxbrTFfjJx4uq7JU1ZYk+hzz KYTTQefVqJg14d62u/pIcJ2Eyliz7QVVueUwz9RaJIdkZ74ZCA7/rCcEUEd0NAQxWGVVG1 ep3U2KOG3nywg/fEK3fLQQx5kekIrUHbyO7vkbsxQP2XpGMcz37y5ZYaEVKFz7NMCjIf4s pY8XMGQiqyCX4LplqraYwdXnDZiRhACLvCo5k1nA0c3gkgxb6U4EefjEY5LLSYXAyea3a3 c8bjSoZx69SYWtF7MKr8DQzu6ACJtFi41vTyqrsZfiUISZvuOGMEqwD+arP9Xw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org), | |mfc-stable13?, | |mfc-stable12? Summary|malicious USB memory stick |ffs(4): malicious USB |can cause panic in FFS |memory stick can cause |taste code |panic in FFS taste code: | |panic: Assertion size > 0 | |failed at | |/usr/rtm/symbsd/src/sys/ker | |n/subr_vmem.c:1332 Status|New |Open Keywords| |crash, needs-qa --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 02:08:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 373091AE09AF for ; Sun, 15 May 2022 02:08:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Q10KQxz3m7w for ; Sun, 15 May 2022 02:08:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E0C9622D23 for ; Sun, 15 May 2022 02:08:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F288oq085745 for ; Sun, 15 May 2022 02:08:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F288cp085744 for fs@FreeBSD.org; Sun, 15 May 2022 02:08:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:08:09 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: version flagtypes.name cc short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580489; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PuBITmNbix9ZTmxlG6rBAnV+1w33NdX2Fbotp8hsutM=; b=AxF2xbKAJ7NcrD0EvgCY+Niu/DwO0csRnNPH9JIW3bauIEX2v8yTEjxDQO4jlDuNRxPHmj f/r21vAS8rYdZRdBVzTAZmBBLNiQZXE6IABxrlFzfuqPPKmhSfopT8xVhNdKrw/nZdmMoU n6FaDetK96uLDm/xOwa1PtjruNJWd1/FeKzXtP/RRbsDjP1L2MdJVBduwg/tXdZoXb8q91 0I3OX4wt46EKIwTe8b6b/4oYBZIeGOafry61sXyvustjMvnJEYyrLITUH2TrUC6vh36A+z fVMmzKl93wjXdnCrBGzBBqznw6qNRRUzHfVoqWbKgI197c96OKQu1vvVOWisYg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580489; a=rsa-sha256; cv=none; b=Vj0A36CW5/itNdhla/BO50gcnQfXnMS7bYnLsMtsGvsldb3QdI9Ib1rgXmdtG6u1gABSFI eDH11whbA9WxlCpTvdAc0pbW5djCowa1gkJOC0bfS+P0VWTHI6kq4PrX+FSSpOnkuNIT0n 3tanV/HeKwK3zLPpIIGSvFcylphLQlU4QkzL4ZyFDm17dCfI0mSo7qUfHr06l91PXPmwJH aso+rcSA/dInzCgcZojHnnxoo7YaiIKNpGMjun2MqeED1nOBCiiSLGS4ErB263u0PD857x RtrFQBTDdpLoAMQb3827qdSCqMnt1Shs1XwXq1MmzNcDNx+vjPSxV843eLG68Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Version|Unspecified |CURRENT Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org) CC| |fs@FreeBSD.org, | |mckusick@FreeBSD.org Summary|panic or hang in taste call |ffs(4): Crash or hang in |to ffs_sbget() if not an |taste call to ffs_sbget() |FFS superblock |if not an FFS superblock: | |panic: g_read_data(): | |invalid length -268744963 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:09:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 85D011AE0EAB for ; Sun, 15 May 2022 02:09:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Rv2JBZz3ml0 for ; Sun, 15 May 2022 02:09:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 26D6F22DA4 for ; Sun, 15 May 2022 02:09:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F29lRp085984 for ; Sun, 15 May 2022 02:09:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F29lUX085983 for fs@FreeBSD.org; Sun, 15 May 2022 02:09:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:09:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? X-Bugzilla-Changed-Fields: version cc short_desc flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OaalEESxtmlNEmUxMXb7xpPDRsi3z+JbVyfmoq4vzAk=; b=pGGqRUWgBNRirr003CCZk3djxNOXSlAisiNRrdBvwx8cxiM8S20QpYgnXOAVNKHFz8jeUn Nph1mwFe9SUarNrZ7b4lLS0sHIHN7tU0W9Uv987rXkA6+14ZnhtLNKmKx/o6bHc3BRI5Cj ukJuoC/NftCvoYVv3cV8bPDbh/5dtx9vSNjpaBbvpFzOOVVSByqLBKiK8/1M88vEQppuaz OiaFopMVsoZ5Iv8CxaU6MWY41UriSP3BqcpVY3ZcLYH0M52XWItG9UCN/WNd0K0B7NCyQl HOrhLFPPnK8OEs+ZmDg7omB4YB2OhIF7mtPg10Wp0h2T23BGJcIU140iwMGxsg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580587; a=rsa-sha256; cv=none; b=exIkICtimCe0rrDsbzSE8+YkeUbUY59rn+/BZpPlonJlU9nMJtZWL6lTWN3bh/Zc3M3ie0 1jBA4EW8ItYvj5exfxmvG/nAqFDiN05WtJNfmXLN7WHu2SmufsCr0/RrVF4umety01EdOI VNDsuuYoCqrrEEVqCbsq2lF0E6JmqZ/aEkmBs4a8R19dbBR45ajiGhP3vx1qbU9zcZORgQ Kz48DtM8FLsx9hGj5e35uBKAKcxJbiMalNFnxvtJBoCkehOFGCCIRAOJUPzbNxhdZCWWTW 99bssGWJx1PzowCKfg/A/3HzKCuuQXu4a37IVyBXe0ume0JqR8yggwpEX/nt2A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Version|Unspecified |CURRENT CC| |mckusick@FreeBSD.org Summary|disk with garbage can cause |ffs(4): Disk with garbage |crash in taste ffs crc32 |can cause crash in taste |code: crc32c_sb8_64_bit() |ffs crc32 code: panic: |at crc32c_sb8_64_bit+0xcc |g_read_data(): invalid | |length -268744963 Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org), | |mfc-stable13? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:11:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D1D991AE1344 for ; Sun, 15 May 2022 02:11:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15TT4lnNz3nKb for ; Sun, 15 May 2022 02:11:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 84CCA22F4D for ; Sun, 15 May 2022 02:11:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2B9eU089158 for ; Sun, 15 May 2022 02:11:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2B9iN089157 for fs@FreeBSD.org; Sun, 15 May 2022 02:11:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:11:09 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580669; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qm9MPjlYJhJ0q1+qzG1gaFMBva298TNu4yjouy09GkU=; b=RzYN7ym9/FyZ55i7oIm7YbrTIuZP/7LiOEZIjN/P6+jx/q6A/7lnb77lD7sciA1e5lPDCI YmxZ1vIl/SYTqlpeXjddYtF7MljD9lK4AkgV/enEN0Gec2AlA0xPk2TD5XdPN/W+9CHBdp qRNOGJR9/gH9mXrIOeQvGqn1M9x+dVGTF20PoFNlrkOdR1409LXEzRAvNL2yNu5WBsC1WT flcaMvMtqSvu21EU1VwLTqHbiIz9WfJU6RqP2oxOrQUkAkBr+cvHHGfYiQTcmHO+juM86u nJFcscBfjOa4xCGqV/dCwxFgvV5PPuni7xsjTZh7SxZheTRXNgu9fJN/SpysSQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580669; a=rsa-sha256; cv=none; b=Z9ySxlSscf7HC1Arj9mUZcJFV1+Wix1E0unO5L3o2M629rfTEEl4XpOIa/eqVo0Zac58G/ Yy7z0YGJrgDdrhvZ3pYJplB+OzkfjvT7wZQvkvtoOqDN5aEZY6l9aEU98+8Dw4gAbKMFlk xs7bcDHM5f0hYdEG438jzrEJBPHrsGyBZVjxgx1IlI0u7IcjSB07d0tLUh+QbkKpIYpx4R G3e6FXgp85Qy//PbhOANUVEBI+cHX2Oqvt3Uz+Zo0TBky08ic1mPB922LtjIrcAoHMhOpT DfajlF3QVdcYNta0Kil19wsTCZ8PitINVXzdHELO6tPs24fOuqjizZ0Z71fA7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |mfc-stable12? --- Comment #1 from Kubilay Kocak --- This appears to be a dupe of (or another case of) bug 244342 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 15 02:11:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9951F1AE14CE for ; Sun, 15 May 2022 02:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Tk2rW1z3nJS for ; Sun, 15 May 2022 02:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3AAF422DC3 for ; Sun, 15 May 2022 02:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2BMeM089196 for ; Sun, 15 May 2022 02:11:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2BM0O089195 for fs@FreeBSD.org; Sun, 15 May 2022 02:11:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:11:22 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580682; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vw9mc1WCnw+lz43mR05oYMSgq2jKixIxwosV3nHQVus=; b=TOBGl/X5vMkKTWC1ff9c8wnUCpyVU6wKTHEL7jHJiWZrGPhLvu7TwOgsRE1WfPBgdAWBZV 9rnrw/E8CKsVduNh9R1IP0PvyE5S/BCx/fT4mjA+Mi7pMbXsqORnkDrvPVZ0sbC98LxNiB YILTtLT023SZGdjcPWVsMzZdJZqf9k6Jnh3L119OhKwYHTk9NKm312n3SOhxWUBxI/xOE3 BuXOltRstbZWBFottximMcc5ep/8+auVvnMAv7awad+5fW0h2Hm8jLiL6o91BCXF1ODGGA 4WBBhvXel45PeGHawA1OiAQjXq9vTRIqIgf7aw3Rt5UDDe5N0tIbLppzECIaeQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580682; a=rsa-sha256; cv=none; b=ekB9hcCWA3fu0oR0KULhocKv29IZKBKI/ng7irr0/q9vGJIojrK5BbY3w+X15tIrATCQ2K bMM68444iPsCkn1SFcQGQHCwb+BfnkcsmjNK0F2qvJuHhujPhmIRticI5Q40BQ/3bPjiig ZcDGULGVWwzk2QuSG9nul29kfWY+mUKvE3pesyv77B6ZurOVULqMBfbn4BZ5XBzh6Wdb0k dwMnzds/W4Cvw0Y+rLGnuIev1TtcR5vtVwR4bH1fyEOX4wj56DjdT4u2YAfXKtIRYWXqIv P+P+cZc1ISSZMTWD0V4VQ3jhQc0PVOg8FhSq+w5qBeKu6FAZJ31OfSFuWLlg4Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 443 | |42 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:13:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AE8631AE2A6E for ; Sun, 15 May 2022 02:13:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15Wl3nSbz3phn for ; Sun, 15 May 2022 02:13:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 61ECA22D4A for ; Sun, 15 May 2022 02:13:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2D7aP092335 for ; Sun, 15 May 2022 02:13:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2D7Ue092334 for fs@FreeBSD.org; Sun, 15 May 2022 02:13:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Sun, 15 May 2022 02:13:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: flagtypes.name cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580787; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oFHEnr0tcieUsJ8TXbPSnA47ValSBOfUvMsLT+iwrlg=; b=toTaM07bUGNehpQhFV9eWeL8q7Q0EzT+FTZJq1E1BVfk6ay3lNqKaHuloCPZ81uP66m4EJ 4bqoe+C1ckNgD8Mznyd9jtxm5hG9lJTOANwnk8MTC+1YX4jkB5dMR0fckVjEVWNS5jbfKv zyxpQE2DZzg03Tba6mwpAJyRf982jUULR1unkbwPBjtPffmLYBLN6fR41ycaVnlgi2H/3M dcG8NrcGdOR8FcHmmJ9vnaqXw3aDI+dXx0gMduWzC5V2be8uBqt9i55sMGEN/jaKBsBadY lp75vE9mPwXu/O9SaiH0DUYyWKdi6C6YVEq6oS6c3X3MrIjRxbFUD4hXLOBDbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580787; a=rsa-sha256; cv=none; b=bxySBN925eVEmLvrhBi99NaGGF+edto/3V5mg8iN9wS4QXe6sGfynVypRb/c6bV6EKUIKh rXiQmVa6YeJ3zBJ9rbge2XxF9MmY0DgCqV0lsQfL/vjw65wn9yw+0grUU7zckQWfQ0roiK mknd1czJJ+k3cbGMDmqX7AbC1sD6TAHzLiwRIT0UQt0MCkmMid13Tziu3qYC0pBuQFgxsI DnkCICdirS/4poQgAWxgEUptSzGiNAzLyXOL6kL9O9NIs4tqj65g1/mD4aCq++U8t3Z1km wVhjKlTkwb9hKQUC+O/nuTgmIgVhPE4n8URnJZm1O1bW/+XXjitluwOZX2g9vQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org) CC| |mckusick@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:13:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6815D1AE2BF9 for ; Sun, 15 May 2022 02:13:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15X75vWfz3pkF for ; Sun, 15 May 2022 02:13:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4D7C322D4C for ; Sun, 15 May 2022 02:13:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2DR8Z092429 for ; Sun, 15 May 2022 02:13:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2DR7l092428 for fs@FreeBSD.org; Sun, 15 May 2022 02:13:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Sun, 15 May 2022 02:13:27 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc flagtypes.name short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652580808; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ecBxid12c5uhdDlMUiJI76VWKg1TV92BhSpOwzXGa14=; b=ovKt0bhNV6jwaUmlw6//cu62Zgy+Fms9auLgNt8frm5TXr8KeYN1LMaYtIjhtZjotesgIy Z4koCKjusmy6I9mslVFRmgC4l5M6evpFlAukoy5ZgbGSLx9KGVYLAivIt7mJ6+XkWm5/Gs /zEf3RYcdr5DiQ5vul/E/Ec9Ny4+f93jx2CjYKLXMpeg+aAVKiFqHA5aPJAnMonfe5NgN+ 5Gq9BIVmiX9wiTrpE9ArtH2IsvwmRu82JSfDh7BvP0943bB1koyRcgb9eVLAbpnyJr5BgM FhX6KVfnoRFUL4zqmDI/mrVCVy38tp1Fv1MdWgdSBHVt9LCx8eS5gWm2PrfONg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652580808; a=rsa-sha256; cv=none; b=fwcTxW9/UGIdzZugLcKdO37JWmdLzkVcF5ctSUpSowp1ABK+W0HfXocaPn4kRd3rTbfeUB 2rw+txtDIPa4AyZfLlxHj1Sbyj7o7inY047QSikc8YCdRlDAGhsPElYsiJRnpPadMuF7GT YukAZ30fWUxiJ2dV+6ONjGBAKPRpX3LhLNjDQWlK8UAFOapXu3cVkOE/34Q/csTuqO7M83 DzuYNCsbsDMyswJvTLBFUT4pA3yRSLNiavNniwZApYX+VbwJLpoxSwyJ+xtUa2CEoKzACd oyWRuAcwWJqKySszyNhcE0PvqLu4YrmyLR4DlEk1A0NbvzlXAQNz0e9fpRG/Hg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |secteam@FreeBSD.org Flags|maintainer-feedback?(ports- |maintainer-feedback?(sectea |secteam@FreeBSD.org) |m@FreeBSD.org) Summary|ffs: malicious superblock |ffs: malicious superblock |can cause buffer overflow |can cause buffer overflow |during tasting: anic: |during tasting: panic: |vm_fault_lookup: fault on |vm_fault_lookup: fault on |nofault entry, addr: |nofault entry, addr: |0xffffffc07cb67000 |0xffffffc07cb67000 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:23:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D1FD21AE56B3 for ; Sun, 15 May 2022 02:23:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15m342Ncz3rXG for ; Sun, 15 May 2022 02:23:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 644C222D78 for ; Sun, 15 May 2022 02:23:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2NlGj098569 for ; Sun, 15 May 2022 02:23:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2NliB098568 for fs@FreeBSD.org; Sun, 15 May 2022 02:23:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263853] geom(4): raid/md_jmicron.c: jmicron RAID taste code can panic if conf is garbage Date: Sun, 15 May 2022 02:23:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: keywords cc assigned_to bug_status flagtypes.name short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581427; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MPdL5ymtzqJWcPv5ErVcClS8iSfcjGDj3gmpX2kLn6A=; b=Ly2RS1N0Jqd/h8u2lcHpP2lFSCQn5oAR+XQOghkgQ3ei/nXu6Jw0bHMqb4dwqhfN4sHeDN sr4s8Co/Ju4geph/V4cemFnriziwaJnNmvRB+HMKoraCn4hmhxU3fQnl6fkV7DPAPEZ0CQ OsGrb/Ux74z5X0paGUhoGwnGb+cNV29o6d/tpfNKbMog/SGNgmI8RLKWTIA/SB0x/modx3 gF3JUd/a6VXV6Wsi9L3Ot/P3upyaWgwJNa9GUdKyBcCY7IyOlEv6EP8En2xUB+YkkN4hsz JHFHVmnANz6I+NqjSKkwj0mwfHn7EgdASuSNnCOzTiq3KAGFDMDuhDFjM0PNrw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581427; a=rsa-sha256; cv=none; b=W+c5nPs0y3XpSaGAu3+uAfdK3qvWPvpIqyxX+BiBSL0qrssSQRh3/QiTnrT6FgtUzy2opa rvN1ZluDagwUH/sH1taw9uVfIE1MDtmwdju6seKirZDpoBH8g82EFrMxAzcj7bMMkT+mTS aQOz1FUEWAnrFpsxt0sSbXRfrDIgq1fDoYN/zJDK3lmkkcUasnivM5XPaf8gFdBVCCDVQI JxAKkkbOQSSVifSZUI4eZBMw5U2yYGzygKQNhRCiNI53K5tu66N7yH2Q5cX9PZF+TFVKUm GANIPoy3+MjAUSY/VNE2S6nt1ybNyLPf25xiwaRsFG/7abdOp6yZhl/06lHXIg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263853 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash, needs-qa CC| |fs@FreeBSD.org, | |markj@FreeBSD.org Assignee|bugs@FreeBSD.org |geom@FreeBSD.org Status|New |Open Flags| |maintainer-feedback?(markj@ | |FreeBSD.org), | |mfc-stable13?, | |mfc-stable12? Summary|jmicron RAID taste code can |geom(4): raid/md_jmicron.c: |panic if conf is garbage |jmicron RAID taste code can | |panic if conf is garbage --- Comment #3 from Kubilay Kocak --- ^Triage: Mark may have ideas given recent src 9e9ba9c73de9 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:24:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2C5761AE5B34 for ; Sun, 15 May 2022 02:24:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15mR6nv9z3rpd for ; Sun, 15 May 2022 02:24:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 50F2722D79 for ; Sun, 15 May 2022 02:24:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2O7SD098630 for ; Sun, 15 May 2022 02:24:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2O7W0098629 for fs@FreeBSD.org; Sun, 15 May 2022 02:24:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263853] geom(4): raid/md_jmicron.c: jmicron RAID taste code can panic if conf is garbage Date: Sun, 15 May 2022 02:24:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581448; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LIKhBNxioQQ+wMmMyZqZHRrX8p8vrpV5D5zYMidWnIU=; b=OhB6Becmywn3EwiaTJpAjWZZNYp8EAgsU17ROZiOdu2NhQMNrgeCtCrV+KoCqdOwFH/7TO DDYdsEDHPGEr4gsT4I1jPxL5mUjs884Fn11NRfJh0Gab/44apjWQmiJDcuaFu1ycUdQ3Hb k09HI5Xd+pccmYqJNrjSc6MsotvfQS9iQ6IAsxhPJ4v/NutGTnWzZRJ4o2z8cxHUIXv6/i YYD0fFPRGuht0ex0kPBo+0i3+3HBCoZiCc2wSRl77w5ASxql4D7GtzYJg1kEQf5zpznIKf IqtpCx8of+V8c/upXZ5IK1X783Zuh32wpMcMe/C+byczMvr2DNneKazNd40Crw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581448; a=rsa-sha256; cv=none; b=YBbJyBzPJVoW/MjuU0oglte/TfHkuxeIKy6hHe+bbuI0qrkgcocASJzsNvDjnXBwqt9xUb AjRQEbwVFXBCDo6vjYncZFgFH/MXd3kZjNzui1GHprbm9GFn4jHUNaH6JMfX4HxeJFznGg Uwa/zPogj9f+D1eJA+hkbHBwxuoQ9MFFHcQZBCVG4dMDAmZzbUWuvnycWZYFyPGeq1+Vec aT0P4IvoF50dFaoSKPE0xzleqTtZYPvIWPEZWyTE7a7cYv/hsr3QcaFcrVGYxa+RoomaQH wEJNIKoqSUwls7DLZybs7pkaBwogMF9G+aDvbPOTvoJIXEvdE2UiMKs47pxrEA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263853 --- Comment #4 from Kubilay Kocak --- ^Triage: Uh, base 9e9ba9c73de9 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3E9681AE6FD3 for ; Sun, 15 May 2022 02:30:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vM6WlNz3spw for ; Sun, 15 May 2022 02:30:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BC32B2331B for ; Sun, 15 May 2022 02:30:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2U7Lo099553 for ; Sun, 15 May 2022 02:30:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2U7SW099552 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status keywords bug_severity priority component assigned_to reporter cc dependson flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581808; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=E25hgFiJ32xCMjlc9xwjyzDLU4Cl1n3sadiSeGm7HCI=; b=HcYbsNHOm1rU6YuG/FDhQLADpCim6VPF4GDeQv8xSLpAWl5VOWeJL+p/CmrB8eTjnOcmWL gFXVTum+SLwu/01jrpkHr6xjXgTtTYCaUUmZI3ZX3rANwot2yxoJokKmpHR6Jz2CrGeJF4 nqo3SpRE5caSLvNrCeSpip5N6UnbVfjhY17Dr1YyBk380irO6ak2dw0XCTzhn5O1aCKBy4 bVR+I251XMuf4yroIdLacp/U2hUTKE4Rn7mnP1vJom2iS3s7kybi7x8C9NF/kIdnjpR8Jh 8csx7hWZsOJOnsEeQgE1Kkt2HtAq6or7ij8xJjgH9Et+DRFLKZynXI/i33BOng== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581808; a=rsa-sha256; cv=none; b=gEtpGKCykB6yc8lmv3Zk4zDTNllM5EOpsVUGJHhpC3Bp2i5oJ7MH3zFJfDLBy/ht/NzbWG sHPiktq8RvTMLt+kbD+h2o++YO2ENDKynq7WuCdJz3VwE+A6BVXGPz07kKY3RfxIDsmPux 7apXqITqsp3uHmrn3pLNpNkBiNMwrOMo3Las+coH8/Xc4hOU+5Bw/j2vSkgmcepfmRIYNU e47+gT4oTdybhUTr0epb3oj/gJr+8sQroGFvuO7ITOVwQ2RYj8GD+xtlypPOK8PUxOk2C2 y2DDqBX5Na6ZQerVsQ1GWJWxC6pgrogXKf1+smOgSWldRcbWActlqTxj5po6lw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug ID: 263979 Summary: [meta] UFS / FFS / GEOM crash (panic) tracking Product: Base System Version: Unspecified Hardware: Any OS: Any Status: New Keywords: crash, tracking Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: koobs@FreeBSD.org CC: fs@FreeBSD.org, geom@FreeBSD.org, mckusick@FreeBSD.org Depends on: 244342, 244344, 244351, 244352, 257557, 263765, 263811, 263822, 263836, 263934, 263971, 253617 Flags: maintainer-feedback?(mckusick@FreeBSD.org) Tracking issue to make coordination of existing ffs/ufs crash reports easie= r. Linked issues involve at least some aspect of ffs in the crash backtraces Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244342 [Bug 244342] geom(4): Panic plugging in UFS USB drive: panic: g_read_data(): invalid length 11866112 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358= 121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=3D4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 [Bug 244351] [7] Kernel panic observed while plugging the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r35= 8121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 [Bug 244352] [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2 at off= set 154: mangled entry] observed while mouting the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r35= 8121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253617 [Bug 253617] ffs_sbget: panic: Unregistered use of FPU in kernel https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 [Bug 257557] Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 [Bug 263765] panic: ffs_sync: modification on read-only filesystem https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 c= ode: panic: g_read_data(): invalid length -268744963 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an F= FS superblock: panic: g_read_data(): invalid length -268744963 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263934 [Bug 263934] buffer overflow in ffs_sbget() if superblock fields are broken https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 96FDD1AE6FDB for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vP03r6z3t1D for ; Sun, 15 May 2022 02:30:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BA5A623035 for ; Sun, 15 May 2022 02:30:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2U8e1099611 for ; Sun, 15 May 2022 02:30:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2U8vS099610 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581809; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8+afHLfDCDM9C8KkMizcj+TQ8xDMCIqwYHYl2ngPNJM=; b=P6EHNnqmV1sNEyLb1LfupgmI31kDjBkJFne7e2v17XB+rKPNuSxKYD4XAF8sofA4Mm241B 32WrdAcrPWF5hWNdh3YBVx0mfPvaX/nQvmbw/J6h4/v5rGbE3wKIuP76b3+k7DkY+SDACi Gf7dLYSOgAtsVQs7Vt6eUR4VzOkDmN9+nzcoer0nFbg+xFuz0PaD9Rzk6wVF+bpkdOWcFg Xx8TXM5eEDYya3pPeL7XANo7WE5X1z+AWgjxEoKqFezHrzbOHeZrqkGoIRhgR5YuUsLY5p +gGx9n9A0MUFKhPhpMIHS4v0FfnSBlsAgtNixAtePRtnvoxfeJg7eVg+cpq25g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581809; a=rsa-sha256; cv=none; b=Pk1XbNQr36Cvsg/iAm0Jf+4V6cCpOYcyiHzJzRTIUiVUI2+oqNLiCG/QdDZI+tAo5IbeiI LG8pfSWNC9e+8x1o7Q3gG2YQ4Pq3kHYS+a2amElcHmomhkeB4AEo0Sz5honX+TIZcKvgzl ATku6Rdzv0y6j586MLgrRYBeRDG7VP3us5DHsFHh3G6P9sW/67wUdIExp9F7sIS0L4lYE5 yPYQ229Fp1V3ARYEmeiOI253Iv3H1gecPWOQJQD0kY06y02hN1nh22s3nnvmnihamnvdGW FpO8XBfyE63aEgp/xIc7EkJCEyVQMJIu9E6m2xaOGLumielvr7gHdGVCeOXAeg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BC0CF1AE7340 for ; Sun, 15 May 2022 02:30:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vP6pp9z3t3h for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 64F1123232 for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2U9pW099651 for ; Sun, 15 May 2022 02:30:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2U98O099650 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244352] [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2 at offset 154: mangled entry] observed while mouting the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581810; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=T0ZpvplALYSVT1LZXIjZFsrMV3cjUb+78EUqJm/h+uI=; b=B/mmoFEb0tLDjDYu3pXhMh1mfiLUJDLTj91PQsGefDm2D7QqtrkMUkSgs87AYObngpPuel yblr7MfROOioEFBu2byeyow10vtuDa+66tmqMRa6Pl679Xos7T4yygIF4JdGIC7E9pyEDi WcCJ25te9xy6wlzABgtf4tKS2V3X3F1OIHhDAGXB5bw2e9CE4mw1z50Tzn+QoVC2u7Y6Si dH62YLY3pOTn2D7TNa+orlG79iG/X+/QifiteRDIPTqMEAY/lc46IGtONE7iJ+UMSLHan8 DyDHuoUFGPd9TL4JHHPIfNItF41/H2eKmi2wQj4jjGHxuvs816IbpgmYvwuz5g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581810; a=rsa-sha256; cv=none; b=v23pFVJOsgQcZVpDOYqdH3vJmh6fe2Zld8QYHflOgDmtWr3tQodB4Nalo33nLCDslyFyJd 5XL5mF9eNgl8iRD9c6eadHAOdny6AkAQzyn7+F9cE8yO4ZZ0GBGhCE5+/GNlneeJt6paWs 1R88EFJnQzyRcTVTi6fgXOlSphaeCVHGK3VkoII3Pif25RFsbCZq5WRUWPowGYK626pY/G vQcNgo1vlncbvjq4YX0Qk5Sp4PPF/PdQ6RHciktgBL2mhGbQpeSJKPi1vajxhL1zm+mQA3 W4m5hP8nucsNFXEep/BEIiooX1hzHY7Cg+FcBW4XscEw3bbHsrab9lMcOe+Vkw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E6C5E1AE733A for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vP34dSz3sl2 for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1DB7323231 for ; Sun, 15 May 2022 02:30:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2U8l4099619 for ; Sun, 15 May 2022 02:30:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2U88O099618 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244351] [7] Kernel panic observed while plugging the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581809; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=luVt3vBGw0DL/q9LV5nE0nXsEJUSw57JN+wLOIicqeE=; b=NVPE10/O3iRz0Pv0vCcQa1DXlZoqHYn3HMGbOwfGsU0IompexFrxzX3ufbEYgJfwlZGNoK CyRz9iZHZAG8Eq98cryFS/y1JwPRwnetwQBTtdUV5vxvLdpnLqApFcJFH/x6GwZDiIqi9B FZsUvbsC+84kv23YXL+scD/i3Yu6QTF2PeDZpsg7hQGcM+SBbGDKFCzUPe6lOC+oKL1NO5 YOKiiyJNe42vvsFrNIy0dWJ9AdI3PwdUgSZ1f0RAWxe/mV5ayN1DLXlRTbERvczR29utd9 qWI1gpYNPujsz5c1X869CU3BCOCpMekd6pDh34XBQe0Nb+bTv46p7/c3FzTEGQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581809; a=rsa-sha256; cv=none; b=wTjmrSk8ZmmyBsnx81MWX28mzNs6/sBZ0zj+0glkR4IiKx61arMVztkB1Wj/XdVwSkoqrE Vn0P0ro9H7nRNBSK2CwkM1+KBXbMzJfIz2KGztEjcO3nI5/KuoptwsnHHKc0ddU4Mz6a4M h/Uff7h71iecwtbQ9qsEbrSUPjavyyOS03f+d39yJq/QcX9M+AWBn3/ApfzQG5DQNY6fIG H0tXxYgel2+/nAcOm/F+DVsI7E46yNExDHdHNLj467xp8RkCX5X/25idV8csIB0o5ISbVL lqpNppcEoF8VAHnexEEHfT5vXc9dUCojCepewnO3tWpNi3KzBJQw5M+wh3Sldg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 837E71AE6FF0 for ; Sun, 15 May 2022 02:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vQ5gfjz3syc for ; Sun, 15 May 2022 02:30:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 45A5123037 for ; Sun, 15 May 2022 02:30:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UAHE099700 for ; Sun, 15 May 2022 02:30:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UAiT099699 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=afRASde+o0gR+XAX69ouMrGujJoLMMw1VQH+mw1kqpo=; b=lUGYw7fFUNEK2iJJPTYjwjC3KblFd47cxURDeF4ldjUm24XiX9LmXMt4oTg4hxHmfHHV/x 0miBEkhsCXI6/H5hnZKH88cXhKQQ/yzTEsGVT+y11Iwsd/B4nyMZshf/xOK+YWB4/p6jF0 cCXQtyX8MGuNcBECzr/mlcDGirYzrvIgBS5+Ef6ZNqdG0Rcu+uExBPuzCKRuN7+9SyjUX9 fQ60nTYumS0ezMwYobSXZTX9M9KCtSRgS1B4Debon39p7fyigiHtA3dPYWMf1YZNAm9RO/ 4tMCKxuq53OEDJ5ZsQmHO36AX3qObmaFzzRXt60yfoEFJ7fwqhFc+EN4UG5/9w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581811; a=rsa-sha256; cv=none; b=lUcAEoqJQNGRLPyvdKy/tBexmA2ZzsVnPf9fz4Ac1B310ADEbezym/cYYE2797FmyMa4JR A/PP29V1qRWVT3+IWXLC3hLBOOwSdmuW3wsXsDZ9fwFTL6eaPTKGeau0OrxU9q7O/v6OaE lCtXhen8zxSLJ9ttvf5rOh+Mg4jKs9EVgvMtuK01WjtRc5n7TnrqzuVbi1v2IJGfgLQxYf Ldjz8dEzgcCwV+IOjMETLSLrvdfz5ku7qt6sO51Up7+yY2bD/TCyLdZoSKcoToRuQdeM3E tdOqCsFEb0A2xS/vprt/6XsfVFAiEv8oiTWvvDQHwGTRgepaxT9NuRIahusbeg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 13E1A1AE71EF for ; Sun, 15 May 2022 02:30:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vR6xSdz3sq8 for ; Sun, 15 May 2022 02:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1F14F22FB8 for ; Sun, 15 May 2022 02:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UBNF099753 for ; Sun, 15 May 2022 02:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UBsc099752 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581812; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JZ16dwyjKaunzrsMO8IB5EamjG4O4GJsTtPhmjC8R6U=; b=tm1CmbP3Uf1PBEjTgfStnVl7FVysIS3KfUF2vVNZb/GX2tBSP5a9MMQcFBvPm9PpAU4MTM bxL/xpSvkCZ1fb7ApHRNBMki20VbikAF4Bvr5+R+BxpDlC95p00uneaf6wvx7UCg8gDYLN yYiPpSL8HvgsT9PZE4PW63bO7D2FR5350dpig7Xjspbj2aq6MM69u8niBSnoSZzlO60ALa Ho4CrvGlV2wTHdZJPXK0Zf5KkP9/+ShPIYgt0CysanPQjJqo7PisTAuoFwFvN4iEn84wbS lmeF9w/V0AeXOKqKrZSBiyKHQdFfZztFyWg53fmVOb6U4LSZitKuS8MhyfpYLQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581812; a=rsa-sha256; cv=none; b=LYFKo18qfnlGo8YtjNa6L4ZedDrUBFyD5ENiO/O71ouaX8zVn4Fx7o/rl8HKjHhNS4pfSk EK1dvpG/q+0LpwF8zTLcI7M5d6NwcnQNim1vugLa2sv7LM2udPNnmyuRyGtzrxvxXdUqLK dgyz1cclUzghGNepwEuMMgyunCJzhBImZqwUHlqyrXE4KJWLTgMkrRaE6x/v+dtVT9SanU kK58spJmU+g5PbymTuJhA6mgfML9/tehjEybdNfX7SN4u+LM9J79BLxuJRWMi1vS9tFUj+ 5jTXu374NsOcLvbaiXMpm5jbTVFsQmugSXCvYarufnmRCnQElYX3d9+hHRq8hw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8538E1AE738F for ; Sun, 15 May 2022 02:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vR0Fxzz3t1R for ; Sun, 15 May 2022 02:30:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BBECC23236 for ; Sun, 15 May 2022 02:30:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UA5u099729 for ; Sun, 15 May 2022 02:30:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UA4C099728 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Kb9X6AillVLvnD8h1K9wJA7E/u2Ua7kwF8CJdHujN1A=; b=FOY4pEIfON1FNCUYeiDJyFxTA1a+RpfwmznfWIKhOSMJBqn0co95uB+JrgrpSF5TfgwYBn 6i0R74FAM7Hi+0K7EFJx0EHN8A5BP7nlxD6p0AYir74zCk+7Rv4RZDPpa4nBeEfBq3+LUy RiHg7/VAKOgLV8vkTczGTlbqziNTvNsDr/IaJ6FVidkvzrUhFVsY5hXqSKYsv/fLnCEr0y wMYaRxEWdsY59aKcKscBJgrwWEsnZhVkQWN+Hsv0AjgC9dYzAjlr+H7S4YP1tSmLC3le0O 56EXNOTH0VGtlyO3DuxvVcv0uLoDmnOHBcfYzmkaKuH+q/2R56Vw81zQCtbW/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581811; a=rsa-sha256; cv=none; b=SF23t9eOuBSRGUwMhVkFoC2GzbENopf8VihboBQyqmr8jFCVICBM8Gq4C+aeeSN3KciwgN /3PU/x+0DW5OrabmmBvaTV42FGj3xOcTeiQpE+qP6sU7P5kou23V/mhO/Pj/D5ZQ7RGG0I IodeceVLIh23aApc/QENpmweFobF1Yie1dafTF6ydTg5e5bZZNc3eOgVlwDN5sYI4BfkIf gwgNWMMqQ9goEYI7ZmamlXLNW55PvPcFiF0nZUZiNknyFga5j5/lpjEZ8jcbzLERBArpZd 3y/7S1ZR4kFjohgZ2f9kSsZRvX8i7Yd89+ZHgrCioMxxk7j53Ow10PWCB500jg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BB53A1AE71FB for ; Sun, 15 May 2022 02:30:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vT0Js7z3sqC for ; Sun, 15 May 2022 02:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A4C6023384 for ; Sun, 15 May 2022 02:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UC36099832 for ; Sun, 15 May 2022 02:30:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UCmr099831 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ATBkKWxb+jdCtyNNdIJa2V+FjQO2Xeh7iPmlzL6HtY=; b=vqpdO/dpQH6HGdddFZUkFhIJGBEk5lQpiEPxzU2LsobFEcOoUzPjkTeSbJEGqGAwO9tzY8 /13K3/wpk553B9csdhJjDbQ4p8sASo/JqtkOWgNUxS190t0wznO8M40m2X67UR9fo2ZKrn gGPhxjNT/RoWfufZc5J+URBneX0ufqhJcowD2bSHwaeWSDEjAXbyumxoNon3JFNxYFMlM8 WIsFFSqM7rQ4l4OpwNc2DF05KZ9RP9x+h3clwqVG43+n8TjYHTDtvIgx73Ffsr+hX0yOQd /5jm9nEH/pL2SWYTle9BFw33eFw2Q94iOVGD9pgzOKLMbbrcHKbhT3lMweLkUQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581813; a=rsa-sha256; cv=none; b=SQar8dn51d1ZuQ9BDmg8H90HSOZSO7AcBszQGPTFRJwHZKqS2uP2JAt2DfTQ4oD+cK481h KmanSHvNBEGoTsWfwFKrRCybig+tXAgUDgA9OUE3mrQWYREaxMHvrcWH1G4aNeL9Ydrx/p i7i7T+3Ily4dB0iykZO2m1wmMPBGP5mECuQ033nAFyRvae2Z2a3pvrn9SNMio4GLc0eAk9 Xj6CR0mgDAoKIgDG4os1Bg3/VZE1evphQBakIfDZr3JKcvVJ+AxLH78ldmW5xDpulY6oTS J7M6oS1AXKE+h52y8rq+7zooCxtO8Hlb7B0/ekB4X7qz60eJOMPDFx7CA/Jd4Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E0A101AE74BD for ; Sun, 15 May 2022 02:30:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vT0K4Qz3snQ for ; Sun, 15 May 2022 02:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5F4FA2303A for ; Sun, 15 May 2022 02:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UBUZ099770 for ; Sun, 15 May 2022 02:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UBU7099769 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vx+zs7NmS1p5f2YNZGDY1DzvK8pvFZb3Mk45vO7rszA=; b=KE5IreWtCKkLfgr5WwsH5+sPeuRrUJ6a4P6VAylx99f7tmeNuUTYsr9EpA4oYZ6nsup+YG Nlp2b9ZHX+9aweV9x3FYpXvxWSbAumki2uVj6iTK2xgN0SDv82tYDLlk6YMJKAPWjCGR/x xuuz322nKVXVNOqJg09R+alSBSTa5oNEL4yEoVDqDbJvlVP3aT7CV24D14glTL7StmNvax ynMTZNw3SOwbgbqZtjAD4r+67pexqf0Gvj3xPCsa1iuYvJi0tzFJXaxNHlfsb+ihRc9ETM d9qyEpdxBFCKoOAofvKrQ/HGXkDUjFSHnbmchDElAYnuwz7e/6QA3LmncWB6DA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581813; a=rsa-sha256; cv=none; b=fILSTKWGoGfR7VenDwv2XvKJuZpXqtd/SpCR8noAVUBZAvrSHHp4zh7d8S5doimCVikcz4 NAXmj/4+adExefeC64L2tw07ApOQh2r5673W1svC63VF2VGWMlR6iMxUOyPWTs7lGE2/Dw k3iOojog7KL1ijpp/k1q/m+lV8GwmBlkSm478EYCcJPR4sWUGnQqKGfakLxJ0AxnDGxmUN H92Sy2LufeErOM2eMyYvwfPVt11wB1y1XdgRCK2bG/KMoOOWht9Rub9zpXwg8U8X6BuHYV YSDtAX6w9ckMZTBLHei+4CB8MclOMoGJFWf++DsVpcVfDypToERm5N8bpt6RAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 02:30:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 19EF21AE79A9 for ; Sun, 15 May 2022 02:30:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vc6ynHz3t2C for ; Sun, 15 May 2022 02:30:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6781123387 for ; Sun, 15 May 2022 02:30:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UKwJ099895 for ; Sun, 15 May 2022 02:30:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UKB9099894 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 02:30:20 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581821; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RKXt93TXtYSNRACcRwROEtxSZCgx81YIkqNWfChdd5I=; b=wOhPVbBS5KW2Qg5B2cZ59BohPOUXxLLMh0STEeUg75ypMGRF6fQX2Kw7KgDUGaLFA7E+3m 8kFoSUOY3qxPAEteLxvwL5sNnmZf/CKay0ePqXGM0DqBremzedwbPqp2ys92cKBMr5VzJ+ EvliNZ44sOk2UgltGPXxhxuGni9aVsFyHPMghuHyOmyUKPtRv5yLDzhyVGxooft+tR4IIG F2c9qSZ6SH/XwjHrCf4dmOPc1aSLczHJ48Fp1PHjS/1UwbECu8BvTslfVw4jL+lFkj2sPW x6LXD/UqVRobtVo9V3aA5WKCxNrV7jbMl/8UO5cPTm3Ur0FBGBHGjBanCfdkYQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581821; a=rsa-sha256; cv=none; b=ffl1fpcy/QM975H1FWe/f8+UMmZprUoHQ33uFUqijxlbjB2xv/1tao0SX0Eo/bc7kXeCiR b5Get0C7Q81wIWvf7D2ed42Yw0wOciqsY33DVOOT87capVPI4BDCoqO47UJhgYdx50o5IZ EP2T+zhbBy7JvpHP9JnoGJh2gqnQGfDGt2n5YbBUBhngLwmmRrlZimovbOIeQ60ytpqkLs uGWySk+cCOtM3Y7VWWMrQwE4iv5SXRKQ9eaTftgM8ivNeZLVighcd+lxdNmNpWlOCqBTlY kQuqAOzE6o6pzysyCsjcZNlbheM/UG7VsZtsxfqoL3O+xGhBu9vXhdyapX6z1A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:30:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 387FA1AE742B for ; Sun, 15 May 2022 02:30:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15vT3WkRz3sx1 for ; Sun, 15 May 2022 02:30:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2843A22E40 for ; Sun, 15 May 2022 02:30:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2UDgj099862 for ; Sun, 15 May 2022 02:30:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2UDeX099861 for fs@FreeBSD.org; Sun, 15 May 2022 02:30:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253617] ffs_sbget: panic: Unregistered use of FPU in kernel Date: Sun, 15 May 2022 02:30:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: arichardson@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iB8qiuYVinOdKKEhVkJ+9jgKF9FZd6aji6FbAjCzVPs=; b=nn5353yj8h2AFR3MITii1WuYqDsLsFzA+gDVnZ9ve6VEY3KTxJFAcvouQcUJSUa+fVDPNB qCBl4vHVVSCj4JhnUErFW84/EOZlPJ6RsLLW33AuxXq3SLMejkafvOJVpmp6huIIUs/MT5 ngApvLArG1llxQCzg2Zufo1xfFJxn3zHIZm+L5vvAhJqiOspVMZAicCD1KaGmk3PCojz6q 2/Lt1q6zhvzhyA8dnlM1+rOAvdMHz17J88C9wwB740/f/ddaTJtjP01ON1+Sv+hEbyOC28 dA5YrCDOPV3dzCfxx4aNABMk95ztMl/yQAoxVJ+PUycSWlffi7u+Ven5Smkkmw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581813; a=rsa-sha256; cv=none; b=gJAJMVNWlJFQr18prtsUDdRwaRbXuEwefPxm1S7Vs47LnwpuIf3C2Kme7iNLMeMt8iWHTq u/cfd6GgurYakegBQo5vOh3ehwBcsh4UOKCAObJ27XlTPviFjzHLnnXBBtm042IdpDy65H +1spo7MUmNLyn975pbo+R68DVrqN6O8npKjiH7st5s5c91VlEbKXtfrAyMLW0pB1kXHEeS fuARZSGNNvC4c4qx5QsUkqEjbZyl7A8Fz1/wDyD/xNkfD+WiU8apfzBrGd6NbTk0jEkTZB 0VmoDYzH22Srge4n/V6pwMG7uc9nt4Ra0itwX1Lzu/lxiynzgT5hnZ8856WzZA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253617 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:32:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A25EA1AEA963 for ; Sun, 15 May 2022 02:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L15xr6NwXz3vhH for ; Sun, 15 May 2022 02:32:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8771C234D0 for ; Sun, 15 May 2022 02:32:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2WGDu002940 for ; Sun, 15 May 2022 02:32:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2WGlB002939 for fs@FreeBSD.org; Sun, 15 May 2022 02:32:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257557] geom(4): Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 Date: Sun, 15 May 2022 02:32:16 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: flagtypes.name short_desc bug_status keywords cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652581937; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PLgq9diX4DiCxT1BX2by45jMBaGxE/tlrc4zTb65MFk=; b=C+6qhHKlWv2XuOUSRWcvYjahto2QbHvRHC3LQztkd+ANmV0Ww99n/s+4+7vm8UM/xECfnV +Z3+Dlsky4Sq03+Ix4BD8E44P09vYahIEOQmE2jGW0qQNJLcEZmnvh0GGHDrKG0xmaCY0v D82mq8hIRW8SaZLV+o4v78vPR0+xxEl/CosofDK/36VkIwUqPgO7FHBOs7MBMDYsO7GFox s53O95zYEuTdRmvxuUAZz7Taye/rG/lnql33rgU4ZZNue1PMVhC3w9g4jSrVKYD4x5yS5A Q6swnaZnYR55qY/mu55D+whiT3X9itpU29c6S1C5Xq6Qzi5/hTE+t5Vns3BJoA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652581937; a=rsa-sha256; cv=none; b=AJoRGiKcZZxwsggW9FG+rTqivZzIDjIKX9WbmuSLN4wKixy6b0BuqT63UEZVSZaAbXawon +vWyDvJmb7yhOso2xorMRNpGzHX/0xI5CR3R928jOkOF5XT70sqa786wFrRz+z6rZv55UN gU94j0mY9HlGUSbZhhT/YCCaCA5BIk8rq34uO98Ler+j4Eshei9vDF7wPwxcTwZWRm66OR ukM9EeZCEG4u+WmXGC3rpWO3ow3JMPVVRS1t5kwbKQS9LA5Qg6aZqhrRKSCZmoEhhibg8b /PKnvlx59Ug34Tf6g5agYB4atqbhe6/d4wx4FzEHdO/kvPuTa31jbXGnej7Kyg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |mfc-stable13?, | |mfc-stable12? Summary|Garbage on disk (or USB |geom(4): Garbage on disk |memory stick) can cause |(or USB memory stick) can |GEOM taste ffs_sbget() to |cause GEOM taste |crash. |ffs_sbget() to crash via | |g_label_ufs_taste_common: | |panic: vm_fault_lookup: | |fault on nofault entry, | |addr: 0xfffffe0009409000 Status|New |Open Keywords| |crash, needs-qa CC| |fs@FreeBSD.org, | |geom@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:36:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5F7901AEBD8F for ; Sun, 15 May 2022 02:36:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L162f3d25z4TSD for ; Sun, 15 May 2022 02:36:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0CAD123069 for ; Sun, 15 May 2022 02:36:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2aP5N003564 for ; Sun, 15 May 2022 02:36:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2aPWr003563 for fs@FreeBSD.org; Sun, 15 May 2022 02:36:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244350] ffs(4): Kernel panic mounting UFS USB drive: panic: getblk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Sun, 15 May 2022 02:36:26 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: keywords version cc short_desc blocked bug_status flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652582187; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zrZk5AvL77BxbJwVRJfHGrzLziR04kxnyZeH4ASWrzI=; b=xNMUwuv9yPopL1ig2heIPNWkPDcerDMDibEn2658BFEfVYbiOHdCrMShph8ZqUSYR35Lom 0KYCsPgbeOLygzNNsTm6uGnMjW+5Mz6IihzNRSMCmXF90PDz2sODtsddEzoX5G5qlB9fGJ RP1n3E6XbFDIl06PMni4j2p6tiobkZ1O/Mb4xYfxTvuIsndbBhFRbIjTgjYNcHhwaBcq3O nGU52cFIDx0nKBYxs2byjo0r3OFJYOK+CEpEkZZBVmhIS98OoCQPlD3USZleSPxwqevmSJ TLXovdP55Q4E8bNVGCgXwzR/zpc8NGZIvlIdbG0iHoYuzxp/KKp15z6SxqoXLQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652582187; a=rsa-sha256; cv=none; b=WNzthTX6EK1YkI3J5QPv+lddK0tUk0yFJCRNBE+XJldBBHHrSRnglm0bgnWR+7ioxeokVy SqjDil55C8phvws+MoSsUZ8RHBS06GGeN3CROf+tfrj5V3RTf8Md8SMTQ2TuAcUyOAmmkK oUSyXzXHnW8EXevcEVJoecRFUm6upem98qI65z8WflIyTOktLmzeDwSIGLf83BIM9JIbYr Bg17nQFbjN+tTw9M88idzWM/WtQ+qmdo9KYzBqwUkW38quBfUIgc6Dg+/WbdsdTaXFJeLA 3vb+nBlDdcRKK0T25UyOFIZutrSIQJbr1R17tp7rNuifpSgBeb4vr1odoD5DAw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash, needs-qa Version|CURRENT |12.2-RELEASE CC| |fs@FreeBSD.org Summary|[6] [Kernel panic: getblk: |ffs(4): Kernel panic |size(75776) > |mounting UFS USB drive: |maxbcachebuf(65536)] |panic: getblk: size(75776) |observed while mouting the |> maxbcachebuf(65536) via |UFS USB drive on |ffs_use_bread() |FreeBSD13-CURRENT, FreeBSD |(13-CURRENT, 12.1-RELEASE |12.1-RELEASE r354233 and |r354233, 12.1-STABLE |FreeBSD 12.1-STABLE r358121 |r358121) Blocks| |263979 Status|New |Open Flags| |mfc-stable13?, | |mfc-stable12? --- Comment #1 from Kubilay Kocak --- ^Triage: Set to earliest confirmed supported branch version Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 15 02:36:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E95B61AEBCA8 for ; Sun, 15 May 2022 02:36:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L162g1TW0z4TKr for ; Sun, 15 May 2022 02:36:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B199223502 for ; Sun, 15 May 2022 02:36:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2aQwX003585 for ; Sun, 15 May 2022 02:36:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2aQ8v003584 for fs@FreeBSD.org; Sun, 15 May 2022 02:36:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 02:36:26 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: dependson Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652582187; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=siXb32iInVFqJUlOOgAIDAcuCUnadWFgTHfwJD1QEY8=; b=GNvDlNsuSy9wHjpBw3ODcINGyn5xKbREWeMG/VSORCGoItSgd8VdLxUhZpcjrydNGbV2XM z66+04iusFBh+D6OSEPM9UTiqbkbX41jiNvVkgsdG1HmCSgzhvDqdZR7WrXGTQuTLUA2RT QWoKikkpz0LjhCPPfB9XuAsP1RwKsHGBRZhktbpJe1e9UScpwnXxQRSl4WYzpgIegf5Z+u Na/DuLC+Z6hRxw9EIJgdE0/u5eAWlbrXRkoQ1szbxzWquLeAfSuloKTEeWJpPqs8wCbtEH R6jseQ2LUqOd0aADL8Dj0SHnTO583SDldM/OERtNOpx4V0gZGbsNUD15oiujig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652582187; a=rsa-sha256; cv=none; b=Bm+NUyDH88ioeDhNgLD8YdfBV8hfOGd51sJ9/Glk40YPuCfqnAZCZwrPSDBjvED++CBm0W ykr9S8DNi/AEf7kLrI1BcHPDhDkL91SdNcDKIDQxDKgAuNuPGQZYF94nmreFqOrVoJHGV/ 0GzdwjsyI7iJnJZi4VDGiR3tOy1p6CZLKAKnrJyhuxg3rAFLtkyPECBPXbIorlaEpPXILk MFkT/6geixsg0HTmoQlmRnE+bGbDCLGkzhklnj/G8p/lgzJCmD6fJCL7Gbsm2ySl0bn3BN 67jhunWPNGWg6LCZvPB+qKzmS/mWvdor3hvqv/TY+FRl8MEcRaOz0ETNCPj6PA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |244350 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 [Bug 244350] ffs(4): Kernel panic mounting UFS USB drive: panic: getblk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.1-REL= EASE r354233, 12.1-STABLE r358121) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:39:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6812E1AECB9A for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L166f1hwqz4Wx0 for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 16AC423505 for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2dssM003989 for ; Sun, 15 May 2022 02:39:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2drd3003988 for fs@FreeBSD.org; Sun, 15 May 2022 02:39:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244346] geom(4): Kernel panic plugging in UFS USB drive on panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( FreeBSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_common() Date: Sun, 15 May 2022 02:39:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: short_desc version flagtypes.name keywords bug_status cc blocked Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652582394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gTQNrRxwgCtyVB9qkNy7PfSW33vqndbAAhQag4LvQpM=; b=PR3BGLyMlwoFuODcXQG+crQ4QaftwZrg5k2Harf4z/B8FqO/J+D/sEwNo9LKfqFHeGH5h8 lCU+qj83edrEsfqMBk1r+UJjtoHO82JowljmowinF5JAEKcFeeiJzm4vrVZdPJg0pMCB7n rPnU/2HufVmZGeZIJJGYFK9gPJu8OMQErk0np7ojaV9lTPSgL4B7UXemnxe4COSrXn8B7g auHaumYEapng2ojs97C/d972LRAp/lL0jAgP9eKmND83T5u0so5R8ZA4VJ8bbENGlea1Jx NcodEWfA4JwALcNdec3lQ2hmdBJJeq/VmV7N5CQqsxKNexFhpiMKgEY69nZA3g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652582394; a=rsa-sha256; cv=none; b=x8MBXofVhAQatacRA5eW0AYJMFbZIvGp6N8J6D5CRd3M5nWZvKe8j+dtvNdJkxJYRoKRSj vvxiyQEW9fuDbC+InyWRK16qn8ocx0ChcID+tBsDmvpFMxJrg1nMC6zTB6smRIpwgo+pnM YeRbU5YTxIIt07BRgaaR23NqXruQVSouLsD/KSCfuPmS9KNkdqF93ZKSW+qr/XvpnQIndM TweJUN9zyCo/+SuE8Wj+aMyARn/D37NUlNAdZlQmAgOzz+QipWSDTzRR1m3hUyXAT9p9jB 5VIyW7Qdn0K857g/Sv7PauNO3MWUWNA8M4egsFCGUu0XbAiV1JMQdDwTOTO7MA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[3] [Kernel panic: |geom(4): Kernel panic |vm_fault_lookup: fault on |plugging in UFS USB drive |nofault entry, addr: |on panic: vm_fault_lookup: |0xfffffe0032000000] |fault on nofault entry, |observed while plugging the |addr: 0xfffffe0032000000 ( |UFS USB drive on |FreeBSD13-CURRENT) via |FreeBSD13-CURRENT |readsuper() / ffs_sbget() | |via | |g_label_ufs_taste_common() Version|CURRENT |13.0-RELEASE Flags| |mfc-stable13?, | |mfc-stable12- Keywords| |crash, needs-qa Status|New |Open CC| |fs@FreeBSD.org, | |geom@FreeBSD.org Blocks| |263979 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 02:39:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B3D561AECB9B for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L166f3lvGz4Wrl for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5F0AF23270 for ; Sun, 15 May 2022 02:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24F2dsWd004005 for ; Sun, 15 May 2022 02:39:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24F2dsRd004004 for fs@FreeBSD.org; Sun, 15 May 2022 02:39:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 02:39:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: dependson Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652582394; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Zihzvjs3n9nj+6/qcp/Dj0K2DFo4jZwd1K5sPpS0Hm8=; b=fe69933K0xp4fuO4rfU1/03nj7Vd7yGmVd2T9EhKeB6B20+8tlhK8PnRB7ZcC+augdnD7J GmxF4so86hp0vTs8DR6/BT2xWZGpQnGyAHjK2X9AsYbax6BXs70oIE9h7b9YLdrK/NhRyw yN91kngNpFuAh4ayOGdE/UyHqXKQGYdI0KC0SwBZLnolk3wQM/eA9MTX0xayzPS8ikYVQK eGlHeKCWQEwhwO01+2Q6dqxZuFsuY6k0zwDfetBBUDAKv31+ZHW596QmGTPSrRzkGpL2Sc xmPSYPQ0McsEsXVuYmfzvE823F6YHSB19q39a8ftAHpVPDRgj3r+7eGU8/39Dg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652582394; a=rsa-sha256; cv=none; b=vnTDixejwjoBTaXuuRa6kNDG4T0v+by6OLIRUgKrrrfEP7Gg/9x/TEoFMz45cvGUmC6/IX g0tikzmOliqoGo7fZG+Iqyam4Rtg2d50pXuI70mR5cU1vr+yLn8Qm6roYQz9Ma3K0nZ+a5 NpmMJ5F71BuyANfw88ku0ZMhiKF0iTWMRqowH4M7qd/HlRwJ73vQmD8g6mmFwHLd7iLuYo LAR1S6U36r/TeDmn2+0pMFPl4diFX1Fn4Cloo42/eOI4GALpyUBdKy2XD9HPkQLk0PUeMk y9TqnSWEoePHu9k+y8A11zoGzPRasVdU0VSHBT2x09tuspFl7yW34xgM5+K4lA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |244346 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 [Bug 244346] geom(4): Kernel panic plugging in UFS USB drive on panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( FreeBSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_comm= on() --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 10:06:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 105A91AD3FCC for ; Sun, 15 May 2022 10:06:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1J1k61DZz3lH0 for ; Sun, 15 May 2022 10:06:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A87C516E8 for ; Sun, 15 May 2022 10:06:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FA6I9Y028891 for ; Sun, 15 May 2022 10:06:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FA6I2r028890 for fs@FreeBSD.org; Sun, 15 May 2022 10:06:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 10:06:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652609178; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZB4El64pVhfaBtrVuHfO0lcr5yB9/LKb3oXWHpQrDqY=; b=inNEjKC79oSs+vxeMEq1sxXmoJZTGXrtAUnTj1DQcs3dcfBueSK3naIdb5d8sAlglAU1oS kqK8WNR1i504U7xQY1f1/hnXmQ3cZ8jp0iOJnX8rmfn9xUjqGLSW47dhwfUnCawzZex9Lp Uhg7J8qFjQ3vMg7fY7kLyOQ6eDmBXNlEtTKKflRrvsbnlXVsXrgrS3pgiO159YmMp7R9aR Xs3ucED6VJ9EnwL9CM5XXSKlpZOtf4M/I2mupOaikpyIY5OrbeI96rvPODnikeyr4bcRyx EeSSPaAEOJATu+0lFIJGXtLi9jtstZRs6OONkxEbokKl9/CL1863WSp7VE5ETQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652609178; a=rsa-sha256; cv=none; b=d/18OSd2JjtqyCNpr75dj8aPTGc6TsRewgz7w2+GdA6t9YLC7kc/XwXrhgGMiMO4WY00eL RwbfkxF3gfffceIBDu9cjo2azAmDdXnWrCDCMwLi/xY6lGh9kX+c2yXslj/CNy4UHuBisj jIPSl4JPkkzfvJP2N1pWNl00k3v90D5thqs6bpWUyt3Recnexiux+jXyYtzDsPr2pUKHoy anmUuWvZjaREEMAit8zmwwMyI952q8dQaZx/I3YIQCRjYJ5oyWmJB46Ax6VGcHbWYng6Fd mWRoGNEj6WFQ7DfpyTfeLFfuIb9sQK1EtFTIdUuoRbUXPEvCUNcgpbkdqXPRQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@gmail.com --- Comment #1 from Graham Perrin --- See also: bug 244384 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 13:18:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 27B5C1B37BE8 for ; Sun, 15 May 2022 13:18:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1NHd40F3z4cN7 for ; Sun, 15 May 2022 13:18:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 60134488C for ; Sun, 15 May 2022 13:18:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FDIbQm025986 for ; Sun, 15 May 2022 13:18:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FDIb9n025985 for fs@FreeBSD.org; Sun, 15 May 2022 13:18:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 13:18:37 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652620717; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kpLEKk3gzCBgU1mLoyrw4B7FT1Pr2dcanE249NKzUh0=; b=WgYSGPVxhWHrMnpXzsWrI/hSCwWZ0DS3wUic4Wp+pkXwbsQ1IZRt+9GCzKwjKwaz6C0CgP EiTdTUNGwTqg3ZZhkXRouprudfjAbgocK33NG1XllQjUfMgO8ljnFFF9qfgBJlQfTMRygs 4gRKWuoH804CELuix3ogSc5eH1b7lrStx/tZ2Q0lcZsV7gIsl/AZO7jdZxXfnK8AsrRV1P zPe1kD+Ux1/xy0F5TDIQ4XHzatGSXARfbz49xJ6Bo+UsYpwrLvuKNde1JE59JlQsIvf5i5 iQ9uXySjp2xiDYFTx1MegYASwkE+XeAILKf5fL0K5A/Ns4dczl75UPpiFU0mbA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652620717; a=rsa-sha256; cv=none; b=DN3OmlvQiFd04Y4aStPcANafUdbnEC6HPYSjWQCTe+GRzAaYfLgQloC2MooYhxb3hOS8+8 PghyPXVQb+nYgd4EirYVo5JE85uuD98Yw4jd2D0/KuFRJRFMKwKgHo0OB6ru3zmS2nU3oS FnGMNvfsi4de6MIF2tfY2yHpbpK61xZxocrnKR9U/AwjmOnXbub3guurNByAapQnyBgV4r IqeR6YAOyfC70raT15EDlanVFc1Aw0vr1UXjJ6tlCXqKdfgfHRNEhB3zFCDJGF06JGNmFr HSci++XCKNb9/dpfRduEWOBtKpk+48ixI1Ilfxf5hQse+PJL03TT/NIZD/FFYA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 15 14:23:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E3C0F1ADE965 for ; Sun, 15 May 2022 14:23:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1Pkv512pz4mtF for ; Sun, 15 May 2022 14:23:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 874984F65 for ; Sun, 15 May 2022 14:23:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FENpX9062895 for ; Sun, 15 May 2022 14:23:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FENpJ4062894 for fs@FreeBSD.org; Sun, 15 May 2022 14:23:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256746] fsck_ffs completely broken for background fsck Date: Sun, 15 May 2022 14:23:51 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rew@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652624631; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G9CkU3JX0NjA1CZh/KZc6R6kP6tZz3/ayGSBr7vt9U0=; b=UKnGatReh3ckLYl1jKrKNu/t0x50XoAP9QbQ+PiaxOGJTPvYiLb2L7a14xxPn5qV8eTSVM 9RM+0YW9+EwWlwhVwY6OK1acLx9eoCXlFM9k8oIA7vbbNHd/zuzMxXI4h3n7WUch+7MFRf FXd2Xzp+UJvDxfLKNEuCsU6QIB/5+b4zBZ0lOBBKezJsYPEGm7K30LVx1VUXF3yH8Mi1jr 5Vm3/UMJOEtAfq4EtCOfgTHXWSfY4P8uXX90yNGxK/SKtEp5zLvIbp3ddccXkacxn93EDn zNZm3KF1aL8wSEPdOyFLY9VeeoS4LdD4Og+8gATtCe4+z04mq1jSht/IncvcXQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652624631; a=rsa-sha256; cv=none; b=eyb8Vs+GF/lvCE5/adBtJ2Ww/5m/hB0PhQ50TaMgqacfo1RY7Yt5db8f6l2s+56eGd281w JKs966j73vSNkxM3ltbCHzWHChLI5Zrp2ZXQ5Iz363AxtTaTt64S5Arb7J9rEIiaHnhSMg 3j2OQg6ugv/GcZIzugI320jAy8Fo424y1JzJpgatslXL0mx0xfOvvTU0fYX4TdGe3FolTF GXJLDacxchPTGK42D0Xws/gTLh3ekyhjRTAlrhWgGn96i554DtqmquPETlWjwgls9DjmqJ uJdEd0Nf1cvo0nYVd2Zdyt785wqOtamLw8KHPWL98JYQSsOXngJdBXDz4Q17Kg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256746 --- Comment #10 from Graham Perrin --- =E2=9A=99 D35212 13.1-RELEASE note: fsck_ffs: background fsck=20 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 16:32:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8F7791AD17EE for ; Sun, 15 May 2022 16:32:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1SZr6PhGz3MVJ for ; Sun, 15 May 2022 16:32:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 81E6E73BF for ; Sun, 15 May 2022 16:32:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FGW4oU028923 for ; Sun, 15 May 2022 16:32:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FGW4Fl028922 for fs@FreeBSD.org; Sun, 15 May 2022 16:32:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256746] fsck_ffs completely broken for background fsck Date: Sun, 15 May 2022 16:32:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rew@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652632325; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lompWU8qOnztO980ZfNlXG0l9EA1VPFCUuSUwtYvPAA=; b=UnIS5LtjDJmB4NkWC9jdO001vT0zTIXS3dR3GNMws5k3sKBcoNtisP+Oq1ISxsoBA9Nu9O t2v60yoegqSYHBr5grbciuENlO/P0QXirgrtlrnBvUeB9xZCujcbDngqrcbb9e3fvA4Bq2 Z8a9wVBygHhh3L0zyxoTqkoc6nD9VzyBHTwRy7iwbslETRXTkzvygtrTXgCxQBrqSdWCUE Nz1nRWJDuy73wxpmbFMcHhnY3hJrZtXhMVwbia+vQ2DBWtcYnJv081R0yO//J0Xylqp2/1 W0Utgx/Olla3LbwisL8ZKRhMcvldW2SNIGJn1QeWxl9GlBZOVFRxs3G0Z3FbiA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652632325; a=rsa-sha256; cv=none; b=MP43o+I7X34Eu5ZBYgXRlfilDquQNP3lggHKZgR7e9DULF1kGbUz+6yZr7Ijuwp+BHz4yd 4LG/czM14GaGOAV9/FMyC02ttgk7oz4+WXd83R2l7DXpa06ofEJxzVvhgJc+smXgkwif0v q7FAj0nmdSYB5nW9L6mQ2szzA/tjmFBbz64mSGAr4HwGuV7YNHgT0VKmXwi71/Q/xnHDbN ILsahlHmnbxexWAwzE2yM23VM4oyxWdxQ7OAlo5fr7MoQUHe3ebhpsAaeattRvfR9Akc8t /PE5XUI5sNAvPvpkIHNC/PGvML5fNh/w9eAIpiWF4oOhbvDi8r5QsVGxLdybgA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256746 --- Comment #11 from Kirk McKusick --- (In reply to Graham Perrin from comment #10) I approved your suggested addition to the 31.1 release notes. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun May 15 18:50:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DAE541AD18A8 for ; Sun, 15 May 2022 18:50:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1Wg353Zkz4Wmh for ; Sun, 15 May 2022 18:50:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8A4371142B for ; Sun, 15 May 2022 18:50:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FIotol099944 for ; Sun, 15 May 2022 18:50:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FIotJw099943 for fs@FreeBSD.org; Sun, 15 May 2022 18:50:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 15 May 2022 18:50:55 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652640655; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+2BwNkPFYQGeTI0/AuhS5xC1wcbDSMGzP7KvVe6Zuro=; b=SWsifTt3glkHUmBUr85u8mZuC3oIwL0MVgZ6H8EJtU6ERHR2ta6IVAf9+O5krN4LbGuXzK j6iZau4bP3P8Cn3Bcr1wnQ56W91SIDZa7k9Rj5VSIPh4lrBcESEVBrDTMibh/Fh4VGI++S uWVgqFMKfBPG+U1mq6Orzt2noE9bDkuia0HICS4IA58APms7txihFhHu+35ozpVqu+5xWY ebn/puw45Gm0/CJQxKQaalLO9///4hDD1XI9z+T1RKeLgOQXZOWNXyCm+O0KEnJdzw0hCd Ug7lD6w/UQ+naRCGdm7SLrLNcyZ1ifslVi4kfGSZfoPdZ3Yl/2dkwtrU1W6ojw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652640655; a=rsa-sha256; cv=none; b=Km6wi84AcK31a6Bpo4Pu4BA5PKf0mYFhIowL9ecJKeKYNOapi4l5euA/kg9nT+j+a5eQPA EDqBc3TaB7aZZXrXRo+ogSubXOo+rQUWNAq63CztFfrwSW2P8VPV+BSdJ1qivB7su1bBF0 HfcPj+Im56K5bDCAwNGSkV4E7eqvWBwZNry3UjwVk0DWkZOw0LqUIaHs6vDIhKYhvfsjD3 WGduyjjdQFMZ6w3uHfbWwVF96EqcjhhGZj24BZkzuCP7Cb5GFgCyCYw/F+EqK4SL9D91FS u+6Z1DgJkXLQE6mzyctRTrMPxjIUjCJJ+ER8NEShDfuxPrgIgUhHYlliZAJQ8g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #2 from Kirk McKusick --- (In reply to Kubilay Kocak from comment #0) Thanks for pulling these all together in a single place. I am working on a general fix that should cover all of these bugs. The fix verifies the superblock when it is read in. Since there is a single piece of code that is used to read the superblock that is shared by the kernel, boot, and user code, it should cover all of these bugs. Stay tuned for a phabrica= tor review. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 15 21:00:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 93E801AE86C5 for ; Sun, 15 May 2022 21:00:06 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1ZX60M06z4kY7 for ; Sun, 15 May 2022 21:00:06 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D4F5312D68 for ; Sun, 15 May 2022 21:00:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24FL05NP072443 for ; Sun, 15 May 2022 21:00:05 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24FL05bM072442 for fs@FreeBSD.org; Sun, 15 May 2022 21:00:05 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202205152100.24FL05bM072442@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 15 May 2022 21:00:05 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16526484050.41FCcDFE.71639" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652648406; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Q21Y/GD0v953xH6j/6Mn+cHDOlus9uFfzRzKu46ptQM=; b=DlNXEzvc8o1n59BBo0izILXMSdFPsUj5Ar3SJLG/Birulp1FVoozuc4CEMmci+PlX8YN39 35e1jiuiZZUX1ai7lfEfxf2gYT97iaQkzk1JL3LVTfGYH4knKiXSbrJPU40ziZ5BIMd4ly QuheRTAw9YbG5FlNrSZcobU93SowTHeRggqBVGA8KPqoV9m0C9FOnKdP2n6Bj0JFwKttNV bqx4wzf6GRsr6yfaUv49SApn4xXqVXi3mq34XwO0nI9Zoygdvmi59GCAbUG54l23rfKUms KJ/QXEo0cX1yDl3wThtuvr89w5r00kMGBhDZl70STaL4Uc8isBAMMNW0ikE1SQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652648406; a=rsa-sha256; cv=none; b=df/xOtpoHLrEN29tCFJHXPsIveHqm6cxrWOOIw0r5qzcTiLhANEox2wRfGeGX1A8JSnyhL aaVlrlCNIBGfp54LmrigtBWn6w+MrR8hFnKz3Q8xk9W5ilp3ELmq8HL3RlDUn8MHrGiw0W lYndc8F0cEhzWiRPQAkPsW+7VAORF7kKZ/5eFQ0LYeAfFic5WIgMlWm1+4VLq5Lko9WHSC IYW4lf8yKGelDo8v8vVFgEOl72gwOY1OauImnajG+dgKJF+FjgsScUnA5dP1AbQLCD54tL 6Jmuzn55adnm2jORLjnCwgupPIOj0qNiL7LO/gDmAesv2/krgY4+dw/S52LtKQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16526484050.41FCcDFE.71639 Date: Sun, 15 May 2022 21:00:05 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16526484050.41FCcDFE.71639 Date: Sun, 15 May 2022 21:00:05 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16526484050.41FCcDFE.71639-- From nobody Mon May 16 00:08:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4A1671ADEFF9 for ; Mon, 16 May 2022 00:08:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1fjx0dsgz3hjB for ; Mon, 16 May 2022 00:08:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E75CD15C1A for ; Mon, 16 May 2022 00:08:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G08qo8074387 for ; Mon, 16 May 2022 00:08:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G08q9O074386 for fs@FreeBSD.org; Mon, 16 May 2022 00:08:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 16 May 2022 00:08:53 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652659733; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=q7vRd1iI42OS0TJuT8glLfm3kKQAUz32X2dXjUZWcsU=; b=GOcn6Ezq3j2MagjAXGZX+r4fQgQNtbP6x5ScNQIB/AJ7kNnu0R1V4cjrPnMZGuCHTQPpJm Y393xBNOo0Rie16/wl3Hyr7D+NJpirMAtWF8TkJc0nQNl8EQ8ZcD8xvZQMKQJ2RLE0w/qn jZ7mo0KmXgWQ9mNLKCpaRekFvNMHbO3ZY/pEC5YuY+h9Hhi597t19maRGYRJiWHOJu6dp/ oOMk0vafrjUKaXcv/TH7KdJ7QymVx5fyKVDp6H+4vGeusjmiWQ3BTAsw+vNb8+cg/KyKaR JtmdPYoYa7cua+2JsAny/LxzVwQ8LGMlrA/cs5AgtA2k9LqOm+9PI3xBLsYSkw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652659733; a=rsa-sha256; cv=none; b=CUamMBRTTi0KaiDkn4PCI7zULYQBNaZse9RLIoGYtsz58KNQXEuIrsY8cQlvozTDWx5RQl UoUN4nan1zg5TrEbKLJQ6xp2NYes7SxmhWKIHH7ffIQcjMg1FGxqZDzrSRsMmio3Vt/qli 2xCuW3QgM90bwk2MphEOjYA8fGcOj1swvfvgkNwfnpJLBkrWXnSceK3jGSFAALojYXuq/e GHG5Vs5GVyXa7vzR6vihmqBUOlgThcOpMFMZbomjdNY5MdPen+xggDmn6T1jMct3uIhi3M al2u3NtMCwHHQPdLxBh36VNg1ShR9Jx9DG/+9fJOtcqmERsCNnIJGguu4ln9+w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #3 from Kirk McKusick --- See https://reviews.freebsd.org/D35219 for a proposed fix to these bug repo= rts. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon May 16 00:18:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A8EF71AE157B for ; Mon, 16 May 2022 00:19:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1fxc3Vspz3jjV for ; Mon, 16 May 2022 00:19:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3188315C95 for ; Mon, 16 May 2022 00:19:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0J0ef081639 for ; Mon, 16 May 2022 00:19:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0J0r4081638 for fs@FreeBSD.org; Mon, 16 May 2022 00:19:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Mon, 16 May 2022 00:18:59 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660340; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pzfX6rSR201+gUttOUUyJ3FwYqC9t+ZPBs/aA3EJKA4=; b=HbmSVEhJpXwbfmEa5LCnbHCZV4CERcG5agQEr2R9X53VDvI40ZXkb3Vz/6gDZk1Cjx8bRk OlgRI0Wc56Adve4HyTPharl5AJLRuu3iGN0ESg8Rqnrk7e+eM1oFLTQnlrowJDrH6M6OEv gTjHZYyGz8gpNA+XRf7d35ckPCwwRsP4IhGY2UUq3w2dYZbfWzKGscOzLoSBmz4qbrh5A5 JNFokwj5VYpyT2F0QAQixNDn6jS5+6/+Q+dD2BmACe0r25JON3ChmxJ0mg4aohZosMXYaR grezXRBBzeMvOUbvoLSU9JR2y/skc2OToFe00EFHNWi6JsdlioJdniggVbjH9g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660340; a=rsa-sha256; cv=none; b=jvkK63EGJGwOdncnuHKFnwC2NuKSVvdpscyud5GObxczZTl+x/uGdqwOuh/gACKJffigso GzNT/lc8e97kFzDz1koCEbn1Xgtjy16ZexaueIPQU13J32V8rMJ92SwvAlh1hV5iXLnLpx awD7wQw9Bly6Z4MDMd43OkeTeXEwSIM3qAvKnaOC7bO7xos5nj1HD99/fVDdXhJp5y2bN4 wGg5iT3fN95nRNOkf7qQ2F1ISQ6rsUOm59QMnTntXVYDi+0lQHnsb8rlsULq6bPLC4IEMR YbKtdu7zdf5qA7bc/3r08ePRPM+nlpFhXEGBQP3iUSJmG0nNK4J9GaGggC0Frw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 16 00:19:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6E2761AE1A35 for ; Mon, 16 May 2022 00:19:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1fyT1cjCz3kJk for ; Mon, 16 May 2022 00:19:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 17D7215EE9 for ; Mon, 16 May 2022 00:19:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0JjGd081729 for ; Mon, 16 May 2022 00:19:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0JjjS081728 for fs@FreeBSD.org; Mon, 16 May 2022 00:19:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Mon, 16 May 2022 00:19:45 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660385; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+51mZibg65q4Zeks3JbZ4R9zczNfeOsM+Y9LXWzM94I=; b=fFwlceJqDXEHXZB1mQJAokiDzD9Fmf91LSFT29eWLbC6+K9qiRAOxSS0SFxhcjp0W779V+ Q6tBohX1WxwSrijW0HzGdyp/Xs7h3msh4m8WyhYEtOi9lBlWScrQCEF11dWfpGVjFUKZUD zDYMOoQkNNCaXc7V1FAr4RGlK+CBGos9JsFaQ8yiGIThi3g9YFKmn/kvJDAN36gXMYnW85 7i5DQ+aQM9e/CMEjT5Z8Y6XJnPqnTkhUPczukDIye5oM2Ujqo4zemOu4N9mYZaPO+3hEgr I/aCz/jgC0LY+QvwNWQDur6MJ/l4N60WZn3WpNrF4zoFcLykob5TQ8I19SVALQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660385; a=rsa-sha256; cv=none; b=fIGxK5O1l6irQhxg1bvU+wkiRD8pQ3OC3KW/Xg+uVHAxcBAAlBF4+JR9yRIvhDczzRTv8s j1l666S7lb9ASvSd9W2OZZZPA9Nz6olXIJqXbDkTs47QZMtXQBQHPUzj3OcHweTb6gkSpl AgoO5zbyL+oV9WVT6fL4ityca/4U4XA50IVm4TGMzL9dwbvoCH9HOv2Ff25Q/RiuvhYFl8 TZnMm5dgJ4igbOnO619P7UYwIHYxSsadk6OfvBSJJv2jTZxQ/2jK5dsz54tzkD9vpeWx5M H0TXgdxxacJ0H8RJfSt3tTjo8yuaNi/Ra7zotfGktfQDgFD6ClHcdox70RehLA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 16 00:20:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E8B0F1AE2C00 for ; Mon, 16 May 2022 00:20:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1fzR3nc2z3kr7 for ; Mon, 16 May 2022 00:20:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6287D15F08 for ; Mon, 16 May 2022 00:20:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0KZ94081924 for ; Mon, 16 May 2022 00:20:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0KZGG081923 for fs@FreeBSD.org; Mon, 16 May 2022 00:20:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Mon, 16 May 2022 00:20:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660435; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=s/rmJVYr/RcQ8XqKgxB/NtUMoOGG/hEF/1LUzvB3zbc=; b=Gg1dGvO0dKpJWWLfRIXRJFi+DftYsQzvPMmEpBbDZ2CwTCTbas7boQmniWlICGGKmIX5go HscJgqwrAYvSMJzPnv9T9/zaUr+EwPMVUl4vnni8Nyuvhn8pejh619Qt2b0x+21QJXRzwy j2WvMeBIi9QywBuGG+zpBCXHHt5j+NfY8LHvz0/7Rl5onxq5w+k4eoeqifCRKyWbHYEjkG kw5kXZ9Oy2I3Xm5kSH4jSM3g1ogkz2uPt/6Nj5QGOf8K6OlBrpdHm55OrpqRwk4Xp7h3mW 7v5ZzPRnm9FbmrTpme6Cl1zDa+S7d5itZDWydOJ6CBgGWoFeLw4QVVMiGJIhpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660435; a=rsa-sha256; cv=none; b=NzgEk1F2X6ybhI3I9jx9eArVCECXrJvm1B4nSizVjiGPV5T2aDXWVXuAsiBNnxnrk6+HmF F6owtGM5Ar/MKnhY5dyEoTZTrj4hw51QaQqTph0H2Ou6XZ9rs0YrW5L91z4HdnYUWLsrRJ 9uX9XhhlwITYgA0N+PWiJ0DAZKOnP9kbOzYcGkHIVlh77CGVIdeiYHkgFOsqWbz2xlacgT WMSeND6dyLOIpHWt92HjnqoyPs3446J5dFfV96gH1kOUnkU79z4Jls0kavTfHrZM+jwc4y EhsW+CSsOTkDa1AplbjSCYX/4t4xln7uiWWZXJQZPO0declEQ86hze3X16IreA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 16 00:21:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0DABD1AE2F28 for ; Mon, 16 May 2022 00:21:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g0D5TQgz3lQ1 for ; Mon, 16 May 2022 00:21:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9CE9815C2F for ; Mon, 16 May 2022 00:21:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0LG1t082918 for ; Mon, 16 May 2022 00:21:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0LGS9082917 for fs@FreeBSD.org; Mon, 16 May 2022 00:21:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Mon, 16 May 2022 00:21:16 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660476; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=02HpoA4Z1Y5B2wkEn8vLqPjQzVmAhWjaN68GDd/x3nI=; b=Y2MlZuHucBo3kLhVgp2a8ZWIxQIxU5vVCTRT/WSln9Z01W0m0uLMxw3T8DhYKcdUhuBreU rmRNwlZdbQk/96m3KAqb/4B8P7I1yfC8BhB5tUW67PwgaMBX79+g4WlFzD7TLTrJ+HUAzc CYZuxCDPTAhfq/voxlZl7SK5A2xTeKCSG/dryggYiTNNp97EKf7HfNjj5/VCLOoKpZ8xh6 RRVx6hwdCnGnDmqJrIzHBlEnulnJSk265VZAmpUoItpNiZEbcTLbO+n4g/BRIE+WPtbMJX HUpBbuobSxxZGUL9rhsWH7aAVu02NLddg7XxUtkEthPfUQLhC5oq625eB8EbnA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660476; a=rsa-sha256; cv=none; b=tVCa5gPO7mnP8opNljkGAVH0N3Q6sBIiZDq0rG7XX5IdNBUHrkJ69U5WrTVc18smryV7iQ 7ityXhQA1BCVLF/XoWuj2A19h747I9aZl3LQijNGR2OCNv90icJrC+653jait2p70SLNy+ fTqQKa1IkktC+9JiAq8KUhWt4r1AhDyN36T+kMLLJtojKPXnpHJGanjlFpcEeNo8eERfql EE9zApqOjok3gaw9F1bkOwilGVXCRL9qLTU+NpMKCN5gPnNKqRQ2eTVNcRfZhijlgKZUap rJnB4EjpyLT6tU9wfcB6VUBcWthAVZ0VOppjLJnPUVaMlWoRDEF1hnziTMuEJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #2 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon May 16 00:22:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DE7CD1AE345D for ; Mon, 16 May 2022 00:22:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g2C4KPNz3m1n for ; Mon, 16 May 2022 00:22:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7581C15CAA for ; Mon, 16 May 2022 00:22:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0MxbR085272 for ; Mon, 16 May 2022 00:22:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0MxdZ085271 for fs@FreeBSD.org; Mon, 16 May 2022 00:22:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257557] geom(4): Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 Date: Mon, 16 May 2022 00:22:59 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660579; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wT/nprPDMBkakyDeIY9p8VMzobBblX9cVNGL2QYSsf4=; b=w8prKkv+wJ7SrNyIG3iNLk3HREMfCtFwR8AIICQl8QAklEXCD3PG/sRVIeBd6nClcGkOSV iuNWqE/9H3lB9FLf/P/AMfvjijd6+KU5jKsRIPxy3OtxuujVJI+6nWXDGggLK9wVbdW3yu tusQk0Z5jAaLdCZxo6lawoECjmRMKsoZNU6nXK2X4uD+n+ZGINOAtZrE96O15v1ehetCDN PkpHNST54VJue9y2Zfi4hm2DsMgo2mw4k7+grCf202t5zXAt3dx77u4RqL4WpR9oYPmir8 3/yjfGlcCkrxsA7xFHDXwJOz888guXrChcs+/AWvsiOLJjsYIuhlGs3qIPzguQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660579; a=rsa-sha256; cv=none; b=fDYvhjV3gjdnOPc9yweM03cNnL5x55wFNYVDvOU43y8LA8aLQ4uqcj9FdivllN14xZpyae 2av7GsqkZrFFpLb3TAwb6DHLsl7kmdB5v0sZCcLxNqQyqCj14/6IfVegyY4kNVj5J4kuvs /+HPFRIx/rzlbpuS4Xein622n++R5O+197eD6eTnU6nf06cbVO7coeJmfVZGMkU3GvMIRS HQu9sz+bXzA2ZN22Wnp6W7Cyy6rGA8KDobWE53rn0XfuwSodjuQ1+UoIK5YVdzlRX/FBgj ParA7GaSwhu1mf4DEgW12pIvNq9FFXll8ZSkcR9NK36G1xIW9ekY5C0Q3YnhRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress CC| |mckusick@FreeBSD.org --- Comment #2 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon May 16 00:24:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 18ED01AE39FE for ; Mon, 16 May 2022 00:24:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g3w6R6qz3mSZ for ; Mon, 16 May 2022 00:24:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BDC3C15C40 for ; Mon, 16 May 2022 00:24:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0OSpO085551 for ; Mon, 16 May 2022 00:24:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0OSuf085550 for fs@FreeBSD.org; Mon, 16 May 2022 00:24:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244352] [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2 at offset 154: mangled entry] observed while mouting the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Mon, 16 May 2022 00:24:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660668; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uWtFUex3CpactH720s5NWMq8rnF9CKQY5zcli6EDTbo=; b=baxFAK+o82LQbc6kz4KObdcx0Y2Q4wotTkjej/Qtwv+pBlyWr2HpqtWYQgz5EfF/yIslCZ 9wrfZjLbhURDDdgpW+SYG1LgcDhlMf8vjn4FHyXhFv0j/sV9wSEfJz5J9DmeUoZUO6ZsV8 chu+XCZQPuXz1W8b3jZUb6zoH2uWxe0UcC0YC4SYNv2O091/JhGlK8iJQiWFYUrbHlnvtg Rr+GK4Hp+h2C9JUad1yYbLCWzoXpl+htb8B8zUflftziPu0OIePPB/sSiflCIUG7CudTQZ /6ZjG7ul25DHH+XiDQw53IkkB51RE/qrBVzVMxBn0QRsuySqGlV61KpeV4QBEA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660668; a=rsa-sha256; cv=none; b=UR6yjTlekKKF30geCuFjl9VXurCsXOhwRbfDgQiQN6xcR1z/8uOKDFOWJsCVSVFhWrNsah MfitC6hkNsf0RkFcI9vVAi85vt4yWTXgLqCnjXR/92RNes4rXfdr2UaHOqAdl4PEGwvMzR 1xC6BwKxIsTxFyAw7PaoIoBkAl4dJxcsneTrL6aE9ggLlflOFBoSdbv6puBT/BzlA8QrPh YhYqkRNheSOS70gjh6Te5fqNgLRvne1H2YeCOZCjLQzbNwPqIlqJ6HHKP6ugGsBHwZT0go AVt9EosBLcmggsJVujJupHRv4OVILeE2s/ksWlcR+eaw1WD9hDeONKcjCAX7Kg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress CC| |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 16 00:25:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6FAAA1AE4201 for ; Mon, 16 May 2022 00:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g4Y1WKnz3mtK for ; Mon, 16 May 2022 00:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 13BAB15FA3 for ; Mon, 16 May 2022 00:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0P1oa085698 for ; Mon, 16 May 2022 00:25:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0P1uK085697 for fs@FreeBSD.org; Mon, 16 May 2022 00:25:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244351] [7] Kernel panic observed while plugging the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Mon, 16 May 2022 00:25:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660701; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vnm4tF9Em63IfV9+3LCzPJIxtdbgCgvpV9dAwah9A8g=; b=T0nfpIda8rB8+beBRidH8ace8AZlzwjyQ+0iy8iIdvjnh6YCMDIwpbbbIlI5KLiQTu1ox2 bu+JqxEW/j8rCD6zYlJqSFZUQU4mzfGyqOzOgxfbqUQ1H/aExuRpQKscshscInrDIYWd0Q +1fcKnJraTBcRL2x2f+PsqP41ZR+gbfr9+n72G38auGch2r5gqwHw6ls9G4su0kyiQg44Y pJoIKfGHNdJjGq4BYotGGDwewb3Q+Vz64pc8C+FBUMS9wcUwjld7CSEYGyUF65DzH1/vDl iRNbpzLMJkPkPf2gDJW544QutqOWVuyH2zTcWJNU2u5GHb0pkp+6OkhB3NROaQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660701; a=rsa-sha256; cv=none; b=XHFPDrlyLJynxIA1qKQFvp75D+Jgx1WOo7rOEvGalsDeh9ddr0zrEfHICRFYcA4smIsMX8 AA6LFpDChR9a9ADeqK1lmwz4IW7byoluYXkJ0xyS223KIc084SeVeNQpKzYy59NeDNGFf2 i57WPGEN7dg1QYsjSVntjomJQpLhhdsJofkA28xZxtbSGBYvSMoHZucz5FzubBRxWdfgji biLYKPWxAfEiRNuiOkcpAw3Q45w+9g07ZVZ5AYNXRilbAuTg+Mt+4D68TNC87vleMCYqi8 Ol+tAJKYFhOnQ2CCY8dycbTSMB4WnRObvX79b3NTAEmCsnJGKvGGQi7+BbNwKQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress CC| |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 16 00:26:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E5DCE1AE4D31 for ; Mon, 16 May 2022 00:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g5p4tD0z3nC6 for ; Mon, 16 May 2022 00:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 88F1D15FA5 for ; Mon, 16 May 2022 00:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0Q6F1085876 for ; Mon, 16 May 2022 00:26:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0Q650085875 for fs@FreeBSD.org; Mon, 16 May 2022 00:26:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244350] ffs(4): Kernel panic mounting UFS USB drive: panic: getblk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Mon, 16 May 2022 00:26:06 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660766; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DIxUUI3wwK9KLJV6vEXVHtQShuhsjT0bl49SaaM9QSE=; b=vTbVyN1oCZj2yCNPMdjkU75zAPTzLmK3A7BIz9DylTee1L/nTCHq7tO5Cdib126Bz4SMHn Y25uQlpz9NkIHKR+0lT3eeksaioqoj28vH13RntrpeHrrrsAWpI3091uxch42jC7PIsHiU SVbVY9Zy8yEVZ3a+VPU8n7giEe5TF92+VpSb3l3cKFqyBBFmppwh2ercJY0K355XkCZNLj hQvXsUIiLH/+lzj+4aaQq+AaLRtTcSMoJBKFl334NU43Wfw16NveITvD3d7+S88vrETVI7 SBEzsLukoHocixHwXhoTZ9qcfMqJGfZcx8VuFl0d/mRqFLEujlhRyTyUZ6mCIg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660766; a=rsa-sha256; cv=none; b=q4YyNY4Vue8BqReW5V6INr0ztVFSBue0ENqrtvrJWmOiAIBMdvwVBJ79ulAobgIDy4pAkB ZBbzt1cbzf5CJFQB5C9ZPsjoKN6azHAZdg+sD84JN7m1jLWPHvySu0I4FQ+j4kkB7PqiJT l21yD95zPxlwKc506A9mPmnIUTW6HWfUSwQqCnJ40GgfzZSmJt2ZH9Jr3uhEkgbpEkZpIZ qFsrcpLznfGHQFoqOTk9S0tFRZ9ozbTlrAoT7Ernhe4guo9WKFOwYflBdOuu42S1UY9ATS kt0+9KryFOnPSczkV24Se3dxu0QbVFb2MZajJnT5iOOSUqLQQ1UqFQxqEH1+BA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress CC| |mckusick@FreeBSD.org --- Comment #2 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 16 00:26:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F312B1AE5CA6 for ; Mon, 16 May 2022 00:26:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g6l3YTGz3nCK for ; Mon, 16 May 2022 00:26:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 59EEE15DD1 for ; Mon, 16 May 2022 00:26:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0QtYE085991 for ; Mon, 16 May 2022 00:26:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0QtWD085990 for fs@FreeBSD.org; Mon, 16 May 2022 00:26:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244346] geom(4): Kernel panic plugging in UFS USB drive on panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( FreeBSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_common() Date: Mon, 16 May 2022 00:26:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660815; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NgxZ32nFV1QGglaORSCpDp55cjcraNKDq9AOEJaBYmo=; b=pgbG9KNZryEnnzIzxlldOd9QyEFICY8jRs/iMZ4Ubo3qR3giakCx2yDBNsyBHmhlMXgrwX V9Bgc1iIYqlSA68oIADB+MFtfcVjz41jNzflFGehyDcklcrOVSTDJKg/bYAiJqoLhpz5Z5 XwigXjA75xRkjfEtZPuSPRrTspnLB7XyYMVoUErYr/xhuVBLfp1NrUxHdxe+p7t9gTLpEX onqc52sgkIJHPKWVfrCHp48uGddTVl/VSOk6zy4kCn3D4DX3DonXLjxCZbPY+Y1Z3Pi9xw VkzcjcMurbxhvOsi1q1jBnnBbxHxn2lICKo3RRUK46pSG6VPu0lpL1KQg4QXmg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660815; a=rsa-sha256; cv=none; b=DFameNARqfxbmiq/xiMgxUb2a1NqmMjx7gbo8O8KzyVjmy9vyq3u1FVWvO39ZhTOfHPIv2 8DNDazeHc9xoyZOWIjtB88U2nLk00xiBKgp6utYoWjxy9+peCg4MQljs513Te9lgm3BElX Y83iRW6OeLRYnO87i88pUFuebOj7x5UJgD6KE+VWzaislas6rW+DCCVMVtZ8GyUHhy+Atz hCrGggJ3yLomBhj1/p6+2UOvKZicwGiz8t51LghC+UN1RRrFnb1yFfvlDcz42AJmBpjrB8 i+KMSB3Fp8QtghaoqLnm6bk7fPNDmQjTsVuCSPdUXNAMLP2W0jLX4cC1vR6prA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress CC| |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon May 16 00:27:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 301BF1AE700D for ; Mon, 16 May 2022 00:27:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L1g7v3qSkz3nPL for ; Mon, 16 May 2022 00:27:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 16BF015FA7 for ; Mon, 16 May 2022 00:27:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24G0RswM086173 for ; Mon, 16 May 2022 00:27:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24G0RsYr086172 for fs@FreeBSD.org; Mon, 16 May 2022 00:27:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Mon, 16 May 2022 00:27:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652660875; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ErfpX73gAyuinzssN+hglsFp8MJ1wxwUPSNDI/QmtJ0=; b=DnxBJya7/UykYOlj1kDVgWXmbtJYAGNaAVY3ckXRK+uifAd53JQ/OahOE390rklY1TctDC vxysEGOsFOXewRM7tl9TjeW1pdxFfj9rp9Nx6yY4EiTb9vngquKZZyZtfZwxnA9/rgG4qv eUJk2CkvahFBCGeAZKIVd1WB4YxfYITl2hGN33uv1O5cTa+d0JnoPbAjQz5k+57y6QhXVr un+47uIw3/1/Dc5svW3543Ao5DOsm0nwXIqg/1AejLdHznTRQ9w5sCJDmuf5e4Y2BihFm+ HUbftbQGOGZUU/AQ8FjLNW4kYKx4bZALCSINsdahuoaOVpIek/Pt2Z0bMSSC8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652660875; a=rsa-sha256; cv=none; b=OYHcadPtEOB+Jx9hU2ZtPtJyh2c/GIeLVJnrV4bdRwIlRBjZ7JVAC5UUBlvOk+oQiBn17g DCzW7gQUvxsfix+QKExKVaUhcJakWrAiBJ3Zel6JgpA3xlABaTfiNd+6Xk5QU3rOwErdHk 0WV4mJ+Rb2AKt4kYMp2tlX09YkW8Rvhi1WwIrTBc4F9ruqD0uXaZl3rzX5ezNBIYHKx+Xb K/WxvWDZ8kuEB9/wD9e8MhJ4KUol9rszJfR11T6rXmpK9+CPNinHyp7s4fW8n6A76zJRi2 ThfIS5i5iwdQ5gQx9xp9gfuV7qapAx4q2/JZIAUfP1R8p002Fo1bEKOKtQke8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #1 from Kirk McKusick --- Please check to see if my proposed change in https://reviews.freebsd.org/D3= 5219 resolves this bug. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon May 16 17:13:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 215001AD892A for ; Mon, 16 May 2022 17:13:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L25SV6pn7z4YF1 for ; Mon, 16 May 2022 17:13:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C9D27241E3 for ; Mon, 16 May 2022 17:13:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GHDkdn048748 for ; Mon, 16 May 2022 17:13:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GHDkV0048747 for fs@FreeBSD.org; Mon, 16 May 2022 17:13:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Mon, 16 May 2022 17:13:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652721227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KrMDQacatAS0oNiw6/5agvcw6wJ98KlMNQCp79QElpQ=; b=jd2JNdhEXTY15QvrK8CRz4fWqOXR7pogKTrqxUve614OgMtFzgHkwUSVXcKxkEtnfW8MbK riuKsRPtcC8hXHbQaBCahFz5/KMYS+lwKXWDOIDCnHOo1RaggR6vp058m3ck+jXiloULlH I5ITkDunR/3m67q8kDmThSV2H/ddxHEKovPK2/BpaaB+DHfHlRqYNXLmwqvu9DtHO0GEJA RTQdSNTJs2EddN7mdENBJ/L4fQjkGRR3+AUUK6swiWJ0C9br3nxYlyVE/ceZncqknn4Nqd KSpSbaizUzh8+o+HF5BwB2csWN+xXTq0Yb7LEYDfyc00RUXXwuwB7OGp8S/9sg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652721227; a=rsa-sha256; cv=none; b=VmhhFW14srsVyb0crubpFTiQjd8BCg8KODv0oHS5HpWNX6gfE7ALoDCF7n9i6WqLhTVVN1 LZtrMtNW2OjFuFSq2D3C7LuFS+1hRlfnBNMCBs727j3jCKz0sbfyPk+Vvgnsf05fxx0bbZ 5KrdBLeEqAUJxmeR8ltni8mYhgtaDaSxKZ9cQG7POyTiPpA8i2KxNK3l0O2E/+aYoDEUJD eBST/DzFAOrrmjBioQ3PuleWEVz4pj0TOnSC5jkeMg/QB7/FyGQAIATsiNP1KGUlr5LgDA ZXsucFlxximFURpCegHU8axttOHbxQb1M3JaoH57DDQRZ4GuHIi/i3LAbXdcIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 --- Comment #3 from Robert Morris --- (In reply to Kirk McKusick from comment #2) validate_sblock() ought to check that fs_sbsize is >=3D 0; without that, it's still possible to force a crash in the crc32 code. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon May 16 20:18:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E0ACC1AD5DC3 for ; Mon, 16 May 2022 20:18:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L29Z25Jmsz4yxV for ; Mon, 16 May 2022 20:18:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 93CB326B30 for ; Mon, 16 May 2022 20:18:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GKIoB7049146 for ; Mon, 16 May 2022 20:18:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GKIoVM049145 for fs@FreeBSD.org; Mon, 16 May 2022 20:18:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Mon, 16 May 2022 20:18:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652732330; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qv1JLvZ12g81SREvy7WCliTpv2gVZQGJ3LBhjTH8waM=; b=J/hilADkGvH0GKHebu5n6sg/heCbauwTROpIS8F3WTmhMojXabiexIMTIIBW6+WQFao8Ha xPa1Cux+EinVUzN8NKXFETk2VZyjsMVU+wsn/8pBrM3LvItxCm2vVO0ngZrMcM3H6bGRSK tuC9fgGgeY64dkkMvGZhmEDkCkAuuvcsClqqT00B4e325oUo8pn7TK4qao8n8qT6atETzK jRF7Y+dhdSa2qi1JrAxpcUGRNP0vRwHBVRodHcn66h7U1/JFbk6aCT0N4Z6N0+77mPy62O kfrTi4TCt6opBzTHlJ2N/bhaMaEWKCjlaxpBCebqe8Dhs5+sit7/Ym471YhWbA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652732330; a=rsa-sha256; cv=none; b=D5Lb6LNgObCOGHsoaWRiFZuB/p/3ZHhlC8vSQVoJLy0mAdDxHxZ+XYQ2dlKaORLXTLdHAr /pAJV5hOfWctr+rrYNLq+YBCV7jPG8WINNNwGjmuWsBWIbqyeODM4rTFVKOQeEFoi2muvp 1I2zw+BYxz2dPSjB8yHeLhvQwVxYH67vxejPHfQlSjigSAH5xD4qma4+xHhclW/HVTa/3D Exid2bcMvSO+XUvKxhPZ6MMcaApf8mPT93ms1V00z0HCXByngybbawLS4wwrhDQVaQNT8q 5PxAJKMqBiHkdDPRvEE7NsgSRGKCbwQYKiAPDNyT7Y83z7p08thMUl8s6JN1kA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 --- Comment #4 from Kirk McKusick --- (In reply to Robert Morris from comment #3) Right. The lower bound test should be fs->fs_sbsize < fs->fs_fsize since a zero-length superblock size would be wrong. I am working on some other feedback about problems that the checks cause. I will do an update to the patch when I have figured them out. Thanks for your help in identifying and fixing these vulnerabilities. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 16 21:29:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CEAB11AE86A7 for ; Mon, 16 May 2022 21:29:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2C764hVRz3DgD for ; Mon, 16 May 2022 21:29:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 67AE4277C1 for ; Mon, 16 May 2022 21:29:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GLT6VB087582 for ; Mon, 16 May 2022 21:29:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GLT6s1087581 for fs@FreeBSD.org; Mon, 16 May 2022 21:29:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Mon, 16 May 2022 21:29:06 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652736546; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Twabr07+48ZsndCx6H9dLx7oweFOBxJfpmbybIuficY=; b=Zf8TLCua5GiN79j9Fh0KwkKtz8fSf5ez/3ieheFlm1UJK9Cbizf+DfV2rSKUmN5jOm5G+4 4a7qiwsLiUa4Pc80PjEuTIx1Repj6jrdkBnkbRs1LwoGB6zWtZLhKO8HtWLgRlVU7u6Ctu elK6NgBotvaC+gWAqqF4pCViGWPejPu2dEBa+dqz0xVHTfOddI6Ve2ZoQ5ipDrVZUhsqFd AslKlut7gbATsGpPrwJsF/2bBUMl/GY9n0PRSfn8NX/Vul7z4FNXsBA8ZAaZifMu9P5Zim Ko1qEz+wAxOhzXAXwjnSRbLA6GrHhb9FooOEI8qBcsWweoT8qm907o5IIB+aWA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652736546; a=rsa-sha256; cv=none; b=to+I9RuVmth69GmlyqI62rsiWjTt+wTBnJXFDSU0/ZM00DVd6GJddiCyJnehQz3qPinrj8 dmqkdRJ/EJffkQt5d3TSiNhF+41vpcBAneSW9K8T+ghdKukvzzf1iCkP0qQprRN9GM69vE uarSPY6ehTbxXG4jh7bYF12SQb/QPlIaNiMmdxLN4dHbAuFEG40ddX5Rj3jML3SicnvcO0 h7a7KJSi3p9ZWv9kgvTfuEhZ8EYvdklO9cj2xOpXbsjyvdq1L/BqR6iHaacEN3qU7+92Qx EKlzoISKFhtV60OXNjWHphdQQBPpD/9KqAzfST89271vLfukeGxdiIKo2lhRiw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #2 from Robert Morris --- Created attachment 233973 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D233973&action= =3Dedit disk image that causes size calculation in ffs_sbget() to wrap around --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon May 16 21:34:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BF50A1AE9B0C for ; Mon, 16 May 2022 21:34:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2CDt3FF5z3G2s for ; Mon, 16 May 2022 21:34:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5148A27E0D for ; Mon, 16 May 2022 21:34:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GLY6w0093287 for ; Mon, 16 May 2022 21:34:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GLY6F3093286 for fs@FreeBSD.org; Mon, 16 May 2022 21:34:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Mon, 16 May 2022 21:34:06 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652736846; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3aqwMp4Hr65yHst0Pu6Fa7xPDjmqMwLrP0NQS8toGx8=; b=Ekf4Km2CZszFOWZiZoo5VXaV9axf6AJnn64HuSAM5089npjMDNA/PuseJbw5Jbulk8Rdb7 tR7q6Fzw2WSSH2S7VfVojXYIBr8VoTVDQiC8SKEN6Bf8TYo5RMTu6vzJ4AzdRUnutk0ltb timL3s5e6VlJX4TtmTrohYEj+7peO7edwiNAj2Fwq9KR+y7woxlBdz1UAVgQspvxgo1vl0 xYLljfFlYZa0joi1iNBzLYCKp78G0vKQ4XguhjssZRhu1Z96IIFV2VkfFYyLGgLyvJpUxv akBv8SUESJo8B0hVUZ/A9cDqYCuo4pxBnPRLTnO+A0gp2qKC711NtVmzxt2NYg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652736846; a=rsa-sha256; cv=none; b=OS/tieB70tTx/iLMavjwBItVeYufQGQVAcgGkxgdnz9IXUJFViKK33JK/6H2GBqL1Gntoc 6ivPu9t0aVEClZBY1aY6MN+4AMGnwTLeVs3CItbOr19N3uTMcD1445IMuwMrlY6Cj03SUX DMDmK+1CAOG1zaic99sgOsxXm/thatYH7xBp+nlOQUE/JrMXt9d0eBiT9EthCuG67Gw0RU ql+FDxGVzA/+qcAiaHME+s/WwdDvkycq+3EZO4EaZKokCS8hGmX5QFXQWAXtuRiabbjUdJ alWa2FJ4JE80D4q/kK1YQ5fDeRnyFI8cVN5pwyMGDE+0tMUBj/hDaEEGWolUOw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #3 from Robert Morris --- (In reply to Kirk McKusick from comment #1) Even with validate_sblock(), the int32 size in ffs_sbget() can be made to wrap around. I've attached a disk image taste9f.img with fs_cssize 2021359616 fs_contigsumsize -1 ncg 126334728 so that this in ffs_sbget() size =3D fs->fs_cssize; size +=3D fs->fs_ncg * sizeof(u_int8_t); yields size =3D -2147272952 when I run mdconfig -f taste9f.img Then the process hangs in UFS_MALLOC(size). --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon May 16 22:49:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B3D8E1AD283E for ; Mon, 16 May 2022 22:49:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2Dvn41C2z3hrb for ; Mon, 16 May 2022 22:49:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 668BCD95 for ; Mon, 16 May 2022 22:49:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GMnPuA035543 for ; Mon, 16 May 2022 22:49:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GMnPdH035542 for fs@FreeBSD.org; Mon, 16 May 2022 22:49:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Mon, 16 May 2022 22:49:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652741365; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AUcFpZ+NSqBQbVPpIntAqySJ6zv8/Boyb8csk95L47w=; b=m/H8z0bzzMbNZY9JbF+Zw1mlyr83CemVBaHRTVYu+qz3yDBfs3xVAo9ZqhxzWglaMfEQi6 84cfs4gxGdsK71rt0K9g9eLRsKlPWoimKUSXkdF03Uws2F1iq979Ex0E6R4eoZZOyWWZsD gl0MocecQgLlEQdQxzaWqYM5GD3ZYRV4N9yqTUdfzgm0n4SvibEQdwZoswYqdRgOaUAXzg /+bXqrWdciIHDuC1G+Z6ulhHF7FDWfmqiOJlC9ILnnQllxWZBbALynIe/ryvL4zoZK80RF 2qeTciAcu+CVaEcjl4PzIWjOx8ZNJBNaEHrHmfdnThnoti/wtvNkDgJJGa77Rg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652741365; a=rsa-sha256; cv=none; b=amQbNGuY+B5qjaNSIxZ3w+qv3BYbPe/r1tqS+smopbHJixGDyz5EAVLfanP4H43cMwj/J3 13wbnd15K4x6+OtgjmOcx9KPQ/Mg8xrsxLP7kGlxPnZZoolf7vJS3nOOlxDOF9dz75soPk rDgVYBPZL+KkQAmvEMz+98P+1K9NIVZ5DPKSXiA88DyZMSSLLXMp4OoG0YHOF5IHFZyEf/ 7JLOUTK3m9FX02Sp778P0Ljb1a4Nu3MX7ZzyWiaMCTrxC1UiQdnSxtb2CUih34rdd6i/c9 pgkULglgwqT9TiSaQQzZJhm5aBEOTSuoS+wMFxo3BIjX5vS7mMuAsbIIQmLh+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #8 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D2430388070fcedb3d30b8dd0e9fffacdf= 630dc34 commit 2430388070fcedb3d30b8dd0e9fffacdf630dc34 Author: Konstantin Belousov AuthorDate: 2022-05-09 20:46:05 +0000 Commit: Konstantin Belousov CommitDate: 2022-05-16 22:32:55 +0000 UFS: clear fs_fmod once more, in the buffer data copy. PR: 263765 (cherry picked from commit ca7c2d2eedf690ae0c780451f53d9ce36bb2c337) sys/ufs/ffs/ffs_vfsops.c | 1 + 1 file changed, 1 insertion(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 16 22:49:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 12FF71AD28E0 for ; Mon, 16 May 2022 22:49:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2Dvp5v2cz3hkQ for ; Mon, 16 May 2022 22:49:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AAE479E0 for ; Mon, 16 May 2022 22:49:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24GMnQDN035581 for ; Mon, 16 May 2022 22:49:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24GMnQlA035580 for fs@FreeBSD.org; Mon, 16 May 2022 22:49:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Mon, 16 May 2022 22:49:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652741366; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1uGUEGDELbB9z7rA2IsWO8VXnPjbeyOe9oVfT4mUsHM=; b=EZbecaeeyKU7WcAeUnivzSdGNBI07PLatU6MxjIKYJobLocW5keAunqNeslZlycUU71a3c OXne8lgB1X+DTznkBdjCpXChqGcISJW1I30nMGNFczyW8w7S0PmrdXA2yWICxwf1vMlmKF e2T9p2Zd+wJZskE7pD+WOZ7NDlcsm2uPw6G6fEHf1lAopOZyOWQLZzjorNsvG4m04K9qgj 840y5BFkry6dUh4sOaq1vPcgvlhUmKQTaXrjkcAj+9iibQSi3KUMMFLylac7oJQf22YM/Z FgFa5Ml6UF60VQN3t9Ifb7mQB56cjnJyS3FqNg7M+xnqlwXTH9WqhDcgmPAZew== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652741366; a=rsa-sha256; cv=none; b=qNROd0iC4kGAKoyBjalSvySN47RMXi1IIw+4UTEsMn+hv70Uk42uiwU2Z1EOR3Btfm3DF1 WrefDgR+8BYiVXPi58r2/iPryZN23z/+S6gOvASuZX0nreaYLqYiCDo0YW+vumRFuxsOXb IGIkYVf3CFhyPn1ez5nff0XgMSu5GuzgpfAEs+eQM6iPvF1FYEkBY1PrSjAT+EsB5AXzSl 9IEIwmHBtF7Ft8GqeeB79cJsGr82y8JcDgklbjQtSTvIG5nCeXU+NxH16rml1X1RXHzx/9 UMwCtXJCsHGMirNV5LtBrsrSlnSPHvv7I6YiT22wyhhKULDcWj6Le0x9YAlq9w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 --- Comment #9 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dbc6860ca7cfa4f3d317dd6380b3852a9d= b99bb16 commit bc6860ca7cfa4f3d317dd6380b3852a9db99bb16 Author: Konstantin Belousov AuthorDate: 2022-05-08 14:00:37 +0000 Commit: Konstantin Belousov CommitDate: 2022-05-16 22:32:55 +0000 ffs_use_bwrite: make the superblock snapshot more consistent PR: 263765 (cherry picked from commit 4ac2df8f4cd91017c000543224204f823008f699) sys/ufs/ffs/ffs_vfsops.c | 2 ++ 1 file changed, 2 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 17 07:05:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 09D2A1B3DF9D for ; Tue, 17 May 2022 07:05:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2Rvv61Gkz3t1t for ; Tue, 17 May 2022 07:05:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AFFD37FF2 for ; Tue, 17 May 2022 07:05:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24H75FYJ007763 for ; Tue, 17 May 2022 07:05:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24H75FoQ007762 for fs@FreeBSD.org; Tue, 17 May 2022 07:05:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Tue, 17 May 2022 07:05:14 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652771115; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4pBQ6qJkhfRBEE7RcAdKZcKk15uXMW69U8g88nquyfg=; b=Mu5imsFGmzVOm7H2xJn6SXQvJjhGgdeF4xMBCCAgkehRC4Mgq3bLMSqQuxAXv/336L1cX6 DFHW4CNtmqoLyLD8ha6QsYWMim+pnuLZ+8/1s5/1dt3ooESINwZ0tW8+EE8oIDiplKmdXo WhpLM8SkjpgkGBXnNBIs0AIxLG6OjAaS/00AwBZVYvtVttBUGZDDS4lcckMN3B09VcSwlc rIoNVNm80YJeK6d3n2OkurentoAvyeQri5r132CqPnJrDzqQbT+s9UkMT4Snizfmq/6kLp VIoBvXXzz9ZCoIzHAchdlRFLG+bA5gHAYRHIUXvwJDCAFduwQe94imI0xGWx9w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652771115; a=rsa-sha256; cv=none; b=ZKKrlkFOYDQNtTGp7Siq4OAOGDdvUvf8O41BL2NDLvZMsd4SL9HYZHGQAFzCOSdSBvc8ha gsAPSK1LEpFJbeF6eNUQkelseqQTo8g5yKKqdoj6ynBGAsgyo83+FUYXG4rg013qpJmRDh G43a7wFsnLUvWYt5Mxu9Ryn5m4VIzsHy70QpiNJCHjzOq9h+gHgoLZF8rKrgpZhBI2WK+E CUjYTQka8OW9XtgV284K4+aR7XrA4y8VsQwGTkZCIAgF6qU1oVfjpJYolkPu41c/kekIuz qdeekhZe1R/sh3JgpJs1VRIjwMsdrnEpZoxKBhguhV8+g8tga7Se6o0oLzD8uw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #4 from Kirk McKusick --- (In reply to Robert Morris from comment #3) I have tried to further restrict the values that I accept for fs_cssize, fs_ncg, and fs_contigsumsize. And also put a limit on the size of the filesystem that can be mounted based on kernel memory limits. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue May 17 08:40:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ACE651AE7744 for ; Tue, 17 May 2022 08:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2V283kBGz4XnB for ; Tue, 17 May 2022 08:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5D922119C5 for ; Tue, 17 May 2022 08:40:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24H8emGk059475 for ; Tue, 17 May 2022 08:40:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24H8ems3059474 for fs@FreeBSD.org; Tue, 17 May 2022 08:40:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Tue, 17 May 2022 08:40:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652776848; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QBh3wDT2DegzZ8cs9/YhCNwF4kF/8ADQ8UdOy30EgVI=; b=QBpkebRFPu3A1iB4Eg6vOyoTN+oSXMcVn0rPr3//ZeUBwJgBECecGQ7FgAI3IaC3tjIihX +vnjPRZMxa/7N2a5xTji+Nrku6QqB21Ry2N6YxJEhX/GT35aqS6asSAJNxmpnksRodZSy3 /6CXGn2J4WxhqBg8cecu1LW94v7chuCPHayq6wd5kvsF8GPcGXuixJnSRk+AVwV9VuEF8/ Xs818/554hVzfuW0gxzTM+49Mt5UJGmB/35sCmGo5VgwepCg1gPB1ztkYgM124BDbMnsnk nENk/npNfXq8y/q5JJShAY6DZYSL4jrKCQ6ikw4DqJPSjqH+1krDPJE18U9zTw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652776848; a=rsa-sha256; cv=none; b=j6+7O4yoWfPoZCyFkgrjALEULlFQv7HN51cSMgLE44ACHVxQzv1xSSOaljSLFtP0bBJB3D FY1aY42nZ2cPN0CGWM2r61+DHsmWrlZKEbDg33Yd1i5nVzsiCOp9FQtZqcUbaxm1pVL57R wGTfUecy5xyacHIvvmMgKTP0LefcZHRSSNeCxN2qIuz1TZslazT3EJu6gTn9KEuWXFhGq5 Fs3ceJIZi9mvZPiH+2KztoVdSLSI5+atRD+YYNRgIJhxNt0gMsC5ZkUkvPYhyuGRv3TrE6 sHLsBRmaPNRelsKeG+9FeuR+14gNcq2hdwK7ehRGuRZU9FR2VxN1wFdmb92kYA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 443 | |84 --- Comment #4 from Kubilay Kocak --- (In reply to Kirk McKusick from comment #2) My pleasure Kirk. I believe a couple/few look like dupes, I'll be normalizi= ng the summaries to make those clearer and close any dupes (with the older remaining open) tomorrow --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Tue May 17 08:40:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2392F1AE7938 for ; Tue, 17 May 2022 08:40:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2V293xj9z4XgR for ; Tue, 17 May 2022 08:40:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 60B6210CFA for ; Tue, 17 May 2022 08:40:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24H8enN9059507 for ; Tue, 17 May 2022 08:40:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24H8enEv059506 for fs@FreeBSD.org; Tue, 17 May 2022 08:40:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Tue, 17 May 2022 08:40:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652776849; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Dqoe6QVsUsHDkluH82fOpk8aoLoYE2NciA5MImObDh0=; b=Z3cVkLsET6XTeuZL2bV5pD/TyRECeTIPlFFJfqAapAFVH/hULSbWKjLLT563UVvRUS0OaV XUXm1FJWGo11h9nCUwZuNjyE/umxD9BvSI7Dt5+/VfUGznE2dHtXhGp9mwjncLCc75AUjo UIYpi+pjNdQ2z4grNXv1ZtlNjNXfKER+ai9C1HmRRNKjd0Y3GQDEez4DIwSKj54gZhtP5F 3KDw5m2/A+wzgP30UOCMW3RAwN9YRqt6QSBCkAcHYi5MOqbSgUBAJJgTXI6UtGj3x7P437 0JfSEXwhjL57r98WU5/U/1D5/g5YcaOtJg7y9MkQ2U93pi+h4hDZnNW7ZbXBiw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652776849; a=rsa-sha256; cv=none; b=pTuEMvTBJ8gT3JECTB6osmshm8PMOoWOzNcL0/+QEzSKVRMz9JGgZPwgGWU+AG75M3hUMu tzVPcuxGkjNy4S1L6vo0oGuyQXzBJzrR/iGoaYxypcWCCuMPWnCc5iDXVhEE3h21NmcXri dZwbycaurm2IvVyx13pohT27fB/UCJeFhQYdcXdHXzhyyWE0Ik8SwiXpIMgTy4sBSz2MDF 6gnguiF/1WqJCQ0Yo6TxLTDBx2BHbclZWn6ZqTbBnTVCGxz4sIhYxA/9iIj9f55k6oTGMS KnXxVLHB4C3/PmUAziiT5Li8VMIftdBuW1Lbxr5XHFXjsGPEDjtj4WEcS1U1mw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 639 | |79 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 17 08:43:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E0DAD1AE83D5 for ; Tue, 17 May 2022 08:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2V5k5Jm4z4ZJf for ; Tue, 17 May 2022 08:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 97AAC1167C for ; Tue, 17 May 2022 08:43:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24H8hsBo062635 for ; Tue, 17 May 2022 08:43:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24H8hsZe062634 for fs@FreeBSD.org; Tue, 17 May 2022 08:43:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Tue, 17 May 2022 08:43:54 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: flagtypes.name assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652777034; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q4rdvZ3x6lN1t1DKti9WLjn8aA6tQlYJQd+NxJ0jXwc=; b=iEB4jTbauDr6LR77etX9dA9YM/qmlhICCVcnXRN3ePeH9HWZMfzfVkrKGelZWOONvAELun 4U+Qe73wthrSn4pNGMc8SRWJhIiQ0VgWOySOuzq8MTmWJ8yXnglUjdw6ywHtCUBJYjHFYE kdurYmniSzrJdPERMpdrbL5/A8/VvgSai3N9dneZSQvCF7a1WaMWTqMskchfQt6WVKERYx 9F2lwCpcl1IonDXLMsSol0SW6mhCMwFIRmPstlRtCRTrYUDng/hbPv8Y7ioARq/1kEb9ce sZh5YLBkZnf19E9Si/1PR3RinOCaq3h73K72YVgqnENdS6BYxYDBYaaxnxw1Qw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652777034; a=rsa-sha256; cv=none; b=UKMqH3haxPI8AHH1B0A9kLOZwqpI78wzeoQnTm6D3CFW0swi5DQPTaMz+cr0YHxLa7J2fh e/NuMD4dxc8lYI3/LQVO1NlHWQGQ06igKOABgC/TtcmozUtNnKQ4od4K90z08RIXNClO6Q AmlrQJaxeg8XnggL26In/meP8l/whj4LvgPU7LI4W3ih4cjjt1GHPbM1ArWUYsGgsg2Pc4 U6gntAtr3LkfmJhaeFGsaAhQSP0dC8mC35zvCbrKoNfyjBrjw4hEd5jKL2LiFKmUubRQIe dzMkuvtYYOOc7xRK3PcYmzARTtQ6bEJa4rkmn8187bDz+rtjp8SfeLvOZnV3nA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|maintainer-feedback?(mckusi | |ck@FreeBSD.org) | Assignee|fs@FreeBSD.org |mckusick@FreeBSD.org --- Comment #5 from Kubilay Kocak --- P.S If this ends up being the issue in which analysis, comment and patches = take place, rather than only a tracking issue, with resolution taking place separately for each existing issue, I'll switch the dependency to 'Blocks' rather than the current 'Depends on'. ^Triage: Kirks coordinating here (comment 2, assign accordingly) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue May 17 08:44:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 545DF1AE904B for ; Tue, 17 May 2022 08:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2V6S74mgz4ZqD for ; Tue, 17 May 2022 08:44:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9833B11A3B for ; Tue, 17 May 2022 08:44:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24H8iWux062810 for ; Tue, 17 May 2022 08:44:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24H8iWlG062809 for fs@FreeBSD.org; Tue, 17 May 2022 08:44:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Tue, 17 May 2022 08:44:32 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: keywords flagtypes.name bug_file_loc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652777073; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tKbXV3ri/5/Fhf6KDNHY7ITAmBY9Jth38qR9RGJb1vc=; b=xPX/4+oO3tQUKh13v5mOtd1bcCNZeOXU8O/3g59W3EjDcMZyOSm8g7voOBoMtTpGfRBMkW eps4kU1tw4WTTIIfA6vxPXe6S0abmZozUGkf22fgaEmX4wLJeS13q+JmE4NC/3H57FccGl oMtXiMuOC3gyrYQ9uCZcbwF5PCkMK+Sn2ZFb5wSnipnQpGaxbIRCTkNv+oqs8JmkgF4oIV r+bPpFHJVKnZBPkTJ9OAkcyuexHGuE/mj2PMyXSYIbqMSGPMOfgelSYtxl+8EDK4uZW0nG uVje0RrGkEe8cRVIEmz7qaoxHwKbFyxAASjOM3UGSh4BHc39MnN6+NWh5mModw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652777073; a=rsa-sha256; cv=none; b=MEydWcpWTbN7i3PKEhTDttqjlAQmh0LomfCIpHUkzopiwVem8LUF+XuRNBHCBQcxSY5cXK Mt3YtAHLa+JLKbU4wJ3J9ArGDU8atWPDIR1vMByOuYYOdTUGKWo+4rcJEJVc2KSZbanVkv KeWw3zk9bijpqrJvAB2w0P7nbzEGbVFukaReeYPWtnr+xJ83IYvutUtgrOHt9ANaTr9G6h guUbYLBqaFXjiOnBOpSQAUU/eKg0XtBZaxpegvOPlO17jkqDKcyjFCAv0ujBOTCtu+UBIO ccILDVEMK0V68i8gLV2jjQ7vm4ul5onk8bnplGvIJ1r1Me3d8mwsE7jUF3c3mg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa Flags| |mfc-stable13?, | |mfc-stable12? URL| |https://reviews.freebsd.org | |/D35219 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Tue May 17 10:11:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9F5D11AD8823 for ; Tue, 17 May 2022 10:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L2X3D3LxQz4kyr for ; Tue, 17 May 2022 10:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 53F1D12C27 for ; Tue, 17 May 2022 10:11:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24HABqVY008744 for ; Tue, 17 May 2022 10:11:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24HABqSg008743 for fs@FreeBSD.org; Tue, 17 May 2022 10:11:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Tue, 17 May 2022 10:11:52 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mgamsjager@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652782312; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LlT8q5vajwspyzttMDDItlsORK+Dgn3Ki3Pl1fsVTds=; b=nUmraY+8Q3g76KKniMK69/WFcVW6huEDm9pUwO5JyfwbLMeBbktaOXrz7u1DJD+RnluWsH ZDuO46P8wTgZIyBlhXCSaDfiUhYbeqdfyIXQA6LFJrU5YcmIB7Y5KB4QFddx794uvY6JBB DYxN+4CL4oDWA4AIyAFpTZQ44v++yyKhn9ni7k0UEGQX82P53wBsDQyAZ1LPj1/n7I19Th EKZoZKhuT5ozfvHLeF1kAqCOCsiXHi9cZ1MUux6fRP6synpUwqWMSHUNxX0yLZvIohyhLY EczfzRq9X7c00xEea8Ll6ok5TGNhKA+OOG4Ivtdo3yCMOnBdXnU+Yg3dRIos7A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652782312; a=rsa-sha256; cv=none; b=RiOAYF9qOMiBY3h+//WiOyYb22ZQ8gJnPMkVLGDE/EhP/oLRyu989yYQlH/fkf6iFbAx1Q 89ssC9WVCOCbjYNfDEaXV95gzel2R+NCKe7vi5DyjpQKSuxOiQiT/kX0SjeYgyashgEDyG J6gJnKXY24QK5qcJHKdmjwodnzCGPDlLtrRKk76pG/V+5vce+KY9v7nAKj2vc+/JeV5Cq0 QD2+iZ741GdUF0PFq9EDUwrLr0uutFK0vxZy5bFZzO4qzF5Br89eiiEN5ObzmnBZWq1Lx/ I2MJGDXXHEISge8Kj0iVtso3/Co8fbq0PDLAx/FgmnZ30qJ4Txeb79QmK4vgAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 Matthias Gamsjager changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mgamsjager@gmail.com --- Comment #7 from Matthias Gamsjager --- Tried it on my RPI2 with FreeBSD generic 13.1-RELEASE FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC arm remounted R/O and ran: root@generic:/home/freebsd # tunefs -j enable / Using inode 4872 in cg 0 for 33554432 byte journal tunefs: Failed to write updated cg: Bad file descriptor tunefs: soft updates journaling cannot be enabled tunefs: file system reloaded --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed May 18 07:45:10 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 146551AEFACD for ; Wed, 18 May 2022 07:45:22 +0000 (UTC) (envelope-from SRS0=hE4k=V2=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4L34lh6zGVz4sFr for ; Wed, 18 May 2022 07:45:20 +0000 (UTC) (envelope-from SRS0=hE4k=V2=perdition.city=julien@bebif.be) Received: from x1 (77.109.114.188.adsl.dyn.edpnet.net [77.109.114.188]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id C16461047E for ; Wed, 18 May 2022 09:45:13 +0200 (CEST) Date: Wed, 18 May 2022 09:45:10 +0200 From: Julien Cigar To: freebsd-fs@freebsd.org Subject: NFS4 over wireguard (WAN) Message-ID: <20220518074510.ulo3mqjjiwlgt7zq@x1> Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="vtqlovt3vcaxyor7" Content-Disposition: inline X-Rspamd-Queue-Id: 4L34lh6zGVz4sFr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=hE4k=V2=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=hE4k=V2=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-2.71 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[77.109.114.188:received]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_SPAM_MEDIUM(0.76)[0.761]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_HAM_SHORT(-0.97)[-0.971]; DMARC_NA(0.00)[perdition.city]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=hE4k=V2=perdition.city=julien@bebif.be]; RCVD_NO_TLS_LAST(0.10)[]; SIGNED_PGP(-2.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=hE4k=V2=perdition.city=julien@bebif.be]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --vtqlovt3vcaxyor7 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I'm configuring pgbackrest to backup our PostgreSQL server and I'd like to use the "Multiple Repositories" functionality (https://pgbackrest.org/user-guide.html#multi-repo) to have one local repository and one remote (Hetzner dedicated server). The remote server is running 13.1-RELEASE, our routers/firewalls are running=20 12.3-RELEASE (PF, CARP, ...), both with wireguard (using the kernel=20 module).=20 As pgbackrest supports Posix, S3, Azure, GCS and that I don't use any of those cloud providers I'd like to setup a NFS server (V4) on the remote server and mount it on the local server through the wireguard link.=20 I was wondering if special precautions (mount options, sysctl, ...?)=20 need to be taken for a NFS link over wireguard (through WAN)? Thanks! Julien --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --vtqlovt3vcaxyor7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmKEpAMACgkQCLYqJMpB HmltmhAAqnkABt+STmCMf5Zpdk+UAf+ioe+ObI8Zops3HquEPRpM1InH8YgOUxhW A4cZZy8vWA5ODRLi5sz9ldIoyDTAo8+K38FgbkCY7OB7HD8uy0514yXz520iOp5U NSp9RPxrhelewvGq2NpDNE6A/q1qYy1loz2hS28CsF0lGZX7L4gKi5xm7b7cyMpz 0kWrltspVj/auJuwmGrbmvRIqvkTA25XBrBmv3kzo9bmRKSj0NS5N7/pw6AcoBon lq5NOfYas6GCkNF1H/WSG3FSL8CVcTgauH63N86ZEyIn1QKZC1lHHjt2pcu2YWVZ 7RYv0uKGYmjcACidGkB7vXH2FrK6iJz7FV1NFaIwOQ0g3cF7dxpatmrBp24XdxAT HJ+0sPpjU4qzZF8w7T13qw9f+hnFM9/fFzLqvi8XqrZ/WRkCB8DUD3LDsf4DoFjD rnmmZVWDRr2G6jchVkOCb7BVnni0hmh+kObUXvnV/rvA19+m5ZJbYgVMTKzPGAEI vUjJv/mJFvNtXfPylBRtsHdKqLSlAez+GAN5kaDGNPZTBh8CSs9AaOvZpfY3frZB GH1CDvOSLA1MpHb8qIPOh19g2TI8/LlKp6Xz8E90fya7eOBHfFFg3LUXdQeONkQe q/g44l3zUR2i9NnPcs/M1VDlo2m5fMYoEBKYxNMBpLJzaXgRgyk= =wbq3 -----END PGP SIGNATURE----- --vtqlovt3vcaxyor7-- From nobody Wed May 18 09:24:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9186A1ADAF1E for ; Wed, 18 May 2022 09:24:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L36y61N5qz3LZc for ; Wed, 18 May 2022 09:24:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0F5CF26694 for ; Wed, 18 May 2022 09:24:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24I9OUnO052951 for ; Wed, 18 May 2022 09:24:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24I9OTY9052950 for fs@FreeBSD.org; Wed, 18 May 2022 09:24:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Wed, 18 May 2022 09:24:30 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652865870; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=48sWA2E4Q5eRmaryBNOXQTI4dyAsEn/SsKr+ALEAO4g=; b=yilOyON9hFEW1KALqLgvAGDyPFzmRUBGIbA/MOko1o7YftJKz3QiXpSd94kdHsau+kjy7n ExII2xJLfWtZfl8ADE6TcQ0Cyi9YuLHL7vYMhbBkKHWNO2zI5nsh9I/e08Gdf49HpVAKN3 JUPf6aB/22FJZQSS5caBuN7wH9hm9kU5Swj8iRYsb08XAocmOSiJy9KEvdwZ4cgltbxJzL syII7jkZY1QIhrivadHhoC9iZZ+MQYdCuufk8RurvBU1ROIgeh+7b2Lq4Qqynvtt2lflK+ dE3tus2iOEN417NNZ+u9Ib8xmUtZUrPYb9g+14TGUWuPzXpSus+DFi74Z1Hbjw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652865870; a=rsa-sha256; cv=none; b=ymVNaMxUgKgChQv2qCnShsmqaAHssKPE2Xh4V/0RL8LKkGT6dpvQzhBdKkw3V03jRIM+Cb KEhG10L4QEpkV4W3ACRqCRGvcibzdr0r/Dlt40sOsfgI0N+3aEv7FKPmdoAb2/B1EbHmKC tLl7bfm6PYDLIJITjmegir3Cay0T8z65UAgdfg5FBY8sd5AjEUPWWBFNMfJD+RLGPHtXUV WWSY+x/KnyUvSXurrfMH6My8EZsSgn6rQXUvZjXb78FGqZMB+/m9+8T/BS3eOBgp1axGyj lFtBxSJvH1M3u8+faNgN01wSwadeK8Eam+rxnIUM21R4PSRZM3a4yKPKMZke5Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 --- Comment #2 from Robert Morris --- (In reply to Kirk McKusick from comment #1) Yes -- your validate_sblock() of Apr 12 makes this problem go away. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed May 18 09:25:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 075031ADB2E4 for ; Wed, 18 May 2022 09:25:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L36yp5g9nz3MHq for ; Wed, 18 May 2022 09:25:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9E4B826984 for ; Wed, 18 May 2022 09:25:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24I9P6gH053156 for ; Wed, 18 May 2022 09:25:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24I9P6WE053155 for fs@FreeBSD.org; Wed, 18 May 2022 09:25:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Wed, 18 May 2022 09:25:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652865906; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tog01x7xZ6A9gLpAsDV0aEFiPkZIycqsNkMHLVgkwsY=; b=TG41gtVcEH4cK/RSdQAQIoslsX3vvPqMbueC1vhkA48xOMKn1AfO1GVQVG4WJLJlKLa62r Im49VQWQMg6v8sKBFvvQ0MBwUSRZJkBS6xa+c3qsN88H1RUsRUrXVA9KGU12yKuOP1tQXA UQlXgrFNlH7JrfFsieX+iFz6NkXkZQqa4NFjoYQz92GpLUOqScE2N9qOXsBcPvXaIGl43/ jwPgMe5qNsZZ7QcDsY+IuZpeMKP4QO1bcMSpeb3ToPA0cyYJgnuLrW5jsza1iIQDdktJ2Y U2vCM7si0+9NuOY0OkYQ1Kh+mx2SHogXlHC6e84x+rtQ5ItE+MDxUYo/SxRpIw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652865906; a=rsa-sha256; cv=none; b=m80j2PXYZMvJtNX/6anQgQ4fSVc8k9jLVA/JslN9oXmz3QB9fUR7svLGIu9qcLoGetoGd8 ym3aa+ekqFMruTGZ7MIgqrA7mkTWh0A6k/KrLMGzbzl2mjBb7nQ6SMuRaA36AQahiU3GGh WCgUhZNDcIiuMURowRNZASTa9afTuez+qMDNgilUsrZXjKNk1sURSsa+d6y129YlVVZri0 nZVrMEb+8wZqF07bNHBj4x+4FVmP44cNub+RBMiDEDaCvcagUTA4Ejz7qglVTIkY1BDC/o cClL9igElYuBJfJ1KU/TOYNukDy3Up+Re13Ya2+/Ljk1/CXVwSrzNoVYPXTKJQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 --- Comment #2 from Robert Morris --- (In reply to Kirk McKusick from comment #1) Yes -- your validate_sblock() of Apr 12 makes this problem go away. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 18 09:25:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 25E6C1ADC36A for ; Wed, 18 May 2022 09:25:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L36zb5GtGz3Msf for ; Wed, 18 May 2022 09:25:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4F5C926985 for ; Wed, 18 May 2022 09:25:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24I9PlQh053374 for ; Wed, 18 May 2022 09:25:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24I9PlEZ053373 for fs@FreeBSD.org; Wed, 18 May 2022 09:25:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257557] geom(4): Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 Date: Wed, 18 May 2022 09:25:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652865948; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UDrNj8epaJq52bbxpPzhV3h7JMgq+q7ljiLfHR5dqPI=; b=QqZYlD7N6QYWNUQHdsYzmNMt6MgseTTMJciD1N74wLUFSCSMOnxS+oIPq2O0L0efHo+mD9 9zXEoilacNMUKQihKKQphyE7G7td898ONd5MqtHCiUN6FiISNPimGwTsq2jWwSrhY5Pc09 xZF/2qTJpThPj9+/zUgkdgY/qiCNYiVieQHChH5ZIhu5EmW1ilFYW9A13ABqBWAFTrsI9Y Dn+WWozf38tZMNkerTr9IIzy8m4PTFB1FLIbLZzP9bwmRpn+mPbteccNa1BQmMyYxDNBLO tzRtiQ0nG6Uo4h1ki5B2Y+4pov9A9A2toYmzmL7+Je2EEZVbG/7viZLj9pRiGQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652865948; a=rsa-sha256; cv=none; b=GaCJqdJhJkATSss7aZKF4Zb1kStGViXYUJRXRzByukIIIXY98o/3q/KUmYlMuWcbwZumRe khqF2i6h/xSTJxmWoEam8GAKop+Ye5IN2W+H/6JmZbil4UUBk5WjZG8y7qAe3bHUM1V/sc e+XJw2D3vDfB9Ncbk2YIONuhSkkAus/84pZh087b083Kgm9USiUX34Qk0HLLYO4enkOFt6 aF0iLAyCrk+wweXEAk9+cuoItnlDW94A8TZz2UtpxXGRVcMcAHacnx+NsWqh7wgAFqHqkg P2EePKBqq5J0vx02Hgr5eQRb86voKTMy4UHSK2ZF4SPXtTZSLKXhwMbCgqICow== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 --- Comment #3 from Robert Morris --- (In reply to Kirk McKusick from comment #2) Yes -- your validate_sblock() of Apr 12 makes this problem go away. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu May 19 00:04:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7682C1AEEBE3 for ; Thu, 19 May 2022 00:04:33 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yw1-x112d.google.com (mail-yw1-x112d.google.com [IPv6:2607:f8b0:4864:20::112d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L3VTX46CPz4sXF for ; Thu, 19 May 2022 00:04:32 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yw1-x112d.google.com with SMTP id 00721157ae682-2ff53d86abbso22108767b3.8 for ; Wed, 18 May 2022 17:04:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=iuuGwwt913MtR40RQSGbBTaSEvTJiQa6p38YtstiYMw=; b=lXFBtbGAOjpRGcjnzpIZUfC6KNtgkLR/uPIbgiJs/8yvG3iXk6p0AIFRU2jK//Xx5E LQhR3BcypIBk1OjYF+nOoNrcNMyauDWmTL3EkPVLjZdHjT+VrcYaEpfWvIrei8WqdKsM 7qJKb6LFqavR3IOo4evS/MSf1xRUHTeHRgD6dAz3bO1XdeE+QBWNkRaSvY0WVugpUT7x dN25MSPEYiL+4j6mJN3+S3HAZRf+//5HmvczaeF/bRKpRXHe10bKtCGLEopiw6q5PiIY W2CDXmW91ZIDp6d5DWw+fn8CPZYxqkW7uRrcWKXpaX4SOn2m7sHJ1bQXTwh9x1cTiUbb L5yw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=iuuGwwt913MtR40RQSGbBTaSEvTJiQa6p38YtstiYMw=; b=fgaZQyh9kVMNBkDyvn2tva9UwiKBvybK8H2WeViszS7ON11FLv4dOIEFzhTgA2XDC9 5le8NY8q1Of8P/gIUD1GdXnONLNr0SDdBjSeidP7JXkbgFJApBkrAXy8PbxjWeG8zPJJ J3vydGLnwm8hQR5Gxfab7GKPosITO9JB5ieDRT5pTIMuEOs2HdpxSsNi9oAfxDPDhxqu Pir4DStqydnhpRxCWS81gcD9kLG8eHzp0MC4uh7GYIU1wbsFE/bbBYjXd6PI52zAgtOo pm9crQOngOw1sCqUvL9hDaQOO4QKYqMO3xN5Iygwkjy04rBxlS4kQeVb4wysCeNOj7g0 pk5w== X-Gm-Message-State: AOAM53361oDE5hM73GbTwyjuV8Rdk4WyUGWuA6/FxKuA6Lupgl3KdQc3 KhpTvtpvGQQexiymqdz/RJnuWthYZvJuaEmGVQ59szlV73c= X-Google-Smtp-Source: ABdhPJySrHLyCSIOQdvHnYFdmx3KAzyOJ1yRT6OjXAlCq4xXlgtffXQGqNIP8DLwxelYGUp0CxEoP8OtTs2ktQ4jXRs= X-Received: by 2002:a81:2443:0:b0:2eb:4ffe:fab2 with SMTP id k64-20020a812443000000b002eb4ffefab2mr2081609ywk.330.1652918666112; Wed, 18 May 2022 17:04:26 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Adam Stylinski Date: Wed, 18 May 2022 20:04:14 -0400 Message-ID: Subject: zfs/nfsd performance limiter To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L3VTX46CPz4sXF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=lXFBtbGA; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::112d as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-3.98 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_RHS_MATCH_FROMTLD(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112d:from]; NEURAL_HAM_SHORT(-0.98)[-0.982]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Hello, I have two systems connected via ConnectX-3 mellanox cards in ethernet mode. They have their MTU's maxed at 9000, their ring buffers maxed at 8192, and I can hit around 36 gbps with iperf. When using an NFS client (client = linux, server = freebsd), I see a maximum rate of around 20gbps. The test file is fully in ARC. The test is performed with an NFS mount nconnect=4 and an rsize/wsize of 1MB. Here's the flame graph of the kernel of the system in question, with idle stacks removed: https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg The longest functions seems like maybe it's the ERMS aware memcpy happening from the ARC? Is there maybe a missing fast path that could take fewer copies into the socket buffer? From nobody Thu May 19 15:07:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 471D71B34E7E for ; Thu, 19 May 2022 15:07:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L3tVt73y3z4gwK for ; Thu, 19 May 2022 15:07:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C477B1FEBD for ; Thu, 19 May 2022 15:07:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24JF72Zi020793 for ; Thu, 19 May 2022 15:07:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24JF72Q2020792 for fs@FreeBSD.org; Thu, 19 May 2022 15:07:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263853] geom(4): raid/md_jmicron.c: jmicron RAID taste code can panic if conf is garbage Date: Thu, 19 May 2022 15:07:02 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1652972823; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pgqFi1Cz2NvH9Za6Ir/3MU7/HMNO+gV1gJ8AzLMBoiQ=; b=dmUT/GISQFcx6FKm9jJOc+HyaiJahs3QVtQEDAntbDnbTtjgkn8yd50bgeIWhzw5iTt6pl FcXXNjKIMlpQMRbNMPPu2gJJBFVrj6WBT0XF1HrTwRM3T3DAZ+ddlS6KZCpY5M9AP3f1a5 VeZBJ7MJJbEd85s0jYfzsseXOxvoEuuzPjTjDeDMfUVbhk6jubkGbik51sQb/VQ/5MCFb8 etPP2NrgCXCdlSpg9gxdn5rK86r4brVJBEpHQ4/5BjhOGe8HqxX42WecuH1fDHhGm2d+Li Nk2tXWUCUBJlB92HMqhrMqwWwdwrYUhGhNq3KQWiz1hNfTDzduI8A6SDMMcF6w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1652972823; a=rsa-sha256; cv=none; b=YWlF7BczSeEMds6BnCVfqYCyapKI8xB0tIbxl8SiU5t87YQfenzZwnqzju+upBBC4fj/Lk BWR60Qxq2cu+9a/apvk2Bh3p4juMNG7HcGK1k9tbrpdcG6obkIyVAkrTp8uig9Ve5/JxeT peLGNiKMkBRUSahzRtLS/LXGIhTvhRNu9QJJIrYQYg1ZR62ok2YpHz2w2izXczFJB/vzAP eSekt36WLgWlLz7mk6LflE3sEcc+STe7L1nyqlQNKGLw6BKCP7GrTsZXFxzFY+Ccc1XQEd m02pWk9Sdv3VrBh7Tw/dI9L9/RD1MfVa3lrW9nIbOXnvt2aN8Pm5Amh5hEzkBw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263853 --- Comment #5 from Mark Johnston --- Looks like there are several problems here. First, the tasting code assumes that disk IDs are non-zero, since jmicron_meta_total_disks() terminates its search when an array entry is zero. disk_ids seem to be assigned using arc4random(), so most of the time they'll be non-zero. :) jmicron_meta_find_disk() skips over zeroed entries though, so it's not consistent with total_disks(). I see another bug in the jmicron taste routine, in this line: spare =3D (disk_pos =3D=3D -2) ? 1 : 0; It's impossible for disk_pos to equal -2 here, I suspect it should be -3. I'm not sure how best to fix all of this. Something like this fixes the te= st case, but I'm sure it's incomplete, and could potentially break existing setups, though I suspect that's unlikely: diff --git a/sys/geom/raid/md_jmicron.c b/sys/geom/raid/md_jmicron.c index 939e05f78017..faa7b1cbb40e 100644 --- a/sys/geom/raid/md_jmicron.c +++ b/sys/geom/raid/md_jmicron.c @@ -249,6 +249,8 @@ jmicron_meta_find_disk(struct jmicron_raid_conf *meta, uint32_t id) int pos; id &=3D JMICRON_DISK_MASK; + if (id =3D=3D 0) + return (-1); for (pos =3D 0; pos < JMICRON_MAX_DISKS; pos++) { if ((meta->disks[pos] & JMICRON_DISK_MASK) =3D=3D id) return (pos); --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 20 01:55:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 830C31AEF34E for ; Fri, 20 May 2022 01:55:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L48vb2XJpz4YjB for ; Fri, 20 May 2022 01:55:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 332BACE0 for ; Fri, 20 May 2022 01:55:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24K1ttox087534 for ; Fri, 20 May 2022 01:55:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24K1ttTc087533 for fs@FreeBSD.org; Fri, 20 May 2022 01:55:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Fri, 20 May 2022 01:55:54 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_severity see_also keywords cc bug_status flagtypes.name assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653011755; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=es8vQLikt97FKTHHRn6a4hTQBBt6lY0CDtUC1efkiIo=; b=GptZa9zwYoFplAW96BHMOJ0yJTbfGG6vAhtPkpqcJC6QGsWU1N5rAMkBTCa5FUHZvW+IA2 TSZtn14PM/aYa/K5wiL5aM5h7jwaatQ1AG3L/C4zg6hp0GIQEr/eVmaXuJAsgt3tEwCgOg uw+RhHrtZQwGoOCarUp0IgdTWNZ09R3FK9yhdmVkR2UjdsxliBnC1BBA25HwRNjKEzMAOz 9sbxSNZfdcqep0fFd+wz7OXmfw+dHBxNwIKBHdfqmLl1bI4rYhXgZAUuuIjEQzSCpNctg3 Yv33T4a9t3TTFVP7BamNP0250o4eWQ0UJCoiPKyZnzWGOsFMJQVmqPdkcqMnSA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653011755; a=rsa-sha256; cv=none; b=ezg9LvUQyZZFH4Idn2OBk8sFfeg6MrTayawl29MAyUI5kni+LfcuouB0UhvkFX/Sc/5tif vsa4q6IfSuHOvC9S9uBU+pTWhkueF0A5aW99NMOraKcTC9qatyW+Rdn65vsJCFj920yDQR bSeYz3itX9/N+5Bnu7J2KJXBqXyH+hhbBtnYuVvYPG234XS8eYGy+i2azAWqUwocYBFcWF iYplJbZHm3b0dohJxLRh+4B9RAYEo/RtgAZvI2KKDjV+PiZEoQsvLMz+zCQSU5IieDbGLA w/oLngtSXzKE32mlLj0nJa5/HdonHZcMnQnbWRI0q8oxqLLWEjgpG60gdWm2xg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Affects Many People |Affects Some People See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 115 | |03 Keywords| |needs-patch, needs-qa CC| |fs@FreeBSD.org, | |mav@FreeBSD.org Status|New |Open Flags| |maintainer-feedback?(mav@Fr | |eeBSD.org), mfc-stable13?, | |mfc-stable12? Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri May 20 02:13:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D3F5F1B34584 for ; Fri, 20 May 2022 02:13:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L49J31k5Wz4f29 for ; Fri, 20 May 2022 02:13:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1BB0019CD for ; Fri, 20 May 2022 02:13:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24K2Dd1U099829 for ; Fri, 20 May 2022 02:13:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24K2DdUw099828 for fs@FreeBSD.org; Fri, 20 May 2022 02:13:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Fri, 20 May 2022 02:13:39 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653012819; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vGHFdq+Zz+zqCIKBiUImooJwpHhyp0G1kq//lD1ji6k=; b=VqTiSOhgSnyN6PhXsNsFt/nA7dyTFk8c3rVzqul+w5OH98jF5jwE6KTccrMD17iIinejgO yl+/mrD4w8DCyA4+tJHp8sYJIthwvHZ4pvOXk8KsXktWV+N0wymruLAN4Odqq3NsUUo2Zu K9+G/JQq+m+Y0Nz0gpQRdLjW+tQbnyL3oXmkzssMD07cW9LF4CUUpz6v0OcRHnBgNdN9bH bYHEe9iJpSXNGPsuRd33fyNXyqFbXcnj05qxAiSLv2jJvX8KhCdhh5K0GQY7VE7M8kIrR3 jR5s7+Nunm707NOgZ9cZfU69EenXF7N5uSQ7A+j4dHA3PsepGWHIf9ZJWpBZgA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653012819; a=rsa-sha256; cv=none; b=g0nX6iJBHQgLmTDY1WTVBr9myTrb0WBPctA3gVl/hkDSq6NiJVL/ChJrlDSKM224b9xMz7 uRe4pQVQCbfrV+IyxX1ZdoG1UwqJW7f73KGNjNsKBhRVlkxCyHx9espCTpvmkkqIhhGsjw wqNYgNdWncftLqd0L4E5iRmzR+67YxjXCBHuZG16BOEBpTswe40hd3qtM3nW+2Hc6yBV1R CTaxk4MLyyj2uPWbHnpwKKuaGNW4ni5AC0q4xEhDRrYP07DQLx4cIBdGY/JyO2FwrYMz3e B7DUgy+t9iYkv4plSIaGK6beUgsVXuHq07Im8WCqyKN/QKfadgYOc8FCOjeFFA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #1 from Warner Losh --- why are you updating the boot code, used only on a BIOS/CMS system, on a UE= FI system? There's no doubt that some sanity checks could/should be added, but perhaps they are different than or in addition to the ones suggestion... --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri May 20 02:14:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4F2661B3466E for ; Fri, 20 May 2022 02:14:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L49Jl0n86z4fH8 for ; Fri, 20 May 2022 02:14:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ECF0311D1 for ; Fri, 20 May 2022 02:14:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24K2EEiJ099975 for ; Fri, 20 May 2022 02:14:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24K2EEUv099974 for fs@FreeBSD.org; Fri, 20 May 2022 02:14:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Fri, 20 May 2022 02:14:14 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: imp@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653012855; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=H6sSZzUEdfTdwx0DJ6yk6zRLIuujV7nub5WPj62iSPI=; b=PyerMMQqwRNa+0gBjf8laifXuLNI0FWTdQUx9YDzYLl6denfGwG4TFKaDFlVaAgefYIL0Z +auH1Wd06qhwUd+olO0Hg1OEcKcMTAWdRl6+wkUIyNJ9mvFjWDGA+frD/0/R6tw3y4YS+E v/APC1SbSxtHQtrzvQ+6bi9cG67vhOark6bG+BeDGoHCwABbxBmTPcaECWfXbGyLU0vGin HcT8JXe7l3GR5xQTHr+n0FOPmchHurw3Fk3cvTXlJ8kO3+aM9qHo44wHF/9+8Alh5kVITL 3NKzkVOaCyTFPu2R2ylk0HqJc7GPd7duA/jztl5AiNGm586QXvieGz7wDVNFDA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653012855; a=rsa-sha256; cv=none; b=XcYlsflGZXfMToIoWkDrE1BFX2dJujl2Ph7MFCrlNIWxO+C8ToXw6aysT9So1W16xDb2kp PByy0+Y5MNziCSayRpPbG91cA34QMoo1edNLoXR7GgIxZAPA/kI4L6s7bWZUYz37o5cJCj 0r6peuzT6oKI/1YDCRbWaLRxZ8ftv7qTcBcu36FbBsNLhjaMWeYfh5l3Lt4gF5JqmN81ft VRSsSF7f99pDheIBjYNk7W+T6NwFDAwrC3em/tvQlFWqdCkJyBHgBp+yK/wEMuDeZ26yBv 60SuCZbn0xzeYexjlr7UKJN+OGItnta3kDwuPSBCe4ag72zuxobGDhN7Ew4xzg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |imp@FreeBSD.org --- Comment #2 from Warner Losh --- This isn't a fs@ issue. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri May 20 03:54:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5AD141806244 for ; Fri, 20 May 2022 03:54:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L4CXB17pMz4ng6 for ; Fri, 20 May 2022 03:54:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 028002DE6 for ; Fri, 20 May 2022 03:54:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24K3sHJZ053129 for ; Fri, 20 May 2022 03:54:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24K3sHOI053128 for fs@FreeBSD.org; Fri, 20 May 2022 03:54:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Fri, 20 May 2022 03:54:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: pi@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: imp@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653018858; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1z3YIkQEEBapjU6SklcvYx+0puE5C/N4xA/CpxDQ/T0=; b=yAQMKM25PtIYllnKlIxXoIUOW3K6G6Kuyx/jyW55nQM4E9AAAgaPoYl0zmeXGuBp4/iL6I D3yAWL0kHors+AtTkhHrAD5axm3nb41FdkUGly+9DjLltXM/CBin2bbjIMg8MGqPwHCfeh j3Cem1WpuKmiJSevDnLii9O+RHsKRM6FtjUPgSiHapVylo4BuuNRqFLwDkJgZmrs+lsWNB Id+H0kj9REt8BvKs79Ba3aPJxN/Kn8MjB+mJFY7OwiqGVKjpfk1rg7UfzL+bSYdTIfabUp lIcn5Dbu7LBgu9oHkaTTwElRqxJUync3AIXA3DjOQy9AUEejl41eW+UOWWeKZg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653018858; a=rsa-sha256; cv=none; b=BQeHPlo2uApudKNcy5WRiqJFxpBG+5PYhpj418XKphYmp8cZGn4bZXhF2ucW1031MTHRIC TtyfHnm+cqnuzoGZQ9pPCuBIx2g6xdz3QG73Cf7xANisbbtwb7HI4FCcFQRN8yrxvoLDPj O56XK4AU7NMvtoT5Y8sc8Zsj1wkeJjXI2ytMMBDCqXTCw9Ps+eB5/3Mn0F+0M5LIR4VNqq LehY8uqjLNUcc5Z7n8b5G9a+8fVAoWTz+pHC9PnRkMVGQ3YSL7Fmf7CwlN9c6YvsxQ4nRP 6pdGDdJBYThzqTI0u6+z0XvquikneIt79FG7DbeZEoUhiBcArZsckPx948fiWA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 Kurt Jaeger changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pi@FreeBSD.org --- Comment #3 from Kurt Jaeger --- (In reply to Warner Losh from comment #1) THere are cases where a disk moves from one hardware to another and the other might boot from BIOS ? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 20 09:54:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3CD431B47755 for ; Fri, 20 May 2022 09:54:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L4MXM0YMBz4byh for ; Fri, 20 May 2022 09:54:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E75737E3F for ; Fri, 20 May 2022 09:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24K9sw5t058431 for ; Fri, 20 May 2022 09:54:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24K9sw9l058430 for fs@FreeBSD.org; Fri, 20 May 2022 09:54:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Fri, 20 May 2022 09:54:58 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: piotr.florczyk@gemius.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: imp@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653040499; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=M29o586DFT6CgX01VnG1Jh8rzUUYhiVMMnIQUSDzfpU=; b=runBJHd8v6TQlmieiid9Z6EYSAaqNnY11dU1dwjlHmLmkrlut7Sf0mrRDunJEtLRcxpOuW VfHnFWrT9zxHBQxGlrhK0qdWTZ/0cvgv2ukWuQ0F/zYBkwWlXBoUEKmBJbe+AZ1E+1bvPU tZQ4yGI2dSKBTbrwKq8gzpJhY+oRNNcbr2t4YmMRnkfMc0FTG+L/+lOX24RTIMoFhdG6U1 VWlifbN0yi77PbDRLYKODf/eVwrZ5ruOU9R1e2bIAddw7R2m2PIKCVWcOdMixeMWtfQxtz 4AFGS+ekH2Bt4OW4PKUn1QhtuImfbnZAMSfYtnNfmONEpcserVZ0cLIUdcqhNw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653040499; a=rsa-sha256; cv=none; b=w8s/69s3jmslZFr4YRAvCVOLsA0hEJJU8pokvf1eMsfjnJ8XI+enxx/9POAXbGU+z8Y7zB wN8vU5x8it8W4rgg+cbPjbWbFgI9LQSLTPGKztPSIMkdk8gWu/e3A4OD+eNM6KmzEbKTVX xjXFTxuSjHjzFhlBD2pryYkcEtgtB8L8NMRKYZ95YBYhKL6NKmX9D/wTLdd/J0iXcIYlw7 662AXzwNaMWRnxwiWVpFtK/wmYfwr7ZOBNYOSPhTb5qoyP7s2yIO+99GBtEk4wzFpEvXYA uwJGNArjF0niEPlKBfBklsFOVzqhs1HA0WRch23cZEAFD8oi0uHyh3AUbA3nRg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 --- Comment #4 from Piotr Florczyk --- (In reply to Warner Losh from comment #1) I know I don't have to but as I already mentioned... If you boot in UEFI installer always defaults to BIOS+UEFI scheme and places freebsd-boot as se= cond partition. This changes holy index of that partition from 1 to 2. I operate more than 100 of FreeBSD servers and this is first time I did a t= ypo. One could say that this is combination of: - defaults in the installer (partition order, I understand why it defaults = to BIOS+UEFI) - bad luck (efi partition not mounted on older installs) - human error but the point is it could be prevented if gpart did some checks. If I understand correctly gpart bootcode overwrites first sector with code which seeks for partition type freebsd-boot. I see no reason in allowing writing boot code in other partition types. I already had my lesson. This will prevent others from losing data. Current= ly only mounted partitions are protected. Case mentioned by Kurt is also valid. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 20 22:24:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AC5171AECB5C for ; Fri, 20 May 2022 22:24:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L4h9H38DLz4S1g for ; Fri, 20 May 2022 22:24:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4CD321AD83 for ; Fri, 20 May 2022 22:24:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24KMOZ1Y081426 for ; Fri, 20 May 2022 22:24:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24KMOZBl081425 for fs@FreeBSD.org; Fri, 20 May 2022 22:24:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260664] ZFS/NFS: Intermittent hangs and crashes after a period of time in: nfscl_hasexpired || dbuf_write_done || zio_execute Date: Fri, 20 May 2022 22:24:35 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653085475; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YcMLhc91Hu1d2L36ys51O6DiAyZ9PM+tvlExDRzW4n0=; b=kusEQ3aaUbEwEh1BucXMO+RQu8CSzXuK7rrFQAlR1ALt9uhQ/GHxE/fgPLpJPEXgBsniQs 7AG56FnTOsF40pa6B0ECAHkDs3ZX0YsnTAmqrtyyAyu9z7235UniAmVADDQ63xnjLh1fHq YBkBAUvnD6H1ngMXfaD5j3nIzPBqIiN4KiumO0mC4fNx7UEF1Dd0JGDkOxyvOtrzrKx8by VfhI50yKGJ7C447aaef23CqAAWNzIDGoR7Ysomo4XDlP3jM8o98g9nwjqZGRDHbfumMyPx EnRMpqXBP51rSXCIPemQ0ozN898bWX0UhLSl4TnVlKHK20rrSIfuSIfITw5zkQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653085475; a=rsa-sha256; cv=none; b=Te3POASGIgqlhkpyuYyiRY0MKgHW/VrcxgDStiXPzUCriszJELNkQvLUyJb2g3MzRWGfJD prDiGFqkUp1rIftpMAGvmw8+WzVhozUDsrAV2a0HQoZT1Mcl9ielAXZ6A0ap3nFQlGAKoJ OyktQYaG5h/Ats4CK8d/nmv0Bwsymbm+N4C7pZTUIN25TRSH9qfBCu1HiKmhEcph1FTuFf MKmxGdX5/DYOfJNRx6eXBiKA7WwIDJekt3S0rB710Rr/5jGfuFHZYjYw/M6eDENfi9CqJA /6a6TlTEyjvcWxGz7BKqMkkixOe34620OZPNPzj0E/m/Nb/B2z8HqX6rJeY2dA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260664 Rick Macklem changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |FIXED --- Comment #17 from Rick Macklem --- Since I believe this is fixed in the 13.1 release, close the PR. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat May 21 00:45:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CE30D1B45B30 for ; Sat, 21 May 2022 00:45:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L4lJM3zfPz4gsH for ; Sat, 21 May 2022 00:45:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6890C1C9D7 for ; Sat, 21 May 2022 00:45:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24L0jtUY060795 for ; Sat, 21 May 2022 00:45:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24L0jt1L060794 for fs@FreeBSD.org; Sat, 21 May 2022 00:45:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Sat, 21 May 2022 00:45:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: Russell.Yount@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653093955; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Z6VRwNMlBodirs4d4XKGCN65fRvaXNlV0GqW3Obw/ns=; b=CN83Q7+LIcvME4Wxf3/J+gHYNT8+wegTndsma+Arv2tTOOtnzNOsVZ5E54y4aN59EFs+kM an5nHOy3zIufjp0Y3U/td2xwg9+tn/LePbDVHLKRXETDoRuGdh4oOwJxC7EANwwk/OWjIX hsFCS0Qk6OWaXzYLbUCm8a9CRUbLD+5ncA8Ivnc8QPyw06Ahqn+A8prMJS7A2f8Se8+Hqd 5wr4Q1dsG2zQcJgSbcPtKRyIQzhDV2Xtt85fElbMU+h0OzKDcFmoqNFWSDOYLD5dlKAYLe w3qxdepuPdF00VeGUlpBuLIoUNiiZq0i9iLyGCoPvXcF9TH1tsgiFZV6OfwZlQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653093955; a=rsa-sha256; cv=none; b=VKFrwaGTRAkIlaPW4Nn7CZV5PupGvWVEdPO2dtCn7ceDg9SQfsQCL8zKE9rfMjJ1hoDzDh 94IBr4LLJY8UUF+1f+a+PQgyK9fNf3ec31nW+xfcCB8xMj8wy+PRfuPcJuCvvr7/0UUwEn r7WwDftt0Y5N92U3sPviarxO+xvG8UK2EOEt8v9PWkqtdvMTUNrj0Fb/dyiR7yD29Odj7b E+pMnULtSeObUXmzeO6bRB3ZMeGxIaKu5x/V5F0tHNxK5Ic3OuzpRBAipqYHWnJ0Kj54xk Yw+O4b0gNhbPTtfqELALjBi1xGVzmVWqQsXghGofcrt0P5hbdfGLq+nOQMwhpQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 --- Comment #1 from Russell.Yount@gmail.com --- This bug still exists in 13.1-RELEASE --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat May 21 22:53:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EF28A1B4BFF1 for ; Sat, 21 May 2022 22:53:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Jlj5JHfz3mPv for ; Sat, 21 May 2022 22:53:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 961057D06 for ; Sat, 21 May 2022 22:53:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24LMr5MB080491 for ; Sat, 21 May 2022 22:53:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24LMr5cW080489 for fs@FreeBSD.org; Sat, 21 May 2022 22:53:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sat, 21 May 2022 22:53:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653173585; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6OnyBY/tmNeMCXz9mG4rSjvuNa+0qCcP+AsvnvnN5xM=; b=tT28sxgOgFBuqmf99Pf+kKL3u5sjMVHySvfiLy2cV2SmfUNa17hwZisM+BRSowefptPn1F H9DtvJklgVcPETIGOGCKQEPF/YLZYC3n3WYFXEvBHLdvMm7ZhZ/sBlwk58AY/8mje8B+Kw mf4HOmzGaDRjaclcpjQF7JRul6gDxES07Tq57mfKwcIkDmLJcGzIl9F3rLRpqXimWmoqKx AvqZKfP7CeF7pNzEsqTM3bSeYdYOEPkkTkqi6oEFJoaLjVSOSsNY7cjcGkR1m4n9H0cj7I YYf1x3vd7zducRPsyVTwrnZYsrmN8r8FIFKdB5WNUK/d60SmkDLTME8R1NrLAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653173585; a=rsa-sha256; cv=none; b=g84uKgpNm/mLfzJxHi5chQ4zMrtizghhkZ0mYanqJQmlKAgkieQM5de90RoVij3kDZuT0V sHzGZEuLJZkv92pwmeaE5UNTvS4fis/PFOIjaaQNWov0NHIJ/oTKjY7YM/+DBQGomTrT/Q 3sTjpczcEZCY5X4s8mJij1wIprbu7JTBR+omSxbzh1Z2uEJP27US9oEiKA4SoLhCKGe5nH GccmrWhF1805IMc3eQvtCpURJny5GrADghA2F71fFOLtGaFOgS3pPUlbW2Wv0blK9DlIGQ 3htu+SvSaWZzgd/V6ejn+fSxQ/ZmVAwAjZyUqSSW1k0E3whFCDIBgccVar0plg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |panic --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat May 21 23:24:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 465F21AEB343 for ; Sat, 21 May 2022 23:24:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5KST71Pzz3qpK for ; Sat, 21 May 2022 23:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D0CCA103F9 for ; Sat, 21 May 2022 23:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24LNOvMm097709 for ; Sat, 21 May 2022 23:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24LNOvKj097708 for fs@FreeBSD.org; Sat, 21 May 2022 23:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Sat, 21 May 2022 23:24:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653175498; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bMX4xfbOobb0Jrn2KP+2a/zZ7yvDi/3ZiivR1GIcBVE=; b=dizS8CcUHnq2+O+RQ5Rc+tOQG3PA0C8HN1rI4jwRCxCPi2izt3EadN+iVPnEqjldxx7VT/ TTptO3DxOlWArQoi0YfihdlIzd3vXzqnjanOpe8a+9btHPQdyACDvIwNt4pwNosjw5+0xe z/aEkIgmfWp6P60T9zeSiFmwaD17HMC/usCgm7NGpsIAuOi1nPh5yL5+hvJEdNEZaab3JS q4eR57CVnMIlqkqyQmnkT3lQyR4BufSv5ytOZU/LdZPAbUO8QoXw6d6COEiMncME/RoAIc HrKOhD2pkH/AJqoQf6SED1wdKQGt2b+SlnyPmiAQFIwQ5A43A9ddMBGlgfPWKg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653175498; a=rsa-sha256; cv=none; b=Z7gpBoEKqV1PosZPFGW9gUp/Qk1PQ+65u7RjUwK/TfoSvF6iK+mXrDGEZkz3/X/Zr4SNZS OzHcJdFOoPsNg4rUtd+SXjjOJYXAsg6/pvWuouFesK+TD5RLBTDAcHiLjh5O2PoTTgWX5h ktyi75RN7/RKHCIpV1K6t+xaAI097L3EWvwxkc10mnRr4YM3FT1S6+Z1ckYfABYbsnaC8m oFwrSRIFzmD+bV6cpE/t8BWUiDvpPnM5THmE/Nwfa6H6e4hvqwKXeipaDZU261zdOpPh8K /ybczqgB2i46qKwPqUIjrUnX+Klenu6Z/SWTcDFA08GirwWwKyDvCPppXuMPRA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 --- Comment #3 from Kirk McKusick --- (In reply to Robert Morris from comment #2) Could you recheck with my updated patch of May 21 to ensure my relaxed chec= ks did not reopen the vulnerability. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat May 21 23:25:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8ED081AEB838 for ; Sat, 21 May 2022 23:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5KTW2v4Vz3rXL for ; Sat, 21 May 2022 23:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 40E2C7D79 for ; Sat, 21 May 2022 23:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24LNPpbC097976 for ; Sat, 21 May 2022 23:25:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24LNPpo3097975 for fs@FreeBSD.org; Sat, 21 May 2022 23:25:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Sat, 21 May 2022 23:25:51 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653175551; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Si2dfZy102HmOGEap/gwHjsV93oQMqsRBgsIX1Ii7vA=; b=wWYD3crsliT6abMhqjO22K9J2gW6nEBuFG5HIsJRjhJW0+yACF7DMUR+6q1PBxlxgO5mwl wSLQ8wxSHIIu5aeXa3PPoQo8GF6CfTnGjhkXAKtVR98urnBLP+z2/bWAFRnRD12+pOIKlU B7kjMR4k2WZYGd3cQCGAOc4gPtthrLSwhCbRuISzK9tZMyrA3oDIWL9sF2A8AO4ZiuDgEs O9vuwMMTNatSSnvZMgJ+8OSO+IRHS6cc3LqNhDV5mw2Zuc4uM8Txz0AEy5PXH4Aas+HPFu HtqYT4WhQQDObFP4qnIsU8qUoDG74Tuu2e0U2CdEdWH/ifv0GozMShswb0rTpA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653175551; a=rsa-sha256; cv=none; b=hHIDilf5B5ncd1f12xPrO7Wa77Hl/B4EgrAIEBfbAs1daFT1vlgWjZhRbkN1Pn50rh+/bt qUpxfy2aqeI4JwRPMZXi14mjg67HMBSzdqx7bVp03cjla4eNgTvPYAEsowzTfQQl54ZfE3 hJdKQ0Hj/fGGnMku+t5lrzckBxOI4V2PjAHHTcGl9eGfzAwb89mNuxDlvu3IOaLpAgD5Wh Mt1exbVT/JF7BehE1JDKHxle4mK8IKfrZtZ5fv26Wxgj/+C9oI3hlpaXS7gIZyu+5n1xNh V7UUcRnuWxB9T3BfLqAeB3O9GkwJ5abtoVDWOuZa8xA6/VYqEmFzW7o0dpM3Xg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 --- Comment #3 from Kirk McKusick --- (In reply to Robert Morris from comment #2) Could you recheck with my updated patch of May 21 to ensure my relaxed chec= ks did not reopen the vulnerability. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat May 21 23:28:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EC3B31AEC911 for ; Sat, 21 May 2022 23:28:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5KXy5Rhnz3rym for ; Sat, 21 May 2022 23:28:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9BC4310589 for ; Sat, 21 May 2022 23:28:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24LNSomc098766 for ; Sat, 21 May 2022 23:28:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24LNSogA098765 for fs@FreeBSD.org; Sat, 21 May 2022 23:28:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Sat, 21 May 2022 23:28:50 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653175730; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GZBPRufzRtby9miGBR4c9EXfmAbYSBzr6HnmglNffK4=; b=u5V810NKf9+Uh6uwqA9uiNOa3vU7XxBNfwt9XUyt/IP3aFFSLd+5FQazjPm8cPi7K0SY9t yGqm4bks1jAgxX88ulh6iwitiJEnpjbSt+AwVT0Z8oZYloB6zErqN+mfqFMAuGiFw9AtAX BXEcd7GouHxzeR7fD9BvgecBXn2ZjXOlnU+swqQl/VWtbk76aUdSC1bbA55lQwz/SYS09x 0CBbfltkDqY3mxY6CcaX06SO2mLGWJpy9rZ/im0sa5J1SjOiLbWg1iwlchPpc3BZHwtlMD 18wI55gPkRSEfcQdSiUsjek0ZejXX/Vc/KHNHylqnkaQNT8U2D6pGMvaxQKp6Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653175730; a=rsa-sha256; cv=none; b=RNTe8VxC2FHuoPyhMJpa6gIuFLqy7F+sYU2mCis9nSZNsn+Fw0rXd9IXyHHhxkHeJcB+yY zSXFC9oktNeD/ru17h5MJ9//iU3NTKa4esAUFWZyo9uASAq5Ln95pLtJ8EQElnq7W8mFc1 N26fw42dgNoCZE9QEmYFgoyDNN3Fo84fzkfJ+wnq3ahG4h6JuNhcCnRygwUxgZ6QIi/CGk R217gMBGFFvD21+h7e2UQdM8bhx5K+cTmmetzJNIvsFulDNttC/jt67ayNSMP6TBN6QONT /qvKe4yAxjfaKfADTgdOFzIHEMkR+u0toOY93SqYoyzagY4nCKirYF8S+t94AA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #5 from Kirk McKusick --- (In reply to Kirk McKusick from comment #4) Can you verify that my patch of May 21 fixes this problem? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat May 21 23:29:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 70B871AECE32 for ; Sat, 21 May 2022 23:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5KZ31jsXz3sFS for ; Sat, 21 May 2022 23:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1B59A7D7C for ; Sat, 21 May 2022 23:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24LNTl5t098985 for ; Sat, 21 May 2022 23:29:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24LNTlMo098984 for fs@FreeBSD.org; Sat, 21 May 2022 23:29:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sat, 21 May 2022 23:29:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653175787; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dABTHckD8u51EJpV41QivEXP520VFli63bYZiv22dAI=; b=hF2crMdRms/X2Ys+CJNuwwxtQ3LuxKbkgqPhHSnOX3w3wFBFt0hyFmjfGljrp77Jd7/7fX YSEmdBq7rCv0ghUQDcBs9u6oyA6ABPj1DerguMBSeW2UINWk9xR51s74JmBsY5Nb1OHvpp +MT/XAdNUVKicobxaPKl1NTFJlgefYszXCUoxrJF8afg9PiL3nFACX0f+xIwrZg31Q50C5 kB/VmWC5oAdtCQzLMkAew+VcTEGxTNxIoOhnEchRxcvWoWCOKRb+VX9IkhSt2YqJFJ3tsN MYaTprjZ4KbwTi25Cj6QqwVehREd7r4f914OIk4HzGcA+qiOkMA4AltUqLtuRA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653175787; a=rsa-sha256; cv=none; b=s2FUXRc9/pDF9620sNrjLZVZzZPFp66EhZUEfPxfdJjS2jda1zP+X+lpbdqfqJj1jOCp6t Us3yvaDSqzKDzyhJ8EkrImP+KbqWvdQN5WZU/kkyWyN7DEclfHhoOTh23Hzw38J+UItnpH xcz8iPupwz9JxEKpV1wjQWpsJa/Kpb7NI9y/sV31PqoSJUkXCZyk9g4uOESsMZa4H1n3T9 U+uZrHJYy4/9oPu30TWVk6nXrEMIi4CaZ7FvakQUh2SJsgbmj6lMdL/GTKTuFMl6rxH6bh hhcc934PoksWfkplwkKitsQVmzhKNeBOhwuhWBwwZUNHyNOE5Dw/0TuQYroFvg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 --- Comment #5 from Kirk McKusick --- (In reply to Kirk McKusick from comment #4) Can you verify that my patch of May 21 fixes this problem? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 00:52:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5528E1B45C9F for ; Sun, 22 May 2022 00:52:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5MQ019xSz4ZHg for ; Sun, 22 May 2022 00:52:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 05AAD119AF for ; Sun, 22 May 2022 00:52:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M0qt1C047803 for ; Sun, 22 May 2022 00:52:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M0qtLU047802 for fs@FreeBSD.org; Sun, 22 May 2022 00:52:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Sun, 22 May 2022 00:52:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rrsum@summerhill.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653180776; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9LO4G5x+Lcg4tP9uVm2ylZsm4pENlYmLDJZ7T6i0SqM=; b=Qdk2OkdNciydWfGuYy0Kk8TLtgwhSGmPNairvEMXbRbwPEQo6tdH1485X3ZB67S8iZ7FFJ RGdtSUtwHMH7yovoU8WruLXudQl4zoJnQ6IZ/tcBdriZx3sI489RqJqDT7BV5DQQSfXZlH NhrajFX0G9xRkWPDCvRqTpT96Kwom/NcRQ7tugxSbUmogGBNL8WBQLeQmDoX3ikTCTadW/ avzgD+W94Nu8X6PI329zWVmNWPAZwHMZiMOtn+z3B2cl7zSG6VtujirNbSgGHAtD3w/IXX Q6dxQQdKmnhmfpA3gK/jqEG98WVrYP5d3YYrSeLwgOoTMOqyDJy9IbUREiHViw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653180776; a=rsa-sha256; cv=none; b=Sz7mjLgRc3TMLwhLjpwLQdZTGQ9N2Cd8dtuWVPKMvqhfXNo1qttuk9GX2Wnhw9FnzMhTzy 2vKodjmypOfocnk4gn3x8nacwG6zxGXJyClzkXq/yekDAqumb95wtnCpTEj2F9+j7E/2MO bhePDQ8vh+OaJjaQtaMc0Bk6A2kbll9lj0BIpwgS+VpG4KviuNErzYddI2AIyqW2ODSJvX Cemc6lLj7JjKCRSL0C849H9BxYxBLbclQOxIZBeJp0Ac5oRN6sS1NK8d7a5I6GgIA3joqG EG7nU1M7PAXhpxjvET120h7NJznRAkBQ7bWbMcGTqkaToUXrbl3dpTg+01Iwxw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #12 from Rick Summerhill --- Could someone fill me in on the status of this bug? I have updated to 13.1-RELEASE (uname -mrsv: FreeBSD 13.1-RELEASE FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64) and the problem persists, ex= cept when the boot loader contains: vfs.root_mount_always_wait=3D1. I do not h= ave a zfs root drive, but I fiddled with the suggestions made by Christos (with /etc/zfs/zpool.cache) to no avail. Is this just relegated to a future vers= ion? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 22 01:59:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1A6321AEB022 for ; Sun, 22 May 2022 01:59:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5NtQ6cBZz4jhM for ; Sun, 22 May 2022 01:59:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C34FC12549 for ; Sun, 22 May 2022 01:59:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M1xAYN078616 for ; Sun, 22 May 2022 01:59:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M1xAKK078615 for fs@FreeBSD.org; Sun, 22 May 2022 01:59:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 01:59:10 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: see_also bug_severity assigned_to bug_status flagtypes.name keywords short_desc cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653184751; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q7L7n4bUT27CQVAPAOPSw2/36KVWp+c80yjRzRTLOO8=; b=lewymMJqJIfLLfnNRQQDbaQpczDKqeMWS0VbcE3xKCa9MX0MzHYkpf2gPC8PolaEjsmaid QJJwxFDZzIZvp2FQxfgTxpIwr5pF7fNUg+74pu3PI9ja/5CxCTEDEOPW1EAUh271qqhTKZ 2RxlL21thE6hWDSZ0/J44F6P7WqoF4VvWWRzT3oiMNsizteEgvVKIVH/Nnavrbi/tG4smP hbssnA0hFphL4wbFErXpTzcJPMRY5zrGIIDcIZe5arR6v16yyGfX/je51WpxprpkgukwO5 nInyWa97gwjGS3Pjjf6W6D6GX6/EXW7pKCz3+m3MKAzB5ZCTLt50uC+2euIgNg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653184751; a=rsa-sha256; cv=none; b=XUKC4J1x1yNOfr2V6xq5mx0PGh4GSs/QWc/Qbz/bDH8nVmLNGUISxCNSCO3jaVCKdEOInD Fj4VH6VzIJ24XSTQKRcGfKmTojPniJ1ouEYBUHhAyTrkfb+AbbEkBZzqe+KeKFGJ0kjLHD Pwy9/zu3oy3BL6wAiIl58kXjpw7Qu3BODyM6B9+OcirfV57JdirtSrZ+XuRArsDXXyEPry iKRnnvJQ2h8A9bPFiyrCUrVAEsrLeins06ozkY1dO66Ztw7YmJ8VC2oAv9/mv06qjwtpBZ nG95xxXJlSdCH+cXz6rTmL4/dShk1HCS+JwXvjKaDlDlBKopMKxU8vGk+q8zZA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://reviews.freebsd.org | |/D4609 Severity|Affects Only Me |Affects Some People Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Status|New |Open Flags| |maintainer-feedback?(bsdimp | |@FreeBSD.org), | |mfc-stable13?, | |mfc-stable12? Keywords| |needs-patch, needs-qa Summary|Seagate IronWolf 110 SATA |ata: NCQ_DSM_TRIM trim |SSD NCQ_DSM_TRIM problem |method for Seagate IronWolf | |110 SATA SSD hangs drives CC| |bsdimp@FreeBSD.org, | |fs@FreeBSD.org --- Comment #1 from Kubilay Kocak --- Added (from what I can tell) in base 298002 by imp@ via https://reviews.freebsd.org/D4609 (request feedback) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 02:01:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3A23E1AEC491 for ; Sun, 22 May 2022 02:01:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Nwg0Npsz4kWb for ; Sun, 22 May 2022 02:01:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E2B64128A4 for ; Sun, 22 May 2022 02:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M216uq080325 for ; Sun, 22 May 2022 02:01:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M2161n080313 for fs@FreeBSD.org; Sun, 22 May 2022 02:01:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 02:01:07 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653184867; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JS0t02RNEZmaVgdbRR2MGCvQWHxNlhJkv2zC0Is6RkI=; b=gl82lqmMG7nn/kP5JYWlTgiCXo4f4C4TQ/slLZb5bytOfb8Gpvq0aUhH5plKAcT6zGMUWj 0KTDjibYNYVeLUr2mZLA580j+gKdyaRrWaeuSaoB+ROZ1SqxZhJOVFnM7+x55fxiLQ9d57 cs3rug6OxISPim6ILzzrV1kcXnUh3PbZfSbCsdS81KzNTzkhuIDYGphKi6E1+rqVgkiNuy r06p2fKGnP70boFzHHNfTaNoVeFqZgtd6WqUcz89lD3IBMcmVC0vfprel6tgoIW3Fg0eEH ZqdeoLOzOl+oGiVSSnAuw6Kg/f0zEjypVwYf5tAb0YqgXdNJZhs09WJ9WYIHMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653184867; a=rsa-sha256; cv=none; b=CA6Q3/n3ZI8rAVlKZHnSsHhFQKJf/+g4Vxlzw6wWUaowza+F0OIW6lSyP5ORMdO6YCXgdL 8W3mJaCyh5SWCA0ciMH5wUZm3VjuCM9IokzVMsYWfL0xB5++4WrqZrV4kuPg+xdk2fd7d2 a7S9fqj68jlvG2XZm4H7nYk3mefa8BrZ/kuvalB1h1qvt2ONYiSmbhIHZrXa0Zr0DmrHcb VhLJ7qjVREdTCuhKZzWfFuhJNZQKhhUNpnEIFz7+s0Q7SMGImHfvxDPNf479/3SBNG+Xzv zwIPbBjLzDZtE5dD/VgkMZTwbhBYK/Txoo3YsKN7mP0LGGqjq1pomvBYwiQjnQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 --- Comment #2 from Kubilay Kocak --- @Reporter Does setting kern.cam.da.*.delete_method to alternative values suppress the behaviour? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 03:14:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2CA931B40526 for ; Sun, 22 May 2022 03:14:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5QYJ6x3Mz4rBC for ; Sun, 22 May 2022 03:14:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CDC5D13A1C for ; Sun, 22 May 2022 03:14:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M3ESnp024146 for ; Sun, 22 May 2022 03:14:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M3ESJW024145 for fs@FreeBSD.org; Sun, 22 May 2022 03:14:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 03:14:28 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: blocked keywords cc flagtypes.name bug_status assigned_to short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653189269; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wpFvnwX71GK3VYhlLhEkkOjmCBp9G0L8T5rN2Tczq04=; b=drbE7Qd+OmQxeM5Dxt00cieeGJhBYeT3nSxe5kdOjTiGa7Lqq8Z6nNocXzYh0jhlthywqU oUbECOR5msAXgMykNsdEnNITIAq3SwKTbThFf6LQ9W1lBe3Fv0iNbqA68wr9PSk5ZQ83lW T6WejCDll5A/K++0RxmLtGS74ZANDhIkPU1OFtoxS7AuJ2Fs2VR0vuYwi0jwLdNzaldk15 nKLjkc//J321W1Jdrq+24LtKHqBfNYy1hXjAdDOwqgtKinMDhvfJoPZJ592FlFD61q4lmv AXmKOWk9CU37XTgFqQo1ZJpR8O+gDqH8ptDL9pKrF7kj7nSt32E7AabuVEGZSQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653189269; a=rsa-sha256; cv=none; b=ETOem7DhaE1EwtS/3ZJIpmrRGmLtcajAJW+8WCfSylqZTKlDNZqihLaJyZgVzpChqowa/V hlxDENC4F1JNM6xjVGVlOU7hNF7OtY063PcGmb+gQoz3p6jE14GSBMUevO9m0UdmRTIALu ZzL8H8p9D4qjDCfhTQqmHv7j7s76UeK0BOKJCCms9bSJeFLSpmWO3HqVveXXhm5T6lAUrE hy/Qsex16JnG+BIpKiLAlhFmVmSG7UJ5u16S5Mzot0AUDfOuY0Kx5x3td4l81b2Oe3nqRh c24Uo9Ci+OJ5jK6Lw2FmP2Nfv95akgy6O5mjdC712f3l2gj4lJCV+MxpX/8+UQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |264030 Keywords| |needs-qa, regression CC| |fs@FreeBSD.org, | |imp@FreeBSD.org Flags| |maintainer-feedback?(imp@Fr | |eeBSD.org) Status|New |Open Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Summary|Heavy load to SSD wedges |nvme(4): Heavy load to SSD |13.1 system |wedges 13.1 system: | |Controller in fatal status, | |resetting ... Resetting | |controller due to a timeout | |and possible hot unplug. Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264030 [Bug 264030] [tracking] 13.1-RELEASE issue reports --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 03:16:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EEB881B41C57 for ; Sun, 22 May 2022 03:16:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Qc45jRJz4sVq for ; Sun, 22 May 2022 03:16:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A053A13870 for ; Sun, 22 May 2022 03:16:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M3GqZd024567 for ; Sun, 22 May 2022 03:16:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M3GqDW024566 for fs@FreeBSD.org; Sun, 22 May 2022 03:16:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 03:16:52 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653189412; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tSWQwnPqkaUMRPRM7mvJwEUDbRip9UVG+13mMx/xjOM=; b=SkyooL3o4fctoNaWM2glgb3bI7oPBiDtLLGGywtJZ5bshWXJ/gUB96BZFbaiE3I0ocEugx pQqh9mgHV4AXVhPWnv8ivl/wX3xDbwnkp88+p4ouhNouQjLNCTzaulv4beoiK8+lwljkTs /BmXtnB1ehRAhuK0RFJabq5dWyr5SH6HkGwDoFAQMWRrb2nnx77s7Ntgl88zjXpH6fKJOr gIetbBHUoN5YsinQmXcIg+spzuVHANdu5TtUcgOlGoL1TBIsTRc9RsbssOX44zt+UiT4R0 y2VZiVnu9LUzRIP7KeLeVvaJCPt4RxR/il+ie0nDy0YOdJJupsvAa32smphK8g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653189412; a=rsa-sha256; cv=none; b=uaqdL1uooFt+kn7cqI6pctbKKAHXtCOdQfq2vDxal6cdGlt8APw/vhfus4Kew3c7QasGhJ LwpESLSCacNcixnFNME/ZlveH5mY/901w/ofIjJjDI2tbQriaKVS4TRVrAdIj5IJzvNc15 NXWlbZiz4Un9oM1vYoNaOXPfJBsje1ALEupPvoJppRxd2jaqSqoJ5PXZaKEDIPU4fFAc8c NBeah/FzeB/16UWs0vzqsIcU9MsGP+y+1/ol74N2Etak2jAN3NtS7x2oya1015TV4hAs2J ODz9I8+jeO2IuaJE4aYO8BMTVoAVOvPIVMMQ11O+B95CpJZROmDlG1tI2XGi1w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #1 from Kubilay Kocak --- @Reporter Could you include additional information: - exact uname -a output - /var/run/dmesg.boot output (as an attachment) - pciconf -lv output (as an attachment) Thanks! --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 04:45:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9F3AE1B511F1 for ; Sun, 22 May 2022 04:45:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5SZS0Bz0z3Jlq for ; Sun, 22 May 2022 04:45:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D735514F04 for ; Sun, 22 May 2022 04:45:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M4jZZh070753 for ; Sun, 22 May 2022 04:45:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M4jZGU070752 for fs@FreeBSD.org; Sun, 22 May 2022 04:45:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 04:45:36 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653194736; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w+EMwek1mYcnPUQPcz+8Yow52BS76EGYLF/au2/O01E=; b=mPw0F8gnoPVNs4zvyxLuPMxV2qFQCkjKAUteureIweaXQUMucBKRUrSkIwib8Qr8xqF+rv zTblgUKxKcvLSRnS0ffMtp1q80X/Znt53oDeJL6yBekc811lR2dOu4GvtoaD69wIKKqRgt HLBWCykGgV6CVVUisfBQytvWwE4JmuxvCMMgYcDwVuSujpkCMEgYtCMWYJYwWtLxoccBP+ WWEWV8WVBWXLFPvRXUhkVrci6aL2q3k/xgycy8qafmEqr2N7OxwNcDeWaZBaxjHn/wpY95 sHZq5Lk0esJ+IPp7caU2iCgfuV3dYgwYZ1WA9Cay8WZd+bDiUm2foPyKSFT3wg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653194736; a=rsa-sha256; cv=none; b=M/Vz6kS6+22BCLhuikFT1/5TXEeFd6ipvXG0uHN4HDUwvXFh0bysXF7z3WplOGT5IoS3rp M8e6+t7wwqLU2egJDl9Uu7EYHIoWl858HqQNxEW7hs8PT4RnvsZYxEoH9k0l8NwfdC/zyK FV3EeFBlCXVGDwJjjoDM2iEv9mcbGhy1hebMDVxiRjwQgFWJ0ZlS1nS6S5XyKOou+JpO1F VkkE+iBbFk3lqeuIM6S0z5XAVAI3seO5LyBcqYcWQ4ChBuRLFcfvvoDPuZA7EPv5S7k87W jeUBc9RQ9XJzAbrRRFYVkpZ4q2juk6lIoIuAAFRkeymQPxmQ+vWn0bRdP6kIWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #2 from crb --- Created attachment 234106 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234106&action= =3Dedit pciconf -lv pciconf -lv --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 04:46:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B2D711B516E2 for ; Sun, 22 May 2022 04:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5SbT2ZYNz3KDP for ; Sun, 22 May 2022 04:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3907C14D90 for ; Sun, 22 May 2022 04:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M4kTGJ070908 for ; Sun, 22 May 2022 04:46:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M4kTYW070907 for fs@FreeBSD.org; Sun, 22 May 2022 04:46:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 04:46:29 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653194789; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KSrE18RceK8/ES4R+NzHzQt0Lo+HvlRtjQAGQoWsSuo=; b=rbT/qu+gUdw4TcdVgfk9MyUUkvJxqjlq9PhDlikGJmVAkikp7m7mzGFwHgAilXAcf2Jn/r sBVIxqA+AQGD8joxph9UY6qs6xhKU74dQEdqC0tNc0C8O8wSK+0QuRofqxPqJKYfL6ufzZ ZZ+erqMhUrOLuviAdjX+uKfUC7+cGSslViYlznRsaV4X6SFMMJ6fisms/yjAwNanyIsvBw zVvAdd3AAR6TD41sHftwgKvJ8jbxBddaSAbDFx2xACAGEHFOT0RVbitC3QoumIIN2uCMY5 Z68kMWVI9wj9gKqkId80noBzvK0PzAUAeaFZegjk41lNTo1tyl0iWY0dSXHPvg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653194789; a=rsa-sha256; cv=none; b=wSc+f8hPexQw3OwYkrnc5Ua6gVI3z9MLNOTwS4YOlQp0ygYRlLqdawkApaHHoiqzBMQBsu sMfZ6B8wx7NWk1HY9rsGDwvLx/XKEURofEFYRzDO44lWvnKQeEeiOw/ofkAh7xLAbCMtig lniQcuJTXablHkqyxstISOeOMC7WGkHH/yS0sBK+e/rstQlQP8YVG1L7QeN+mDGdcyfB+6 B3iA+L71U+OWXebFy/zYq/y0yqd/psNRK9keHn/+xtBaOnstpj86HKiQrhY501sFckF9s6 aFd/QpMliFOhX+uTSv7mOCZ3oEH8L0S/MgtuZH9OXDrABrVro3wIHQlkgURCWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #3 from crb --- Created attachment 234107 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234107&action= =3Dedit dmesg output dmesg output --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 04:46:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B04F21B51960 for ; Sun, 22 May 2022 04:46:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Sc11nHnz3KX4 for ; Sun, 22 May 2022 04:46:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 15BE214A55 for ; Sun, 22 May 2022 04:46:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M4kvb8070991 for ; Sun, 22 May 2022 04:46:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M4kvYG070990 for fs@FreeBSD.org; Sun, 22 May 2022 04:46:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 04:46:57 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653194817; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=glt258n0/sviXdt/ZD/qOa0dEvchry4cxrbQyNnArRs=; b=VoQufa+GcdH+lXioQz816C+FQ7uvcL3ihng2BsBmjijsM15QQ1+Tgqk3GeNkl1VBkSXglI 9uTEsSEV6zbVsCQESBfH8haD13i3wPNr4TKM3+jvFZdkvir7YgmV4iO9TLebIKsNOran9t hQ8IsruiOAVBMlITrIGYzR82prSJ0esxse2RfG3+z6k5rE/9c4VuZ3bGztDin5UgwO02zS CMnbmzif7yku0dIBOS1ZkHHsCh9tbAdGH07aVZh/nWlnQ8o4RJqsEjw7stFjiPTz2QyyLv MvOYbWZn3fUu2sM0S5tqCV5r4sAJhG20XblHxFajRcFMpoGLptHikODxVOwewA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653194817; a=rsa-sha256; cv=none; b=pAxUCpR8BsoXJgIJn/oYW5zQhCEsQ6Xssm6wqC8zsW1XOIK5feht3FlXOOKqxwqhlp+/z3 sChPcWSiGs7BVbr1tdY6HYo5olqR/2zQbye+ln800og98iyH14PEGgIkm4vL+bOLdlL+sf kDk4rdOJrFiAxQHs4FBSiMGNp784On7HXUD33lJMi8Xjaz5DrMWSZH4msxqGKR6Bt6Rcs6 jp9wyKMe9P1ET2fa9JFY/KG5EIx7KeIXDAupAAe5wFA704PqFzoh0YKyLNle44KPOvRiNc G4UV3JB62LrRb6D8xnPf4alBGmv3gPm3PoKZ6dp40gZMRm/HuUBmp/+4Qi90Lw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #4 from crb --- FreeBSD eclipse.ChrisBowman.com 13.1-RELEASE FreeBSD 13.1-RELEASE n250148-fc952ac2212 GENERIC amd64 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 05:03:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D494C1B5512E for ; Sun, 22 May 2022 05:03:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Szf4sSkz3MC7 for ; Sun, 22 May 2022 05:03:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 86F4915359 for ; Sun, 22 May 2022 05:03:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M53wwJ081581 for ; Sun, 22 May 2022 05:03:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M53wdk081580 for fs@FreeBSD.org; Sun, 22 May 2022 05:03:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 05:03:58 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653195838; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rWkDCDu/AUoXBxjxqD902mXUinWTJwPEjKVf8SXntxk=; b=q8Hyt50J9x8VyQuZfnbCLV+/7jJ1+9KpqErNnoXNRnQ8zw5wWHZymDVf/S985Ke52zxnVM OfVoP0vs9BVd4w+v+wNX2IfOILP3ImqCxDY1CTsIyki9uCtPsHYWLLHdaIIzvdbfEo0KIj CyTRPfu0+/RfnL4KCeBb+qrrxXpP/P6zfOhJq02PH8gNsA0AQN47pfnDwo6TtKVwvV8dZk GYV82P1lLh1Cc02ULwGQ5FFUzJLgtNlT8MEG6gOe5JB95i5W/3eYzfh5EHCNwLPoRAehCK z/e9NDKnxt+GhMmRzX9tlUEIg0aSAELLLuqqM3WHuoTFdEcaCxtXfiJsNhj3gw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653195838; a=rsa-sha256; cv=none; b=U27smdw82LK1tImWxqUm0uT0jZXr4W9b7Fgcu9JEnDOyUM1c7GUWur595ccXHkVlfY+m6N sFHk7A2s5na0H6/fp96J9YRjzJvrrtqYP4ygYvpQzOUnJLeDh6tnwQsmWEm2PoCrQbOYro hq7zQKVlxRsgibLd47CbvvsTOeeS+G+fSWeGxUtw9xH2aEgNpuIZOPRzrTHueQKa1brlGQ nYs6SQeYu+o7iIepB5EjKQFqc9xhMddJB6YjSgEXpHe8d5QSn6RijNTFa45+Mw+/sCNFsB rGkYNa6kgDk+qq7zbl1VtZrG8buja3kT8Mw9NtVf7zVCuPe1MUmJeHmRggQekA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #5 from Warner Losh --- Does this happen with nda? nda will retry these things w/o failing them up= the tree and so zfs won't have problems. Perhaps nvme should just retry these I= /Os a small number of times instead? As for the nvme controller, I'm not sure much can be done: We're detecting = that we've stopped getting interrupts from it, we check the status and find that= the nvme controller has failed and we have to reset the controller to keep goin= g. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 05:05:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6BD631B55581 for ; Sun, 22 May 2022 05:05:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5T1J1PNhz3Mch for ; Sun, 22 May 2022 05:05:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 105551535B for ; Sun, 22 May 2022 05:05:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M55Oho081829 for ; Sun, 22 May 2022 05:05:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M55OiH081828 for fs@FreeBSD.org; Sun, 22 May 2022 05:05:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 05:05:24 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653195924; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dGhP38gB686xsWxVJo7CO/WfcWNnFk324f86Bb+6GVM=; b=j6ZnAmfvKW7H+3wzfCbsgswWl8IsYFtPt/+zvnSewbTjmxPWThZp1IxvrNNZnQJFF17YDO Qfg6E/6OSv9MwsSyYrO2XS/ow6f5pjt9EfNi5VcUADwjBpddE30uFPm9ut9g9a1KpDmh6A r6Zg3EaWpoiqjBfMItvul7+epkoN3Fe3AhoUnkdbX2Gk4QiNO0+Sjubpv9dHkvce9I0+Vg VaH1vGCILbg80czueiqymjmoa56T0EGl6joNpowuZ/R1yzoYeuOcYRjtLtdELyjIh8vBO4 IsNZsGNrJ0lAbk0SfZff4chsbqPpTCZAhkJVlLHPqpPhDdq3TWq2ldLWgLkJeg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653195924; a=rsa-sha256; cv=none; b=uZnGuBtKZ64b6BYl8X5esr24Na4w7klAUz8+RcDAGDPKWtXtPiZW4aIdWS8PWBNax3DPSx 3xF2zN6fzCpVqF1eQmY4pDf1X2hsKAq6G9KOGu3ATggeFCZRXpeOjYdKEentzCwXrY8s6Y 2Yd3YDNRMJajkOwxKxwjZiP4qh8ulsIJIg5JFS5qq7/CKfxDOOD3GKy4T5R7p1ER31selI waWDq6TpEWFwF5swOOdGWtk/3sIYvx5hK9JD0TJTm9Hgri3nnrvxBirbHAxVtR4rha529R v8idmCEpn9WawLP37VY/Q489EEYc6IaVVUArzHi4/0IPVsJzjrsfe7JwhCz5jg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #3 from Warner Losh --- Can you send camcontrol adaX identify and send the results so I can add a quirk? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 05:07:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DD09D1B55837 for ; Sun, 22 May 2022 05:07:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5T403lSjz3Myh for ; Sun, 22 May 2022 05:07:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5D9271521A for ; Sun, 22 May 2022 05:07:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M57iKw082186 for ; Sun, 22 May 2022 05:07:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M57iL6082185 for fs@FreeBSD.org; Sun, 22 May 2022 05:07:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 05:07:44 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653196064; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/SHaJ73d+hvA0wc/r+wNVjp9w75zJ3TJqTec60lA0yM=; b=Bup+o+2k95wV8qRn4n4/NM2VOW6RU76YOFXpLIfOTrgAQuICNgVBwwXyVagjtQiu3KY3p7 bjjY5iu+Ra5ANPeqcNaQ71pKaZkUL3ct10AnPok04PHMOQvmYGqTFqJjEwgQJI5EuUWt1M LA1cRafoE1g7UoBspFa0NRj9y6vyddqM+dEbRki1qSnNo2DZuATR4/ygEj8NHzsqZ5YxKk J8thssPGshyMc05eLs/56StffH+ear114L9QAsFy5TVhvO/RG3LdgJe0bes+9ePzTd10b3 h9olXiUQ1mDbkQaDjYdH+5lfYNQhJB1m9GSt3u5n4XttCXjJdYVT/bvK/IOwPA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653196064; a=rsa-sha256; cv=none; b=t+AFynyDcLap+I+lexe/8FF/vtNjZkg7j10jXccBnMrlsFO6eBpvXwNZfFONQnW0T8lGKm TrSbyp2q+V3ZnJIOaUuA1y5J9ejUHKottZeMsrdH8g7FF+2A2GyB8MfEaKKUZAqSOLtS34 +Gw5XAlGwY5YFd5TBNMGjvvjZ0lPaBEuHWzeTp8/5s3/sV63IH03ESYzi8IFVGxf/yVSZS OYzjWsRPMJb4w8GmUVNxf4Nd+QfVdnUOkvz/sSDlmn0A0mkx7aFJ9M+AnSeuFq0yxGARDg hfCe/y9V8vwAqFtoNgDWyfiDdfD4StEbr+CQKpAC++A0f0Bh++lQVqOKCKUXyQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #6 from crb --- I'm not aware of of nda. This is the system that the installer created. I presume nda is some sort of alternative to nvme? Is there a, not to diffic= ult, way to convert my system to use that? If so I can try if you can point to = some instructions. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 05:27:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 058D71B3B820 for ; Sun, 22 May 2022 05:27:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5TVn3Yyrz3qDn for ; Sun, 22 May 2022 05:27:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2C21D1554B for ; Sun, 22 May 2022 05:27:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M5RTlC090857 for ; Sun, 22 May 2022 05:27:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M5RT1w090856 for fs@FreeBSD.org; Sun, 22 May 2022 05:27:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 05:27:29 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653197249; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UyGkBjPT4GrjcqlOFUUtuQfRZLZCHPt2dw/0AEZLH2s=; b=qKbQUc7n5NyG2rP5rAcoeBFTOfxM2wekTeu4LkqqXe/bb5OcuKPQUJ/LrAklsdIuAzkYGO SSIJSqUwcxt7TGIfe/spzzxitFsvkynujXTuYvDvqrp4J63axogv1WiHpMUrD5AdFUNNWZ +wmzNf80H85nh7opsT+qalBgkOKRUCtOXTPh1fgg9unjh2pVAyMkWF+Dv9WkasIWkeDJZR s3k4+bfEDVk5g8q3aq2Edppx3o5a66pOFXuABor89TUZkpjoBJSXYpY8fRTtVbEtDwIi0/ omWXowHVi/EAMFd31HLrKYkoW1MigLtbuBiH+L8MdxYkDdjAHiYrgCPzEocpOQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653197249; a=rsa-sha256; cv=none; b=at4OWo+Kd4Dn8Df387W4xWxkaLhKkERqMkt9koC/k9QgOs1DzEEOaOrtPGh7g4q/OiSYxK BY7O7vMmUS373ze9ciI/a4U9Gcb8re9bojo68zoSUKuc6hvaIpfTUW6CBBtZEwgFTIlXKK 44WE8NIolktaLkElXVVMNKPlC2LXfc1P9I8qYth+e2a4OCINDHs0ivUAeJJjbBH/5tVatz r7qrg81H761fl46VImQhJBmmbhV+kMmW1DZbpj8fXzerQYOKvbRY7Z2qJnV/cOh1Tztcj8 RDDeAnif3PBzmlu6Le7geAt8Rk86XIUPgJZHGSQoZr3zhuynseloeWjkTcKxeQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #7 from Warner Losh --- nda is an alternative to nvd that uses CAM. Unless you need really high IOP= S, nda generally is better than nvd. In loader.conf, add 'hw.nvme.use_nvd=3D0' and reboot. We provide a compatible /dev/nvd* that points to /dev/nda* so almost all us= es of /dev/nvd* should work. But with zfs, chances are you won't notice. I wrote this code, but had trouble driving the nvme drives I have access too off the cliff to test all pathological behaviors. This is one I tested in simulation. However, looking at the code, I fear that this workaround likely won't help you. The message happens when we fail the controller, and that seems to be happening when reset fails (which we should report directly, but apparently don't). Do you have issues with the machines being too hot or having poor airflow o= ver the nvme cards so they get too hot? In general, FreeBSD (or any OS) shouldn= 't be able to schedule so much I/O that the card's SoC controller fails... At least not in a repeatable way across multiple drive types. The 'possible hotplug' means we read all 'f's before trying to do a reset. If the card is= n't there at all, we'll timeout and fail the controller (which maybe what's rea= lly going on). That suggests power and/or cabling issues if it isn't thermal somehow. It would be good to eliminate these possibilities if at all possib= le. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 05:50:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 04E3F1B3F910 for ; Sun, 22 May 2022 05:50:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5V1F1Xm9z4VqP for ; Sun, 22 May 2022 05:50:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0F16F15B36 for ; Sun, 22 May 2022 05:50:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M5oPJW002711 for ; Sun, 22 May 2022 05:50:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M5oPwp002710 for fs@FreeBSD.org; Sun, 22 May 2022 05:50:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 05:50:25 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653198625; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HRpGUWsfIjnJj3DarTHMjnljd2w9MZAZwVv8vAwxp18=; b=TceYOb4AqZy0N8n5Ern9UAfNvc4leSBMbCbMexXDKTYe+KAUz5o8TpwSs/a6a9ZYHiIA/Q WMFWFAvKjgihC6ZeP6Ulnc4ZLPxwq8u9lQUTjvw8zs+a8X5qMs+zYfgkD7jDgdXP9DGU23 4jk9K1A/elxlX8F/CjehHzqDOQ02cb/riKoCc4uiHgvI7keoO40KqWMeYzbp7VaakzPRLT qvtvYwC3Yb+aI4OV+GvIFrbmN9o4RRtoy3oE6Fxf8I8yTUfBcIxwa1mrzHvCpXwVr6hQ0Q dXHvF2VfGMLEQLoUHVYQgpeGdon6v/gUNzgwppyF0oBv4tXDI1nHUnDyFllI9Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653198625; a=rsa-sha256; cv=none; b=CBnvLJV3UAP+8213X+OCfz8EJ6ALu/6MsKe4e1kymQ6dC84INjKOdjQ+I+s8VIoFWqZWH+ FZQwl0XzprDrDYR0FuS5huBpYRCDgxL2wod8eJ/4br7JQpBq+nCSoMfUeJoNpewArJ0PcW Wjc0RjkjxknQQqUeP/h+YWk0g/6UlLZ1VDmP3X8XAt7Iv0S0Bcxhx751Kibxb6Z2IxlH1S RjPUxQUScT2UWDbKiY1JDT5xUiANwlU+/YEijhFolhYEe/+dDVV52pr6FzurtqZ5xvWkvB 0RBWf49jnEz9vPy9jTzIC+gU+pfPwJ2MQo9HZZMvJnHof9fVgqfIFoq0Ty1aMQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #8 from crb --- Replacing nvme with nda results in similar looking messages from both nvme0= and nda0 (theses didn't show up in a remote ssh session so that I could cut and paste them). I don't think the cards get to hot. The machine has 3 fans that spin up wi= th cpu temperature and as I mentioned earlier the card has a heat sync. When I link while building world with 32 jobs I do hear the fans ramp ever so slig= htly but mostly they're quiet. I doubt it's cabling as these SSDs were directly inserted in to an M2 slot = and I seated the last one securely a few days ago. It could be power, this is a bit of a hacked system (I gutted a Sun Ultra 40 and replaced the contents with this reusing the power supply) but I don't h= ave a way to eliminate power as a possibility right now. Theoretically this sy= stem should be able to deliver 1000W and I only have the motherboard, processor,= 64 G memory, the SSD, 2 ethernet cards (one a Mellanox CX3 using fiber) and 6 spinning drives which are basically quiet. Power seems unlikely as the sys= tem seems otherwise rock solid with load except when hitting the SSD hard. This (unfortunately) seems to be completely repeatable now simple by copyin= g a couple of repo over 10G ether from a remote nfs machine to the local SSD wh= ile the machine is otherwise completely idle. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 08:15:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9C6651B3C885 for ; Sun, 22 May 2022 08:15:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5YDN1w6Zz4pwr for ; Sun, 22 May 2022 08:15:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1C481178F9 for ; Sun, 22 May 2022 08:15:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M8FGc6083906 for ; Sun, 22 May 2022 08:15:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M8FGMQ083905 for fs@FreeBSD.org; Sun, 22 May 2022 08:15:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 08:15:16 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653207316; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9Ig7J5LxLfRRhagLFJjsmo/R7N3PpYNKZP9Y5bLpkpA=; b=yc+RUIIAvjo8ctCWKkeW5JZ4NTEjRd8bQ6mfUbpo2+cKUgM3LqsBsN3lLWtG5hGkYEvcM8 cXVEO0IZhS3z0MuwdP4mkh9jYKwUnr7kDFuBPr2r20tyehEjKzaL7Sw5c9xSuRVHIT/Chy Rh7QuAjN42FF53aV7QvVTQBl2GXLBkHZWjCSuNUtbR0a305acX6daA3K3CJLv49FzfmCXE 0ZAPyCp57w1raGC2z+TyPL2tmBw6nq3SY60N2b1HXwo5H8uzfEEjGs1vZJGFz3iml1pTrI ws1HK/L2atfJYA//33fMSjhH33aVZCY/2Rbtg3VICqEw7SNbx8e+RHgqXKqWNQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653207316; a=rsa-sha256; cv=none; b=yRseNfL7MK0Ron+Mo0qJMiwH2Ier3GRBvOOqsrRvi6g1Zdkx4+sA8n4YqfUC5ZRMYmq/sq e7gqYaM0gg2MXbrhxzTNhK7L6A7bvly+5r4kFlxwFEfmmaWIgHH8W0Z+TS9dkDQ+ju/idA wCNiGAIlR/sNddjv2/2f8hhQhUyR/Vx32QKc3HMFJGk0WBLT/43fAYi3ON8PL1QTC9EnNk 2yNSpToef8xnjbesny/6JyjB7MNWFsf5VNHB7D+Uea7LCpfDPLp8bgi4C5L7zmRZBKJ0iQ 5SeNK/teXlsA+syCi3KkiFAiUCVmMMAATdxnzlt/7qA1oC3GGb+RgY+OzV4j9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #9 from crb --- running: nvmecontrol logpage -p 1 nvme0 yields: Error Information Log =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D No error entries found root@eclipse:60> nvmecontrol logpage -p 0 nvme0 nvmecontrol: get log page request returned error root@eclipse:61> nvmecontrol logpage -p 2 nvme0 SMART/Health Information Log =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D Critical Warning State: 0x00 Available spare: 0 Temperature: 0 Device reliability: 0 Read only: 0 Volatile memory backup: 0 Temperature: 311 K, 37.85 C, 100.13 F Available spare: 100 Available spare threshold: 10 Percentage used: 0 Data units (512,000 byte) read: 9999 Data units written: 1527715 Host read commands: 440839 Host write commands: 3023543 Controller busy time (minutes): 7 Power cycles: 519 Power on hours: 166 Unsafe shutdowns: 518 Media errors: 0 No. error info log entries: 0 Warning Temp Composite Time: 0 Error Temp Composite Time: 0 Temperature 1 Transition Count: 0 Temperature 2 Transition Count: 0 Total Time For Temperature 1: 0 Total Time For Temperature 2: 0 So I bumped the case fans to full speed in the BIOS and looping on=20 nvmecontrol logpage -p 2 nvme0 | grep ^Temperature: in one window while doing a "zpool scrub root" in another the temperature doesn't budge: Temperature: 310 K, 36.85 C, 98.33 F but the machine still wedges --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 08:31:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 847B01B3FA26 for ; Sun, 22 May 2022 08:31:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Ybd2VGqz4rSs for ; Sun, 22 May 2022 08:31:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3663817ED7 for ; Sun, 22 May 2022 08:31:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M8VvDg092082 for ; Sun, 22 May 2022 08:31:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M8Vvul092081 for fs@FreeBSD.org; Sun, 22 May 2022 08:31:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 08:31:57 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: freebsd@ihead.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653208317; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ML1T1etj+6d5uOaO/Qo9u2fwOj8kbEUgqMuidUcPJ3Q=; b=sUpHsMCM3Nsw/UKsEQBDl0AT7Q1Jns9Goso0fg7sQyUdl49pH0tryVgjf5uATe91Q89NQJ 6O97F7BYUyzo6Fcd8RD65ZYOoNezQ0YeF3w0M5C6F6nowW+XbJTJ4jHUxDkpTbni/VnxUe 8gvNorNbwRf/oDlCoYncGrj9e6rSYAe8LJvZ9nNf7Xhi49zhKKKF9/3HEB7jT/vPrLICij AM2+O2vHgyvprKLRsbkuo0G2G2b8SRurYP0VWqSG9NzNDMEUhgOqjGJBB4fy0N01dBSLhq c9tq/aid1xuEJXP7fnYX0hMF70XGID2x337IgqDyfIq6SB6d6x78R2WJWHUmHg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653208317; a=rsa-sha256; cv=none; b=x7cR5y1ab7m3YLw5cNL7Gijs6Nx6OnLioJrTELcE9wNQyQlBcAT623OB8VXMCQplrYY/gt fV/EPTAarbjFHcF2pgbCc3dfB3gVG4LFnucshiZlfOHPECSB9QzzAQb38jtqvOJpIvOoFq qiGbTHevkeao18vZOkOVlnUa5C7AElUXgrxW4xFEXldT0e80IPa4outHgEX+VDNQ/lwIeZ yraF3JF+SPOf4GljelAjamP5LIqE5jr8gBUXMG+P3ciurfCon9aKjQ6mWFc6+wOvd7bEB/ 4152giVl6YgfchqPn7awm5hP8AnTnjoU6tdvoR6+3PKYQlkWnlk1ANWEWDIeuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 --- Comment #4 from freebsd@ihead.ru --- (In reply to Kubilay Kocak from comment #2) Workaround is: kern.cam.ada.X.delete_method=3DDSM_TRIM. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 08:37:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 37A661B40AAC for ; Sun, 22 May 2022 08:37:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Yjw6y7lz4sLL for ; Sun, 22 May 2022 08:37:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CC07817EE7 for ; Sun, 22 May 2022 08:37:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M8bOtG092993 for ; Sun, 22 May 2022 08:37:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M8bOeP092992 for fs@FreeBSD.org; Sun, 22 May 2022 08:37:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 08:37:24 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: freebsd@ihead.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653208645; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XvEbjWG+vREKraIExxBpRCVY9YzOKfTvKm6PG/WAKUk=; b=p0SfRBPGuSOBhI6o+bE/YFN5Z5flI60yy6RgFVHvvlKtUQBdJRoEDexMsJ6ybNViI91P9J F/avFXWCWwQ/4vi2+7Iuac3QOiWd59b8PNW4gpo5201iuxfe1U5QgYqJJ4N8Lyd2FOi1hD NeLnYxBjtrfmGijm2DmIW9RijtK9KN5jvN84CrNHRVXIcewWwFfQiViXVUPH7FYcruxPvO MurvVrhW6kPtkmiT54G5y2ESbi+ST7z/4MjL53eBmU1pgKw+wVcTDxVmG5gDdp8A7/Z5/e fZy4Q7j+G9soj47uNZidCbtHAG/gS302Wav38VdMY0BOMIcuwGaITSZPAc1rNw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653208645; a=rsa-sha256; cv=none; b=d8ipmqTIGCneXfJwkAS5HN5vPmvhsJhjpgQLj9m/mTeg+k+zRl65lQ/sKb4Uaw4ken9pYI 9FKAQj7vQSS7f/+xPhZy00JGlDmeeB9P9kQQ1hZgwWo77Xpt0qrML0oxZcjHVMxQH92Ti0 uLQtKb2GBWvi/V0s7/oEC6yn4UQAVg07qHcKdir0BhgsaAD7GX4Gi24oOMlAkpEI4DruyG HZ+mM8Z9TYBRQIXUGQqzuZKtwsPF019/KDGjhYb0Pqk42YVEPVqGyhTW+Z5UgRtFy78jMP 3JEyn7ip1umtI+JazCZ0Vo8nnFz1pSlyVzB3/tDVBNe4hMKd2WiQKcLgahLZMw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 --- Comment #5 from freebsd@ihead.ru --- Created attachment 234108 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234108&action= =3Dedit camcontrol identify --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 08:44:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 60B9A1B41BEB for ; Sun, 22 May 2022 08:44:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5Ysh1HXlz4t7c for ; Sun, 22 May 2022 08:44:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0885F18272 for ; Sun, 22 May 2022 08:44:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24M8i7f8097018 for ; Sun, 22 May 2022 08:44:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24M8i7lg097017 for fs@FreeBSD.org; Sun, 22 May 2022 08:44:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 22 May 2022 08:44:08 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: freebsd@ihead.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653209048; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TCjHSz8/TJqjTeGnSFQzgziByBkV//ho5DO91Nhymiw=; b=lNF65Tni4XLq+m2fbAaCF3YzA4NjjVyDynKJWShMHDgoCGCBSkkpB2j766wgATEJUBJCNX WX1zPpZukjuoNL2LMZthbHB2F9ylweEybyRVdSirt2i/3kjf5n6/CokssUsM32VqM2dbq8 0O2LQNG6C5iNeDnXuvC4KKAepHg/v9em8RnqhKRBLHvzJSjhEkCF7vJqJPUxzdViEsUvOn 5vEHsqKxlnp71F3xdF5kuvi/1ku3vDt1rYxONpITwcJt9O68+Cmgre/svOiJSkf+QDwQcu F5+HBk3KI2UX2UlwYRtT8oNkJplzFs1DKBKFYLfaTXCw623vCvK30KeJoSNCIg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653209048; a=rsa-sha256; cv=none; b=H2wslnykBQDDQdGggvXAZovtfoouI971vQTKze0pamuXjQ8bBhuB2hQpPQhP+2YyvbpB8d STabBxAR2OazIBZpInpNP+d6U5supL6TNK8jRevJ9bjlMJCHYkWz7Hce7EYF7STsMxDlXc TlqkgrBU9xM46ZjtnFfQz5HtgGwlcWdJmddSunDKR5pYQxtShwj8NsrA5anyaZLKY4B6+H hjSdkPEoaiM+ZahLVmJKuHXE40G5Oo99pmuURlHodc5XUsyu2tgwZnkIVKOnWISfcbQmNT wDoeN849Qot6h9OFXjJoNkgCTgDrjRyDKKSY2570gB1sG0oA5WgZboF2S3597A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 --- Comment #6 from freebsd@ihead.ru --- (In reply to Warner Losh from comment #3) I added the attachment ("camcontrol identify"). --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 12:08:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5123E1B39ECD for ; Sun, 22 May 2022 12:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5fPv0k1hz3r2y for ; Sun, 22 May 2022 12:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EE75F1AFA4 for ; Sun, 22 May 2022 12:08:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MC8oa5007455 for ; Sun, 22 May 2022 12:08:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MC8ofS007454 for fs@FreeBSD.org; Sun, 22 May 2022 12:08:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 12:08:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653221331; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fU/9M0JDw4+yBx3jYgXyU4sR+ycWxHvW+xfSr3sPfP8=; b=ijpMNJjtDzEpMuL2yTJEYWKFi+z92oAz1CHx99a3LooDD3tp1rzdeXYrD/uuA2i1khUgMx 5Eu9O+Aw1W2iCGV2gqqsqHT4Imp1p6YUY1lwmR55h7LWgaRyoDbk2wSwuh9wUrGIvZNI6t p/MCfqJ30+GCtr3E0IJFfoWFXUiXu/gc73r4U1i7q/KBi/edac1tJKSWM7MWvmg1bFjbO6 mghpuVC3HWgUmnMXj/n0nunCDFAglBs6QHDatH4P11Ip0gcSpW6lNZpqVGtQYLhUFXFbfv X3U1r0ilbzT2rVO6g9Ff1kwFinzWjnteu2QGv8PwXOSKBeUhs4FuArwDzEWiGg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653221331; a=rsa-sha256; cv=none; b=wuCidw9qEKUrUDbjzWsmIWdU+DUHtPTJN1PuE2atU3zJiDcg1qhw962okBszUh1GU5G7X1 PjbMMJ+oLMGU4v9OqAekLJ+gPYyLJzM8AQpbt86hmek1OXWOJvY1lJnVfkui5VKyY8yfkG v9aDdhJn4NWrHu23L4kB2PNdxS2q6WdoR6S/kaLi9EsqEXyUWh5IUuwQqWnCFzg/qCz7sL whydxfyEwOVEXvOIvYgk9aQt5e4hYn0NmDPCS7qI8C05OoFrCo8Udz02b2ElAysMeWCQ+Z 4EgNZPvVw2jrcm5LYbmMmQAnoca9PeqH1X07m8ykj897jcO03mzXSlsXM2JyXg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@gmail.com --- Comment #10 from Graham Perrin --- (In reply to crb from comment #0) > =E2=80=A6 13.1 RELEASE =E2=80=A6 Do you have (with ZFS) a 13.0-RELEASE=E2=8B=AF boot environment and if so, = are symptoms reliably reproducible with that environment active? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 12:18:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1777C1B3C02D for ; Sun, 22 May 2022 12:18:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5fct6Lcgz3sBH for ; Sun, 22 May 2022 12:18:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B48CC1B077 for ; Sun, 22 May 2022 12:18:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MCIMoG014980 for ; Sun, 22 May 2022 12:18:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MCIMDe014979 for fs@FreeBSD.org; Sun, 22 May 2022 12:18:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 12:18:22 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653221902; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vj6gJII4SO/dnP5bMAS6cS/emKIgq5bS4v4SGoUA0l0=; b=dqHkV9otqxmsPICySVXgQyKVTUITtixGcD8wQ9CrG2XzW3LVwbvEnsi4nBx4G0nL1DWljt 8vJax3mi1njUe3vV5gR81o/SBHW8BOI14v1U4oThgmGYdp2TbInw40GBttONqocWWvkfq+ +n6/QnVvKjRQ0nr6eH8UVs24BX7h1IAXzhvtv+c4rsbKDJ7pS2esZkypO78vYMoHKSgnry wIM9nPaEa0voXXvxxzWDRN4jkYpxuorWBKk0PLPpHtqpjsMlo+nel9PAoSyJbXjn2adPR0 GgIZTvnr3U0wBcgw31KOC/le0WKD/f1oXV2VSYhTueW3V+oEImMMbr0SGJutEQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653221902; a=rsa-sha256; cv=none; b=GDtGi0rO5KsYcPQMabzApC4XxUAQ/dL9bqjCrdlcgzLluKbKtKQNQuGS+G5sL2YnQGXum6 oyAAxws0Tz7BTdYqsnx51c7wlt9do2oaI9O357NUooSbHcgjX0ug8v9ktvBPiS+XIwvfj0 Bxg+fr8DWklxY1GFcnBB38VO+wE6lY1r82sO3Oj9Yyj39X6HX0I2NQJrlqImraTZznvh9B cl+2SLJ63tyBV6mE/2N0RfmEVNFi/3vH0ExBki4JBs3zaHy7OwkAmrINC/7VergUJ57qL9 82G6AsbZw6Yfpal22vkuGyqKJ/+T6GWQloTE527l7o9V76KT66te11wVjS15Uw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 Dimitry Andric changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dim@FreeBSD.org --- Comment #11 from Dimitry Andric --- FWIW I always see something similar on VMware guests, where the root disks = are NVMe. "Heavy" load consisting of doing git checkouts on UFS, and the like. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 13:35:52 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4CC831AE970E for ; Sun, 22 May 2022 13:36:05 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yb1-xb2e.google.com (mail-yb1-xb2e.google.com [IPv6:2607:f8b0:4864:20::b2e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5hLX5416z4Tvl; Sun, 22 May 2022 13:36:04 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yb1-xb2e.google.com with SMTP id f16so21256813ybk.2; Sun, 22 May 2022 06:36:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=uvirHoJ8hZTuvjGTMqiv6oem3tGvANPR6TvTnTwYpKY=; b=YvPG3Gg2rrS182Ij1M0RR4X9VyrIvu9Ny+BSQ79sNMuococz2MyFN36Asfo/kcycDm TbeNBTk+RvIDvdt91mkkVL+PG3u5Rqzi+4+ZYAizqLylVpnl/cB/g4MKhqVL3Xtl6A86 oC2acNGjaWp6oc9N6nb+k5IiXCBBCgoMAATCEX1Wl/Vf11Rr3xlec1RBcfzwWXQuGM69 BL9ewQN6cGF+QJO087Qro0D18HTeMUlqkwMobpqGWgnOW55bnajt2GQFbIAqt80/4CUS Nv0WXT9Hkv2Be+sqGEaKceeGcUupfUEoeypIqw4Vcxs5dJz8sN/TOasamPxlsu8P7+Kl RFeg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=uvirHoJ8hZTuvjGTMqiv6oem3tGvANPR6TvTnTwYpKY=; b=2WPoyaRzR0rlwMv8W8ETssLO+X3JF+POOjHRDFp3TKZBO6ny4SnsOa9poS2yRSDqgT zBA5T2U9R+5Q1Coe3X20Pshfta8U1u7E+INDu5zKLyVUi+yu4ltGgzfZTASvvuaHMKZk JNJ2HdMZdkLkB2jNpZYUYAmZZlxctRlrkjiYDRN6UduOtxPIBBGF9POb6fK2Poi7JoQG IGHM3gYRgcE3KyQMPHdz+S9nJItqq0UAe1fi2Ci6ddGnmssojnaqNQ2OvBaZIkZb9q6s XGM1Q+FTzdpb8rXbUsKIeO425o17l1n0Ecjm2z6s8ywMXpKCMy69rD0qqC1uakMvFj8/ v/eA== X-Gm-Message-State: AOAM53140li1sk/51hj0uYFn1rhQulsE7ZnQi5/BaKLOSq4v1S2Zz9YB yQ7XQq7X6QZiY/Tj5kLH//46O/SrS9CBOdB0UZrm7TCO4tM= X-Google-Smtp-Source: ABdhPJzcOf0JcpvsoiqC+Ff2OWP9gQ08BlhCi2n08ix2al0XkqMhQSU8S1pcbgmUzVchLM9G+XI7bOeSFmWaP3tmhA4= X-Received: by 2002:a05:6902:54d:b0:64d:cc4f:111 with SMTP id z13-20020a056902054d00b0064dcc4f0111mr18351285ybs.148.1653226563760; Sun, 22 May 2022 06:36:03 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Adam Stylinski Date: Sun, 22 May 2022 09:35:52 -0400 Message-ID: Subject: Re: zfs/nfsd performance limiter To: John Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L5hLX5416z4Tvl X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=YvPG3Gg2; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::b2e as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2e:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N > What is your server system? Make/model/ram/etc. Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores, a little starved on the clock but the load at least is basically zero during this test) 128GB of memory > top -aH During the copy load (for brevity, only did the real top contenders for CPU here): last pid: 15560; load averages: 0.25, 0.39, 0.27 up 4+15:48:54 09:17:38 98 threads: 2 running, 96 sleeping CPU: 0.0% user, 0.0% nice, 19.1% system, 5.6% interrupt, 75.3% idle Mem: 12M Active, 4405M Inact, 8284K Laundry, 115G Wired, 1148M Buf, 4819M Free ARC: 98G Total, 80G MFU, 15G MRU, 772K Anon, 1235M Header, 1042M Other 91G Compressed, 189G Uncompressed, 2.09:1 Ratio Swap: 5120M Total, 5120M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 3830 root 20 0 12M 2700K rpcsvc 2 1:16 53.26% nfsd: server (nfsd){nfsd: service} 3830 root 20 0 12M 2700K CPU5 5 5:42 52.96% nfsd: server (nfsd){nfsd: master} 15560 adam 20 0 17M 5176K CPU2 2 0:00 0.12% top -aH 1493 root 20 0 13M 2260K select 3 0:36 0.01% /usr/sbin/powerd 1444 root 20 0 75M 2964K select 5 0:19 0.01% /usr/sbin/mountd -r /etc/exports /etc/zfs/exports 1215 uucp 20 0 13M 2820K select 5 0:27 0.01% /usr/local/libexec/nut/usbhid-ups -a cyberpower 93424 adam 20 0 21M 9900K select 0 0:00 0.01% sshd: adam@pts/0 (sshd) > ifconfig -vm mlxen0: flags=8843 metric 0 mtu 9000 options=ed07bb capabilities=ed07bb ether 00:02:c9:35:df:20 inet 10.5.5.1 netmask 0xffffff00 broadcast 10.5.5.255 media: Ethernet autoselect (40Gbase-CR4 ) status: active supported media: media autoselect media 40Gbase-CR4 mediaopt full-duplex media 10Gbase-CX4 mediaopt full-duplex media 10Gbase-SR mediaopt full-duplex media 1000baseT mediaopt full-duplex nd6 options=29 plugged: QSFP+ 40GBASE-CR4 (No separable connector) vendor: Mellanox PN: MC2207130-002 SN: MT1419VS07971 DATE: 2014-06-06 module temperature: 0.00 C voltage: 0.00 Volts lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > - What are your values for: > > -- kern.ipc.maxsockbuf > -- net.inet.tcp.sendbuf_max > -- net.inet.tcp.recvbuf_max > > -- net.inet.tcp.sendspace > -- net.inet.tcp.recvspace > > -- net.inet.tcp.delayed_ack kern.ipc.maxsockbuf: 16777216 net.inet.tcp.sendbuf_max: 16777216 net.inet.tcp.recvbuf_max: 16777216 net.inet.tcp.sendspace: 32768 # This is interesting? I'm not sure why the discrepancy here net.inet.tcp.recvspace: 4194304 net.inet.tcp.delayed_ack: 0 > netstat -i Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0 24178283 0 0 igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0 8447249 0 0 lo0 16384 lo0 367691 0 0 367691 0 0 lo0 - localhost localhost 68 - - 68 - - lo0 - fe80::%lo0/64 fe80::1%lo0 0 - - 0 - - lo0 - your-net localhost 348944 - - 348944 - - mlxen 9000 00:02:c9:35:df:20 13138046 0 12 26308206 0 0 mlxen - 10.5.5.0/24 10.5.5.1 11592389 - - 24345184 - - vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0 962249 102 0 lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0 31623674 0 0 lagg0 - 192.168.0.0/2 nasbox 27967582 - - 41779731 - - > What threads/irq are allocated to your NIC? 'vmstat -i' Doesn't seem perfectly balanced but not terribly imbalanced, either: interrupt total rate irq9: acpi0 3 0 irq18: ehci0 ehci1+ 803162 2 cpu0:timer 67465114 167 cpu1:timer 65068819 161 cpu2:timer 65535300 163 cpu3:timer 63408731 157 cpu4:timer 63026304 156 cpu5:timer 63431412 157 irq56: nvme0:admin 18 0 irq57: nvme0:io0 544999 1 irq58: nvme0:io1 465816 1 irq59: nvme0:io2 487486 1 irq60: nvme0:io3 474616 1 irq61: nvme0:io4 452527 1 irq62: nvme0:io5 467807 1 irq63: mps0 36110415 90 irq64: mps1 112328723 279 irq65: mps2 54845974 136 irq66: mps3 50770215 126 irq68: xhci0 3122136 8 irq70: igb0:rxq0 1974562 5 irq71: igb0:rxq1 3034190 8 irq72: igb0:rxq2 28703842 71 irq73: igb0:rxq3 1126533 3 irq74: igb0:aq 7 0 irq75: igb1:rxq0 1852321 5 irq76: igb1:rxq1 2946722 7 irq77: igb1:rxq2 9602613 24 irq78: igb1:rxq3 4101258 10 irq79: igb1:aq 8 0 irq80: ahci1 37386191 93 irq81: mlx4_core0 4748775 12 irq82: mlx4_core0 13754442 34 irq83: mlx4_core0 3551629 9 irq84: mlx4_core0 2595850 6 irq85: mlx4_core0 4947424 12 Total 769135944 1908 > Are the above threads floating or mapped? 'cpuset -g ...' I suspect I was supposed to run this against the argument of a pid, maybe nfsd? Here's the output without an argument pid -1 mask: 0, 1, 2, 3, 4, 5 pid -1 domain policy: first-touch mask: 0 > Disable nfs tcp drc This is the first I've even seen a duplicate request cache mentioned. It seems counter-intuitive for why that'd help but maybe I'll try doing that. What exactly is the benefit? > What is your atime setting? Disabled at both the file system and the client mounts. > You also state you are using a Linux client. Are you using the MLX affinity scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux system for a fbsd system? I've not, though I do vaguely recall mellanox supplying some scripts in their documentation that fixed interrupt handling on specific cores at one point. Is this what you're referring to? I could give that a try. I don't at present have any FreeBSD client systems with enough PCI express bandwidth to swap things out for a Linux vs FreeBSD test. > You mention iperf. Please post the options you used when invoking iperf and it's output. Setting up the NFS client as a "server", since it seems that the terminology is a little bit flipped with iperf, here's the output: ----------------------------------------------------------- Server listening on 5201 (test #1) ----------------------------------------------------------- Accepted connection from 10.5.5.1, port 11534 [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver ----------------------------------------------------------- Server listening on 5201 (test #2) ----------------------------------------------------------- On Sun, May 22, 2022 at 3:45 AM John wrote: > > ----- Adam Stylinski's Original Message ----- > > Hello, > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > at 8192, and I can hit around 36 gbps with iperf. > > > > When using an NFS client (client = linux, server = freebsd), I see a > > maximum rate of around 20gbps. The test file is fully in ARC. The > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > 1MB. > > > > Here's the flame graph of the kernel of the system in question, with > > idle stacks removed: > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > happening from the ARC? Is there maybe a missing fast path that could > > take fewer copies into the socket buffer? > > Hi Adam - > > Some items to look at and possibly include for more responses.... > > - What is your server system? Make/model/ram/etc. What is your > overall 'top' cpu utilization 'top -aH' ... > > - It looks like you're using a 40gb/s card. Posting the output of > 'ifconfig -vm' would provide additional information. > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > - Inspect 'netstat -m'. Denied? Delayed? > > > - You mention iperf. Please post the options you used when > invoking iperf and it's output. > > - You appear to be looking for through-put vs low-latency. Have > you looked at window-size vs the amount of memory allocated to the > streams. These values vary based on the bit-rate of the connection. > Tcp connections require outstanding un-ack'd data to be held. > Effects values below. > > > - What are your values for: > > -- kern.ipc.maxsockbuf > -- net.inet.tcp.sendbuf_max > -- net.inet.tcp.recvbuf_max > > -- net.inet.tcp.sendspace > -- net.inet.tcp.recvspace > > -- net.inet.tcp.delayed_ack > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > - Are the above threads floating or mapped? 'cpuset -g ...' > > - Determine best settings for LRO/TSO for your card. > > - Disable nfs tcp drc > > - What is your atime setting? > > > If you really think you have a ZFS/Kernel issue, and you're > data fits in cache, dump ZFS, create a memory backed file system > and repeat your tests. This will purge a large portion of your > graph. LRO/TSO changes may do so also. > > You also state you are using a Linux client. Are you using > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > Have you swapped the Linux system for a fbsd system? > > And as a final note, I regularly use Chelsio T62100 cards > in dual home and/or LACP environments in Supermicro boxes with 100's > of nfs boot (Bhyve, QEMU, and physical system) clients per server > with no network starvation or cpu bottlenecks. Clients boot, perform > their work, and then remotely request image rollback. > > > Hopefully the above will help and provide pointers. > > Cheers > From nobody Sun May 22 14:12:46 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 16B261AEFC0E for ; Sun, 22 May 2022 14:13:01 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2043.outbound.protection.outlook.com [40.107.66.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5j9737yZz4YJJ; Sun, 22 May 2022 14:12:59 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ZbM4ise+KjvbjopOceUBGsovrB3KARG1pOn13R3ho/6hodi3uaYucMIswj1fsEOTYI6Fa6i0elHM5ICS5Ut7IkAJwGC0ICH1mh38mgoWOfP96YL2HxeRgjdpkA9yIKPpe4PdHqBby9SWtH4cK+e64MlpkymkGKuzxf521Y2gVmQmWGpf0rMv5lUvVEJng+h1qpfuUGwtNJXtTnh1WyP9T0wdLCmZ+iJosdaiW/7qmnWL9G3IrC4mFafvOFz0LjM5ruUHDRCUIV57UFQBjwD+uD3NH8QDs20ttfDUr3fTdkjKlESVozHwqvY4eVANvGKnkONl+gc0VN8H/sX8s5yOLw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=UI4halNCCIOTp+yj2OqmGtPvASdYQLDyHqmTxpQ1z1o=; b=jTVim3HjB5HOJRNf/Uk4aStku7zw/2e82c5r7edW2RaTgTkUgxF1P2OU63FSGMmQBNbiU3ECHsS4FsfnP90BeuLWtrOfi4peywbXNLkSY2Bi1Ghn/pxvzwNnMNPpARc7zQZDke3wWv+wYDrsfCEvr+IB5oQA9CWgZ9AKieWmxmjQaiOM80ZJ12rI9cr/RExdJZj68Z+x+iP/zrZpN+ScRnGhk3a96PYPpOM7INjPFQFvl3VC9c4tvATjjBJns+9BnxGl6gWOP1NQ8m4k6lAuc5kpcuC2E68/QwoByXhL1QDspteFeWP2rFoipo72mVIZBfm3wRJoO7+o3xeoS/DI9Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UI4halNCCIOTp+yj2OqmGtPvASdYQLDyHqmTxpQ1z1o=; b=RjW1NrVpsqDYOGlh8nQSV+hYZAKJTKikKAZrpMGs0evGQBI8oaY+Ip9Cz8K/zkyokuYMuEcM/LeqV6bGlhGkhdiYV7GbDhCmY59qMw24/+veeWtt8Jo8nZISYxYP4iauxcchMO7e0798T1iwZot25FaGkcCuOoJROZUVmIAlH9m1hvn1uM80QkDIA15RGQanaM0tb5pjf95V1Zs1Mn5ofQI0PHDX/RzCMTzWaxNtZgfggyd1sBkxnHe7qYsSVW8VP4f//EYpO74rl2O1I3uqplaiYEt+Nlzg2V91Q2psMBDjwmf79FEs8fbiG+1dyQqhL18noFj2F6TFBqV3d6fTeA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT3PR01MB8561.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:9e::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5273.20; Sun, 22 May 2022 14:12:51 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5273.022; Sun, 22 May 2022 14:12:46 +0000 From: Rick Macklem To: Adam Stylinski , John CC: "freebsd-fs@freebsd.org" Subject: Re: zfs/nfsd performance limiter Thread-Topic: zfs/nfsd performance limiter Thread-Index: AQHYaxQfJkENgRkWo0q5KjKiS/ePTK0q68g+gAADxyc= Date: Sun, 22 May 2022 14:12:46 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 2d92e1dc-73d2-e8e3-d262-8680d99989e9 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: a6059930-a86b-499d-b21d-08da3bfd2584 x-ms-traffictypediagnostic: YT3PR01MB8561:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: lQ2MebsyBRL62HLi6Ntl4bsI6BN1oQN5VEBnX1Zx9x8mz80sWQ2UVLW48y/HyAvCwS0hXptkrs7FE+mdCIEKhy+6IFzmhVtGs314eWj8yMIT3c8QGccDmrvrTGkLqMW8AAcgHzmzYBk7TXQe7OYM4xR/fESbl9S31huqpwbqH9FDOo9f46QdDTr/XqYFp/wD2E7elo5NVLLRhCCKeCQ+P4IW/382ql1k08NyMQsx32K4NqdZwk5F0OuCUlrSt707zYmMkwVFaPe0xMB32cAl+JxrKWYaTDM1cDNzUHfPG8WJyqNqajTO54sn7BYqLPvrV8MlEMJx3HEso5ZlCGhTd4KD4M1DjIXjI7RpfY072OMRdHj/mrzMJO9Yg1Y/+W8+YStI+nCVD7e6bHqtqVgnXQ5G4QdU73fU0VKRP3m9B1b2O8nVweeB4y7OyJVK+37vN5ziuEyihCEMDmupQfKPsOBZ6nn+of/E6BSbZZLPmG6gwH1KcLWsZcDaoMJbQhFsVXVKC/7fEdlN4KvsOBhVhsrm1UhGpPVx7usuaQcqjs0cIBamY2wfLDg2Y9bJ5ReZNYCD0aG4Pol1BB8UmBdSM3j3re9rYmgK2hwboOPrAQV9m//+RRgISkF+I2XOI8rwgXUba3Lg02Nl6ysK9gQaLzYrcRLhMDcfiyLyOBiVysNbZeoUYZZolQCjg315SB3bnJIYkJheoj5PBAdHCn59g5mFt4BpLTqJctNJzQvVEDJh6FsdjzEeR6Wfi/zksXf7a5urBkYVqv9vL0Jz4n+xLJ92gUof6I+738i4zjmDPHk= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(3480700007)(122000001)(186003)(83380400001)(8676002)(4326008)(55016003)(316002)(110136005)(71200400001)(64756008)(66946007)(66476007)(66446008)(66556008)(38100700002)(38070700005)(91956017)(76116006)(786003)(86362001)(8936002)(52536014)(508600001)(966005)(7696005)(2906002)(6506007)(9686003)(33656002)(30864003)(53546011)(5660300002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?IYsVZOfJcOcN7/qz0CmZ4ohEZZEUa0wZ6XBT/UxsdKrK/ORM8bzI3qg99V?= =?iso-8859-1?Q?YPJwh7QsrLziYTHUJMAMMRFKu3ccngmBqD4AYmJ4TxrJr2wSdUCj9dTdU7?= =?iso-8859-1?Q?TeP4jLz7GK/i7Hrg1mJwZcIMgzh9mSvf1dcQrtl/2AA64y6g1d+dKUtjni?= =?iso-8859-1?Q?HyelmEo1IP64J1dgYpHt0rZnwNbVlrXMNFjCUtJPmMzVcbJuVq04Qm2B9V?= =?iso-8859-1?Q?hP/SXoRE/IZSSzyXadj07FXDkAjKIuDuvAprWIp/mf6sYhr+zDj8xxSILC?= =?iso-8859-1?Q?7+SGu0AP5NFa8cr+DBOU9C3/4lOOs6KW4KD9ryk5Q6nzZVX2djjOiSAS7d?= =?iso-8859-1?Q?fZ/gh2WcIgP1RgQpOoqfz1HhwD+x7M6y7PgzVSJH3sfvnqJW9PGK+u20t5?= =?iso-8859-1?Q?ig6MMjVbQD7oeRW//9pKKTfeThZvVybrvJaVL89YWTwb5WU1e7xDbFY6QA?= =?iso-8859-1?Q?F9WS9VHUwonSOavOT9u9cIT4Rq8bmLbx8jTq1548lrRytg1wkNBN03qYau?= =?iso-8859-1?Q?kCEmYi5d6hUgpll8lzuaMtRK4/5ljgZiCYs8hdjA4ZQ2Z9Uv/KyvvFMaMH?= =?iso-8859-1?Q?butfq/v6LED4KByVew/ftv4WPib6LrZO/VuDEdsmBXE7odX8Rs4Bkj2wjg?= =?iso-8859-1?Q?VzC13+NXBQ6DbumTo3xJrQr9EMoYJMtdKp2o+x+N/S4o5B/ivOhg5ia5zO?= =?iso-8859-1?Q?Zfvjkx79db/MaE5IUMBmCf0Po164Bic4/Z00sQ4WFqe66KYAQm2Tcoe+M0?= =?iso-8859-1?Q?S2OJTgpA7yiwQDpOrzYEWsey6eVvEUEilbUrx/rl4u5OHl8D63mJjuhzBK?= =?iso-8859-1?Q?H9qzMddg3Wy17P+iMSw+cCDC2VvH0pVa9w9f/3t4Bx+omdc8MVO7kRvKXy?= =?iso-8859-1?Q?io2LynLTLWuLU+EBEw/eWYcOjIGy9/viUJZsmfQoMWZlUAQ8ebr3SJE9xU?= =?iso-8859-1?Q?iG8j3SxYLx5ReBbMgE0VBy6MC4Tgi95X66HfO59Hh996SQ2vvQFqgWQK+I?= =?iso-8859-1?Q?q+kzL/ZiotIPaDKXAZp3gqn1vswI9KDTJ09HKLetKs3Csr9J83PPaj9OB+?= =?iso-8859-1?Q?pZJ8arrroVBqKIwc8zc3yE1oldPP6T3cM0H0LZKSSuTRSUvfHl5nhbJ9xK?= =?iso-8859-1?Q?lIsKpsaw0qXkuFcx/M1p7g+pPM/Y9+FEEH9kjk5O2EpJh+vWRPJU73Bu50?= =?iso-8859-1?Q?RKR70JbVIB/ZXRSYI4CLnRl3mF2/IruIxKO++f2iMCP4LPD/PWCxmrwpaL?= =?iso-8859-1?Q?1Y3rLhVtypnH7jkCU4w7gJu7BqZYUMCNnHKUY0m9mOm5ZoLSJQ+MkDWJTd?= =?iso-8859-1?Q?+gbehlyPmplynGxzPQ+Ol4ULWv3Vw5qh8+qkUrW86OJxYKecm5ZfNGVCN8?= =?iso-8859-1?Q?Mw+8VzeNfU+yWQzJoBkKD7uR9xR7Xrgcv25Thw9PP3HNTgmpzuM5LkMfBD?= =?iso-8859-1?Q?FkpPJiTAieC9sHOEnxhtX0A7V+sNXeL8k/GqtyGVtc3+TU2XU8HiAFz4z4?= =?iso-8859-1?Q?OyBQjiNK6BuxQSysRc96CTF86qO8HRQWYT81lSJt4TOvscvu+oUKJk/miK?= =?iso-8859-1?Q?+WgI2NuPlsuyYfDD8HVrujjZOAk/INM4oLg/3GTK0cs3REpURs7B4gK2O7?= =?iso-8859-1?Q?ht9vv9IsEISYk0BcqMgZhpGgzb8UT+nml69kDZkDW5DDuUYYubiXdt4FF8?= =?iso-8859-1?Q?0D9MqWqmJVcUynNWimOjhtoETBK/EcjlkEwndxtmGn84sfclsXOq2n3/Co?= =?iso-8859-1?Q?YMgFef+BLtswoUEDPI9CVNtWdrdwEmxqUaKzPbMXMtz95J+N4mUphN3/9t?= =?iso-8859-1?Q?F6kwra1KuFypufRqxqZJ12tJnsnak8O5s7MQZF6y6OLxTvEbBXibyJxlx4?= =?iso-8859-1?Q?mA?= x-ms-exchange-antispam-messagedata-1: fv0FwOxS1CJFog== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: a6059930-a86b-499d-b21d-08da3bfd2584 X-MS-Exchange-CrossTenant-originalarrivaltime: 22 May 2022 14:12:46.8252 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: jfye67VDSra7Mh4tj5hC99ptM0chKcxYqoB9gBxZZ51lGNScDEWfD3hUM1jFhtgqj9fYxzXPhz53FGGExmL7+A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB8561 X-Rspamd-Queue-Id: 4L5j9737yZz4YJJ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=RjW1NrVp; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.43 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.65 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.35)[0.354]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.43:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.43:from] X-ThisMailContainsUnwantedMimeParts: N Adam Stylinski wrote:=0A= > jwd wrote:=0A= > > What is your server system? Make/model/ram/etc.=0A= > Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores, a little starved=0A= > on the clock but the load at least is basically zero during this test)=0A= > 128GB of memory=0A= >=0A= > > top -aH=0A= > During the copy load (for brevity, only did the real top contenders=0A= > for CPU here):=0A= >=0A= > last pid: 15560; load averages: 0.25, 0.39, 0.27=0A= >=0A= >=0A= >=0A= > up 4+15:48:54=0A= > 09:17:38=0A= > 98 threads: 2 running, 96 sleeping=0A= > CPU: 0.0% user, 0.0% nice, 19.1% system, 5.6% interrupt, 75.3% idle=0A= > Mem: 12M Active, 4405M Inact, 8284K Laundry, 115G Wired, 1148M Buf, 4819M= Free=0A= > ARC: 98G Total, 80G MFU, 15G MRU, 772K Anon, 1235M Header, 1042M Other=0A= > 91G Compressed, 189G Uncompressed, 2.09:1 Ratio=0A= > Swap: 5120M Total, 5120M Free=0A= >=0A= > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND= =0A= > 3830 root 20 0 12M 2700K rpcsvc 2 1:16 53.26%=0A= > nfsd: server (nfsd){nfsd: service}=0A= > 3830 root 20 0 12M 2700K CPU5 5 5:42 52.96%=0A= > nfsd: server (nfsd){nfsd: master}=0A= > 15560 adam 20 0 17M 5176K CPU2 2 0:00 0.12% top -a= H=0A= > 1493 root 20 0 13M 2260K select 3 0:36 0.01%=0A= > /usr/sbin/powerd=0A= > 1444 root 20 0 75M 2964K select 5 0:19 0.01%=0A= > /usr/sbin/mountd -r /etc/exports /etc/zfs/exports=0A= > 1215 uucp 20 0 13M 2820K select 5 0:27 0.01%=0A= > /usr/local/libexec/nut/usbhid-ups -a cyberpower=0A= > 93424 adam 20 0 21M 9900K select 0 0:00 0.01%=0A= > sshd: adam@pts/0 (sshd)=0A= >=0A= > > ifconfig -vm=0A= > mlxen0: flags=3D8843 metric 0 mtu= 9000=0A= options=3Ded07bb= =0A= capabilities=3Ded07bb=0A= > ether 00:02:c9:35:df:20=0A= > inet 10.5.5.1 netmask 0xffffff00 broadcast 10.5.5.255=0A= > media: Ethernet autoselect (40Gbase-CR4 )=0A= > status: active=0A= > supported media:=0A= > media autoselect=0A= > media 40Gbase-CR4 mediaopt full-duplex=0A= > media 10Gbase-CX4 mediaopt full-duplex=0A= > media 10Gbase-SR mediaopt full-duplex=0A= > media 1000baseT mediaopt full-duplex=0A= > nd6 options=3D29=0A= > plugged: QSFP+ 40GBASE-CR4 (No separable connector)=0A= > vendor: Mellanox PN: MC2207130-002 SN: MT1419VS07971 DATE: 2014-06-06=0A= > module temperature: 0.00 C voltage: 0.00 Volts=0A= > lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA=0A= > lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA=0A= > lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA=0A= > lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA=0A= >=0A= > > - What are your values for:=0A= > >=0A= > > -- kern.ipc.maxsockbuf=0A= > > -- net.inet.tcp.sendbuf_max=0A= > > -- net.inet.tcp.recvbuf_max=0A= > >=0A= > > -- net.inet.tcp.sendspace=0A= > > -- net.inet.tcp.recvspace=0A= > >=0A= > > -- net.inet.tcp.delayed_ack=0A= > kern.ipc.maxsockbuf: 16777216=0A= > net.inet.tcp.sendbuf_max: 16777216=0A= > net.inet.tcp.recvbuf_max: 16777216=0A= > net.inet.tcp.sendspace: 32768 # This is interesting? I'm not sure why=0A= > the discrepancy here=0A= > net.inet.tcp.recvspace: 4194304=0A= > net.inet.tcp.delayed_ack: 0=0A= >=0A= > > netstat -i=0A= > Name Mtu Network Address Ipkts Ierrs Idrop=0A= Opkts Oerrs Coll=0A= > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0=0A= 24178283 0 0=0A= > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0=0A= 8447249 0 0=0A= > lo0 16384 lo0 367691 0 0=0A= 367691 0 0=0A= > lo0 - localhost localhost 68 - -=0A= 68 - -=0A= > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - -=0A= 0 - -=0A= > lo0 - your-net localhost 348944 - -=0A= 348944 - -=0A= > mlxen 9000 00:02:c9:35:df:20 13138046 0 12=0A= 26308206 0 0=0A= > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - -=0A= 24345184 - -=0A= > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0=0A= 962249 102 0=0A= > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0=0A= 31623674 0 0=0A= > lagg0 - 192.168.0.0/2 nasbox 27967582 - -=0A= 41779731 - -=0A= > =0A= > > What threads/irq are allocated to your NIC? 'vmstat -i'=0A= >=0A= > Doesn't seem perfectly balanced but not terribly imbalanced, either:=0A= >=0A= > interrupt total rate=0A= > irq9: acpi0 3 0=0A= > irq18: ehci0 ehci1+ 803162 2=0A= > cpu0:timer 67465114 167=0A= > cpu1:timer 65068819 161=0A= > cpu2:timer 65535300 163=0A= > cpu3:timer 63408731 157=0A= > cpu4:timer 63026304 156=0A= > cpu5:timer 63431412 157=0A= > irq56: nvme0:admin 18 0=0A= > irq57: nvme0:io0 544999 1=0A= > irq58: nvme0:io1 465816 1=0A= > irq59: nvme0:io2 487486 1=0A= > irq60: nvme0:io3 474616 1=0A= > irq61: nvme0:io4 452527 1=0A= > irq62: nvme0:io5 467807 1=0A= > irq63: mps0 36110415 90=0A= > irq64: mps1 112328723 279=0A= > irq65: mps2 54845974 136=0A= > irq66: mps3 50770215 126=0A= > irq68: xhci0 3122136 8=0A= > irq70: igb0:rxq0 1974562 5=0A= > irq71: igb0:rxq1 3034190 8=0A= > irq72: igb0:rxq2 28703842 71=0A= > irq73: igb0:rxq3 1126533 3=0A= > irq74: igb0:aq 7 0=0A= > irq75: igb1:rxq0 1852321 5=0A= > irq76: igb1:rxq1 2946722 7=0A= > irq77: igb1:rxq2 9602613 24=0A= > irq78: igb1:rxq3 4101258 10=0A= > irq79: igb1:aq 8 0=0A= > irq80: ahci1 37386191 93=0A= > irq81: mlx4_core0 4748775 12=0A= > irq82: mlx4_core0 13754442 34=0A= > irq83: mlx4_core0 3551629 9=0A= > irq84: mlx4_core0 2595850 6=0A= > irq85: mlx4_core0 4947424 12=0A= > Total 769135944 1908=0A= >=0A= > > Are the above threads floating or mapped? 'cpuset -g ...'=0A= >=0A= > I suspect I was supposed to run this against the argument of a pid,=0A= > maybe nfsd? Here's the output without an argument=0A= >=0A= > pid -1 mask: 0, 1, 2, 3, 4, 5=0A= > pid -1 domain policy: first-touch mask: 0=0A= >=0A= > > Disable nfs tcp drc=0A= >=0A= > This is the first I've even seen a duplicate request cache mentioned.=0A= > It seems counter-intuitive for why that'd help but maybe I'll try=0A= > doing that. What exactly is the benefit?=0A= The DRC improves correctness for NFSv3 and NFSv4.0 mounts. It is a=0A= performance hit. However, for a read mostly load it won't add too=0A= much overhead. Turning it off increases the likelyhood of data corruption= =0A= due to retried non-idempotent RPCs, but the failure will be rare over TCP.= =0A= =0A= If your mount is NFSv4.1 or 4.2, the DRC is not used, so don't worry about = it.=0A= =0A= > > What is your atime setting?=0A= >=0A= > Disabled at both the file system and the client mounts.=0A= >=0A= > > You also state you are using a Linux client. Are you using the MLX affi= nity > scripts, buffer sizing suggestions, etc, etc. Have you swapped the L= inux system for a fbsd system?=0A= > I've not, though I do vaguely recall mellanox supplying some scripts=0A= > in their documentation that fixed interrupt handling on specific cores=0A= > at one point. Is this what you're referring to? I could give that a=0A= > try. I don't at present have any FreeBSD client systems with enough=0A= > PCI express bandwidth to swap things out for a Linux vs FreeBSD test.=0A= If you have not already done so, do a "nfsstat -m" on the client to find=0A= out what options it is actually using (works on both Linux and FreeBSD).=0A= =0A= If the Linux client has a way of manually adjusting readahead, then try=0A= increasing it. (FreeBSD has a "readahead" mount option, but I can't recall= =0A= if Linux has one?)=0A= =0A= You can try mounting the server on the server, but that will use lo0 and no= t=0A= the mellanox, so it might be irrelevant.=0A= =0A= Also, I don't know how many queues the mellanox driver used. You'd want=0A= an "nconnect" at least as high as the number of queues, since each TCP=0A= connection will be serviced by one queue and that limits its bandwidth.=0A= =0A= However, in general, RPC RTT will define how well NFS performs and not=0A= the I/O rate for a bulk file read/write.=0A= Btw, writing is a very different story than reading, largely due to the nee= d=0A= to commit data/metadata to stable storage while writing.=0A= =0A= I can't help w.r.t. ZFS nor high performance nets (my fastest is 1Gbps), ri= ck=0A= =0A= > You mention iperf. Please post the options you used when invoking iperf = and it's output.=0A= =0A= Setting up the NFS client as a "server", since it seems that the=0A= terminology is a little bit flipped with iperf, here's the output:=0A= =0A= -----------------------------------------------------------=0A= Server listening on 5201 (test #1)=0A= -----------------------------------------------------------=0A= Accepted connection from 10.5.5.1, port 11534=0A= [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931=0A= [ ID] Interval Transfer Bitrate=0A= [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec=0A= [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec=0A= [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec=0A= [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec=0A= [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec=0A= - - - - - - - - - - - - - - - - - - - - - - - - -=0A= [ ID] Interval Transfer Bitrate=0A= [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec recei= ver=0A= -----------------------------------------------------------=0A= Server listening on 5201 (test #2)=0A= -----------------------------------------------------------=0A= =0A= On Sun, May 22, 2022 at 3:45 AM John wrote:=0A= >=0A= > ----- Adam Stylinski's Original Message -----=0A= > > Hello,=0A= > >=0A= > > I have two systems connected via ConnectX-3 mellanox cards in ethernet= =0A= > > mode. They have their MTU's maxed at 9000, their ring buffers maxed=0A= > > at 8192, and I can hit around 36 gbps with iperf.=0A= > >=0A= > > When using an NFS client (client =3D linux, server =3D freebsd), I see = a=0A= > > maximum rate of around 20gbps. The test file is fully in ARC. The=0A= > > test is performed with an NFS mount nconnect=3D4 and an rsize/wsize of= =0A= > > 1MB.=0A= > >=0A= > > Here's the flame graph of the kernel of the system in question, with=0A= > > idle stacks removed:=0A= > >=0A= > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#fi= le-nfs_fg-svg=0A= > >=0A= > > The longest functions seems like maybe it's the ERMS aware memcpy=0A= > > happening from the ARC? Is there maybe a missing fast path that could= =0A= > > take fewer copies into the socket buffer?=0A= >=0A= > Hi Adam -=0A= >=0A= > Some items to look at and possibly include for more responses....=0A= >=0A= > - What is your server system? Make/model/ram/etc. What is your=0A= > overall 'top' cpu utilization 'top -aH' ...=0A= >=0A= > - It looks like you're using a 40gb/s card. Posting the output of=0A= > 'ifconfig -vm' would provide additional information.=0A= >=0A= > - Are the interfaces running cleanly? 'netstat -i' is helpful.=0A= >=0A= > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order?=0A= >=0A= > - Inspect 'netstat -m'. Denied? Delayed?=0A= >=0A= >=0A= > - You mention iperf. Please post the options you used when=0A= > invoking iperf and it's output.=0A= >=0A= > - You appear to be looking for through-put vs low-latency. Have=0A= > you looked at window-size vs the amount of memory allocated to the=0A= > streams. These values vary based on the bit-rate of the connection.=0A= > Tcp connections require outstanding un-ack'd data to be held.=0A= > Effects values below.=0A= >=0A= >=0A= > - What are your values for:=0A= >=0A= > -- kern.ipc.maxsockbuf=0A= > -- net.inet.tcp.sendbuf_max=0A= > -- net.inet.tcp.recvbuf_max=0A= >=0A= > -- net.inet.tcp.sendspace=0A= > -- net.inet.tcp.recvspace=0A= >=0A= > -- net.inet.tcp.delayed_ack=0A= >=0A= > - What threads/irq are allocated to your NIC? 'vmstat -i'=0A= >=0A= > - Are the above threads floating or mapped? 'cpuset -g ...'=0A= >=0A= > - Determine best settings for LRO/TSO for your card.=0A= >=0A= > - Disable nfs tcp drc=0A= >=0A= > - What is your atime setting?=0A= >=0A= >=0A= > If you really think you have a ZFS/Kernel issue, and you're=0A= > data fits in cache, dump ZFS, create a memory backed file system=0A= > and repeat your tests. This will purge a large portion of your=0A= > graph. LRO/TSO changes may do so also.=0A= >=0A= > You also state you are using a Linux client. Are you using=0A= > the MLX affinity scripts, buffer sizing suggestions, etc, etc.=0A= > Have you swapped the Linux system for a fbsd system?=0A= >=0A= > And as a final note, I regularly use Chelsio T62100 cards=0A= > in dual home and/or LACP environments in Supermicro boxes with 100's=0A= > of nfs boot (Bhyve, QEMU, and physical system) clients per server=0A= > with no network starvation or cpu bottlenecks. Clients boot, perform=0A= > their work, and then remotely request image rollback.=0A= >=0A= >=0A= > Hopefully the above will help and provide pointers.=0A= >=0A= > Cheers=0A= >=0A= =0A= From nobody Sun May 22 14:20:37 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 61DE11B310DE for ; Sun, 22 May 2022 14:20:50 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yw1-x112e.google.com (mail-yw1-x112e.google.com [IPv6:2607:f8b0:4864:20::112e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5jL92CSLz4Yrq; Sun, 22 May 2022 14:20:49 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yw1-x112e.google.com with SMTP id 00721157ae682-2ff39b44b06so124674847b3.13; Sun, 22 May 2022 07:20:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=tlrJ2gfiNU5I7GWa1h86cXJSUO1IhBHVqnVRs2dnigc=; b=DNwwUt6iamZ5znDpJKp7/hq1bdPsRzaW+PzKGD5kECEjP8AabiMGoxezrjjJzr1ipy FqVv5gc95lTtQ5u4yOdIZa95c9xOxOBViIZ2KwWV2jXkrIo3o29s9Ji3c/R7Bv5Kf5UB pC3syj4bRKtXaMEY9Rq4i3edx4XwabfEs9W13SVVK9xfYQre36NKgFi52CG+QqJHOxX6 FjHeQWZOjReZdXqIz8aglGd7205U5/tIszjf/nr9cTGTadLK0op4COAHwxudOD+osP2b i+PFV3fgYNUL4MEfd2mzpu3gyH89wdbuOmPRUWpizUBZSfGw8zgUpAdTPlk128yHan0E pZgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=tlrJ2gfiNU5I7GWa1h86cXJSUO1IhBHVqnVRs2dnigc=; b=H30/Q+K+muEJpGyGNGZxaVgrBZhZv5N6qt48ERD+lPiXQqt4rcnossGhhDrOjDtuLs ZR0oYUIaKX/FoOSlOXg0d8mPPyQ6Zm/GrV5p3ojl6duM1J4zCVDzJKkSUCqU+Z4a7MdW K94/QjnzfpsFSh2WmhCSZUzwSxeMWR/YLZ9h8QjDtp3US9pAaMdxh8SWX1qRMm2NstjS 4cfzNM0mVt6/lFjPfjVKZfT9zSRGS6fLmorRydgndR1Qn4F/AIUsJ/IBtT7fe+2iAWJM 08DWwU7elPYUVnWRku++RHGo/wWH0eSB/3h7WJY7NM2S5BMM92S+gM9/XR829SJxYv+I amCg== X-Gm-Message-State: AOAM532gBMIGHwM6Z1xnw3ECDhEmnKu+G/VZcCyRyQWdfJOVeZnLLdYU rQR3uhLIMQGqhghky/bZ5wlykOrmOZBJZpodbu9u4BfBnnI= X-Google-Smtp-Source: ABdhPJwq1ZWK5XGCr9mlELrAtoy9TKvLT/N5EG9hZ+ETGHnRwKdX0v8f1hwMiL/KnSp2HepjpigG1TJjrwcUh5Pwtz0= X-Received: by 2002:a0d:d8c5:0:b0:2ff:eed:1886 with SMTP id a188-20020a0dd8c5000000b002ff0eed1886mr19064812ywe.336.1653229248424; Sun, 22 May 2022 07:20:48 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Adam Stylinski Date: Sun, 22 May 2022 10:20:37 -0400 Message-ID: Subject: Re: zfs/nfsd performance limiter To: Rick Macklem Cc: John , "freebsd-fs@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L5jL92CSLz4Yrq X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=DNwwUt6i; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::112e as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112e:from]; NEURAL_HAM_SHORT(-0.80)[-0.803]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N hw.mlxen0.conf.tx_size: 8192 hw.mlxen0.conf.rx_size: 8192 hw.mlxen0.conf.tx_rings: 6 hw.mlxen0.conf.rx_rings: 4 (So, should I use 6 connections?) I tried to eliminate ZFS from the equation by exporting a tmpfs backed file system but I got IO errors when I tried to stat the mount point from the Linux client (perhaps a bug with tmpfs and mountd?). > If you have not already done so, do a "nfsstat -m" on the client to find out what options it is actually using (works on both Linux and FreeBSD). /mnt/nasshare from 10.5.5.1:/mnt/share Flags: rw,noatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,acregmin=120,acregmax=120,acdirmin=120,acdirmax=120,hard,proto=tcp,nconnect=4,timeo=600,retrans=2,sec=sys,clientaddr=10.5.5.4,fsc,local_lock=none,addr=10.5.5.1 I had tried prior to this the NFSv3 server but found that it actually performed worse than the v4 one. On Sun, May 22, 2022 at 10:12 AM Rick Macklem wrote: > > Adam Stylinski wrote: > > jwd wrote: > > > What is your server system? Make/model/ram/etc. > > Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores, a little starved > > on the clock but the load at least is basically zero during this test) > > 128GB of memory > > > > > top -aH > > During the copy load (for brevity, only did the real top contenders > > for CPU here): > > > > last pid: 15560; load averages: 0.25, 0.39, 0.27 > > > > > > > > up 4+15:48:54 > > 09:17:38 > > 98 threads: 2 running, 96 sleeping > > CPU: 0.0% user, 0.0% nice, 19.1% system, 5.6% interrupt, 75.3% idle > > Mem: 12M Active, 4405M Inact, 8284K Laundry, 115G Wired, 1148M Buf, 4819M Free > > ARC: 98G Total, 80G MFU, 15G MRU, 772K Anon, 1235M Header, 1042M Other > > 91G Compressed, 189G Uncompressed, 2.09:1 Ratio > > Swap: 5120M Total, 5120M Free > > > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > 3830 root 20 0 12M 2700K rpcsvc 2 1:16 53.26% > > nfsd: server (nfsd){nfsd: service} > > 3830 root 20 0 12M 2700K CPU5 5 5:42 52.96% > > nfsd: server (nfsd){nfsd: master} > > 15560 adam 20 0 17M 5176K CPU2 2 0:00 0.12% top -aH > > 1493 root 20 0 13M 2260K select 3 0:36 0.01% > > /usr/sbin/powerd > > 1444 root 20 0 75M 2964K select 5 0:19 0.01% > > /usr/sbin/mountd -r /etc/exports /etc/zfs/exports > > 1215 uucp 20 0 13M 2820K select 5 0:27 0.01% > > /usr/local/libexec/nut/usbhid-ups -a cyberpower > > 93424 adam 20 0 21M 9900K select 0 0:00 0.01% > > sshd: adam@pts/0 (sshd) > > > > > ifconfig -vm > > mlxen0: flags=8843 metric 0 mtu 9000 > options=ed07bb > capabilities=ed07bb > > ether 00:02:c9:35:df:20 > > inet 10.5.5.1 netmask 0xffffff00 broadcast 10.5.5.255 > > media: Ethernet autoselect (40Gbase-CR4 ) > > status: active > > supported media: > > media autoselect > > media 40Gbase-CR4 mediaopt full-duplex > > media 10Gbase-CX4 mediaopt full-duplex > > media 10Gbase-SR mediaopt full-duplex > > media 1000baseT mediaopt full-duplex > > nd6 options=29 > > plugged: QSFP+ 40GBASE-CR4 (No separable connector) > > vendor: Mellanox PN: MC2207130-002 SN: MT1419VS07971 DATE: 2014-06-06 > > module temperature: 0.00 C voltage: 0.00 Volts > > lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > > > > - What are your values for: > > > > > > -- kern.ipc.maxsockbuf > > > -- net.inet.tcp.sendbuf_max > > > -- net.inet.tcp.recvbuf_max > > > > > > -- net.inet.tcp.sendspace > > > -- net.inet.tcp.recvspace > > > > > > -- net.inet.tcp.delayed_ack > > kern.ipc.maxsockbuf: 16777216 > > net.inet.tcp.sendbuf_max: 16777216 > > net.inet.tcp.recvbuf_max: 16777216 > > net.inet.tcp.sendspace: 32768 # This is interesting? I'm not sure why > > the discrepancy here > > net.inet.tcp.recvspace: 4194304 > > net.inet.tcp.delayed_ack: 0 > > > > > netstat -i > > Name Mtu Network Address Ipkts Ierrs Idrop > Opkts Oerrs Coll > > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0 > 24178283 0 0 > > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0 > 8447249 0 0 > > lo0 16384 lo0 367691 0 0 > 367691 0 0 > > lo0 - localhost localhost 68 - - > 68 - - > > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - - > 0 - - > > lo0 - your-net localhost 348944 - - > 348944 - - > > mlxen 9000 00:02:c9:35:df:20 13138046 0 12 > 26308206 0 0 > > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - - > 24345184 - - > > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0 > 962249 102 0 > > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0 > 31623674 0 0 > > lagg0 - 192.168.0.0/2 nasbox 27967582 - - > 41779731 - - > > > > > What threads/irq are allocated to your NIC? 'vmstat -i' > > > > Doesn't seem perfectly balanced but not terribly imbalanced, either: > > > > interrupt total rate > > irq9: acpi0 3 0 > > irq18: ehci0 ehci1+ 803162 2 > > cpu0:timer 67465114 167 > > cpu1:timer 65068819 161 > > cpu2:timer 65535300 163 > > cpu3:timer 63408731 157 > > cpu4:timer 63026304 156 > > cpu5:timer 63431412 157 > > irq56: nvme0:admin 18 0 > > irq57: nvme0:io0 544999 1 > > irq58: nvme0:io1 465816 1 > > irq59: nvme0:io2 487486 1 > > irq60: nvme0:io3 474616 1 > > irq61: nvme0:io4 452527 1 > > irq62: nvme0:io5 467807 1 > > irq63: mps0 36110415 90 > > irq64: mps1 112328723 279 > > irq65: mps2 54845974 136 > > irq66: mps3 50770215 126 > > irq68: xhci0 3122136 8 > > irq70: igb0:rxq0 1974562 5 > > irq71: igb0:rxq1 3034190 8 > > irq72: igb0:rxq2 28703842 71 > > irq73: igb0:rxq3 1126533 3 > > irq74: igb0:aq 7 0 > > irq75: igb1:rxq0 1852321 5 > > irq76: igb1:rxq1 2946722 7 > > irq77: igb1:rxq2 9602613 24 > > irq78: igb1:rxq3 4101258 10 > > irq79: igb1:aq 8 0 > > irq80: ahci1 37386191 93 > > irq81: mlx4_core0 4748775 12 > > irq82: mlx4_core0 13754442 34 > > irq83: mlx4_core0 3551629 9 > > irq84: mlx4_core0 2595850 6 > > irq85: mlx4_core0 4947424 12 > > Total 769135944 1908 > > > > > Are the above threads floating or mapped? 'cpuset -g ...' > > > > I suspect I was supposed to run this against the argument of a pid, > > maybe nfsd? Here's the output without an argument > > > > pid -1 mask: 0, 1, 2, 3, 4, 5 > > pid -1 domain policy: first-touch mask: 0 > > > > > Disable nfs tcp drc > > > > This is the first I've even seen a duplicate request cache mentioned. > > It seems counter-intuitive for why that'd help but maybe I'll try > > doing that. What exactly is the benefit? > The DRC improves correctness for NFSv3 and NFSv4.0 mounts. It is a > performance hit. However, for a read mostly load it won't add too > much overhead. Turning it off increases the likelyhood of data corruption > due to retried non-idempotent RPCs, but the failure will be rare over TCP. > > If your mount is NFSv4.1 or 4.2, the DRC is not used, so don't worry about it. > > > > What is your atime setting? > > > > Disabled at both the file system and the client mounts. > > > > > You also state you are using a Linux client. Are you using the MLX affinity > scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux system for a fbsd system? > > I've not, though I do vaguely recall mellanox supplying some scripts > > in their documentation that fixed interrupt handling on specific cores > > at one point. Is this what you're referring to? I could give that a > > try. I don't at present have any FreeBSD client systems with enough > > PCI express bandwidth to swap things out for a Linux vs FreeBSD test. > If you have not already done so, do a "nfsstat -m" on the client to find > out what options it is actually using (works on both Linux and FreeBSD). > > If the Linux client has a way of manually adjusting readahead, then try > increasing it. (FreeBSD has a "readahead" mount option, but I can't recall > if Linux has one?) > > You can try mounting the server on the server, but that will use lo0 and not > the mellanox, so it might be irrelevant. > > Also, I don't know how many queues the mellanox driver used. You'd want > an "nconnect" at least as high as the number of queues, since each TCP > connection will be serviced by one queue and that limits its bandwidth. > > However, in general, RPC RTT will define how well NFS performs and not > the I/O rate for a bulk file read/write. > Btw, writing is a very different story than reading, largely due to the need > to commit data/metadata to stable storage while writing. > > I can't help w.r.t. ZFS nor high performance nets (my fastest is 1Gbps), rick > > > You mention iperf. Please post the options you used when invoking iperf and it's output. > > Setting up the NFS client as a "server", since it seems that the > terminology is a little bit flipped with iperf, here's the output: > > ----------------------------------------------------------- > Server listening on 5201 (test #1) > ----------------------------------------------------------- > Accepted connection from 10.5.5.1, port 11534 > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 > [ ID] Interval Transfer Bitrate > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver > ----------------------------------------------------------- > Server listening on 5201 (test #2) > ----------------------------------------------------------- > > On Sun, May 22, 2022 at 3:45 AM John wrote: > > > > ----- Adam Stylinski's Original Message ----- > > > Hello, > > > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > > at 8192, and I can hit around 36 gbps with iperf. > > > > > > When using an NFS client (client = linux, server = freebsd), I see a > > > maximum rate of around 20gbps. The test file is fully in ARC. The > > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > > 1MB. > > > > > > Here's the flame graph of the kernel of the system in question, with > > > idle stacks removed: > > > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > > happening from the ARC? Is there maybe a missing fast path that could > > > take fewer copies into the socket buffer? > > > > Hi Adam - > > > > Some items to look at and possibly include for more responses.... > > > > - What is your server system? Make/model/ram/etc. What is your > > overall 'top' cpu utilization 'top -aH' ... > > > > - It looks like you're using a 40gb/s card. Posting the output of > > 'ifconfig -vm' would provide additional information. > > > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > > > - Inspect 'netstat -m'. Denied? Delayed? > > > > > > - You mention iperf. Please post the options you used when > > invoking iperf and it's output. > > > > - You appear to be looking for through-put vs low-latency. Have > > you looked at window-size vs the amount of memory allocated to the > > streams. These values vary based on the bit-rate of the connection. > > Tcp connections require outstanding un-ack'd data to be held. > > Effects values below. > > > > > > - What are your values for: > > > > -- kern.ipc.maxsockbuf > > -- net.inet.tcp.sendbuf_max > > -- net.inet.tcp.recvbuf_max > > > > -- net.inet.tcp.sendspace > > -- net.inet.tcp.recvspace > > > > -- net.inet.tcp.delayed_ack > > > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > > > - Are the above threads floating or mapped? 'cpuset -g ...' > > > > - Determine best settings for LRO/TSO for your card. > > > > - Disable nfs tcp drc > > > > - What is your atime setting? > > > > > > If you really think you have a ZFS/Kernel issue, and you're > > data fits in cache, dump ZFS, create a memory backed file system > > and repeat your tests. This will purge a large portion of your > > graph. LRO/TSO changes may do so also. > > > > You also state you are using a Linux client. Are you using > > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > > Have you swapped the Linux system for a fbsd system? > > > > And as a final note, I regularly use Chelsio T62100 cards > > in dual home and/or LACP environments in Supermicro boxes with 100's > > of nfs boot (Bhyve, QEMU, and physical system) clients per server > > with no network starvation or cpu bottlenecks. Clients boot, perform > > their work, and then remotely request image rollback. > > > > > > Hopefully the above will help and provide pointers. > > > > Cheers > > > From nobody Sun May 22 14:35:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 145521B34418 for ; Sun, 22 May 2022 14:35:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5jgB64ccz4bFb for ; Sun, 22 May 2022 14:35:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AD5B11D316 for ; Sun, 22 May 2022 14:35:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MEZYlE094729 for ; Sun, 22 May 2022 14:35:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MEZYWh094728 for fs@FreeBSD.org; Sun, 22 May 2022 14:35:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 14:35:34 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653230134; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZyLHmB2fExy5FAHV4kVbQCR5dfwzo8WnZEFJetIf1Fs=; b=Xe6gQjt9Erl2BIWelxTj6rFf6EwkgkHtDr8Q/jZ4bXuIFpV69r10snmMpVV/DF4sRUyYsI 2i+ThhP3H4nJ+l+Rl7vyuJgEmf97nKqjGhIZsGOVIXCzol4qOWPY02I02RWipgeTkRf4ue l8qgvzlo9pvYAY+9ZBr3SgYqUllGShZ9nn4vO1HNnOJB/BVE3SjAlQFzxhdM2N18x3Gknv kLQo8iH+IrJMZIRN5hcFn5E7MXStjaKUD/sSunnCnC0ziHuWKpSjH4mUAkXOheHXCbIlzp suojsVE7VuLKfq0oh3DhgZIKj4SsCcMryidJy2Ki/OF5LkwfTuWrpAafNvFn1w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653230134; a=rsa-sha256; cv=none; b=cQs10mTGlZ1Sj4JIu2+AAEkE2lQX9G0+qkZZjJyQOeauvFhWhmi4bbDnroQcv9xZCnQuXS zO0SP5b10gD743EJY2ehW5w07Qk8FEaO55XopykR6kSNsfZRm3bRPIpDmmPYyqVJTgwtac XHfC9qf099JlBPeYQDq9BMCNgfTTvgyINOX4r6iBC41RlYMLgOuLZCr3GZRmU2mCZBQxDg lU+aFct53AyLKUR1Ca7xAAPO3yo+QjoZY/beuPsoK3EzX0ty7GL0SB3Z9CEfCc4p1Lx6r3 +QTwnbCdgUGCUnNHimB/m5xrhYDpQJ4LOjGxnW/hZgsQ/BdjSsN/cVKQ8Cqf8w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #12 from Warner Losh --- I think that it's power: Power cycles: 519 Power on hours: 166 Unsafe shutdowns: 518 519 power cycles in 5 days? 518 unsafe shutdowns means that they were sudde= n. That's a power cycle (or brown out) every 20 minutes if this has been on continuously that time. Temperature looks good (no temp warnings) and the smart data from the doesn= 't show accumulated over temperature time. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 14:39:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7C5AA1B35397 for ; Sun, 22 May 2022 14:39:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5jm52FH7z4c2m for ; Sun, 22 May 2022 14:39:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2AB261CFD5 for ; Sun, 22 May 2022 14:39:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MEdnqx095805 for ; Sun, 22 May 2022 14:39:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MEdnZs095804 for fs@FreeBSD.org; Sun, 22 May 2022 14:39:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 14:39:49 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653230389; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=O+SJmvvRZkjfCav+bVaC4+/1FqpSBfTMixsqZgvkgmQ=; b=mLQjAz/93RAr8A0pz9vKyy29uGZ9AyuOrf3fazU6s5FsOGNOhxrhzgc+EPwk3vXzWtRtOW JwUeUu0m3+7t5xLp5p8cog3O7kWwmTR0VSykEgMsgczDRrmp5Kof6lTPgm5CikJxdXXuHs 35OUh5bM5TeBIIkxnv8QtQKmqbrQ9awjaclyupbK4HRtJT9DPygBqPWoJsIOiuHUL0jcf3 jRQd6WFwUGzcqthC9VGRzSEVFI/IuXNa+Acy/RyKGd+lw9M1Afz1S5vLrLfM9o9MjHm6Yf DVcEmuKzqv/Sn3dbFrU9dRNXcXCE0k7rwEjS4+7yx5XIPzqNPWIX/yXaLjVmsA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653230389; a=rsa-sha256; cv=none; b=YJYUZ6MCrnojeLplVUM/XY8KxQVCdQ2ohBJb4viQBHLpZfM1Ou+dIhDN3L2MTHTiOMLdmb /AjnCfd7oJIzFmzRn42AK4Hlt5qDkQkp8P+utI3y9iCMQ+KKHq8cC1Uy3Zf0Sl34Sagac6 deCAFEhrTCu4SKoGyXdpPtoNvq49bGLm+cA3PZ0vpLmfHjgpQeaht79FcAzA+psvD+EDF3 fLNspgA/r7yobi5MFDCTX+YDYmreDOgsbBj83efYBegZrvr68wpgnbVnKt/RdY92prxNZx 2PwpNoRg4erMQx1wJiGJvcZjZLDYRAnxzjvQpAdjLuYx8MP1q6lrx29lPPPg/w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #13 from Warner Losh --- I should have said in 7 days. The 20 minute figure is correct though. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 19:18:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C1E451B3FDA4 for ; Sun, 22 May 2022 19:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5qxB4NYBz3KjF for ; Sun, 22 May 2022 19:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7625E20E67 for ; Sun, 22 May 2022 19:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MJI6MY050746 for ; Sun, 22 May 2022 19:18:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MJI6np050745 for fs@FreeBSD.org; Sun, 22 May 2022 19:18:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Sun, 22 May 2022 19:18:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653247086; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZDPhDz/jieSUQEgnA0s/KclVTP++GPtTC45eTCQN5vM=; b=DCW24bOsJFmYDegOSc40WP1nbiKCIc956JHFZRwci+hHoieTwVDojGJQU2HmM2GXidTOe6 YHVZyz/CbBJN+WFcWSCXtvvU/AbwAhn+2be3zk9w50dPcIoxT0ZVfiz5v86TnaFtRYtFOS ai42zsbbpi154z0GVvry05k5x9fkvvZ97CBuI4lk4u4ntGFxbsgOhdo4l0GoxAk3w7PPdt nw0cwGTGG9e39DVLU1zS8bybwJCF0zTlI5oxSTMT+BFpSL4dnSHtz0O2y60ifj4TlX1WhT QkGaY8MgFijZSDdLX1HcxmKaw0Sba0HRCxkriiUyRyLD/kCPUUvRrqeCxLC3wg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653247086; a=rsa-sha256; cv=none; b=Sj/Q3U1BSZmnSgIx8GLUAfABbj4RlGq72uRvITP6y97wwlpgBqyYJOqTTPtOnPWSxiFYMR xRRtd4S+PDX7wQbud1+sqILX9vjt2y+GjLlkYVaVkYLz8IXYcAvZ6uXqJS4TrfECyAv+CC MQ/wVqiITLYlbiEI4zXfX/HSrEYwQBHdJfON5+Edfu6Aet4gBoNKYaFPYN6B+Aq14aJlZ0 X2Hke/s1GJodtIDURQbbDUJ+QdWssA50ANEapNWeGm/sAua9WimdUZXpZJF3hZa/YrqPgh yVsodVMdrYq7gcyaqhFO1yLjPPZ1AIW5iHCrwc9zjHq/Zb/ayeBSz3Uuw9pQBQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 --- Comment #4 from Robert Morris --- (In reply to Kirk McKusick from comment #3) Yes -- your patch of May 21 makes this problem go away for me. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun May 22 19:18:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8514B1B3FBC3 for ; Sun, 22 May 2022 19:18:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5qxD6R4Cz3Kd9 for ; Sun, 22 May 2022 19:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BDC192111A for ; Sun, 22 May 2022 19:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MJI85K050778 for ; Sun, 22 May 2022 19:18:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MJI82s050777 for fs@FreeBSD.org; Sun, 22 May 2022 19:18:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Sun, 22 May 2022 19:18:08 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653247089; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sR6VHdy7T09qbskihdYMP1EwnVjlcGEcm/H1eAAHFH4=; b=Jx9GswkgPHzwySI0RTFBo70uFyTT2BERvhisweQQ4Ux46Svb8cPY+luaNTWuroHM3UOZeV uRk0/Ecje6uF+sbPphKouw2Ow+LEvwzyeJipNYYxqkocIsCRVE2BbJUSitwlYRdgYmclUU M2oHtxG0JcCH8/DOMX//hyM3N6f5TGi6W9A/vnPFriydSLSXAz5rh3x2r/7lHGD3fDyoc8 ZcC8oTpFWvN5qRk7VcQC7ZJtvuI0Jw3lKQtiU7AdrJCVFfw1j6oxhitTZNLGVdlxwXCMby +Lyjf2rR4BbNwLvVBsRhGpauOvoArA36QoURk6SM5V8zugN9jOfEjJXlyEkesA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653247089; a=rsa-sha256; cv=none; b=wFBmGJFlODN0sg9XcDDqlpZMxb30P2q5A75T6vg0uIrhzkb+Co33M08lZLupnGA2SUQt3D yUeEJq6qjNlyZZ98San6nKUZ4iK87sJh0tpqzibpNs0LqZmA41F+sGS/UmzCrpbcxIA3ti KOcwjIFEDCB7csEFogcT6dAF57BmlcPC7sDmqojm72V3aWQ64z6BxiSnr1oZo4CG1f4FI1 X1p8DhZheRXCd5miVXD4Q8QytYUp9TBOh1XdHqfSR8Fiz70nJLREvcHb/vO7MJWbUCMNq7 TG00NXQ6C17DVRqU61r1hmzkQAV8hJvFayyvct/XmwjbYmsPiv5k7hT4+rMy1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 --- Comment #4 from Robert Morris --- (In reply to Kirk McKusick from comment #3) Yes -- your patch of May 21 makes this problem go away for me. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 19:18:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 326FF1B3FF16 for ; Sun, 22 May 2022 19:18:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5qxP3V68z3KZt for ; Sun, 22 May 2022 19:18:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DE09B20C34 for ; Sun, 22 May 2022 19:18:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MJIGsv050873 for ; Sun, 22 May 2022 19:18:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MJIGUd050872 for fs@FreeBSD.org; Sun, 22 May 2022 19:18:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Sun, 22 May 2022 19:18:16 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653247097; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jPLLMVBg0uVmGBehi1n4Uxfin0bTJXdJ310qT4svvqs=; b=q2/2PCzobfa79bMBFPagWVByc38JxdhBmi9dmEuvk1nGFNvLCF292KNtYIrdqAkAYrJCp7 Vxenqlpho0xeDW45y/gxcg07lGUYT6KGzrpESdqvmN8GE+tFQOgsNqDnWnFpX3seBWvDGd yGL0TJCtNtZQN8VFTqfCSFy8qWWd2HiTO+54+f/3IjGNjEQwm62L/MXCaeS0zIvae1MoLM W07zH6jEKVXzfD8vGJDzCrnPnzsxBkdCUuZtXfjph7lzRH2mvNPs6HRFxm7yknxdPhCW8o fJIJMRkiwwrGwwru8VrztwGzWRlyWHwhi2xjB0f0wRW5Vx+0ucwHa6q29RE3Tw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653247097; a=rsa-sha256; cv=none; b=QMFyFHHnanUBtxMuHxb02ul5D/x/Is+67WT5sxonl2NhtQ21bdPUeIp7qr6eAOBKvGpoxD MYni2Vbjg8jAFgggRW5ccKY+5DuQ7C10wyiyKOz0BwlqMdT3ZLcDxeVm/iHTuzvhTh0C2o IsDkZrmWyp5QXQBalPpYFqB//eOyPAoFNIEcRn8uMbDmL9fsILmKg7yZF3QSDqj/CCv7qH SjwNUsZlKXOh6l7AEsfTAOohvHiBUMy4CPw0r5xhKAwozo3k53czNkmuk+GF7At0Fofzwg xO/tIIBdyo6ibx52ED+NZlz+5fmA8T1cml9FvZyP8HDcu0TKb4JpfutJqk9mLw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #6 from Robert Morris --- (In reply to Kirk McKusick from comment #5) Yes -- your patch of May 21 makes this problem go away for me. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun May 22 19:18:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D7B5B1B3FF9A for ; Sun, 22 May 2022 19:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5qxR1n2rz3KpJ for ; Sun, 22 May 2022 19:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0AAE320C36 for ; Sun, 22 May 2022 19:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MJIIto050895 for ; Sun, 22 May 2022 19:18:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MJIIaS050894 for fs@FreeBSD.org; Sun, 22 May 2022 19:18:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Sun, 22 May 2022 19:18:19 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rtm@lcs.mit.edu X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653247099; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jNv+O0rWahJzwCQLxifVUvr4GAV8RWdrBJcFgwjnEZI=; b=DIoY8RZP9Q794Td/YgyrYTBR7E3xhY6WLK34xpRjlxMKWlMRMsrvqirV2pfQo2CKbCapKn F06sHL1w6GcmuQ8389Qf4/vYI4WEE5edpMGcoUoevGgWff64Kl1SP0S8elwLPdRPG0HSs+ vDKj4orZp9fi6mJOQqIFplb61BZ//bK8EaZ5CL7CIucn7v4bqmMj7iqZF7ZOlr/wkyFv7o yUbwhQP1kP1LbiWcKPzEqaVWlNaLw+vYZRiINuIaDLRh/qM79Yj3jQNCrBgEvCzlGZXeS2 doSkr+NsdZi8z+OqfsbELJ6y8Hz9pfamz2SbDJ0XxI2Ikx3nY6Z5N5LzIXDRTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653247099; a=rsa-sha256; cv=none; b=fRCn8Lcnz6mUdPPzqNhLs2+1CiQH4WaiUSwZQu7krfkiCfCfKf/Q5A0K3yr+e98rSiHUZJ A/w4NgjO2NkHa7vFI3p2QLUO+KWxF0AcbUrYmbWQiw5OZyF/YmEgFJqJ4zPYIugUr0Yrxo Fo0ztdhSQxBXciQlSOm5Enephzc9k0/ASGUZS1+oKTkE0ghQcV4BBY8O+GWXJpPjpdDn/5 uraBoEEX/aGY9nr4x1mMUnEiQJdlgfrqA/TkGlCa9M8UTKdNFLXHAlOASZc3NIlZELdOuw lNNTHzUkzBLUuV29gwWrbx7Lfy3miMzHue2+obT+6ICujKm7hZCaeb5tPD4w/g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 --- Comment #6 from Robert Morris --- (In reply to Kirk McKusick from comment #5) Yes -- your patch of May 21 makes this problem go away for me. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 21:00:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5134B1AEFE4E for ; Sun, 22 May 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5tCr6Jtwz3tJ4 for ; Sun, 22 May 2022 21:00:56 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7658B2273D for ; Sun, 22 May 2022 21:00:56 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24ML0uam013684 for ; Sun, 22 May 2022 21:00:56 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24ML0uRJ013683 for fs@FreeBSD.org; Sun, 22 May 2022 21:00:56 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202205222100.24ML0uRJ013683@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 22 May 2022 21:00:56 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16532532562.7Bf2.10678" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653253257; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=szvn0/kDMOo7R0eVNBJOk5BwmqyqsIvlddOt6ynjVjo=; b=rkowN7IDCezvblUEtjN2pTeAXASemrTV6F1HaUDfHOk0v/FXKo0C0RMBhRAU1XWUAB3lJR dB33gayBZDWwKhyNMQKmEHq6BkXD66WTl3epBw3mfRmpZjZRVo2FTgCd41oj1a3ocribMt QTtvxd30ZkPDsAbW7HFjVdP3yMyDZrh69Hb8vL23/5RwkrjdqyZbX/BNGTCNDMeJaLq/+a hD+JeEeE2BL8EbzuW0ULCgzBRAigxWlKdYaU7odOHX8ccwgDWi7Ybq4/SpxK8739htcuzN dqCO3yPW0A/GR/GNXLZdltLM9gGhxnvGF6nLNRie9BFDmhyIrzI+2yq/WLr/hg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653253257; a=rsa-sha256; cv=none; b=MPWjIjEByEEaR5/hKQpt4sPM8LMixne56Amor7tO+rJkB9zn7kwr4o4ylL0nw8nMCj2p4x m47yUVHuZggEtlOYM5NtoQW0R0lG+L9m3uiHc8A8zAPr1GgNoKLDyVUzws6iO0aH0NwLzH H3E8S60QF38M1byCEn1kdwlw3gY9b/39ZnEevjkJwd03YfV/mYA0vgb4OYJeptLu3lSjFS sdb8EhkOi/OWhJ9KPbNK8SzuZ4cnGGtyNe5sKc5+r+xzRLQ9Rv8vksipbh83DjbquWFLxV t8pr3AM7CP1nh3ntLDVmxnb+mbIYxXBLBRc9c13ShTFFONcsMfsZcLf8u74K8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16532532562.7Bf2.10678 Date: Sun, 22 May 2022 21:00:56 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16532532562.7Bf2.10678 Date: Sun, 22 May 2022 21:00:56 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16532532562.7Bf2.10678-- From nobody Sun May 22 22:26:07 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A68CF1B45333 for ; Sun, 22 May 2022 22:26:15 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2062.outbound.protection.outlook.com [40.107.115.62]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5w6G33wjz4hVR; Sun, 22 May 2022 22:26:14 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=neq6jAyN1Tz/64IIWQmzVH3vkQIsV/k8p7KdAN9Sl3Cez8+UzqYV9WV9/lgKxAIM9vH6+jFog2n8VJjnZL4XKM4YFfR6YWjL2MP6dKzsyGCcmHdkpjQ3rbP7SolQ3tMphNYXctN9UXAmkEgwJqXmrm2ZgI1CAGYaiMigIWPcGb7UqKQdMyWIhXyu3Ymg8dKDk6z57RswY3rV/xCgeFqrpKVEGinLJVV+UpMlM2z91Vy32efPoy1z2jQaKqJXDWF72V0aR3R1KseixaTEWIRHWnS1MsmIJn0a+w5OwUPbzHwVvRMV2+A0w5xNPulSyOECZe6Og9CBIOhWaKEpPG/jHA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=aqD9DG56VRoOMECY0V/XsEAyoWrnMEb8f6OBHNu5pHw=; b=h4R3I+ziIpjWcYRVWEgQQN2spZV7eRoozaI05cJHnAQjQE5Hjm40pORt++6h9UmRxFLWdS1YUmrLB/QmhnzjI2/QLzLy+tBL7l0OJr9E4xFgOogXadwma69rXPb1RasGHvVXxTGAM3EUTBPTwLlA2bmfEw/7uKQBaniaajmqFmmW9mXEX5zgjDdsKy8aeCk+n9rrn+NME5JnskmdtMrkSi1FR6zKFhC6PH1cDVqfBH36bajV2hahzf8x0EvU/wVN8W3RCP2Ko8qG2sRPJlsWO05L5m5RsQxoEFvsZs1QfArj8z7VEIo3EUSBqH+KcPJJ4qi4GISov+5C6k55GKSu8A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aqD9DG56VRoOMECY0V/XsEAyoWrnMEb8f6OBHNu5pHw=; b=lBgrxARSVxKLNZUdFXNy6AguAOD/hqQEMUBLDhNRc5vq9ZtZWpM1j0qRx3lftsDc+wBAkusV5iMos65kJO9kdMRIpDGxv9zyuAtred9z0YVNSxNbGxEyolOHrJEqRAS7g5s9WWJx6S5cohaM1GMEbe++H1OOC6N+FZpLEeXNbktJf5T561WlrbzMJ3RnJc46bcBiVskftFsRfiXA7UJ39lHIsmyxKTY/GD7ooPmhPzgZ8vcXhTSd5EgW5i2YTBUG3GOToSHOBzsNSKOw14Tmonw3aBGMq61og/OAi3hjYrPvCIwJNkAayjmIXEyv/XxMZ09g9HoiLiaihaq07lf5Wg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YQXPR01MB2727.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:4b::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5273.17; Sun, 22 May 2022 22:26:07 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5273.022; Sun, 22 May 2022 22:26:07 +0000 From: Rick Macklem To: Adam Stylinski CC: John , "freebsd-fs@freebsd.org" Subject: Re: zfs/nfsd performance limiter Thread-Topic: zfs/nfsd performance limiter Thread-Index: AQHYaxQfJkENgRkWo0q5KjKiS/ePTK0q68g+gAADxyeAAAh/gIAAgbCR Date: Sun, 22 May 2022 22:26:07 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 3ebaf0ba-14f4-9a95-903f-664af768760c x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e5ab4289-6e98-424c-2834-08da3c4210b3 x-ms-traffictypediagnostic: YQXPR01MB2727:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: tE7DBDCPwAFqjKIZodEtDp/Ngv5o3dQPIEz0yZqkbSP/c9BVRdLSZnx7bKk6ap66+lk1Y31OckyDInF+Q5lAZxeYYZ8IE6X2zRHkKSUB/oMCvN+3hyRhySxvbFzkHwNqmhSFlErAbjDgXsYKRvEldguOMqcxjXTI5qeNqbhfok6Zla0HTmoK9UoWospPUsRT514Is3QrXoEFNmuie+7Z8ewzbqwFr6kP+DU7Hh08PN34VJukUWh7NZBTaV5999zmM1v62MCknD3PT5bFHOOCWnkOP+yAs/AEiHsDQA80iBTUGS/umSlseqCgXVKCw718zP5645OiqGaD1FR6wrMTrX0CbR3woKI5RF50X/PndORoZYfpuwubeNzoj/WaXD1UnnRu9bJs9ZqPipIbT1LcliZnuKEqXmknkTI2bnAY/VgdUOdb5aSbG7/9y0+b1MKikR1uPp8g5GTiMMdRXuA7RE7xDeDn5yY0nl2fmyLcD2f7D7xlEgb9F5hSP6n4O5zD5TYl9KbRySOUCc89h2y6UcqwSk0f+QAuS4G0b3FN98CpGnUiC7nbD5kqVHZImb/MImX+V6Jt7SMlsFs3JgNuQMCd/6WCQ3YqSag+4oRyQZjqVk9xJ4bWEYZXBXc/DLS9YhBLHcEpKyX6f+Kr4DUG3z+8y12JjNN8/Zm0fAeX0oEvEOC7XG8t2L4UVEWy7nvcutTzDvaJToDwh0x/1gtu7JLyux049FH3uNmP9ai/78Q4Mo4N2XOxMJ9dyFSsNhtf6k9iH+5Wd1X+b0xyNXtPk+dU8WoRyZxdivZYAvOP/sY= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(38070700005)(38100700002)(5660300002)(2906002)(122000001)(52536014)(8936002)(3480700007)(4326008)(91956017)(54906003)(7696005)(6506007)(83380400001)(66946007)(186003)(33656002)(66556008)(66476007)(66446008)(64756008)(8676002)(76116006)(9686003)(86362001)(786003)(316002)(6916009)(55016003)(71200400001)(966005)(508600001)(53546011);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?PZ/4JqpNNjmBcXFHwJY11qgN2yCwl/pBwNgyf3DZLKPRTZYmMDzdAfHebd?= =?iso-8859-1?Q?Y8PNAcDKXDjkCFBGCKLH/nIZlpV0oE0wFLTWHlyzYYrb3zUM1a3Dmrt3Mz?= =?iso-8859-1?Q?EHhQ0ivrItjJTZld7qp2szBvEa/OoxZ80KJOQE+ygMtHz3uhAF0ZFbqgOI?= =?iso-8859-1?Q?FpevVL3OttV4cA5aDOTqbzOjA7qkAd4q0q6dPWaOLgIwjvihxJXTDMLvE7?= =?iso-8859-1?Q?9x7OoB5DHOsBfOSb04XEvirwnd3ATsIFLERqQaAHfFtUTNlay53UjoJlro?= =?iso-8859-1?Q?gVhVyy5CfS/MlwTRQxeg1KKwY7rAAakasBOLpSSPzn3loHHPyKWcjzsFMc?= =?iso-8859-1?Q?rgC/cN9t1HLMBPYkiulKsE4bEeYqim3XnhzD3PgFtttvRSz4sIj+Wl2nwM?= =?iso-8859-1?Q?F91vWeXAunR94Vx4SeG3QSqRPFHv4bhKbJ6HOcAgbKSy5dkkEYLJXlQlAn?= =?iso-8859-1?Q?4dmuiE94Z+RGJJ9mwCixjnQ+hmAKzWKkTjg3UbE5qrZ3oqcpmiagyNkEL7?= =?iso-8859-1?Q?ktFLEsd5X7oVs1+PKwwdIolC8KFHuI2GhmmLcA/7DrNkOIQL1YfNrQfS6a?= =?iso-8859-1?Q?zJaEIofq8KEZwdPjyOG/371mVYOqH7ht8eltcgd0u/RvfxDZaIZpxkXWur?= =?iso-8859-1?Q?kCgeBVN3jrRsulqizLzb5+Mmr8HvfEeZ56o25f3pYBhp59rZ8uNS8Zqhku?= =?iso-8859-1?Q?ZoUEAEo406gpJ5S3lNIiTvunXlDJl59Zo7jAqaEIf+QH3c/5EwynfB62RL?= =?iso-8859-1?Q?d+8W21wQ8tUvNWVZKCpXg5P8wz7QBzwJfHfA+TtlVQ6c6+HJ3Rbg18g6nt?= =?iso-8859-1?Q?8lflLBqboW2oABxMdYjewbCMiA/8xG17p5BSGB0XuJrLBezihdvoqW+Mr7?= =?iso-8859-1?Q?gTOVwGqH0N3fIYtnVA0TZT+IXVlvTPpAR3UgGDGDgGW67i5UXnema0YWs6?= =?iso-8859-1?Q?PJTNsGJMyy+R2D6PDkj33Hh2iS2R04gQLcEZCqFRO+w4OwVmxPAH2PU3El?= =?iso-8859-1?Q?DmgqoinNFKnTHSAlOPdjZHosxfQnxd2YCwa7I0pG9b1HTWkUOUs23Elyav?= =?iso-8859-1?Q?iwMnfTXOlfoW38xOE8bWSgp9CGNnsb17qQGCjLqum48b7EE/h3qXiiGhwn?= =?iso-8859-1?Q?5n0ANYUbM4V66k/Ab3ibk5ztarz0k2JOQ+TQ4rQ1yuUkzNTgR9+9SAclgq?= =?iso-8859-1?Q?HJ+jz1X+t/EEbdc/yqINITlWEz0/lUp7zH6JiuPtQc1+B3OPLWTK0sUuxZ?= =?iso-8859-1?Q?H1gph11Jdt9+zhU68j+6knTKMEPtlGBKGzdqFiCyDejd7z7z/wvJXObPJ2?= =?iso-8859-1?Q?2QEZ6gvZnXi/4lOgNiaGhkK9GVLqTlojTklNxilH0Zwmbeu02ha7TV1fy1?= =?iso-8859-1?Q?jP+vczQjirWm6gQeKJgqK8lXOZ1+F/G+dWv02ErF6ir1sTLV6+GVSATsZW?= =?iso-8859-1?Q?af/zVvzrcGIcTEB67VQorj6iyGwtxYzPuh6vopR1Cz3mF73BYd2yc3bhBI?= =?iso-8859-1?Q?dQRjQd6dkKGPShQ00+77ysUlMapnrtDnIrgh9FNfODbcuH/BpmQ0pmlv0k?= =?iso-8859-1?Q?PnGrmWV3ot2q/XUsaR98JJj7brmKgo5fcpZYn4/dZy4kRnA9HAqFL8ODdZ?= =?iso-8859-1?Q?mkm+sKUuVttu5/s8EAVLHFMhgKtwxgAxn1PnK29xh5dptieYx/23klsPAQ?= =?iso-8859-1?Q?lIQFMjPbl9GjNUWSflskmdcGrbU2EGj1CT8jY5iWPesSZUT01Jpf5qrYMS?= =?iso-8859-1?Q?o/o5OT5Il8tAzWVOQe7ugZG0YA1T4MxFLoSU6HQJ6mqJ1B+Ng0LxvALn4v?= =?iso-8859-1?Q?nh02zRB6LMFNI15JInj1oLCKKJ9Roj8mHSzbiVGWai4KR5/PGdYN?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: e5ab4289-6e98-424c-2834-08da3c4210b3 X-MS-Exchange-CrossTenant-originalarrivaltime: 22 May 2022 22:26:07.1406 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: pmAzaSa5RAnMD0mJpsUHLDjPbnhEMec3zjUGSANd/qOQbg9GTB6/fTcwlT6Haz07WrWB43bZw3GRbKDB3yPcfg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB2727 X-Rspamd-Queue-Id: 4L5w6G33wjz4hVR X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=lBgrxARS; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.62 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.46 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-0.46)[-0.459]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.62:from]; MLMMJ_DEST(0.00)[freebsd-fs]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.62:from] X-ThisMailContainsUnwantedMimeParts: N Adam Stylinski wrote:=0A= [stuff snipped]=0A= >=0A= > However, in general, RPC RTT will define how well NFS performs and not=0A= > the I/O rate for a bulk file read/write.=0A= Lets take this RPC RTT thing a step further...=0A= - If I got the math right, at 40Gbps, 1Mbyte takes about 200usec on the wir= e.=0A= Without readahead, the protocol looks like this:=0A= Client Server (time going down the scre= en)=0A= small Read request --->=0A= <-- 1Mbyte reply=0A= small Read request -->=0A= <-- 1Mbyte reply=0A= The 1Mbyte replies take 200usec on the wire.=0A= =0A= Then suppose your ping time is 400usec (I see about 350usec on my little la= n).=0A= - The wire is only transferring data about half of the time, because the sm= all=0A= request message takes almost as long as the 1Mbyte reply.=0A= =0A= As you can see, readahead (where multiple reads are done concurrently)=0A= is critical for this case. I have no idea how Linux decides to do readahead= .=0A= (FreeBSD defaults to 1 readahead, with a mount option that can increase=0A= that.)=0A= =0A= Now, net interfaces normally do interrupt moderation. This is done to=0A= avoid an interrupt storm during bulk data transfer. However, interrupt=0A= moderation results in interrupt delay for handling the small Read request= =0A= message.=0A= --> Interrupt moderation can increase RPC RTT. Turning it off, if possible,= =0A= might help.=0A= =0A= So, ping the server from the client to see what your RTT roughly is.=0A= Also, you could look at some traffic in wireshark, to see what readahead=0A= is happening and what the RPC RTT is.=0A= (You can capture with "tcpdump", but wireshark knows how to decode=0A= NFS properly.)=0A= =0A= As you can see, RPC traffic is very different from bulk data transfer.=0A= =0A= rick=0A= =0A= > Btw, writing is a very different story than reading, largely due to the n= eed=0A= > to commit data/metadata to stable storage while writing.=0A= >=0A= > I can't help w.r.t. ZFS nor high performance nets (my fastest is 1Gbps), = rick=0A= >=0A= > > You mention iperf. Please post the options you used when invoking iper= f and it's output.=0A= >=0A= > Setting up the NFS client as a "server", since it seems that the=0A= > terminology is a little bit flipped with iperf, here's the output:=0A= >=0A= > -----------------------------------------------------------=0A= > Server listening on 5201 (test #1)=0A= > -----------------------------------------------------------=0A= > Accepted connection from 10.5.5.1, port 11534=0A= > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931=0A= > [ ID] Interval Transfer Bitrate=0A= > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec=0A= > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec=0A= > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec=0A= > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec=0A= > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec=0A= > - - - - - - - - - - - - - - - - - - - - - - - - -=0A= > [ ID] Interval Transfer Bitrate=0A= > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec rec= eiver=0A= > -----------------------------------------------------------=0A= > Server listening on 5201 (test #2)=0A= > -----------------------------------------------------------=0A= >=0A= > On Sun, May 22, 2022 at 3:45 AM John wrote:=0A= > >=0A= > > ----- Adam Stylinski's Original Message -----=0A= > > > Hello,=0A= > > >=0A= > > > I have two systems connected via ConnectX-3 mellanox cards in etherne= t=0A= > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed= =0A= > > > at 8192, and I can hit around 36 gbps with iperf.=0A= > > >=0A= > > > When using an NFS client (client =3D linux, server =3D freebsd), I se= e a=0A= > > > maximum rate of around 20gbps. The test file is fully in ARC. The= =0A= > > > test is performed with an NFS mount nconnect=3D4 and an rsize/wsize o= f=0A= > > > 1MB.=0A= > > >=0A= > > > Here's the flame graph of the kernel of the system in question, with= =0A= > > > idle stacks removed:=0A= > > >=0A= > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#= file-nfs_fg-svg=0A= > > >=0A= > > > The longest functions seems like maybe it's the ERMS aware memcpy=0A= > > > happening from the ARC? Is there maybe a missing fast path that coul= d=0A= > > > take fewer copies into the socket buffer?=0A= > >=0A= > > Hi Adam -=0A= > >=0A= > > Some items to look at and possibly include for more responses....=0A= > >=0A= > > - What is your server system? Make/model/ram/etc. What is your=0A= > > overall 'top' cpu utilization 'top -aH' ...=0A= > >=0A= > > - It looks like you're using a 40gb/s card. Posting the output of=0A= > > 'ifconfig -vm' would provide additional information.=0A= > >=0A= > > - Are the interfaces running cleanly? 'netstat -i' is helpful.=0A= > >=0A= > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order?=0A= > >=0A= > > - Inspect 'netstat -m'. Denied? Delayed?=0A= > >=0A= > >=0A= > > - You mention iperf. Please post the options you used when=0A= > > invoking iperf and it's output.=0A= > >=0A= > > - You appear to be looking for through-put vs low-latency. Have=0A= > > you looked at window-size vs the amount of memory allocated to the=0A= > > streams. These values vary based on the bit-rate of the connection.= =0A= > > Tcp connections require outstanding un-ack'd data to be held.=0A= > > Effects values below.=0A= > >=0A= > >=0A= > > - What are your values for:=0A= > >=0A= > > -- kern.ipc.maxsockbuf=0A= > > -- net.inet.tcp.sendbuf_max=0A= > > -- net.inet.tcp.recvbuf_max=0A= > >=0A= > > -- net.inet.tcp.sendspace=0A= > > -- net.inet.tcp.recvspace=0A= > >=0A= > > -- net.inet.tcp.delayed_ack=0A= > >=0A= > > - What threads/irq are allocated to your NIC? 'vmstat -i'=0A= > >=0A= > > - Are the above threads floating or mapped? 'cpuset -g ...'=0A= > >=0A= > > - Determine best settings for LRO/TSO for your card.=0A= > >=0A= > > - Disable nfs tcp drc=0A= > >=0A= > > - What is your atime setting?=0A= > >=0A= > >=0A= > > If you really think you have a ZFS/Kernel issue, and you're=0A= > > data fits in cache, dump ZFS, create a memory backed file system=0A= > > and repeat your tests. This will purge a large portion of your=0A= > > graph. LRO/TSO changes may do so also.=0A= > >=0A= > > You also state you are using a Linux client. Are you using=0A= > > the MLX affinity scripts, buffer sizing suggestions, etc, etc.=0A= > > Have you swapped the Linux system for a fbsd system?=0A= > >=0A= > > And as a final note, I regularly use Chelsio T62100 cards=0A= > > in dual home and/or LACP environments in Supermicro boxes with 100's=0A= > > of nfs boot (Bhyve, QEMU, and physical system) clients per server=0A= > > with no network starvation or cpu bottlenecks. Clients boot, perform= =0A= > > their work, and then remotely request image rollback.=0A= > >=0A= > >=0A= > > Hopefully the above will help and provide pointers.=0A= > >=0A= > > Cheers=0A= > >=0A= >=0A= From nobody Sun May 22 23:39:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4D6E71AEC1C7 for ; Sun, 22 May 2022 23:39:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5xkN2gK0z4s49 for ; Sun, 22 May 2022 23:39:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 37B6D24EA4 for ; Sun, 22 May 2022 23:39:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MNd85m006080 for ; Sun, 22 May 2022 23:39:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MNd8KY006079 for fs@FreeBSD.org; Sun, 22 May 2022 23:39:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 23:39:08 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653262748; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Yex9q5soULzFRqPg+u7EV6/7Jeeh/WaaCN44UPWAgRY=; b=I3KXuRbsbkMswybfWB1/8RaorgTXBtPG1CSRW49Kc2dE64YKc8NMN8PVycEjRk1Cuq6eK2 RtkrUPnEQGyjmP0qfx5IhRUsmXFnaZMAqPsBZt3QiL5S/Yy8WHcGh9Zi52Dn/MCIbaCLY/ JkaWK2apdkUSeRUeNJ98gIB2tl2jDSCLKsqVxwu4FC4ZyDpIz9uzNJPmOwZdtzwc/Uhk9C qqMMj6ZNJora9/WIvPJ2sjqCXI6SXNONt5D3WitOVCImkUKdH4Dzy+Yg3wgeK+vt95nL1W lSrdxchxNbAR+JbREs0cwwqhEU+nW8UbeBGh8fhicEG2z62r+fKQoG0ZM1MDUQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653262748; a=rsa-sha256; cv=none; b=l+Nqz/9H+dYgrD5cgLROZckv8vTvoogGzHphXYCYwn4ZlAFnCBPOjEbqu+874nsD+Cf01n n7lQ5odmY7wMw9sC2HNobvgsQbIUv6WrqLtolptvMmAi6WCWL1c7rpg98Kd/6LZwW2PojG 0YE07BQpdMK5W4qNYEUE3hNzvcUQX7dStiWelS1dZdgz/X+iSJPM5IVW/MVTHfR2PT4IDI C70I4RWs83fX3ehEGqZ1O/HpUoOn4K0KMZflwgGNvnRau/NF++/fVC5DCfYHEL+IpsP82q 167UmuZx9OwqaG2564KjMnFLE0LdPMu1HkCfZvIDfQjGU0QL+4Vk7hYzSIY9PQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #14 from crb --- Warner, Every time it gets wedged I have to power cycle it. I've done that a bun= ch in the last few days. 500 times? Probably not but dozens? At least. It = does (did) stay on continuously doing mostly nothing for long stretches when I'm= not using it. I suppose it could be power. my recollection is that I only installed the 8 pin ATX power connector for the CPU not the 8 pin and 4 pin= but the directions clearly say you can install both but you don't need to insta= ll the 4 pin if you have the 8 pin. I don't really have the option to swap in= a new power supply but I could remove the 6 hard drives so that they aren't consuming power and leave just the SSD. Graham, I don't have a boot environments of 13.0 but I suppose I could reinstall the 13.0 SSD and try. On the other hand this machine got a new SSD in the last= 2 weeks and thus 13.1 was installed because the old SSD with 13.0 on it had similar problems and I was suspecting at the time flaky hardware with the S= SD being the cheapest/easiest thing to replace. This was meant to be a build machine and given I can't hit the SSD hard it makes it almost useless for me. Builds over NFS (even over 10G ether) are = WAY slower mostly due to the time taken to untar the distribution files. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun May 22 23:51:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B30911AEF4EA for ; Sun, 22 May 2022 23:51:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L5y103ctvz4tWV for ; Sun, 22 May 2022 23:51:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5D42524DD9 for ; Sun, 22 May 2022 23:51:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24MNpmvt012284 for ; Sun, 22 May 2022 23:51:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24MNpmBj012283 for fs@FreeBSD.org; Sun, 22 May 2022 23:51:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 22 May 2022 23:51:48 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653263508; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vk7zvV1ho/2rj73yUpEP/txwZASYzZ2Mpeq0ZptC+Ak=; b=EXtHcOB5oRb9dwKU5XZ4dnyDrplZPG9Yn0EY7MriWOQeJAZqaJrphVOd8ZTvKLdd/DIFas uUWJLQCmmBmrgEGVYgZ7p9yOezqBfLycSalTTZTG9IvQiXf8yQd+o4qbLLR8vLZjpzMHlY t6+Y1gaF8v8N9txj3Aj3K0fjlnYOrV1mTy5oY6P3DYnc2khuingmJySEWn0AfUNhbEbcJq 4wyXAjqU/q/GKTKNhDPgokLlSNFHWcuBFq0F97kMhNKlf0KAnC/be4DyKUYwL2vJZFdfHE TtRhZtcKF5j0vdkD3kWtFGJieDQhK3Sjz2maHRflcwGFxrU5H3zVfVWLKF9xyw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653263508; a=rsa-sha256; cv=none; b=MfupMHs/queBBaZc6gmQ3BxdhqgaXdRoNJk93BCvqjw0/CgyPlHgClehfuHWuQhxlmFrZG VYzwG1Dd+8P5TW6o3d0eQ6X6RNa84CMC3PnIXcLbewy9MI6hzFdDbu1EYiYX49yYh6KaM9 9+CB1EXgzxVNdv8j71K6H4DARA6L6v676uuVcSO9GO6EApoKenWtHybDjnUzzJ0Nq9yClp LRJZl/fGNsfahe4QtfF/tiMRV99LMVsaemoU6d3aC32HIzzGbwbDQJ1mKdta35z4ZaBHVq YbLAclHf2h6XcWmu2FZGBmt1XO0vmMQjbPn3J7KfpAE59RlF2bzU7iK40vY1tw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #15 from Warner Losh --- If you've physically power cycled dozens of times, but the card is reporting hundreds of power cycles, that likely means that it's got marginal power and that under load the voltage drops to the point the card things it's been powered off. It would be interesting to find out how much that count increm= ents each time things wedge, but I wouldn't rule out a bad connection or current draw requirements for the card that exceed what the either the PCIe bus can provide, or what the external power connectors can provide. There may be pl= enty of power in the system, but at the wrong voltage, etc. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon May 23 18:34:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8D8581AEECF6 for ; Mon, 23 May 2022 18:34:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6Qvt1vLvz3jQg for ; Mon, 23 May 2022 18:34:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 228E114A65 for ; Mon, 23 May 2022 18:34:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24NIY2kh062491 for ; Mon, 23 May 2022 18:34:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24NIY2qU062490 for fs@FreeBSD.org; Mon, 23 May 2022 18:34:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Mon, 23 May 2022 18:34:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653330842; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lWLXg+IpKSFGnN5Llvx1AWP1TroUtkP8nPs1bYv9MsA=; b=Mb0+iohr50HWiI+uDdMl80JjUGAv3KRoQTfPNfCcEpSs1hzi+Z6ZZFkshIUfEH1+AcxIMh dbUvvMeK0w1Q6CQTqiRXOxVrWWXFBUvSTsa2o030DRWuXG4uGUwDU7Wue51s0aPRq6okT1 P1kH45fOj4e65gFROj8FwEruK29xmejMqSwAZIxgl4qQcx14H5bbSjIV7y8fA/Hg8KP1Ri Rx3D5B4BYraaSqO8G+xnvnKxhRGbbKOYJNS5b7zBPIaKb+ikdHlMRdstnTHW0LVMf69Z00 HtkCuufE35Ce/M5CHGoX6vpeqceA3hNPTdwgdMUJ0q6A6Qvnhp5nlJboerwFRA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653330842; a=rsa-sha256; cv=none; b=ecYi4zNbbqun5wl1JYHCwnMVP3Zua+hCuPMXB00LZyB9VWrhgl4XkHeoMWSqFRY9wGFsJs 1sut44K9SHKF2dpD0QRoISL54ytGYv+DQx1CjzY8vyYeDfOsC5Kb20FKJHVV6zU9NHML3E TlcFS3cj+j4P7TIjFvXODxDPxMy3Rc4EOmbUvI0RNZFUegxP0lHrPmy2ox/v4z7f8/Mqwp YrsgaSAIRS6aWpfeqoFXmIodt7MkiUusHZKzyzagCfR5PV3QkbdBUF8iKfTxLw4De25Nz/ 2Jk3W/e/FXD78cTc2TKGGjDIb3DvDuYlOHAgMLB8Sj3nvASsEdBo5mUmOgV91w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #6 from zmey20000@yahoo.com --- If the feature is not needed, perhaps the case should be closed. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 23 18:38:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 64C4B1AEFA4D for ; Mon, 23 May 2022 18:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6R0g1Tjjz3kQC for ; Mon, 23 May 2022 18:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0FAE814F5A for ; Mon, 23 May 2022 18:38:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24NIcBRd063295 for ; Mon, 23 May 2022 18:38:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24NIcBsP063294 for fs@FreeBSD.org; Mon, 23 May 2022 18:38:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Mon, 23 May 2022 18:38:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653331091; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jLXrv17TSdfzWdGmkmrwg/c8tFKB28Np5wGvsH/tuOQ=; b=yZ3WJlO4qJz7glM0b0lxv0U1yL7TgjFo3k/c5H8M6SPBoNGmKnpUcTWt6Lk95PfHoEvyqW dzwe56JvNA4k2bX5tsGXPuYzYhNuE0uzzAyBwktl8fLxO3+s+QVjUeLscnUsUm/7QICB7s 0fH3gbZizO43QlIZhvB2PIMn1iKcmMbhAU98hJWUiptv56csa2Xll0p3XuyM24g7NKjFie 7r2MoTFVa4Y/QFHhzwAFl6No7ST5b79HZfXG7GSfI/mJ1YQHsrewmhH7IZ6IF+3UfhucZ/ S+bme85llZCOw5S03n5VPNL9xEJ0MZyLCYu6iIjDBEG5/4/iBWK8LcaoxsrrEA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653331091; a=rsa-sha256; cv=none; b=gAbuujTs/5cwgc9lq6C9uF0Bmsote4GG3yHoQ3v7gppcNK3oZ7/3Ag02YUsQl5HrD5q4YD F457lxHXHqiZRhWuoK55O4emwKVEiUpmRwk7PVH7qspvufvu1GPuo1yTI+YMavzLVUhE0X 6yhkXWPS7bpofNxCPSptNKItqvqExLvErf688wZPSaExQ4KQg0HLWXwxkCBUzrlSaQ3Yq3 IdSKOUtvw8EumUfL3ONm/P/YKCxGEjad/+qQkDrTp05pPNKgwPnbX0TXJ5psBP0d/Ds0ia MWV8LgoePkrFb4wGrrQkhhFIHzaNvt6j10depO+dXd7oGfTGCD+qcDE+twegXg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 Allan Jude changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |allanjude@FreeBSD.org, | |tsoome@freebsd.org --- Comment #7 from Allan Jude --- zstd will provide the same compression as gzip, but faster Although I don't see any reason we would decide to exclude gzip support, ot= her than the increased size of zfsboot/loader etc. What does Toomas thing? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 23 19:00:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 02AD61B3BA8B for ; Mon, 23 May 2022 19:00:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6RVN5yVZz3m2K for ; Mon, 23 May 2022 19:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A956E15614 for ; Mon, 23 May 2022 19:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24NJ0SC1075679 for ; Mon, 23 May 2022 19:00:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24NJ0SKS075678 for fs@FreeBSD.org; Mon, 23 May 2022 19:00:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Mon, 23 May 2022 19:00:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653332428; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8albl6teJrT5T0BeQ27VBERLZOs3Ro5cIU1YNuP/9e8=; b=vC8TdQtuOEN9jtm49G31qw+iOkZf2ZDgvrNeCxF6GFoNBzmQ32r5c04HFvRb4PJlw2p3M+ K8uRsYlktCf5zm8LibRdujjGybYnrvHV5cTBXrGxnjk/5Vb9KeoaVLEW1hZyEuU/E4uNiZ 8f5+53harfCSyGD5pfHUr4dmwd8BpSsv9Fps+F0j6Py786gy8oJjzTxabONkk1WpqBZYMR iAnr27usfA3qKfzKxox4Yxone54yLvUKwVY/7ezvky3ooNFECaiNsR4wN7J/KPke3Cxavj jsCmkO4fPlmiq7RAKDylaiRRxWl/yJLHMrAvuVXeu6AYTVfUnV55EdGoZBJNMw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653332428; a=rsa-sha256; cv=none; b=wJTRh2OA3q1LIL35FUItpIJ5QeAr//bnqgeXTnLvcTzBosDBPGqIPyX3jyzNyBdQKIgoRo bigc+EAlxPSSfgcIJ6D0kPqCjlomqpmv57rmx2yL3OK1JeP1XTZ/5r1qYKv1NQlflU2QIP bZsMXl/pqQKqjiGavGkomiUd03pIvwxN6Y6L+vbKxTKdYVJIBMZdLawukz+Vq6J1HtjRCc N7k3g/Z/T800PFbRRYYneCIY20B3JbR1VI2+PRK6nJykh3QWWIQfjQ+/OWjyen/Wd7kXf4 DFvY2vdl3yDuSMkMYyfmypvfIdgtPGaFPEB7UAeFV3yTqUSUz+m78pMp+KeZgQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #8 from Warner Losh --- This patch looks good. It leverages code we already have in the boot loader (inflate.o and friends) so the size increase should be minor (should test t= he before/after size). zstd is also in the boot loader (or at least compiled for the boot loader),= so we could use that instead. In an ideal world, the boot loader would lose inflate.o and friends and use= the functionality from zstd instead since that's supposed to be a replacement f= or it. Since we only use it in gzipfs and pkgfs, perhaps that wouldn't be a he= avy lift and that would result in a savings of maybe 20k which I think is going= to be more and more important to look for as the loader slowly bloats over tim= e. the EFI loader is in good shape, but the BIOS/CMS loader is getting tight on space with all we've added to it over the years. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 23 19:35:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 97AE31B441A4 for ; Mon, 23 May 2022 19:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6SHK266Cz3t0S for ; Mon, 23 May 2022 19:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 25A441608E for ; Mon, 23 May 2022 19:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24NJZvYS096396 for ; Mon, 23 May 2022 19:35:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24NJZvZu096395 for fs@FreeBSD.org; Mon, 23 May 2022 19:35:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264174] Use of redaction bookmarks or redacted datasets on a boot pool renders the pool unbootable Date: Mon, 23 May 2022 19:35:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653334557; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lGDN3z4aV6PfrZbw6IL0zlPK7dICjbfELveiedWK9K0=; b=qdjgnzALgh2Gz9e1G6yo3dk1msUg0vlyyZFgMYKSELn4OqCGHWeqY4soHoUsAMDLMxdUD+ S4bFdb2/e+71SwuDp6jiF9Zukakv2IzTkyYw9k3SYW2CoAfnFyJ2gf+zIAUMETkTzNsJb2 4jXOoD+eJVZk1VbI3A7zQ5kmzd9EPEFnUlXw8ItBkE/1Bws3F/AvI8ALwWiwI9HcAy0eEW BUH+AvNaGzplee+0TCQmoHyEybk7T5q2QsjZRwa4CeEm4FunCHgJzwvI5jq7mN9PdFucSV 6FoIeSTxq9UXKBU2Ez3o+9h6QqlQ77ZfNZuK9QjtgoyB1iRuHa0Na67hETW14Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653334557; a=rsa-sha256; cv=none; b=DB1RiZzJaBQia9+MLz13fAv1tL6V4BBi7nz39a0foA3wxpFAAckZMOHDzjHRoL7ki2pksK 1kGkXHrJJsSDnMoyn6wCv3aPfhls2UiK7kiObWAyQDyqzFm7CwZjxKKtxu9rpnt9GYj6Be Tg2QSP2PGFjEpCAagVCWIC3z6M4OoaJy/cfCC3fAwfN9CP7+mYhMEX6MIo+6zgeIACweOz kJudZEjeSHH6mqFq/mkdt1pJskRlEcorpWJizPHknCuk9hYukk7BoFTi+AX5Vc/3XQvjhR 6lziChUjoFsqyBi6fcwXWSwt1jm86DVGqmffqM1YdmBXNDGZaNAKYSbiALdDfQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264174 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon May 23 20:02:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EBA3A1B4936F for ; Mon, 23 May 2022 20:02:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6St65g2Zz4S09 for ; Mon, 23 May 2022 20:02:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A330C1643C for ; Mon, 23 May 2022 20:02:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24NK2cWg011187 for ; Mon, 23 May 2022 20:02:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24NK2cYb011186 for fs@FreeBSD.org; Mon, 23 May 2022 20:02:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Mon, 23 May 2022 20:02:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tsoome@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653336158; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EBXXUJugMTZLkTAE6iqdP6PU9uLGztuNdGWTFIkDBpc=; b=VG5xG7XMuAdteKAggMPU/4/tjrSNxgqGqeECLark7Fo6qTL6o7/hNqNG1DQoS5KXc2InA1 wUAaB6UnSv9fyxwSg71g9BzM03DElxfVM4hVq2VmFi7VfaVuNoa9cwojbWJ49RoUR3Qryh RSRU4GDGaEr9AizpKckLDZY3z4H/StDnBbTi6/obcMJSF54rcpiRlzyaJC6hIMnjfNPaho Ud2lxyScZ5gdRmMsOgCQEcSzrX2XOIlnPsDlbi35b6A48g+0D0NJv02+rf4SD1gXmews5z JFyojOIx1v8GUmvBrh9U6fZp+HUUNesuycbPuf6Tkyy3Bryg5o85iI7cQYcvlw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653336158; a=rsa-sha256; cv=none; b=PzL4IBa+rPiN6BiLTSn0KKh3ciVNHH+PvAHJ1FiNpffItwvVb9Wa26Dd+rSuv5GxvQkmci khcFRVeQwL2OE0jBYfMyHHAoJ/LbTw9xuB3EML0wJ0nguq5INmxdETHBWlAM5iifVWCxON j47dNsHsIj4IY8adt3pVlahiBCS8D5VwNIICtFosMJvcBhnpnvDIws1Mz4R3qL9gmJ6ZX7 FWLiHe8DhpShH2nlYD4klrB+hYBf9xy3zPfZiX94AA4kEG6SGv2SalK3dSJbxI1NldlgPe w4ZViTKR0fnzwjQeQ3oaUFqpONURRoBXkjaXhvb7iYTy261FpgQDQ9C9hz4+Mw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #9 from Toomas Soome --- (In reply to Allan Jude from comment #7) We already do have gzip in loader (gzipfs), so this will not add up too muc= h. I did not realize FreeBSD is not supporting gzip boot:D >From other hand, it does not seem to be like vita function to have in loade= r, but again - as we actually do have code there already, the price is just ab= out one wrapper. (Apparently I did add it to illumos loader in 2015). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 00:33:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B277B1AE9062 for ; Tue, 24 May 2022 00:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6ZvC1V98z56L3 for ; Tue, 24 May 2022 00:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 145D31A783 for ; Tue, 24 May 2022 00:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24O0XxX9072451 for ; Tue, 24 May 2022 00:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24O0Xxak072450 for fs@FreeBSD.org; Tue, 24 May 2022 00:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs refuses to mount glabel label. Date: Tue, 24 May 2022 00:33:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653352439; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9iB6iiAXNlANjtvcxhymxDUpjg+X6M0CximFkwmsAIE=; b=IH2ayGpg3QNmYaMedLoF4dNot3X6rQTB3wQPLnfZvcHkbZNwqNWxeMgslG2oYZHkN32ozk GpMWsarLOe9m2Z6JVko1ki0SzNEo2mJSlCAG/68i+aPylz7iyCe4xOjKbhTNRLRNvyfn6d W1xewV8xueZBKEk9ux1XWb6mYgrxAbWMH4ZB15v9/edsqJO5oY2OpVWvHtJLsVyDkOP7xS 8fIRAtd2d8bo3JpVn72UZ5oMZHjByW5v33jJyLXKFUIhm9akLhh5PdDNmmhqiLuGmWnqia eu+RiXFys4Am/2MWr4uQU3BPGjoCB/7GarY5ByiXs3hJo0fFnGWpYq6DBqOnpA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653352439; a=rsa-sha256; cv=none; b=iJ2yVj0T/g2EWYcwrK1pywk2ckk5M2fCqM9szDf0+h1NKqmOaQj4o9bvJ/pxELIiv9ESGZ w2L7IqEnyzxQ+lBHkB9ysCtcgWzbFVuGEuh7SoUB7+tL5cazo35zJBd/FSprKz9HAfuiJF ktxpo4AQwiCxub2rCk+s6D7QGd+cHRIZT82PqpgDcOE0W5ksJ4Ttz1SP6phpmi+JNbnw5P cX9i7mAp1Y2Ki5v/q4+G3kT+IZlagGBvL8/JqsGBupGCn1mMWZ1sp99tXSJnVVH6LmKOf7 IucNQ5TmEwicABCadPT5DyXlpnjOdxO6qAKW9+83ncsr5SbjJV23i8C3OxghYw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 00:45:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B770F1AED6F7 for ; Tue, 24 May 2022 00:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6b8X39vjz3Ccc for ; Tue, 24 May 2022 00:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4DEE71A538 for ; Tue, 24 May 2022 00:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24O0jWjr077436 for ; Tue, 24 May 2022 00:45:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24O0jW5g077435 for fs@FreeBSD.org; Tue, 24 May 2022 00:45:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs refuses to mount glabel label. Date: Tue, 24 May 2022 00:45:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653353132; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HJl/oHkOjLab+CinTRyYwF5uSXJhnSbkws5AQ7ZpSGo=; b=SJNH7G9DSsZp1voVZLIYkJvjKSDg3RCfESGrVRIR4MmgxvbgJXQD+dfA7VlDbPu7g6nf71 +WF24VydLjtctSNlxz8MAavWSuHVZnN8PEnEFer752a0zNPQq7Ac1m8Dl4FXCynBlisjOd O30E7JWVkuFZ/eTD57i728Lhxp0Q9KvtxAwhAd1hEFp/LHfS7T9FEb3s/jIEmCFX8PEJIQ IZkHARSOLaOyVFlX0E6ZDcC7oa9/4ax9LN6KzrT04bx6R/+91mJa88gk7x/Av46Ow5OhSZ puNFnJ3Fwo3hbHVmuJj9lXBrpLbJg3VN/SZue222i+XCkO9/R9zNEVIdmiL9oA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653353132; a=rsa-sha256; cv=none; b=LxQPNKGIZoHZ+1Nz6HsBD1B6TTq+uwDFZq327j0vhzIDgSoI4iXfjhYkWzlGUgQPdGaSGV A/HFLlB7iEMQX40jO5sVe9w/CRNZbiNqJYYCVtTCuVI47zfsDzJn5Mf47zeOzn4kvh7893 MJ2CNdeRBKC2G5ypwjgzJaEs/R7AEP8DRfoCkwn+X9SrrIhZaKfbNK00+QTQH4DbLPR3g6 d/45z2LIcFvWT8oQSpORhcq5KL5bxYLXiDhFdbKhaWmQpUj++O0nX/k+PaGi3E5jecb5kH vze9zdazkgoL+CfpvhQVwWsvzd+OH0+unCHR7wgORbCPu1fWSqu/8EOnP4Of8w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #2 from t_uemura@macome.co.jp --- (In reply to t_uemura from comment #1) Specifically, the following condition is the culprit. (off_t)pmp->pm_HugeSectors * pmp->pm_BytesPerSec > cp->provider->mediasize /* past end of vol */ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 03:02:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 74B821B4F341 for ; Tue, 24 May 2022 03:02:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6fBl25c1z3k0y for ; Tue, 24 May 2022 03:02:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2934F1C6A7 for ; Tue, 24 May 2022 03:02:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24O32dQu056073 for ; Tue, 24 May 2022 03:02:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24O32dP4056072 for fs@FreeBSD.org; Tue, 24 May 2022 03:02:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Tue, 24 May 2022 03:02:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: flagtypes.name bug_status keywords blocked short_desc cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653361359; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ydLgYeDUW6KmtZCyJKcVTkLKBaRhPtE1D8QGJuzMUMI=; b=ByQcRftHhi/rSgCuqZ+4BWZvaU1phtvRzwRwV5cxjy/5FVKn451eurFP4htBDQNyX5Amhw kBzsF/dc3R1ogYii9H+n4VWK29GB6uPo0XfM0LKpPArX6pGcmoZXjihyv2cGdR2Htf3meL J5oIu5/RPO8ifOaQ3/EunOQ3lsPx2jf3ffAJQVOvDE0fnh98pgmR0VvCryTyMoMaVazG5C ABYRAMk3Z8qZT0YVnPGe7sXGXnjFkT+5ZrWXJyzY5HhqAZsws+cliSV0DCgF+fGjZzkJUF HiHHbjsyhKdBCZfbmhc46fH2jX/sONksgD4D3RaU9ALx8rEg6Visqqznmi/3kQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653361359; a=rsa-sha256; cv=none; b=SgaM8/8peK5p8+EmFh9SDzy6bPs/trJvoNPPeqlKiXrp7h7b4owlmFCZVtsedjBZCYnLqS 8B6IZay2m+B+sH42LGwNSomqMzKNjssEo2qnUV8iQRVD2ulLcdSpqUwU/NCVJyQhHfTnTr JN7Ksuw5OT1fi08HJ6VQ92TRofAyg4ATbs+NnuVF9A1qx0tP7JTPTxUrzGY0MCiPVZ+osA l2715v1M8WlhyEnxa2xqBmSaOJxgzVYIqa8bkVB92ro7cyrQ+x0il+Qt9ylbySZLTpIcx2 c6eGXCB4BA482hicnXhPsvbfggHpaNbde/eC4sIUVJ+hGAd2tWGBIzdRIl+Ajw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Flags| |maintainer-feedback?(kib@Fr | |eeBSD.org), mfc-stable13?, | |mfc-stable12- Status|New |Open Keywords| |needs-patch, needs-qa Blocks| |264030 Summary|mount_msdosfs refuses to |mount_msdosfs: Fails to |mount glabel label. |mount glabel label: | |mount_msdosfs: | |/dev/label/MACOME_CONFIG: | |Invalid argument CC| |kib@FreeBSD.org --- Comment #3 from Kubilay Kocak --- ^Triage: Request feedback from base c5c1537dc7ff Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264030 [Bug 264030] [tracking] 13.1-RELEASE issue reports --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 16:10:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9653A1AEFE93 for ; Tue, 24 May 2022 16:10:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L6zgh0s33z3F1Z for ; Tue, 24 May 2022 16:10:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D3F552791F for ; Tue, 24 May 2022 16:10:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24OGAN8U091347 for ; Tue, 24 May 2022 16:10:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24OGANJA091346 for fs@FreeBSD.org; Tue, 24 May 2022 16:10:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Tue, 24 May 2022 16:10:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653408624; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Jrlwin8YUm9L8957FtOsb2e4qREffuPZ2s+HCSLckSg=; b=aRGkgfldFBG12WAMHyi/3qgE3rl2cTQ2QfwFZl52jGhVok+EL8dwTJ70eD4G33r1QPNJ1N bOuTBjfgsv/Bs2OxlUiZVNOoVJWAi8uCodiTKwY6i4I4kcojL5Z1jYaFBVmSFhe70hJQ50 3S9di8vBxgJviAtZ7yB+5HLG6tGOrmfE2FppR48wSoiaq5LIkHvzluvby9+f/fj3f7U9Vs LHNKXjSvwkLmgn+s/rHDWIR9VB3MzcVR1CiVPM28KeFwz+lhnzIUBTYN867/M+KIf46s2G Ak5sSEeFNyiVWP0g4xKgBgo6OcxzUa5uuTptilT7e/s5DrGd0zj67TkSMsB61g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653408624; a=rsa-sha256; cv=none; b=qyKjyH7v3zbF9zRB0BZmC2IheSNon7ZRTCCO3DdKPHpzBuoK5aByEtBFsB6oAbJSFKGUsU TMsqstnJybVLx4VXrrVQcGc4UpAKgypkoYQy6T85Zf5xFPJsSwPFtjCk0jyEZ6TlplPv6f bFvmqzaKbiWqlrS7AWFr4RUDdBMN/oib9opAd7s/iH8C9Ll+1QIR95H+sbBy//6jLgucaQ 3f6CTuGa/aduexOUxL1C4+BcuEddCn+S7q3Vt5eUl4u7GRHwrlHMVOXyuJW4cKQkZEUYyp U9Lqlg4c/99+aKh09IzXGpK1AfXfVks+O81wGM1+PgfbTh5H2nnk7EfQlnMweA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |markj@FreeBSD.org --- Comment #4 from Mark Johnston --- (In reply to t_uemura from comment #2) How did you create the filesystem and the label? It looks like you added t= he label to the partition after creating the filesystem. But the label occupi= es some space on the partition, and I suspect that both glabel and the filesys= tem "own" that space. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 22:26:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1C47E1B3BCC5 for ; Tue, 24 May 2022 22:26:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L78195qzyz3GWj for ; Tue, 24 May 2022 22:26:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A5F734A7B for ; Tue, 24 May 2022 22:26:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24OMQ52L001356 for ; Tue, 24 May 2022 22:26:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24OMQ5Dc001355 for fs@FreeBSD.org; Tue, 24 May 2022 22:26:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Tue, 24 May 2022 22:26:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653431165; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qa6GzrB5n1Ivq8q4dt0iSlTorL12H8eeIYuXkxs35K8=; b=pa1WJsrTP1+lnhwPbr+7qn76gFzfUYHTQDcAskZmXY+GlGEq1f+54F6+pxUDuqFgEfpwYA cW5CNdQsaKS5ovrW0K86pcoWixMOIn6VREJTYmZskM0Ldgaam2rYuBDlWjrwHNTRGf3zBB gonld6qKU4LpOWE4VrogjRrT7pF8cr/GjEs6YNoggwUOqUzyFnzo/3AlIFIBWzuIZXqJBi reVinJCvdpu7ZdKKDZ9R/qwarbKFEqDyBzsAOOKouts5sxFjDn7MJ1Idyil9ebhufnxAoi ZUiuTEf/IIH47vFvgIEQEwzKAmvHATsPw9bgVMxK01IV8W5+nCHUDf1V6N+cwg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653431165; a=rsa-sha256; cv=none; b=Cc9G0IbJHj4222BATmnUWmRGluA39BIttxvtJEaPasT1xvXBl2XwycsR76ELY7zEo2LRgD YAAwicFY7cb4z0cVywQLO3QsnsCg8x8xjtmN64Z3sz3t+vc6gactTTDPwoENQu1LCuM6mx NTytWniKkBgYuhxuYICDN9UGcVsSeZN7JQrf3VUtHUUSz9/1gxf6GBE1KSsJqF+f08zbbW oD4/dnalUm+KUjCTLxWG1w9Wj4VOE7/6TbU9FhkGs7sPMuv5atY/lnJxdAVb374NGDns2Q P0ucy4vnXvnRYORgSUQJ0ySeumvfBXEgl6HShypR1ne8q91Qkbj4oLr6jx2vbQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #5 from t_uemura@macome.co.jp --- (In reply to Mark Johnston from comment #4) > It looks like you added the label to the partition after creating the fil= esystem. Correct. I'd put a label on an out-of-the-box USB stick. So, will the problem be resolved by re-formatting the disk via the label by newfs_msdos? Or maybe reformatting with Windows won't fix the problem, as Windows will ignore the label? I'll try later today. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue May 24 22:30:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B7E591B3E249 for ; Tue, 24 May 2022 22:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L786g0v6lz3J24 for ; Tue, 24 May 2022 22:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7B2255414 for ; Tue, 24 May 2022 22:30:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24OMUovX002249 for ; Tue, 24 May 2022 22:30:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24OMUobh002248 for fs@FreeBSD.org; Tue, 24 May 2022 22:30:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Tue, 24 May 2022 22:30:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653431451; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9SMCfKSucgXHI2JkV37vpJsLJOEGpjlXaOtWy7oEfzo=; b=FtY4PXVIf4ZR9zDPeYeMDejRsURHBtwDUpAYrd7kd+X8Z9LSFcpuy/gpZEgdrxugwCcN0A pNtyjiAXAuXSDn+/ww6PgudWvu7CYPgTzoRfw7CdkBrysY6RquF4/1pA1G54zmEfZ8/gTp 5o6iJcnU73x94K9Xw3h7mSRkq5JN+PiqY7xoqy6b12+BJXM0qrAJLiKoDn4xtCbA0Oyuff EgTYSOOYUlyFFnmtViJt2z9XOhbI9SvDJ722QaLZsh+/nBiSTYM9quxHNJxxqoA1U1fsFh amEPsmqj9X85YAUQ7nocoICNGVX8JZAQOG12iYbEZaLjZm1a61tHj7PGCMXwtg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653431451; a=rsa-sha256; cv=none; b=sbcMpHiW9AZYJP985W4hZ/cND68hI3gZqcaS454j/ouwuK5oRamEKP4w869tE7Ks3T5xlg oZbWAo/UFYr6+ls/b2UEggocPJm67C+t5EgbHNEFIO1bmWXYQ6sFHY8Rlsd0tyhJsZshPg i4kO2XWMZJiNPM2s7vFxRQXcbIXgNsn/d3T0jL/qigg8JwN14eVRpchziN9NQTFpotnkAD bTwMWkam+ssroPL1fP4WfkvS6vuI7PwwpShohGdK2umN+mSDpq2eVWkn3G1afnqskoWB+G 1HTXiEyWA+FkCcgGIa/PMH8JgIiK83zw88IvODtxYf+QLG8ecaJ4diWMR1Ty5w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #6 from Mark Johnston --- (In reply to t_uemura from comment #5) Formatting with Windows probably won't work. But you could perhaps use the embedded volume name instead? The FreeBSD kernel will find it automatically and create a device under /dev/msdosfs/. Though, the length of FAT volume names is quite limited. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 00:41:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C87A41B42CE1 for ; Wed, 25 May 2022 00:41:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7C193nfWz3tZ5 for ; Wed, 25 May 2022 00:41:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 602966D44 for ; Wed, 25 May 2022 00:41:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24P0fHhh074394 for ; Wed, 25 May 2022 00:41:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24P0fHP7074393 for fs@FreeBSD.org; Wed, 25 May 2022 00:41:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Wed, 25 May 2022 00:41:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653439277; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Iq0q2CDUer4TY0HhuzFbBmAi8D+1/l2lrAKGdTKtP6c=; b=Nv59pYSKvNpRRFnClJe+3TDAxaL2othrIa+XI0XkuLoGuE97th/ORFYFgckOZe9de2fQ+L 9i4OnyctgtTmiZMrUZ2I8kCEAlKNWjBMDgZyWSZC1knu0oS5CAW7K4rMxh90MliWf4697b SOx0cZgZuqu2cVRM0ksXgTjTEQavuXYZQ4JOX3baAIQOhxhVik8G9kZsSG6SiCNs3fhbvt stUQPgwBQ+fRsuJ5AF/5c2SnNb+eaAm5T7HTynFrMJQG0ao88crRBtbrqj1HCwexhDgsL/ jCO+jizbkzGk8716/5nvxGe8g6Xy2XLXwk7soPlbsZSgGKpBC53Y3VfRBKkuig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653439277; a=rsa-sha256; cv=none; b=O6/WfiG9mkd0S/nzhV4kvhBrl0LuPyh54PQ8KoEUBNIdLHYLwNMydPMXvQNdTZ7g5e7s0j dEwAq+ZS9bn33H665NR/PPTithJdC0R/aizJ1GfpLvEuyKWVO9Xsny13KllYAnbhRotCKP Taaf2MLzvlQkI6jAGAERE/BQ2U16F3OOAB3PR4qLLJJvY3IWCbNhXrI3PZd8p8/n9vVqOW AJzmctVN+00Vi2zV9Gk/drbUSFX8qRgX4sTJH87IbSRfF8dO20nkz3Y8Bdsgd7ktYXASMc 77N329NNg2OKf+I3e2RZ+mRqDIrVCsq3nuQc8IpJ2QeFkavWiSHxu1bhSVKnmg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #7 from t_uemura@macome.co.jp --- (In reply to Mark Johnston from comment #6) Re-formatting with newfs_msdos does resolve the problem. This really is not= a regression but my improper usage, but I appreciate if I could have a notice= in glabel(8) or somewhere. Should I close this issue? > Formatting with Windows probably won't work. Formatting with Windows doesn't work. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 14:04:28 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 00CD21B4B435 for ; Wed, 25 May 2022 14:04:47 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yb1-xb2e.google.com (mail-yb1-xb2e.google.com [IPv6:2607:f8b0:4864:20::b2e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7XrF37XFz3kPw for ; Wed, 25 May 2022 14:04:45 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yb1-xb2e.google.com with SMTP id s14so9109563ybc.10 for ; Wed, 25 May 2022 07:04:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=WqauYeIpDzfQH2j9BQM5W12L1mbzOU1bUIOKiyZFlCM=; b=X3iwiRd/c10rNXi7zXibRKznavNgOBh6JFIldMS7ckzYYGh6M6SJL9p7a016zS0srC ukW9+0rY4pLsgfqtl09N6MWyXsBOiRifA8Vt/3mGh5dcgShn7d88iAtOio4/1s28SO1F OPIBUnjj8tbmKIenncEQLjPjAjxzc8E8WH5cYHnp2wbCCHkOrlFZuF21CLtL/sD84Fe4 eyw7IkQ/1wAayqnt877x66ZllG1a97n4Mx5j/z/d1nHlkHKCYzKnOJh3IhUVSFKuBIyw dhyFQfs2xA0+C0LOIcqX8PLbsyQ3KuLAdjFtvkkfs5BVbvIo3uVlM094j7WHAbctvgd+ bDtw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=WqauYeIpDzfQH2j9BQM5W12L1mbzOU1bUIOKiyZFlCM=; b=6/nIOijvIALCro4uiquqkr1rdBMohXDv6+wOGKIYyk5Luumtd8kI6D17Q4IIK6nTCX WNIal9Y1giXofGd6YI3c31n4GqwsLhj3LUj/6nsZsFnvXBK/GJIfiScHObEnl8K784iF lgqhxpr9auZQefZ2W/+yiSmOUnDz3vRdibpq6CDagrLbsbV37dRng5pjRTPlPh2iqNNj JRsSU2XyyBJHVijhl7U+9SS7De+/e1I72FPLLe2jukDoQNOqQqVFM6yN8Mx7JBSPN06V 0r6Qc/hQBw642yCU4IZjyQ1rPmrTKgJpRBLxDQjH1qjSUCZajp1aQnSyxe4fGWYlPy32 k3mw== X-Gm-Message-State: AOAM530c+uBnicCoAux5jVsMeoZ8JFZOKKTEqOchkt9NVNRilzkH5TlD Ixn+JSCi/KH1q3HtzJRg2jdWAyZlrTpHl/gfPGt3N0TS X-Google-Smtp-Source: ABdhPJyPUbwaazpFyJWJoUiJ67eAFRerYtQgJ+A/mQiwCxkrKpxcTemQr+/KqWcywDunuDvrDt2zBpFuD7cgUFW/eNo= X-Received: by 2002:a25:9e10:0:b0:64a:e7e7:d452 with SMTP id m16-20020a259e10000000b0064ae7e7d452mr31713743ybq.201.1653487479399; Wed, 25 May 2022 07:04:39 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Adam Stylinski Date: Wed, 25 May 2022 10:04:28 -0400 Message-ID: Subject: Re: zfs/nfsd performance limiter To: Rick Macklem Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L7XrF37XFz3kPw X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="X3iwiRd/"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::b2e as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-2.73 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.27)[0.267]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2e:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Obviously I don't expect you to know the answer for why Linux is hiding this option in their sysfs tree, but it wasn't entirely rhetorical. If you search for ways to optimize NFS throughput, the readahead option usually doesn't show up unless you search "NFS readahead". I figured for the multiplexed connection configuration to actually work it had to be doing parallel reads in some fashion but it wasn't obvious that there was another option client side that had to take place for it to work (all of the little blurbs about the new nconnect feature seem to just imply it works magically out of the box, even with 100gbps links). The closest thing I could find is somebody complaining on bugzillas that at one point it was too high and caused some thrashing for them so they capped the auto calculated readahead to be 128KB max. It's also a bit odd that Linux exposes this tuneable as a size rather than a number of parallel reads of the multiple of rsize/wsize like FreeBSD does. Anyway, thanks for the help, CC'ing the list for posterity and to help future people on 40gbps links that seem to hit that 20gbps wall. On Sun, May 22, 2022 at 10:08 PM Rick Macklem wrote: > > Adam Stylinski wrote: > > Good call on the readahead option. Evidently Linux by default sets > > their NFS client to only 128kb for their readahead and the setting is > > not a mount option but something buried in sysfs. Setting that to > > 1024kb, I was able to get ~30ish gbps. Is there a reason this feature > > is so scantily documented and well hidden? > I'm not sure if this was meant to be a rhetorical question, but for FreeBSD > it is described in "man mount_nfs" along with the rest of the mount > options. Also, for FreeBSD, the default of 1 block of readahead is > normally adequate for LAN network connections. > > I'll leave the answer w.r.t. Linux for others to ponder, rick > > https://docs.microsoft.com/en-us/azure/azure-netapp-files/performance-linux-nfs-read-ahead > > On Sun, May 22, 2022 at 8:29 PM Adam Stylinski wrote: > > > > I've actually seen this server drop interrupts on the floor when too > > many things are hitting the NVMe interface and the mellanox NIC at the > > same time, so I wouldn't be _too_ shocked if the ability to service > > interrupts was a limiting factor in all of this. > > > > My ping is roughly 310-480 us: > > 64 bytes from 10.5.5.1: icmp_seq=1 ttl=64 time=0.039 ms > > 64 bytes from 10.5.5.1: icmp_seq=2 ttl=64 time=0.035 ms > > 64 bytes from 10.5.5.1: icmp_seq=3 ttl=64 time=0.048 ms > > 64 bytes from 10.5.5.1: icmp_seq=4 ttl=64 time=0.031 ms > > > > I'll have to look at the nfsmount man pages for Linux to see if I can > > find a readahead parameter. > > > > On Sun, May 22, 2022 at 6:26 PM Rick Macklem wrote: > > > > > > Adam Stylinski wrote: > > > [stuff snipped] > > > > > > > > However, in general, RPC RTT will define how well NFS performs and not > > > > the I/O rate for a bulk file read/write. > > > Lets take this RPC RTT thing a step further... > > > - If I got the math right, at 40Gbps, 1Mbyte takes about 200usec on the wire. > > > Without readahead, the protocol looks like this: > > > Client Server (time going down the screen) > > > small Read request ---> > > > <-- 1Mbyte reply > > > small Read request --> > > > <-- 1Mbyte reply > > > The 1Mbyte replies take 200usec on the wire. > > > > > > Then suppose your ping time is 400usec (I see about 350usec on my little lan). > > > - The wire is only transferring data about half of the time, because the small > > > request message takes almost as long as the 1Mbyte reply. > > > > > > As you can see, readahead (where multiple reads are done concurrently) > > > is critical for this case. I have no idea how Linux decides to do readahead. > > > (FreeBSD defaults to 1 readahead, with a mount option that can increase > > > that.) > > > > > > Now, net interfaces normally do interrupt moderation. This is done to > > > avoid an interrupt storm during bulk data transfer. However, interrupt > > > moderation results in interrupt delay for handling the small Read request > > > message. > > > --> Interrupt moderation can increase RPC RTT. Turning it off, if possible, > > > might help. > > > > > > So, ping the server from the client to see what your RTT roughly is. > > > Also, you could look at some traffic in wireshark, to see what readahead > > > is happening and what the RPC RTT is. > > > (You can capture with "tcpdump", but wireshark knows how to decode > > > NFS properly.) > > > > > > As you can see, RPC traffic is very different from bulk data transfer. > > > > > > rick > > > > > > > Btw, writing is a very different story than reading, largely due to the need > > > > to commit data/metadata to stable storage while writing. > > > > > > > > I can't help w.r.t. ZFS nor high performance nets (my fastest is 1Gbps), rick > > > > > > > > > You mention iperf. Please post the options you used when invoking iperf and it's output. > > > > > > > > Setting up the NFS client as a "server", since it seems that the > > > > terminology is a little bit flipped with iperf, here's the output: > > > > > > > > ----------------------------------------------------------- > > > > Server listening on 5201 (test #1) > > > > ----------------------------------------------------------- > > > > Accepted connection from 10.5.5.1, port 11534 > > > > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 > > > > [ ID] Interval Transfer Bitrate > > > > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec > > > > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec > > > > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec > > > > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec > > > > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec > > > > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec > > > > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec > > > > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec > > > > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec > > > > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec > > > > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec > > > > - - - - - - - - - - - - - - - - - - - - - - - - - > > > > [ ID] Interval Transfer Bitrate > > > > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver > > > > ----------------------------------------------------------- > > > > Server listening on 5201 (test #2) > > > > ----------------------------------------------------------- > > > > > > > > On Sun, May 22, 2022 at 3:45 AM John wrote: > > > > > > > > > > ----- Adam Stylinski's Original Message ----- > > > > > > Hello, > > > > > > > > > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > > > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > > > > > at 8192, and I can hit around 36 gbps with iperf. > > > > > > > > > > > > When using an NFS client (client = linux, server = freebsd), I see a > > > > > > maximum rate of around 20gbps. The test file is fully in ARC. The > > > > > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > > > > > 1MB. > > > > > > > > > > > > Here's the flame graph of the kernel of the system in question, with > > > > > > idle stacks removed: > > > > > > > > > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > > > > > > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > > > > > happening from the ARC? Is there maybe a missing fast path that could > > > > > > take fewer copies into the socket buffer? > > > > > > > > > > Hi Adam - > > > > > > > > > > Some items to look at and possibly include for more responses.... > > > > > > > > > > - What is your server system? Make/model/ram/etc. What is your > > > > > overall 'top' cpu utilization 'top -aH' ... > > > > > > > > > > - It looks like you're using a 40gb/s card. Posting the output of > > > > > 'ifconfig -vm' would provide additional information. > > > > > > > > > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > > > > > > > > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > > > > > > > > > - Inspect 'netstat -m'. Denied? Delayed? > > > > > > > > > > > > > > > - You mention iperf. Please post the options you used when > > > > > invoking iperf and it's output. > > > > > > > > > > - You appear to be looking for through-put vs low-latency. Have > > > > > you looked at window-size vs the amount of memory allocated to the > > > > > streams. These values vary based on the bit-rate of the connection. > > > > > Tcp connections require outstanding un-ack'd data to be held. > > > > > Effects values below. > > > > > > > > > > > > > > > - What are your values for: > > > > > > > > > > -- kern.ipc.maxsockbuf > > > > > -- net.inet.tcp.sendbuf_max > > > > > -- net.inet.tcp.recvbuf_max > > > > > > > > > > -- net.inet.tcp.sendspace > > > > > -- net.inet.tcp.recvspace > > > > > > > > > > -- net.inet.tcp.delayed_ack > > > > > > > > > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > > > > > > > > > - Are the above threads floating or mapped? 'cpuset -g ...' > > > > > > > > > > - Determine best settings for LRO/TSO for your card. > > > > > > > > > > - Disable nfs tcp drc > > > > > > > > > > - What is your atime setting? > > > > > > > > > > > > > > > If you really think you have a ZFS/Kernel issue, and you're > > > > > data fits in cache, dump ZFS, create a memory backed file system > > > > > and repeat your tests. This will purge a large portion of your > > > > > graph. LRO/TSO changes may do so also. > > > > > > > > > > You also state you are using a Linux client. Are you using > > > > > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > > > > > Have you swapped the Linux system for a fbsd system? > > > > > > > > > > And as a final note, I regularly use Chelsio T62100 cards > > > > > in dual home and/or LACP environments in Supermicro boxes with 100's > > > > > of nfs boot (Bhyve, QEMU, and physical system) clients per server > > > > > with no network starvation or cpu bottlenecks. Clients boot, perform > > > > > their work, and then remotely request image rollback. > > > > > > > > > > > > > > > Hopefully the above will help and provide pointers. > > > > > > > > > > Cheers > > > > > > > > > From nobody Wed May 25 15:36:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0069B1B42B0A for ; Wed, 25 May 2022 15:36:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7Zt45kLlz4Ylk for ; Wed, 25 May 2022 15:36:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A12FA1C080 for ; Wed, 25 May 2022 15:36:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PFaSrE083592 for ; Wed, 25 May 2022 15:36:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PFaSNZ083591 for fs@FreeBSD.org; Wed, 25 May 2022 15:36:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 15:36:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653492988; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+6zMtHX/ZkKFGFTEuJh+BJDQ7llSdASBZyMumLUr44E=; b=ONNp+FH8H6JJdsWM4/6HboCXjlsiOgGfbkW5xF2yM2a/9WrbMufHWBvLW/CZZJkvu/Jdj1 wh34MmqKYAU5U7EgIGgXJ9UDKm7SjNAbLi8WzsMs22xcsINYdYomhNPkciWvP56SqW1djq RVRrS8CA6pHEEk6IU9D1wvo5ZEwCbp1ZxyAWqHnlmwuvDAr/Kw0kA3k+IOOfX6Nb0PUw6y KGxRxpF+5+5nJtIqfqfABKxGbGnK64o5cQUO9II51LhbEM9s95mOuCf626dHo4YX2J/jg6 hCmyYrL7rGpLcu/ENjcSQ+gasSwZ1wpZR9VylE9rttcODNzyspWDXYWrPa3fgw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653492988; a=rsa-sha256; cv=none; b=Tm/R2ARQKfHdotUShGHuquLngLkzIRJq5mtAZ2EGXGH7AF+tEDGj1LaAQ0fX3IdI1ZSu2O EZU+YIRAQMqj5/wLprTlj2+dANACidAAOROszLk9McAE/FV2RXxRZsm2YJTrkHnAvmQjrg +jQ+vJUjvNvxBG0Jk1N2hKVWoibNOj+zC+CHLNOdioZBx1Hf76C6IdaVQXSkrfp2wr2wyW 8pFA6kPW7yA9a65mEFs3AoYkWIHJWAML+st24NTHO6amYdfQTQDX2Dk5sb+FIjav0GtBCF MNom6JkS+gDbMH4W5F39GNgl+TN05JWZ9OrxSgvCtfl+oAaUX6+2e6pPO7DnHQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #10 from zmey20000@yahoo.com --- It looks like everybody do not mind of the change in general. So, what's ne= xt? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 15:41:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 087A01B442F9 for ; Wed, 25 May 2022 15:41:57 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2050.outbound.protection.outlook.com [40.107.66.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7b0M58G7z4bVj; Wed, 25 May 2022 15:41:55 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Y53Igig/2I0QqNva6RaBYD5Zf5PiabYWuGBr1jko2ilcY3tezaJc/VpItogunpvh5sjjf7M+LyfW+lceHEY2OMY7wjdRL1KYOOVry9CLD06Ty9wVYkqQD8D1qSddalSaJrpEyJ6b+z7uu5SYDZ4f88KxZY7QSpAEpa4OUcGoxHkp4QldJHqJ2DxubPFwVR3WcUf8U/SWZmsw3L3EMZoZXJZ+RQEcZzSRJo5qp/y9kAnHvk3pibMTUWWKAl78gMP09o76EQ1zdyp9S0kW6Y1xzgy2L/iTzSD0W6c9AjLHljR3q8zFzdltzGSJIOs2t+lmxLnX/6mva2XQRFj2WKTb8A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=bNqmLenA0NWce+oGfzTesHd3FX5c3f6wToo5JADP2cU=; b=YOVbteW9AEwvde+JRGm1m4FkpRc54KgdoTMedNFB8JF3PHVJTLM0evWFTN4InnV9bHbzoHxGdpB61iuj8IGPAudj5gS06RH5l6Rkv3qRwl79stXKj/SEE+zYdv861zyhwShAldjhWgNV4Z13CiKOIQOx8mIfGg17924dVLvMt2A98JEkbTZybSybfj2qfLxOMYgyBuIg/hD33ESlES8SKSJ93Ll8DWcMDUsOMMWajdfKOOpAY9SsCu9d7pX6e1VQYFFhtG8aQnsir/l2LSjqBxoe10yGT8rRHAGJTX03b1ABTKc3HB4m3CvuTxMhI2UtLNh1deJzOA325fRWXBi4Vw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bNqmLenA0NWce+oGfzTesHd3FX5c3f6wToo5JADP2cU=; b=XYtqaFxHM4kibKUaomczbx92z3eEU4x+7bhQ1dOLF8mXHnXB2vYzOP6Nqx/i00fbP8Y7hZ+wW6wp6nRLRiU5gE51Os3Jay+TW8/BpRhhx7gLIcC7IBqla1l0HedegmDOh0wuNrXaQu2FYKvJKiGqGW5C03IWZDmN7m19L/plnhsbYMU7WFRPEpwlCAK9I9cKfXf/eoDnBJ7jVkM0mcTXuCH2mjHGl/tEFyCHe7QmlF+/2B+YaozgcrFoOtPAY+gd2eKW6llzgrUH3lAA+VwlPjCN5sKP3HJNGxtFATfadJ2prvm5jwyEMx4cDJEFj65Aa801wVqzn/VUQRlunK5C0w== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YQXPR01MB6464.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:4c::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Wed, 25 May 2022 15:41:48 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.013; Wed, 25 May 2022 15:41:48 +0000 From: Rick Macklem To: Adam Stylinski , John CC: "freebsd-fs@freebsd.org" Subject: Re: zfs/nfsd performance limiter Thread-Topic: zfs/nfsd performance limiter Thread-Index: AQHYaxQfJkENgRkWo0q5KjKiS/ePTK0q68g+gATWMbA= Date: Wed, 25 May 2022 15:41:48 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: f88affbd-78ea-a077-afec-8aea3a28a835 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 469c91f1-d747-4ab7-859e-08da3e651465 x-ms-traffictypediagnostic: YQXPR01MB6464:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: kzMhXmISU4D1d15Y2ZOuCydPEKR5orRKBNVOwjnewZwGvCH9dPlf8zc6qvsNG7rkRXtfc0u8VIm0b43alUl1BBL76Z3cuSFuGs49gFMgLS4IR3Qpu2xNMlsJd55iqRFooUPYCai5dzs5XV/ZlOyy2bxtZgJYP8HOyNnKVgMSAWpbLmQJyP9KiyXj0Xksu/5nwQLc3O6ATQNVwIEcYsep8wwCrVAPDpbf/Y+k1MQSW4sJmXq6Lpx9maSBcBnI4XW8EB0HndXt/9Hn65MC8sNfWJ2shCWDb/K2W7ua599iNCTCjFhyJIr60LezXovA4HwPj0dChWf9ay5sdWhB9YbgZl6bfj8nXpfnVEKOOo4x6teiia5ForzNmOFE2kVspFA3No3ibcx0dlijZ1bgUsayKSFlViS4j91xhGWLL1RAEYXDYWhMeFmmcE72Kpqo3EsJltHbOctGvrxNOcgO2FAlHMbEyOeyjhnhjQTt9gtBLivPcLprEzNCiN+hNDEx4fNHXPuazbm/gUzIFRcougiSKFs4tt4C1DHyMLUJpPK7L6F8q98JcbV0eN7SHYE0yBpCR3kytP1K6lqCP+87DPnR7DvZmXsuzoQv+oLb3S7yJK9tYbZen+PQG04GORIdtuDLRJAa/aZF1qAHQqh9X0IR2FrpeZTRist79QHay8HMbR26JsZQs7J0RDDanu5kArwqWHNUaqXKX0EWrdnwyBUkR8JmXET123Q+fiMG+0xupxATo4srsMP4C/3K4WT6pXbqAsoIt69mBk1fX38pHft9NqQg8pa/AD3MWYzuz4vUA7k= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(71200400001)(7696005)(83380400001)(91956017)(4326008)(8676002)(86362001)(33656002)(316002)(186003)(786003)(966005)(508600001)(38100700002)(2906002)(8936002)(55016003)(110136005)(3480700007)(9686003)(5660300002)(122000001)(52536014)(66946007)(64756008)(66476007)(66556008)(66446008)(76116006)(53546011)(6506007)(38070700005);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?1TKSTWFXrDJ3nyXe9AK0ahtRQN8nR0PVnNUDRJERzRnt3tjJw2L1AqcQki?= =?iso-8859-1?Q?rE0xpfFY9wPH3CFKItIxHtSI9rRwzp2QhWXw5TexHb6kgxjTuNj/gN8Vn9?= =?iso-8859-1?Q?r/dDQymdnfoMjaWjYTIUxc/7jt6dWP7EqVGsEXtnJCuU4mpWGyAjx3NYSB?= =?iso-8859-1?Q?Wa/dFUWmTBvxdINxrItzs/N6lga09QM4pOtWWoRXhwLLJF2AolBUmiwG/8?= =?iso-8859-1?Q?wp+LrXdsXiEH/Ty9oSmsHDdvZAg1GR99x9LJHBNpmir7W2+zoHSVCQDkT1?= =?iso-8859-1?Q?GE0c7sQMIlwulvb1cNVC9zCqQ4ugcqH2HoTDSPdIZMaMC2Svk+Ld8YQImZ?= =?iso-8859-1?Q?YlNH01qugCnbUJPw5nfSQqghqLgeK2S4zro6aVDmksDvWVNEQZS2badqCw?= =?iso-8859-1?Q?KbyLzY/IX6RAc34LK9+fUr3W9XzAuMcdqzE7P7K16Iij3QXliM3y93tQa0?= =?iso-8859-1?Q?Cg+uFTtSnrMtyx9L42q89AjeTRXKE7jHjUuo3465dQn0pQWGIH+Foku6ht?= =?iso-8859-1?Q?lpKmjHpWcVWuSHEqmuT9LWyxhq/s3Q2d/vydpyAeksj0bWSYYwyexzuRta?= =?iso-8859-1?Q?aezEyptmGdMYC2JsvMsZ4+KydLcLuVeyvkjEoZ4VZiSug/tRx9Gnn6015W?= =?iso-8859-1?Q?WS/bhyWgEF4u3dJq9Yr8Hc6QKfu8F+xy86b6QOaUfsDpGnHNnJg+4e5D3b?= =?iso-8859-1?Q?pG5iqcJWNbZ9mqBqtG3uRIN0UqdJcrn7UUjq+IuHv+sanE9sLvqVtOIE8o?= =?iso-8859-1?Q?gWd/zHs0y1yyb1H1ELh8FXh91pCXFuVsYMeSB2sRpoZDyb9jlEXwRd/g7h?= =?iso-8859-1?Q?i93ToDqm8PRPQtPmC/428r/ln0+mV/5bc0WrvIOCApxzKUBwyFG4PQ39c/?= =?iso-8859-1?Q?uCdSzoYQWa7i999xYR4w/WM0Ur84wv+Hhcn8fODUUosJ0NEPsfr6DTgnVD?= =?iso-8859-1?Q?Z2wUgY+4e7nVxvpzn2PiKZC5xRT6FYBifpI82a0qatXztFhSQR6XOWRGbe?= =?iso-8859-1?Q?yYPOeibz1gW6mTXGp1tx6NJh6P8Q20ykFwcRlQ+vh4n+BMc3yNF8Jrz8Pd?= =?iso-8859-1?Q?Qmbw8bK02B5A0YWMjimf9WnyJ63WClRYAcwMp5vZ3jpd398UXunwojqg/J?= =?iso-8859-1?Q?Rx5fPFlr5vhV8w5vD04ca+7myTTSuUxtccqBc6tQoUU8Sg3+c2tNNv5YzO?= =?iso-8859-1?Q?E11Ix0MITHehh8f/zu2kw+TqaNOE0VXWhmTK1pV7Ls9+rjBwfCC6kpfCla?= =?iso-8859-1?Q?n7NfYOFj1EW8e069qsvsainPH1tGIfDHnAuw2m5FGTI045nlsRbM2hkRn9?= =?iso-8859-1?Q?UJHJE9aXCvp0iNywRlospTOf5bfZxC/egPVF8QHGtgQRkEXm4pBG3t0Ert?= =?iso-8859-1?Q?jKCFa3ikWYRfg9pAv6LuUto3Y8NKh39XNt0I5FeM8Ncoc+uwDN6R3H38XR?= =?iso-8859-1?Q?PaXrOoZy09RdbdQJyF+NUciqL1wr+GU/AEiq+fMdgNbc8Zu96nWTvt9ULE?= =?iso-8859-1?Q?UqMZRfgOmunlDZ+T6lFgnagzQ5AIG0h8iR9Q0C7Yhlo2PwV+wzsR26CfGS?= =?iso-8859-1?Q?GlmO+ufg2j66/9VpVqMiY4+jG9bb1ddU6PTb8Tq/DTiEtj+wPamoV1EsVi?= =?iso-8859-1?Q?8L4CLM7p9u7mvPYB2FbD5QLbaoWesOuXduGU1T4NE/wly4mEj5b+lE8HXL?= =?iso-8859-1?Q?GPzNGAUkWU2EoSZPK41fqco/7gveqjqXw6gBFBkUDYOtPgewfqSCVnm4xF?= =?iso-8859-1?Q?cjzu/oKgILwKfGTe/5I6X0FYqPgTfLS4N6v5uABT361I+jVr7MEjZneq/2?= =?iso-8859-1?Q?ByATyn5X/e6qSC1mN8WhGK7b7cR6933vH9jXoQKpNeWlIjRqj/igcYh88S?= =?iso-8859-1?Q?52?= x-ms-exchange-antispam-messagedata-1: x7TKUCpqRkJgrA== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 469c91f1-d747-4ab7-859e-08da3e651465 X-MS-Exchange-CrossTenant-originalarrivaltime: 25 May 2022 15:41:48.0538 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: TSyd3z1oFFlq77101ZOiV6XAMnJTF29AqJCi90gXhQZT06a9Wz/Z9saBjxGuVCz97lorLYzFxfXSu7O5fBuPpw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB6464 X-Rspamd-Queue-Id: 4L7b0M58G7z4bVj X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=XYtqaFxH; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.50 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.50:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.50:from] X-ThisMailContainsUnwantedMimeParts: N Adam Stylinski wrote:=0A= [stuff snipped]=0A= =0A= > > ifconfig -vm=0A= > mlxen0: flags=3D8843 metric 0 mtu= 9000=0A= Just in case you (or someone else reading this) is not aware of it,=0A= use of 9K jumbo clusters causes fragmentation of the memory pool=0A= clusters are allocated from and, therefore, their use is not recommended.= =0A= =0A= Now, it may be that the mellanox driver doesn't use 9K clusters (it could= =0A= put the received frame in multiple smaller clusters), but if it does, you= =0A= should consider reducing the mtu.=0A= If you:=0A= # vmstat -z | fgrep mbuf_jumbo_9k=0A= it will show you if they are being used.=0A= =0A= rick=0A= =0A= =0A= > netstat -i=0A= Name Mtu Network Address Ipkts Ierrs Idrop=0A= Opkts Oerrs Coll=0A= igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0=0A= 24178283 0 0=0A= igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0=0A= 8447249 0 0=0A= lo0 16384 lo0 367691 0 0=0A= 367691 0 0=0A= lo0 - localhost localhost 68 - -=0A= 68 - -=0A= lo0 - fe80::%lo0/64 fe80::1%lo0 0 - -=0A= 0 - -=0A= lo0 - your-net localhost 348944 - -=0A= 348944 - -=0A= mlxen 9000 00:02:c9:35:df:20 13138046 0 12=0A= 26308206 0 0=0A= mlxen - 10.5.5.0/24 10.5.5.1 11592389 - -=0A= 24345184 - -=0A= vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0=0A= 962249 102 0=0A= lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0=0A= 31623674 0 0=0A= lagg0 - 192.168.0.0/2 nasbox 27967582 - -=0A= 41779731 - -=0A= =0A= > What threads/irq are allocated to your NIC? 'vmstat -i'=0A= =0A= Doesn't seem perfectly balanced but not terribly imbalanced, either:=0A= =0A= interrupt total rate=0A= irq9: acpi0 3 0=0A= irq18: ehci0 ehci1+ 803162 2=0A= cpu0:timer 67465114 167=0A= cpu1:timer 65068819 161=0A= cpu2:timer 65535300 163=0A= cpu3:timer 63408731 157=0A= cpu4:timer 63026304 156=0A= cpu5:timer 63431412 157=0A= irq56: nvme0:admin 18 0=0A= irq57: nvme0:io0 544999 1=0A= irq58: nvme0:io1 465816 1=0A= irq59: nvme0:io2 487486 1=0A= irq60: nvme0:io3 474616 1=0A= irq61: nvme0:io4 452527 1=0A= irq62: nvme0:io5 467807 1=0A= irq63: mps0 36110415 90=0A= irq64: mps1 112328723 279=0A= irq65: mps2 54845974 136=0A= irq66: mps3 50770215 126=0A= irq68: xhci0 3122136 8=0A= irq70: igb0:rxq0 1974562 5=0A= irq71: igb0:rxq1 3034190 8=0A= irq72: igb0:rxq2 28703842 71=0A= irq73: igb0:rxq3 1126533 3=0A= irq74: igb0:aq 7 0=0A= irq75: igb1:rxq0 1852321 5=0A= irq76: igb1:rxq1 2946722 7=0A= irq77: igb1:rxq2 9602613 24=0A= irq78: igb1:rxq3 4101258 10=0A= irq79: igb1:aq 8 0=0A= irq80: ahci1 37386191 93=0A= irq81: mlx4_core0 4748775 12=0A= irq82: mlx4_core0 13754442 34=0A= irq83: mlx4_core0 3551629 9=0A= irq84: mlx4_core0 2595850 6=0A= irq85: mlx4_core0 4947424 12=0A= Total 769135944 1908=0A= =0A= > Are the above threads floating or mapped? 'cpuset -g ...'=0A= =0A= I suspect I was supposed to run this against the argument of a pid,=0A= maybe nfsd? Here's the output without an argument=0A= =0A= pid -1 mask: 0, 1, 2, 3, 4, 5=0A= pid -1 domain policy: first-touch mask: 0=0A= =0A= > Disable nfs tcp drc=0A= =0A= This is the first I've even seen a duplicate request cache mentioned.=0A= It seems counter-intuitive for why that'd help but maybe I'll try=0A= doing that. What exactly is the benefit?=0A= =0A= > What is your atime setting?=0A= =0A= Disabled at both the file system and the client mounts.=0A= =0A= > You also state you are using a Linux client. Are you using the MLX affini= ty scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux= system for a fbsd system?=0A= I've not, though I do vaguely recall mellanox supplying some scripts=0A= in their documentation that fixed interrupt handling on specific cores=0A= at one point. Is this what you're referring to? I could give that a=0A= try. I don't at present have any FreeBSD client systems with enough=0A= PCI express bandwidth to swap things out for a Linux vs FreeBSD test.=0A= =0A= > You mention iperf. Please post the options you used when invoking iperf = and it's output.=0A= =0A= Setting up the NFS client as a "server", since it seems that the=0A= terminology is a little bit flipped with iperf, here's the output:=0A= =0A= -----------------------------------------------------------=0A= Server listening on 5201 (test #1)=0A= -----------------------------------------------------------=0A= Accepted connection from 10.5.5.1, port 11534=0A= [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931=0A= [ ID] Interval Transfer Bitrate=0A= [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec=0A= [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec=0A= [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec=0A= [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec=0A= [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec=0A= - - - - - - - - - - - - - - - - - - - - - - - - -=0A= [ ID] Interval Transfer Bitrate=0A= [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec recei= ver=0A= -----------------------------------------------------------=0A= Server listening on 5201 (test #2)=0A= -----------------------------------------------------------=0A= =0A= On Sun, May 22, 2022 at 3:45 AM John wrote:=0A= >=0A= > ----- Adam Stylinski's Original Message -----=0A= > > Hello,=0A= > >=0A= > > I have two systems connected via ConnectX-3 mellanox cards in ethernet= =0A= > > mode. They have their MTU's maxed at 9000, their ring buffers maxed=0A= > > at 8192, and I can hit around 36 gbps with iperf.=0A= > >=0A= > > When using an NFS client (client =3D linux, server =3D freebsd), I see = a=0A= > > maximum rate of around 20gbps. The test file is fully in ARC. The=0A= > > test is performed with an NFS mount nconnect=3D4 and an rsize/wsize of= =0A= > > 1MB.=0A= > >=0A= > > Here's the flame graph of the kernel of the system in question, with=0A= > > idle stacks removed:=0A= > >=0A= > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#fi= le-nfs_fg-svg=0A= > >=0A= > > The longest functions seems like maybe it's the ERMS aware memcpy=0A= > > happening from the ARC? Is there maybe a missing fast path that could= =0A= > > take fewer copies into the socket buffer?=0A= >=0A= > Hi Adam -=0A= >=0A= > Some items to look at and possibly include for more responses....=0A= >=0A= > - What is your server system? Make/model/ram/etc. What is your=0A= > overall 'top' cpu utilization 'top -aH' ...=0A= >=0A= > - It looks like you're using a 40gb/s card. Posting the output of=0A= > 'ifconfig -vm' would provide additional information.=0A= >=0A= > - Are the interfaces running cleanly? 'netstat -i' is helpful.=0A= >=0A= > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order?=0A= >=0A= > - Inspect 'netstat -m'. Denied? Delayed?=0A= >=0A= >=0A= > - You mention iperf. Please post the options you used when=0A= > invoking iperf and it's output.=0A= >=0A= > - You appear to be looking for through-put vs low-latency. Have=0A= > you looked at window-size vs the amount of memory allocated to the=0A= > streams. These values vary based on the bit-rate of the connection.=0A= > Tcp connections require outstanding un-ack'd data to be held.=0A= > Effects values below.=0A= >=0A= >=0A= > - What are your values for:=0A= >=0A= > -- kern.ipc.maxsockbuf=0A= > -- net.inet.tcp.sendbuf_max=0A= > -- net.inet.tcp.recvbuf_max=0A= >=0A= > -- net.inet.tcp.sendspace=0A= > -- net.inet.tcp.recvspace=0A= >=0A= > -- net.inet.tcp.delayed_ack=0A= >=0A= > - What threads/irq are allocated to your NIC? 'vmstat -i'=0A= >=0A= > - Are the above threads floating or mapped? 'cpuset -g ...'=0A= >=0A= > - Determine best settings for LRO/TSO for your card.=0A= >=0A= > - Disable nfs tcp drc=0A= >=0A= > - What is your atime setting?=0A= >=0A= >=0A= > If you really think you have a ZFS/Kernel issue, and you're=0A= > data fits in cache, dump ZFS, create a memory backed file system=0A= > and repeat your tests. This will purge a large portion of your=0A= > graph. LRO/TSO changes may do so also.=0A= >=0A= > You also state you are using a Linux client. Are you using=0A= > the MLX affinity scripts, buffer sizing suggestions, etc, etc.=0A= > Have you swapped the Linux system for a fbsd system?=0A= >=0A= > And as a final note, I regularly use Chelsio T62100 cards=0A= > in dual home and/or LACP environments in Supermicro boxes with 100's=0A= > of nfs boot (Bhyve, QEMU, and physical system) clients per server=0A= > with no network starvation or cpu bottlenecks. Clients boot, perform=0A= > their work, and then remotely request image rollback.=0A= >=0A= >=0A= > Hopefully the above will help and provide pointers.=0A= >=0A= > Cheers=0A= >=0A= =0A= From nobody Wed May 25 16:53:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3AB9F1B538CA for ; Wed, 25 May 2022 16:53:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7cZZ0Rhxz4mNq for ; Wed, 25 May 2022 16:53:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E535F1CBDC for ; Wed, 25 May 2022 16:53:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PGr9HQ028772 for ; Wed, 25 May 2022 16:53:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PGr99m028771 for fs@FreeBSD.org; Wed, 25 May 2022 16:53:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 16:53:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tsoome@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653497590; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RmmSapBe8FvN97jNbeuWlk5edtDjf5pXWVzYBjv+s1k=; b=awKGmrB2EAA9ZL08NCIVaudgA2fNocyk1JMlsMY+ThHEBp9nqj7i/uVbo2LTzbvTNmVkKN d28IhjZQL+URIRnRR1/oGcAPX3Ds7torKlKncv+G9nCOgcw0aASnRAwN3YiRoydaZ+oqXm 0HzU8siPudIGqonIvUK8e0NUf+3BLP4ttULlGFjr49bdyOb8uQ4XJo/4WVt2KJ64MI/cpi 2O2tEjAuQqaPJjVw8BYySct1X+xYPLNPoKWnUefDTk5YaHbBVe/+amJBJp+HSj4fwnRtf6 Bmm5OcKF3pMvk78PdmkLv2x8pbrLLG3o1PBPvggyuZkSYLxuqDPfUHw9uPWiJw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653497590; a=rsa-sha256; cv=none; b=etGglt/5d9N1n+ZUQY56ULeWkwqWXSvaPtuU4kQTNvU/CJt6FDjpW0i1rONW+zkg9PAN6+ oP7nw/T+XxUb17ElxsaHNyG5TW1u9kLdFr8xVWEfW4bTIFSQPK1tgE/V98WsmdV/o+d4Mt SgdNcEk0YhssORqcFKvNo5KeuIp5YOnKJcChU+fXkHPmzdvRKfklF4bmSfoerD/NOROrQy lXOKEb20nuU2yh0Hezko6FojjtzOwQnwk5hQxsr4bAONo/9hPuWuXkWT4f0Y/pb6WNcw4H Yrpd+wVvsTZ/CEpzuJY/DblHX2bgE3u/YgXdtkyEU10cQknuYYUKXl4zDAMlJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #11 from Toomas Soome --- (In reply to zmey20000 from comment #10) This is the patch attached here? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 17:24:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DA0771B58877 for ; Wed, 25 May 2022 17:24:13 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yw1-x112a.google.com (mail-yw1-x112a.google.com [IPv6:2607:f8b0:4864:20::112a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7dGP0yp8z4q8P; Wed, 25 May 2022 17:24:13 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yw1-x112a.google.com with SMTP id 00721157ae682-300312ba5e2so55945027b3.0; Wed, 25 May 2022 10:24:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=lEFfWo4bkd1oldtBcyVesf1EJbI2xhkxvI7YAeLv2nw=; b=GmDINEQV1yL6CSRmP7bvBtfavAu6ysrBerbjHp++VX62ewBjMyvRPxEj4NJNs7snRO y4e2WoOxeTTePyxIO0x6uY206jrubtsic4Q/77ZSSBF7KBBVNNgHgwLXcQUqTDgE3fkp pPOW5Ec5Zr8S5PanJjq6Rw4gU50wSn8ZQn3oeyhqP06n6Ts1kAiNMeFysXUn1DVaFb5X YO8btEBREjhB7lyLwUKHPYjjv3RGIQdjQR/j0WYrVniKAeXRW8XtYEnArM/LSgbukzuW QTtimAU2I+/kry+vKd55muO6x3meTi7Pivhc9to6B8YiRqMNrTlOP+WqR05uA4k8A+pj xH6g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=lEFfWo4bkd1oldtBcyVesf1EJbI2xhkxvI7YAeLv2nw=; b=Y6P5xeGnCprV46fbNxBpHYLVKoyNXRUfhiziYnrZJfVkvIzZOfoEbybTLELAqutKAM DuicHxgrEOGab8V4528eCLNynvcWogVNZcSYN1rZJU/q9j310JjXzkhsab4onwO/HS7m mHM8CJUmBVRjyt9y/sYpKwdtP72JKluBGs56oefWJZto7qTnYYG/dkzu0/XP+7yU5BY2 GmafAGeDBvuVLzw507PUrUyA+f7YQ49aOVyFlo05y/XvknmDEHRbz5/WT+ebkRcz01dQ x+iJ2iWtnXZb4P41PoE0a5M11rgnIVP48RzSciFzjnhE2IUTt533cIySHQOx2k116u0n BbDw== X-Gm-Message-State: AOAM53171dvwtljzM5ID06dUpcMHVZG0Z3o4LOae6CEetJDoXuYjSKao 8kF6PE+FT3a4PMpOsTYKN5hX82/JBEL7zi2KuQg/L+iYcoM= X-Google-Smtp-Source: ABdhPJxiiUwxnj8k0TzDGaSNrejrLI1YSww22xZsH88EtGQsacP8LGVvnHJsKPoIuao6sBvSuP0PaUxmUybjJ3qO+5Q= X-Received: by 2002:a0d:f2c2:0:b0:300:d3e1:ef2f with SMTP id b185-20020a0df2c2000000b00300d3e1ef2fmr1593008ywf.331.1653499452474; Wed, 25 May 2022 10:24:12 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Adam Stylinski Date: Wed, 25 May 2022 13:24:01 -0400 Message-ID: Subject: Re: zfs/nfsd performance limiter To: Rick Macklem Cc: John , "freebsd-fs@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L7dGP0yp8z4q8P X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=GmDINEQV; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::112a as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-3.53 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112a:from]; NEURAL_HAM_SHORT(-0.53)[-0.532]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Hmm, I don't know that the present of jumbo 9k mbufs is indicative that the mellanox drivers are using them or not, given that I have a link aggregation on a different (1gbps) NIC that also could be the cause of that: mbuf: 256, 52231134, 49500, 25931,1956138424, 0, 0, 0 mbuf_cluster: 2048, 8161114, 2794, 4352,700435355, 0, 0, 0 mbuf_jumbo_page: 4096, 4080557, 12288, 3977,155289291, 0, 0, 0 mbuf_jumbo_9k: 9216, 1609044, 32772, 4174,35785053, 0, 0, 0 mbuf_jumbo_16k: 16384, 680092, 0, 0, 0, 0, 0, 0 Early on, 9k MTUs did show significant advantages for throughput from what I remember. But of course, this is before trying any of the aforementioned changes for multiplexing the connection. On Wed, May 25, 2022 at 11:41 AM Rick Macklem wrote: > > Adam Stylinski wrote: > [stuff snipped] > > > > ifconfig -vm > > mlxen0: flags=8843 metric 0 mtu 9000 > Just in case you (or someone else reading this) is not aware of it, > use of 9K jumbo clusters causes fragmentation of the memory pool > clusters are allocated from and, therefore, their use is not recommended. > > Now, it may be that the mellanox driver doesn't use 9K clusters (it could > put the received frame in multiple smaller clusters), but if it does, you > should consider reducing the mtu. > If you: > # vmstat -z | fgrep mbuf_jumbo_9k > it will show you if they are being used. > > rick > > > > netstat -i > Name Mtu Network Address Ipkts Ierrs Idrop > Opkts Oerrs Coll > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0 > 24178283 0 0 > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0 > 8447249 0 0 > lo0 16384 lo0 367691 0 0 > 367691 0 0 > lo0 - localhost localhost 68 - - > 68 - - > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - - > 0 - - > lo0 - your-net localhost 348944 - - > 348944 - - > mlxen 9000 00:02:c9:35:df:20 13138046 0 12 > 26308206 0 0 > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - - > 24345184 - - > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0 > 962249 102 0 > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0 > 31623674 0 0 > lagg0 - 192.168.0.0/2 nasbox 27967582 - - > 41779731 - - > > > What threads/irq are allocated to your NIC? 'vmstat -i' > > Doesn't seem perfectly balanced but not terribly imbalanced, either: > > interrupt total rate > irq9: acpi0 3 0 > irq18: ehci0 ehci1+ 803162 2 > cpu0:timer 67465114 167 > cpu1:timer 65068819 161 > cpu2:timer 65535300 163 > cpu3:timer 63408731 157 > cpu4:timer 63026304 156 > cpu5:timer 63431412 157 > irq56: nvme0:admin 18 0 > irq57: nvme0:io0 544999 1 > irq58: nvme0:io1 465816 1 > irq59: nvme0:io2 487486 1 > irq60: nvme0:io3 474616 1 > irq61: nvme0:io4 452527 1 > irq62: nvme0:io5 467807 1 > irq63: mps0 36110415 90 > irq64: mps1 112328723 279 > irq65: mps2 54845974 136 > irq66: mps3 50770215 126 > irq68: xhci0 3122136 8 > irq70: igb0:rxq0 1974562 5 > irq71: igb0:rxq1 3034190 8 > irq72: igb0:rxq2 28703842 71 > irq73: igb0:rxq3 1126533 3 > irq74: igb0:aq 7 0 > irq75: igb1:rxq0 1852321 5 > irq76: igb1:rxq1 2946722 7 > irq77: igb1:rxq2 9602613 24 > irq78: igb1:rxq3 4101258 10 > irq79: igb1:aq 8 0 > irq80: ahci1 37386191 93 > irq81: mlx4_core0 4748775 12 > irq82: mlx4_core0 13754442 34 > irq83: mlx4_core0 3551629 9 > irq84: mlx4_core0 2595850 6 > irq85: mlx4_core0 4947424 12 > Total 769135944 1908 > > > Are the above threads floating or mapped? 'cpuset -g ...' > > I suspect I was supposed to run this against the argument of a pid, > maybe nfsd? Here's the output without an argument > > pid -1 mask: 0, 1, 2, 3, 4, 5 > pid -1 domain policy: first-touch mask: 0 > > > Disable nfs tcp drc > > This is the first I've even seen a duplicate request cache mentioned. > It seems counter-intuitive for why that'd help but maybe I'll try > doing that. What exactly is the benefit? > > > What is your atime setting? > > Disabled at both the file system and the client mounts. > > > You also state you are using a Linux client. Are you using the MLX affinity scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux system for a fbsd system? > I've not, though I do vaguely recall mellanox supplying some scripts > in their documentation that fixed interrupt handling on specific cores > at one point. Is this what you're referring to? I could give that a > try. I don't at present have any FreeBSD client systems with enough > PCI express bandwidth to swap things out for a Linux vs FreeBSD test. > > > You mention iperf. Please post the options you used when invoking iperf and it's output. > > Setting up the NFS client as a "server", since it seems that the > terminology is a little bit flipped with iperf, here's the output: > > ----------------------------------------------------------- > Server listening on 5201 (test #1) > ----------------------------------------------------------- > Accepted connection from 10.5.5.1, port 11534 > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 > [ ID] Interval Transfer Bitrate > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver > ----------------------------------------------------------- > Server listening on 5201 (test #2) > ----------------------------------------------------------- > > On Sun, May 22, 2022 at 3:45 AM John wrote: > > > > ----- Adam Stylinski's Original Message ----- > > > Hello, > > > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > > at 8192, and I can hit around 36 gbps with iperf. > > > > > > When using an NFS client (client = linux, server = freebsd), I see a > > > maximum rate of around 20gbps. The test file is fully in ARC. The > > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > > 1MB. > > > > > > Here's the flame graph of the kernel of the system in question, with > > > idle stacks removed: > > > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > > happening from the ARC? Is there maybe a missing fast path that could > > > take fewer copies into the socket buffer? > > > > Hi Adam - > > > > Some items to look at and possibly include for more responses.... > > > > - What is your server system? Make/model/ram/etc. What is your > > overall 'top' cpu utilization 'top -aH' ... > > > > - It looks like you're using a 40gb/s card. Posting the output of > > 'ifconfig -vm' would provide additional information. > > > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > > > - Inspect 'netstat -m'. Denied? Delayed? > > > > > > - You mention iperf. Please post the options you used when > > invoking iperf and it's output. > > > > - You appear to be looking for through-put vs low-latency. Have > > you looked at window-size vs the amount of memory allocated to the > > streams. These values vary based on the bit-rate of the connection. > > Tcp connections require outstanding un-ack'd data to be held. > > Effects values below. > > > > > > - What are your values for: > > > > -- kern.ipc.maxsockbuf > > -- net.inet.tcp.sendbuf_max > > -- net.inet.tcp.recvbuf_max > > > > -- net.inet.tcp.sendspace > > -- net.inet.tcp.recvspace > > > > -- net.inet.tcp.delayed_ack > > > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > > > - Are the above threads floating or mapped? 'cpuset -g ...' > > > > - Determine best settings for LRO/TSO for your card. > > > > - Disable nfs tcp drc > > > > - What is your atime setting? > > > > > > If you really think you have a ZFS/Kernel issue, and you're > > data fits in cache, dump ZFS, create a memory backed file system > > and repeat your tests. This will purge a large portion of your > > graph. LRO/TSO changes may do so also. > > > > You also state you are using a Linux client. Are you using > > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > > Have you swapped the Linux system for a fbsd system? > > > > And as a final note, I regularly use Chelsio T62100 cards > > in dual home and/or LACP environments in Supermicro boxes with 100's > > of nfs boot (Bhyve, QEMU, and physical system) clients per server > > with no network starvation or cpu bottlenecks. Clients boot, perform > > their work, and then remotely request image rollback. > > > > > > Hopefully the above will help and provide pointers. > > > > Cheers > > > From nobody Wed May 25 17:46:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AD55C1B5C675 for ; Wed, 25 May 2022 17:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7dmK2XBhz4s4L for ; Wed, 25 May 2022 17:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3399D1DD93 for ; Wed, 25 May 2022 17:46:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PHkfHO056760 for ; Wed, 25 May 2022 17:46:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PHkfuh056759 for fs@FreeBSD.org; Wed, 25 May 2022 17:46:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 17:46:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653500801; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BiJxhJkVskrcGcHbkCsptHA8mTSy+njTNeEjDmrtvLU=; b=Hy563120qUOPqQytGvUYfE3nJYzTVBRyI4rmyzFEeS3qZ9tESb2uIJrYg9ycUcgBGSdDQ1 QukeqDt3exFyl/cD2QMZgTF2FkkszUt6hB4CeWAc9MImGegyqpRzc/26IxJ94WVMVgHUtl JpsazwDCJSILFuq4guciRNHGqjSSSGyaTpXg9/iqr8IwqwdHpgyLyk4JQurJs4FHY49IL8 tHRNii10UU1sWNh4foy6vN1ibuPkr8GzdgglnKDUlCZrIRylsAgGZ4Ui2PtkVqe5foVcHv Ye5twUDPwdzY5x9OaxiiBpYYCJzqrFXlPjCL8tA5+z1Xpu+BSA1CT6qkPLHoJA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653500801; a=rsa-sha256; cv=none; b=UrR81hRQL/4iMKBIrVk6MUAdYWAXjx5LdRneHgHTL+pRzjC1XIqBr7GIX6fPmLOvhAoUlc cvVoSgOiDFeg9B49olQMFRcZWjRNkT0YI/it2k2NCK/92MAhGT+Mh2luy/cRBI230WYpyI 2y69Z9IRDMK4KcmrmDDLBm9kjcTLX8AfyFvum4hkd+a6k4hY9I7/p3oAaT3w8W1Z5QOKXX No2kCz/7mx4XCDOJjqFlcDTvbTxuvitwGQInOGsP2D+pDqk9Ea0q2ee8AazunojU7xoOzC oQygbat/JxSk/j3FyYOOgYIGzN1zLN/e9yMeolBHTNsx7haHEqSFuHmIB0ttmQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #12 from zmey20000@yahoo.com --- (In reply to Toomas Soome from comment #11) Yes. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 19:00:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AEF4A1B39CD7 for ; Wed, 25 May 2022 19:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7gPB0L3Vz3Fkm for ; Wed, 25 May 2022 19:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DC8B11EC26 for ; Wed, 25 May 2022 19:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PJ0D6i097585 for ; Wed, 25 May 2022 19:00:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PJ0Dqo097584 for fs@FreeBSD.org; Wed, 25 May 2022 19:00:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 19:00:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tsoome@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653505214; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oZ5a7X19QDLINuYalb57T0oafVVl+SHPXIZkE2LLcxc=; b=t6wILijmqzeDxzI3P9xRjl5AkrHyR/wSSWvcoHuCiPtgG9GSEbycXkDP+ad8OlaUMCsY5E ewkzYrd0Rj4DURMIvvKZ8aPrVsqCSToXdnqhhmdG6viOk/yXEOpfz2q+Y7Exw/RAy8axwW nPu7UM+1j5TNBKCDLv0yWhy8/iTjcUFv+rpnRp8kgsT0bGbkwbv9VjEmy/nAGEGQE8GpPt meoByEFKyipiYiKVhhjqDYokFXDSoPUY5jtTG2CC+Mn5yH3ugIZQlgI8UEb1HHUD93l1cc 1aP/yv32KVCuqDn4fw79veZnw2rp7a0nRlS8GM90ukqBurmuHWVlmA7FjOgfzg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653505214; a=rsa-sha256; cv=none; b=B0itsjhjz4QJFrrx3u7w6Wv4Oe2UL1GXtILGCKc3ohKOPl7Gi1BPrC8OCrq9A6BRDsm36E RxSFKvBPJ08aPDJ29jZtAtUuZIH6W8ctz2CgahTJMkWOv7YAvhST1iEg++Ho+DMRtjJm5s y/WCklLfNOW2As2w1N06qUCy15x479oazn+eeB2FdeUtl6kMuXuYAJXC7DkcoAsnoSpVZJ sX85q2KrL43kGeAoW7AhiWf8bNhav0Y12JK8oP6lZ8/yxyGOxPeVyeW3DJn12d6m9d3sMc lRA58E4bd4dQHa1f8NmBdM1AFH6qyEJrrZiGQZOZ4EQ2Ak+sOJmzlMrp5RtgRg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #13 from Toomas Soome --- (In reply to zmey20000 from comment #12) I did pick it up and made some small updates - replaced ARGSUSED with __unu= sed, small change in README, using calloc(). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 19:00:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 809E21B39E6C for ; Wed, 25 May 2022 19:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7gPn20nQz3Ftq for ; Wed, 25 May 2022 19:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 22F821EA73 for ; Wed, 25 May 2022 19:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PJ0jAL097710 for ; Wed, 25 May 2022 19:00:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PJ0jgG097709 for fs@FreeBSD.org; Wed, 25 May 2022 19:00:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 19:00:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tsoome@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653505245; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OJY9hY/1yH0S5S84t4zBfPhm0xeF36M71Po+Ro209n0=; b=LK9QruvMLpZ3dVsx9fKgBzuM4E2L6zhdSWH7v/byXon96TDSvypuJId1nuUIOhKtc4QTcy P/AabbRqOnicQS3FpfcOTk2fRiVze40avtWmMHn5w/wEAzxEmDR83vbJDjV7jYZrTtaKdq yXdnRkdJPZzycV6zzXCoDngv+MRJezn4b0mpQiya061P/jpAJIIGAm3VoDqO9PQrrq3Xcg kOHd6arUnFff7BAUJASwZHIyyzUJ9W+S/rKK72BvT04QgLvwli0efHG6lDeUIaFB1rVRyg bPY7UQf5Ln+8+vnTHDMdWZ4zyox7Nz9Eu8PM0e2G4rYLcC5HzQw+8tXMPCmdKA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653505245; a=rsa-sha256; cv=none; b=O7BmSkE+GiBO3LET98D9k+iiXu8Phx0KiUMmcO6Ch3Z0XRtF6n2immD+3yU5mPs78xw9sY JoS/ot5YRR0KvXRKEy9AWKyspZazGEJYfr9WRKBITDQuNyBpymnIebT65bMUccqQJ+MLF/ vmK1IYdnc4rBv2kPP2bLOl0/B8XiDr1NTs3GgmG7mV06XKFrRnPaaqzvV73RVPXpxUgO1b hKqCcg2o1WYe5Z8/7kkAr24D4boyP5hSRaicU7bp6lHRc7bwgEEw3a5ge3PG21kXuRuNWa P4SLuZrCYNpToNxwdse3TK3xpEZn+50MePgZLvG5G72Bhfpo2fNVtRE8WDt4aw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #14 from Toomas Soome --- (In reply to Toomas Soome from comment #13) Woops, url too: https://reviews.freebsd.org/D35320 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 20:04:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F22A11B46CFB for ; Wed, 25 May 2022 20:04:43 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2043.outbound.protection.outlook.com [40.107.115.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7hqZ2sv0z3PZx; Wed, 25 May 2022 20:04:42 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Q7if4c3jsoNy5ss0rX4oH5vkmowZhQO24lFlKSaqgkTfwZwjx84UWF9dHNkr8GuHSLZc9j6JlWeVWRakiVAa8690dXqECoFs467Ht+ibrl5C1pSBnZ6/mBS314SwhutLd2kN7fCkMZkf5aAf0oGjHIz3p33sl5c9jyvoRF7f2dGeHe5e2GrNQdp4lTU68lvM9c/1Gf0w1Au5coY75DrMfJTIRsnjP3Acm/tlrhOavs4YyNH4TAiXvNYot6H7+XMAMqT3q6/6uSBShwN5GBP5SDRXg8bazMweRFu3OZvtRbo40akX48srZvl4wzYV8bNm4TJzcc36R1ltH9LQSO8Rxg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=L1pZ/O1w0s6baVh+gRIPMCWzW7H6fktb7i92tA/XSoU=; b=SJ5z9OAfVKrdVSYaKBHqr5GVnIvJqMs/zNgM5MqzL+THUSDKK2+mKPVuXu/niG4S2WVmb6ZJTnglimlXTu//9VroaU/jKA5me9Po4Ion5r4AxCBxAxSFv0xNi51iP1TUEkjoYvkwJAlPtgd+e6P3ndwTormdtIwwd5qNUxlgVkSD6cOQcfiGXkacJAkp7WWVkKtA9GGae9FfFk27gOgYGi5MavJ0+umqExYbtNKum5aAuKZ+w2hIegay6Jl5q+BYCmNxnjePyTrf+A0XPFYXIXj9yLfntxCzZYfXPhAcB3C9omLSbCRlF0HTi0Ht1AA6LWhESsNuG9+9z+rBaMi5QA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=L1pZ/O1w0s6baVh+gRIPMCWzW7H6fktb7i92tA/XSoU=; b=oxOziLOuj4HbdIUpSRoLtPfUphtwiCDx4i3A/lIwoTitVHiL109gf1ykCMjrTMUrSiwJ01FLX2cU9VfNrZufmC7xXvpHKlgLAuMPqRlGyfDE0CPpAtAl/Sg1gAmuJfvIFVW2nZ9F0D1JZngzNKWiRZCIbjNVr6XKL2f+F0Zxudu8ihULpXLcjBDu4sxYY0qCtU+BDToXfi4/KPq39hbdC4XoBbnjZzAYywdUXzzq5+ThSadR9h7Jed3g3WbTbM8I8QpURVVvbBNyqjvYrshSqV3bWdMy8+LMRsb5LMP7jis+hCNKbgvrhy4QioD1L60QHfd+5bYNX2KVsb5Rz679jA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT2PR01MB10305.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:d9::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Wed, 25 May 2022 20:04:35 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.013; Wed, 25 May 2022 20:04:35 +0000 From: Rick Macklem To: Adam Stylinski CC: John , "freebsd-fs@freebsd.org" Subject: Re: zfs/nfsd performance limiter Thread-Topic: zfs/nfsd performance limiter Thread-Index: AQHYaxQfJkENgRkWo0q5KjKiS/ePTK0q68g+gATWMbCAACBRgIAAK5pE Date: Wed, 25 May 2022 20:04:35 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 94babc4e-5543-7259-ecbc-a180a50b1a5b x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: de2bbb41-dc37-4177-a374-08da3e89ca52 x-ms-traffictypediagnostic: YT2PR01MB10305:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: tcST2ODRIoz+CbfvckJbsVt55pab9pbiARFRQVCNsOGXO3nIdtgPjIPQozI5e/HUkt6NiohacCMMf5V5RYqptHHhrY1WfocgVgJmWOaBo/j4Ysk9lxsjaN6C1DOhDpp5wFQgsMrmhCUzFuoLbwOWcaCK0yc/Drw4bjTdomqol5GKDJHB1pQ8pFY/7l0LEeaLN0FWv2YAIFWpTFmTBgze4eB3UdGJ9319nt4UDkO2VSMHpkwKmxpZe5BFTt0KIqdiLHxauSoEUa6roPWNlAMK9q0csKGgcAvzWFj8jkvlrCuLjoOId9yQmzkC9LwXzev2dG3HoHMvcyYrTUjxPxX1HU0wNIqx0qJdgVM3D9gZgimS0X22yknH4oS/XkcJZOA6jaGn2hL6/4FyS73GsxOK6VgI/ULEccXMo0obF/a2rVBRsJgKH5HntH9o7j4EvTAmQUbv45xyuuuiSHZY9rmCdrivTFirKqso2/7gg2RsroPejF6otTpj641b8cd3bMceankxtWeTrZHlZR6ZZN2piRgbEAqY1iiutM+oC7QwG1fkJyGA59xLuvOLozb1hmeJnZC5tCbQqk9uKk0jWhi+EATJ44cLPwi5ZgV/IfjgzEDKhUOdpuHVciGt6Um7+BRS1c+tYk+pfhObSmpUzDPtepcNvh6xrsz7phr/QJ/ChvYi+yP6BaLufyMvP3BBHyOs/Id1wryXS4pi7ToSap6JLJCm39gN/W0+IzQnpk/XyHiggGLlwUHWprHZBTYintMYZnbg+jBvbCYy+MkPICvx/cqhvJO4xrKruK9epAsJ+JY= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(3480700007)(508600001)(5660300002)(8936002)(52536014)(55016003)(76116006)(186003)(33656002)(83380400001)(966005)(53546011)(316002)(71200400001)(86362001)(6506007)(9686003)(786003)(54906003)(6916009)(7696005)(2906002)(91956017)(38070700005)(64756008)(66556008)(8676002)(4326008)(122000001)(66446008)(66946007)(66476007)(38100700002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?1H8A/XGYlTrYsxDMWFsSh7xcq4Bt6UFhgwnQ+ILkQ0UmH2+yGtDHh3paNn?= =?iso-8859-1?Q?rGSfQh9GkQZGtglCYqLNieNeSTGuKoh3yLZWh/jnsbg9YAOv1nH/5gEmuA?= =?iso-8859-1?Q?V5eXAdRqgyLttRRa5fIFDqvRvMTtrz5iSLLQKBwM6EV9t9A06grQskH8b2?= =?iso-8859-1?Q?LyHQjdCGP9vnBzFZSkuh2RwMlsipN3Sit0AH1ls5QGUQ+TzRY8eLadLbg7?= =?iso-8859-1?Q?nTPC+DyWltETHvNrbgsuEUMFdeVRr8prDxCDkzb+LOdc2j8RYxWJs4YK92?= =?iso-8859-1?Q?rmqkJky29iZhhlo1nkQIIdLZmCUqfGf7AlSA5C2UmrSlKo7MZiL/lImAWC?= =?iso-8859-1?Q?Wj1A+yGIp95lZEqdmPXe2VzlV9tFUnMAbZnUXsmkh917JfKNSdvdN5S/3L?= =?iso-8859-1?Q?45mmxOt0tGuRg9KUZB5euvV8HdkvhKde8jOG1NASah1oXlHwaYqvBXmg31?= =?iso-8859-1?Q?lB6tNJYicICa9vScIn3mtdFXTGucEfvHcm+F+9kN6CNbl4XIoWmgdBzL+J?= =?iso-8859-1?Q?mX4jVles6OdujFr3SFREncrk5jcW6LS9z818CwAk6CQe2IKy62cefFuLo3?= =?iso-8859-1?Q?z6ECdQ/ccsbm21cRarUwYXRl3yTZuWyC98Xe7u7hrJNbLxk34kHS4USMNE?= =?iso-8859-1?Q?Y5Elgn6mPpgGzjrtMSODM3vs1IqfaOAKEhXUDVzV/0tBeZUy5p7yIs0SRR?= =?iso-8859-1?Q?vH+4FJzg//0Ctm6vODfYUskHmVKut1aF0EQXII9TMv5G01ekwce0gt9C+S?= =?iso-8859-1?Q?/mW7IWwCd4zCd/MuBLbwY83zMuxxDFH+5+meQDRxBE0397Od03tbwn/P9Q?= =?iso-8859-1?Q?y9yK54hpvsXGM37KS9fAtAdQPIj0PltP2YqqfAgz5cg5cXRPMcJMTA6f7j?= =?iso-8859-1?Q?kbCaFrfkTKmWyRJdkbqlGQknuisby0M7z0UxBtosG6CIUdPI4aNpwIrl5D?= =?iso-8859-1?Q?IvpmsDo/f9lGvc9V4nIQnqd8R65Df6VKDfAoAmTGklLjMlc64pixJapyFS?= =?iso-8859-1?Q?OVEs6IAaFQt3GJQ/EiTbAvS61Gym1qUZVeEiwYDJNwbplAt9C2gr/rEFbU?= =?iso-8859-1?Q?89lyzN022G2xOU6odRjJNEMmmfJcqif1hHJV0XhFMCPHC/2kqPk8t/d6/Q?= =?iso-8859-1?Q?/YjTYHasnkx7XqGsIXdkLRYepjsBqIAWQpamUeiRIVtiHkRyfih6oWv3Kn?= =?iso-8859-1?Q?nPhCJmw9q8iVwf+LHyLOKYT4PW47Y0tOpoV1GTwUT9W1KwnpHLbJB1VvxP?= =?iso-8859-1?Q?EfpeKmZUgMhjbILo+GjhwfOmznUgOWSnD4b3XPeg2sXYS9meEhJWoM7LXP?= =?iso-8859-1?Q?r2kGxyJ2KvD7FiLDxChJovxJHHECtKaYvkEyv7Jrk1QIBOhfBSpICpNSgZ?= =?iso-8859-1?Q?IhEwX6zGNFLmPV6ol2C5scGJoXxisALC8CuXAjq3hCeV+uJIx0QSh3V+TF?= =?iso-8859-1?Q?ts27Fn8y2YfGy/INIOo3agyIuac7uxhaI61Gwb6MXQyLdnA17mlkZm4MJB?= =?iso-8859-1?Q?+JRH3AeRlk6vaGgEIJ/d6bMar1eiCMMnPwfNwXQK9N4J0RAK1ChlFezNaa?= =?iso-8859-1?Q?GilVKWG1uEWsMGnO27X7ev4/bfHzHyTcIUjhxH8uQRyKxG314lKfNWOw5m?= =?iso-8859-1?Q?wVOVWYZA8Wb1XZSn+FCKS0Ygh4yLm9KYOolMylX4Ri4lUb7Ni2YmrjSfRi?= =?iso-8859-1?Q?bhVnUVQQXriPXll24CdRNrXL4BPVXFeDj/KbQa8C8Y6ju9gg3XuXb8cwsN?= =?iso-8859-1?Q?vcX8zeDeQc6xYzn1/0QAIlWTVsCTRB5DzNS0qDwoem0lCn/56gGKMebM0C?= =?iso-8859-1?Q?uuRWEKNwsorEZ/+s1T36i6Z0LV6/iWcJF6Jy1LshF6rvryn0NAKBJYqvpP?= =?iso-8859-1?Q?v4?= x-ms-exchange-antispam-messagedata-1: HWuO2YGvIKteRw== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: de2bbb41-dc37-4177-a374-08da3e89ca52 X-MS-Exchange-CrossTenant-originalarrivaltime: 25 May 2022 20:04:35.1889 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 620/4oOjZGC4rWGzV77K7aMZosPy2rjpnoPHvNbN4XqVCtr6ulROshtZX1H3lZCAQgQ9KE4k/4oRZx5y45tL/A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB10305 X-Rspamd-Queue-Id: 4L7hqZ2sv0z3PZx X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=oxOziLOu; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.43 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.43:from]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MLMMJ_DEST(0.00)[freebsd-fs]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.43:from] X-ThisMailContainsUnwantedMimeParts: N Adam Stylinski wrote:=0A= > Hmm, I don't know that the present of jumbo 9k mbufs is indicative=0A= > that the mellanox drivers are using them or not, given that I have a=0A= > link aggregation on a different (1gbps) NIC that also could be the=0A= > cause of that:=0A= >=0A= > mbuf: 256, 52231134, 49500, 25931,1956138424,=0A= 0, 0, 0=0A= > mbuf_cluster: 2048, 8161114, 2794, 4352,700435355, 0, = 0, 0=0A= > mbuf_jumbo_page: 4096, 4080557, 12288, 3977,155289291, 0, = 0, 0=0A= > mbuf_jumbo_9k: 9216, 1609044, 32772, 4174,35785053, 0, 0= , 0=0A= > mbuf_jumbo_16k: 16384, 680092, 0, 0, 0, 0, 0,= 0=0A= >=0A= > Early on, 9k MTUs did show significant advantages for throughput from=0A= > what I remember. But of course, this is before trying any of the=0A= > aforementioned changes for multiplexing the connection.=0A= I may give you better performance for your test runs, but if you fragment t= he mbuf=0A= cluster pool you can get hit pretty hard.=0A= =0A= Buyer beware, as they say, rick=0A= ps: It doesn't matter what is using them. Any mixing of 2K, 4K and 9K can r= esult=0A= in fragmentation of the pool such that an allocation cannot happen un= til=0A= mbuf clusters get free'd.=0A= =0A= On Wed, May 25, 2022 at 11:41 AM Rick Macklem wrote:= =0A= >=0A= > Adam Stylinski wrote:=0A= > [stuff snipped]=0A= >=0A= > > > ifconfig -vm=0A= > > mlxen0: flags=3D8843 metric 0 m= tu 9000=0A= > Just in case you (or someone else reading this) is not aware of it,=0A= > use of 9K jumbo clusters causes fragmentation of the memory pool=0A= > clusters are allocated from and, therefore, their use is not recommended.= =0A= >=0A= > Now, it may be that the mellanox driver doesn't use 9K clusters (it could= =0A= > put the received frame in multiple smaller clusters), but if it does, you= =0A= > should consider reducing the mtu.=0A= > If you:=0A= > # vmstat -z | fgrep mbuf_jumbo_9k=0A= > it will show you if they are being used.=0A= >=0A= > rick=0A= >=0A= >=0A= > > netstat -i=0A= > Name Mtu Network Address Ipkts Ierrs Idrop=0A= > Opkts Oerrs Coll=0A= > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0=0A= > 24178283 0 0=0A= > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0=0A= > 8447249 0 0=0A= > lo0 16384 lo0 367691 0 0=0A= > 367691 0 0=0A= > lo0 - localhost localhost 68 - -=0A= > 68 - -=0A= > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - -=0A= > 0 - -=0A= > lo0 - your-net localhost 348944 - -=0A= > 348944 - -=0A= > mlxen 9000 00:02:c9:35:df:20 13138046 0 12=0A= > 26308206 0 0=0A= > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - -=0A= > 24345184 - -=0A= > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0=0A= > 962249 102 0=0A= > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0=0A= > 31623674 0 0=0A= > lagg0 - 192.168.0.0/2 nasbox 27967582 - -=0A= > 41779731 - -=0A= >=0A= > > What threads/irq are allocated to your NIC? 'vmstat -i'=0A= >=0A= > Doesn't seem perfectly balanced but not terribly imbalanced, either:=0A= >=0A= > interrupt total rate=0A= > irq9: acpi0 3 0=0A= > irq18: ehci0 ehci1+ 803162 2=0A= > cpu0:timer 67465114 167=0A= > cpu1:timer 65068819 161=0A= > cpu2:timer 65535300 163=0A= > cpu3:timer 63408731 157=0A= > cpu4:timer 63026304 156=0A= > cpu5:timer 63431412 157=0A= > irq56: nvme0:admin 18 0=0A= > irq57: nvme0:io0 544999 1=0A= > irq58: nvme0:io1 465816 1=0A= > irq59: nvme0:io2 487486 1=0A= > irq60: nvme0:io3 474616 1=0A= > irq61: nvme0:io4 452527 1=0A= > irq62: nvme0:io5 467807 1=0A= > irq63: mps0 36110415 90=0A= > irq64: mps1 112328723 279=0A= > irq65: mps2 54845974 136=0A= > irq66: mps3 50770215 126=0A= > irq68: xhci0 3122136 8=0A= > irq70: igb0:rxq0 1974562 5=0A= > irq71: igb0:rxq1 3034190 8=0A= > irq72: igb0:rxq2 28703842 71=0A= > irq73: igb0:rxq3 1126533 3=0A= > irq74: igb0:aq 7 0=0A= > irq75: igb1:rxq0 1852321 5=0A= > irq76: igb1:rxq1 2946722 7=0A= > irq77: igb1:rxq2 9602613 24=0A= > irq78: igb1:rxq3 4101258 10=0A= > irq79: igb1:aq 8 0=0A= > irq80: ahci1 37386191 93=0A= > irq81: mlx4_core0 4748775 12=0A= > irq82: mlx4_core0 13754442 34=0A= > irq83: mlx4_core0 3551629 9=0A= > irq84: mlx4_core0 2595850 6=0A= > irq85: mlx4_core0 4947424 12=0A= > Total 769135944 1908=0A= >=0A= > > Are the above threads floating or mapped? 'cpuset -g ...'=0A= >=0A= > I suspect I was supposed to run this against the argument of a pid,=0A= > maybe nfsd? Here's the output without an argument=0A= >=0A= > pid -1 mask: 0, 1, 2, 3, 4, 5=0A= > pid -1 domain policy: first-touch mask: 0=0A= >=0A= > > Disable nfs tcp drc=0A= >=0A= > This is the first I've even seen a duplicate request cache mentioned.=0A= > It seems counter-intuitive for why that'd help but maybe I'll try=0A= > doing that. What exactly is the benefit?=0A= >=0A= > > What is your atime setting?=0A= >=0A= > Disabled at both the file system and the client mounts.=0A= >=0A= > > You also state you are using a Linux client. Are you using the MLX affi= nity scripts, buffer sizing suggestions, etc, etc. Have you swapped the Lin= ux system for a fbsd system?=0A= > I've not, though I do vaguely recall mellanox supplying some scripts=0A= > in their documentation that fixed interrupt handling on specific cores=0A= > at one point. Is this what you're referring to? I could give that a=0A= > try. I don't at present have any FreeBSD client systems with enough=0A= > PCI express bandwidth to swap things out for a Linux vs FreeBSD test.=0A= >=0A= > > You mention iperf. Please post the options you used when invoking iper= f and it's output.=0A= >=0A= > Setting up the NFS client as a "server", since it seems that the=0A= > terminology is a little bit flipped with iperf, here's the output:=0A= >=0A= > -----------------------------------------------------------=0A= > Server listening on 5201 (test #1)=0A= > -----------------------------------------------------------=0A= > Accepted connection from 10.5.5.1, port 11534=0A= > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931=0A= > [ ID] Interval Transfer Bitrate=0A= > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec=0A= > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec=0A= > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec=0A= > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec=0A= > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec=0A= > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec=0A= > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec=0A= > - - - - - - - - - - - - - - - - - - - - - - - - -=0A= > [ ID] Interval Transfer Bitrate=0A= > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec rec= eiver=0A= > -----------------------------------------------------------=0A= > Server listening on 5201 (test #2)=0A= > -----------------------------------------------------------=0A= >=0A= > On Sun, May 22, 2022 at 3:45 AM John wrote:=0A= > >=0A= > > ----- Adam Stylinski's Original Message -----=0A= > > > Hello,=0A= > > >=0A= > > > I have two systems connected via ConnectX-3 mellanox cards in etherne= t=0A= > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed= =0A= > > > at 8192, and I can hit around 36 gbps with iperf.=0A= > > >=0A= > > > When using an NFS client (client =3D linux, server =3D freebsd), I se= e a=0A= > > > maximum rate of around 20gbps. The test file is fully in ARC. The= =0A= > > > test is performed with an NFS mount nconnect=3D4 and an rsize/wsize o= f=0A= > > > 1MB.=0A= > > >=0A= > > > Here's the flame graph of the kernel of the system in question, with= =0A= > > > idle stacks removed:=0A= > > >=0A= > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#= file-nfs_fg-svg=0A= > > >=0A= > > > The longest functions seems like maybe it's the ERMS aware memcpy=0A= > > > happening from the ARC? Is there maybe a missing fast path that coul= d=0A= > > > take fewer copies into the socket buffer?=0A= > >=0A= > > Hi Adam -=0A= > >=0A= > > Some items to look at and possibly include for more responses....=0A= > >=0A= > > - What is your server system? Make/model/ram/etc. What is your=0A= > > overall 'top' cpu utilization 'top -aH' ...=0A= > >=0A= > > - It looks like you're using a 40gb/s card. Posting the output of=0A= > > 'ifconfig -vm' would provide additional information.=0A= > >=0A= > > - Are the interfaces running cleanly? 'netstat -i' is helpful.=0A= > >=0A= > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order?=0A= > >=0A= > > - Inspect 'netstat -m'. Denied? Delayed?=0A= > >=0A= > >=0A= > > - You mention iperf. Please post the options you used when=0A= > > invoking iperf and it's output.=0A= > >=0A= > > - You appear to be looking for through-put vs low-latency. Have=0A= > > you looked at window-size vs the amount of memory allocated to the=0A= > > streams. These values vary based on the bit-rate of the connection.= =0A= > > Tcp connections require outstanding un-ack'd data to be held.=0A= > > Effects values below.=0A= > >=0A= > >=0A= > > - What are your values for:=0A= > >=0A= > > -- kern.ipc.maxsockbuf=0A= > > -- net.inet.tcp.sendbuf_max=0A= > > -- net.inet.tcp.recvbuf_max=0A= > >=0A= > > -- net.inet.tcp.sendspace=0A= > > -- net.inet.tcp.recvspace=0A= > >=0A= > > -- net.inet.tcp.delayed_ack=0A= > >=0A= > > - What threads/irq are allocated to your NIC? 'vmstat -i'=0A= > >=0A= > > - Are the above threads floating or mapped? 'cpuset -g ...'=0A= > >=0A= > > - Determine best settings for LRO/TSO for your card.=0A= > >=0A= > > - Disable nfs tcp drc=0A= > >=0A= > > - What is your atime setting?=0A= > >=0A= > >=0A= > > If you really think you have a ZFS/Kernel issue, and you're=0A= > > data fits in cache, dump ZFS, create a memory backed file system=0A= > > and repeat your tests. This will purge a large portion of your=0A= > > graph. LRO/TSO changes may do so also.=0A= > >=0A= > > You also state you are using a Linux client. Are you using=0A= > > the MLX affinity scripts, buffer sizing suggestions, etc, etc.=0A= > > Have you swapped the Linux system for a fbsd system?=0A= > >=0A= > > And as a final note, I regularly use Chelsio T62100 cards=0A= > > in dual home and/or LACP environments in Supermicro boxes with 100's=0A= > > of nfs boot (Bhyve, QEMU, and physical system) clients per server=0A= > > with no network starvation or cpu bottlenecks. Clients boot, perform= =0A= > > their work, and then remotely request image rollback.=0A= > >=0A= > >=0A= > > Hopefully the above will help and provide pointers.=0A= > >=0A= > > Cheers=0A= > >=0A= >=0A= From nobody Wed May 25 20:43:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0D5941B50AC7 for ; Wed, 25 May 2022 20:43:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7jhm6BPqz3mNL for ; Wed, 25 May 2022 20:43:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A8C9820803 for ; Wed, 25 May 2022 20:43:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PKhq4u056936 for ; Wed, 25 May 2022 20:43:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PKhqdN056935 for fs@FreeBSD.org; Wed, 25 May 2022 20:43:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Wed, 25 May 2022 20:43:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653511432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EVt99n66RDHX+fX/Oj6plZkI9ZPgOLHcRc454PSCOSU=; b=v6oWkLN7DVwlZi8w1BN+SQBlBFciegNWZrRn6KUVVN0kp85wWiCetcwPttcinr6weFeXSa I/2hXsZxbNgRdDlzKQqvhTOxVY2GjkT+fZ/543qX3f5E7cDG0Y6BZrj5IO39JXKETBLRIC Kqqe2j4KdE80xXY9tmfSAhENiOuDZFE10LQO5wBoLHBhwsbAwTETMuSfypTwJuiMY++8UC TFs/+dPV3HX9WQQZzm5JBzx5UGG2ELl1lWxZ72oBrP1USy7zJHZ35dd29SUyM2fsEiYPOd gA8hi/Ch/04aPjuNAiUNJjNC6WLr9IphP6fJedoYCa7zj+IJDBnM9d6MkdBNxA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653511432; a=rsa-sha256; cv=none; b=oSedlZz4kg4vuOdNWg4wvbTJvl9Lkvr4WJSTW7MSOEDkmyYcEE+ltxhoQITmuaP4XmPaDi Y52etasBlqIh/oHmguJ3YeJKoux1ekBX8DhuqxuBpdiuGAwmsAdygWBIplTmd5wNoDsbL5 Dpgzpb8c0Jqq8EMjsc7VDSjaJtJ9C3w7/gKohRvcXMnO+0twEaXxKEj4SoJJeIBNOmVSv+ LihEpH0PoOvy2VuJP9OOEvLzxDAvpwHg/EgjPaQt9U3o3XYIIrMmqIn9q6Bgu/XlkwLQI5 mYalgQ6crshl8b0aTmSzZEx//EKZ3asc9TzjBU7GhN+BNeTN2TI/W09kqnpK0A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #15 from zmey20000@yahoo.com --- (In reply to Toomas Soome from comment #14) Looks awesome. Thank you very much, sir! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 25 23:49:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D510F1B553BF for ; Wed, 25 May 2022 23:49:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7nqN4vkkz4g5w for ; Wed, 25 May 2022 23:49:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8603522E46 for ; Wed, 25 May 2022 23:49:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24PNnqxg057357 for ; Wed, 25 May 2022 23:49:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24PNnqWh057356 for fs@FreeBSD.org; Wed, 25 May 2022 23:49:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Wed, 25 May 2022 23:49:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653522592; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cXs6yRjHkLoC35gmUmZmqKA46z966JtB8ROhJO74CT0=; b=FXfUFcuCEyIaU8Dz4gen80i2tf+s2v3KnHV3Gpb74KFeco5+clBUzMi5Iu9FVwfhxN2ctS IcnwJI890sE2cjZ8b4d8iXqX0AkCao4KuMUeYyB29dxbAbNblAIPvFfbXd528DFhdGYo2n kG6nCWVYBjJ8jMXW/n+uQCxM8oa5n1OWrKDhmqOa1weALpWKwrA5FKL4I7cM5oVdqnzA1M 4JTE7vYswESjCiKe7TkSds9AOuKMbhI0MHVIQEc40uHHrbBGqSQcy1pTF680itNsTFbbom tduuW/DpDOl0+tCqN85ERzbeWX4zUiNKFOQIMKkfWhocqZpNfQ/EvnTfWnDckg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653522592; a=rsa-sha256; cv=none; b=EYHUZonm4quSosQ8DW7jbDRfSVr7lGTmOMS2l8uruSV1RsA4Xx+Jb6W1Hz7fCp5DRUkNY+ q2UgeF/epRc9erg1brnNfxBqsaH3qC9s7XdOigL5MczhPVt+pwdIqDXZkjmOTF0CMVX96v Qupy5SvFqp6z8Sptp3t+5JVvF4KcboLe5YIa3DlRRiegN4B8TrrBCihwIzJa4d9nsIWmd7 JLlmM5N85pD0fTFKj8AzOUTJ8AfamCU/POHAYC8moWZRiDxkTNkwAKYKkl1t21Ydp9igSE F7hl+BNxAvk9oIsI6oiDJqK2fxtVWsvrc14PUquhErg5h6jfBzspejc3wxggQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #8 from Kubilay Kocak --- ^Triage: Docs improvement or is there something we can/should do to improve mount_msdosfs label handling? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 26 02:42:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A33C11B51978 for ; Thu, 26 May 2022 02:42:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7sft3VM7z3LFS for ; Thu, 26 May 2022 02:42:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 58F89258A4 for ; Thu, 26 May 2022 02:42:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24Q2gk7d057604 for ; Thu, 26 May 2022 02:42:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24Q2gkj9057603 for fs@FreeBSD.org; Thu, 26 May 2022 02:42:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Thu, 26 May 2022 02:42:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653532966; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PxNM6O5X+8a+SI8OzVQjFzXCS/Gn6OlOjk9F8+L5p0g=; b=hgtZZ/PjRTHl82e3RWZedGKZQtM4YFaRzFCidrAOLyn0JcenXTO1KqW2yBGwDqlHQZHAd4 hYcsgkzV0ruUNXTeZbUHFqMnazLru9Wz1SSFkBY0tGYTGu4bBRK3TjrieYVgM9z6tfRIsC Wi23MS/sgTSO/q648tyirrLDn83bH6sJTOwI/yhDditSEd/5GIVwG/89LA7QjYn2RnX75g UXjeb3iN9dPs+pxOve8Aa6baCznLH1VlMgrb5qPeqZrZYPhOiYC/oOD8qIuz65TqQzakBN qVqt9WWMvkLIpsU2UyrEtJQ4bg8pdHtzSpIqwJaR+uFjF709YwkTqkjT2h/FhA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653532966; a=rsa-sha256; cv=none; b=KtyCUukRuOG1tlbfYMB7ca0PJoIxW9TfQIoVC9VimwSBjxi6OieiDlgee/dlHctb2O5Q8+ DghlMFOgsgGpMpWFL3mvDf5if+LgbnAtpaqZVIe0aS0csgWiGECcQN4WpCCJm7se3WbvaI OQI7cU7oSUf5xrPdiVw3wd9GL/artT5NICdL3xQ62ZAGPC0iuWuESr1f2CG5an2xV5U3xq suLmrITC9JqEqcX8gmYtPu+dyg2e7nTGJ3eoaLDrYtSxQNVGcUaoFebMymDd8bN+0VhkDF uzi01nCfIqP9zzbrSvhtym28txFCU9wJwJvzxVXNfZyyevRmO3P0bg4UoWSCaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #9 from t_uemura@macome.co.jp --- (In reply to Kubilay Kocak from comment #8) Appreciated if glabel warns users when they try to label on existing filesystems, that they need to re-format the filesystem via the label or inconsistent state may arise. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 26 03:37:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4DDFC1B3C598 for ; Thu, 26 May 2022 03:37:48 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L7ttN1ZH6z3jDd; Thu, 26 May 2022 03:37:48 +0000 (UTC) (envelope-from jwd@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653536268; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Z/Nbtqh5/8GcBdKHSWX33N88I4Eu2gx303vbu/lnlqE=; b=fpz285bQlmfGSiaZEjjT3yCWqOE7j9JSd1W9ZZAckUZ1KZOsIS3V1DrauLmZoyF4tXMX7a Cvn8SCmfW9YZlYLrafUrvVm+d/aBNklAfb3ZzzIORvfcWPIOrD7nqob6PPI8q8y2Gwmktf Tlw1gMs31VSQlnOvDMKJGzMTkD4W9sFfu5Exe9U7SqO6N9IYiWulB+vqFsvZIb8evH5eXM 1hnEsTSU641K8KEU3SG/d64shfbW0J9/8lZAVwNz2NosjD4carIsMlbCNxpUHdBvgvmJyY BU2TYZylpbS3CB1nWLhB0ODH9JmebwSt88xLkInraipbCGDFzqSQuip8Yhuebw== Received: by freefall.freebsd.org (Postfix, from userid 821) id 1FA4E1ADC1; Thu, 26 May 2022 03:37:48 +0000 (UTC) Date: Thu, 26 May 2022 03:37:48 +0000 From: John To: Adam Stylinski Cc: freebsd-fs@freebsd.org, Rick Macklem Subject: Re: zfs/nfsd performance limiter Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653536268; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Z/Nbtqh5/8GcBdKHSWX33N88I4Eu2gx303vbu/lnlqE=; b=YS3s/9VOF0NpZmA2QXeP24+WX7JxcmC0Hm1BwSiHP0clDbiFriv7IdqYfr+buroeToayYr uDSeii69jq6n34yfPE+gOc2mRo6C7wxWl2YI5KjNdOZ+d065RN3AIsL3LZTRTROE3bf9HI NdaK4Bw3qOZIXc6BL7bNFkIox2Bi3w9Xa7JneczCF1+SROBO2/7fXan5pNBpuTdBb8UKr8 kL34kNSe+G5nIc+cDWG6aZ4cpTq1c6EaB5I8h0r9T43sgp4wRbQMjSFi75UDTG5VtSQm/x IqqJaxNWqcNFE+SAC7MVdJzQS/An0zAaSUfwrmI+FZe2anKXwrmdnmZdV5lKQA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653536268; a=rsa-sha256; cv=none; b=jZtuLbdzCZKxCqJ0UoetaBDOsoJvD0vDJMxcphRcDx0PGzJD1nwkEpqKO06RH1ayFjcI+u nAohkwlUGwCCO3cqngLo9UUk0vOFX6+UeryRYAtBtBhlnEx8eCdwZoZFGK/E3dUJkyV8fD sWaZ3MK+/YcVUWHZYqg84CrJQKLDKaC2BgnzSb+OWvxxaOv4bM1D7aN0pN+xliH/ZNZULl MUAMVQ8IAy7+YyGGO+m1mOiqD/HpkcpILwCz5EVGperV8h/B2U2Y9vc/xXp9YzSdiYlT4I NHAKlU+NXxIM/oJUZDGlY5yNKTM9BqXyDJqPl0mpFaGK1xXbMClTI/2RXRT2Tg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N Hi Adam, Sorry for the late reply to your original reply. Many good replies from Rick cc'd (Hi Rick :-) 1 item pops out to me below. ----- Adam Stylinski's Original Message ----- > > What is your server system? Make/model/ram/etc. > Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores, a little starved > on the clock but the load at least is basically zero during this test) > 128GB of memory > > > top -aH > During the copy load (for brevity, only did the real top contenders for CPU here): > last pid: 15560; load averages: 0.25, 0.39, 0.27 up 4+15:48:54 09:17:38 > 98 threads: 2 running, 96 sleeping > CPU: 0.0% user, 0.0% nice, 19.1% system, 5.6% interrupt, 75.3% idle > Mem: 12M Active, 4405M Inact, 8284K Laundry, 115G Wired, 1148M Buf, 4819M Free > ARC: 98G Total, 80G MFU, 15G MRU, 772K Anon, 1235M Header, 1042M Other > 91G Compressed, 189G Uncompressed, 2.09:1 Ratio > Swap: 5120M Total, 5120M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 3830 root 20 0 12M 2700K rpcsvc 2 1:16 53.26% nfsd: server (nfsd){nfsd: service} > 3830 root 20 0 12M 2700K CPU5 5 5:42 52.96% nfsd: server (nfsd){nfsd: master} > 15560 adam 20 0 17M 5176K CPU2 2 0:00 0.12% top -aH > 1493 root 20 0 13M 2260K select 3 0:36 0.01% /usr/sbin/powerd > 1444 root 20 0 75M 2964K select 5 0:19 0.01% /usr/sbin/mountd -r /etc/exports /etc/zfs/exports > 1215 uucp 20 0 13M 2820K select 5 0:27 0.01% /usr/local/libexec/nut/usbhid-ups -a cyberpower > 93424 adam 20 0 21M 9900K select 0 0:00 0.01% sshd: adam@pts/0 (sshd) > > > ifconfig -vm > mlxen0: flags=8843 metric 0 mtu 9000 > options=ed07bb > capabilities=ed07bb > ether 00:02:c9:35:df:20 > inet 10.5.5.1 netmask 0xffffff00 broadcast 10.5.5.255 > media: Ethernet autoselect (40Gbase-CR4 ) Something worth checking: The media line indicates that rxpause/txpause are active for this interface. I don't have a mlx based Linux system handy so the following is from memory. On the Linux side, please try: ethtool -S $interface | grep pause The output should include the number of times a pause frame was transmitted (Linux system NIC receive queue (almost) full) or a pause frame was received (meaning the FreeBSD system NIC receive queue (almost) full). If the values are 0 this is not an issue. If rx/tx pause frames are being sent/received this will slow down the link (rather dramatically sometimes). With only rx/tx pause (vs dcbx) a system spewing pause frames can bring a set of connected systems to a slow crawl. -John > status: active > supported media: > media autoselect > media 40Gbase-CR4 mediaopt full-duplex > media 10Gbase-CX4 mediaopt full-duplex > media 10Gbase-SR mediaopt full-duplex > media 1000baseT mediaopt full-duplex > nd6 options=29 > plugged: QSFP+ 40GBASE-CR4 (No separable connector) > vendor: Mellanox PN: MC2207130-002 SN: MT1419VS07971 DATE: 2014-06-06 > module temperature: 0.00 C voltage: 0.00 Volts > lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > > - What are your values for: > > > > -- kern.ipc.maxsockbuf > > -- net.inet.tcp.sendbuf_max > > -- net.inet.tcp.recvbuf_max > > > > -- net.inet.tcp.sendspace > > -- net.inet.tcp.recvspace > > > > -- net.inet.tcp.delayed_ack > kern.ipc.maxsockbuf: 16777216 > net.inet.tcp.sendbuf_max: 16777216 > net.inet.tcp.recvbuf_max: 16777216 > net.inet.tcp.sendspace: 32768 # This is interesting? I'm not sure why > the discrepancy here > net.inet.tcp.recvspace: 4194304 > net.inet.tcp.delayed_ack: 0 > > > netstat -i > Name Mtu Network Address Ipkts Ierrs Idrop > Opkts Oerrs Coll > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0 > 24178283 0 0 > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0 > 8447249 0 0 > lo0 16384 lo0 367691 0 0 > 367691 0 0 > lo0 - localhost localhost 68 - - > 68 - - > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - - > 0 - - > lo0 - your-net localhost 348944 - - > 348944 - - > mlxen 9000 00:02:c9:35:df:20 13138046 0 12 > 26308206 0 0 > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - - > 24345184 - - > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0 > 962249 102 0 > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0 > 31623674 0 0 > lagg0 - 192.168.0.0/2 nasbox 27967582 - - > 41779731 - - > > > What threads/irq are allocated to your NIC? 'vmstat -i' > > Doesn't seem perfectly balanced but not terribly imbalanced, either: > > interrupt total rate > irq9: acpi0 3 0 > irq18: ehci0 ehci1+ 803162 2 > cpu0:timer 67465114 167 > cpu1:timer 65068819 161 > cpu2:timer 65535300 163 > cpu3:timer 63408731 157 > cpu4:timer 63026304 156 > cpu5:timer 63431412 157 > irq56: nvme0:admin 18 0 > irq57: nvme0:io0 544999 1 > irq58: nvme0:io1 465816 1 > irq59: nvme0:io2 487486 1 > irq60: nvme0:io3 474616 1 > irq61: nvme0:io4 452527 1 > irq62: nvme0:io5 467807 1 > irq63: mps0 36110415 90 > irq64: mps1 112328723 279 > irq65: mps2 54845974 136 > irq66: mps3 50770215 126 > irq68: xhci0 3122136 8 > irq70: igb0:rxq0 1974562 5 > irq71: igb0:rxq1 3034190 8 > irq72: igb0:rxq2 28703842 71 > irq73: igb0:rxq3 1126533 3 > irq74: igb0:aq 7 0 > irq75: igb1:rxq0 1852321 5 > irq76: igb1:rxq1 2946722 7 > irq77: igb1:rxq2 9602613 24 > irq78: igb1:rxq3 4101258 10 > irq79: igb1:aq 8 0 > irq80: ahci1 37386191 93 > irq81: mlx4_core0 4748775 12 > irq82: mlx4_core0 13754442 34 > irq83: mlx4_core0 3551629 9 > irq84: mlx4_core0 2595850 6 > irq85: mlx4_core0 4947424 12 > Total 769135944 1908 > > > Are the above threads floating or mapped? 'cpuset -g ...' > > I suspect I was supposed to run this against the argument of a pid, > maybe nfsd? Here's the output without an argument > > pid -1 mask: 0, 1, 2, 3, 4, 5 > pid -1 domain policy: first-touch mask: 0 > > > Disable nfs tcp drc > > This is the first I've even seen a duplicate request cache mentioned. > It seems counter-intuitive for why that'd help but maybe I'll try > doing that. What exactly is the benefit? > > > What is your atime setting? > > Disabled at both the file system and the client mounts. > > > You also state you are using a Linux client. Are you using the MLX affinity scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux system for a fbsd system? > I've not, though I do vaguely recall mellanox supplying some scripts > in their documentation that fixed interrupt handling on specific cores > at one point. Is this what you're referring to? I could give that a > try. I don't at present have any FreeBSD client systems with enough > PCI express bandwidth to swap things out for a Linux vs FreeBSD test. > > > You mention iperf. Please post the options you used when invoking iperf and it's output. > > Setting up the NFS client as a "server", since it seems that the > terminology is a little bit flipped with iperf, here's the output: > > ----------------------------------------------------------- > Server listening on 5201 (test #1) > ----------------------------------------------------------- > Accepted connection from 10.5.5.1, port 11534 > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 > [ ID] Interval Transfer Bitrate > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver > ----------------------------------------------------------- > Server listening on 5201 (test #2) > ----------------------------------------------------------- > > On Sun, May 22, 2022 at 3:45 AM John wrote: > > > > ----- Adam Stylinski's Original Message ----- > > > Hello, > > > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > > at 8192, and I can hit around 36 gbps with iperf. > > > > > > When using an NFS client (client = linux, server = freebsd), I see a > > > maximum rate of around 20gbps. The test file is fully in ARC. The > > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > > 1MB. > > > > > > Here's the flame graph of the kernel of the system in question, with > > > idle stacks removed: > > > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > > happening from the ARC? Is there maybe a missing fast path that could > > > take fewer copies into the socket buffer? > > > > Hi Adam - > > > > Some items to look at and possibly include for more responses.... > > > > - What is your server system? Make/model/ram/etc. What is your > > overall 'top' cpu utilization 'top -aH' ... > > > > - It looks like you're using a 40gb/s card. Posting the output of > > 'ifconfig -vm' would provide additional information. > > > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > > > - Inspect 'netstat -m'. Denied? Delayed? > > > > > > - You mention iperf. Please post the options you used when > > invoking iperf and it's output. > > > > - You appear to be looking for through-put vs low-latency. Have > > you looked at window-size vs the amount of memory allocated to the > > streams. These values vary based on the bit-rate of the connection. > > Tcp connections require outstanding un-ack'd data to be held. > > Effects values below. > > > > > > - What are your values for: > > > > -- kern.ipc.maxsockbuf > > -- net.inet.tcp.sendbuf_max > > -- net.inet.tcp.recvbuf_max > > > > -- net.inet.tcp.sendspace > > -- net.inet.tcp.recvspace > > > > -- net.inet.tcp.delayed_ack > > > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > > > - Are the above threads floating or mapped? 'cpuset -g ...' > > > > - Determine best settings for LRO/TSO for your card. > > > > - Disable nfs tcp drc > > > > - What is your atime setting? > > > > > > If you really think you have a ZFS/Kernel issue, and you're > > data fits in cache, dump ZFS, create a memory backed file system > > and repeat your tests. This will purge a large portion of your > > graph. LRO/TSO changes may do so also. > > > > You also state you are using a Linux client. Are you using > > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > > Have you swapped the Linux system for a fbsd system? > > > > And as a final note, I regularly use Chelsio T62100 cards > > in dual home and/or LACP environments in Supermicro boxes with 100's > > of nfs boot (Bhyve, QEMU, and physical system) clients per server > > with no network starvation or cpu bottlenecks. Clients boot, perform > > their work, and then remotely request image rollback. > > > > > > Hopefully the above will help and provide pointers. > > > > Cheers > > From nobody Thu May 26 13:57:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6DB421B42779 for ; Thu, 26 May 2022 13:57:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L88dL1xyrz3Pmk for ; Thu, 26 May 2022 13:57:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 240357320 for ; Thu, 26 May 2022 13:57:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24QDvQTt031920 for ; Thu, 26 May 2022 13:57:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24QDvQEN031918 for fs@FreeBSD.org; Thu, 26 May 2022 13:57:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Thu, 26 May 2022 13:57:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653573446; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TEgjOJi1JRg47f1yHLBaTBhC1/XrhjbKgcpFFqFeaDU=; b=dl8EqtCioDKFnSVFMbzMAPg1sGlEVgm1u/w80WYcY0duSYXAziboWx7l4+OxhTZbUzHzgN ayuVO/DN7Ximh70Rs4tIImYf32sxy1PU38lEoY23WG3Ekx1lcdx/S25fahsWSoRA66JZp8 dxVLupLT6vke//itaUrMrlD9v0oIPbsa6O1OlxgI8g4YBv+V8+EH5bcvWbuH2P6evquu5O 6GCTwu+Y19vFxSPNPdzPsG7A+sIMdSfTL4NHv3nd5IAWzK2GmePgmhAhvSKxOq50jFFRkS vY8qicucTZSR7XFeQSs+KQgZBy35h2Pkr42Quw3RxRaC+KnaujeANQgbazF4Bg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653573446; a=rsa-sha256; cv=none; b=wbrTUUOvYNrwJUhJ0RJTdnL2HRN7+mRfWYXnqK7KibC06SnSxBu4MDEDYTxg4kemuD87br Hb9NQYt/4yoNPJe9yyVx5IF6YUbOy8RJmz+enTmX49noUfd8Oty7i/O2Iz+nTT4XQgn5rC P6MhddcwU7YZ6+EnqW9l8fNNkl9yajkJiN7iHwYO11qiildsfcwKo/yLgfxunB3LXuFeft kGCJgZ1isDswYi1MniBPCy7vejvrr4NkbjdN88Da3yny3Zj1j9KLv84znSzGwdCD4aaHPk ud2di1X+J0vRv//KlgCyMPcut/JikHqOepR1ya+yBSeX8F7FU1Y5o8UnsXJCpQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #10 from Mark Johnston --- (In reply to t_uemura from comment #7) Here is my attempt at improving the documentation: https://reviews.freebsd.org/D35326 Please let me know if it is clear or not. (In reply to t_uemura from comment #9) This is a good idea. We have fstyp(8), which can "taste" devices to see if they contain a known filesystem. However, that functionality would have to= be available in a library in order for glabel(8) to use it, and that would req= uire some effort... --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu May 26 21:37:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 591411B5814B for ; Thu, 26 May 2022 21:37:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8Lqd1L7Vz3hlm for ; Thu, 26 May 2022 21:37:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0A9ED15BE3 for ; Thu, 26 May 2022 21:37:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24QLb0iC092447 for ; Thu, 26 May 2022 21:37:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24QLb0Ww092446 for fs@FreeBSD.org; Thu, 26 May 2022 21:37:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Thu, 26 May 2022 21:37:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bblister@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653601021; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ip0/XYzR+fx1qN9d7eCYwpe7s0c1TN8+uI20uVkvJvg=; b=p8tWEZHjmvERMRA4fgovIZVHqu0O7TJ5lbp61Jek9R6Fm3Ch8AKkkcdp8uhmBRBQfnoJ9D yesYWJlnu8R4a2YfFepwtiqzTQnJU/kJGjjZQ8BVTXnZScmKE5UwgJNsBFPRmSmsr+TfXY csRMexlL1ML2d2Xk5CsZG922/AxrjAW7JYHj3vmx6MAKRj46lSuUAYUK1CA4hY75KSG8mi Gultd/goqhuK2mgX2oskHw0F/LfhDQeOELVnu9KL+sNh74NvC7xVkFA0OZii3Q/h7VYpAd D50RpDtT3CzfzpVx0gnLUwIeO8KQqTPxAD9soM6s7W3n4Rfz9idk3wnM85hGxQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653601021; a=rsa-sha256; cv=none; b=o6Yz7k4/hv2e+3Uel81HKdNWHjXirY2/iB7bFdBqWElwX7W809R9+4ajxdcBdBMpWu+uL2 e8N9hxm+qW0Uoir8P6y121ixAeh3DglP8hHLMreNjjECo06YQHi71UPUygLqaQxOuxHX04 +kavcpSiMp0XTKpxgeEvHZv72fHkGQVgfxZRiM2H1w0muWQwIKTUnPr3FqYLiRDIy05bhy tacDMtsfGIVGwbDegxnUke4qgF8xXdyi0BpOTfWxKNJeOwstJqSzhOxQ/46ul0cok7bGps NhSpQ/duy3CAn4GFSaSMnzh/qNsKVAXA9rJwTluYvLcr7ppSHnR5Ws709pNz1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 BB Lister changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bblister@gmail.com --- Comment #8 from BB Lister --- Tried also on FreeBSD 13.0-p11 (binary update from 12) to enable journaling= on a secondary filesystem but I got 'using inode 6 in cg 0 for ..... byte jour= nal' and 'failed to write updated cg: bad file descriptor'. The machine is on a virtio storage VPS (on a KVM cloud provider). Thus I have to wait almost 30 minutes for an FSCK on this 400GB partition. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 27 00:15:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8E57C1B5018C for ; Fri, 27 May 2022 00:15:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8QLx5Rgpz4YBD for ; Fri, 27 May 2022 00:15:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9BC9C18281 for ; Fri, 27 May 2022 00:15:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24R0Frs7090658 for ; Fri, 27 May 2022 00:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24R0FrQ2090657 for fs@FreeBSD.org; Fri, 27 May 2022 00:15:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264166] mount_msdosfs: Fails to mount glabel label: mount_msdosfs: /dev/label/MACOME_CONFIG: Invalid argument Date: Fri, 27 May 2022 00:15:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653610553; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0auPVMtlilk22NJkn53siJYOfUv8SDdpUZuU90Lj8Eo=; b=yMoo6p4/alUy6VOgUN+XuBb8pA7sw7TdlG3/ALxCqEcyW6yU8zrVPIcLFHHua1//ci9Vc3 MlJ5rj6unfqR1/qozDVFvPTnvtMTz1pww/gAl5ASWRdMlv0UtwXUSDFuYP+DqViB7LNOIl TcLAQNhuDUwKpe64PC4j4XQwb2qhS6Sf9ce0bqSODv4wZP17gSz0/6d5bZ+hVjLWNDPRCA N3UaALp/51jBNEehuuNJ30UgPBkXQJr+GAr4FBXo4+tU6akCJATDhtJ5Ons60mZIuLcnxT T87VoMi6AiSpca1CivY+JwDu/aEsvdp1PGhTlxVOvInhbytavE1L7FkqkqIOVw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653610553; a=rsa-sha256; cv=none; b=DSjYdWHx/EWl1cQtFk0zdgG7f2Z1aaiBlaer4OhhR/oa8pXTJnrymY/uaDKrDqJy/AX8nb Rfjak0Vq6HbMM1lgq88E73sn7QP7hC2jmoZspJ3Em7o9PTYi1Ih4z9wyhutA5yCRQskQEX wiQeOVr7xvhwb7y4wL9mY6HPQa48VB3AEadSQQKYf/JKwowtSpJ0aFJEDujoZuPoYqbrfo cln5ZOhnaJQg8Ai0qzNycj2GeYtUAELvF+q3Bk048IMxe1fIU5DgBvhDVizDZUTdnSTcG/ Q2/RYtbT0xHfJ/ojw4NatRFn53HOWgROowNEWooGGf0PNQ8gPKSHbs9Ezk2J3A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264166 --- Comment #11 from t_uemura@macome.co.jp --- (In reply to Mark Johnston from comment #10) > Please let me know if it is clear or not. Personally, the second paragraph (Note also that generic, automatic labels occupy ...) is more important than the first paragraph, so I think these two shall be swapped. > This is a good idea. We have fstyp(8), which can "taste" devices to see = if they That looks promising, must be the best solution. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri May 27 11:30:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4C8061B5C55E for ; Fri, 27 May 2022 11:30:26 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from mail.rlwinm.de (mail.rlwinm.de [IPv6:2a01:4f8:171:f902::5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8jKF3L0kz4knm for ; Fri, 27 May 2022 11:30:25 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from [IPV6:2001:9e8:94e:3b00:10c:30d:d129:e919] (unknown [IPv6:2001:9e8:94e:3b00:10c:30d:d129:e919]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.rlwinm.de (Postfix) with ESMTPSA id B39261C4BB for ; Fri, 27 May 2022 11:30:16 +0000 (UTC) Message-ID: Date: Fri, 27 May 2022 13:30:15 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.9.1 Subject: Re: zfs/nfsd performance limiter Content-Language: en-US To: freebsd-fs@freebsd.org References: From: Jan Bramkamp In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4L8jKF3L0kz4knm X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of crest@rlwinm.de designates 2a01:4f8:171:f902::5 as permitted sender) smtp.mailfrom=crest@rlwinm.de X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_NA(0.00)[rlwinm.de]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 23.05.22 00:26, Rick Macklem wrote: > Adam Stylinski wrote: > [stuff snipped] >> However, in general, RPC RTT will define how well NFS performs and not >> the I/O rate for a bulk file read/write. > Lets take this RPC RTT thing a step further... > - If I got the math right, at 40Gbps, 1Mbyte takes about 200usec on the wire. > Without readahead, the protocol looks like this: > Client Server (time going down the screen) > small Read request ---> > <-- 1Mbyte reply > small Read request --> > <-- 1Mbyte reply > The 1Mbyte replies take 200usec on the wire. > > Then suppose your ping time is 400usec (I see about 350usec on my little lan). > - The wire is only transferring data about half of the time, because the small > request message takes almost as long as the 1Mbyte reply. > > As you can see, readahead (where multiple reads are done concurrently) > is critical for this case. I have no idea how Linux decides to do readahead. > (FreeBSD defaults to 1 readahead, with a mount option that can increase > that.) > > Now, net interfaces normally do interrupt moderation. This is done to > avoid an interrupt storm during bulk data transfer. However, interrupt > moderation results in interrupt delay for handling the small Read request > message. > --> Interrupt moderation can increase RPC RTT. Turning it off, if possible, > might help. > > So, ping the server from the client to see what your RTT roughly is. > Also, you could look at some traffic in wireshark, to see what readahead > is happening and what the RPC RTT is. > (You can capture with "tcpdump", but wireshark knows how to decode > NFS properly.) > > As you can see, RPC traffic is very different from bulk data transfer. Would it make sense to extend nconnect to apply different QoS markings to the control connection and the bulk connections to prioritize small(ish) RPC calls over the bulk transfer RPCs? Failing that is it possible to connect to the NFS server through different addresses for small RPC and large RPCs to use different NICs and switch ports? From nobody Fri May 27 16:39:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CBB551B53782 for ; Fri, 27 May 2022 16:40:08 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-yb1-xb2f.google.com (mail-yb1-xb2f.google.com [IPv6:2607:f8b0:4864:20::b2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8rBc1KPrz3wG7; Fri, 27 May 2022 16:40:08 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: by mail-yb1-xb2f.google.com with SMTP id v106so1815164ybi.0; Fri, 27 May 2022 09:40:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=oew15Mw4/28gvsQEvXr5L0uEo0rTNB5pDxumumNtqjA=; b=BgJOL5CJ6PUerkEyHQhRq8ONyMtSxl3hyVPz+L4QQrLiID0S1PPVaeN+gePhCpm+HC idGWBNKyKPvBSY6Uc/lHyGvxvKdc/aLso9Oa35cFbGy6YpawprfcOcZWYDFkzzqq1XqB TqTMxgCvY+XGEPb/nGXs72rGM83Fo0vplVR2sBAq7i7KwMw6fFyCcqq3PIUvqZ3YZ6qZ T4jMKdjyGZ4bl77NTUTWS4JKfUDnQI03BpAmiBsOGLH/Wpim3dex6h5bnWdzx4Eot300 MMuxz2dgz9dC4D9QeNGvzxkkXM2OiN184eHLErq7KZEX2WErRGmnejVofDMUoU5RFfu1 ZVoQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=oew15Mw4/28gvsQEvXr5L0uEo0rTNB5pDxumumNtqjA=; b=f3FoU8I9Sr96JEv3gZ7cRVxjjFSrAeR1vDoOQJEJSHpl7Eyt35HX3UyPGgtpVEyN1H 8xn2tHWUsKXPpRn+Mc7p1XVsXGkkHnQXilSA/zMtWNvbm7LbQgb7OvSNaznWPOQdka0U IN4kVaRV2WOzkq4Y6GhNmOmUEyxb3AEVBJn3EUK9+eSQRcD+OfFXtDt+cmhJOloC1dza NALYewYjq+evLiYPImj3819ysaJ4coARoLBwL8IPos2EK/+RvIUMaZU/FXcAVW9xxjHq HB5uLGdeWpZ9exQRJaj/aVG4jwaCChEr8wBGxe/IOHn6eNlbOrpZnvlZCccTdbNqKaBb dtwA== X-Gm-Message-State: AOAM531I4pGH9nbYdYjYNJ0M+MRStyi9wxtYHRId3YRi7ngZ81NjeZqF jWkVXtowuNy36WS1Q3fNyMGTRCBqxjOUylu0WSWn1W7ylns= X-Google-Smtp-Source: ABdhPJzEyYKH2ECdzX1U6u/Hw9+/IE5fR0cK/fUNqVCzjkYHToJH58PZHOztuJfQJXUPqFYYgWWgwA0GrUDi4n34lHg= X-Received: by 2002:a25:db4f:0:b0:657:c31:995d with SMTP id g76-20020a25db4f000000b006570c31995dmr8280288ybf.148.1653669607181; Fri, 27 May 2022 09:40:07 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Adam Stylinski Date: Fri, 27 May 2022 12:39:56 -0400 Message-ID: Subject: Re: zfs/nfsd performance limiter To: John Cc: freebsd-fs@freebsd.org, Rick Macklem Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4L8rBc1KPrz3wG7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=BgJOL5CJ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kungfujesus06@gmail.com designates 2607:f8b0:4864:20::b2f as permitted sender) smtp.mailfrom=kungfujesus06@gmail.com X-Spamd-Result: default: False [-2.46 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.54)[0.536]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2f:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N rx_pause: 0 rx_pause_duration: 26 rx_pause_transition: 2 tx_pause: 4 tx_pause_duration: 0 tx_pause_transition: 0 The system's been up for about 95 days, though, so it's hard to say if the 4 in the counter there actually occurred during the tests. On Wed, May 25, 2022 at 11:37 PM John wrote: > > Hi Adam, > > Sorry for the late reply to your original reply. Many good replies > from Rick cc'd (Hi Rick :-) > > 1 item pops out to me below. > > ----- Adam Stylinski's Original Message ----- > > > > What is your server system? Make/model/ram/etc. > > Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores, a little starved > > on the clock but the load at least is basically zero during this test) > > 128GB of memory > > > > > top -aH > > During the copy load (for brevity, only did the real top contenders for CPU here): > > last pid: 15560; load averages: 0.25, 0.39, 0.27 up 4+15:48:54 09:17:38 > > 98 threads: 2 running, 96 sleeping > > CPU: 0.0% user, 0.0% nice, 19.1% system, 5.6% interrupt, 75.3% idle > > Mem: 12M Active, 4405M Inact, 8284K Laundry, 115G Wired, 1148M Buf, 4819M Free > > ARC: 98G Total, 80G MFU, 15G MRU, 772K Anon, 1235M Header, 1042M Other > > 91G Compressed, 189G Uncompressed, 2.09:1 Ratio > > Swap: 5120M Total, 5120M Free > > > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > 3830 root 20 0 12M 2700K rpcsvc 2 1:16 53.26% nfsd: server (nfsd){nfsd: service} > > 3830 root 20 0 12M 2700K CPU5 5 5:42 52.96% nfsd: server (nfsd){nfsd: master} > > 15560 adam 20 0 17M 5176K CPU2 2 0:00 0.12% top -aH > > 1493 root 20 0 13M 2260K select 3 0:36 0.01% /usr/sbin/powerd > > 1444 root 20 0 75M 2964K select 5 0:19 0.01% /usr/sbin/mountd -r /etc/exports /etc/zfs/exports > > 1215 uucp 20 0 13M 2820K select 5 0:27 0.01% /usr/local/libexec/nut/usbhid-ups -a cyberpower > > 93424 adam 20 0 21M 9900K select 0 0:00 0.01% sshd: adam@pts/0 (sshd) > > > > > ifconfig -vm > > mlxen0: flags=8843 metric 0 mtu 9000 > > options=ed07bb > > capabilities=ed07bb > > ether 00:02:c9:35:df:20 > > inet 10.5.5.1 netmask 0xffffff00 broadcast 10.5.5.255 > > media: Ethernet autoselect (40Gbase-CR4 ) > > Something worth checking: > > The media line indicates that rxpause/txpause are active for this > interface. I don't have a mlx based Linux system handy so the following > is from memory. On the Linux side, please try: > > ethtool -S $interface | grep pause > > The output should include the number of times a pause frame was > transmitted (Linux system NIC receive queue (almost) full) or a pause > frame was received (meaning the FreeBSD system NIC receive queue > (almost) full). If the values are 0 this is not an issue. > > If rx/tx pause frames are being sent/received this will slow down > the link (rather dramatically sometimes). With only rx/tx pause (vs > dcbx) a system spewing pause frames can bring a set of connected > systems to a slow crawl. > > -John > > > status: active > > supported media: > > media autoselect > > media 40Gbase-CR4 mediaopt full-duplex > > media 10Gbase-CX4 mediaopt full-duplex > > media 10Gbase-SR mediaopt full-duplex > > media 1000baseT mediaopt full-duplex > > nd6 options=29 > > plugged: QSFP+ 40GBASE-CR4 (No separable connector) > > vendor: Mellanox PN: MC2207130-002 SN: MT1419VS07971 DATE: 2014-06-06 > > module temperature: 0.00 C voltage: 0.00 Volts > > lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA > > > > > - What are your values for: > > > > > > -- kern.ipc.maxsockbuf > > > -- net.inet.tcp.sendbuf_max > > > -- net.inet.tcp.recvbuf_max > > > > > > -- net.inet.tcp.sendspace > > > -- net.inet.tcp.recvspace > > > > > > -- net.inet.tcp.delayed_ack > > kern.ipc.maxsockbuf: 16777216 > > net.inet.tcp.sendbuf_max: 16777216 > > net.inet.tcp.recvbuf_max: 16777216 > > net.inet.tcp.sendspace: 32768 # This is interesting? I'm not sure why > > the discrepancy here > > net.inet.tcp.recvspace: 4194304 > > net.inet.tcp.delayed_ack: 0 > > > > > netstat -i > > Name Mtu Network Address Ipkts Ierrs Idrop > > Opkts Oerrs Coll > > igb0 9000 ac:1f:6b:b0:60:bc 18230625 0 0 > > 24178283 0 0 > > igb1 9000 ac:1f:6b:b0:60:bc 14341213 0 0 > > 8447249 0 0 > > lo0 16384 lo0 367691 0 0 > > 367691 0 0 > > lo0 - localhost localhost 68 - - > > 68 - - > > lo0 - fe80::%lo0/64 fe80::1%lo0 0 - - > > 0 - - > > lo0 - your-net localhost 348944 - - > > 348944 - - > > mlxen 9000 00:02:c9:35:df:20 13138046 0 12 > > 26308206 0 0 > > mlxen - 10.5.5.0/24 10.5.5.1 11592389 - - > > 24345184 - - > > vm-pu 9000 56:3e:55:8a:2a:f8 7270 0 0 > > 962249 102 0 > > lagg0 9000 ac:1f:6b:b0:60:bc 31543941 0 0 > > 31623674 0 0 > > lagg0 - 192.168.0.0/2 nasbox 27967582 - - > > 41779731 - - > > > > > What threads/irq are allocated to your NIC? 'vmstat -i' > > > > Doesn't seem perfectly balanced but not terribly imbalanced, either: > > > > interrupt total rate > > irq9: acpi0 3 0 > > irq18: ehci0 ehci1+ 803162 2 > > cpu0:timer 67465114 167 > > cpu1:timer 65068819 161 > > cpu2:timer 65535300 163 > > cpu3:timer 63408731 157 > > cpu4:timer 63026304 156 > > cpu5:timer 63431412 157 > > irq56: nvme0:admin 18 0 > > irq57: nvme0:io0 544999 1 > > irq58: nvme0:io1 465816 1 > > irq59: nvme0:io2 487486 1 > > irq60: nvme0:io3 474616 1 > > irq61: nvme0:io4 452527 1 > > irq62: nvme0:io5 467807 1 > > irq63: mps0 36110415 90 > > irq64: mps1 112328723 279 > > irq65: mps2 54845974 136 > > irq66: mps3 50770215 126 > > irq68: xhci0 3122136 8 > > irq70: igb0:rxq0 1974562 5 > > irq71: igb0:rxq1 3034190 8 > > irq72: igb0:rxq2 28703842 71 > > irq73: igb0:rxq3 1126533 3 > > irq74: igb0:aq 7 0 > > irq75: igb1:rxq0 1852321 5 > > irq76: igb1:rxq1 2946722 7 > > irq77: igb1:rxq2 9602613 24 > > irq78: igb1:rxq3 4101258 10 > > irq79: igb1:aq 8 0 > > irq80: ahci1 37386191 93 > > irq81: mlx4_core0 4748775 12 > > irq82: mlx4_core0 13754442 34 > > irq83: mlx4_core0 3551629 9 > > irq84: mlx4_core0 2595850 6 > > irq85: mlx4_core0 4947424 12 > > Total 769135944 1908 > > > > > Are the above threads floating or mapped? 'cpuset -g ...' > > > > I suspect I was supposed to run this against the argument of a pid, > > maybe nfsd? Here's the output without an argument > > > > pid -1 mask: 0, 1, 2, 3, 4, 5 > > pid -1 domain policy: first-touch mask: 0 > > > > > Disable nfs tcp drc > > > > This is the first I've even seen a duplicate request cache mentioned. > > It seems counter-intuitive for why that'd help but maybe I'll try > > doing that. What exactly is the benefit? > > > > > What is your atime setting? > > > > Disabled at both the file system and the client mounts. > > > > > You also state you are using a Linux client. Are you using the MLX affinity scripts, buffer sizing suggestions, etc, etc. Have you swapped the Linux system for a fbsd system? > > I've not, though I do vaguely recall mellanox supplying some scripts > > in their documentation that fixed interrupt handling on specific cores > > at one point. Is this what you're referring to? I could give that a > > try. I don't at present have any FreeBSD client systems with enough > > PCI express bandwidth to swap things out for a Linux vs FreeBSD test. > > > > > You mention iperf. Please post the options you used when invoking iperf and it's output. > > > > Setting up the NFS client as a "server", since it seems that the > > terminology is a little bit flipped with iperf, here's the output: > > > > ----------------------------------------------------------- > > Server listening on 5201 (test #1) > > ----------------------------------------------------------- > > Accepted connection from 10.5.5.1, port 11534 > > [ 5] local 10.5.5.4 port 5201 connected to 10.5.5.1 port 43931 > > [ ID] Interval Transfer Bitrate > > [ 5] 0.00-1.00 sec 3.81 GBytes 32.7 Gbits/sec > > [ 5] 1.00-2.00 sec 4.20 GBytes 36.1 Gbits/sec > > [ 5] 2.00-3.00 sec 4.18 GBytes 35.9 Gbits/sec > > [ 5] 3.00-4.00 sec 4.21 GBytes 36.1 Gbits/sec > > [ 5] 4.00-5.00 sec 4.20 GBytes 36.1 Gbits/sec > > [ 5] 5.00-6.00 sec 4.21 GBytes 36.2 Gbits/sec > > [ 5] 6.00-7.00 sec 4.10 GBytes 35.2 Gbits/sec > > [ 5] 7.00-8.00 sec 4.20 GBytes 36.1 Gbits/sec > > [ 5] 8.00-9.00 sec 4.21 GBytes 36.1 Gbits/sec > > [ 5] 9.00-10.00 sec 4.20 GBytes 36.1 Gbits/sec > > [ 5] 10.00-10.00 sec 7.76 MBytes 35.3 Gbits/sec > > - - - - - - - - - - - - - - - - - - - - - - - - - > > [ ID] Interval Transfer Bitrate > > [ 5] 0.00-10.00 sec 41.5 GBytes 35.7 Gbits/sec receiver > > ----------------------------------------------------------- > > Server listening on 5201 (test #2) > > ----------------------------------------------------------- > > > > On Sun, May 22, 2022 at 3:45 AM John wrote: > > > > > > ----- Adam Stylinski's Original Message ----- > > > > Hello, > > > > > > > > I have two systems connected via ConnectX-3 mellanox cards in ethernet > > > > mode. They have their MTU's maxed at 9000, their ring buffers maxed > > > > at 8192, and I can hit around 36 gbps with iperf. > > > > > > > > When using an NFS client (client = linux, server = freebsd), I see a > > > > maximum rate of around 20gbps. The test file is fully in ARC. The > > > > test is performed with an NFS mount nconnect=4 and an rsize/wsize of > > > > 1MB. > > > > > > > > Here's the flame graph of the kernel of the system in question, with > > > > idle stacks removed: > > > > > > > > https://gist.github.com/KungFuJesus/918c6dcf40ae07767d5382deafab3a52#file-nfs_fg-svg > > > > > > > > The longest functions seems like maybe it's the ERMS aware memcpy > > > > happening from the ARC? Is there maybe a missing fast path that could > > > > take fewer copies into the socket buffer? > > > > > > Hi Adam - > > > > > > Some items to look at and possibly include for more responses.... > > > > > > - What is your server system? Make/model/ram/etc. What is your > > > overall 'top' cpu utilization 'top -aH' ... > > > > > > - It looks like you're using a 40gb/s card. Posting the output of > > > 'ifconfig -vm' would provide additional information. > > > > > > - Are the interfaces running cleanly? 'netstat -i' is helpful. > > > > > > - Inspect 'netstat -s'. Duplicate pkts? Resends? Out-of-order? > > > > > > - Inspect 'netstat -m'. Denied? Delayed? > > > > > > > > > - You mention iperf. Please post the options you used when > > > invoking iperf and it's output. > > > > > > - You appear to be looking for through-put vs low-latency. Have > > > you looked at window-size vs the amount of memory allocated to the > > > streams. These values vary based on the bit-rate of the connection. > > > Tcp connections require outstanding un-ack'd data to be held. > > > Effects values below. > > > > > > > > > - What are your values for: > > > > > > -- kern.ipc.maxsockbuf > > > -- net.inet.tcp.sendbuf_max > > > -- net.inet.tcp.recvbuf_max > > > > > > -- net.inet.tcp.sendspace > > > -- net.inet.tcp.recvspace > > > > > > -- net.inet.tcp.delayed_ack > > > > > > - What threads/irq are allocated to your NIC? 'vmstat -i' > > > > > > - Are the above threads floating or mapped? 'cpuset -g ...' > > > > > > - Determine best settings for LRO/TSO for your card. > > > > > > - Disable nfs tcp drc > > > > > > - What is your atime setting? > > > > > > > > > If you really think you have a ZFS/Kernel issue, and you're > > > data fits in cache, dump ZFS, create a memory backed file system > > > and repeat your tests. This will purge a large portion of your > > > graph. LRO/TSO changes may do so also. > > > > > > You also state you are using a Linux client. Are you using > > > the MLX affinity scripts, buffer sizing suggestions, etc, etc. > > > Have you swapped the Linux system for a fbsd system? > > > > > > And as a final note, I regularly use Chelsio T62100 cards > > > in dual home and/or LACP environments in Supermicro boxes with 100's > > > of nfs boot (Bhyve, QEMU, and physical system) clients per server > > > with no network starvation or cpu bottlenecks. Clients boot, perform > > > their work, and then remotely request image rollback. > > > > > > > > > Hopefully the above will help and provide pointers. > > > > > > Cheers > > > From nobody Fri May 27 19:23:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7018B1B4DF92 for ; Fri, 27 May 2022 19:23:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8vq11d6Nz4q7w for ; Fri, 27 May 2022 19:23:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D61F128398 for ; Fri, 27 May 2022 19:23:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJNOT1099161 for ; Fri, 27 May 2022 19:23:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJNOiV099160 for fs@FreeBSD.org; Fri, 27 May 2022 19:23:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 27 May 2022 19:23:24 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fXtWFVXD+ok1m3R72HnAk4jttAs5U+aYUeHIHU2+7VQ=; b=FiGV8TeyTQFzHQjA8Nnlh/GrlGFzj7vAFqdorG4tusg1Ct/HGF6EHs7NHQQT6zgJCQ/B/Y v2jYhSOZDgo7rgIV0X9cFjFnHtwUTEFQaCtabT0Bmxwb+WH8xxlaTbrznO0miAHA95h3q/ GULcbgkmYJsh9n+V/7ytqiYxHLRC6q/raC7brTJqSy80gnobpmIzn9OShhTnIUm+t5QXLX fcyDViIjwYEPe4hKIPpo5ZD/ViH1cydj70pP2QNNq/AmV4cwkCMGV6zMBR3AuB04zrFGQD GlqYjB/u6iCS1x/KcY9y7fFHmPwq2YlqDT9JTsc8k//2QsQ8cD9TLa8I1gtSqg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679405; a=rsa-sha256; cv=none; b=rELITv/EQ1ma4c8t6zWjEUE2VY4hqqJGrEYoVtHeppOMzWuL554n5mhW1ZdF2dXSrXitGI TtNbN4zfDH/dqAGk5l6BWiw4Ym21TzAnZBzngzDamWa08ozpap5j6X7lc/Ow5oP5n8q0cS jI9XG/aH7eO3g2cVFQ7lQ1VE8hXHXSsanQltDMMoMReXuSC41F5IomAzqjrcxC9pbNxND9 SgmNi6gF7DKzVOW7y3x6oHJ5kSZTIz8zig7DRh1v+3jzgwDoh4XUkfFHpIUsxZo92WBIQ7 EKnxSYVXJaqAOWH/9rcaSfwLKYxaEmgVkgZWHSXlzlVNswTSDo7molxkK0e50w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D076002f24d35962f0d21f44bfddd34ee4= d7f015d commit 076002f24d35962f0d21f44bfddd34ee4d7f015d Author: Kirk McKusick AuthorDate: 2022-05-27 19:21:11 +0000 Commit: Kirk McKusick CommitDate: 2022-05-27 19:22:07 +0000 Do comprehensive UFS/FFS superblock integrity checks when reading a superblock. Historically only minimal checks were made of a superblock when it was read in as it was assumed that fsck would have been run to correct any errors before attempting to use the filesystem. Recently several bug reports have been submitted reporting kernel panics that can be triggered by deliberately corrupting filesystem superblocks, see Bug 263979 - [meta] UFS / FFS / GEOM crash (panic) tracking which is tracking the reported corruption bugs. This change upgrades the checks that are performed. These additional checks should prevent panics from a corrupted superblock. Although it appears in only one place, the new code will apply to the kernel modules and (through libufs) user applications that read in superblocks. Reported by: Robert Morris and Neeraj Reviewed by: kib Tested by: Peter Holm PR: 263979 MFC after: 1 month Differential Revision: https://reviews.freebsd.org/D35219 sys/ufs/ffs/ffs_subr.c | 163 +++++++++++++++++++++++++++++++++++++++++++--= ---- 1 file changed, 146 insertions(+), 17 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 27 19:29:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7EEE41B5013F for ; Fri, 27 May 2022 19:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8vxp68KQz4ryL for ; Fri, 27 May 2022 19:29:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 84420282B7 for ; Fri, 27 May 2022 19:29:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJTICS000513 for ; Fri, 27 May 2022 19:29:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJTI8v000512 for fs@FreeBSD.org; Fri, 27 May 2022 19:29:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Fri, 27 May 2022 19:29:18 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679759; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TH6LU5hqxjpr/opsj+sneDPjeoEF06Xat0vSKIyUHbk=; b=eDHL+QL9VCB9BxJ9rxb+dwspaADQhXtpNdEn9sMZz9vVn448U9MGwQjBZO6I6IF76ixLJ2 zQjRmXA5zqjtcr+k01OC7OjCjw+iTwZn35AMSR5dE5k9XeD5L0xmywWCeCJBv8fLwSoiwB VDtFAFTA3rv8wNiHfI8FornEVINDGWjDoIPls8J9+atSaKpwJuqOzCvKjsZD/ThnqmJPq8 zfHGqFDjVojK5kpCqlhbwymLjUyoobwhuS7Cnn39AbZ1xZZjHkKFsY9BrFHUqBIQRNo4x7 4y8MB+B61ntz0WjkcayP3fE+wd/xUgQXrmaEks+uBupgsfulaK18jPTA9PgXAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679759; a=rsa-sha256; cv=none; b=OBQ7naNpdPkVgdMcn7r8Qz2/3IHjYXavza3mqq3JK+FOWrd8Nrb2OtoqdxKvCaGYL2a5gc lI0dIFu3FGJELu4E1AbtMWOw2z+jkWI1+cnx6mCYFeaujECkirGsRrZdlYJZhUEuhFr+9+ e78KJHaZ6NaE3tzDrrvgx/iadcJFavxAnCupmqoP+2by4Y2BaazlpeTsPlrXmPqA1oEIH8 mXeXenikMDeOQbkhQZ5RpZI4VEs3rsOmAzuWaK7KRhIQjPW5TRVP0Ow9C4rOI9K91jGjJ8 2jkfhmzkxg0rgovxeKuhy88dknisw8NuHJo1iyJhcDjSe1kVndXQz0EmBlrUvg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 --- Comment #5 from Kirk McKusick --- Fixed by https://reviews.freebsd.org/D35219 Will close when MFC'ed to 13. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri May 27 19:29:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E61351B504EF for ; Fri, 27 May 2022 19:29:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8vyD57nZz4sJg for ; Fri, 27 May 2022 19:29:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E336A28515 for ; Fri, 27 May 2022 19:29:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJTdWT000602 for ; Fri, 27 May 2022 19:29:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJTdeM000601 for fs@FreeBSD.org; Fri, 27 May 2022 19:29:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Fri, 27 May 2022 19:29:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8iHd4OMCQ9ocQkoDNgeV45SkXpA+pAXz2sVQLW2rUn8=; b=iRoZla6ihY1yoPmUJShQbxMuvubjRAdRlxiazolqy9BiHRaUsboRfLbYKNz0IqvBfRD6rh rVmWRTXsdlSaOX7GahyJx7lPL4N476NOsMIli42ZWnHYInxuwvPeDLT9YQjiq2VpEnwXZU GgoWCcOlzrsHoGQQq0ty3TrIwXD3ZxaPJ3SYSlF9q7Av129C6bi6MyrdxuaUvlj0BsObmi E+70YRYnAiLkE8n1oxdRrqfyxOKsYL0xLao/X84aui1XYBQmBIfnj7lkczxgUjBn2j9ZsY Y3/pZSF/COgxgyz1KUQsAnoMcWwbsGSlUngjHK3fGC6HmyQpcS7tS6tl2QOCWQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679780; a=rsa-sha256; cv=none; b=MDQzXH8oqxyYVzjDehNVJ8itAxoMybN+ImXAxZjSFNfmIA0Xw6j/ZEdMQTUu4hoAnCP5DV q2CtvxBcP0jMjTRe6Cz2TukXlMAOptN/S7nsjSwkgFYRNCavt920+cF6Pf/akknPLswF58 CpWJY5iHS103tKCNMyntUMqY9c16fYXnXyb7Dq3dxvKppn3SO77OT46FCZv14DJ7MsGLtN ygElwn022Zf41E7Wtpoz6WtTl5nY4feFHbj2ZaNaTC5vIh1FEgIditm1DMfyMoRhcE3zAM EnDrV69ZzEJQayATPYYhceRu3Wqdt5iIH+2VxhEhtznY6Bv/OuB866Ip2G+iSQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 --- Comment #5 from Kirk McKusick --- Fixed by https://reviews.freebsd.org/D35219 Will close when MFC'ed to 13. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri May 27 19:30:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 355C71B50C5C for ; Fri, 27 May 2022 19:30:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8vz24pSfz4srQ for ; Fri, 27 May 2022 19:30:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C576828518 for ; Fri, 27 May 2022 19:30:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJULdb000833 for ; Fri, 27 May 2022 19:30:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJULw0000832 for fs@FreeBSD.org; Fri, 27 May 2022 19:30:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257557] geom(4): Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 Date: Fri, 27 May 2022 19:30:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679822; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zO5PmqjNc0gKAwwzENlAREJ8TVq9GwrobQDUHD1JzhM=; b=AuD8IM22t3UuKbRa9uEJA/Fjg979+yNftBUqe+aYw3clPMmrPHS7hVUl1AbSYybCK5HaCX VbsNaCGKjuquA/Ln7DpyF+aqDbRkBzunji1mg5l8q+1UL63WLbyXaYbzGJ+sxm+0Mzj/bs Y3yzv2mcqcf/gXyWQVwib07hPLdQ85gTcTZ76qmNMD6wQFCiR9OOX9uwTEFaGCMtzYQPtE 4KtEra0/aLuoHb5qaea/RM2ljlxsM9H3JRCLLiDAFaNMM8TLdepVhPykyV+R9tUgXcV2Sq zooybAfv+4p+H8S3IHKCkFfom3gEQT3Z8eJdPpGgDUS8EFpjmZr7kBEZBuZYrQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679822; a=rsa-sha256; cv=none; b=KvtG2GBLqvh15+JmndiQi/JyDMqdn8PrBfy2B38oEqOYrZImHaiBVkpTO4EheOYLdnqLBH 0cxfjdRkXpLplNBy0PQZrcjm1YdwC33Yklvss7+weqVkWyCIbwqdT8ZzgKiVtBuTg98oVR EevdPTDDEXcZKKtYy4p+i5HKigo9z2cdRwz+dKSi75nzES++OMTPbN9QxXskPUUQEKlXSV +f7GoE2oIURqqM5hrLrfXi/BMB3AWH9puNhnNgCVn8iPeExeI3JuPKEoLFSjlAEsDbiS2Q g5K8WLIBZmMJNQ3jzYZXwvZMC7Bez+l9E3P+HLtYGq5BnqeuD1CqrbfZVKAZRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 --- Comment #4 from Kirk McKusick --- Fixed by https://reviews.freebsd.org/D35219 Will close when MFC'ed to 13. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri May 27 19:30:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 68D881B51402 for ; Fri, 27 May 2022 19:30:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8vzh4cK1z4tFW for ; Fri, 27 May 2022 19:30:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6AF2D283A7 for ; Fri, 27 May 2022 19:30:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJUuxY000950 for ; Fri, 27 May 2022 19:30:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJUumm000949 for fs@FreeBSD.org; Fri, 27 May 2022 19:30:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Fri, 27 May 2022 19:30:56 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679857; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=i6GRdhYH+Uz0i0LgLPWqqru3BY53qwijdACeQzOGeeY=; b=RUGAMwyTOd1Lq5OyaeL801xpj8ZLADj8iPHIWnQgqfTqqf/xNTT1VUrfAXK7j/zyvqMdSt B0Gia/f9lY2OakdU2RvBAUPTjynWmX3GSUAKiyDaQqdQ7YHh6qiHr512zlycH9FSF86C9G ch11+ISv/5CExT4cRBXwOHWFgemsMKlh/MQaracr4AH122hJXQNllFR1OH3uZtOZxhAuRN XTOJatPz0glaQW3KPTmEgc/8xfeoSsZA35eBiig5WqyyvhOvrEFVFqBPb3U3jgWqS8rx61 QOmZTWv4H8h4dckKaoy2RLK8ZWQffeAjwD6IyPoaRexhnbAAu4JRmTZub6LtHQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679857; a=rsa-sha256; cv=none; b=r9tna98H5ryLdLqO/+LWTZx1q+XPIfQyQ03QwpCKVqnlGKmay0XGRJymmsoWXPMRbHcCty doMoqmCbXtdY7721CnIUOZ8V4qTNBjaKaBTPEnW39nws6qQejcmoA5zEm+t1CZZyg24H45 a5lobFtm4+02E+E+0aRLud5BURhky+sAC8HdDFUv11pHl99uP2o53Eo3uQ3uqa9JxJQFW8 qtXuQSN8uoRNyFp+ISJtj/hQIR+nzrDdGXeYHe0NIMYp7aSX7VZu3R1pxokF7RfOZ2qcaE yGdPF7naYPlwsv+Ue90e75VcWRjAWyEYksT9G5FGDlhEFKnQTPian0+xg+JPbg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 --- Comment #7 from Kirk McKusick --- Fixed by https://reviews.freebsd.org/D35219 Will close when MFC'ed to 13. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri May 27 19:31:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 063951B5168F for ; Fri, 27 May 2022 19:31:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8w0630BNz4td9 for ; Fri, 27 May 2022 19:31:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 136F9282CD for ; Fri, 27 May 2022 19:31:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24RJVHfq003330 for ; Fri, 27 May 2022 19:31:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24RJVHVn003322 for fs@FreeBSD.org; Fri, 27 May 2022 19:31:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Fri, 27 May 2022 19:31:18 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653679878; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VIKaxAYny/KfwQi8mcS0tkQSgCAzSjWh4MSh38X2WhA=; b=hmyUoFiydXRh2iMl9KH92LZOi4FMMjSea5vIkIypY0Mmxk+DiEF6Vbex9UUTCU89+cA3xq OylaDSuh7FH07M9A1YxgNmC4Mqkv1416Dd7W2fHgIlVURunzzfFCle6EuhCBVzI235lr54 RVG/WpOhye7hc1sxofQodrmIyYuHs+WYYw16EjWlfwslWSf5ofEo96vvuPaar3KG7bpyOB 4vS8v/d1M4s7oLKWjAKEiSdPZkTizQgvB8G8LeGSyJL+sxwcmK0zo/iHqKefIbjrRIDRv9 fP3c1yBOCOQpV8EqnpUdr8lfEoHMAVHVEBUYH5640Et1SFt6YqTM1A3eGPiXMg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653679878; a=rsa-sha256; cv=none; b=yE2NUzc4wXFaOfQcvGJKnERv7yjAWyLgSdM8xd4v+7H63ZMl0d2YztJ8JDYY0aP73f5Pfl gDoI6E+priNvs74+c2qOBbS0ZmyLAkrlyL54n3kuT3jNr+kRjQ1jhUNyUlHs1bj2Z4/mPW XcWJbKwK6RLAfwsx5ybTex245BKWdAjp7f//ntFMUoTSHQ2WeQiOc8h7camrSe8+x4Zo+G MiTmg2XP2XUjl9lWxca7gm3ikQaNpG+/B2A42rxCKRAQIsfJM2SD9+q+Pi2KjcdI/Q5lcH GXZJyf82Hl1Ttfrr1RCJjayxyaiCDoekUj6IgzSVm6oRPSug/ERj9JJ+7hRjDg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 --- Comment #7 from Kirk McKusick --- Fixed by https://reviews.freebsd.org/D35219 Will close when MFC'ed to 13. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri May 27 20:12:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C41A11B57E41 for ; Fri, 27 May 2022 20:12:56 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [130.236.254.3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8ww765jwz3FFW for ; Fri, 27 May 2022 20:12:55 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id 3B4AD63B5 for ; Fri, 27 May 2022 22:12:54 +0200 (CEST) Received: from shipon.lysator.liu.se (unknown [IPv6:2001:6b0:17:f0a0::83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id 39BBB64A0 for ; Fri, 27 May 2022 22:12:54 +0200 (CEST) Date: Fri, 27 May 2022 22:12:53 +0200 From: Andreas Kempe To: freebsd-fs@freebsd.org Subject: FreeBSD 12.3/13.1 NFS client hang Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4L8ww765jwz3FFW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=lysator.liu.se; spf=pass (mx1.freebsd.org: domain of kempe@lysator.liu.se designates 130.236.254.3 as permitted sender) smtp.mailfrom=kempe@lysator.liu.se X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.lysator.liu.se]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[130.236.254.3:from]; DMARC_POLICY_ALLOW(-0.50)[lysator.liu.se,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2843, ipnet:130.236.0.0/16, country:SE]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello everyone! I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1 systems hanging when using a CentOS 7 server. Below are procstat kstack $PID invocations showing where the processes have hung. In the nfsv4_sequencelookup it seems hung waiting for nfsess_slots to have an available slot. In the second nfs_lock case, it seems the processes are stuck waiting on vnode locks. These issues seem to appear seemingly at random, but also if operations that open a lot of files or create a lot of file locks are used. An example that can often provoke a hang is performing a recursive grep through a large file hierarchy like the FreeBSD codebase. The NFS code is large and complicated so any advice is appriciated! Cordially, Andreas Kempe Hang provoked when calling "grep -R SOME_STRING ." in the FreeBSD code base. ============================================================================ PID TID COMM TDNAME KSTACK 35585 101045 python3.8 - mi_switch sleepq_timedwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_lock nfsrpc_advlock nfs_advlock VOP_ADVLOCK_APV kern_fcntl kern_fcntl_freebsd amd64_syscall fast_syscall_common 35585 101045 python3.8 - mi_switch sleepq_timedwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_lock nfsrpc_advlock nfs_advlock VOP_ADVLOCK_APV kern_fcntl kern_fcntl_freebsd amd64_syscall fast_syscall_common 44046 101189 vim - mi_switch sleepq_timedwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_accessrpc nfs34_access_otw nfs_access VOP_ACCESS_APV vn_dir_check_exec nfs_lookup VOP_LOOKUP_APV lookup namei kern_statat sys_fstatat amd64_syscall 44046 101764 vim - mi_switch sleepq_catch_signals sleepq_timedwait_sig _cv_timedwait_sig_sbt seltdwait kern_select sys_select amd64_syscall fast_syscall_common 44046 101853 vim - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx_op amd64_syscall fast_syscall_common 44046 102164 vim - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx_op amd64_syscall fast_syscall_common 44046 102165 vim - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx_op amd64_syscall fast_syscall_common 44046 102457 vim - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx_op amd64_syscall fast_syscall_common 44046 102472 vim - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx_op amd64_syscall fast_syscall_common 44172 101824 tmux - mi_switch sleepq_timedwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_accessrpc nfs34_access_otw nfs_access VOP_ACCESS_APV vn_dir_check_exec nfs_lookup VOP_LOOKUP_APV lookup namei kern_chdir amd64_syscall fast_syscall_common Hang provoked randomly when trying to save an image in kolourpaint. =================================================================== PID TID COMM TDNAME KSTACK 58062 159450 kolourpaint - mi_switch sleeplk lockmgr_slock_hard nfs_lock vop_sigdefer _vn_lock vfs_cache_root vfs_root_sigdefer lookup namei kern_statat sys_fstatat amd64_syscall fast_syscall_common 58062 176390 kolourpaint - mi_switch sleepq_catch_signals sleepq_wait_sig _cv_wait_sig seltdwait kern_poll sys_poll amd64_syscall fast_syscall_common 58062 176678 kolourpaint - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep kqueue_kevent kern_kevent_fp kern_kevent_generic sys_kevent amd64_syscall fast_syscall_common PID TID COMM TDNAME KSTACK 34291 101005 fish - mi_switch sleepq_wait sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock vget vfs_hash_get ncl_nget nfs_root lookup namei vn_open_cred kern_openat amd64_syscall fast_syscall_common 34291 102492 fish - mi_switch sleepq_wait sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock vget vfs_hash_get ncl_nget nfs_root lookup namei kern_accessat amd64_syscall fast_syscall_common 34291 102493 fish - mi_switch sleepq_wait sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock vget vfs_hash_get ncl_nget nfs_root lookup namei kern_accessat amd64_syscall fast_syscall_common PID TID COMM TDNAME KSTACK 204 100923 autounmountd - mi_switch sleepq_wait sleeplk lockmgr_xlock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock vget vfs_hash_get ncl_nget nfs_statfs __vfs_statfs kern_getfsstat sys_getfsstat amd64_syscall fast_syscall_common From nobody Fri May 27 20:59:57 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DEC421B388A1 for ; Fri, 27 May 2022 21:00:05 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2042.outbound.protection.outlook.com [40.107.115.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8xyX4895z3LVc for ; Fri, 27 May 2022 21:00:04 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JRJuTqMtqxoF/3SITTzfXxMAXuePvtj3UfivMARy5fsUboSe4dmDBfFmcHsctzSgufJ3zTLsucrswb3EPJ5CBKQWPxOWv5qn+BkE46c7tbUUoLOiTIeH/A9byA7xYliJivMx57VrgZ0BUBZakVcnkFKvILYMM1TAjfw+7MgGEFpAxiGmyz9vkDltDTDQHjviUEPpDqVc0w8tlgWZpXe+F4/5wM+pEZOvL5kBnq1X7KyD66J4Lr0cmPEa/w4OTbdPuSTv3+pTiwaxgfMlByeWRAfrFWUFFtgV84iS6TxPrSuXh+hgXpZROoiMdWsNSaRWsAqGbE7KMStXIqDXP9tBMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Z0rFnLWASoyZ0L8wL5HORsiWmTDCWZNNoMIJySvys/4=; b=RAEJxEGcPuPnSIWscZI8aLNNtk7MHzfDdK75fg7NjTbrEAl6TSOL9G1pycdVNbqVUQow1C7rBrLkwPjUHCyVKK2HU78N6cd/KZTBC7rtBO1JAmf9B5SRlXvpCmsGbqZZCipSuPWBzkgn8ZlNEYaj4HLC2kXyH1TEC7NJNeJZy8w7Bt7cVSG76ZFIcfSA9uWp8ID/dhdfAeRxhsHFdqQE34ppCM4OV+2rxKujuAHTzlMOYJutAfX+zu2rOqgxP0tyna1TFtr3VboHUjXf/boc2k96tkYX8+KrgBQDF9/AO8YHFmx6o2v0NtMyUm2ypaghnVQu6B5nYXnoDAMzp8ALZA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Z0rFnLWASoyZ0L8wL5HORsiWmTDCWZNNoMIJySvys/4=; b=J2K2wdOEOMzmHrbuJX0p6cFUk9z8J1qmes1QUwLG6kqu272MTgKKCI2401ISz3mbzAT8ovZy2VnY9XFzIoZE4Q7tskIZxAMJP887mUwwFfdYsE1olurXLyAx+G3ZbbR4fXWirkE0uDPgMTG8iPuDVs00bIrFvukYCWmhwuGCpu7HkRD989HN4WAcggBgFiwY7nMYfo9EwBJWofm8mc2qMTttc8g1rcd62eY1yR7jGMDQRZH0U/PykeZFx/HeoGKjbHF6ncZHrlOM6CrplMOkdzoi3ITWmvm6V1YOdmfE8i6M7RnZG0Bt3uxwHjwdPV+1ZApN4EnxQe5dt512OdrvnA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT1PR01MB4741.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:43::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Fri, 27 May 2022 20:59:57 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.016; Fri, 27 May 2022 20:59:57 +0000 From: Rick Macklem To: Andreas Kempe , "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2f Date: Fri, 27 May 2022 20:59:57 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: e57124a1-e28f-b903-5d1d-c5bc967679e9 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: a5942a5f-9f8d-4e09-c287-08da4023db9c x-ms-traffictypediagnostic: YT1PR01MB4741:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: mNESCPvikzNuzpGgn0OqXQ2mMRH0V2UQO9w8LoFBZm/clJtBwnrLA1uD9i5l/ZP9BI+V5nZW83ErHs7T/qn0idFCYqlceTIm/jc90z5kVGr9cqSDU1OGH+JVQvw5OTP1s14nNUDTLg4yrDlHOquH9pF7T1jK2Mzq0Ag91AvzRXAbW7qgf8goGxZ8ljunH48VF1DGQsjetxV43l7jAR2ZwQNa7rD4tmHPDZBGx3LM1zVIdiF7zOV9D1LZxTYcHJUDizlTOT8hcm3yv0jfdArJ0Eu51/WnF2pNopQuCUqkQSmW0hYojuqd2LaDAczwXD7DqVt67/3Bynb0MEPeVDo5B2+1bqqFdL5r00VeMV5t8w3BMEA3qxO8H1jWC9Df8byWKqtV0fspka/ubtNCwsk8l5vDEB68TQZk27te8jwQcLJB3WtCssghyvt7nLhDu033tzfOg6eKXJne7fcBlNUmFW/PbeWjLcwTXcox0eUZsxRsydHmm8g8C0Jsv69ZIIvAPWZVKlxSI5bEFmmHNhZtjVrw03oZb7tdKSFwEAN+yN18CEJv+loggaEp7HUXYv+E4rtik68oSFFdL7Y0BwxUEc3E7bRwXshZoSyPMHVSlMdRmLSEWYvWBlg1ls0JbEM8REi7SWQbsRsLBdYiG5uWahpPuz5j268446KILlKybP2dEzG/rbjhwhu7lNN88pavBIsBvU/OCOD0YvjyjXGW3Q== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(52536014)(2906002)(38100700002)(8936002)(33656002)(9686003)(91956017)(66946007)(76116006)(66446008)(64756008)(8676002)(5660300002)(66476007)(55016003)(66556008)(296002)(316002)(86362001)(83380400001)(110136005)(71200400001)(508600001)(186003)(38070700005)(6506007)(7696005)(122000001)(786003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?knO0Kb1cZPSZ+SLE3lLSAD2MYEtLzPggcI/PN0xGL+wZlQ1DYzwPYn1rE9?= =?iso-8859-1?Q?fFmuW8pWhVhyxYgbWWUKHnZ+LQCfCtord45WH8yazaFGPsKAY2c/QYSs5k?= =?iso-8859-1?Q?XtEmg57RrKA0BotQ9w3H4pmrIExdzxh4RmhQbzKWZsnCIgMxHqMCoG9Or2?= =?iso-8859-1?Q?/fpFo28wViIwoB+fqfGawH6wAHjcJO5aaR6RyXM5KR6qSMWa3hJEmt6SK8?= =?iso-8859-1?Q?ifA/54A+o8awanTMPc1v8B8cYwY8+VVrKgYZTlwCUSEzHXP4f+aYDcBn27?= =?iso-8859-1?Q?f0jJOYRLBAD1QhF/HF/KArVOelaHe6KU6eTKUhKTAgo/bdlOgFg3cVTFvj?= =?iso-8859-1?Q?BpPdMOw/d0lMwq1+awoUkjm/rqPltV+gri5gqtgHfGdVebNR5WhqYaHz7U?= =?iso-8859-1?Q?307xCHX1AfXj2584QXEkmtTFQXKVbz3C2RR0Q+m2X0odAyWbr9UBbmsb+i?= =?iso-8859-1?Q?9qBD7tXn+GbNxWItxhAoZ5HfyHWzzxqEEdKe42BKMmsvvLyR84o7UtIy8o?= =?iso-8859-1?Q?8foxOdJ0aSdOB1Egd2bXa5VW12iW0WtF230lmsahUlIES71lp1JKx69Ouo?= =?iso-8859-1?Q?nkfkN88a9JlJAC2cXJtQ8jjgeKd433tm3oLi0O7iH1uUaId+MCISJdVtjA?= =?iso-8859-1?Q?jLuliSJMKe1RA24NZQWNMnIFck34ZvnZ9+TNkc4NmIjj9HkbuM8qMBNuUI?= =?iso-8859-1?Q?3VD05fNmrkv6VT55B9nFpR5UymsCqX3nu3Twnb/0psqe9+uM+cLWkpe2Hv?= =?iso-8859-1?Q?bDAcZmHQpYJcq51AIZhz+23hwhax4JCtgId9epjwb+GZDXy+pW9ZWAP6Ak?= =?iso-8859-1?Q?esqwilACFp4hslDFjcwSypHGG+Op+msGy+trZXxLOeuZnD+IawoZ1u+enI?= =?iso-8859-1?Q?R3BLv76S7hVqunyFkWq8br/Bfeu/RGbFIDcZalYLN1wmoFeDjjK1GCxcV0?= =?iso-8859-1?Q?XcOPzA7mCmszF4djNrb6TXP7yg/BwnbHBMJ0NLS02DXHkJ/+po1h7Tg1Et?= =?iso-8859-1?Q?Qyx4WD/OdeXEkmVwucGluP9mXGffuQHRitM6THikOPq67nEnOD61UGU0z6?= =?iso-8859-1?Q?d+DS72TtFakn2hjeGhCr+VvRIQTBKaFzd7m7JK+GDDrX0TNHpVptqh+ZZ+?= =?iso-8859-1?Q?oZ05r6hKWp8WgqC9OOWZYtTSAX6ZTd4QGF6OTqJjTTWxTkXvGULLzbbFi9?= =?iso-8859-1?Q?QZw+nkeu0M31PUKgv89PcxvzZkrRs0RLbAI6lp4LO3EydQBN+e8Fix05fo?= =?iso-8859-1?Q?ZFfn5k/iWqOpVzzAeWPnGSBFClpymOLnK3AG5OBxRWYU25iYQrMxyzr4Qs?= =?iso-8859-1?Q?hi1BgsKxXREgTT62pwElKM/yFrGCRCQUOMNgF4NvInusyVbsXYQy0DNkjK?= =?iso-8859-1?Q?vUtF4kURLXaG7hY7WjWRJCqmpxiMVIFtlODYUUHQjsw3exZ8pc4fV4biQT?= =?iso-8859-1?Q?e8NTZKUNL+GO0tun549vLP7p567xn3P88u+eo3cewNT2Ac3RBs7KzGr58j?= =?iso-8859-1?Q?4lZI9xxK0k88fsvN3I1Ab6wfo+wLCZutZEG1PIn+acGr4VW27VyVnGburr?= =?iso-8859-1?Q?L+S1tynD1m6+gTCMh0+I6q1CPm29M3E48aTz68b5+iksi1UHI5hWlR+Kcl?= =?iso-8859-1?Q?+vzTgebir7IoVSrqVtCdfSN3ZbDU/Q1I1KQdQ4Yb9yOm/0J/9qj4+BWTcg?= =?iso-8859-1?Q?BifAOY8p221+TmmWxSsDWnsXesnZa5aw8o1CXPuF0ZarZThM3k8mZNouyR?= =?iso-8859-1?Q?97n+53U9Aiw5jBm2n4kkRbyXxRGeumOVY0bMFpE/Tr8ZHfBu7CTNKlOtks?= =?iso-8859-1?Q?xEtKJWP/dyZD54pOdw+lkBOGiJmsu62fn/rMQIFqwrY0KjoeHOBtHNfWeA?= =?iso-8859-1?Q?Do?= x-ms-exchange-antispam-messagedata-1: uj8U22P/Udy/CA== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: a5942a5f-9f8d-4e09-c287-08da4023db9c X-MS-Exchange-CrossTenant-originalarrivaltime: 27 May 2022 20:59:57.8707 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: wPbi+dFMZouoFDfd2VLUj6BfI9zzMIIr1OrThNSs7DFwCyHOXt0AjOn1rhca9CymzI4Ym+qg+SD1A9UvF6nYUA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT1PR01MB4741 X-Rspamd-Queue-Id: 4L8xyX4895z3LVc X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=J2K2wdOE; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.42 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.03 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.42:from]; NEURAL_HAM_SHORT(-0.03)[-0.026]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.42:from] X-ThisMailContainsUnwantedMimeParts: N Andreas Kempe wrote:=0A= > Hello everyone!=0A= >=0A= > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1=0A= > systems hanging when using a CentOS 7 server.=0A= First, make sure you are using hard mounts. "soft" or "intr" mounts won't= =0A= work and will mess up the session sooner or later. (A messed up session cou= ld=0A= result in no free slots on the session and that will wedge threads in=0A= nfsv4_sequencelookup() as you describe.=0A= (This is briefly described in the BUGS section of "man mount_nfs".)=0A= =0A= Do a:=0A= # nfsstat -m=0A= on the clients and look for "hard".=0A= =0A= Next, is there anything logged on the console for the 13.1 client(s)?=0A= (13.1 has some diagnostics for things like a server replying with the=0A= wrong session slot#.)=0A= =0A= Also, maybe I'm old fashioned, but I find "ps axHl" useful, since it shows= =0A= where all the processes are sleeping.=0A= And "procstat -kk" covers all of the locks.=0A= =0A= > Below are procstat kstack $PID invocations showing where the processes=0A= > have hung. In the nfsv4_sequencelookup it seems hung waiting for=0A= > nfsess_slots to have an available slot. In the second nfs_lock case,=0A= > it seems the processes are stuck waiting on vnode locks.=0A= > =0A= > These issues seem to appear seemingly at random, but also if=0A= > operations that open a lot of files or create a lot of file locks are=0A= > used. An example that can often provoke a hang is performing a=0A= > recursive grep through a large file hierarchy like the FreeBSD=0A= > codebase.=0A= >=0A= > The NFS code is large and complicated so any advice is appriciated!=0A= Yea. I'm the author and I don't know exactly what it all does;-)\=0A= =0A= > Cordially,=0A= > Andreas Kempe=0A= >=0A= > Hang provoked when calling "grep -R SOME_STRING ." in the FreeBSD code ba= se.=0A= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=0A= > =0A= > PID TID COMM TDNAME KSTACK=0A= > 35585 101045 python3.8 - mi_switch sleepq_tim= edwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_= lock nfsrpc_advlock nfs_advlock VOP_ADVLOCK_APV kern_fcntl kern_fcntl_freeb= sd amd64_syscall fast_syscall_common=0A= As you noted, this is waiting for a session slot to become available. Norma= l, so long as other RPCs=0A= are "in progress" that will release slots when replies are received. (If yo= ur mount was not hard, sooner or=0A= later, the client will give up waiting for the reply and the session slot w= ill not be released. Once all slots=0A= are "not released" you are hung.=0A= =0A= > 35585 101045 python3.8 - mi_switch sleepq_tim= edwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_= lock nfsrpc_advlock nfs_advlock VOP_ADVLOCK_APV kern_fcntl kern_fcntl_freeb= sd amd64_syscall fast_syscall_common=0A= Same as above.=0A= =0A= > 44046 101189 vim - mi_switch sleepq_tim= edwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_= accessrpc nfs34_access_otw nfs_access VOP_ACCESS_APV vn_dir_check_exec nfs_= lookup VOP_LOOKUP_APV lookup namei kern_statat sys_fstatat amd64_syscall=0A= Again.=0A= > 44046 101764 vim - mi_switch sleepq_cat= ch_signals sleepq_timedwait_sig _cv_timedwait_sig_sbt seltdwait kern_select= sys_select amd64_syscall fast_syscall_common=0A= > 44046 101853 vim - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx= _op amd64_syscall fast_syscall_common=0A= > 44046 102164 vim - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx= _op amd64_syscall fast_syscall_common=0A= > 44046 102165 vim - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx= _op amd64_syscall fast_syscall_common=0A= > 44046 102457 vim - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx= _op amd64_syscall fast_syscall_common=0A= > 44046 102472 vim - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep umtxq_sleep __umtx_op_sem2_wait sys__umtx= _op amd64_syscall fast_syscall_common=0A= I know nothing about umtx, so can't help here.=0A= =0A= > 44172 101824 tmux - mi_switch sleepq_tim= edwait _sleep nfsv4_sequencelookup nfsv4_setsequence nfscl_reqstart nfsrpc_= accessrpc nfs34_access_otw nfs_access VOP_ACCESS_APV vn_dir_check_exec nfs_= lookup VOP_LOOKUP_APV lookup namei kern_chdir amd64_syscall fast_syscall_co= mmon=0A= Another one waiting for a session slot.=0A= =0A= > Hang provoked randomly when trying to save an image in kolourpaint.=0A= > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A= >=0A= > PID TID COMM TDNAME KSTACK=0A= > 58062 159450 kolourpaint - mi_switch sleeplk lo= ckmgr_slock_hard nfs_lock vop_sigdefer _vn_lock vfs_cache_root vfs_root_sig= defer lookup namei kern_statat sys_fstatat amd64_syscall fast_syscall_commo= n=0A= Yep, waiting for a vnode lock, I think.=0A= =0A= > 58062 176390 kolourpaint - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _cv_wait_sig seltdwait kern_poll sys_poll amd64_= syscall fast_syscall_common=0A= > 58062 176678 kolourpaint - mi_switch sleepq_cat= ch_signals sleepq_wait_sig _sleep kqueue_kevent kern_kevent_fp kern_kevent_= generic sys_kevent amd64_syscall fast_syscall_common=0A= >=0A= > PID TID COMM TDNAME KSTACK=0A= > 34291 101005 fish - mi_switch sleepq_wai= t sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock = vget vfs_hash_get ncl_nget nfs_root lookup namei vn_open_cred kern_openat a= md64_syscall fast_syscall_common=0A= Also waiting for a vnode.=0A= =0A= > 34291 102492 fish - mi_switch sleepq_wai= t sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock = vget vfs_hash_get ncl_nget nfs_root lookup namei kern_accessat amd64_syscal= l fast_syscall_common=0A= Again.=0A= > 34291 102493 fish - mi_switch sleepq_wai= t sleeplk lockmgr_slock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock = vget vfs_hash_get ncl_nget nfs_root lookup namei kern_accessat amd64_syscal= l fast_syscall_common=0A= And again.=0A= =0A= > PID TID COMM TDNAME KSTACK=0A= > 204 100923 autounmountd - mi_switch sleepq_wait= sleeplk lockmgr_xlock_hard VOP_LOCK1_APV nfs_lock VOP_LOCK1_APV _vn_lock v= get vfs_hash_get ncl_nget nfs_statfs __vfs_statfs kern_getfsstat sys_getfss= tat amd64_syscall fast_syscall_common=0A= And again.=0A= =0A= Not very useful unless you have all the processes and their locks to try an= d figure out what is holding=0A= the vnode locks.=0A= =0A= rick=0A= =0A= =0A= From nobody Fri May 27 22:12:41 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 42B411B49257 for ; Fri, 27 May 2022 22:12:44 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [130.236.254.3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4L8zZM513Yz3mN1 for ; Fri, 27 May 2022 22:12:43 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id 2D75F66A8; Sat, 28 May 2022 00:12:42 +0200 (CEST) Received: from shipon.lysator.liu.se (unknown [IPv6:2001:6b0:17:f0a0::83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id 2AAB166A7; Sat, 28 May 2022 00:12:42 +0200 (CEST) Date: Sat, 28 May 2022 00:12:41 +0200 From: Andreas Kempe To: Rick Macklem Cc: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4L8zZM513Yz3mN1 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=lysator.liu.se; spf=pass (mx1.freebsd.org: domain of kempe@lysator.liu.se designates 130.236.254.3 as permitted sender) smtp.mailfrom=kempe@lysator.liu.se X-Spamd-Result: default: False [-2.11 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.lysator.liu.se]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.89)[0.892]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[130.236.254.3:from]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[lysator.liu.se,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2843, ipnet:130.236.0.0/16, country:SE]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, May 27, 2022 at 08:59:57PM +0000, Rick Macklem wrote: > Andreas Kempe wrote: > > Hello everyone! > > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1 > > systems hanging when using a CentOS 7 server. > First, make sure you are using hard mounts. "soft" or "intr" mounts won't > work and will mess up the session sooner or later. (A messed up session could > result in no free slots on the session and that will wedge threads in > nfsv4_sequencelookup() as you describe. > (This is briefly described in the BUGS section of "man mount_nfs".) > I had totally missed that soft and interruptible mounts have these issues. I switched the FreeBSD-machines to soft and intr on purpose to be able to fix hung mounts without having to restart the machine on NFS hangs. Since they are shared machines, it is an inconvinience for other users if one user causes a hang. Switching our test machine back to hard mounts did prevent recursive grep from immediately causing the slot type hang again. > Do a: > # nfsstat -m > on the clients and look for "hard". > > Next, is there anything logged on the console for the 13.1 client(s)? > (13.1 has some diagnostics for things like a server replying with the > wrong session slot#.) > The one thing we have seen logged are messages along the lines of: kernel: newnfs: server 'mail' error: fileid changed. fsid 4240eca6003a052a:0: expected fileid 0x22, got 0x2. (BROKEN NFS SERVER OR MIDDLEWARE) > Also, maybe I'm old fashioned, but I find "ps axHl" useful, since it shows > where all the processes are sleeping. > And "procstat -kk" covers all of the locks. > I don't know if it is a matter of being old fashioned as much as one of taste. :) In future dumps, I can provide both ps axHl and procstat -kk. > > Below are procstat kstack $PID invocations showing where the processes > > have hung. In the nfsv4_sequencelookup it seems hung waiting for > > nfsess_slots to have an available slot. In the second nfs_lock case, > > it seems the processes are stuck waiting on vnode locks. > > > > These issues seem to appear seemingly at random, but also if > > operations that open a lot of files or create a lot of file locks are > > used. An example that can often provoke a hang is performing a > > recursive grep through a large file hierarchy like the FreeBSD > > codebase. > > > > The NFS code is large and complicated so any advice is appriciated! > Yea. I'm the author and I don't know exactly what it all does;-)\ > > > Cordially, > > Andreas Kempe > > > > [...] > > Not very useful unless you have all the processes and their locks to try and figure out what is holding > the vnode locks. > Yes, I sent this mostly in the hope that it might be something that someone has seen before. I understand that more verbose information is needed to track down the lock contention. I'll switch our machines back to using hard mounts and try to get as much diagnostic information as possible when the next lockup happens. Do you have any good suggestions for tracking down the issue? I've been contemplating enabling WITNESS or building with debug information to be able to hook in the kernel debugger. Thank you very much for your reply! Cordially, Andreas Kempe > rick > > From nobody Fri May 27 23:56:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 679C81B3E1CD for ; Fri, 27 May 2022 23:56:40 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2044.outbound.protection.outlook.com [40.107.66.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L91tH3GGnz4SvR for ; Fri, 27 May 2022 23:56:39 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XIQdYzgXgPqUgZHd4Q2uuKWjEo7fDwLEeMoSKCQYG6YIIWdsV0pP2o+iE90S/wyiBKkrIiKtvG0R+A28qVt5sp9o9Ai9Kxl6v8zbQSrRNHbp4L2miFKocXx9lljWLBfjnQTTve6FVm7ketdQ5qzoyVqdha/LAoELvWT/3bE7jdRuBFpR/Ovi8vzMxaegrUl+UG0cMyty1ChFCwsbwpT2dwIpin/oMr5vfhGdDTkjptexWNBOAzNb1tchyMBFLTcsyMfjoW1AhqZGHDU9FpzC1d8fOYcVR6Z/9yhIMqkgp94fuIYQe4V34kmCHWsqeZvholVYx0UDkYMIU2oKdcb2wA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=hmDitkr4bUt+p8XJATX3yoDvcLUj+qNuj3cZ4NrwII4=; b=UDeMgmmmoDuySDNUUSqqD9TcPmJRrsXSz/SW1ALeJ9OadgNyDlkWShMXhPlHHLvqXnDF77LncJQVwN0d25azru+uTI9zqhgp32JNDgWjYkLWoi7utCtKWQVhDMVcJFxZOBBNCFnmv0tMUNUgOmMB+Hb9ak0qGZgtGBUXvjn6CaVnCEjEo6L1MSR6vqGs+MRPD+566xLzfz2Q5bd2ZpMoUcBDtiEbfrbjufRwl5RwTZpX34HDTqzryxeijhlCANEirAU7NUMUodJu1MIf1s1EqePkRZsNlX9w14JeRJogJEFYLYF774yt5MsHK+7l6XSlERXCWONgIzmSr55YSu1CHQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hmDitkr4bUt+p8XJATX3yoDvcLUj+qNuj3cZ4NrwII4=; b=bDykNjiZAdAhQk0yGybdwnFDWo+/iDo7UJN5V8Zk/9Ta7eAQPOS6+5vky1IYoWvfmsdBpEdmkU8v684uQv5wwEEXFLGo6bQaBLT54kl7B+UQuipGfEMQpxVCGsiCn9XlcbMDyeluSBLYqq6EfoPbhoGKACrVJDF/hihFrfYDmyJznL0CsVMgAdOECFsb/QDGA5dEY8zOoB7/OPd9xgr8a1bwsS4x+kLTXaUlzURa6i0UAXUX/khr+Xp+Jlu7Z4lniHhBDi8mtSlI1dbXyk+8bJCqwMeDUg1IcZqcZCygixPg7TagxYFY3fzG/EZCYNXaWt+rau82y1vsVfbWqmtnCA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YQXPR01MB5121.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:25::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Fri, 27 May 2022 23:56:32 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.016; Fri, 27 May 2022 23:56:32 +0000 From: Rick Macklem To: Andreas Kempe CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgAAamoCAABgQoA== Date: Fri, 27 May 2022 23:56:32 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: d82dab0d-ccd1-319d-5002-110f6730bc98 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: d6ea25cc-4da4-4a07-7d9e-08da403c8678 x-ms-traffictypediagnostic: YQXPR01MB5121:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: rrRwKnQFl9MIki4GCUoJMl1ZDEF6WSbcw1iGBQUO4HsXEvFEzEusHUdu47lPy+KHTdXP7RbEwS9vYnCN9fws4ilego9YTSyKMwedtqQ4wG8sSogTa4hfT6oR9HAwt90qG1XRgBwDyCwUbWTAgN51gT/ueCvRWcBCniTx4rHtguMD56GsXoMtJBysQjFILDcieRHy7Q85GN2C/xUygnzCsUW6WTMnJ74ugq1CFm2oAuA4PMPmRRyA5gl6mYzKiegMoVGWLJmWxU+3OhpSvRUEou0EoYCp0cy7dl+02LLeOiwTKUKUEP8cDb5Vs7xwKiCT4ewl0BWYt0beLRPMss7rnZyBdwfhfSDiH27npmOtfTp1CpO4TobgoMg1ieNq8x4SWeiG6+kdb1qXrPJZ1hYkRAptXsyMAvgyb9g3xCj65kIPOlUEhRl7T6gOuwQ20963VW5SK9FcxOA29oTYJX97yQIs/hmIs38CElx+2pUk9RoYV/Jb/mHys54RWRhd8Ssqu8mdTn9dabckOgPn2DAMP0uSL8eGvEmNyFN03DGNxl9yHEXC1uPaq8qwYwMwFZqSoaJbgpH2T2pdexfKaLtn269dnuUksbu2FIflsHfXpcOjPlwWjNak7AQqphEhd/bA x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(122000001)(38070700005)(33656002)(71200400001)(83380400001)(186003)(66476007)(5660300002)(6916009)(38100700002)(2906002)(64756008)(6506007)(316002)(7696005)(8936002)(52536014)(86362001)(296002)(508600001)(9686003)(786003)(76116006)(91956017)(8676002)(66946007)(4326008)(66556008)(55016003)(66446008);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: 7TBJE1GBMoefg2rgZywGpCDhVDxDCfkKAoWGd+ki6us+b9YRoHDwFWFB/CH/2OeBDkxUgY4x+SpLsmPg2OLW/FyXz/ZBMEA7+2wKPxInZS3nPdp1VAI1cd9p5/UzMs79EM/iQPPGJmDhUbH3+z54d0VWxyw2a+jWqug75mSh1725aqa8AwEwfBq3XX832e0PnVsGL3zUIIBhAH9rSotX9cyj3C3qBpqAu6uJaYOBeXEM2FYFR00AnlyetSrl/vHaQ/1ATFMVXrZeUvnP6wif/g5wOLdtu4IF+tPjfPKcH18y1Ll4lH20sGwzhEGUpJJbX6jmhQKY65wDQpifNsNYScpvB8UNVvkrWicriLhbiD4TEGeFbXuo1rBcJArG4d6A+PwVrPvPSi/LXA1TIK2iQZ1CA9QhB5Mh9XYxSun81BPV+RRdTlvvuH0l3qcmL1gvjXTJTIBJcOIF8O8FeC45pCxzobwmBEOPyxkTmjeHFLM= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: d6ea25cc-4da4-4a07-7d9e-08da403c8678 X-MS-Exchange-CrossTenant-originalarrivaltime: 27 May 2022 23:56:32.4449 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MRblcWP21yF9dtlmErh5NfNrdnTtyEilA3ZA1usxZbSK0oLD2QQhDmvt3wzX1SWQu1V6InjCkoRWSN+Pq3FbYA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB5121 X-Rspamd-Queue-Id: 4L91tH3GGnz4SvR X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=bDykNjiZ; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.44 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.97 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.44:from]; NEURAL_HAM_SHORT(-0.97)[-0.970]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.44:from] X-ThisMailContainsUnwantedMimeParts: N Andreas Kempe wrote:=0A= > On Fri, May 27, 2022 at 08:59:57PM +0000, Rick Macklem wrote:=0A= > > Andreas Kempe wrote:=0A= > > > Hello everyone!=0A= > > >=0A= > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1=0A= > > > systems hanging when using a CentOS 7 server.=0A= > > First, make sure you are using hard mounts. "soft" or "intr" mounts won= 't=0A= > > work and will mess up the session sooner or later. (A messed up session= could=0A= > > result in no free slots on the session and that will wedge threads in= =0A= > > nfsv4_sequencelookup() as you describe.=0A= > > (This is briefly described in the BUGS section of "man mount_nfs".)=0A= > >=0A= >=0A= > I had totally missed that soft and interruptible mounts have these=0A= > issues. I switched the FreeBSD-machines to soft and intr on purpose=0A= > to be able to fix hung mounts without having to restart the machine on=0A= > NFS hangs. Since they are shared machines, it is an inconvinience for=0A= > other users if one user causes a hang.=0A= Usually, a "umount -N " should dismount a hung mount=0A= point. It can take a couple of minutes to complete.=0A= =0A= > Switching our test machine back to hard mounts did prevent recursive=0A= > grep from immediately causing the slot type hang again.=0A= >=0A= > > Do a:=0A= > > # nfsstat -m=0A= > > on the clients and look for "hard".=0A= > >=0A= > > Next, is there anything logged on the console for the 13.1 client(s)?= =0A= > > (13.1 has some diagnostics for things like a server replying with the= =0A= > > wrong session slot#.)=0A= > >=0A= >=0A= > The one thing we have seen logged are messages along the lines of:=0A= > kernel: newnfs: server 'mail' error: fileid changed. fsid 4240eca6003a052= a:0: expected fileid 0x22, got 0x2. (BROKEN NFS SERVER OR MIDDLEWARE)=0A= It means that the server returned a different fileid number for the same fi= le, although it should never change.=0A= There's a description in a comment in sys/fs/nfsclient/nfs_clport.c.=0A= I doubt the broken middleware is anywhere any more. I never knew the=0A= details, since the guy that told me about it was under NDA to the=0A= company that sold it. It cached Getattr replies and would sometimes return= =0A= the wrong cached entry. I think it only worked for NFSv3, anyhow.=0A= =0A= However, it does indicate something is seriously wrong, probably on the ser= ver end.=0A= (If you can capture packets when it gets logged, we could look at them in w= ireshark.)=0A= --> I'm not sure if a soft mount could somehow cause this?=0A= =0A= The diagnostics I was referring to would be things like "Wrong session" or = "freeing free slot".=0A= It was these that identified the Amazon EFS bug I mention later.=0A= =0A= > > Also, maybe I'm old fashioned, but I find "ps axHl" useful, since it sh= ows=0A= > > where all the processes are sleeping.=0A= > > And "procstat -kk" covers all of the locks.=0A= > >=0A= > =0A= > I don't know if it is a matter of being old fashioned as much as one=0A= > of taste. :) In future dumps, I can provide both ps axHl and procstat -kk= .=0A= Ok. Lets see how things go with hard mounts.=0A= =0A= > > > Below are procstat kstack $PID invocations showing where the processe= s=0A= > > > have hung. In the nfsv4_sequencelookup it seems hung waiting for=0A= > > > nfsess_slots to have an available slot. In the second nfs_lock case,= =0A= > > > it seems the processes are stuck waiting on vnode locks.=0A= > > >=0A= > > > These issues seem to appear seemingly at random, but also if=0A= > > > operations that open a lot of files or create a lot of file locks are= =0A= > > > used. An example that can often provoke a hang is performing a=0A= > > > recursive grep through a large file hierarchy like the FreeBSD=0A= > > > codebase.=0A= > > >=0A= > > > The NFS code is large and complicated so any advice is appriciated!= =0A= > > Yea. I'm the author and I don't know exactly what it all does;-)\=0A= > >=0A= > > > Cordially,=0A= > > > Andreas Kempe=0A= > > >=0A= > >=0A= > > [...]=0A= > >=0A= > > Not very useful unless you have all the processes and their locks to tr= y and figure out what is holding=0A= > > the vnode locks.=0A= > >=0A= > =0A= > Yes, I sent this mostly in the hope that it might be something that=0A= > someone has seen before. I understand that more verbose information is=0A= > needed to track down the lock contention.=0A= There is PR#260011. It is similar and he was also using soft mounts, althou= gh he is now trying=0A= hard mounts. Also, we now know that the Amazon EFS server has a serious=0A= bug where it sometimes replies with the wrong slotid.=0A= =0A= > I'll switch our machines back to using hard mounts and try to get as=0A= > much diagnostic information as possible when the next lockup happens.=0A= >=0A= > Do you have any good suggestions for tracking down the issue? I've=0A= > been contemplating enabling WITNESS or building with debug information=0A= > to be able to hook in the kernel debugger.=0A= I don't think WITNESS or the kernel debugger will help.=0A= Beyond what you get from "ps axHl", it has happened before the hang.=0A= If you can reproduce it for a hard mount, you could capture packets via:=0A= # tcpdump -s 0 -w out.pcap host =0A= Tcpdump is useless at decoding NFS, but wireshark can decode the out.pcap= =0A= quite nicely. I can look at the out.pcap or, if you do so, you start by loo= king for=0A= NFSv4 specific errors.=0A= --> The client will usually log if it gets one of these. It will be an erro= r # > 10000.=0A= =0A= Good luck with it, rick=0A= =0A= Thank you very much for your reply!=0A= Cordially,=0A= Andreas Kempe=0A= =0A= > rick=0A= >=0A= >=0A= =0A= From nobody Sat May 28 00:12:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1BAEC1B41A23 for ; Sat, 28 May 2022 00:13:08 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2051.outbound.protection.outlook.com [40.107.115.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L92FG28jlz4Vvt for ; Sat, 28 May 2022 00:13:06 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=M7tOpOeMvWc+CxbXGhJZ1UoGyQpmhxsSnsalwWcwm7CXxWokWpFkzJIVefNiBjCxiQpPLBpTkl+GAtPdHy087kTqvSgyVFVojTMr1uU/9hB9sK6DgTY0l4gPlh4sP+7/34pjttW3+ddTHHOrBF9Chy2tkBlOMN1z0LOd4PBCdQjSeGXvdvkMRCV9iUI3Bl49IbwqCb6SJArzWYp/4rc06Cwj9YLlR8bILSDxMJRTw9AAPsHyYmD0ETD5160syiA6ArnYndf7q41MrYwp+5lTq7f26aXNv9k4e6ycYyCIl0nfiru9xVTXllUHu9f649iDZQLWizJepOhoYalK1FvmHA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=kcnkoWQaSLiLjRbvazKlAS7KzSDvKyuK+QOFMsfVRBc=; b=n0NCuZvmR7LRHJmLcPlskljgTj5Ia4k2zIG6RQcbDuau2I+b5nqQKDRqC3PnRk7pD18NciMVRGizADSaMsLOcajawSabxgojZBlvc2QIIcs6cH6kXfJGjYKG1FAQSBYH541kI8yfjL/MfNJNMxDoPC3t6+xmmCI4v0hCRu6a5iivEIPTNaHQEATtUlE6VzrQ2zi2Axy9jp7a379HsEd9/jrBIvObYHijaCY4pth0kuMcVgAue2v2AxMcCM9Hx9/Fv7Ayf4ZKMX/tTc51clrMPLnQi6gZ4tmjCuuNHRsee4lmYr1HqxdbNUplTfWw6d5Uw3lz85SIqKglh/JKpwizsg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=kcnkoWQaSLiLjRbvazKlAS7KzSDvKyuK+QOFMsfVRBc=; b=Vx0yEYLlU3bKXS7D/gfWmM2lBW0tigIo2xMJtqIJB+F0M2l/kukfOHHuCEINw4AlWBVzIU+5cObWFtvEk0RpUzt7gtbLXzJUdcKqCS+/xyxMW+WhEpmxGm+Y5HOOyMyv3iq1762v3GmLj3KzJEAbplyO9GQIZ8I7maEJaeGhT0rgsOOcvNg6XLo2c9Z3eHh9OCtb/Jb4otsyt4ewqtoz1zNUBbDnfd5OIfAfwHuGgkGN0RvxvHPNJ/O1AcnhzusXc5tnORJSHl3CkZW7fMWfc0wLJ+4FEeGfQz+Le4Dva53FHQnGlSxH+rjP+3Iaf63kidJtyxMffDauMsfsAE/5rA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT2PR01MB4670.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:3d::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Sat, 28 May 2022 00:12:59 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.016; Sat, 28 May 2022 00:12:59 +0000 From: Rick Macklem To: Andreas Kempe CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgAAamoCAACAyTA== Date: Sat, 28 May 2022 00:12:59 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 3872ff3f-d1c0-ca11-ac8e-ef94177e2ebd x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: eb3f58b6-34d2-49cc-1c6a-08da403ed2cb x-ms-traffictypediagnostic: YT2PR01MB4670:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: j+2gMVKZnnnJO22+8/d1n1HSr/FhP3SzW/J+pAPAdboXb2sPyJSSjZaafOr1wmBqLSE+469f6RIIZNbgDbpQnw3z0tFB/iUyAnsEKGKtcQSy9tfUOTyFe3lkp47YjdqFXyMJ9Sar0ZD2Zg2ju5X9oVmV1/HATb52ty3TDk1a65/H9UZ108buhBRpmHVWvo5Camib1zsplxg+y64f3GEQGim7frL8CoQqsBlSb3MPwpfywwfXlg/shkDVXELSHDhfrU1TJ+/nMeAACo3kh8hiZpBgLUIFmr/udfcdhaLoFDxtbPu1apKPDJNUpF6kBSr4GXF6Uu9hZevGf680WmSrUpVzcyniEOcNoaUKqRrhKg0pvMFhv5ECsbiY3+YigRR9OU0P5noT6IufuxiAbEOmNCT0KTycOc4QZ6sBQIBSTRDzWu2pv/XwKMmrZJGWA+Dii0Fa2tuyCe2ZVWJA/CyjcF5qI73ga0s95XiPnPbVdFe7zgXOwH2w3UGNZLkRezBbVj5+Wj+GqeqZVfCk4kPhcChMUWg2k7BQaKq+BKQKzmXKpwsYXV1qyWrXzKROXZ8gGgfb60duQg46NdxBSQmGllnhLAFkRU5DaCPtl0no5RziYjqU0Ivsz3FurDHE/rcDYjP6J78D8r1OO/qbdkt0UJa9eOftDTrm1dw93mj3qnQY7WxuORm3tKrh9IuivUGgFbshimPdTcv8neEiP+mhfw== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(122000001)(38070700005)(7696005)(33656002)(38100700002)(76116006)(66946007)(66446008)(66556008)(71200400001)(66476007)(4326008)(8676002)(91956017)(64756008)(316002)(786003)(296002)(6916009)(55016003)(2906002)(9686003)(6506007)(86362001)(5660300002)(186003)(52536014)(83380400001)(8936002)(508600001);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?GnynIvF31zYCrPfXtb1/xNJVdW3yU+cnBFR10blQ64kGcZviSCibFIz8Np?= =?iso-8859-1?Q?SbfrVvhE5kBWRSu16JPw3U7ekRE/wr1AWQVtc/dfgT6sOFG8xjbmHkJ31C?= =?iso-8859-1?Q?gKeoEWhnUAXT9Y8RUUDRcjkNX3xxWwID5GBH7czs1Zv1twUyOhBvSezHYI?= =?iso-8859-1?Q?Bj+d06Dyd3QFTk3Tz0uFS0IV1NZ0+9tfTq+2wj3JFuEtWJ0w9DvGqDhb6A?= =?iso-8859-1?Q?pJ1VaBJT7iC5p8qZYrsTpCOeqCd3qfnkPgoYXkm2GdktpDWupG4nMm9/oU?= =?iso-8859-1?Q?1aJRlSwS4EM2STc4bPPezjE1D20hHh2n/wv2IUt68tZROfFzTKlzVsP3GH?= =?iso-8859-1?Q?Xf6/TbmuHukZzxTi1s57liXq9Zaq3+DhX0hZ5yNSKbdZKP8HF8Uho1m/gf?= =?iso-8859-1?Q?oWcJajbdgYMy4xMWw8qyn/XmCaemUCKDgOLOge3IqX+cueNuonq6Zex5U3?= =?iso-8859-1?Q?KQPeU1p/QcYieNqcazyNcjOd0Rojp4OPdszJo/YiSR8u304yzeKB19vRSf?= =?iso-8859-1?Q?PrnmENpKD53h9+uqcLkPg5xK4x9nA/JsIEiJQdD8tB2ehJBe2UvGG/YdJe?= =?iso-8859-1?Q?BAorzRZ6t5r+3OrENJr0v2qPTIIRF/K68nifL+m7xbIP2yAT0AETUMxwBy?= =?iso-8859-1?Q?nElSnWgCj0R9cElS2hoC6298RhqVrqmjG+YCwj7IR6PF4+sodVVG7VwfVB?= =?iso-8859-1?Q?Fq35nccBAYRC6+17w6tEKISk00RAQ+g5P0UH0BS4L5FFee0uhlrxjlmtez?= =?iso-8859-1?Q?K/4B6569M18W6NDTcQ3ia4iUMqHnBCs+nE0xFrSF7h3t/GlJrdtKEU6Qv5?= =?iso-8859-1?Q?wf9fKrSPvrOBBYYXQ5Hc4jFxAMvF6PLn2j7d/KNimv23izJQ//MWazr7/E?= =?iso-8859-1?Q?5kDdcuFw/kT7bnLp64cyfw+tm0wxA8gp+4Hgmk4zXTNOTj5pCfo92vEIyk?= =?iso-8859-1?Q?oFrKdykGLij/8qCK3UNX3l816hQ8CMkq21KxIuHmtzEanSymL0Mxpl1DMP?= =?iso-8859-1?Q?CSS+q6XAJPu13KLPTKV1op4feIdhSKnuvajbH6OJjGnxFblu58dets8Z4l?= =?iso-8859-1?Q?JM2Ax6UaXFoYAV9xuii6fXZ2WdyGlj86E0bTzGRrKiKcOOy3gBAWv+POQ7?= =?iso-8859-1?Q?AfkcZ5WyklYK3ZdfuUOJgeDAFTzkU98aohdSU+Vu6b6GMmdK96/YaJNlzz?= =?iso-8859-1?Q?XJizwwXk5eBngGjKtjyxKrZJ0limQ8JJA4vuHzWC5Q3PGQCVv48PJZSdH8?= =?iso-8859-1?Q?tWvGPZLy75vG5Olmqx1UC71+WdWDnZoGByRUmZZ7VyxZ23T6RAIwvjTEQb?= =?iso-8859-1?Q?uL8UgwQQkbc68cKkL680VQJQ2SO5TWeMW/kTLulwXgCsOwoUhOgNlV2SSe?= =?iso-8859-1?Q?jT1JEuyS4IeiY52WhLX/I17TKRB+oEitMb684YtVIByTZYfBwR47QIcqzZ?= =?iso-8859-1?Q?oZSkuX6bQRWAfozW91cCYuvDR5pUa9nPyRB/LYcNdFzQvD3kb2/k/RJ43h?= =?iso-8859-1?Q?lliaosOP+bB6qCndhqMWAOyiVmKII5FID85vk32WBBDrthHiYDTTX2pfro?= =?iso-8859-1?Q?YxNIti1oHxJA1Ki0+MKM34r6O8i/jLQjcVkCNstXxmRoa0a3bd6Jm4qNG4?= =?iso-8859-1?Q?JH8ke6L2+qJMXV4XyWZyUv3+HoqoQRKEHubyUcWalr6VAs6HQmP8pPsJlb?= =?iso-8859-1?Q?zm1CXjG7G31MWR6AvYbYTLP26B4jopDY/n50VuZbQE7gRjoL7PWMEYoTjm?= =?iso-8859-1?Q?hXJDt1gQ1naEQP67U6ZHrZH0jvjTLlrOMLkKV/XsgkCqsq27n1LobQLxta?= =?iso-8859-1?Q?sL+a+J2vhJdk/h4K89O/RhnP3erAx7dmu5TA725DW0GqVMUHnvb5fkxWjF?= =?iso-8859-1?Q?DC?= x-ms-exchange-antispam-messagedata-1: iFNvbSWbRuadVA== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: eb3f58b6-34d2-49cc-1c6a-08da403ed2cb X-MS-Exchange-CrossTenant-originalarrivaltime: 28 May 2022 00:12:59.4867 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 998NYcfzx8c4U5V2HWrF0Q3BInyuqJ2t2TA7Mna9o76Ds8MIJVblaYphve4jHFJZy+SnC09HDrpmkX3j7Y3Tfw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB4670 X-Rspamd-Queue-Id: 4L92FG28jlz4Vvt X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=Vx0yEYLl; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.51 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.51:from]; MLMMJ_DEST(0.00)[freebsd-fs]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.51:from] X-ThisMailContainsUnwantedMimeParts: N Andreas Kempe wrote:=0A= [stuff snipped]=0A= >=0A= > The one thing we have seen logged are messages along the lines of:=0A= > kernel: newnfs: server 'mail' error: fileid changed. fsid 4240eca6003a052= a:0: > expected fileid 0x22, got 0x2. (BROKEN NFS SERVER OR MIDDLEWARE)=0A= I think this can also happen if a Getattr operation fails with an error at= =0A= the server. It then has "default attributes" and a default of 0x2 (root ino= de#)=0A= can be expected. So, I suspect this is what is happening. Generally, failed= =0A= Getattrs will be problematic, but I'm not sure if they can cause hangs?=0A= =0A= If you can capture packets when these get logged, we can confirm if a=0A= Getattr operation has failed with an error.=0A= =0A= rick=0A= =0A= > Also, maybe I'm old fashioned, but I find "ps axHl" useful, since it show= s=0A= > where all the processes are sleeping.=0A= > And "procstat -kk" covers all of the locks.=0A= >=0A= =0A= I don't know if it is a matter of being old fashioned as much as one=0A= of taste. :) In future dumps, I can provide both ps axHl and procstat -kk.= =0A= =0A= > > Below are procstat kstack $PID invocations showing where the processes= =0A= > > have hung. In the nfsv4_sequencelookup it seems hung waiting for=0A= > > nfsess_slots to have an available slot. In the second nfs_lock case,=0A= > > it seems the processes are stuck waiting on vnode locks.=0A= > >=0A= > > These issues seem to appear seemingly at random, but also if=0A= > > operations that open a lot of files or create a lot of file locks are= =0A= > > used. An example that can often provoke a hang is performing a=0A= > > recursive grep through a large file hierarchy like the FreeBSD=0A= > > codebase.=0A= > >=0A= > > The NFS code is large and complicated so any advice is appriciated!=0A= > Yea. I'm the author and I don't know exactly what it all does;-)\=0A= >=0A= > > Cordially,=0A= > > Andreas Kempe=0A= > >=0A= >=0A= > [...]=0A= >=0A= > Not very useful unless you have all the processes and their locks to try = and figure out what is holding=0A= > the vnode locks.=0A= >=0A= =0A= Yes, I sent this mostly in the hope that it might be something that=0A= someone has seen before. I understand that more verbose information is=0A= needed to track down the lock contention.=0A= =0A= I'll switch our machines back to using hard mounts and try to get as=0A= much diagnostic information as possible when the next lockup happens.=0A= =0A= Do you have any good suggestions for tracking down the issue? I've=0A= been contemplating enabling WITNESS or building with debug information=0A= to be able to hook in the kernel debugger.=0A= =0A= Thank you very much for your reply!=0A= Cordially,=0A= Andreas Kempe=0A= =0A= > rick=0A= >=0A= >=0A= =0A= From nobody Sat May 28 08:12:31 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DE6E91B4AC63 for ; Sat, 28 May 2022 08:12:33 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4L9DtT0vyPz4RWG for ; Sat, 28 May 2022 08:12:33 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from pi by fc.opsec.eu with local (Exim 4.95 (FreeBSD)) (envelope-from ) id 1nurYl-0008Y0-G6; Sat, 28 May 2022 10:12:31 +0200 Date: Sat, 28 May 2022 10:12:31 +0200 From: Kurt Jaeger To: Rick Macklem Cc: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4L9DtT0vyPz4RWG X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 2001:14f8:200:4::4 is neither permitted nor denied by domain of pi@freebsd.org) smtp.mailfrom=pi@freebsd.org X-Spamd-Result: default: False [-1.49 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[pi]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.73)[-0.729]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.34)[0.339]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Hi! > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1 I have it with an 13.0p7 client against an 13.1 server with a hanging soft-mount (I tried unmount to change it to a hard mount). 61585 93- D+ 0:00.00 umount /office/serv 61635 133 D 0:00.00 umount -f /office/serv 7784 138 D 0:00.00 umount -N /office/serv and procstat: # procstat -kk 7784 PID TID COMM TDNAME KSTACK 7784 107226 umount - mi_switch+0xc1 sleeplk+0xec lockmgr_xlock_hard+0x345 _vn_lock+0x48 vget_finish+0x21 cache_lookup+0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 kern_unmount+0x164 amd64_syscall+0x10c fast_syscall_common+0xf8 # procstat -kk 61635 PID TID COMM TDNAME KSTACK 61635 775458 umount - mi_switch+0xc1 sleeplk+0xec lockmgr_slock_hard+0x382 _vn_lock+0x48 vget_finish+0x21 cache_lookup+0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 sys_statfs+0xc3 amd64_syscall+0x10c fast_syscall_common+0xf8 # procstat -kk 61585 PID TID COMM TDNAME KSTACK 61585 516164 umount - mi_switch+0xc1 sleeplk+0xec lockmgr_xlock_hard+0x345 nfs_lock+0x2c vop_sigdefer+0x2b _vn_lock+0x48 vflush+0x151 nfs_unmount+0xc3 vfs_unmount_sigdefer+0x2e dounmount+0x437 kern_unmount+0x332 amd64_syscall+0x10c fast_syscall_common+0xf8 ps-axHl can be found at https://people.freebsd.org/~pi/logs/ps-axHl.txt > > systems hanging when using a CentOS 7 server. > First, make sure you are using hard mounts. "soft" or "intr" mounts won't > work and will mess up the session sooner or later. (A messed up session could > result in no free slots on the session and that will wedge threads in > nfsv4_sequencelookup() as you describe. > (This is briefly described in the BUGS section of "man mount_nfs".) > > Do a: > # nfsstat -m > on the clients and look for "hard". No output at all for that 8-( -- pi@FreeBSD.org +49 171 3101372 Now what ? From nobody Sat May 28 15:30:18 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 577F51B5C33D for ; Sat, 28 May 2022 15:30:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2063.outbound.protection.outlook.com [40.107.66.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L9Qbv371Xz3h2G; Sat, 28 May 2022 15:30:35 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=bsOOvkkeg8/VvNEn4fA7uJq4HrOpM/GrjL+CoVET8E3DS/XJ8xfZjqvTDTnesKA5QF2xsZphBsXAc0uOibNPgVb+iUArMtT/AqeOYKwJHtkPYAtZGRlYXhh2/9JVJ3qr6NfpziFcYwYXLK5ohjFQl+VJnLSR4NoZUlsuw4CxruX62gw4FHPAapGrw2vGT3iv2vBVM4MvMpKXRYmLL+mgAAhl5fjXaL6y38GeaShS21L9T/PKZiaWpnEFuNsD9URYkc3aZcaOvENM2lIvTZxD3k1e9zKqnDEVpQ1XfFXUI2hvMSu1HoShB1N0ENrU9vnUbsdpos08mvxXdsh1Xe4rRg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=iayVepgpgUjkeRpb1SuhuBzBb7ZW9lImrV+rHE+NWo4=; b=Ey7PZGvFqBiNzAY8D4DetvHqD8UaB1BEQcfeAdui53BB/pC3MZ6YzMTRk+Z4JYwp0r3aQz4adw0FBkYyI+RJuQ97zByATcHfSzoJEcMp3yFGtFjtDo1EVQkLyNuVrllwG7CUex9irdVdkKQb5ZSuFe+jtu4Jh3IPtTfpoYJykzIkasME5cd2rxyHL7D2dUwtJSKb+X+UqWqyxPjntN73TItWWzLb9A1R1ovGydZLZG9ih9yoOh1WUaY/ZGJ5lzNil/bsI2lKhc8gdyXLOzzPdwUHXnqOQyPnNIJvSpnU27qUC4mkG1zSnrVjLG0/MDZXbOS9cF2qxpvb7GK9zfS0wA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=iayVepgpgUjkeRpb1SuhuBzBb7ZW9lImrV+rHE+NWo4=; b=ZonOn1qffKwDoXVs9zZqc2X8zYf7nTuQROA7osXdT7NofJ8lfWuGE+Et7XOv7pQBTL66ESQjke/0WdLiou3PxuBxo8ug0dWcaEH6omMq6zWsnrv9ojUWpV84Xaa5ZvNNOPp9VLD51fxFizfNK9f4Pd8prS84xILqFLWrHFaoICbIU1Jj/2iP4+O5Z0TzIhcA6AOxFm1lPKf3DcBNtM/NDW2xKuVXByJZKtHNjOBlR4/UNuVxiHBQ1F5G8PMLXkzaq8W7gQuDV9LCoop1Wy2PbEabm19dqy/17KCVj7K1Y+sJb0ZU3swILznxM6qNl8aVwdCJuHek0la8/LT0TvYTmA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT2PR01MB8309.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:b0::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Sat, 28 May 2022 15:30:27 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.018; Sat, 28 May 2022 15:30:18 +0000 From: Rick Macklem To: Kurt Jaeger CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgADCMYCAAHUPJw== Date: Sat, 28 May 2022 15:30:18 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: fe4cbff8-9a52-c762-042b-7efb69b2fd08 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 4f92cfe1-2f7f-40d0-f0f3-08da40bef8af x-ms-traffictypediagnostic: YT2PR01MB8309:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: jPXyJC35i6v7LWZ0JomJxxLyH3rHgucQ9vl+XbKZ0EPuMMEg5hrtEK0GOJIJNZxE4T6WQpFat57EsKj2vIVvODhYRWko2vyI9MOx8g7biug65bnJXllY1g5obR+fOD5ySaRvAjVfFdLO3axpkn25b2CerTcg87sW5aC6PEWj7rXb2k0GEC/9seOrGk8g0RDJfs/zDDXRv3wtTH97Zux6exAKkIjKRo7TvpQ/+A2vEcf2yuKM+DL85JkSvVfWwi3Q3608z3+xg/1642MBpQ/g4vtJ68MwoinL2p1DgXkRYcrO2OloNKO7qMoiuSnIPaX0wc43FV++8RxH2zOlNmOo2WpUg8ydNa5QvAx0rBuxe4/NsH70QBMm/ON3UThkJuJ+fDnPTLBo1yi5A89pqfFZeYt9pGwX3Lfbkahz1Z+bET8mpnf+tWQbM/EufiE1S75q8VFuhh9X2YarjI2uvBY4AFc8bIEywhhUdnfoNsSwNccSYlUUEVZPdLNvT86+IyC5ZM+Zk0cUOWfr69O45B3pWnGCFMsxP+wTtyouHS31UbPqVYn5an3Pq4Egmiy54eDxgxEgO3uDPU1VCLfGpnEHxkVKnsOaOdqyx7B80EQ+DskpMzT/thW1k9PuyPwy2H2X6PCuDjJB4FP62Nr//gw8QaJosJnTA4pxAc0bZjuem1bIIvfT/gp0iP3UH69bY3IFE7KsuRJJyvKy3u7+Jq1x7UslXHDlTsxV/+W4fGmHdjw6TkNIkuhtd6Rn19hnzgSPfc3vcwgm2VC1jSoK+HzkmhS6veka/bfyRXSHSURVY+Q= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(83380400001)(966005)(71200400001)(186003)(2906002)(52536014)(5660300002)(508600001)(55016003)(8936002)(6916009)(786003)(38070700005)(38100700002)(91956017)(316002)(33656002)(86362001)(76116006)(450100002)(64756008)(66446008)(66556008)(8676002)(66946007)(4326008)(66476007)(9686003)(7696005)(122000001)(6506007);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?9kfDK6PO7DhOKDGE4bHRC/ZRQw9gVHnKgEQ7n01NeS5JV01qdn5uspKKI2?= =?iso-8859-1?Q?WVYvePo5FkecCxg5nXadvRXyiit1oOqpaLnswpjDf6rsbvGmGXQfekqxTf?= =?iso-8859-1?Q?FpCUOWWqgUstVg2Nc2v2RoNi78hxFfHezdLaAkYdWiVr6EQyUyxHM1OZVv?= =?iso-8859-1?Q?GyUBJAVbA11UkHHuCoxzzxzjRbLKk8VXpac+bRkUG6hrzcQ4YDPLBszC2X?= =?iso-8859-1?Q?Qs8mrq+qzoF1WlpxxWUejk7TYf8GqVetXsekhHefGeco0Gz9D3513WralR?= =?iso-8859-1?Q?rh6sbjD8nCvgmnmoNekfDusvrbZ4Jp2pbMF0mptzoB5tnXxBfH11yvYuva?= =?iso-8859-1?Q?x1W63/RaAMSYxJme+VHDJ1vs4OV767ii1r3Gp2DPxb72KlJV1CA3dwf+F8?= =?iso-8859-1?Q?vncq8ZyqzDT+/Yh1rv7XkMd8fE1sFxCBIlPuHNsnEPkUfsQEu/K4YSF5me?= =?iso-8859-1?Q?CLAL/ml0qkkaQhtNhVDQuOgMfEnK4kESoBaUS8dmcjtI+9VZhcGYCpR6ER?= =?iso-8859-1?Q?zkhpl7Aiq5qE20RL/Ryg+UuPlhKQKpeCqJxMc+xAe8f/ZdaRO5LSFeF+hh?= =?iso-8859-1?Q?JGHNgueUQCpKJU9BllRoRjGTAMrue3x+8JcYZpLCAWcgSV96fgU1Grf0yc?= =?iso-8859-1?Q?nRCr0ul1u/xLGkufDGTnVtKJt7JlGJHIsrRmF9BcG05Bsn63GBVHeTGk8M?= =?iso-8859-1?Q?5mWYshSiEpVc428HKsMOy/7OUEGwJIV6Zu8YcoYdq+cleWM06AT78EQvWW?= =?iso-8859-1?Q?3JcL3sWfOtBUZyb4ffyCEUJ0wcICyi/lvtJP3YrFrQzzOo2t+vBoThDbul?= =?iso-8859-1?Q?Lkz/9BgUnOeCkhPIKSh/vxZskmrLABuAEfed2ylxjJ7ZxepaKFsjoMPrJx?= =?iso-8859-1?Q?ol9qvwQ4v391r1Lnfup465Ur7Ipz9RnKpjbfDyfuoYMEIwBljpdkCYULkx?= =?iso-8859-1?Q?DdMPakog9XYjIvWth9CH0kppokESuVO0Cvbxlbk9AWyIDfTxEmy20zAw6c?= =?iso-8859-1?Q?cUvgaNJnXQsl2NDIUnaBRq4iJSBbkyldAccPYSTwn5dDSOCMrKjDdfJxMG?= =?iso-8859-1?Q?eO84LuykBgR+dW/6vW223UDK1ply7LMYelqRp3vVQU0NvVdwUtRaQIIj/d?= =?iso-8859-1?Q?4j8ZzdAdz/hgYmNCEytC/iOkldwrFLBfLJARWk6A/2HnM5O+WgSVllRasx?= =?iso-8859-1?Q?3LRRYrTvtx6DO6CebjhVfSN/RRFZjIDU+1XIqey06Jbz1ejueR5X99/WoB?= =?iso-8859-1?Q?f2/vRN7lFyVxTBChBPpwByRO/2xty67VEkwUudpZndIB6ceHwJrNu3xrSP?= =?iso-8859-1?Q?8egCsDfhQCmyo9WXDZReZ/OevbBVemJFn9XD5evOeKGqael+XwmwRb7TO+?= =?iso-8859-1?Q?pVExnZlrNOMSSV7JAt3saxvBsubhRGv9dbnYJbTuYx1g/KdRre1VihBTce?= =?iso-8859-1?Q?sEUVNQNp9ZhH77+FXcgw4aJdVMhXdZuoSV5rpMQSOsCQE2noiv7o8Q6hzm?= =?iso-8859-1?Q?r8XwSt5VuxEVN1NCgWdkqDN0Qxqc3ZqHChuxPyNLtPgvCdDX5MP5c1ADXW?= =?iso-8859-1?Q?QMetAbtt4kqJ9U9tZJsVHdXp//NjTIxvB5e7OpgcrMdiITyH2EHNjIasW8?= =?iso-8859-1?Q?Dm4kE6pjGIAmXVBLkLEEwZp7jHh3QJaaz+pj15m4esRgIRg8sZfqF7aKP7?= =?iso-8859-1?Q?NTmyolqjmo6CNisHxDoqPdnfX/UluGsvFEbanlMzMiMtm50MuDBuwXzBVr?= =?iso-8859-1?Q?SIG/+FIjBRJoj3g1ZoKtX8GdH485pS2TRGEBMTQR6eN6c11rWPmIWy2bwL?= =?iso-8859-1?Q?gM2sFzJlmvgfZhOQfamS2W5KHqhY9eMcFggULlITOe+DY5sxKPDXS2Px2N?= =?iso-8859-1?Q?Zs?= x-ms-exchange-antispam-messagedata-1: Keplqfqi4z4SjQ== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 4f92cfe1-2f7f-40d0-f0f3-08da40bef8af X-MS-Exchange-CrossTenant-originalarrivaltime: 28 May 2022 15:30:18.6434 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: EPgUPHVF20WnL1UjdMQd0DhbZcFujFacIQ2bi6d5CqjiYk3E1hBlmOcELvyOHA3iQ25tioKkZZ42GqR590D42A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB8309 X-Rspamd-Queue-Id: 4L9Qbv371Xz3h2G X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=ZonOn1qf; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.63 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.97 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.63:from]; NEURAL_HAM_SHORT(-0.97)[-0.972]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.63:from] X-ThisMailContainsUnwantedMimeParts: N Kurt Jaeger wrote:=0A= > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1=0A= >=0A= > I have it with an 13.0p7 client against an 13.1 server with=0A= > a hanging soft-mount (I tried unmount to change it to a hard mount).=0A= > =0A= > 61585 93- D+ 0:00.00 umount /office/serv=0A= > 61635 133 D 0:00.00 umount -f /office/serv=0A= > 7784 138 D 0:00.00 umount -N /office/serv=0A= The first umount must be "-N". Once you've hung a non "-N" umount,=0A= rebooting is the only option.=0A= (I have thought of doing a "umount -N -A" (for all NFS mounts), which=0A= would allow it to kill off all NFS activity without even finding the pathna= me=0A= for the mountpoint, but I have not done so.)=0A= =0A= > and procstat:=0A= >=0A= > # procstat -kk 7784=0A= > PID TID COMM TDNAME KSTACK=0A= > 7784 107226 umount - mi_switch+0xc1 sleepl= k+0xec lockmgr_xlock_hard+0x345 _vn_lock+0x48 vget_finish+0x21 cache_lookup= +0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 kern_unmount+0x164 am= d64_syscall+0x10c fast_syscall_common+0xf8=0A= > # procstat -kk 61635=0A= > PID TID COMM TDNAME KSTACK=0A= > 61635 775458 umount - mi_switch+0xc1 sleep= lk+0xec lockmgr_slock_hard+0x382 _vn_lock+0x48 vget_finish+0x21 cache_looku= p+0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 sys_statfs+0xc3 amd6= 4_syscall+0x10c fast_syscall_common+0xf8=0A= > # procstat -kk 61585=0A= > PID TID COMM TDNAME KSTACK=0A= > 61585 516164 umount - mi_switch+0xc1 sleep= lk+0xec lockmgr_xlock_hard+0x345 nfs_lock+0x2c vop_sigdefer+0x2b _vn_lock+0= x48 vflush+0x151 nfs_unmount+0xc3 vfs_unmount_sigdefer+0x2e dounmount+0x437= kern_unmount+0x332 amd64_syscall+0x10c fast_syscall_common+0xf8=0A= These just show that they are waiting for NFS vnodes. In the "ps" there are= =0A= threads waiting on zfs vnodes as well.=0A= =0A= > ps-axHl can be found at=0A= > =0A= > https://people.freebsd.org/~pi/logs/ps-axHl.txt=0A= I suspect your problem might be related to wired pages. Note that=0A= several threads are sleeping on "vmopar". I'm no vm guy, but I=0A= think that might mean too many pages have become wired.=0A= =0A= rick=0A= =0A= > > systems hanging when using a CentOS 7 server.=0A= > First, make sure you are using hard mounts. "soft" or "intr" mounts won't= =0A= > work and will mess up the session sooner or later. (A messed up session c= ould=0A= > result in no free slots on the session and that will wedge threads in=0A= > nfsv4_sequencelookup() as you describe.=0A= > (This is briefly described in the BUGS section of "man mount_nfs".)=0A= >=0A= > Do a:=0A= > # nfsstat -m=0A= > on the clients and look for "hard".=0A= =0A= No output at all for that 8-(=0A= =0A= --=0A= pi@FreeBSD.org +49 171 3101372 Now what ?=0A= =0A= From nobody Sat May 28 16:00:07 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 752EE1B61497 for ; Sat, 28 May 2022 16:00:15 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2067.outbound.protection.outlook.com [40.107.115.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L9RG624s3z3klp for ; Sat, 28 May 2022 16:00:14 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=b/j0GfRMMALqZGtuMkeQm6PQNKesTK91D+WHXOSPC9yZOxErnoeF17CIzlnBQLvsaJvBGWIzLkCHvgrdqO0jeZv+orwoThrQhXWxcuNKrb/L+xsUKvXW4BEmzlUF59jR6xkFETldq4+4PNz+LN/si01ser3QLocy8kj6cZlVenqBqEtmX5qiYM+ecTcfmV2qpYKOBqAGyl01qrrx0b6a1+Pk9UkuLKXGdas1G9WMT/iHF9BJ7XniJq9TpFajfIiHWTgnh+987omVNrWgUUDCjmdfHRcW3bwMkLfigdAI8q2dQdK3cKMo6bGFgG5V+akeTrxdmu/Kb05oHDlsJH0QBA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=J83r6wvrOYy/mHyCDyWwAibNNMCMvhZWKINXDDMOC2M=; b=Q+Ds/5l/YxjtdCj1iVXWxgI6udwDg9WTKIwxw3P/8PWvpzjBFOaVKFWgRTrki5Yo4wiYVdRo+kx61eViJHE/+/9ae0gM6FuTQ4k4ybzklyNOUfE52pM5krUdQhtPbo1ASzjXwX96e3W6LD9fYO6Vbhu85OunKmoBidruw520N2e+ypQrDB1Z706zWe1yiTjL6V68B+OC9cX2VXsEYol4EzV6xsR5YFa5xj+fSM8p95P3hDDuBlKvCuUf+Fwx3GmE8RNqyd1F1A6vnSml9GIkC229agWcL0B9Y9lunC3ZdSR3Xh+TzSkJ1zHCzUH/17LdMipr68KbmrPwJVr6nY21/Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=J83r6wvrOYy/mHyCDyWwAibNNMCMvhZWKINXDDMOC2M=; b=fghI47oGpQ4nuceYV7pHzYUBB+R0JV8sOWrS+3El6isZDU+WRvKIAOzUJOcj0z6JqgwBGjvX+nWcLfIKsL4j0JlYWzbyziMMBEnKg6ILKOF/71w7wWAcU3/ZPiqSe5lwjzUfJ3cbYFZ6NtVdPRFDaTpacVaw+/VyvmTSc0ePsGcYAUNpJeF/6pQ4UFH0DVtLRO1uySBNJJ+WKeg1SSAb4yooxVFRrUyNW8zjheCVgs4vBUil2kN1wP8ZHp+MC2cu+/pG6E48+BnHgVF08n0tN1n2v1U5fSJaCoPnlYhX2yNIb1MutYj98qf1/7Ei1GqOvznDWitlKVX0VJcOZmAqjA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT2PR01MB9208.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:a4::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Sat, 28 May 2022 16:00:07 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.018; Sat, 28 May 2022 16:00:07 +0000 From: Rick Macklem To: Andreas Kempe CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgAAamoCAASIOpA== Date: Sat, 28 May 2022 16:00:07 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: a41a836a-01a8-4761-1e23-0a8e6f4c488f x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 4a1dbbbf-2bb5-46e0-9f34-08da40c322c4 x-ms-traffictypediagnostic: YT2PR01MB9208:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: WuWg9mV2hGzRChqZ9LYbJQZbuBHsw3LQlI72efvf/Onh+OLuBqYzwIV0bPh+l8+1Y5eQ1Tos4zsW1ybEcjkiuk3aqEZbwkD5g79S3tNicEjtjCsWUp4qfxMbt7erBv2jugVAYPf/h0MLkJxZxHiAPL8JSKIU5PX8BIEGzPkkrTvKT1bXJjTqRjIg86f46MizUbhA/GetCTs0O8L+Kksnc468R7+e2+yCsOoCiGodZ1bwB2cZPBHH7ov/diBsUKl4ivrKE3usdWAkUEkrk8WQTy43TRzFmoCsAGJCVWE99wv4uvJ6gz8CwyHJ4DezQXdDGUhlNFl4sUEwr9M4L2rcRlOW93ka4L8qxFPLGslt2+dEGiu+UsXW4cJhf/dwgGxnTuP/FylP1ffeNJQfIklzSq8jAF11Wl+OaYkytEeBRO63o23GIIAfwGPNwLQf7Kt3m22FS6WrUgoamebyTUeX7mcxJOEtqtI3Mdl1nRDlqCYcWFORrJXYQecRKnoq4LMy+Q7okWCjRruxCVlZnLS+IRGGDu7gAIP1eIDn9tphOf/fGvV8y30wHz3IIuYZ8V+UetFZWYcgCKroi2QX4qnOS0Lk2Glvfu8zAo7YzIya5j5yOqIOlz6ckW9bE1bKFZsjR1wBwU8zraVKtRmONp0CqCG/YtKF/xy0YsBwnofy0d3FCNGrJ879qQNPHHqm+enURigfOt9AvRPx05djwlt7fQ== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(6916009)(38100700002)(9686003)(2906002)(5660300002)(83380400001)(186003)(52536014)(296002)(33656002)(316002)(86362001)(8936002)(4326008)(76116006)(91956017)(6506007)(8676002)(7696005)(122000001)(786003)(55016003)(66476007)(66446008)(66946007)(64756008)(71200400001)(66556008)(508600001)(38070700005);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?kcwUXYiophBu2R/ikOCGIRoQqIU/3DI8cLtbqtTh3ziu0ejQDjLQG81Tep?= =?iso-8859-1?Q?1eTVCSsbhOi6sZf7BFLuNUpV1JbgHIb8NZB/m9S1qaXTelqzXiA6IoKwRf?= =?iso-8859-1?Q?uue5HdBwWhff2RsKuVtoxGDPcxuNONFPVg7XQl/uSXtZ4snTyUbMeuRtNp?= =?iso-8859-1?Q?WxAqerpDlagVvvSxP0IF4Cq8wyJEpgNTY7L3wlPwZYW9Ljdmtks50siXBm?= =?iso-8859-1?Q?5O49VvRKHPTDqUFj2mvfWMqlpFtFlB6Gl517mOs2wDP5JEE1EcVe+MgOKT?= =?iso-8859-1?Q?PZYy8BLaF1syIiXQqgVygxcnKGan/XL4Ec5dU2FgMfxaNyC0cKyu7frcKc?= =?iso-8859-1?Q?qIbQ1pehX2BUhLXZ2H/QRrNbhm9j70TV4KxCFFtCcbnLcAMz3BN+J4KPZD?= =?iso-8859-1?Q?9W2U9lm3Sxy8BsDsU42rmToRvKJcKCy93LKACTn/Dxq+jnNcfyxYgkUNkt?= =?iso-8859-1?Q?Y2DqPcXPedw4RU/k22axBAUZL5V4u85jL6FepI78rDo20EC4aZ4IzX05/9?= =?iso-8859-1?Q?OrHE6nztD5XdU+ffK8iA8ixS0xXCMD1w2TaQtlJtxpwvxV1l8Fu1R4bBFb?= =?iso-8859-1?Q?Xh7dZ3pC1Xo2B1WbgdnsJC2tAjP8frC2cwIHgno0jBWKGU+nDAm2FXBVwO?= =?iso-8859-1?Q?T0T9Q1yCkjnnxuxvZjl+G3DmRPporDrzxQRKM/ZzIphr8RFTWqvIf4dvp1?= =?iso-8859-1?Q?z89I2inlACwLmZJObapF8/LfYrB0icM9peB2vduDUUYwAJAn8MYoZYiaO4?= =?iso-8859-1?Q?lt3e9lYW/USKlk+WeM0+GRfgi7eSzA3LhXBTxlAChU4yOPa5d9JLLlwY0V?= =?iso-8859-1?Q?mXYCIZg8lb2eaEzZ1IfSqLF+cIH3SV9y/aPbbNEcfy3PywTLi4XSiF60pv?= =?iso-8859-1?Q?j3vIc1f6OhD2t78IFSqr6QMd7v7e/qKlR1oBSfSbZAX1S3nvdNVszq6ApF?= =?iso-8859-1?Q?xmEP/iOuVRgQQOsVuad2gV311PR8uyb6y8Kl1sGTWDl4wCw4e21i/fW69R?= =?iso-8859-1?Q?QD4JMgwv4E0XxG3NyzL9KhIRRdyeLACtA96tadgCFiOLjQDXrALCJpHH+3?= =?iso-8859-1?Q?J94BADoD1SlVRMPbZ5c1WP6Dsvwdnzkc2ABc/F3b6otnxLkAoYyIXIf1yN?= =?iso-8859-1?Q?ym9oqHa15P+HtPiXWXvZL4iO80JrN1xUidlCvCZHFwngw4tpZQlYcx+fqP?= =?iso-8859-1?Q?xEt8jud+eeHLmoTt89JgdfziVcLzkZvAhQJcgoTrGLKeFjpJE5o5i+J27D?= =?iso-8859-1?Q?KEnRFEZ2Plp7bu6y8ye8wUmFp/Ineld7sRvIrlv+Ek2wJ+fAfRjjD650ml?= =?iso-8859-1?Q?5HAST8s4rkOpVpcaDj5TDdIUitO5BPFFNU5LeEciqqfhn6j68U+sT/qG8a?= =?iso-8859-1?Q?St8s0AR8xATZ9pSBg1Yfh5TZ3rWMmZSQibdFu43m41AxaqpdA9aJhS1qe+?= =?iso-8859-1?Q?IDRpOfGJ23mR2wVXkiFzh/SkIsGJ6veGuT9MbQb0eqUQhP1GrH8wlHd/U3?= =?iso-8859-1?Q?KNRzN4YzfR0T+EY5jCc2ZtGVEZuCD97PHyQ5DBQDyQ2YDhwvsLjRAdRz9S?= =?iso-8859-1?Q?GMiqGrsxtF/bF6xHuEHlEiXoD2eUJ/mJyMrYkNPGOFejwbRus6pA/okMD6?= =?iso-8859-1?Q?j+3R2WqyB0CJVEJHH1beHFLksHuukx9+PsxqxAUhhJF3DZ8eQ5NVnKS8s2?= =?iso-8859-1?Q?cMTamczjzEZT+6QV5rXpAO8BbJpikiw6MLFLRH4L+6wydiyJACPhF/0c/r?= =?iso-8859-1?Q?lL7yAGIAmMbS/6Zoe1ZgKjbs6A9UHyi08UI4mi4M5NcCVQTEVYv3AO59Ef?= =?iso-8859-1?Q?ZyHLP9TafoX19oYJFgnCasKpOplnkqscw75WB93a7ZdsLKr46xtEcm5mdX?= =?iso-8859-1?Q?54?= x-ms-exchange-antispam-messagedata-1: tkmJOQbhyb6dzA== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 4a1dbbbf-2bb5-46e0-9f34-08da40c322c4 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 May 2022 16:00:07.1833 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 5QgBqXEDdi4tMcszsOvhwbkU+LT/N1ahsege0DI3PROXiuh4AxKYLmsmS5aSOawTPCZz7G+qBYKU24jqdUlQPA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB9208 X-Rspamd-Queue-Id: 4L9RG624s3z3klp X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=fghI47oG; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.67 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.67:from]; MLMMJ_DEST(0.00)[freebsd-fs]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.67:from] X-ThisMailContainsUnwantedMimeParts: N Andreas Kempe wrote:=0A= > On Fri, May 27, 2022 at 08:59:57PM +0000, Rick Macklem wrote:=0A= > > Andreas Kempe wrote:=0A= > > > Hello everyone!=0A= > > >=0A= > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1=0A= > > > systems hanging when using a CentOS 7 server.=0A= Here are a few other things to consider:=0A= Delegations - They are complex and seldom improve performance.=0A= I think I finally have them implemented reliably, but???=0A= They are disabled by default in the FreeBSD server and can be=0A= avoided by not running the nfscbd(8) daemon when mounting=0A= non-FreeBSD NFS servers.=0A= # nfsstat -E -c=0A= - If it shows non-zero "Delegs", consider disabling them.=0A= =0A= TSO- Some net chips/drivers don't get these quite right. NFS is very=0A= good at finding the flaws, since it generates all kinds of small and= =0A= weird sized TSO/TCP segments.=0A= - Consider trying disabling TSO if intermittent hangs persist.=0A= =0A= Jumbo mbuf clusters - Some net interfaces use jumbo mbuf clusters=0A= when jumbo frames are in use. These can fragment the memory=0A= pool that mbuf clusters are being allocated from.=0A= # vmstat -z | fgrep mbuf_jumbo=0A= - and look to see if the third numbers are non-zero.=0A= Reducing the mtu may be a performance hit, but if the memory=0A= pool that clusters are allocated from becomes too fragmented,=0A= NFS will come to a grinding halt.=0A= =0A= An NFSv4 server that does not reply to an RPC. This is a badly broken=0A= server. NFSv4 servers are supposed to reply NFSERR_DELAY if they cannot=0A= do an RPC at the time requested. They are not supposed to throw away=0A= the request without replying.=0A= Hopefully, such servers do not exist. If they do, the mount will hang.=0A= About the only way to detect this would be a packet capture when it=0A= happens.=0A= About the only fix is a different NFS server or using NFSv3 mounts, which= =0A= are stateless and might work better in this case.=0A= =0A= rick=0A= =0A= =0A= > First, make sure you are using hard mounts. "soft" or "intr" mounts won't= =0A= > work and will mess up the session sooner or later. (A messed up session c= ould=0A= > result in no free slots on the session and that will wedge threads in=0A= > nfsv4_sequencelookup() as you describe.=0A= > (This is briefly described in the BUGS section of "man mount_nfs".)=0A= >=0A= =0A= I had totally missed that soft and interruptible mounts have these=0A= issues. I switched the FreeBSD-machines to soft and intr on purpose=0A= to be able to fix hung mounts without having to restart the machine on=0A= NFS hangs. Since they are shared machines, it is an inconvinience for=0A= other users if one user causes a hang.=0A= =0A= Switching our test machine back to hard mounts did prevent recursive=0A= grep from immediately causing the slot type hang again.=0A= =0A= > Do a:=0A= > # nfsstat -m=0A= > on the clients and look for "hard".=0A= >=0A= > Next, is there anything logged on the console for the 13.1 client(s)?=0A= > (13.1 has some diagnostics for things like a server replying with the=0A= > wrong session slot#.)=0A= >=0A= =0A= The one thing we have seen logged are messages along the lines of:=0A= kernel: newnfs: server 'mail' error: fileid changed. fsid 4240eca6003a052a:= 0: expected fileid 0x22, got 0x2. (BROKEN NFS SERVER OR MIDDLEWARE)=0A= =0A= > Also, maybe I'm old fashioned, but I find "ps axHl" useful, since it show= s=0A= > where all the processes are sleeping.=0A= > And "procstat -kk" covers all of the locks.=0A= >=0A= =0A= I don't know if it is a matter of being old fashioned as much as one=0A= of taste. :) In future dumps, I can provide both ps axHl and procstat -kk.= =0A= =0A= > > Below are procstat kstack $PID invocations showing where the processes= =0A= > > have hung. In the nfsv4_sequencelookup it seems hung waiting for=0A= > > nfsess_slots to have an available slot. In the second nfs_lock case,=0A= > > it seems the processes are stuck waiting on vnode locks.=0A= > >=0A= > > These issues seem to appear seemingly at random, but also if=0A= > > operations that open a lot of files or create a lot of file locks are= =0A= > > used. An example that can often provoke a hang is performing a=0A= > > recursive grep through a large file hierarchy like the FreeBSD=0A= > > codebase.=0A= > >=0A= > > The NFS code is large and complicated so any advice is appriciated!=0A= > Yea. I'm the author and I don't know exactly what it all does;-)\=0A= >=0A= > > Cordially,=0A= > > Andreas Kempe=0A= > >=0A= >=0A= > [...]=0A= >=0A= > Not very useful unless you have all the processes and their locks to try = and figure out what is holding=0A= > the vnode locks.=0A= >=0A= =0A= Yes, I sent this mostly in the hope that it might be something that=0A= someone has seen before. I understand that more verbose information is=0A= needed to track down the lock contention.=0A= =0A= I'll switch our machines back to using hard mounts and try to get as=0A= much diagnostic information as possible when the next lockup happens.=0A= =0A= Do you have any good suggestions for tracking down the issue? I've=0A= been contemplating enabling WITNESS or building with debug information=0A= to be able to hook in the kernel debugger.=0A= =0A= Thank you very much for your reply!=0A= Cordially,=0A= Andreas Kempe=0A= =0A= > rick=0A= >=0A= >=0A= =0A= From nobody Sat May 28 21:27:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5DA001B59165 for ; Sat, 28 May 2022 21:27:54 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2086.outbound.protection.outlook.com [40.107.115.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L9ZX91nsYz4v02; Sat, 28 May 2022 21:27:53 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=k4crpnfYm8Cj3ZS0uj1IFNhe/q+PteAie/M2RcV4XScGFgcKoxr4OdunrjWB2PdFy9/NVrC1tgwcFfjWLPi3x99A08waHF3inyGW3Bvuq+N6Xn1q10jDxEOhM4mqa4Fid1k/NNXlyNPOQ9IGR/uytc0rj1jLJnRkZx90sksDgMCgxKzdRyRCKDz8QkpyrNw7caMP8gINM3P8UO6MbbEm286bcxXtjuF2GOmqDwuoPIIQsUcAol8fgYEMnPa+L6LSA7aHe8JqCTMJtXsDM/5JEveyWpzIPyX01JlnieSGXPcZBqNq34rD8aTUBm1Kl7r5cKXypwA4ws6QfyXrDnfmRw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=N9RyI4pmGN8g22PgxeLh9ZZkP7thzvni7h/Tc2VfmCs=; b=WJPS/AULKCN/6cS9c1xxxQh7dM/WV9eG5TCyDscfYHf3DWQdT2GSzZpjLn8fmRVqywcIvc/KYkmRXrT93Ib51C3+yzxNn2JdVS8W4ftLxaLNMofFZPbOAdQpKLuKdbBzRhNJ0fjcZaxS2A4N7UxrZydw9tsMc4wf7DssDAR3tSU7p+RgwCQv3WUhl/0uGSdF+AixHQRMSCNSkhhroXXvdmNtPfBI5r7EEDIWEpzXpt59lg1adF3BOvtDw9ZL3eBBCfz9uu0SdpzxhLRydBIShsXpfn3hNr+AHJIj4XBROuplGt6GAGryGV3OpxhcvVNiEdm/986wML5Lbj3dS8/eNQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=N9RyI4pmGN8g22PgxeLh9ZZkP7thzvni7h/Tc2VfmCs=; b=FEEK/02aoNv84JXNDRPx4XglT/GDD6zwFSUwPPE7GY/dJ6bxo3cKV9dmnl3JM30dzixAjWpCgjpDLfy8mVv3s1dlOuGAAoco7bT6Bz/ctCWhjXyDBUmKcctZtLxlMvAk51OiMaKXhHM4T4wDfExGc7OM4FVnMpZHmksUULNxghsZLUqKee1CuVM20570QhTlPbACABIGIMZ836V0gieJJDtUkTmXhfx7dX8a08221BMid7/kqsLmYPsF2agjfCWY8UproPvTninqpcvv/pV3W42SQC078C1HMxe8TSEZTX7nZ2jooAN4aK/FORf6Orw7qs6XmxEDk1rjxhoy4cMfhg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT3PR01MB9234.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:a1::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Sat, 28 May 2022 21:27:45 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.018; Sat, 28 May 2022 21:27:45 +0000 From: Rick Macklem To: Kurt Jaeger CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgADCMYCAAHUPJ4AAZZKm Date: Sat, 28 May 2022 21:27:45 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: b99ddb7d-0138-36c0-0657-44ebb50525ff x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 501529be-0af2-4ebd-7b75-08da40f0e808 x-ms-traffictypediagnostic: YT3PR01MB9234:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: oSBmXG3UEAlv0GNcfAyN0lPURkoTjWi8TsPMkbXQkBJYyit0YHhwtpvr6SH/sY4o7L7dHR9nALCS7XQjSXkWba3efS7lDvVqeaXvD2zKx120Xdnv2g5OgzZCJFcD1PGscnx9dXhseYyCwv3GBUwD5aIbaejiJIBAxw5FYHhZZ2TsRFv6XdE7Y+u5e71UPfjzJ2nP9xm8CdJVq1TnBJFpITj2+gG9OOWV+D2kFbmuBHAD/Hj2TKRM4aetBdyfMzEHlPkOIMC9At8KDVS4ZZ1hD8Px/V07sW4xW60brDkJM7zlWpkpq8rY/st7kI1t9hYA5ZkMDZxRNhAGjfbRqE90Tc8U3SdTzGHM5WZGYNZmUAZFBlYlAwuLlJxdU/L7jnF41D7sGYfkgtIww5ctpyTbhn/dRncciCu/VNEMPQWhEtDeQAxGApSVM3odKExtQHq8mpj2q3TvYyz/R11lWD6F5y7lTWEAIFIZJpHPo3qsW6UAq+c2fLH/lmXDGWjjqOb6hyP66YIpkHy+f1A3gMijsb15Fi0IRigVRh9Ny5owlfcrJO+btFoU0InmlfpebsHEPQAg36FoNMMpkpz3av/AhvV0JSeCXXH4mppkiNiX704lJDdF0L0GCGWqTmv1oTD7H4iMScueFH9ENItLRgsNsJbj/nyD+waxeYSE8hK/XFCoVgaAnQNsQfe4L/iGQh4EoSGBAGrYoqYBlUNLW9rToUoG1O6PGju0oIzvMEpyREjqPuev9DRVywx9rPZdYDiBUh/wv4iu6mxVrzF/bXUrgPW0BgK5fOQW6UsDqzLeHo4= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(508600001)(66946007)(966005)(64756008)(55016003)(76116006)(7696005)(6506007)(91956017)(4326008)(66476007)(52536014)(66446008)(9686003)(86362001)(2940100002)(186003)(5660300002)(450100002)(83380400001)(8936002)(2906002)(8676002)(71200400001)(6916009)(33656002)(38100700002)(122000001)(786003)(38070700005)(316002)(66556008);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?Yi/57pXOCNmYuMwpcIniR6aAtFsA7+egGTOJlG6y77SF3cKljpZtH5aTDa?= =?iso-8859-1?Q?xxTVcFaQQ3jxDMGk5Y+GziB2XkjiSetFF7KP/gtonSObntpA8N9ScI/UiI?= =?iso-8859-1?Q?qF9fbdqBfDo+lWZrwaPnhKsqkKt7YOjsz6L0GvlsndZ9x5KyAvEr/RVShN?= =?iso-8859-1?Q?1BznFvwHu1rZNHAzvkKUow8zPVxx5r8+2l/BHK5jZnYSUnVnMk310SqjFV?= =?iso-8859-1?Q?RSDVYw3lcSZd/k4cRTAJU3l4KpGUWBbUL7Mf/nR5kzUXQ1aqkVpKQD2w//?= =?iso-8859-1?Q?fl5NdvatWdp2AM8tuQ3qkx2HiJMqMpqV7OE6bhuNkhgk51oAGhJMRKj4E8?= =?iso-8859-1?Q?xbP2d5A9W7H2tCg93kiLRcQ/JOo2Qjqnqk9r2jYekO/kKAuuwDlVoCstz6?= =?iso-8859-1?Q?aYbZb5mO1dOHdU6mgqoT0M7JyWFj4llt++wtxKL+jVJFqPplBDE7D99Sm/?= =?iso-8859-1?Q?msfEZF5EnsrYG4ERvnGXJ7lFHi7k96JECaBr9CKKUe0ayFXkoauzPwfO4z?= =?iso-8859-1?Q?PiE3ddUDUA4M5MIxqLAx3e5rZ8gE0UvIZlrYyulOU89z6UnFmKmZEI/xrW?= =?iso-8859-1?Q?wV9MrMZrxBipb7aj/5wvwcS7ZBtCYWjl/F8ZbePwiNoSYKZQPwOMv3q2kt?= =?iso-8859-1?Q?g+qrkgWNVIfjkK7FVkOkgDNnQjVxTjn5V7d5L7pCEWZaCIZeMw5N+Xh3Px?= =?iso-8859-1?Q?/nxzGoXBrEb9t9PvbJ6SEHnjEAlZ/iU+8zHLETs7Qb6es+xDPfj3rZ+Xm4?= =?iso-8859-1?Q?FLCxcq+xC5HIkZR/giaBZ58c+zGC7zyxoxHcRh775JA6RCkve1h7HFpJsB?= =?iso-8859-1?Q?rW8T7sHwOlWN6XHxD6oXdccxYwLVmuY8RI/ceMCBsCT4M1VA4Pre33T/wH?= =?iso-8859-1?Q?0PmbvwztxdJ3MyMvz/ITn2wAiBSNj61FpmQ6k/5mEBRrRQkscMKd6+jEj6?= =?iso-8859-1?Q?4Zi2eKBnWitC3gURwcK6NluFwBQJrAhBsfiJ2GbwTb3+J1pF0ibQ6sCaNl?= =?iso-8859-1?Q?Igrw+4OdOYG0VzCPpRd53Fe6ymqKF5SaQIC9GqbAwAUWT+ivC8Xh+9XcCX?= =?iso-8859-1?Q?9ixJFDD/8k32YKhb4HDIEBSYYH+qV8aw4TyptuyfT+OsMuC/jJJrBTFvAD?= =?iso-8859-1?Q?+gukq2cq6dawOQ2qceTNQiQUuN7Q5B+XuLVzmkrEWQ9116EvY9OWDxSilL?= =?iso-8859-1?Q?w+6AHtky6y9Bhtmfiel8Uy9ZTd8ZC3aahzKonSmxyHRgceTMsuOVc/CTUt?= =?iso-8859-1?Q?UY7esMbd72Bqw6MCCTrcuIePq/fDSrzI8bcIYJgpm8+7DKdrtaDa4XakEp?= =?iso-8859-1?Q?C6c13Lf86RxpTXHFKe0OprRtuMgZikYjaVgbrbogZ2LomYt+MBO3qm0B83?= =?iso-8859-1?Q?xd0qk6+QToAq5uOMZTAu9nC9kJmGJrWdC7Sq/yS2f6e6QZmfJJzv9yKqtU?= =?iso-8859-1?Q?owNECJ/uBi73ay/tHrtxbKIpwEkYfqeIyaqCQhK5C8/y1ZKHsMnEM8bRTj?= =?iso-8859-1?Q?CHqIkgdaltAr8B2wY5xF7XE45L7g7it/j6BVg1I+dLnvZk5tZyJvK1ORwF?= =?iso-8859-1?Q?TFq8fbIo/Fa668jHD4VP0BcdkMpGMEI4fYAodp9D39ohJDNgm/3F4y0CfY?= =?iso-8859-1?Q?LLZoN5IpIRvmHGxadO8eh6efN0uu72I+7Fg8t7IF1zeawlbCjOchSAkWND?= =?iso-8859-1?Q?Rv3SYSN971lTTZo8DVcFIklRQ3HqXFjnxR/2U6D9SEJnP0WdlF+dqMO6I9?= =?iso-8859-1?Q?uu2LQCJIX7FSpnK+vPEkL/lOIkdGD3f5uuXsYcNw08ZaILMzXmCfCX6Z8O?= =?iso-8859-1?Q?5JVQ4WxLTFiuol5WdJZIxO1+Gg/oG8NSryHPNWe5QPgG+EJRRhe3WP/Zuq?= =?iso-8859-1?Q?cf?= x-ms-exchange-antispam-messagedata-1: 8j3dpJDqv4dzRQ== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 501529be-0af2-4ebd-7b75-08da40f0e808 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 May 2022 21:27:45.5232 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: CpA2F/jKJMcQQdI/YdMXkul9U5Qq0S9v2aAMs4Zekx7a+Oo9a6vG5Y6hu5BIADPqNou9DqorBTy96Z+YQOOjaw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB9234 X-Rspamd-Queue-Id: 4L9ZX91nsYz4v02 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b="FEEK/02a"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.86 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.86:from]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.86:from] X-ThisMailContainsUnwantedMimeParts: N Rick Macklem wrote:=0A= > Kurt Jaeger wrote:=0A= > > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1=0A= > >=0A= > > I have it with an 13.0p7 client against an 13.1 server with=0A= > > a hanging soft-mount (I tried unmount to change it to a hard mount).=0A= > >=0A= > > 61585 93- D+ 0:00.00 umount /office/serv=0A= > > 61635 133 D 0:00.00 umount -f /office/serv=0A= > > 7784 138 D 0:00.00 umount -N /office/serv=0A= > The first umount must be "-N". Once you've hung a non "-N" umount,=0A= > rebooting is the only option.=0A= > (I have thought of doing a "umount -N -A" (for all NFS mounts), which=0A= > would allow it to kill off all NFS activity without even finding the path= name=0A= > for the mountpoint, but I have not done so.)=0A= I take this back. I just did a fairly trivial test of this and it worked.= =0A= Looking at the "ps" output, I don't think your case is a "NFS protocol hang= ".=0A= When I look at the "ps" output, there are no threads waiting on NFS RPCs to= complete.=0A= (umount -N kills off outstanding RPCs, so the VFS/VOP ops can complete with= error, which should=0A= dismount a hang caused by an unresponsive NFS server or similar.)=0A= =0A= The only threads sleeping in the nfs code are waiting for an NFS vnode lock= .=0A= I suspect that some process/thread is hung for something non-NFS while hold= ing a lock=0A= on a NFS vnode. "umount -N" won't know how to unhang this process/thread.= =0A= Just a hunch, but I'd suspect one of the threads sleeping on "vmopar", alth= ough I'm=0A= not a vm guy.=0A= What I don't know how to do is figure out what thread(s) are holding vnode = locks?=0A= =0A= This also implies that switching from soft->hard won't fix the problem.=0A= =0A= It would be nice if "umount -N" could handle this case. I'll look at the VF= S code and=0A= maybe talk to kib@ to see if there is a way to mark all NFS vnodes "dead" s= o that=0A= vn_lock() will either return an error or a locked bit VI_DOOMED vnode (if L= K_RETRY is=0A= specified).=0A= =0A= In summary, I don't think your hang is anything like Andreas's, rick=0A= =0A= > and procstat:=0A= >=0A= > # procstat -kk 7784=0A= > PID TID COMM TDNAME KSTACK=0A= > 7784 107226 umount - mi_switch+0xc1 sleepl= k+0xec lockmgr_xlock_hard+0x345 _vn_lock+0x48 vget_finish+0x21 cache_lookup= +0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 kern_unmount+0x164 am= d64_syscall+0x10c fast_syscall_common+0xf8=0A= > # procstat -kk 61635=0A= > PID TID COMM TDNAME KSTACK=0A= > 61635 775458 umount - mi_switch+0xc1 sleep= lk+0xec lockmgr_slock_hard+0x382 _vn_lock+0x48 vget_finish+0x21 cache_looku= p+0x299 vfs_cache_lookup+0x7b lookup+0x68c namei+0x487 sys_statfs+0xc3 amd6= 4_syscall+0x10c fast_syscall_common+0xf8=0A= > # procstat -kk 61585=0A= > PID TID COMM TDNAME KSTACK=0A= > 61585 516164 umount - mi_switch+0xc1 sleep= lk+0xec lockmgr_xlock_hard+0x345 nfs_lock+0x2c vop_sigdefer+0x2b _vn_lock+0= x48 vflush+0x151 nfs_unmount+0xc3 vfs_unmount_sigdefer+0x2e dounmount+0x437= kern_unmount+0x332 amd64_syscall+0x10c fast_syscall_common+0xf8=0A= These just show that they are waiting for NFS vnodes. In the "ps" there are= =0A= threads waiting on zfs vnodes as well.=0A= =0A= > ps-axHl can be found at=0A= >=0A= > https://people.freebsd.org/~pi/logs/ps-axHl.txt=0A= I suspect your problem might be related to wired pages. Note that=0A= several threads are sleeping on "vmopar". I'm no vm guy, but I=0A= think that might mean too many pages have become wired.=0A= =0A= rick=0A= =0A= > > systems hanging when using a CentOS 7 server.=0A= > First, make sure you are using hard mounts. "soft" or "intr" mounts won't= =0A= > work and will mess up the session sooner or later. (A messed up session c= ould=0A= > result in no free slots on the session and that will wedge threads in=0A= > nfsv4_sequencelookup() as you describe.=0A= > (This is briefly described in the BUGS section of "man mount_nfs".)=0A= >=0A= > Do a:=0A= > # nfsstat -m=0A= > on the clients and look for "hard".=0A= =0A= No output at all for that 8-(=0A= =0A= --=0A= pi@FreeBSD.org +49 171 3101372 Now what ?=0A= =0A= =0A= From nobody Sun May 29 19:27:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AA4BC1B64EBE for ; Sun, 29 May 2022 19:28:02 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LB7qP6vK3z4nMZ for ; Sun, 29 May 2022 19:28:01 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from pi by fc.opsec.eu with local (Exim 4.95 (FreeBSD)) (envelope-from ) id 1nvOZt-000Aob-VB; Sun, 29 May 2022 21:27:53 +0200 Date: Sun, 29 May 2022 21:27:53 +0200 From: Kurt Jaeger To: Rick Macklem Cc: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4LB7qP6vK3z4nMZ X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 2001:14f8:200:4::4 is neither permitted nor denied by domain of pi@freebsd.org) smtp.mailfrom=pi@freebsd.org X-Spamd-Result: default: False [1.72 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[pi]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.51)[0.508]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all]; NEURAL_SPAM_MEDIUM(0.31)[0.310]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(1.00)[0.999]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Hi! > > Kurt Jaeger wrote: > > > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1 > > > I have it with an 13.0p7 client against an 13.1 server with > > > a hanging soft-mount (I tried unmount to change it to a hard mount). [...] > I take this back. I just did a fairly trivial test of this and it worked. > Looking at the "ps" output, I don't think your case is a "NFS protocol hang". Today I upgraded the client to 13.1, and changed the nfs mount from soft to hard,intr. nfsstat -M now show this: # nfsstat -m :/serv on /office/serv nfsv3,tcp,resvport,nconnect=1,hard,intr,cto,lockd,sec=sys,acdirmin=3,acdirmax=60,acregmin=5,acregmax=60,nametimeo=60,negnametimeo=60,rsize=65536,wsize=65536,readdirsize=65536,readahead=1,wcommitsize=16777216,timeout=120,retrans=2 We use RCS for single files, quite a lot. Sometimes the co -l or the ci -u would not return and hang as well. We still have rpc.lockd and rpc.statd running on the server, are they still used or not ? What happens. We also use vi to edit files, and in the past they reliably showed us when someone on nfsclient A had a file in vi and someone on nfsclient B tried to edit the same file. Let's see if the problems re-occurs with hard mounts. I'll investigate how to move to nfsv4 with a test box as well, if this helps ? > I suspect that some process/thread is hung for something non-NFS > while holding a lock on a NFS vnode. "umount -N" won't know how > to unhang this process/thread. > Just a hunch, but I'd suspect one of the threads sleeping on > "vmopar", although I'm not a vm guy. > What I don't know how to do is figure out what thread(s) are > holding vnode locks? Given that simple NFS mounts and editing with vi on nfs mounts should be very basic use-cases, it's time to find ways to debug this 8-( > This also implies that switching from soft->hard won't fix the problem. Thanks for the encouragement 8-} > In summary, I don't think your hang is anything like Andreas's, rick I'll report as soon as I have a another hang. -- pi@FreeBSD.org +49 171 3101372 Now what ? From nobody Sun May 29 21:00:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A77621B45FF3 for ; Sun, 29 May 2022 21:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LB9sn1ZV9z3Cq7 for ; Sun, 29 May 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id CC0521CED for ; Sun, 29 May 2022 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24TL0CVW098656 for ; Sun, 29 May 2022 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24TL0ClR098655 for fs@FreeBSD.org; Sun, 29 May 2022 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202205292100.24TL0ClR098655@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 29 May 2022 21:00:12 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="165385801210.dF16.97661" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653858013; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NCRHsWjnn/+OPtLWHngpD9qFRPvtvWV+7v3B2d2eK8Q=; b=p0GsP/TJ9jZIriYNCDe3EA9DY9nOQgstVxrIueXTM7bxToGv+S2xsEp7L9C7M00P5CSFHR 9zOgY6fInfXB9Xp7yqULUDu//+toj5ojHYAsNOBV55lkjLTwOdNRaxb+BW02ytYXeiim7H hJUBD/pPeADLbLRIh8447+KrySRw2jzFGe1gjoA+Ljh46da7YmYaYnJyiyo/zyn/Eokij5 e4ctMxQYvsOSS4zio0WXmVpwoa5a4WnO9iL0TDi5iJlvUd4zF8g8KaAlxaDDv7aEhwAu89 0AhXXYtxlbqXX8U+Gj9fgWg//TAvK5q+qlXx5z3n44Dulk2lcUVLi8Z4Y4qEFQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653858013; a=rsa-sha256; cv=none; b=a1aKmvPgPvk3Qr5VnJ9tBTVd3zCxPT/FLF/G/Ub96nUKDXwlq4lQ3dhLVFEnTlVUVtKHHX SmR4R7kiF/p6UGLkxVxKeF4qkJWCgCywZh4BL2WpHTVosEOfV2gtYtdLdPM4yXomuuLN8i iCJiLbQERxBMrBDqLCGc6ZhW2Vf/wLhuwNX9cPbS0hZdf1D/CNzB11A4urWw7zUW5BuxOC rRJPIpsrM5vHNuvPjcd4dmm0lcvkkeA2sKfrfkyhkvFtLyOrCbDNInszQfe8ooF429KuLC rG83gMIKICnro2g21s6bS6knD83BmOOZa0VbR1e0BWtjtqTPo+jt1ZtKABjzdg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --165385801210.dF16.97661 Date: Sun, 29 May 2022 21:00:12 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --165385801210.dF16.97661 Date: Sun, 29 May 2022 21:00:12 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--165385801210.dF16.97661-- From nobody Mon May 30 01:56:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B22171B505A5 for ; Mon, 30 May 2022 01:56:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LBJSC3f4Qz4pVL for ; Mon, 30 May 2022 01:56:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5A2C0654F for ; Mon, 30 May 2022 01:56:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24U1uxKg060540 for ; Mon, 30 May 2022 01:56:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24U1uxwl060539 for fs@FreeBSD.org; Mon, 30 May 2022 01:56:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264090] gpart bootcode safety checks Date: Mon, 30 May 2022 01:56:58 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: imp@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653875819; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aWy5YOL3h+fmqansWWH8mfi0LG40rJUvg0Y+YWfb2vI=; b=duRSnBqffQiE+mEfNQavrUn90DkK3m1gqGaO7A80D51Uc5Ke3Ax5YQo9APW8ChSPyaFfJ2 ZZGLshb91JxBoqJtiO+93AZsvQ1WCGcoZ3J1m96uoU8ndJFBNWkJG0opQUFXqBRTikJWCt X4yrr0vntjTi3WSV6xSBzjyCULtC9cenBm/RqU/a9sQfly+qn9xDW1lkEkfbplKqXJDG7p FOhozcYGBfMq4Tg26MFlFYxv3R3iPgOO1a4n53NtShoHPeiyDoqNgCy5Ps1zN650MvoqEG UKnM0YJPiYB9Au5VyYVeahNOn0d/3ZG2uEnItKzO6degIIckZEAB00xMxGG5lQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653875819; a=rsa-sha256; cv=none; b=qRUaMdouimB2esba7/bmfYf/KjvkWeOhGW0QsPf4cxutiQphQgprSdI93IpvSwILbVFi0B i4npePucF91ApwlytrClMnXx+mDcCT0cf0Gso5SOK9tI4YQuJ4PoQ/2cNTiVc14kpczk6g Dm61I/AucoO1kum6QPCN3SHuMa858hTnuAMeYQ0VZPblS4T8IFK64uxFvlU0b7HRMl7iDa FP78bhmrXeWER9uQ8/6g/6iZXaEOUx1NqtgfxZh09VE6bV7Tr/y0SYDRoYTpFNaSM7iaDh SaUhyQH876kbEn0TFvDWZMAquW15b+Xf0BxdR8svbV5a/zMspcTmdXO3LlLM3A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264090 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |delphij@FreeBSD.org --- Comment #5 from Xin LI --- I have been bite by a similar issue today. Basically gpart bootcode happily wrote loader.efi (a PE binary) to the EFI partition as instructed. PEBKAC,= I know, but we could do better by performing some basic checks like the image written to EFI partion should be a FAT image, the freebsd-boot image should= be greater than certain size and do not contain PE header or a FAT image, etc. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon May 30 03:07:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3141B1B5C220 for ; Mon, 30 May 2022 03:08:09 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2066.outbound.protection.outlook.com [40.107.66.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LBL2H46R5z4vjq; Mon, 30 May 2022 03:08:07 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lhysXhYT3LuHpFf3z25Zw5ZSjWvxk4AZ734GgdXgHSW5F/JmrFcmNeoB4aWpunxm+ZxIPH6mbjZxP86n/4oK/yCCJSwxNBCuC+YgtEtur8RYtDqIFtP5RHEsphrnI2p+/WjdzKNc2/xTphVVbFXoCN8wAACFD71FcZzZZz2PyuguOEGa7PneEb8bXGVvL7KSahJhOL3bAOVvQzszgY8yHo1kNeL6KyYuBd7hZs+p2/SEWfTfAtzGeCJnetB97UHI3xymn7Ffuyr2CU9JXUTmptQNVs9Ih+mYiz6HiVtKqquWseDqUnvss6ui9jdRhrA/e/SYWQ7WeMrgx5bi+whlVQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=LpEkLBAfMDTxR4FKGXnG4/pt6nXPCa+ogSPDpW4XFVc=; b=csZ8x2qwDjvpWbpJeqRwlI/PHiQjwhcWgIUf3wnEAPJRJnYAMlqJAQTTKNoXvWIKQOlu0DRzsvXdSIvLZ+zwdjWA8Jgn1HottfgFOnobS3w4gBTIuIVno7N1HIpt2SvIip2tnjNexbabY+xx8ICQ+V9iVh5EFSd8ZAL1alAh98PmdCvaq0sUSl1Ox5gCPpKxwbzfZ5G8hj0yONJLJUEVRIeISORvAzMq230bh+pqff7JgfMJQc/Q1lZdhg5f4AEN0A6PmmCYEkQJQMME/lBBES7XnVZ1OB9sPQAsf0cNx8H9643DVohHMBduSIw5OR9565UksapahqLHEdBphYbHPw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LpEkLBAfMDTxR4FKGXnG4/pt6nXPCa+ogSPDpW4XFVc=; b=a4vXmmV6qMAliEk0/EIM8l60Ytx0Rg5cP6FxwxJOW//vAFDutPSnrprx9c/0BR10AwRzTj3DUjdubvZ/EHq9pRArDJzLpXxdOsuHTN0wctA2sdocEcvPjCZliS8Zmr6S0Dtnqs/jjy5hKT/HORIoJgEcoxLlcxbr9NPB3DUVw5UkjmGpJ96YlIe+KYKuNZgExnl7h/gecHTsLEKNH/clBijXkGd5Ux0j7x1iR4LVq3hsY8gScXl4Y9XsRnH1fyEK7nYENXoTaRPonf2nNRDmNFEg1YoiBiFIyOTla52+7OOPRmVVo4ky/mXxly949hRdq9GNRE2GlwgzOxOuKJLbDw== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YTBPR01MB3039.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:22::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Mon, 30 May 2022 03:08:00 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.019; Mon, 30 May 2022 03:07:59 +0000 From: Rick Macklem To: Kurt Jaeger CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgADCMYCAAHUPJ4AAZZKmgAF0ZoCAAH2M+g== Date: Mon, 30 May 2022 03:07:59 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 1f16b545-96f3-33d4-8dd5-769cc4e28e2b x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 66469f0f-bbfa-40e3-1a19-08da41e99a55 x-ms-traffictypediagnostic: YTBPR01MB3039:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: NwM8F6K50YwLtKEoAIciPIx/oj/FGMiks08nBptWH0LADs3J/c3V/ha8TRcXiqwswzku3UILkSxmg1Jmd2hOQK7VqdW4vGtOeVKCLSe6c+CZf1FH5jZVwN62YOViu78mkSEbFOqzEMcwCIxluWlo0WcmqrL6OWw/mYDBgz6nGAQMsEIPNTosdwvbejPvLOaduSl9HAjkj2SnK+epOg0cIdmr0Jw6SOcf3rGTXUTzU6bfmc5hCJWUgSiI2pB/zpMkQrDJnUPYGhV0QY8hxNTmABEiY5PVC/KDCuo+GufogUWfz77vUTlXNFP5mV75ZPn03gTqqgzcfvAScSKXPPmj6JVxpj6xFCxoPbvIpxoiYkZBt1OVxpBjhyEGK2BwyeyXB0R8kibyLXntdFyZRNxsRImgUM1HTjpKv8RcGXmWYq9aB3DPv2+5y2nqisikwGiQOQwvxgnbvfusga1klH25rZ+uyHnaiTaGdH3I5SbOvjvGM0xqDUHZmKVRkmdV3mGlAkZZkVn8IfQ4iZHXuI4DlcZAJFxcANeaIxQs4wFR98e/A69RUSyEh+A6H5MUYyKcM1dD2s8g9W1jQCHZsB2ADAX9b2pSyuOOnKl8YIyqOMq1OmJZT1vcvT8lSIF8o4v9oL302ALiJchTa29YcTZRsw72t7Spj7KQ2jLjP81Osiw6lbz1EiFvbpxHc596OjivWnPpCKHJHviMKGa27aTqhQ== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(4326008)(8676002)(91956017)(64756008)(66446008)(66556008)(76116006)(66476007)(450100002)(66946007)(8936002)(52536014)(38100700002)(5660300002)(86362001)(186003)(508600001)(33656002)(71200400001)(9686003)(6916009)(786003)(6506007)(7696005)(316002)(2906002)(55016003)(83380400001)(122000001)(38070700005);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?bcdnkW6BshbmwHMvRIFvt41lzs9XPscZy2CxFDs2QlOoZpXHYFgHb8qcOI?= =?iso-8859-1?Q?1wjWWcrAdLLYIzPRI1GTk2A0KddAjUVfflDnzG7m4VAmKXnNnChPZM809j?= =?iso-8859-1?Q?KdvivrpaZUnT9inip84p6mtlasfLhfTCTBSHzMviTqWuhuvMYhAkFgR0D1?= =?iso-8859-1?Q?Sw/8hhGKrU6XqFAZY6WYkdvxOFtiQ6zDQHWff3pbK5cH/Q1LqyD2w3bSyS?= =?iso-8859-1?Q?nQjOgwnzvIkHtbZ+tqbeZ5prQh8cvuQSzReT3UOvnniQ2B9CasAJ+9+NwX?= =?iso-8859-1?Q?mESv2EVzP6UHgeM6pQQR895bPBnLRLmtTZR5v5Sm7AXF7YV54vvEjdG6tI?= =?iso-8859-1?Q?wKj65SGpQyn41EnxhkcvUAiZRy/uot/9o+2I5z40zDodAO7ofnpdJ8G3Jf?= =?iso-8859-1?Q?8NU89LkTiaKbs1jlY4be+8kmjUcguwATQ/KGZ8CNsFeVKOdKgFHq7YAts7?= =?iso-8859-1?Q?ER1SW4+eQZHEN5SbFMVOcRluRYjFSA7lZAaovx22gTozLH5ESD4KW45XF4?= =?iso-8859-1?Q?wO2pxiC2PLnujPX7UoU3uQm2dFvc4LgZb7VE+qC1yP/JZXMjIGePndW9OW?= =?iso-8859-1?Q?zdUwkEMcjAM+ZCkZwWIBfsli3g4sUN+ItSYu9Rti7aTShUvoFfeGoW/cTv?= =?iso-8859-1?Q?DQZg3LxGJeAT7gfH8JSLquqcIIhpCX+dnyiHzVJ+pwGUHt2cFJWtdLxoL9?= =?iso-8859-1?Q?WM9nLyLz59gc71Xma1TT80IEjgJUelU6iy+TElU52/xJn0bym7FWVYuKkq?= =?iso-8859-1?Q?9e/p3sU9uOxUocuZuslGNxWOgC7vmsY/ui94ZuYQFSi357GxAl+ErJJPqh?= =?iso-8859-1?Q?Aybp4M9ZYZV9c07ILbSREfjg20Xyaso0NoQzfg+HOAT1SxaHttJA/su9Jm?= =?iso-8859-1?Q?zB/Mq/HbBye1KLV/dCK6NUzwL5Hh1gs7YOcqZt6rL5m5PY36+7/9ArfpuE?= =?iso-8859-1?Q?/e1jt8B7EvoN34UGkz1SWdCHlBpxb12Xlwznh3f1WG310cxTqicW8Ahqyo?= =?iso-8859-1?Q?zWEjyodXYCupGI0t0H/F8O/607kFklniWtmBMmpWBNZx6wjxI5v0dtUi/j?= =?iso-8859-1?Q?KmoSQxB1Nbmj9yK/VvykcbHYtv9TwCXIEJvm2o6IQBO7K3QvSsL16EUIMq?= =?iso-8859-1?Q?O4Y6uLhv/HdpWyYczJt6VDB0fdDek96R/trgpwo5fudFSFR+x8Y1InhNyS?= =?iso-8859-1?Q?vHfLUaM+2yfzLq15FM4Fd2ayD4VQOnY0pjKqxzqxfilGkAyjkc4gxGgXxK?= =?iso-8859-1?Q?2Hg6/XHLMg0oSzkMeO2XXOzI4HgjpzKuHC5TFfbYJPXLpkTnyoK9Y/0NFE?= =?iso-8859-1?Q?Tck+3TRCBtxntJ48yWAP7+wId+HviimbGIN0CaU5vJEeXIrdWXXfy+/z9c?= =?iso-8859-1?Q?fCRPPLfyuCY0EWYhYh24FZCM12RxLrUNzCm0HqulYsQvyuS2WnzY2gombf?= =?iso-8859-1?Q?9XP6VyxnYauyMWytBzs2khZzXGPNnC2GySpVPbKlGvO80FTZhK9q7ZLfVW?= =?iso-8859-1?Q?nDyYZOOX8X/mBgJjwo8imVeOsZi5yV4wgTDnIDv6Q4YgJVVWvzV5LnTgLw?= =?iso-8859-1?Q?8qqsaoOKDpLiqqGakAgkevqmZ4tTooSql9mzJ2uoyMqm0j9rVJeBkCIKsf?= =?iso-8859-1?Q?bC9zMjvlOsEhlfgGnmTpCrErJqtLIrIdj8zcRufGA/VGZV0Q4PJIOWKFgP?= =?iso-8859-1?Q?88RgczSPXIhXds4/bylV9/Zt7D8NCGzBFCnPvVavBV2EDb52EGZv2yDAeN?= =?iso-8859-1?Q?xuN7Nox6+gs2VW+8h598kVs4wftRSGLCwHlH4BmLQHWIzgsIbsjL8jAnZz?= =?iso-8859-1?Q?2c8rRqeeWS5iqd727K7RZPuj+9hFiVaQpOH1y/OXEl7XL4fp7OkAnq5YXj?= =?iso-8859-1?Q?ii?= x-ms-exchange-antispam-messagedata-1: WeFgzrRP/9GVlw== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 66469f0f-bbfa-40e3-1a19-08da41e99a55 X-MS-Exchange-CrossTenant-originalarrivaltime: 30 May 2022 03:07:59.8488 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: teKWuH6hWXy1kLnaOQKCzN8LCZ8DVOAfft8nuRFiZw6b0ZinPUSCFia1T0eTTTl++iUknIvMStNG/E8vWA8bpw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTBPR01MB3039 X-Rspamd-Queue-Id: 4LBL2H46R5z4vjq X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=a4vXmmV6; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.66 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.62 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.38)[0.378]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.66:from]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.66:from] X-ThisMailContainsUnwantedMimeParts: N Kurt Jaeger wrote:=0A= >=0A= > Hi!=0A= >=0A= > > > Kurt Jaeger wrote:=0A= > > > > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1= =0A= =0A= > > > > I have it with an 13.0p7 client against an 13.1 server with=0A= > > > > a hanging soft-mount (I tried unmount to change it to a hard mount)= .=0A= [...]=0A= > > I take this back. I just did a fairly trivial test of this and it worke= d.=0A= >=0A= > > Looking at the "ps" output, I don't think your case is a "NFS protocol = hang".=0A= >=0A= > Today I upgraded the client to 13.1, and changed the nfs mount=0A= > from soft to hard,intr.=0A= >=0A= > nfsstat -M now show this:=0A= >=0A= > # nfsstat -m=0A= > :/serv on /office/serv=0A= >nfsv3,tcp,resvport,nconnect=3D1,hard,intr,cto,lockd,sec=3Dsys,acdirmin=3D3= ,acdirmax=3D60,acregmin=3D5,acregmax=3D60,nametimeo=3D60,negnametimeo=3D60,= rsize=3D65536,wsize=3D65536,readdirsize=3D65536,readahead=3D1,wcommitsize= =3D16777216,timeout=3D120,retrans=3D2=0A= >=0A= Since you are using NFSv3 mounts, the comments w.r.t. hard vs soft are=0A= not relevant.=0A= =0A= > > We use RCS for single files, quite a lot. Sometimes the co -l or the=0A= > > ci -u would not return and hang as well.=0A= >=0A= > We still have rpc.lockd and rpc.statd running on the server,=0A= > are they still used or not ? What happens.=0A= Since you are using NFSv3, if you want the locks to be visible across=0A= multiple clients then, yes, you need to run these.=0A= Alternately, you can use the "nolockd" mount option, which avoids=0A= using rpc.lockd and creates file locks visible within the client only.=0A= (NFSv4 does not use rpc.lockd, rpc.statd.)=0A= =0A= > We also use vi to edit files, and in the past they reliably showed=0A= > us when someone on nfsclient A had a file in vi and someone on=0A= > nfsclient B tried to edit the same file.=0A= > =0A= > Let's see if the problems re-occurs with hard mounts.=0A= It probably will, since you are using NFSv3 and, as I said, the hang you=0A= posted "ps" output for was not even an NFS problem.=0A= --> It appears to be a VM problem.=0A= =0A= > I'll investigate how to move to nfsv4 with a test box as well, if=0A= > this helps ?=0A= Again, I do not think this is an NFS problem, so switching to NFSv4=0A= will not resolve this.=0A= =0A= > > I suspect that some process/thread is hung for something non-NFS=0A= > > while holding a lock on a NFS vnode. "umount -N" won't know how=0A= > > to unhang this process/thread.=0A= > =0A= > > Just a hunch, but I'd suspect one of the threads sleeping on=0A= > > "vmopar", although I'm not a vm guy.=0A= > > What I don't know how to do is figure out what thread(s) are=0A= > > holding vnode locks?=0A= >=0A= > Given that simple NFS mounts and editing with vi on nfs mounts should=0A= > be very basic use-cases, it's time to find ways to debug this 8-(=0A= Look for a VM problem...=0A= =0A= > This also implies that switching from soft->hard won't fix the problem.= =0A= >=0A= > Thanks for the encouragement 8-}=0A= >=0A= > > In summary, I don't think your hang is anything like Andreas's, rick=0A= >=0A= > I'll report as soon as I have a another hang.=0A= I suggest you report this to a mailing list where the VM guys hang=0A= out, with a subject line like "processes hung sleeping on vmopar".=0A= Don't even mention NFS in the subject line. Reporting it here with=0A= NFS in the subject line won't get it seem by the VM people.=0A= (I could be wrong w.r.t. it being a VM problem, but I am pretty=0A= sure it is not an NFS problem. It just happens to result in NFS=0A= vnode being locked, which results in the hangs you observe.)=0A= =0A= rick=0A= =0A= --=0A= pi@FreeBSD.org +49 171 3101372 Now what ?=0A= =0A= From nobody Mon May 30 04:31:10 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3FCE11B69718 for ; Mon, 30 May 2022 04:31:19 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2086.outbound.protection.outlook.com [40.107.115.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LBMtG1k26z3Km9; Mon, 30 May 2022 04:31:18 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kCsP8ky8UfCtfFJ6rE8wInZb7/RA0eOJiacKc4dMWhojJ0Mq1+SAp8etkcnB/2fjjfD+5mf6tjrz/18pmU2H9bg9xZtBROFa5KNkzmqsed2Lcd3VIx9tZNb4iD4Ny6Np4JdpYoC574jD+aTWk4s3LG0cxw1TeDeqzrmTXxfz6yOMwGM0yO/gFEOzCXTlMH5lAF/kSZhu2cfmiaVW4lJCfgVe1D7jO/mEH1Tx7Gh67V7QeqmCH8YiT7ejyFZxugJDhr0pbfkuCUOiDVYe4uwX0lTGAjarJa1jbC9rotC9dAwJYwrV9z5Et9ziPJByMVJTe75QrNBO3+s4TCgvLf2y7Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=MfEEWOeqKfzfil8X+5whvJHd+ZMRmw5/vGTL7IUr+ME=; b=KIxjWf5RiBGP/+6YkgKLjIZFiHBs7xs3kCFc8qyZo+v+GyrCNx+hS5ad4wZBiqOfDfxUOFNgyb4GmDm3jWoliJdq3aOmqMxL9wyVGo6sTlQ73z2MfBvpoVSp3qAvNxnRhIaRoTX0D8zuXyzgazqDjJaOBwA4ykS7PIaCLa3bs4d4RI26x/3jTNTRV/oGarjzME/paxPb8ZBPPjeDGU7Me58WtDxHafwLVjMlNJ0Rkbwww+yfDX6hFAC+ITvmPOsSzQTA4mcFEYpXqSeXT18ewUkzIenIsSMgCEhgdpv/9N5oiLctnIlLfT1FAMhx5SrdmGfmczxxJopNxQWpIbE4uw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MfEEWOeqKfzfil8X+5whvJHd+ZMRmw5/vGTL7IUr+ME=; b=Vt7jyf+c6viOaA/EvoWwKwRBHYletp0GJTCGhldYV2je+AqqtdWYkr90+kOWM1k5KBolOejoIEaAE67GcUR+4VqVuFHmjTkcimEbyPBK63PpJ6w5zQ3WkgOP9RIYcUz3nTYRs+Yw7tGzEdqE7ilrEBAiI8EEJT7DBcyCk8CcpnddMdGbnMSPHchHGR10zGH4pgh9uNY9WqKdR562PkI7VkVj6YzuzSWLHa9yq3lLzFI3+QYRXebfnYmkf5ENFACwBjfqVcTlPqDphcYWgH/p89IlkDLKFhbc9dVDF9DQwMCe8XTbW8JTA2ZkBTHmgBkYu82ORLtHZs0NMuG+DjzEeA== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YTBPR01MB2543.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:21::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Mon, 30 May 2022 04:31:10 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.019; Mon, 30 May 2022 04:31:10 +0000 From: Rick Macklem To: Kurt Jaeger CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgADCMYCAAHUPJ4AAZZKmgAF0ZoCAAJTuzg== Date: Mon, 30 May 2022 04:31:10 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: f0611781-1866-a83d-c66b-91a66c0b5f95 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 26043dcc-5334-45af-ef28-08da41f53907 x-ms-traffictypediagnostic: YTBPR01MB2543:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: TIvkIYocSJ8sVFi+63sNbJQJtiNIVeH8EB+9BuPCuIzOOoeOu73fOBq6FnI8UNzRTNuCNBkoUuhL6hSrpCq2OP8zaMuQ6+9V952YlbHurqE8cZi2NXQdhxnI94BfolznNf0iRb+cAFVCbSTpz6fTSApt3fT14HqH3E7m3WNiQRFQTLAs87OFDfwWMYp4yJ4edy2zB8nAmBlzDekbdS9hiK3pbYwTqG2hNRSLwJayenth3y+nPwlrffgXx7NdK/Mbqj33+3KiOfYuBK/YhWLneKJ0DTe4XKEiDQzLGZ0f/TK43L91w4VSTy7y/kTuuuXGadhaK/2YaCr5mIfDVW6YGUjv8nbWmlxA6nzSNlH9hnEjIChLiGVttY2cGYkrhauHcqdWIh5GCJB9M125vu7qFuhLNwa0JHuSPQDT3X8A1mT8a0wUnepC9gPUKocgB1nvkFmXi4fDPEPQnnHzYeiLnAkUQJx1DebyJPJjQTc8jcuvoNM0s0f5WiNuXCy7i0e62L1B9r19SwclndHqL7Lmfh15AGYz/KCCLuVPiwl3CduzzHf5XnK9YqHoE2DCk/VkkQotmBo9aoN+q5YWuCqVvYNaAoh+N78Yrx/nd/IveINLXs19ykIzuvRjhUjBE9OuMePW2RnCoQjGYYrlWRhhhPVRoFwla4ZGPjC8o/NB8B2s4pcDIdb4axWpwGBQtzSI6Y6TI8VCfqgY90i/XL0J8g== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(186003)(5660300002)(508600001)(55016003)(52536014)(86362001)(83380400001)(66446008)(76116006)(4326008)(66946007)(38100700002)(8676002)(6506007)(9686003)(91956017)(786003)(6916009)(7696005)(66476007)(64756008)(316002)(8936002)(33656002)(2906002)(450100002)(71200400001)(122000001)(38070700005)(66556008);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?LyWxxd0Q1XoWlIna9QZijWuprDIvFfwkNQBow7h4M4RUc4CiBj9j25XyGy?= =?iso-8859-1?Q?32iyszOiIS2LSv/sCwt3dkst7CuMXlrKsvL63QEPk/+4BHgkjhebkYjfYN?= =?iso-8859-1?Q?BLx3Nt0KSalF7XCIzgVllKTSWI4YDyrT2F7k/v7xz0ou6Mf4xEydkRfe7P?= =?iso-8859-1?Q?CbNkVVOVWJ4TS0VZvXjFwD4pGE2egl3lxg7pqXjwwtOkOD4yj+n3WnU0Rp?= =?iso-8859-1?Q?chir++AWgD3E8Qt85KjloPjwKN/ybYrwXkRHEbl63Ze09LBRXXgz85OKpf?= =?iso-8859-1?Q?nS87ZkPF8mhth/n5w0FVMR/39R/QjdEEE5m+R0XYm9uEpYSWZLnauCKAhn?= =?iso-8859-1?Q?ckaAqB8bVWN2hA8uuZlIoelHe9QbUBBMCt8R+lSeIbNR2W+JbfSSSTQLuc?= =?iso-8859-1?Q?haSL7oznYoJ5kQLCdGUvuEEVpsmko8gKsmP9OaihOu574l5pxr4C9Q9ze5?= =?iso-8859-1?Q?p5x+oP4pe+PXRSYdBCv5ydDdnwzP6XKANyA/tQiR/oL7JWcKqyMd31g/oN?= =?iso-8859-1?Q?NdGaGqa2+etSIFKn7k1jtgnwUxBsUFq6JQQjtIKk8/O+baHG0zZGMQcRyZ?= =?iso-8859-1?Q?F/1+Ml795wRq4lmStCXeTfaa3U03b94w9kB66gw4V2OS3nHEhaXE5scMZw?= =?iso-8859-1?Q?gGWs+kzZ0J4BCR8SKSDaNA2S2LNe4JfoBpeK+uB1UI+SVWmsUgT+Efib5+?= =?iso-8859-1?Q?IRpjvuwnVF8R6dsLDP2EYQfExQu2ThWt6njupAN3OLXpw3Vf1kQAQC8rb+?= =?iso-8859-1?Q?jz+IxlxeJE6EWUQtxiut05vbgcSihjbmJt0XBBN+r40NuVvhbWDs8vSQws?= =?iso-8859-1?Q?79W7R1AdL0xIyz/S1tvHoKBcJBTinxA/E1/wCozG4FD3Gu5TgYgZINLfh7?= =?iso-8859-1?Q?CeT5/ANlDHazz4SM6SRQ1Ee8D8TjXRq18hGUySrzSbSOklIXw78dmnIxCp?= =?iso-8859-1?Q?RxQwtnEYVmd0XuWXXLXhr826svPKaNp6LHYahW8jOvK3adZQp7OBzfbJop?= =?iso-8859-1?Q?kgqO0LNVvxIpxljHgZQ1rYn3kHIwfojtvgS/OlWISTvj1fJa8wd69cD3m1?= =?iso-8859-1?Q?JNf1mgOtSqz3sUqb9Ryg7RzS2WCA6uDuG4Kuizj2EvWjDU/ZRL0CiUuDaT?= =?iso-8859-1?Q?GQybKNrsAhxwLziMgbpuLKNjNhwhIRt4zLvjPdiDRcexp2v2OvECcSrUqP?= =?iso-8859-1?Q?kaNg9S/jGKK5qyOwOE8llFa3+GtgUFp2w68afMmOnZfzTJmmhu3p1dyQtE?= =?iso-8859-1?Q?6SP/1Cs8cEZUEJRppYfwJXMCzZZIXf5MW4BGc5QcOSsKBcHNBCqxWsiEZP?= =?iso-8859-1?Q?3kLL2vPfIyQPuKVG+iIN8+u0E4DbQKz5Zgq4LT/+KFNUDUbKDyppz1LZri?= =?iso-8859-1?Q?VkQVXxlHUkkp51EPzG06hJv+OzYtop9c/2E+MEHIKNVG3dasyI2qwHzROl?= =?iso-8859-1?Q?XrmtIXSISGwGhUnf9t0BymIlMuf5gCeTZSqNfIet7l9FGwqkfAGtyQ2fOy?= =?iso-8859-1?Q?wCjOpHTFxhYgjQdMQ9whHR9mcTezGJls8FXklNndSB20XicJNDOzffNiQM?= =?iso-8859-1?Q?RCZt4uMzDdqOhl4azv31bidxzl68FxbuuqeRTPMZ+NAhA5PfTbVdjeZMx+?= =?iso-8859-1?Q?HqjJX02VMHHbOC7jIzzyn2NgJ9mGgE/+42VFlbUeCtaeojcC0kQ/aCUAag?= =?iso-8859-1?Q?WOeenR5h3w4MnxfAnrc69bJAhYF4gGvcAn1tcR+91HYXmEIDl/uZgyHTGq?= =?iso-8859-1?Q?6T7RwuMYc7HXhJP+MK+4jPyf3Dgjvh6pvTfQtBepr8A/60e2HnOG0NzNih?= =?iso-8859-1?Q?q2TZ9zRcQ9aEiG8JXAtHk650FyfCh6jNdr7XaPXvu8HWGF1zMtP6fPiAQ2?= =?iso-8859-1?Q?vl?= x-ms-exchange-antispam-messagedata-1: vK7B+OeUBUqupg== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 26043dcc-5334-45af-ef28-08da41f53907 X-MS-Exchange-CrossTenant-originalarrivaltime: 30 May 2022 04:31:10.5492 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: SQl0CH3hLrmy/lDQjzduSJGDW3m59JqXIjRjaWgXLLJMKZ/8VCIo/xZ6VRPCqdRJDFfIU++TowuvhGFU6rq2sA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTBPR01MB2543 X-Rspamd-Queue-Id: 4LBMtG1k26z3Km9 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=Vt7jyf+c; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.86 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.86:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.86:from] X-ThisMailContainsUnwantedMimeParts: N Kurt Jaeger wrote:=0A= [stuff snipped]=0A= >=0A= > Given that simple NFS mounts and editing with vi on nfs mounts should=0A= > be very basic use-cases, it's time to find ways to debug this 8-(=0A= To find out what processes are holding locked NFS vnode...=0A= Run a kernel with the debugger built into it.=0A= options DDB=0A= options KDB=0A= =0A= # sysctl debug.kdb.alt_break_to_debugger=3D1=0A= =0A= Then, when the hang has occurred, go to the console.=0A= Type =0A= You should go into the debugger:=0A= db>=0A= Then type "show alllocks".=0A= You are looking for the pids of the processes that hold NFS vnode locks.=0A= db> continue=0A= - Allows the system to run again.=0A= =0A= Then look through the output of "ps axHl" for the processes found above=0A= and see what they are sleeping on.=0A= (My hunch is that at least one of them is sleeping on "vmopar", but it=0A= is just a hunch.)=0A= =0A= These processes are your problem. Figure out how to stop them from=0A= sleeping on something else while holding an NFS vnode lock and you've=0A= fixed your problem. (Do not assume it is an NFS problem. I'm pretty sure=0A= it is not caused by NFS.)=0A= =0A= rick=0A= =0A= > This also implies that switching from soft->hard won't fix the problem.= =0A= =0A= Thanks for the encouragement 8-}=0A= =0A= > In summary, I don't think your hang is anything like Andreas's, rick=0A= =0A= I'll report as soon as I have a another hang.=0A= =0A= --=0A= pi@FreeBSD.org +49 171 3101372 Now what ?=0A= =0A= From nobody Mon May 30 12:32:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EE5A21B4206A for ; Mon, 30 May 2022 12:32:24 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [IPv6:2001:6b0:17:f0a0::3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LBZYM6m5hz3KrY for ; Mon, 30 May 2022 12:32:23 +0000 (UTC) (envelope-from kempe@lysator.liu.se) Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id 1E940A41A; Mon, 30 May 2022 14:32:14 +0200 (CEST) Received: from shipon.lysator.liu.se (unknown [IPv6:2001:6b0:17:f0a0::83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id 1B6829F7C; Mon, 30 May 2022 14:32:13 +0200 (CEST) Date: Mon, 30 May 2022 14:32:12 +0200 From: Andreas Kempe To: Rick Macklem Cc: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4LBZYM6m5hz3KrY X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=lysator.liu.se; spf=pass (mx1.freebsd.org: domain of kempe@lysator.liu.se designates 2001:6b0:17:f0a0::3 as permitted sender) smtp.mailfrom=kempe@lysator.liu.se X-Spamd-Result: default: False [-3.80 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.lysator.liu.se]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[lysator.liu.se,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:1653, ipnet:2001:6b0::/32, country:EU]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello again Rick and thank you for your reply! On Fri, May 27, 2022 at 11:56:32PM +0000, Rick Macklem wrote: > Andreas Kempe wrote: > > On Fri, May 27, 2022 at 08:59:57PM +0000, Rick Macklem wrote: > > > Andreas Kempe wrote: > > > > Hello everyone! > > > > > > > > I'm having issues with the NFS clients on FreeBSD 12.3 and 13.1 > > > > systems hanging when using a CentOS 7 server. > > > First, make sure you are using hard mounts. "soft" or "intr" mounts won't > > > work and will mess up the session sooner or later. (A messed up session could > > > result in no free slots on the session and that will wedge threads in > > > nfsv4_sequencelookup() as you describe. > > > (This is briefly described in the BUGS section of "man mount_nfs".) > > > > > > > I had totally missed that soft and interruptible mounts have these > > issues. I switched the FreeBSD-machines to soft and intr on purpose > > to be able to fix hung mounts without having to restart the machine on > > NFS hangs. Since they are shared machines, it is an inconvinience for > > other users if one user causes a hang. > Usually, a "umount -N " should dismount a hung mount > point. It can take a couple of minutes to complete. > It's been a while since we last ran with hard mounts and I'm afraid I can't really remember for how long I waited when the hang happened while trying to unmount. It is possible that I thought the umount hung as well and rebooted unnecessarily. I'll try again next time for sure. > > Switching our test machine back to hard mounts did prevent recursive > > grep from immediately causing the slot type hang again. > > > > > Do a: > > > # nfsstat -m > > > on the clients and look for "hard". > > > > > > Next, is there anything logged on the console for the 13.1 client(s)? > > > (13.1 has some diagnostics for things like a server replying with the > > > wrong session slot#.) > > > > > > > The one thing we have seen logged are messages along the lines of: > > kernel: newnfs: server 'mail' error: fileid changed. fsid 4240eca6003a052a:0: expected fileid 0x22, got 0x2. (BROKEN NFS SERVER OR MIDDLEWARE) > It means that the server returned a different fileid number for the same file, although it should never change. > There's a description in a comment in sys/fs/nfsclient/nfs_clport.c. > I doubt the broken middleware is anywhere any more. I never knew the > details, since the guy that told me about it was under NDA to the > company that sold it. It cached Getattr replies and would sometimes return > the wrong cached entry. I think it only worked for NFSv3, anyhow. > > However, it does indicate something is seriously wrong, probably on the server end. > (If you can capture packets when it gets logged, we could look at them in wireshark.) > --> I'm not sure if a soft mount could somehow cause this? > We do use a setup where the exported NFS mount is currently backed by a Ceph storage cluster. I guess it is possible that something might have gone wrong between the NFS server and the cluster, but we haven't seem similar issues on our Linux clients. Of course, this might just mean they handle the error better. > The diagnostics I was referring to would be things like "Wrong session" or "freeing free slot". > It was these that identified the Amazon EFS bug I mention later. > I'd love to capture some data, but the problem is that we only have a reliable reproducer for the soft mount with grep -R. In the hard mount case, it would occur seemingly at random. The coming weeks are a bit packed for me, but I'll see about trying to find a reproducer. [snip] > > Yes, I sent this mostly in the hope that it might be something that > > someone has seen before. I understand that more verbose information is > > needed to track down the lock contention. > There is PR#260011. It is similar and he was also using soft mounts, although he is now trying > hard mounts. Also, we now know that the Amazon EFS server has a serious > bug where it sometimes replies with the wrong slotid. > I'll have a look at this and your other suggestions as soon as I have time. > > I'll switch our machines back to using hard mounts and try to get as > > much diagnostic information as possible when the next lockup happens. > > > > Do you have any good suggestions for tracking down the issue? I've > > been contemplating enabling WITNESS or building with debug information > > to be able to hook in the kernel debugger. > I don't think WITNESS or the kernel debugger will help. > Beyond what you get from "ps axHl", it has happened before the hang. I guess this means you think the error is at a protocol handling level and the issues aren't caused by locking issues in the code? I was wondering whether the hangs that were not slot related could possibly be due to some race condition when locking since it happens so seemingly randomly. > If you can reproduce it for a hard mount, you could capture packets via: > # tcpdump -s 0 -w out.pcap host > Tcpdump is useless at decoding NFS, but wireshark can decode the out.pcap > quite nicely. I can look at the out.pcap or, if you do so, you start by looking for > NFSv4 specific errors. > --> The client will usually log if it gets one of these. It will be an error # > 10000. > With us not knowing the NFSv4 protocol, we were holding off on even trying to get Wireshark dumps since we wouldn't know what to look for and would have to learn the protocol first. You having a look would be greatly appreciated! As I wrote above, I'll try to get dumps if we can find a reproducer. > Good luck with it, rick > > rick > > Cordially, Andreas Kempe From nobody Mon May 30 14:51:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7C8891B48BE5 for ; Mon, 30 May 2022 14:51:40 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2088.outbound.protection.outlook.com [40.107.66.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LBdf32p6kz4SRH for ; Mon, 30 May 2022 14:51:39 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Nb+hjMoA4we2q3QaRR+E4MI8je2+HsscjMU/Lr2NlzvJj1oYhOMTxV7poypccVC05SbjLhMQcLjyUX4OMeVrvCfjWGQ2fJAhNfQayfo/urNyG9EGY2PnAF5St5fmIs3I5sSpSVWgQ5qFKQenKGmVh/sMWcBTO+UDFSfLaOylEU/XT2L45DRkU+bhUdT+byAcQ9YxtKILjjV/qycY1p+InEgMGDsV3s1Ouw+fO084WGiusuliD6eggEwwiXyP9Mh+j9O7qTrUF5KbMERoBDxDGO/YurEW58mzu/93EmRo13fecEySpSC1HbmqExQnjFu/sX0BBDvztAu9eWNUo9zC/Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=DxhlPdQlq5LT64AmSQsso0TTEKNnchj7rl+Y4yh4mqg=; b=kSn1wbl0nlfe9BoEM1/vg63Oe8Y5aEnZFapne96X5JGV/SvSF7GkwSuF2Iyrpg5GCbOybz+viDRwnaY+CQfMlm+ToMmxWEmULSVQFaIR0ueSzi/jL/2Xsnz1OMF5yLOcGk7MYUfWVx9Dm34Ww2Gc9gf+WXuiHgHXrQq300FdaW5xknNNX9XcmMeM0NYpU1PuxPsyqhRUXV61X7nbwUXLAgiLuP3Bhim1/3Lx105K/bZM07cvFdEC7XYk6H6SvzOSNsyXATex/q3aFRtHf2V6NqKKWXpYtpRP/55o2B3VE9E38HnX1lgPVnWsB/MAA9fcafxDYLlHxDF6igwn++L4Iw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=DxhlPdQlq5LT64AmSQsso0TTEKNnchj7rl+Y4yh4mqg=; b=hkL2cy7TkxAbnK9xkcvqo3LWrqqOPhx3Q4dS1dG4lXHBVpw8YH5He+EvPU0T0gIQqqVjsnm2+wYs//I8v+4U7+22Wv1p/44MgL9Et/dfxK3VogoFs3Zt3QTSPaHpBXIQEDl/4xsHesA8/WZKOSn+lkmuJG7TdH6tMECRwoBhFoQgA6q+0ELp3rWaXzTTuK96m4pUvAZsk3Yyo1mNA/snXjYGKoUNdJHk+ivlc/y7XA7RQrybvQe3S9QJ5ui5xKaSO8K1PcRWocwDLyKpfl0A79DT3kEtZ+0RU5bK936zvTjrkZm1vJcFu5vAlrnn1zcNMTsFGpjIjGz6q9JW8p3GMQ== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YQXPR01MB3893.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:47::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5293.13; Mon, 30 May 2022 14:51:32 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::b921:251e:4a0b:54fc%6]) with mapi id 15.20.5293.019; Mon, 30 May 2022 14:51:32 +0000 From: Rick Macklem To: Andreas Kempe CC: "freebsd-fs@freebsd.org" Subject: Re: FreeBSD 12.3/13.1 NFS client hang Thread-Topic: FreeBSD 12.3/13.1 NFS client hang Thread-Index: AQHYcgY+3LPS/CtmUk+ZVTnbRrY6qK0zLx2fgAAamoCAABgQoIAD/L8AgAAhTLI= Date: Mon, 30 May 2022 14:51:32 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 7e95e85e-27d7-7d3a-6f35-d6492c507fcb x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 73b7f7c2-07d1-479e-0051-08da424be2e5 x-ms-traffictypediagnostic: YQXPR01MB3893:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: jIWBuz26TCTMq2e1GMzjCpSKWAK7EUgpvYbJxROn9cMw5Tx/dXbAppSof9gtCIeISomHQTZVcsGFAVbmlN0T8IgTIFDKVNGfssQHutSCvFcNwHPip1UBqGNqOLTtOzaY8wvQh2/7FymjuigI74sEc/aBkvupWlLSRuthZhTqFpmg5GE0bm9gvFhXHE91EuItadoxl9M+v3e6HLezijDccP12DST7Qwx0DEKsbX7NkFSBlugwGHywR8bPPw7Py2r5D1qKBIcmvfvJlfMlYi0fvJ088qG4IeWo39bpDYgk/fP14h0h6wqoQG/dcjXiTM4U6As/TfGB7dbWG7TeQIAMUVjadV6MaM5lJ4DILNLpPnZ2idQJ6GQPMpghgViqo9oj0Kyk9VaWXSvAh9OxqbUwaim/X3l0V2jQJzrBT6YGKruuk3WfU3xSlynsgLav3CuqHbJ6YUW1cmVOKmtxbOY95d4aYRoZk8BnrrJkK9NsZvf7qRp4+rsv9oluJFIhmuHokYrKSOM88mNFpLNcj31ccNL/ot3pYYXugL1RN42Rc6svUKG2wtpl1Gsl6R1jSXdLPH1IzXvgfQzjWJyRm3iFXKCSaBCVSTdIRkitnQx0LlEoafKi1WtvdVyWcUDO8SN2SGWVadfupcH147uiVK3PYY/yaA8fYDwfb0mxOblden+hyFq0egGJzIKiPNt72KGuOMhKsCccjXsDn5CAdnbFzg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(83380400001)(38070700005)(508600001)(122000001)(86362001)(2906002)(71200400001)(8676002)(4326008)(6506007)(9686003)(64756008)(66446008)(786003)(316002)(296002)(66556008)(66946007)(66476007)(55016003)(38100700002)(52536014)(6916009)(5660300002)(7696005)(33656002)(8936002)(186003)(91956017)(76116006);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 2 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?s+50XdbASKHZn6RTyHhN3IaZ/3mhL+l5Zvm5l7OYe9bIe22diVFRsPtGZD?= =?iso-8859-1?Q?gcIMcqmYWk+VG0b+rE/ZoS9k2o1cKKdcNGMVmdUieFT9xfpKg97zrT2jH5?= =?iso-8859-1?Q?8GHQykEmyW8+JWxH54MhFk0P4y/V8LFQcMfu2vo7OXMIcqh6I/Ie0PKH9G?= =?iso-8859-1?Q?H0YPo50zl+BUSiwbjMfDtT6lnGj1QMl1/ODVWmYP4hj908ruA9LSCZulUE?= =?iso-8859-1?Q?YDxFBAf7uzwllb26pWAXFn4/egndUzpmEh3WxNcdI9RWS/JfsZIuNbXVOX?= =?iso-8859-1?Q?FRfbSOizULH9gfvviviZbHy5jDi8FLUbYtoqNTjqW93xDPxeFdu859lq/5?= =?iso-8859-1?Q?GNpjQ1ZOruHBaK6dMQfDAwQnaocII8TfCnchBKur5zTXkE3vU2CJwQSdf7?= =?iso-8859-1?Q?vExsSMrmiMiCIJuDlkImJKs3xK6GFs+IsLrGO6yZYhDBGWQxb9YYZL8eit?= =?iso-8859-1?Q?sPJzD2DNMMWSPXOFtTAjU6xzzQVNTYxTVgyV3puR+K6RlFGN6/nleF3hQ6?= =?iso-8859-1?Q?8Tlk/H7dw3aizB1Aa3h5AuAYVkPT31vdVWrDD+LqHumuL76DBeF0c8IeAY?= =?iso-8859-1?Q?TJLM8tQsB1EqBVGN/UemeHVBaLiLWNY7ryr3cFzE4GsWI69fYVg7vTSpK6?= =?iso-8859-1?Q?/q18H4/YF9Cc1a95GSkplaNzpKDgUG1/nT8jok16+V8suMYQup86N7ekv9?= =?iso-8859-1?Q?zqbGcSP2VObTrkKOfxgI0wWfoVzzJZqY2H0ioJGwUYYnbh9u6Pk5VKbBCF?= =?iso-8859-1?Q?VM30/HY3HQdyXccGGYUyTf3nLHYEc0UmK9sHasHbLOhzHtRcC9/jAcWx3j?= =?iso-8859-1?Q?NmJwYKIRglLqEYhGJP1+FFfvAJXbWCGyBANHywQeKVCT7nQuOKWJ3cW/eJ?= =?iso-8859-1?Q?QORNM5WYHGmMyNtxwAxqn0wJk9xZmgtQlGJVVjCP7OrBVbpFzre9Ao6kJh?= =?iso-8859-1?Q?4gz2WW7t+JQRI7il0Nn4pCL1zJHHVr9ahwqckVx0mBrcAfyXHR2/RRn7QM?= =?iso-8859-1?Q?E6iYhxX17YpblVCLhCdWdzZZM6P7v0nAFXIdbz92Qw7mmUKhH15UgouoaF?= =?iso-8859-1?Q?U1dwlscEDaKQSv6cuEpBpT+z3E3BwnWM33c4wWT8JA2JV8AMH+1DntrFQB?= =?iso-8859-1?Q?a9gYU9+nZkYL4AF584g+tpJQt7GC71mggYcrugn0H+ZXjat6u9YLqgKrMi?= =?iso-8859-1?Q?FF3p+Xa601dNzPewzISYgxZWd25qsQIV8vHfyaKXEwa/aZl662mv7rKBnb?= =?iso-8859-1?Q?GncblPDTl+XOnY6IxQbVW9kRLFwf7ixjZ/V2FSb7EIIqr2YCyGAdw4zgCm?= =?iso-8859-1?Q?pkstM9nXoPmB/ZGPlpVfcjP5K0cvGuQSO65xdMp4o43RGTs2XPuaHDZC8H?= =?iso-8859-1?Q?N5fdqkIQk688BEPZ9KElICulbTsUVwoVX65QAPXlu9j9586QJ0ahsCA7oU?= =?iso-8859-1?Q?MiBkQwirWFlWxO5KMWQ5k3wAnGyGUoO9hITGN107GJsQkZInyi1bVYNd0q?= =?iso-8859-1?Q?a4A5O15M4UxgisKKctTdCcq20tkZOuh7Xyv8U8AOUy8NaPSqCYJJOe1yj6?= =?iso-8859-1?Q?uvbAxj+SoRXf2YviqUsIL1DgA80ql5vag5Kh3zO8qONEHkjMHqyQpE64mo?= =?iso-8859-1?Q?53EelpstO9O/79Z1ySWmGwNn/i2UMa81xqMV376s4XoCCt6u26n50EHeWR?= =?iso-8859-1?Q?rDd94Pls4Ub7AxXhU5P6+NSCs2oK6/YnxD0+HRQlev5aXSD8z7wokkhl43?= =?iso-8859-1?Q?vS/2FkewOh4UyrqI52+E5RCSsUzBFQ68zfo1OjjJKBUiXWr2XxwgErOgAk?= =?iso-8859-1?Q?Q7utI82T9JX764rS+j1W7Rc2/q4RJHrZwTjSEM4DSkVcMwNOXK8jNuc0Qz?= =?iso-8859-1?Q?+V?= x-ms-exchange-antispam-messagedata-1: HJ7SBLgSzfBAhQ== Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 73b7f7c2-07d1-479e-0051-08da424be2e5 X-MS-Exchange-CrossTenant-originalarrivaltime: 30 May 2022 14:51:32.2360 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: taOqkQm8Ou4+YodaP9p3VV4UKYF66N/W38CZkypFy98wIJ7esRxEh9y3blCOIvyYWgHEFz0dyxLIQE+35c+BSw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB3893 X-Rspamd-Queue-Id: 4LBdf32p6kz4SRH X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=hkL2cy7T; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.88 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.88:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.88:from] X-ThisMailContainsUnwantedMimeParts: N Andreas Kempe wrote:=0A= [lots of stuff snipped]=0A= >=0A= > I guess this means you think the error is at a protocol handling level=0A= > and the issues aren't caused by locking issues in the code? I was=0A= > wondering whether the hangs that were not slot related could possibly=0A= > be due to some race condition when locking since it happens so=0A= > seemingly randomly.=0A= Anything is possible, but the locking is pretty straightforward and no one= =0A= has found a bug in it for ages. (You can certainly run a kernel with=0A= WITNESS, DEBUG_VFS_LOCKS, etc., but there will be a performance=0A= penalty.=0A= =0A= My experience is that most hangs (other than the business with sessions=0A= for soft or intr mounts) are caused by network fabric issues.=0A= A couple of examples:=0A= As I noted, having TSO fail for some specific segment. Then retransmit of= =0A= the segment fails again, and again... =0A= =0A= In 13.0, there was a bug in TCP that=0A= caused the receive socket upcall to not happen under certain circumstances= =0A= and that could cause a hang. The bug is not in 12.n or 13.1 and the hang=0A= was normally observed when a Linux client had a FreeBSD server mounted,=0A= not vise versa.=0A= =0A= After a network partitioning healed, Linux and FreeBSD would get into=0A= what I might call an "RST storm". Every time one end would try to=0A= establish a new TCP connection, the other end would RST it.=0A= (Sorry, but it has been a while and I cannot remember exactly how to cause = it=0A= or if it even got resolved?)=0A= =0A= > > If you can reproduce it for a hard mount, you could capture packets via= :=0A= > > # tcpdump -s 0 -w out.pcap host =0A= > > Tcpdump is useless at decoding NFS, but wireshark can decode the out.pc= ap=0A= > > quite nicely. I can look at the out.pcap or, if you do so, you start by= looking for=0A= > > NFSv4 specific errors.=0A= > > --> The client will usually log if it gets one of these. It will be an = error # > 10000.=0A= > >=0A= > =0A= > With us not knowing the NFSv4 protocol, we were holding off on even=0A= > trying to get Wireshark dumps since we wouldn't know what to look for=0A= > and would have to learn the protocol first. You having a look would be=0A= > greatly appreciated! As I wrote above, I'll try to get dumps if we can=0A= > find a reproducer.=0A= I certainly don't mind looking, but you might be surprised at how good=0A= wireshark is at this stuff.=0A= It not onlt decodes the RPCs for you, it flags anything that looks "sketchy= "=0A= in yellow and anything obviously broken in red.=0A= It was wireshark that spotted and flagged the RSTs I mentioned above.=0A= Beyond that, you just try and get to the place where things broke (a hang= =0A= might be at the end of the capture, for example) and then work backwards.= =0A= It is true that you need to know the protocol to spot things other than=0A= server error returns that are not going as planned.=0A= =0A= The big challenge is getting the packet capture that is less than petabytes= =0A= in size. Although starting a packet capture after a hang has occurred can= =0A= be useful, it is usually too late, since the breakage has already happened.= =0A= =0A= rick=0A= =0A= > Good luck with it, rick=0A= > > rick=0A= > >=0A= =0A= Cordially,=0A= Andreas Kempe=0A= =0A= From nobody Tue May 31 12:32:21 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BD8E11B6193B for ; Tue, 31 May 2022 12:32:32 +0000 (UTC) (envelope-from SRS0=xyAW=WH=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4LCBW32mYbz3lfY for ; Tue, 31 May 2022 12:32:31 +0000 (UTC) (envelope-from SRS0=xyAW=WH=perdition.city=julien@bebif.be) Received: from x1 (unknown [10.209.1.149]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 2888310132 for ; Tue, 31 May 2022 14:32:24 +0200 (CEST) Date: Tue, 31 May 2022 14:32:21 +0200 From: Julien Cigar To: freebsd-fs@freebsd.org Subject: UEFI question Message-ID: <20220531123221.n7ubs365ceeqo2d4@x1> Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="hahkre47pdnco4ld" Content-Disposition: inline X-Rspamd-Queue-Id: 4LCBW32mYbz3lfY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=xyAW=WH=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=xyAW=WH=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-2.24 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_SPAM_MEDIUM(0.48)[0.481]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.30)[-0.301]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_HAM_SHORT(-0.92)[-0.916]; DMARC_NA(0.00)[perdition.city]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=xyAW=WH=perdition.city=julien@bebif.be]; RCVD_NO_TLS_LAST(0.10)[]; SIGNED_PGP(-2.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=xyAW=WH=perdition.city=julien@bebif.be]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --hahkre47pdnco4ld Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I have a Dell R340 server on which installed a 13.0-RELEASE and then upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used (raidz2).=20 The system has the following partitions: https://gist.github.com/silenius/2= defdd5480c5c1bc9ba2ff8940756466 Some things regarding UEFI are not clear to me: - as you can see in the partition list, the installer created an EFI partition on all 4 drives, however it looks like only the first one has=20 has been populated (an mounted): https://gist.github.com/silenius/1220c953f= 905d868c1615fd0e7122bbf .. why ? - if I understand well if my da0 disk dies the system becomes unbootable (https://gist.github.com/silenius/51d202053295270eaaeb2c023161= 65ee).. correct? - what's the correct way to fix this? should I newfs_msdos on each EFI partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or should I use efibootmgr? Thanks for enlightening me :) Julien --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --hahkre47pdnco4ld Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmKWCtEACgkQCLYqJMpB HmlQgQ/7BJWw+sbhG5Q0xkYU999iZATEAdqdDxrPqdE4ZOTFWYe/KKrWF9XGjS1S qPsiRo7ReucWfECe48Ov/OOeOYZz1y5oZNzeL/C9vFdMWTRk0031b8O2WSsD2K7z FpDyD0/fV/doygpYradHz166Pn/bs21u59j+boZBnc8gdeK3SHsNEodoCoQxYC1m +/yI5bjFA7Py5svMeZUVV8ecGXtjfyNVR2mI+HQZ55dO8SsN+K44UnD9hOS7frmq RaIRI1G/rRfj679+r4cFKRwpAIUJlMA/3IxmJl7F58swTFndfp0tGnhIIgvA1bZA +IY304ndIt0I1RgEnVauX7VR4dhvGC7osteV0EQEZYILSmfnwMo1f+oif9yj8JjL dsbu8FNNgq3uRoBPPp6gjG/gGE4bEBpNecAwpESnjF+YcbybcJS0mNXNWP85M6D5 G4fS42PPd5eL3jEfMPpi+cHor+hLqGOvm+x6wRkgBzp/U827kv0CLOeJGHbMoBeJ 2l8s1xHweAIebM6hkCVxlAFkzvJ9/d5tXXNXpxC98+/dYO7OFEFvAQqC8EDUrhlv BG/nfaH3Wxb9aMCYK73iFxpEx2K7N1rBQt4xT8vRWhPOPPkpiVcoyY4nbYtQN3Vl L31phforU4yt3wSEhYqnwHJrJ9nP5d+9C/9sxG73YQ/3v2YOmQY= =ftq5 -----END PGP SIGNATURE----- --hahkre47pdnco4ld-- From nobody Tue May 31 15:25:34 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DB8981B617FD for ; Tue, 31 May 2022 15:27:06 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Received: from phouka1.phouka.net (phouka1.phouka.net [107.170.196.116]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "phouka.net", Issuer "Go Daddy Secure Certificate Authority - G2" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LCGNV0cLlz4bdw for ; Tue, 31 May 2022 15:27:06 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Received: from phouka1.phouka.net (localhost [127.0.0.1]) by phouka1.phouka.net (8.16.1/8.16.1) with ESMTPS id 24VFPY28028301 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Tue, 31 May 2022 08:25:34 -0700 (PDT) (envelope-from warlock@phouka1.phouka.net) Received: (from warlock@localhost) by phouka1.phouka.net (8.16.1/8.16.1/Submit) id 24VFPYKm028300 for freebsd-fs@freebsd.org; Tue, 31 May 2022 08:25:34 -0700 (PDT) (envelope-from warlock) Date: Tue, 31 May 2022 08:25:34 -0700 From: John Kennedy To: freebsd-fs@freebsd.org Subject: Re: UEFI question Message-ID: References: <20220531123221.n7ubs365ceeqo2d4@x1> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220531123221.n7ubs365ceeqo2d4@x1> X-Rspamd-Queue-Id: 4LCGNV0cLlz4bdw X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of warlock@phouka1.phouka.net has no SPF policy when checking 107.170.196.116) smtp.mailfrom=warlock@phouka1.phouka.net X-Spamd-Result: default: False [-0.03 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.81)[-0.812]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_SPAM_LONG(0.59)[0.585]; DMARC_NA(0.00)[phouka.net]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[warlock@phouka.net,warlock@phouka1.phouka.net]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:107.170.192.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[warlock@phouka.net,warlock@phouka1.phouka.net]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: > I have a Dell R340 server on which installed a 13.0-RELEASE and then > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used (raidz2). > > The system has the following partitions: https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 > Some things regarding UEFI are not clear to me: > - as you can see in the partition list, the installer created an EFI > partition on all 4 drives, however it looks like only the first one has > has been populated (an mounted): https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf .. why ? > - if I understand well if my da0 disk dies the system becomes > unbootable (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee).. correct? > - what's the correct way to fix this? should I newfs_msdos on each EFI > partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or > should I use efibootmgr? > > Thanks for enlightening me :) I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs picking it via UEFI/BIOS on boot manually). I'm multi-booting windows and FreeBSD, so I'm being (justifiably) paranoid, but not based on being burnt in recent memory. Depending on how your system works (drives are enumerated at startup), in theory any of your disks could be da0. If you've only got a working EFI partition on one, that is probably hedging your bets a bit but yes, if that drive died, you'd probably be dead. In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) partition on both disks, I split my total swap between the two (not mirrored), and did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs partitions. In my case, using the UEFI/BIOS from the motherboard, I could manually pick a disk to boot from which let me vet UEFI or ZFS bootblock changes for sanity before committing to both. But yes, I'd upgrade them both to the same thing once I was sure it would work. From nobody Sun Jun 5 01:36:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0FA361BD81AE for ; Sun, 5 Jun 2022 01:36:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LFzjV46LTz3h31 for ; Sun, 5 Jun 2022 01:36:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5E181D18 for ; Sun, 5 Jun 2022 01:36:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2551a61p006272 for ; Sun, 5 Jun 2022 01:36:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2551a6Wj006271 for fs@FreeBSD.org; Sun, 5 Jun 2022 01:36:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 01:36:06 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc assigned_to flagtypes.name bug_status short_desc keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654392974; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dC9yXfCM+6L6mmNBEtITRFBBXQ7ZjK0i+qI1N+gNAYM=; b=tEsd4l9AWRlf+H7kVY31p0IIuih8GYm8Oh2RLlIIDsmTVHPu6sfVBlhAnpNtnt/jWMRehb C7ghXZ+d3wBwLkADujZtPQctLu8apOMcBiMH3WTp7rhmbKZCI6B/6Ln/rCbf+KlfjSRxZ3 GQaIPabjXOx/FkJdy/yZ5nKbFSJn+xgikFk7kGZTFCaIC3cxSGKone9QZ4Z2CQKjLQa0MV 6EtRGMEMAZSXCXcj6UdYa/y13OUMIik5ZIiL3hFxBO8Udu8hGLL897PI15QJfuNdXIMrsJ DIWOxqOikq+x5ygT7L9v1GH2/ieWTM3lThMEkPLrzRYRpW18HTecSikoOaUgDg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654392974; a=rsa-sha256; cv=none; b=jCUF+L4P1zkbpNfqinKH0yy99qbINplzhFK9/u6v4euTCdwQQOnVZ6IWJwuvX4WpXxjNra 3gzE8weUQiBD/B/hqReVN41lVLqO2jU8RxxHc9YDp+9TEptwHjDWNOobemvydmJu03n1Gg x1B5OEWAl7hfYQtJwHl9V9G5sAsgYzuhM5UvuFg7D5ASL2QXEj0qkz+Lgd7FrqfdabkiAO nZ9v1FkrslFgBheZ3jxXn8Z8H1KASwfSqc13gOO3kjvXGOKAGxm7SfdqTZJJ7xk3pSgRmT EyqgvCOY8kVF67er/3Obk2uGyHRsYItOOKkZkqo/o4wex7CZlnFw9jlaJVlwrQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org, | |mckusick@FreeBSD.org Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Flags| |maintainer-feedback?(mckusi | |ck@FreeBSD.org) Status|New |Open Summary|ufs "Cannot find file |ufs: Partition recognized |system superblock" on main |on 12.3 not recognized on |2573e6ced99616f2edccf97fb0f |CURRENT (2573e6ced996): |9283a84148246, perfectly |Cannot find file system |usable on 12.3 |superblock .. Invalid | |fstype: Invalid argument Keywords| |needs-qa --- Comment #2 from Kubilay Kocak --- @Reporter Are you able to test fsck/mount with a 13 release or stable snaps= hot image? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 05:45:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 67CCE1BD86E3 for ; Sun, 5 Jun 2022 05:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG5F76pyPz4VRr for ; Sun, 5 Jun 2022 05:45:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2DE0A4569 for ; Sun, 5 Jun 2022 05:45:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2555jUrh038006 for ; Sun, 5 Jun 2022 05:45:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2555jUFY038005 for fs@FreeBSD.org; Sun, 5 Jun 2022 05:45:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 05:45:30 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654407932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AEBP7/g7dnsXNGAfk6m91/KrUw9iLAmZ/3xGHV9FrgQ=; b=y1Ix7kJPRgVu1PA0xyWHXGvJMdYpKuqIOy+kABPZBqPP1u49T+odNVYhjthhW0sfvZgyV7 oNzl6cOjkQ7yz2ILYlsRvwPzjSi95nd75FNmyYzfyoldb+ctyctsVIXMMvD3Q9I+LRDHYl R8KOQIQJZD/8Q4b2jXUib2OUsSkdfU3moNQ52PBdJRG+bGT8uaNKW2PAhsf4tUY7bEvdja moVMdme83Vri6ub5Ra0vqnFsUaVvykPVFMg3D+bnRQOxNSn7Wm9xUJp7ovmvQOVnMRDhAe BRuHMjpy7AaKJdcaoEhteh1qqvebBZFY2I+A5HlFp8kYyh9SxKyDYcgbOAxpRA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654407932; a=rsa-sha256; cv=none; b=ny20N7KH7onhSbqjVb6f7CY7KGXtrFARbLFFTz2bAXvTGUgjF7hvGTHx06rgnJVburyTBa UdV+4NwPbNmZpjxRKd2WTAiUKLo7tJLRMsDPJRBgGAXVnoeHD0mvqBSkZNSfGQX1jZ5lwZ I1NQswp1pDprqhTZw68dHDTvxPsb/RjbNnHClfoMgWTP7Nhh6amK8cyoEUWsqa2sU94hYn iFVHJYuARruDesIWrFN5kYpjDzhLPXE/LACX7juEn6FYSJBM3lbT9Xu9Z5dArHoLDgZKst wyLdkk6qtbkVeuGjbG1LL3jrMgVcQBRghlbohK/LFzI14z2lynvmYbdZB8qI4w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #3 from Martin Birgmeier --- (In reply to Graham Perrin from comment #1) The issue appeared when the system was upgraded to d64f2f42c111009dade9ab7ae4d75a0256630e14 (2022-05-28). It was then upgraded= to 2573e6ced996, and the issue persisted. The disk was recognized when the system was running 398c88c7582a195cbfeb689ceff1400cc717673f (2022-01-01). -- Martin --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 05:56:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6417A1BD9D9C for ; Sun, 5 Jun 2022 05:56:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG5TH5kslz4W9r for ; Sun, 5 Jun 2022 05:56:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 659714471 for ; Sun, 5 Jun 2022 05:56:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2555u2kZ042701 for ; Sun, 5 Jun 2022 05:56:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2555u2p6042700 for fs@FreeBSD.org; Sun, 5 Jun 2022 05:56:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 05:56:02 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654408564; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rfs3j3QhNqiUiw7QmTCZeBoEdfhHYoOW9Dyjr4+FZJM=; b=hXT0ugJzhrjVXt+rnocRo2mKnhXgZEQY5M5HtPWZoZ+1zqma85cq8W5oRFxUDptBjvjm5y pEz2R3v3j9iiwg45XP+T7QbNQZ+HbMDWwmVebAuzlXLtc4j6MY9YRNh/Cr4VH0GbCi4AaT +K+LZpJ2UUi/VfR22Ff04FqRCihMN2VDWaZdQOEGCHZVLcqY3vdwpKHC+o3F7TS4NYnQAS NUQLOO8LsbZs9Q/FIPV+lj1Znb3oQAi8trlsBsAZDpouMLTmah3NT18nMqBWDAq/kmV3hm 3KR+gtC/rHDLz16KspN8nPPCm0n1QKwA8XbPtzsRsgIZOVrFhFFROP+pfU5f/Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654408564; a=rsa-sha256; cv=none; b=mSP+OWuWqqFCdsC/5t0moSeHJVnutjFhf7rl7q/OE4eSPBQWUJTYUbD9y0UmzWOQDExAOD 3pTS4QLuyDHPUET0yCNldy36LdREJlACNXR8U45W6rtYrbJMpaCqrVeYLOexXUgRwd2eqt M+QwWcfsrDol5TZkj77Bs5lfyyd6fLZxc3DKtVxqwc8wVsMdnoKuUCIIuvlOHPXNP18j3N moHsjLVYLGKeDEe+2v6JjiaPer+qt41e7WW7MVYr004YtjHteGiB0uD8kwCQIHne4PlZDV jQtAlWWYzh2gJD6DwGBkVnTAlpP11mO2/sBb140W/LNgLr0nrNIaRzKBUPlhLg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #4 from Martin Birgmeier --- (In reply to Kubilay Kocak from comment #2) 13.1 fc952ac2212b121aa6eefc273f5960ec3e0a466d is working: [0]# ll /dev/da0* crw-r----- 1 root operator 0x59 Jun 5 07:48 /dev/da0 crw-r----- 1 root operator 0x5d Jun 5 07:48 /dev/da0s1 crw-r----- 1 root operator 0x5e Jun 5 07:48 /dev/da0s4 crw-r----- 1 root operator 0x62 Jun 5 07:48 /dev/da0s4a crw-r----- 1 root operator 0x63 Jun 5 07:48 /dev/da0s4b crw-r----- 1 root operator 0x64 Jun 5 07:48 /dev/da0s4d [0]# fsck /dev/da0s4a ** /dev/da0s4a ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] n ADD INODE CHECK-HASH PROTECTION? [yn] n ** Last Mounted on /mnt ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 3627 files, 131623 used, 376160 free (3256 frags, 46613 blocks, 0.6% fragmentation) ***** FILE SYSTEM IS CLEAN ***** [0]# fsck /dev/da0s4d ** /dev/da0s4d ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] n ADD INODE CHECK-HASH PROTECTION? [yn] n ** Last Mounted on /mnt/usr ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1269131 files, 10661916 used, 13593544 free (15728 frags, 1697227 blocks, 0= .1% fragmentation) ***** FILE SYSTEM IS CLEAN ***** [0]# gpart show da0 =3D> 63 976773105 da0 MBR (466G) 63 1985 - free - (993K) 2048 761726968 1 ntfs (363G) 761729016 215044152 4 freebsd [active] (103G) [0]# gpart show da0s4 =3D> 0 215044152 da0s4 BSD (103G) 0 16 - free - (8.0K) 16 4194304 1 freebsd-ufs (2.0G) 4194320 10485760 2 freebsd-swap (5.0G) 14680080 200364072 4 freebsd-ufs (96G) [0]#=20 -- Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 05:58:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 375AF1BDA857 for ; Sun, 5 Jun 2022 05:59:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG5Xk3JPKz4WrN for ; Sun, 5 Jun 2022 05:59:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8180C4471 for ; Sun, 5 Jun 2022 05:58:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2555wtZd043220 for ; Sun, 5 Jun 2022 05:58:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2555wtLu043219 for fs@FreeBSD.org; Sun, 5 Jun 2022 05:58:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 05:58:55 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654408742; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=E57Wa0Y6U7rtHPebBNrLAHVcrGJJXVKhdFHl4NB+ejo=; b=x++tt+Sds4UC+WgbG8zrU7Gf2+DUhyUDkC9asTNizdR13nXhX9M67sn0PzEb0lg2+zy7+i L/QxeV24s59ReAs3OsfcIumeIV7CpMwZAsMtH34wecOhuWQvBxgbwG1fDxJEgvm+ULRhZP uQdKK17OA35AQw+aR2bhaPoVXBpbdmR3Mfb7JUzxl9nMTKQg90zahAB2aYRcswMIrYlN2E WMmFXRx/rh7U74QINiENpayHBdaNEHjruBnQhwelfcWAA0NkDc8CGRkS3LaCHCgHsL1tIl CKIk78XR/wEnKdfhSF0glqZqxAcPi1tv3eTSsuiPP8bms9laQB+3dD5KocK8jA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654408742; a=rsa-sha256; cv=none; b=kpqRA2OJcueZuFhPIBLknuAQfs21Sn646qxWfTgQYqrJUo5Z34qxxyhmiJmGJwsKrzZPB7 llV02VX36rqlolETqQWAy/gGjBDyMFZCRaMibaEHVGDYYG2pZL52vN85+dlAPU3CGQKceV 37YwZYp0L0xZQks7Txrd2/yT0gSDAk6lVdKakMji8Hzd+qIY/8J4SDmUlu+MJgpbS1Ohw5 EydN+SxE93e6/Xt3KCt34SXE1THASKjW6mGkfWdZLbmlEfwWNqb3AfCpq1RQPnViahx2Hk /LUiA1IVQ3RSCYRmipRjHoQoa9vCAF/rL/KQ9cLNNcjsmNI7FIObCPIcXY24YA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #5 from Kirk McKusick --- Created attachment 234455 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234455&action= =3Dedit proposed fix Please apply this diff to your kernel and see if it resolves your problem. = If it does not resolve your problem please let me know the "Failed code" that = it prints. Note that you need to recompile libufs if you want it to apply to filesystem utilities like fsck, dumpfs, etc. And you need to recompile libs= a if you want it to apply to your loader. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 06:00:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F28041BDB04B for ; Sun, 5 Jun 2022 06:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG5Zq34Rmz4X41 for ; Sun, 5 Jun 2022 06:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 282CB427F for ; Sun, 5 Jun 2022 06:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25560pEM044261 for ; Sun, 5 Jun 2022 06:00:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25560p0q044260 for fs@FreeBSD.org; Sun, 5 Jun 2022 06:00:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 06:00:51 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654408851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=P7Q9qgoMrowys3/Ba2mildVcLL2yS5qCvhdxSopnLD0=; b=qYuVTFrlQRlAH/u7Rgi1+75tnuJxkDOTHqN8aL1sQyne+wgOCMX+SeGcQyemkGbJFjWOr5 ArE9KwWxPx9wh6WFqju3cGlmO3Yh+jwe7/1diUPcjGISiChgzIqrlOODFIQhS97ms1VHVp na1hYPmZ7A5OsC8g1nYXyWG0dNFTBm060ZP1PBd+ESWHRlMaLu0mxjuhyNvKp/uhPPzd44 HuAYwJpiryWIRtJ8TY6vCnV44Rk47zWyDFPU0ikYyf+g27fWFGSxvCZivolIIGvRWlt9om DMmMQYP/As3LA8k2LiF4+LlBVhmxPyLHfcjvMtGtutwTx96tQf2UaCxwDy2/Mg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654408851; a=rsa-sha256; cv=none; b=upDgiAvq+aOmf9uL0IxfIgMBmvbepGhFGQXuLc6PIa/UcPN0FeEHDK9tGy2XzQiaKXD3At lwd8jGG13s2Sde1kCTAJR9oSnaLOOb+9ABXOZVhf04uj5PR7ytI8lNYQvnvfpcF7X+ztsZ fQkknQt9FjVkNF3MT6frYEuhdLi0wOlPLEOE3Nl+GmTeKsDoLg1YQIlWs69TM12jRjrtkk /9LcGQGrJuTuQl2vDZ7YUZkzuyTD/ojU1PfpaB6kFe7F4Z1kzpz7IjhmpDQa0c6Cn/y8aJ t0yFtFuOtGpVtNg9oBU7rf5S/YMwtOJLNxdUyHGuhKMwZ5E9x+k5N3Q0Ez8Suw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #6 from Martin Birgmeier --- I had a small hope that after fsck'ing on 13.1, the partition would be recognized on main - alas, this is not the case. -- Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 07:11:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 122E41BE470B for ; Sun, 5 Jun 2022 07:11:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG78g32v5z4fCJ for ; Sun, 5 Jun 2022 07:11:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 63F025987 for ; Sun, 5 Jun 2022 07:11:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2557BiGA085199 for ; Sun, 5 Jun 2022 07:11:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2557BidY085198 for fs@FreeBSD.org; Sun, 5 Jun 2022 07:11:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 07:11:44 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654413107; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+a+xeuNp6Hr+HthOXb0HvcS20o3R9MQ81MJ3jpcIxF4=; b=Sqt0UasAd1/frBfp7gWRIW0EDiugxLT8kG26AhnolgeLeZqO64nJ93S7DTRTO24HV/6mxh NV/ayyoFcqmBgE30UoAnsPMziObtjYfKIIWNf+3e7jqYApiOViMxUprH75Bju+TFQjeU3w IE3+pZGBdQrhUpqztnpWqzX57qYsyntYmHHwShsc14FMUzDU0x5IWSTQ/Wv+1Le+OaNdsa QlgSOd+MTJE8e08DVxw/PjZSsOe49dEjXHfTZ3UZoWWnCo4/RQZPBGdXpF4brzDRr7oWZQ KSmczmI2J4dnABpYNMlYp3TiisLQs3mIytWuOfTHUhsDzWutk5ngj5tJrWvtTA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654413107; a=rsa-sha256; cv=none; b=Kw3WFU+IC9DrdYFUPiFZzgN4OsgNn/P/ceVVm04QEbu9m8rV+6jJRjZDIPUwb7BtXb9oBT w+JUzqaZ4DK9SeqNc+UAO7aXanjno61iN89QBU2Ec8epo2+vlmUOKdkw81NllvNaGqSPLj ARZ9j0+u7SCQMcriNXmvvNcKcxgg349gsyS8gJ4dcs+2T/NlGaYJFr1ARvQlSkF1wCB5ws V4V6iSjEc7F1gweBDIUDAIR92T9/m+Q9QTkThatinOgdxtdLfSlGC4MYO25L1HDV6a1M+/ QGYfOVTsIkqZu2g9i1bYcVu/SRt//yL//IyKLQHclN2/McBMva5fhS8QBj58cA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #7 from Martin Birgmeier --- (In reply to Kirk McKusick from comment #5) I recompile using buildworld buildkernel -DNO_CLEAN. The following files differed from the installation and were reinstalled (I first install into a temporary location and then do a compare): boot/kernel/kernel boot/kernel/ufs.ko boot/loader boot/loader.efi boot/loader.kboot boot/loader_4th boot/loader_4th.efi boot/loader_lua boot/loader_lua.efi boot/loader_simp boot/loader_simp.efi boot/pxeboot boot/userboot.so boot/userboot_4th.so boot/userboot_lua.so boot/zfsloader lib/libufs.so.7 (everything in rescue) sbin/fsdb usr/lib/debug/boot/kernel/kernel.debug usr/lib/debug/boot/kernel/ufs.ko.debug usr/lib/libufs.a usr/lib/libufs.so usr/lib32/libufs.a usr/lib32/libufs.so usr/lib32/libufs.so.7 It is interesting to note that libsa was not recompiled. When attaching the disk, the console shows the following: da1 at iscsi2 bus 0 scbus4 target 0 lun 0 da1: s/n RPI-B_DISK26 detached (da1:iscsi2:0:0:0): Periph destroyed da1 at iscsi3 bus 0 scbus4 target 0 lun 0 da1: Fixed Direct Access SPC-5 SCSI device da1: Serial Number HAL_P0026 da1: 150.000MB/s transfers da1: Command Queueing enabled da1: 476940MB (976773168 512 byte sectors) Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Failed code 3 Fsck'ing is interesting - it now proceeds on da1s4d (it is now da1 because = of a different way of booting): [0]# ll /dev/da1*=20=20=20=20 crw-r----- 1 root operator 0x6c Jun 5 08:59 /dev/da1 crw-r----- 1 root operator 0x6e Jun 5 08:59 /dev/da1s1 crw-r----- 1 root operator 0x6f Jun 5 08:59 /dev/da1s4 crw-r----- 1 root operator 0x73 Jun 5 08:59 /dev/da1s4a crw-r----- 1 root operator 0x74 Jun 5 08:59 /dev/da1s4b crw-r----- 1 root operator 0x75 Jun 5 08:59 /dev/da1s4d [0]# fsck /dev/da1s4a ** /dev/da1s4a ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] n ADD INODE CHECK-HASH PROTECTION? [yn] n ** Last Mounted on /mnt ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 3627 files, 131623 used, 376160 free (3256 frags, 46613 blocks, 0.6% fragmentation) ***** FILE SYSTEM IS CLEAN ***** [0]# fsck /dev/da1s4d ** /dev/da1s4d ADD SUPERBLOCK CHECK-HASH PROTECTION? [yn] n ADD INODE CHECK-HASH PROTECTION? [yn] n ** Last Mounted on /mnt/usr ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1269131 files, 10661916 used, 13593544 free (15728 frags, 1697227 blocks, 0= .1% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck /dev/da1s4d 1.65s user 10.11s system 2% cpu 7:56.92 total [0]# gpart show da1 =3D> 63 976773105 da1 MBR (466G) 63 1985 - free - (993K) 2048 761726968 1 ntfs (363G) 761729016 215044152 4 freebsd [active] (103G) [0]# gpart show da1s4 =3D> 0 215044152 da1s4 BSD (103G) 0 16 - free - (8.0K) 16 4194304 1 freebsd-ufs (2.0G) 4194320 10485760 2 freebsd-swap (5.0G) 14680080 200364072 4 freebsd-ufs (96G) [0]#=20 -- Martin --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 07:14:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 034211BE5407 for ; Sun, 5 Jun 2022 07:14:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG7Cy5LYTz4fvq for ; Sun, 5 Jun 2022 07:14:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5FE6A573A for ; Sun, 5 Jun 2022 07:14:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2557EbfL085679 for ; Sun, 5 Jun 2022 07:14:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2557EbiO085678 for fs@FreeBSD.org; Sun, 5 Jun 2022 07:14:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 07:14:37 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654413278; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=N8BxI8OePWn07y1cn/A3TOOeSQpXKATDsSkgNe+3qag=; b=Q+w3PD+2a8JwbPWxYtZ4FI+l56sTyhM9HgO6o2mjHo1N3gF7W4zOG7XO8nHRvlMzbaF2E4 puxAzEb7B5vFhrYvcYHiuqUT5RLyfovEQrcBFDUsnsrJ7YlsvI1aa5XDrgkWKnooFUPdXV 6ckKHitBV2N9+eCtvFizt/qH1vgkhZo1t6Whl9JHkOsA9rg8A9ADWn8EoVVBGmdARjlrdY 5oy5cJb+/GCJvUpPQiLivTDgs+vxLB31zrggobAGBCcZVP2ua29gz9ykM6ZsjvNTn4IT1t rbaArC3kQrufaVU/GXsOlERTWNCnG2rG+y4m5wRGuXltWUxqUIGnSBYGl7Iy1Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654413278; a=rsa-sha256; cv=none; b=m8b8FaymHeJs3ZOp0wuKtGuDcY2fLUj17lPJxUvPPp7h1J2VZgAIdKNXuMd4oz9F1+iAP2 0GftKGugGr27BHbaB6j8FCtEW9jdhUs9M4CvdvOezvO+d+0ti59JUO67TziD6c1ysAUFXI cvRMCXqTnXev8TmYCywjVDiDXke0KSSRJYdLvr2mxAus3OCe3Tk5Aw0PVI83kPSZBd7tLV x30oJUerqPMT1vOPI1OAJLA379ohfMBblpeTylbOa4jxbb4V8C2/0QUbZQzqLDcYA6OnM5 Nskzjkp1v6oNGoIlEaC2C6Zh7LeCu4GxLCsAn0lpQ840StrJOo3KN8UdpKP51Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #8 from Martin Birgmeier --- ... and it can be mounted: [0]# mount /dev/da1s4a /mnt [0]# mount /dev/da1s4d /mnt/usr [0]# ll /mnt/usr total 104 drwxrwxr-x 2 root operator 512 Nov 15 2009 .snap drwxr-xr-x 3 root wheel 512 Nov 12 2021 VOL drwxr-xr-x 2 root wheel 8192 Aug 25 2018 bin lrwxr-xr-x 1 root wheel 10 Aug 7 2010 cvs -> ../vol/cvs lrwxr-xr-x 1 root wheel 16 Oct 10 2010 cvs.local -> ../vol/cvs.l= ocal drwxr-xr-x 2 root wheel 512 May 1 2016 games drwxr-xr-x 55 root wheel 6656 Jul 2 2018 include drwxr-xr-x 10 root wheel 16384 Aug 25 2018 lib drwxr-xr-x 5 root wheel 16384 Aug 25 2018 lib32 drwxr-xr-x 6 root wheel 512 Dec 6 2014 libdata drwxr-xr-x 9 root wheel 1536 Aug 25 2018 libexec drwxr-xr-x 15 root wheel 512 Dec 1 2018 local -rw-r--r-- 1 root wheel 0 Apr 20 2011 local.NODUMP drwxr-xr-x 2 root wheel 512 Dec 13 2009 lost+found lrwxr-xr-x 1 root wheel 10 Nov 1 2018 obj -> ../vol/obj lrwxr-xr-x 1 root wheel 12 Aug 6 2010 ports -> ../vol/ports drwxr-xr-x 2 root wheel 5632 Aug 25 2018 sbin drwxr-xr-x 32 root wheel 1024 Aug 14 2017 share lrwxr-xr-x 1 root wheel 10 Nov 1 2018 src -> ../vol/src lrwxr-xr-x 1 root wheel 16 Aug 6 2010 src.local -> ../vol/src.l= ocal drwxr-xr-x 3 root wheel 512 Dec 29 2010 srcs drwxr-xr-x 4 root wheel 512 Mar 23 2013 ss drwxrwxrwt 3 root wheel 512 Apr 15 20:14 tmp -rw-r--r-- 1 root wheel 0 Aug 28 2011 tmp.NODUMP drwxr-xr-x 4 root wheel 512 Jan 29 2012 users [0]# umount /mnt/usr [0]# umount /mnt=20=20=20=20 [0]#=20 -- Martin --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 07:15:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B39D01BE5A21 for ; Sun, 5 Jun 2022 07:15:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LG7F43lYkz4gL2 for ; Sun, 5 Jun 2022 07:15:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 90A8F5ABD for ; Sun, 5 Jun 2022 07:15:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2557FZK5085873 for ; Sun, 5 Jun 2022 07:15:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2557FZl5085872 for fs@FreeBSD.org; Sun, 5 Jun 2022 07:15:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 07:15:35 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654413336; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rrAuGaONHoDN/3/UGbLDRUe7hgu/5UUt0BF6i7O24NM=; b=UHcFHWYavNske1FC6GMNX4z/6xB3+XJR4gDFbGhCGMysEm3Pxg74rpGBVrzJpYXK82nHBL jMeQbUjR8kHO3huKMji9PbQNRZY7Z5n9eI1P7anz5G3Mfi+KdMNldUDYxtJuhYNB7tsfLz RBqeijm7dGAFlimlGDXE15+QqWlVcFApXZdEXBj74erpvBUazuRgVuv0+LJliL0txKsM+7 RHn8v9ij4NPUJkC82nLmcjZVJQy+mZMgXFEAVgdwhznGcKL+Kn8rfUQuMp4lrYKRMIsIgr gyjWT9agrp6KOoPTYJlANnhK3qJjGNjgpMdSlDmEVxSY4bA8IrD97MazwLqzRw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654413336; a=rsa-sha256; cv=none; b=TwQQtw22V8/Dnm7gbrthmbkfLe0BZb91VQbe838UkrT0sLrCR+sI7B0qTXJ6soXGaF6pkM ajTMg+siB4a/VIWk1HLR26lsq/+zlZfNf12UBKveZufb9QW3XRXMHKL9KeYaaRuDTsgFo5 2LJFntMMXL2d93hQ4FY71sY629Zr/p2kQQ8EvR60FgeiQMoXVG1w4lsuctWeH/BcVn9l9Q tEeiH+FOQx74wVWSfUBsio33WNAeVDFeONSAo5S5OaNwNmDLHg7tB3bEBBWyl0ozUAV3d9 Y/4DlNvhaoQSXMg//W7kwPhu0tznDzH6APwPocn8j12B/WU3RBScTDUHtnIrQg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #9 from Martin Birgmeier --- But why then "Failed code 3"? -- Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 12:07:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C12D31BD2603 for ; Sun, 5 Jun 2022 12:07:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGFk72d96z3lPd for ; Sun, 5 Jun 2022 12:07:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D85B511D0B for ; Sun, 5 Jun 2022 12:07:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 255C7g66045563 for ; Sun, 5 Jun 2022 12:07:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 255C7glW045562 for fs@FreeBSD.org; Sun, 5 Jun 2022 12:07:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Sun, 05 Jun 2022 12:07:43 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654430863; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9JAe9u1nYMcusGTwhb+SDnRYjY+oIemY7Ze69X3YjEY=; b=yieqwQp8EI9XboM1ngy9zYO+oLezSpKejqu23nT+4A/pKS2HHtZJCCzz+WEqrFtGwEBV6D aQvNIWAQH6GwkK2a1Zqz0rCUs76PdX4/Miwzf+XLOr+lpyAeTyYCYmZG6Ak8arh1TJAUe9 hJVFzLjKpIhUAvKDIH7wfEDErRrx+qCl+5FWXKH9UEtBIrwF0ozzn3UUaPzQshwlIap3lU L7DnxzPkAe+WllZGgFwzOR0UfCOoD2jd/MKQiNBC5e/8UbLnxCVNMJR0blAGZQpCuGf5dg 7w02V7xeEJ4M97ieNZYJ3hMHAnWY9/mq/mfqg67peg0Re1DKxWfrgh1YkNwqVA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654430863; a=rsa-sha256; cv=none; b=vvBOnsvTpVltml4qar63o04239iXLMx8GpvWehOTbm8MOeBNdAiljgKIKSmLqbZobT3fWD gEgR6KFangbaW959csT3omChCpW414kvhuSgKFQrQHNXSwiHcWOMSl6SmLn8zKZ6Gu29dB 4BrLt5V07e/xtmjv2cPvUcJsC5h2auGJFKN2gOWME/bCXdkL4moXe79Yk0iikrpbwODTY0 ofh9kYI8vAshKWLsqdm482QJhbubx8qZnoJIC99Fz2yLSlLc96ELsMj3Z/jYFkVkcGWxpm 0KVUKEdlcvsIJe9gfgysxM1PvSebZXr2pmsP6Pq90LoP8AQcQKm6kiHJUPFoFQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #16 from crb --- It may indeed be power. I was in the BIOS today and see that the BIOS/motherboard has the capability to show the power supply levels. Here = is what it shows: Nominal Actual =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 3.3v 2.928v 5.0v 4.779v 12.0v 11.597v I know that there is a tolerance but I don't know what this is for these bu= ses. However I do see that the 2.928v values is highlighted in red in the BIOS w= hich I suppose must mean that it's out of spec. I guess I'll have to see if I can get a replacement power supply and see how that works. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 15:09:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8CCCF1BECD98 for ; Sun, 5 Jun 2022 15:09:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGKlW4cWjz4XYh for ; Sun, 5 Jun 2022 15:09:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 196AA14051 for ; Sun, 5 Jun 2022 15:09:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 255F95q9043896 for ; Sun, 5 Jun 2022 15:09:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 255F95TC043895 for fs@FreeBSD.org; Sun, 5 Jun 2022 15:09:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 15:09:05 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654441751; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vwgIFDpmtXvMIEA++IA8WZdfpWQiENRGxY95raOCCEo=; b=dOZlarA52Qi/ogvHCWi/Wt1TyAeFsBpW+6oC0rPFC2wq1chbB6rMOUIDPBnM0cyqFhFyna AT1IzOMzO2EJpMEpjESISWpott4UWyuM8PDkCLTgu+ij1KrW1LwbV1oATd+Srmcg1V3OX6 hlN0EU3yk9nUQk6ZF51UdQShY7Inqh6IRGW8anIX1ILu//trgVOa9kc3L8PFk+Haz62/OS M4jiJteQYm2ldPTQVfeIFko3BN7Sz/Uh89P2DZIHQEJlHsraMBQ4WEgLfOrQPAb9jCrEaU 15xt9wK6wbOhVmhQaB6xJeIN2QblBaWy/aiHqaOYoWKc16CQLq2cGP8KER/lQg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654441751; a=rsa-sha256; cv=none; b=dwtE6APeLnfMM3Q8jv5v6TNY84XSMT1pYZ7Z2raypCODNUQL3a2YcaOyL6R7KLxfYh10e1 vQwoPRaLbfKSOmh/LR4AgyXXHiES2X7bcyqJtp9b0idRdKY+gJs3lT26sy2N7/+1XcNt00 U6yMCh4vvVNbSCRATGKwG/prOjKyJ3oOG4Dvx7wHPsg6adFVnxY1Wm670sQ/rk1PElCCsw 9WQGdWVtLtvF0GRHGPBmEP9ue+yIH5k6aBDWNWQoWLH1h878vQOiWPvakvJDHp+cYPXY02 h77FYEIUpBs463tvB/9Mj4oG8H/3KY3VU7jg9Rh/rtSnmUO5w3ZYR0eF9cwWcg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #10 from Kirk McKusick --- (In reply to Martin Birgmeier from comment #9) Code 3 is when an attempt is made to read a block that has a bad magic numb= er. When disks are added the tasting code looks in up to four places to try and find a superblock and most of them fail with a bad magic number. So code 3 failures are expected. I probably should not have added that failure code. = But the good news is that you are not getting any other failure codes and you a= re able to mount your filesystem. So I did manage to track down the cause of y= our failure. Thanks for the 1M image of your filesystem as that is what enabled= me to track down the cause of your failure. I will do some cleanup of the code= and get it checked in. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jun 5 16:13:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 812AA1BD835B for ; Sun, 5 Jun 2022 16:13:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGM9z2p91z4jtW for ; Sun, 5 Jun 2022 16:13:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E653B152E1 for ; Sun, 5 Jun 2022 16:13:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 255GDgpg080643 for ; Sun, 5 Jun 2022 16:13:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 255GDglo080642 for fs@FreeBSD.org; Sun, 5 Jun 2022 16:13:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 16:13:42 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654445623; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RbSc91VxkKPLr41nXHeOFC30NQcjxZAhlC2wiM8UZtw=; b=a0NuwFMQCHKwBYkElfeUOu1/IrNCa6qrmRD/0ZCN5p9pjH/T066It25xtz2zYKs2q6mJ63 oWrIfK2tFRUyBTaqVocMMFewOT54EwHp/Wn13ZE2zbPFnwhCWIkw/HM7TN6iRZRJ0MRf+H iCAsZulTyswPsuFckYJc0EyKm9PhvrosVkfuk2nJGO8DsCOQxBtwEfCuJrL8KAnyC+duYc tOv7jiP4HGu+ZjrEGJU3V6/qpyoEwKDjWEH761Ss75W+ItVdANhY6clH3H4g5kiD8g/eDC Z25c6Ome7/3MxqUL+DDRZQeG3dJjgJ5v2JS7RmaE15hrYu0JEgezsrPPZ+uOUA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654445623; a=rsa-sha256; cv=none; b=KML5GyyXQw7dgeRBPQa1+4xfoNYyIh4n+F1BBE/gE6vV7UGmzwSgIMCzTKZjzaAva7J25p 5BTTBDPsnKfjn17m6E+C9bnmAi/ea8nKqj3jjg7cxIyaAPQkAFj9SWop3bNweQLCKd8Hzh pQ0PCnKTFFCneanQD0cItOuq/GkoYqQ1raJZgK3Ohhdu1kVSJRtkuUIbMEB4o0d0Edd3yi V1/tYKJskps+XUdXnO/SQYILNBqqDzkHAUxBVCixtrG9EiPSUhj59/2pJtEGR1nagzpB6w A4Ke6F8tt5omWOBt8xhiePRpsOzajo1dUEdOzI8RnRNhUf2BR/yN2m2qo/E+RQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #11 from Martin Birgmeier --- (In reply to Kirk McKusick from comment #10) Thank you very much for the quick solution! You should know that I am telling my wife and kids who you are and about yo= ur contributions to Unix, and that I admire your modest ways which lead you to still contribute to FreeBSD in your area of expertise and - even - fix someone's problems who is sitting 10,000 km away in Vienna, Austria. -- Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 16:16:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C6D521BD8AE0 for ; Sun, 5 Jun 2022 16:16:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGMF23Sy4z4kMt for ; Sun, 5 Jun 2022 16:16:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D9BCD14BF1 for ; Sun, 5 Jun 2022 16:16:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 255GGKub081052 for ; Sun, 5 Jun 2022 16:16:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 255GGKAW081051 for fs@FreeBSD.org; Sun, 5 Jun 2022 16:16:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 05 Jun 2022 16:16:20 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654445782; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Joq299dhKeejZrq3Amuy8WhNSGGo/joDsOeG5xaUzxg=; b=nmzbdIllu1HQ1aw1DnRC0TDZx2dF+Zb3y0e+DWeYOACtGYksFyCYp0B6hXamZVnJcF1Uqq 7v2cp4FoTEsuDCqv5MfBobdbSvC3wMdEholFd20IcPnC0ENWkyM3rhfEA3KPWbea6FsSrW 80wHM2HU27hFJ/J5npwhv7pNtCTb+Pi1P4u9fZ9f5ClotTtoONmix+kTcJkRlYf8VH7ANb kqbzT9qRYLxH8Iv+rfK1Eq5RN0ehuqJYH1w1sgsEp+Ew08cvIPOv7l50BBrxqXb58wLjwU YwM0EsorGinxnakOU25vp2uMTU8xyzrJYPAxpYLGzUTLoJ391uC9SyWQlzVWjg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654445782; a=rsa-sha256; cv=none; b=nYE59a2WkvorceFZ+cJDJY5TQKc1xlVcixgtPKSRw7+605d58deZtdFb9bKTMFf3otJyKY IFvojwVzPZDn6rSSmegGzbBWqiMwSSDVCnEn4nssF6mPU8kru7r0ZvPzNs9y/RqFfl1nUr hPkzkCVO8kFxI/wcM1FL1S99WGhCKQnhGlW2FrnSTWCROmMnK9F/5AriK8B822IqPJdvuV AJ2qIX73P7MByN+FJgfzv8qAaJNPnSTh/n9nZT2bIiCeCySa+sO1mXQ7feIB0df+og7m5X AeGEPOY4b6WK/CHqrkyGN9LwrhoBUYYxjyNY/n8eRjEJXoyfY1gIIG46jDbdGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #12 from Graham Perrin --- (In reply to Martin Birgmeier from comment #11) =E2=80=A6 a round of applause, echoes =E2=80=A6 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 5 21:00:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B427D1BDE795 for ; Sun, 5 Jun 2022 21:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGTYR6QLRz3pnK for ; Sun, 5 Jun 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ADA6F191CC for ; Sun, 5 Jun 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 255L0xT3032505 for ; Sun, 5 Jun 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 255L0x3E032504 for fs@FreeBSD.org; Sun, 5 Jun 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202206052100.255L0x3E032504@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 5 Jun 2022 21:00:59 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16544628593.D9F35b.29247" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654462860; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jaUULiuLa58kaq7xfmlZZYXTI2b7G2jshsfMQcfpiHM=; b=v+0IDTcK/DXoHAYzsmT60srhgUdMvVyoWEg4mfAnBGfxjnDmCDSqx29kTJJWINSV+SiVCh n4gpyyC16yKCX1T5gdurJEsxjoly4lJqoOLM4asSMyu1y1afPtxj6vFOEkcOyjxyaIw6Eu 2L6a2EYxvRgYxvsOj5lLZSypBs/s8/guv7/VS0vCBqNnP1QXG7zxoAPovaiJ7DDszTOrhE sxnmjkpKs97sE7CZ4e9oAPcDZBkfIbcwjmFOicnTcoUPSLZ/jJ1EjoFrzn0mndLcPSsWNP S8/epVIgL1Bc/0UTdUaPqxODxW+cbN/ErdAnQvMKXSZ73K0bluwBrQ77wL78Gg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654462860; a=rsa-sha256; cv=none; b=TX09de0jI5493cPgSSSvrul+S5e/8IXIDjRhsSbYw+GNDouCcRl5rBKPPItUHPgbKYfKke CwA8r5M9HUs1uZJgtWXovjmfs1dyhpzn7j9+WtQFhUmDS636RurgJZ5ZUMK9iSxp/xxPvk z5VF4BA/2HWMJJ9ck61RgAJsZgIqYKR+tDfliPjF6wqAuJG7fzNFUaMMrWrZ8+C+/eu4cE NMPb8RoAb7ppDanYbp2+VJ2DtKtKjSx80IUij1SB+PqZvuV/Kgi0wvtHXwvd/YGJUOg5Ow o7XZTKFQFC/3O514vEats9d+OnzyEUamREyImlZ8f9VQqUm50SoxIqUF1IcrkA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16544628593.D9F35b.29247 Date: Sun, 5 Jun 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16544628593.D9F35b.29247 Date: Sun, 5 Jun 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16544628593.D9F35b.29247-- From nobody Mon Jun 6 15:42:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9DFB91BE5DBE for ; Mon, 6 Jun 2022 15:42:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGyR026gFz4X5l for ; Mon, 6 Jun 2022 15:42:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B2CBDE0B for ; Mon, 6 Jun 2022 15:42:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256Fg3Yw031809 for ; Mon, 6 Jun 2022 15:42:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256Fg3ra031808 for fs@FreeBSD.org; Mon, 6 Jun 2022 15:42:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264174] Use of redaction bookmarks or redacted datasets on a boot pool renders the pool unbootable Date: Mon, 06 Jun 2022 15:42:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654530124; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eFj25FtDsYKSoIw+zO1nB2o90nOzUcxW1YDSKJmIje4=; b=nf5Fz8VMcYLOdQXeUJYdBMhXhoeBt73rbeQUy+1UDZMBKi/BMBOJRSB4+k84IBXLMwHBaU 6wqqHahHe50D6CPs7Gb7frP6PMbhTnIDrAMYa+jXLw35Mg+Zft8XOsg2ZsR/89bULVxJR/ vCONcFTmXaH+h8Jcq09SF+2vhU56FGK1aWyT/7cHPA4FND6sp7npgtYSIG5eiVLIovATS3 mMvuYFs++5fj5KPxCvd62ta8kDLABdYJjroDVLzSGk/X2JMKnNSgXUxmIqzmOaldpHBWm9 CuKg8Gp7pTgRBwpNIzrFwrPaTIIh5GzHLuBIPZ6c0t8/9fNQ1i3OeMd+g4MbAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654530124; a=rsa-sha256; cv=none; b=fmMptoTvwhVR2uvzo3i0JEBUNtj53NV8/wD8qTazY1A7McjN/IJqm0lhxcZYGvShYPNfqa KGcwW1ROLqM1hTxEf2qpLsjy7I94aJvd7/ycjTz9dOiMH3+9VzXcG3aeeO4Hb9/Nx8b4+h 6rXrV3Ksjp4T8RMvElx5VERC2p+LlBiRvbUlanu6b309/0H04zDSSPAy/SrM598ULOmOV9 XGweww1vzGZ/3zgMz+CnGjvsE+OQMxkxiagPKdxuhx2plUSmqWCV+kze+nHo1WNVCQH+lB fxgSetM6cU5T5T0DNC5yBp/XGu7Zx5XkNFxmH9WsetJMJFn6OIHhwbKJzEXpVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264174 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open --- Comment #1 from Mark Johnston --- I haven't yet attempted to reproduce this, but the described behaviour of enabling a read-only-incompatible feature upon receiving a dataset sounds q= uite wrong. I do see the following in recv_begin_check_feature_flags_impl(): 543 /* 544 * Receiving redacted streams requires that redacted datasets = are 545 * enabled. 546 */ 547 if ((featureflags & DMU_BACKUP_FEATURE_REDACTED) && 548 !spa_feature_is_enabled(spa, SPA_FEATURE_REDACTED_DATASETS= )) 549 return (SET_ERROR(ENOTSUP)); so it seems that we are indeed checking this. Perhaps that's not sufficient somehow. Of course, ideally we could handle these features in the loader. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 6 16:21:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C4E721BED53A for ; Mon, 6 Jun 2022 16:21:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LGzJs3XvQz4g40 for ; Mon, 6 Jun 2022 16:21:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D1AB41338 for ; Mon, 6 Jun 2022 16:21:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256GLm6J054521 for ; Mon, 6 Jun 2022 16:21:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256GLmGo054520 for fs@FreeBSD.org; Mon, 6 Jun 2022 16:21:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Mon, 06 Jun 2022 16:21:48 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chuck@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654532509; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uWmGqkc69fyEqJ+gNH0kSZcVPkGftM2oML3z/FChQkI=; b=T0mPp1t6sdkSmcNcg/5b+a+uF8YtVAHu7gaSEu1AIVLiEIp2/jWxy+EfgWuJhvwt7PFlzu aFHrF7FKYbpsw7Zpu/wlcguCcqBBmGVD7op2KWsDEeG6nxD6Ssyd5tW5HOwxOIkmY2hypy 7hnwewa+3P7T2PE8ohMcKQP43lYQ7FmHhSF/WNjlItY2ZS8GYq24tRzueAUGlgjU8WiFa/ 1Dqib08SDsqfXdZGCyh+1vDwDbKIcr6ldWb8svAWO2pRyC+j7ucexNbNz+dKlFFj2G1ikh 0NsSHoF2rWszgJvC+tNjG6N9lL0PMjUtRzl70FqMobCDe6PQ8jyCaoIcT9oQ3w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654532509; a=rsa-sha256; cv=none; b=HQmQ3Jxso6Qk+WnTNmlqFI7SWl7tJhFIO+Tk69uG1ktAoQoDZDl75koYBXU91CaA59Xdok kb8YCD6wDbqoGq6VrBY0M+rjAZCWoIIkQzbYCD1nUHZjd524RQk3OEkscWZq65MpQ397QF xpVJ3Jm47q8rwQhLsVVPuIg0aqtf4Kcb5DKTgiFS8U7dxLcqClAWnty4gVhP1L9oeIiCAf I0lHBQm829lwESRhh4JcIHQ8CSb2rKrAso7Z4IjreH9lhkD9XCgyUrYxhenEHJgr136+o7 7E/Xx32EzejM+xc0UYmgYtsRQTf6YzO9Eal5pISO3FnZh/khvJPGGDUn02Adpg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 Chuck Tuffli changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |chuck@FreeBSD.org --- Comment #17 from Chuck Tuffli --- (In reply to Warner Losh from comment #15) But if the card thinks it has been powered off, I'd expect to see the driver need to reinitialize BARs, the CC register, queues, etc. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon Jun 6 16:58:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CAB1A1BD3747 for ; Mon, 6 Jun 2022 16:58:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LH0754Zqpz4jmg for ; Mon, 6 Jun 2022 16:58:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 60F741DAC for ; Mon, 6 Jun 2022 16:58:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256GwPnu073788 for ; Mon, 6 Jun 2022 16:58:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256GwP5c073787 for fs@FreeBSD.org; Mon, 6 Jun 2022 16:58:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Mon, 06 Jun 2022 16:58:25 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654534705; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fKTh0zc2GMHHgPFP+GOqQFr7qt1jNv8h0Feo8oq5Yxo=; b=KJoilKmGtrdoP/mHATxXrNXNfF+4jKl5EX4XJu76O6MfAvEUV0WLOKjhJ67N6LpYS+DDFM Vm+7rKfbeNjkOpMHOvJUQ3xeRevOhBGsfnpVt39/I2kXdGC4ffYO+giRBSs2pZAhqalInd ImBfSWzZsEkRarBYHbmdGfkGHhYnsw+RDYP/v6dX6bvBLcK5ZoUk39TvAoPJ9bfAITAjeX 015m1Ix3bSb4kGIJZapOU/iPJf3sNsZdguJupRudulhWGRaFbZWm6O7BBLIHV53lR+d4q2 gE2Q+tuXv+5l9PNWPy0HeO2JHJMW8MzsqlPZwwM2EeQz3Yk33GzZWtFl4214/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654534705; a=rsa-sha256; cv=none; b=iYn9AkcdWGOTP2sjECHRw6JSTAviWc0u0NFbxmKT95x72gbNcyjK/IJ04B61eDnVVPbATf 7MZEF8cM9h0CK3WXB+uDTisLoi3VHIVVj1eVFoaXgbk0l8qO9u/qKyUqw58I4irVYsXtur LBbeKmwjRVF5r5Z062jwYB9TTCARFlkTrWwcH81RDPt0OJ6Ah/TZqwriGE1lXGZ7t4ZFlk p0spEfKT4J2nXovda6vZQG6BUCCd1LwapxkDI0l6sz7Ee9TohPI4L+BKpwfUHD+M2LBpFr RqNVwS+sCvi1DRg88/90gSx/9ekGtOmvrjFmmZHY4uqrDHy5WUVpxKGSxwBwOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #18 from Warner Losh --- (In reply to Chuck Tuffli from comment #17) Currently, we don't try to do a FULL RESET of the slot. That's the next ste= p in recovery, and that would drop the link, bring it back up and reset the BARs which are lost in this process. If the card has powered off and back on quickly, that would be the last step in recovery. We don't currently do tha= t, but could add that. We'll also need to bring in the DPC changes Scott Long = did before starting a new job that doesn't let him contribute, but it's unclear= if that's in play here or not. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Jun 6 16:59:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C0F791BD3E85 for ; Mon, 6 Jun 2022 16:59:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LH08N49xKz4kJd for ; Mon, 6 Jun 2022 16:59:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6708A1DAE for ; Mon, 6 Jun 2022 16:59:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256GxW4f074017 for ; Mon, 6 Jun 2022 16:59:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256GxWKq074016 for fs@FreeBSD.org; Mon, 6 Jun 2022 16:59:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Mon, 06 Jun 2022 16:59:32 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654534772; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=C76LfcvU6W+92pqDpY92h0pUbrAP54Wy/Okm//ChecI=; b=RVfL7teUfIYbkgtCLieSyox1vTJQ0tGzF/2/TIJtIP4RQQJE2TLfr/i2U0xOck8WuyaQJC qzXq8akT+Pkj28AUFOx3NFo1tKzuJtTfpk+Sj0bjzd1CWyGl2xzTLI9kjxizJfU4bDu7rJ ajsurRhTa60A3IIL5viIqq8AqDzuyL/JNpdZ2VKWmv7KVasjEI/Y1/Ztf12l5yGSlW+kpV Ss0Bhzyy0uz7Ulr9wYUyWAI/ZoWiGIRXgk8WknakxnR8axCauIusuURCuRx4YXWMyl3M6F HJJtvXoolyN5J9fo4YLAD1jTcqj38CM42pTe5ExaNgKKPMAmInCa4NbJ+MPBrQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654534772; a=rsa-sha256; cv=none; b=segA/X1nfZtOBf5Feq+I5jGneRNuR0A8PPP+8Z3np3Z23NKN84Bffo9hFIMpElRfGAHa8S t1+rkBY5OhOm4HGjjRgMqCuKxPTQQrv/m5occwl/dcHYSzKVjAkdkglRS8Y0uZQ+ZTsy5V x5diaXGi0GSMst3Gnds3Miu9L8Dz3r5YkX86yIzxm5I8eWz+9BPxmyXFpj/uJBPMJRXFhT Y5yGjJHCTpUKsbaeTDaiwFdFGqZueHh5kB99E9DfOukgS4G51X5omEZHOEcN7Bu73IjMOR NaNTuydRDgDs6svlbdATrIwLdsrjN8OJVbyrQ4T2uj4CgDFWJRn4ZuH603Dp+A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #19 from Warner Losh --- In addition, no other driver in the tree that I've seen tries to deal with = the fast off/on situation that I think we're seeing in this bug. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon Jun 6 17:18:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 557BE1BD749B for ; Mon, 6 Jun 2022 17:18:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LH0ZZ2FCBz4mHX for ; Mon, 6 Jun 2022 17:18:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7C1D31FD8 for ; Mon, 6 Jun 2022 17:18:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256HIaYP086146 for ; Mon, 6 Jun 2022 17:18:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256HIa3S086145 for fs@FreeBSD.org; Mon, 6 Jun 2022 17:18:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Mon, 06 Jun 2022 17:18:35 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: chuck@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654535926; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iNHOjrK/KkYfFK7sMNGYl+wcNAYAv83fpmjM5HyTKiY=; b=SYsjLWPsllOm41czPtpoHDdK6tkDT+zC92jh0LTXN+QzIuM3L6Qny6q9goT3XiHIPVSXea 7xQ/YpRSXjmajhKY56IAkcitkNrtb2JvFWIDvuETMPQL2L9A9HksQgmBbTACiFRNlcWqR7 2ZHFkJ/gAEqwHkVM41H4QscB9H6TV33fB9qjDAd/QmF+uuFXRhfH+fYHU/GUs8umOkVS6T G4EcuV/qhs2ddjGe+o4mWI9jT2oWTSOKucL4Nw2rlb1d8j3tFt3c6YhEXSb1g6Uxb3cQsW jYRAT7kbY/MT24e5Ei3YCbcWvJ9ymnyiSKIygV8AgQ7hLFEdFKpke/YSpYD4Zw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654535926; a=rsa-sha256; cv=none; b=eIsaV3NuiGee5JvJmkTSVM6qPpRb/+cZ8bDz+z14ffYjnmBYtB0C9d+dch7gS9fmYTCGer bx3T29rk1r+WIds1wKhGGzxiD1rmTh/YIUp6n8EOcnkN/PnJVUgxL/72Ude9EgP1AfnKti VYarnRYzZIaGjn6LvV4aF7obyx2jqo3SMXmhECTIzvoV0B6pi3+qYW5d5MKGR0pxBnUPAK aO3F3JVh7VR7u8yVrcXa3YVFt2JkzkjquIJSDVJemfpvaqRdcJzwOg1wS2F8NJrKJQzAPb Fk8AAIdfPCp4SFR1E+csqshN+37eLIwvleOEkwMWOeCmQvRPq7OTPh4ktpz+Hg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #20 from Chuck Tuffli --- (In reply to Warner Losh from comment #18) Sorry, I wasn't clear. Looking at this from the device perspective, a power cycle is a PCI fundamental reset. So if the device was experiencing a power loss, I would expect the BARs to be zero, etc. after the power loss/glitch/whatever, similar to the state after the system initially powers up. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Jun 6 17:39:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 098811BDBA78 for ; Mon, 6 Jun 2022 17:39:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LH12d56QDz4pnX for ; Mon, 6 Jun 2022 17:39:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8616E22C9 for ; Mon, 6 Jun 2022 17:39:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256HdbTp097910 for ; Mon, 6 Jun 2022 17:39:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256Hdb0v097909 for fs@FreeBSD.org; Mon, 6 Jun 2022 17:39:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Mon, 06 Jun 2022 17:39:37 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654537177; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=I28AhTYf6FJOudLBgb3eTwreoC1vYda1iCJ9RRm8oq0=; b=STFX50TfCThqzctmDQuhyjt3hbJiZZXoM8tUWjQ/CDwBDuTUEDoMu3OocJIbWRsMKjkt9m A8Ykn8c3et75F2aSwCZ0ueGYH75U5HD7JAgs0LVemPJ82loLZCcA1MGv2/VHiPAIaAeSXa 3bpj19lxk4ikyhdCWVX69x8Pby/ka6gy/6qPrA1RWZ2aVFPJEF04hOiPIoTlpeOOexRZN5 W6G/TWRppA/DHukQYmEYrSu+LMZfkqky63U//xSVoCNMiP3d0VQQ/IkqOM9ABsbX5gTKHe UOZHeNyjCwLI0aVQ4F8yAVcLE9tD5MzZdzYhxF/hXkP4lVqscOtWWO/kiGSvGA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654537177; a=rsa-sha256; cv=none; b=aPpNd25t9YkUuwa53arhw3pSCkZezJnARl4lCbkFKWnA4l+79sXHfNTfvrrgcH8q1/Cami iiB7nJDzmuK/YoPwxRY2eSPNUnNnned6MOAhXRkkYVn8HTBnAiB2CZ4Rxbg2zqB7HSc6lz Mc3Q7pUalhKcvCsXYRTHoFsPBVl9tY+BhW0g45ckyshmfRzyxwcVoIA4vbnvY1LACL3EZp lZCwaWHRoqS6o2vOE+5EaXLa5eBt1fPwjyfab9O0SkRKoQJQB5XGPT9UFoI9zZh5/GefLa gwhHQXInePnKI9cE9/of6XBeaTrPQiYa8zLNLNHlcbCLnLxeP8AmItYTJrCOXQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #21 from Warner Losh --- (In reply to Chuck Tuffli from comment #20) Yea, that makes sense. It's why the 'hot plug' code triggered: no BAR programming means the old bar addresses will read/write 0xffffffff. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Jun 6 20:08:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C44E21BD5F93 for ; Mon, 6 Jun 2022 20:08:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LH4LP3X0Jz59D2 for ; Mon, 6 Jun 2022 20:08:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 520764BAB for ; Mon, 6 Jun 2022 20:08:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 256K8TUB082824 for ; Mon, 6 Jun 2022 20:08:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 256K8Th3082823 for fs@FreeBSD.org; Mon, 6 Jun 2022 20:08:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 209396] ZFS primarycache attribute affects secondary cache as well Date: Mon, 06 Jun 2022 20:08:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bdrewery@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654546109; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Ry0zL1YXdlAClRB9UBqn9bDrCdlNabC1aOBp6UigNs=; b=nn+u/gl3fMD6H/7RWPy4mhe+OGAswyRX8zVzjh1/EjHHXfjABH4p/H9met3c4NbNpaCcpn GFFEhQnoPeXMpEdJQBXIWOPM9xisQCteA57YtqD0iPb2af7X7UiJbsvqC028GA8F8fTih4 wQC70Wvizvm5GzylyDLXjFYXv8TDhFu9NOKW+GgLpFRGzVDbGV88teUqPN57r+sgnKKooI O21ns2aIilTFMvECIiKd1a5F/MYQDunVUyDusF6aFqzTs6Yyn0WNcpx3YHWJ77RsutrFf8 Ug378YY0ci06sC/atXq070jg7tbRWpc5+7XMI1O9sJH+nbGVhLFwCqao/b5TNA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654546109; a=rsa-sha256; cv=none; b=XltmimoD1vnOz6e9cvIuEL4OD3paIjt1XqVd1xh/huRcluV0ESl8pGgeIYYr+Tvmh9hwxS AsnntIzc97DPE2wUER9NPhVQwntl/ngOF8/ndj5f6UZYd6mkk9fujyENH9A0lDx8qE/9NZ +I9oy7uSRiYO5Sik0h0aHw3MbVZLdwttaLmBYGur6bA7aSlhRFqFQAFZ2HcwSvlqqTd0J1 yf904/RorGkncefkoSEadaXb3m8XWTOLrsLURM2zrnEFmQdthIwbhHQdrabqDdRPys0w9V TjuFUVksBIlO4IfKHaMtFkdWxsXPZRYJBiKwRREpXJ2a9HwtH6KUovLtsWog6A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209396 Bryan Drewery changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bdrewery@FreeBSD.org Status|New |Closed Resolution|--- |Works As Intended --- Comment #1 from Bryan Drewery --- I didn't realize this until today myself but this is working as intended. L= 2ARC only takes metadata/data from ARC before it is evicted. So if using primarycache=3Dmetadata then data can never make it to L2ARC since it was n= ot in the ARC. https://www.mail-archive.com/zfs-discuss@opensolaris.org/msg45601.html I can't find a great source for this (in a manpage) but the code spells it = out. sys/contrib/openzfs/module/zfs/arc.c * 2. The L2ARC attempts to cache data from the ARC before it is evicted. * It does this by periodically scanning buffers from the eviction-end of * the MFU and MRU ARC lists, copying them to the L2ARC devices if they = are * not already there. It scans until a headroom of buffers is satisfied, * which itself is a buffer for ARC eviction. [...] It also won't cache prefetched data by default. Apparently primarycache=3Dmetadata also effectively disables prefetch (https://github.com/openzfs/zfs/issues/1773) https://github.com/openzfs/zfs/issues/12028 discusses this primary bug's is= sue and the fact that this primary=3Dmetadata,secondary=3Dall setup can lead to= read amplification too. If I've misunderstood and your report is about the fact that already-cached-in-ARC data is not sent to L2arc and you think it should I t= hink a better place to report is https://github.com/openzfs/zfs anyway. I doubt = they would handle that as it's quite a hack to set primarycache=3Dall, cache a b= unch of data, and then change to metadata and expect it to fill up L2arc. Eventu= ally that data would leave the l2arc as well and you would need to manually do t= he hack over again. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 00:31:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C2C4F1BE0197 for ; Tue, 7 Jun 2022 00:31:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHB9c3r4Sz4cZk for ; Tue, 7 Jun 2022 00:31:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5E72A10A48 for ; Tue, 7 Jun 2022 00:31:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2570VGVD033907 for ; Tue, 7 Jun 2022 00:31:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2570VGfX033906 for fs@FreeBSD.org; Tue, 7 Jun 2022 00:31:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Tue, 07 Jun 2022 00:31:16 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654561876; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rJ9hylrVMbzevnFsMxjoYlZPlgoUBrREBadfsNGZtX4=; b=G8FD7Z21friyDx2m9N0cWVvGdZ4RlQNRpcrY+5y4p/QGCuZ5+LhLpJZaTg1OFYV89L2ODQ nLifn6NhozaBH0t54YPFx3jRF+H7fU++xTUivLOvi4DnVHQaOe4EZYcisknJFSz57oTLHC xfat+kgLA2PthcLxIaT3WYp17mJnbp7Pn0osdbbNdf5s/ytQF51fmg0awG6Ug2Jdv1wrVu bt1wNr6bOCcZKQtSuOlUM6aqFa7Q0DU+eqLcC6VBSK6BrQiINkHHmWxyRQcdFiXkraL8M+ gft37QVsYAeSgcEXP+s6zfYsIbNii7yQTR2g7pzin+QehYXq1se0OlG1FbpvXA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654561876; a=rsa-sha256; cv=none; b=xIBTp+TSxWLqynrOP36p4hzL8mbaupWk2sRBOT4tVKfhD+3TRbYzCzWtoXApa6XEvGYZdk jqXhi6yWtZvkQy1EhsV7mlCzq39zmwcTHytUQ5A4ip2a/9H6I49XN8Gyo9cGJlcvB+fbQR pS0ztH5c8Pw/r+XR9xWQF+BZ+Gt3o4Tf0T68CU81f7G516u8YtFpLw4560Pn++ak26abRI vP6rdAWdwRtY4hlMhGNdEbBzv67cf2PVLXIgTXsLwYtNmCmmcNFNrrMIzwsAl4HfNiYyUs 1mIUlMoWY40aG/eKMPxycNR5OFbd+HZ0OFbBUwtlByEPerGwVW61kEtXufkjQQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #13 from Kirk McKusick --- (In reply to Martin Birgmeier from comment #11) (In reply to Graham Perrin from comment #12) Thanks to both of you for your kind words. Since I was the one that broke t= he code, I do feel like it is my responsibility to fix it :-) Martin, I do hope to meet you at EuroBSD in September since it is being hel= d in Vienna. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Jun 7 04:51:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 92A031BE6CBC for ; Tue, 7 Jun 2022 04:51:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHHy31Gcgz3LVS for ; Tue, 7 Jun 2022 04:51:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8EA5C147B2 for ; Tue, 7 Jun 2022 04:51:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2574pcTx076497 for ; Tue, 7 Jun 2022 04:51:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2574pcJX076496 for fs@FreeBSD.org; Tue, 7 Jun 2022 04:51:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264174] Use of redaction bookmarks or redacted datasets on a boot pool renders the pool unbootable Date: Tue, 07 Jun 2022 04:51:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: astralblue@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654577499; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=33oyOBxTyZ94W6tO5XwRAr+c6VYYMZ+gG7l0reXLs0E=; b=oycxVDyeIhVCaIEfzl8FrNQswENlmw57wpsRFWWSUguioX2xi6zTT1vflCTt/RIRUHWTyi M5HnNHkEUsJQ8024I61tBbthVdJ9sVSypLhy3MlUJqgYOF820jOxvXvTLr/pDJBH8VSjP8 J7/Pbo9DsZ7wgmi60WHWQKnOBFZzLFLWX6Ssv5FgFcsfiF+2uwk2A7gzSHE1YoEK7avJ/o ehDlT6D8Z1py00pHkhO19xSHMm/IxQFtgdzItBdh4VZBnap08jS6xDSZ5rhmREH6deVAlp REyh4ob96Bjh0FoPgruIAsd5uEnZICz85uOrQIdbOtFdT5+va2XEu3mqVxQOsA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654577499; a=rsa-sha256; cv=none; b=euWYGl8VWzPVD7FXQQFfA8aiSV4t1VINLiuxPRvejFHaYZngK0o6spcYMumnhKNeTABjHm VCp+Ymdxl+dVFNIS+54YqijUfWjTjNLauTnBtwuMD+nzrJP1DI+xFwJWbbY2NoV3U5BZyo 4h2hlWYuriELz+zJ6XN4kZdtDOe4pjVV9jq8iSOHWvlxcVUb5jiqKl78O0xRyRAUGLiG09 Wt1unAnLNDwLWqOjFr1rjQd5OG3XdEqiyPGa/tQmUtUvd2B9E8aswu2Exlu8bjIOU0AF+U psipw+V2CzfI5/WQ+wlvW4cXySvr0dXERbQ64cnickhNRvtEZIWcab7G4OWIfw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264174 --- Comment #2 from Eugene M. Kim --- (In reply to Mark Johnston from comment #1) Feature flags are tri-state: * disabled - the feature cannot be used in the pool. * enabled (but inactive) - the feature can be used, but is not currently in use. * active (implies enabled) - the feature can be used, and is in use. The quoted piece of code prevents pools with redacted_datasets feature disa= bled from receiving redacted streams, whereas the bug is about receiving redacted streams in a pool with the feature already enabled (but inactive), resultin= g in the feature state transitioning from enabled to active. The boot loader rejects the pool if a non-whitelisted read-only-incompatible feature is active; enabled is fine. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 05:00:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5A2C51BE80C6 for ; Tue, 7 Jun 2022 05:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHJ8X08b0z3M48 for ; Tue, 7 Jun 2022 05:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 566B7145DE for ; Tue, 7 Jun 2022 05:00:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25750hCQ080737 for ; Tue, 7 Jun 2022 05:00:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25750h8k080736 for fs@FreeBSD.org; Tue, 7 Jun 2022 05:00:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264174] Use of redaction bookmarks or redacted datasets on a boot pool renders the pool unbootable Date: Tue, 07 Jun 2022 05:00:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: astralblue@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654578044; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VrHpj40OgfUyqIYlC4FZli2atyHK5B8S9cusi2AcGSI=; b=i9frX7rifW7EFPLj1lgDXucHxCIi0N7cJLPro0Rc9dyIu9hd1DrXGp1v6GwphcyDDJzdq1 F3g5qrbvT12z2k5/EMQ/SLwWHt5TsVhT5A+rZ3xilaRctmehj67n+C3ly15SkND14S02F8 i+JUMGKHB7bIX4/4pz8VeXl7ecrjPvknJPjLbZO4o7Wpa/zwbRT5bgq+YIpbILsDRC6VeU QgIP6sgpuYgcaBXgdUeYyYuVFEJ/mAQ6DES58CEGJSlOPMO0ErInXu0HBXzFS/im4+302Y E8+Q0GO/nbdsYPKu8EutkOv+i28/mb/sVmsDeu+OH8KmssrLJSbEep38K/zXYQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654578044; a=rsa-sha256; cv=none; b=RG0/cuG8uY9M6dv0Lfdx/lJt170HEtV0q13b2TTu754FNpJZfHwYf+ifBL/g6V8Q0CuaaZ s32/n5gTLgRZdiGRtr78y/YvmWddwOcS7cwiz05a/ib+lYZb2RPdnkLBADo2a1c3n0seM5 tch42ycpsSDSZmSP8QskGOUsA6Nj4nv9yBF6ahsW/hNNR+Mw9J3dnpa4ac5D2fRWHokvD1 5igDYsVNIXNnItBhszUZorjSzT7u29W7eb2oFPxi6t/tKHY1zed1WcdcKEQ4I/G9any7xi ew6vUdg/3LEo97Lrsyszv0UPlwrd8IzPfXrG5LQzlxsaLbqTUs37neqiZeLMZA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264174 --- Comment #3 from Eugene M. Kim --- (In reply to Eugene M. Kim from comment #2) > Feature flags are tri-state: I meant feature properties (of zpool), not feature flags (of zstream). Sor= ry for the confusion! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 13:35:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 83CFC3EAB72 for ; Tue, 7 Jun 2022 13:35:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHWZJ1XmJz3jh1 for ; Tue, 7 Jun 2022 13:35:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 117301BE9D for ; Tue, 7 Jun 2022 13:35:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 257DZJrm073301 for ; Tue, 7 Jun 2022 13:35:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 257DZJCM073299 for fs@FreeBSD.org; Tue, 7 Jun 2022 13:35:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Tue, 07 Jun 2022 13:35:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gldisater@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654608920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CQK+F7raatAb94UoVM/+7BOAHyVdnR72G+R0o+qzmF0=; b=tww+jkA6YG15eZNBC2uRdRtNld+hyLbdmokoUcC2AR7InrxocgWPXKG22CRDstNQourGs+ O6X4MmpKvKdjnWq+7BhWZFxEYs4l9yjuNt1Ya4ae5Yhjp1ANRLqmuFZ0w1eKmBtAwwI+Gn qL1SVnzRGlpibKXSiVNceqkVZ7WGUw8OfnYUT4bK79/4gz6RH4gUSSGgkSxtKPOcJIv+DA zfPACWQ8P0O1Zv47n1Mvr8g/1uD3yM/4qLLF5MrQo9itdMtTRXlpWyIv58LzJDY81iynRt F00APjMjGbWmdWfA4rEQo7xKU6D3PvYPVGlYFfuxIYXBmbQAtoJIUSQ3/fzG/Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654608920; a=rsa-sha256; cv=none; b=pYVMUJ/mofXKxY0e4gic/9JBmwXAM/km14n8DuXcPbdwUTDXSzMrwWTZ7ayz5wbPbqRJEs /LyAyhXEYsAckxHEhBGdnbAkHnNrgtqP1mkLHQGyhGrxvLba+9I4jkKhG4kURlX01rStg7 gTxOXeMjAaJvuRYhO8nHn0QCOv2Z3vl+yYnJGDoqQ/1S53AbJClF3iqDC0XD6xaWHNo5pX RIOW9Hid7VYI8kS7fibiY50Iz5rFw2ZoOvsL0PGRcrfEFjuhbv5ieXHvtzr9rYP9e9dxPq o1SAgtZXwu7c0agyXRku95NRB8iyXbmLsZNAkt5/DSlvAqLcJTLQJccQVLRhbw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 Jeremy Faulkner changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #222488|0 |1 is obsolete| | --- Comment #4 from Jeremy Faulkner --- Created attachment 234523 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234523&action= =3Dedit OCF KASSERT password After BSDCan I revisited this patch and found that the man page and one of = the KASSERTs that lead me to attempt to work around the asserts were removed/changed. This patch to change another assert to allow a 128K data buffer to be checksumed into a 256bit output buffer permits the offload of SHA256 from ZFS. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 13:36:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 62E2D3EB1EB for ; Tue, 7 Jun 2022 13:36:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHWbl1fhRz3jpw for ; Tue, 7 Jun 2022 13:36:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1990A1B769 for ; Tue, 7 Jun 2022 13:36:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 257DaZC6073650 for ; Tue, 7 Jun 2022 13:36:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 257DaZXG073649 for fs@FreeBSD.org; Tue, 7 Jun 2022 13:36:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Tue, 07 Jun 2022 13:36:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gldisater@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.description Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654608995; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IlbmhbkMW8HuaC8ZyS8tVekaI7ngHl7VTqQ5tK3IssM=; b=KkZZTRFmq/zeVI+pgHoCD6UhckVy79sh5lDC0mZgEuD3fTAHgID4eSLBzlyRSUAJ1L6j3O /yTVv2lYUHQ69POZTLl6SzWPgWcqY/tCbUzZUbxWPWgf8ZtKitfZNx0WlDBofL/9S88zuT zkZizu+3Oe0x0ZNT971FHZwCY2jhLV4sIjT/7fbhsBGH6gFB61/LtO7WTpJUE5IkC8TlHN Q+hVWrZnn9U5meZ+4KQ3TgKfxO2WMc/5hLLN7UQ7ov0OHE/oidzb50G/e/Me4ITtS/g5iY z92XM1vAoG3O9XR+AqJDw0xV4Y+VGFoKfCiwE31mFSJ4kO4kuaieWDxEAKM8mw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654608995; a=rsa-sha256; cv=none; b=p1EURXgZ7GIHpmKvffBAdct3i3oJorLHNCbtDyebi0GQqmc3CVgq+z+LMh+yHszWaYKKoV Q8VlWJP9WsMo20WzD157o9Q3yt85daE3chIUFX7pIPFUzjxcZJUeaNqacT4MoOaCT4A9bO LHAj8z1oi3tJguFyzx+7RiGBkclkX4hbDc+z6r2jiAxJ4xbdZPqTI1DIcztz606KkGeRor La1y/hq4v0yCbTarRklrzowGXauGu/Bth2zd8+1DoHu8aw54GLjpYt1ExtNjEOiPZJwJIF 0WKoAR+f0/DZ/d4PCBYbdC7QSEY4FrPW9AmLYX+sYU0i60TuN0tJbVmYW3z4bA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 Jeremy Faulkner changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #234523|OCF KASSERT password |OCF KASSERT patch description| | --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 15:13:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9A2607FA425 for ; Tue, 7 Jun 2022 15:13:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHYm63Gn2z4YB4 for ; Tue, 7 Jun 2022 15:13:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 508A61D054 for ; Tue, 7 Jun 2022 15:13:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 257FDwtZ031234 for ; Tue, 7 Jun 2022 15:13:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 257FDw10031233 for fs@FreeBSD.org; Tue, 7 Jun 2022 15:13:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Tue, 07 Jun 2022 15:13:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654614838; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7jpTcsFj5Yr7pyaeBIqjGgeiM30m673bORnrggK/eSM=; b=i0iCnI+xPYu3+3bH6zekxVZGccKaKNQs4dq8iD84dBG6UZRA3/ueM+DYx8poeYsHcD4o43 1VTYORn+wN5RsSYK4Pc+j+aao0sS2TxjuHjHvWrDuGu4e062/2Y68Ct6z6rikm98MfDv6i 9+EPubkecqpHra7u71LZQzFt3WgLwHfUpTFbPOCoGFUGA/zzjP4PJaQtJZ3OpuKwlFtuN2 U4surx3bBjuGraEn4w4iez7vtGfKVyoXSyl94JxewJcXO3Np8/cy+G/ozJEAbG9EnAmqT2 JP6TI3cjAokJXtnCZvOnF+KQP8xipz8ry+GF14RCdFExgmPyWJZt+HJSX66yXw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654614838; a=rsa-sha256; cv=none; b=QU6LzLHv31hlQYz4BGB4fnBwRW5jZRCxMIsMbZHTBl5onP1nMzpheY330C+DW6ihomhGWZ nzaKY53OvUZhgZZ4uA9dDi0/BZwJ4gbqh2wNyPjEfnSL9OCwM/dMXGxRcT45u0yGXp23b/ J91YwGqtAxF5CwJHMUR8c6xtNKoGemjWwmLk4S7uAz1vKT//xPosInFOB699RE9uL1kN2W DMTZTrbM6GDKacMhVYLRp9BRoFB7iMt03SeEDD7of1TfBbgJMyL8WmR+30oXuYVvTBQtU5 V7KIy21LNZn2sdZJ1kF50gAafhm40cXSnVYQpwRyX5tGB3DKC95a3sw22Tl8ig== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 --- Comment #5 from John Baldwin --- I don't think the patch is correct. I think the issue is probably that you aren't using a separate output buffer, and in the case that we aren't using= a separate buffer, we should just assert that the output_payload_start is 0 a= nd not check it otherwise. Or perhaps you are using the output only for the digest and not doing encryption? In that case your patch might indeed be correct. I think though in that case we'd like to assert that payload_output_start is not used (i.e. 0), something like: if (csp->mode =3D=3D CSP_MODE_DIGEST) KASSERT(payload_output_start =3D=3D 0) else /* existing test that output region fits in olen */ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 7 18:25:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 38596834A0E for ; Tue, 7 Jun 2022 18:25:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHf1R0Cvyz3JMq for ; Tue, 7 Jun 2022 18:25:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DC33B20116 for ; Tue, 7 Jun 2022 18:25:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 257IPkGS039186 for ; Tue, 7 Jun 2022 18:25:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 257IPksN039185 for fs@FreeBSD.org; Tue, 7 Jun 2022 18:25:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Tue, 07 Jun 2022 18:25:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gldisater@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654626347; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vS6F1gydw5Fg3cJLDb2N/lDBqHuT3ZbS/Crfq63vCsg=; b=Fsa+VkUR9c0XjJutggdEg5qTlEEoPzw7rdTgsjJyR2NrDq6yKi6fKbknb0B54zIp5m4HAW o6+PBdRUPKW3QiWhgDYPnsdgSf0Y+FuIZSBvFxEdLYCsvfp7EIEZ/Pa/3rkFaGyEB3P0Ax e8ygSyVFBgXFrM+JLEtiVIYzfqlptxLOqBytKghBEnK2E7SoWRsKOYU7jeTBc/AIGYkJHg S4TTOi5c48++eCCD3AxrkTKAH3gIt88Di65DAywGthHoaDqiIDn+FQ74Xk5aoetIdt/hkY Eg43LPdYXmc80I5TzwF6d1J3JkYTrdiFu6kUJo59bUBTdUYCDbCaZPWDrGRPtg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654626347; a=rsa-sha256; cv=none; b=fTZOAJaIF2jIpp3oBcg8PmKtW/xQtI9bNRMsi8z9ihpEUjh5X6si7+mOldkX2OFyIat8HG ZP6hr+gexD2np14LiB/rQtnMTZhQKG+iV2LTjW5NayPOdqkDitNL4rDqU/+/1dNzc9ihMG 7O2I8iEJkHzsKs/pLcpTEP3O3Rhpop6urvnk96N/hDV7sMfFL4AvMsKt35/XNyoYD9KVRM SS95jxgI8wzRqA3FrZfXklSqkLZ4Y9y5p/kzfSdvCyX9qStku3+JkN/T/beS/2M0L0ZuAj b05cUKbQGfQRl30+rNjOWutCLolrarRgDJgdnIoqo4I5JsqyrstxemR5qx9Y2A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 Jeremy Faulkner changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #234523|0 |1 is obsolete| | --- Comment #6 from Jeremy Faulkner --- Created attachment 234528 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234528&action= =3Dedit OCF KASSERT patch w/ jhb suggested changes I am using using an output buffer and only calculating the sha256 hash, ZFS encryption is offloaded to OCF elsewhere. My patch for ZFS is here: https://github.com/gldisater/freebsd/commit/ca66e8943dc3be3f4266ddd66375085= 9c82c1291 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 9 06:30:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C3A26837050 for ; Thu, 9 Jun 2022 06:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LJZ2z4MRSz3tM3 for ; Thu, 9 Jun 2022 06:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 760171F01D for ; Thu, 9 Jun 2022 06:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2596UJSQ009847 for ; Thu, 9 Jun 2022 06:30:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2596UJGR009846 for fs@FreeBSD.org; Thu, 9 Jun 2022 06:30:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Thu, 09 Jun 2022 06:30:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654756219; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7vdq6yDvYRKT8fFtT11cfZcL3YB3wB6zVw2hremzpAo=; b=ShUngbu/LzUcHtAtBPAY+gOZ9/kU+rl99qoZ/zscPSjzi01B5qdJxbH5XEWBAdqUTHTpQ1 JlMCKt7BMEavPwRS3KiE9oPiAWv+weARKhPi3QGrCQmqaq4XMpva25T4dDi0hJGJnQ9GiU +cZL5oIpqyWvEKjaWoGw++3PJ9MJqTMH1EbR6+xvFJnhJSo3SJAJ8bStRL5ihQSCW1cr0c c7hhkBNA32GavYxcGVex7W4P5oHceTK/h9Hg3/AFV5tOB01Zh1PJxqha0ApxJt17WVulgo YZSlzz+G+IKtnHEXo0hvohsJkQ7+n6tHPPX2VDi8ykXHU8aSQZXgCAdCQg6N/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654756219; a=rsa-sha256; cv=none; b=dCk+3IDzk8B5w1FKTb2A0WLsOgDTzIVpXTOLtipnpTDw+J1DwwnO95L2nBskAKtIMphSha FulJw9psSHJbw9tfPJbrTo0dGUYGCNxCUZJ3/SQ6iRfcFNUEr5uBGSaSnVGjYOxczUhfLR LZwoc7heG4SWZTNt9TUhTKY2c6AkG6UHFFCh++QFwL88aF9f4l6RBvZrC4s/vq4qdZuNNW 9xdyfBgLPGuUe/eoeNV7kTl96OPAQPZ8eFOgMeMSSazu9d7th7qdwmT9NmAUBBq6SFrqcA b/SqKJuiPg7m3XHGC1J/kDUdr1hGlJlkOyLE5q4X0umYZSYjQ0i6vx9G9Z3fEw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #16 from zmey20000@yahoo.com --- (In reply to Toomas Soome from comment #14) Just curious as I'm not not sure about the process, does it stuck again? :) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 9 06:41:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C0F67838651 for ; Thu, 9 Jun 2022 06:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LJZHn3jc0z3vLw for ; Thu, 9 Jun 2022 06:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5FA6B1EEEA for ; Thu, 9 Jun 2022 06:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2596fPSa017455 for ; Thu, 9 Jun 2022 06:41:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2596fP8Z017442 for fs@FreeBSD.org; Thu, 9 Jun 2022 06:41:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Thu, 09 Jun 2022 06:41:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tsoome@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654756885; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y27/tHhpOFKflugh/7mc0ohXpbfZ9iCTCLsamcThKes=; b=tNBkH2kxkqAO8ICZ2RqcUUcRsLfEFFP+6tJdfQkNEJluhAv/cvpc1zCoN1X4xHfiXPUIol TRfe/Cq3mdS87V9GtqTuFyLiTUrVYDI0dDUJWoWbh+noZqwb+0PvUO1u1oDvcSPNOj9MGj ZFDSAx/JyaCcY+wOFF56MJUVZyb/MjmAjGBBP7LH5bgV9DPTw+4fE1YzftVxuJgVu8C+1A JVMHnqPUwEjfrCeB9PkJOt0mRfmkJiyJkXtTGz3ULCESmMxM8hm5HVaFHfeuCZYZZ3kZYF mHIOoNdZHBhdI8n2SmynmQHpsF6c2f1V+7ffTuJrfjuZ9JM9QGh4V6FFvQ+HcA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654756885; a=rsa-sha256; cv=none; b=ZiwN5IaNNrbnWRVklDhUoSxPkDhZs7+wB/doh7lnmd4bIFF7KOIBs+Hv1nak1PuiArVn09 xZnyAjZcH/eHtUXKbm8hdpTMRunh5vIA9iCezBeL1ziBMYkbmn+mxto+OjMV08urIv5ow2 PrYdJwExBXtK6LNXDvchbcbyezjqAGofOK90klB6qt68fAfZixl/xAh0WeyGt0+Lvb6sWk gUP32A4tB+GzhB8OZDGpFieJO3284WABPrLU/rk4jltwqoAdadRZSITYORlIMB4+TQS+gr bJYBDcvUffyr60FeTNkMnDVwhPNDFidaEXe1bUDJdbkRFcaZCUb3pZ9fc5jPJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #17 from Toomas Soome --- (In reply to zmey20000 from comment #16) just pinged reviewers, will wait for the responses and then we are good to = go. Will likely need to wait a bit as people in US are sleeping:) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 9 06:54:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7518D83A33F for ; Thu, 9 Jun 2022 06:54:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LJZbK2FL7z4RHc for ; Thu, 9 Jun 2022 06:54:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2A7E21F2D9 for ; Thu, 9 Jun 2022 06:54:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2596srDE024015 for ; Thu, 9 Jun 2022 06:54:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2596sree024014 for fs@FreeBSD.org; Thu, 9 Jun 2022 06:54:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Thu, 09 Jun 2022 06:54:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654757693; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PkeR/4Uzak3+DyxwTuS43/HVKti96uNsBwuTqwAzYRE=; b=yeOblKoEoEPzUL5wPXHd1ZWesznjGFQ4uR3F0yRP16p/juUUG8EZ+9RMfwABPPwNTlEUV5 xsXws82/fxxf7rTlBnhkAG51g/083Ig6hyRclbC/8y9pKkAmFQMyPALNYRqpIidtT7k8sr j/P52Bl4RjeJEeTsUi3L0yarf93AXjQuHOF/EpU65YPNDaFJZHbMoO59jqozxYTo0ZhjDy sJVXd4WxJA9L3uvqypEvjlS0qL0gnHv9Q7UfRB8SEPmD91/7iYeUsXDc+3fypdyyzTL36X DiYbI/9Pz0iVnGiEI/tjUNnWDcDIc6i8+tZ7fGuB0LwYw2nSVId7Un+d5n3J1Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654757693; a=rsa-sha256; cv=none; b=Xsx2Ouhk+dlKiLy9Y+FqPbmky/tM/Q04fohXLikSJbmY0108yJJc0StdG24BEhr3kiwMYq pkYYBsFKDTS6rEkcnNOJxDlYW4FFGkC/mzLystc7hmYQbRrrXdU4wc/bOr6jwIUPHQKGfa z4dWhbmQ/hKBT1wOa2G+mMm1tSSPZS68/USO6ccj/BOSMVFBSEPSM2e1e0rcKXug+ys5AM dZGM+AGsxGToFFI4bxwp0uCFi6KVRxuxrej5IM2koRlPwu8oi8HiTC59pxM+F3z2cpYChX Q0dM7Cmu3krOeWdLz34NEL9ktZR5UiiKmcLrTMhQEGdq9LDEd7YloHWqPn8kKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #18 from zmey20000@yahoo.com --- (In reply to Toomas Soome from comment #17) Thanks a lot, sir :) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 9 19:20:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C1079837507 for ; Thu, 9 Jun 2022 19:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LJv7b19HHz3CVf for ; Thu, 9 Jun 2022 19:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0987D19B7 for ; Thu, 9 Jun 2022 19:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 259JKQnZ026478 for ; Thu, 9 Jun 2022 19:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 259JKQrR026477 for fs@FreeBSD.org; Thu, 9 Jun 2022 19:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Thu, 09 Jun 2022 19:20:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654802427; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qRD7EfT484WwG9MMArlrYZrTCDhbWv8QnpcYN+We4VI=; b=Se4Ti5P4+/IdT81sudwgnUOfi2X0cVVuT/jT9AzJchz/fJzYdDxb2XknspUQc3DtyqlWSd 1Dwn+bspV9vmuxX4hEabf2ammSOHy9GzZhNkNOEo1DWa6mImdxcZxjTeowIsLEIIE1Ar5v Kgtjgg2iDeH1noD9lY1bbEfZf9XznFym4eyUHgM6i4h1ov0rMkK3tc9s57/y2SpKrwF3j2 0A9nijsGhNQPBTaxd927B+W6wVzAhhOasvj+upHNRc9oITJQiCjTC8q+dpiUxQbYKuLANz pp6pYzgdhv7DgiOoDEXqmbdae9zMDf+sNvwHOI0LRYHIoksH7MmfMW1h9ipxsg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654802427; a=rsa-sha256; cv=none; b=sFETUOzVqU18fu59gqXWitSLPYDaVxinwEErYwe7qL8F+Rcf1WzrvFszr7eB4zxO11sNHX HLkP7Ee7SKIzZ2eFexI9I0SD5+todM2uilnRvFTIYreD04Nq/Ivc8eCo7qxPoQRTpwvTQ8 agFHffZyfEu6NUJyl8skhUZEvZDGtVWgyLtTE7IarPNYxDWvilQjkvNJt5FGNxsEnsgJve idMBP4VAIRPXM7tYQhi0REyC8E2N1Byte88vrWtsR/XAqnaeLXiqULzkLGp7PwDdBeyigJ NjDECa8y1fOkeNQAiJRuCVif8VeUyo1qNjvmQIilT1u6hGu4I9XgNypMKvmXNQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #19 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3De50e40684aa61526327be713de512e0f9= 934477f commit e50e40684aa61526327be713de512e0f9934477f Author: Toomas Soome AuthorDate: 2022-05-25 18:53:57 +0000 Commit: Toomas Soome CommitDate: 2022-06-09 17:54:30 +0000 loader: add support for gzip compression As we do have zlib code in loader, we should also support gzip compression in zfs. PR: 153173 Submitted by: Mikhail Zakharov Reviewed by: imp, markj, delphij Differential Revision: https://reviews.freebsd.org/D35320 MFC after: 1 month sys/cddl/boot/zfs/README | 1 + sys/cddl/boot/zfs/gzip.c (new) | 96 ++++++++++++++++++++++++++++++++++++++= ++++ sys/cddl/boot/zfs/zfssubr.c | 19 +++++---- 3 files changed, 107 insertions(+), 9 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 9 19:40:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2EEBC83BCD2 for ; Thu, 9 Jun 2022 19:41:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LJvbJ0lFcz3JdW for ; Thu, 9 Jun 2022 19:41:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EF3231FB5 for ; Thu, 9 Jun 2022 19:40:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 259JexmC038450 for ; Thu, 9 Jun 2022 19:40:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 259Jexkk038449 for fs@FreeBSD.org; Thu, 9 Jun 2022 19:40:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 153173] [zfs] booting from a gzip-compressed dataset doesn't work Date: Thu, 09 Jun 2022 19:40:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: zmey20000@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654803660; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hXYIwOyPPEK9De93xSVI2I9WQCU+izAB6Xjy6v1b2Nw=; b=aZoY9o+nqYorbJn2tFYEkbZqfpTd5gzzqTmyVoFrIIaMIhFzIsjCgMelpRySXYh6iRs3aV fv0nMv44GTz8bBeP/ZksjzuXyETC3TPSUnJzm77wn9laokQ6Cvt5AF/ktTIT2PP6bX+Oo+ 847AAWOJy2jqrBtUAH/frhGE9DZ5HgmzjvlqBd4lE/s0mo8Y3qGbl4rDqOwcKp9ngUllT4 sTSh2TEpb2udt4rb+ekFDbvILmFsM4tIoK6im1T9xqgGxd4lEaY/BlzCzqSU2030R/0+pk hj5w9SbKBYbVsSazupa7wTtOdQtniN4sxKqozaB86Ohpixh0AcgKib74lwx08g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654803660; a=rsa-sha256; cv=none; b=LtA8VyBueMzDrNli9x8qqmSRfP3czgE69d3zTXi8TbAESHZkHL949OVO7e1lagnn/UXfE2 E0BvU7MfbtPmjEww/OTCxNp6UivRgpNMebwb6DmbwrmuqCPnsBv16i1CCOE/mkGf7Rn2s0 VGnteVDqIBGgCh/4HfS75yXJBCUoulbaxfwTXj0GWmuDREza/kVZpbZrUlp+g6GVckAIEF VD8kugaak1GcqYHYu6BvgwO4EerEdYBC3H25I0S2G64SyPIk4MlHe+N6OmaouGTtq6RlU6 n/mg6/UumwJOXcDnkP+q70Bo2EAAF0OO8YINFYBXfzRaLDMNvZ13vLwvFXpuuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153173 --- Comment #20 from zmey20000@yahoo.com --- Great! Thank you all very much! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jun 10 18:49:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6D77683FB3C for ; Fri, 10 Jun 2022 18:49:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LKVPl1yzvz4pqQ for ; Fri, 10 Jun 2022 18:49:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 209F01DBED for ; Fri, 10 Jun 2022 18:49:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25AInlO4099911 for ; Fri, 10 Jun 2022 18:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25AInlK1099910 for fs@FreeBSD.org; Fri, 10 Jun 2022 18:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Fri, 10 Jun 2022 18:49:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654886987; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iSMVZEuYM75bMB/z7BqEIqt7xJbKws9zMIAKV86N5+I=; b=oMEIEjM1OzF7L4vixjk+xuvvLRRTERfnvWZUM3wNDazJJ+8YXblh3SR5SmhSfyatUOTWij uLhWhmFT4wANkmh70wUkGKwkVB3eUv7mq+HspQn6+DfsQGEZhYFXzznlWWK8Sp69cnXKNW /GtszQbal22VNEwJk8pKwAt8vGV1eam5rg8E4zIUQAy5x82n8rXksnljGAheUaHzb8PbRx Hz7hqj2bymF0KLkp8pZO9aOtzM4V5QR3mvQuYW8uaOD+3EmAD2deQaKBi3v7kYUsz+hFjY 9n2yJfHGlAdFVg2b3O0N4YWO9zsEf/j5hcX3TvdnoHWfet97rK7nXd/jU5iLIQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654886987; a=rsa-sha256; cv=none; b=dza7FwyT/9Em8yvlMvYNMkCpCdTROIqOh4wYRJKKovYLXNmoj5QcAJUEFNIGGDbRAI44Tm DuVMlZkQWR9iQEXDK2fUFgYvkAfky/s4XZ4ZF++IeA+7vfkmV8iC74BIzHf9m9Z5cOKqNi rWZyxt625oJrmXOzLRqeWSah+mXclDaSF0h0PDrbUQsVnZV07HpwlnYLYb+gLqZWeh3hvD vCeexlaYeRXSSt2kWxQtlWqfIHUmUymhO/J+azceVErGPJ9RUKlVFJ7XQblYoKfIkYriOD 8tqS9D6Z7U3GBCx4omj/YFKuMnsWytMmaJ0qFM4GK9jk2xGfFYA1KiBLz+GNJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #14 from Martin Birgmeier --- Ah, I did not realize this! But I don't think I'll attend EuroBSDCon, that's way over my head. :-) But I would be honored if you and your accompaniment would accept an invita= tion to dinner at some nice place! Best regards, Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Jun 11 18:06:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0B54F847B95 for ; Sat, 11 Jun 2022 18:06:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LL5PY6BSvz4XRy for ; Sat, 11 Jun 2022 18:06:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B2101119F4 for ; Sat, 11 Jun 2022 18:06:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25BI6fWA045319 for ; Sat, 11 Jun 2022 18:06:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25BI6fiO045318 for fs@FreeBSD.org; Sat, 11 Jun 2022 18:06:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sat, 11 Jun 2022 18:06:41 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654970801; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yaRpgc19ltxrco+Qxq+PzTg6t3vtHRyv4SIVQpv1dqA=; b=xnBHCSk60sThMZFtDMPsk5B4vq6HgcOChDfqwPSjufavxkUInAs0ldj/YnGUwJiYA34mfq nXQ6zGdXeMRpFo8uhlwzo4K1GhdXRNV67oCt9oWRYzpMLF5o0lzCGgkW3JvrBpQxtsUDb0 aEsvNP6fIEPe/rMloHDf7zxnGTs39UIyc/3j6FYp/wA6k5iVdLvQ2+ZTQ4AdTXcEy34f43 byOswuDLOsePZIylNwbVOpSfyXyFi/JCBO1tNnsP7vaebKQ7hMXJEl2K5Wpf2tgaefk4tW 2SudBpm0klXkThnsbjEgvxKafUQDQg8UGDTnnqUkJwVbtF2lFXMYIpPkaGlvRw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654970801; a=rsa-sha256; cv=none; b=iPeMhSGYYXAXzVw/lB2cHkocm+FEJTPmM57ShbcnLL9MQhDfMyeHL1z+pfZPPCrazDb6yY cO6GRrKvHO1pn9VFLMKPdXBC5PdfzA2l9Crp6Ghh6fJvFOn24E5risD/JGEgOrJrVvk7GY mAw4TTFoctbkQkibRlqDZo+qFni4ipWnvWQqeXPOKCmOKNhJ3gO0Hmw2A/kO91fAhSaM6I MzM3nsm7jZu/kxrnaxkBUlh8UqMTcZlItfAalJaQq5P7gsKz/F/Mghd1m91cEjdCOQD5Om Xys21KJHVyklVTUgzl1R53n/wbPq9iE6sH25UpjdT05hFNC1mAFaIz5bAiND1g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #15 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D800a53b445e7eb113ba193b1ac9863129= 9178529 commit 800a53b445e7eb113ba193b1ac98631299178529 Author: Kirk McKusick AuthorDate: 2022-06-11 18:04:19 +0000 Commit: Kirk McKusick CommitDate: 2022-06-11 18:05:14 +0000 Bug fix to UFS/FFS superblock integrity checks when reading a superbloc= k. One of the checks was that the cylinder group size (fs_cgsize) matched that calculated by CGSIZE(). The value calculated by CGSIZE() has changed over time as the filesystem has evolved. Thus comparing the value of CGSIZE() of the current generation filesystem may not match the size as computed by CGSIZE() that was in effect at the time an older filesystem was created. Therefore the check for fs_cgsize is changed to simply ensure that it is not larger than the filesystem blocksize (fs_bsize). Reported by: Martin Birgmeier Tested by: Martin Birgmeier MFC after: 1 month (with 076002f24d35) PR: 264450 Differential Revision: https://reviews.freebsd.org/D35219 sys/ufs/ffs/ffs_subr.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Jun 11 18:15:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A6C50851840 for ; Sat, 11 Jun 2022 18:15:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LL5bx3QHMz4ZDk for ; Sat, 11 Jun 2022 18:15:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 52EEB120A3 for ; Sat, 11 Jun 2022 18:15:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25BIFfKA052380 for ; Sat, 11 Jun 2022 18:15:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25BIFfeG052379 for fs@FreeBSD.org; Sat, 11 Jun 2022 18:15:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sat, 11 Jun 2022 18:15:41 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654971341; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qnpyf77GyKempSoWxh0miORVhZ3KrUJLvlh/rWf/zb8=; b=nhg5RJThMuPtexcRVjRciJ4qAoz/rq2ugzCjM2DSQkQacJpV94/BSjy9rm7J+nz5d0/43B BT6ZouXBk4gnc0FU8gJrvnEo0hBGgaOA39CgNdkOiwPI5AQrZrBYaK2tkqv0qjes28mfqa zZT5hu8Md18x5IFMU7c+4MXXQDSq6Nr1Q6Omej7LWGW4LlRHNl5QZzgWqE4xFh92llheDz O3vjHnMAVMaQSVEeS84GHcTDEXP5oYaXSOiTp50u3DliyQ4qaZklFwFE3F4OSh51ehs00K TQOic74FpokQwnEEyGGknuhjBtpmBwO3TwayTOVsqYCTvRnKwXPZ7l/4cK8u4A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654971341; a=rsa-sha256; cv=none; b=HHw88Ka+ihWnan2TDYDpgZ3hECfW5n/HEkoABTvfvvHdscLU6EwWl0JH5uKbFM5116BYmL +yW5LHTsh9jC9qz2slOOIqdhTdbZwI4CM8LxtvPWF9iSRt7pr0Ef8UoAoSf/UKaZdtV5YF 49wppODFiERQ49H9U1TQdoCqzcvNCFEc5LL7aj0Q5JYyHT4P9bn3NerZq2e5Vx7LR8e6hu SXBvC0Lq2RkUDSNMof+heL8pS4hA6r9ZeuErVZEFy1nDs1wtWIsNJNXbXIkn8iBQTKujad Xl4nKSHrfSU1cRYp6E0LKKm0XPnwq36NzwdqpTkMwoy2lglETV9+UL/hrIURhg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #16 from Kirk McKusick --- (In reply to Martin Birgmeier from comment #14) My 2-day kernel internals tutorial might be over your head. But given your ability to run FreeBSD and analyze superblock load error bugs, the main conference will not be over your head. Plus you will get to meet many other= BSD users in your part of the world. You will have no travel expenses or hotel expenses to attend. In short you should head over to eurobsdcon.org and sig= n up today :-) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 12 07:41:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5DCAE84486D for ; Sun, 12 Jun 2022 07:41:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LLRTJ1W9Mz3wSl for ; Sun, 12 Jun 2022 07:41:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 159361D079 for ; Sun, 12 Jun 2022 07:41:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25C7f8vE075777 for ; Sun, 12 Jun 2022 07:41:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25C7f8L6075776 for fs@FreeBSD.org; Sun, 12 Jun 2022 07:41:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Sun, 12 Jun 2022 07:41:08 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655019668; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OYb8NfE2VNFYl879R5AzOnjF1YXsXOB82VfpvhYbykw=; b=NBCiPunFXdqYcqpSZZJX60pjLqOs77ZS1FTr0niTvLQQwOpozFo+ZECNU+jPKzRLEUvhN2 SBI83pXiMn6Pv5EaSko9yRGHoIZwtplzIKRaId5iGdSSIPp+NsR8NPCdKTdxANdua0pwJD h7lSfPRKdyP0zYmf4jcuFT5VLJQv2A0bl60PowpVZHHYhkes6hXvA5SH/y1N3LIMGO+us/ 5vC6nZ05HU2NGGjGDkTZ0UsYRBXSvIDhdHPaKknXLkuONnIM3cHkNFBvslNS2aXwPFQEuq UW3aRPLlXD5CDuIfAcJyvDukO3o6Jq1mzhjHW/zi/iwsRfXyObfYBrWZNT7/0g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655019668; a=rsa-sha256; cv=none; b=o+06BfGgP0TBzLbSP/Y79jje93l3FVuJgDCge2VDhnphxBcjXZ6pXSw4kDKkzowq+jQVD5 JQnpMGWbn3LX+D4OhFL+cpNiVyKL9e02qHPe4F5waG5dc3aa1KTlVh3Z5Be23NJSWMmrMP NiOqbHu8eb9n/vSYgsFaeH1BnG3RPxAfg37vFGf+neGImRuqEayLjHPw43vUR4I9wQfeoq zGqNynacGnr7XjQKrC8TeyDy8K78Axn8vOByhf+rsFFQNjjF4nwk0gWc/STeNojLWowzby D8twbyG82kuagCkIl3ePfjdp6Lslm8XtlIwe+fK94BfQKG7e5BJSfkr7aHJLfQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 --- Comment #17 from Martin Birgmeier --- O.k., understood! Thank you for the fix. -- Martin --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Jun 12 15:15:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9F6CD8403B6 for ; Sun, 12 Jun 2022 15:15:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LLdZ32dNsz3sF6 for ; Sun, 12 Jun 2022 15:15:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2458E23864 for ; Sun, 12 Jun 2022 15:15:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25CFFtxv023537 for ; Sun, 12 Jun 2022 15:15:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25CFFtRq023536 for fs@FreeBSD.org; Sun, 12 Jun 2022 15:15:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Sun, 12 Jun 2022 15:15:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655046955; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ryxfDPKHIEO15d9/AD12K9jT9KqoAQ1JdP2/TzCjpgU=; b=hXyX6bDt+u/i4/mCEAKGM0ISk1wPn/XobFDld9hpkPKrb7Wb5752ZCVWFm9tQ2YYdunyrq p3MrV1zHX+khCVFXQL1m0gA9D1uQdzrAKLJ0wDjMdA4K8I8Q6iZRgHgG16CXTj9CpDEFT8 J6adTDDjWBm4K/y3GHUr73/W5RwOg2I9dwJ/UCVNBALeSRQR6tTv9Ap60xKTxugoAblgtv gWpoM+Dp/ntm9JJZHSUQIfLoZvQelCCobnqABc3rMEvO8JqMgo0RAICjx8KilHNh4MtMQn QVTZXzaz0jEEYtpvNXmAQ7Om/IKgr1Zx64LT9kzaCgRe7Q7YwcN6p9TYE9Ojuw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655046955; a=rsa-sha256; cv=none; b=ktzrG+i2capJRyBNpycH6aT2G5agvsOHW2LOIC/fUfVuvn2ImjFIpp5HyQ1KyugSUdS89R /wUxy5srA+0ixhjPPd7PwzFSAoiv1tN+o3qJ1p4bSqJD/37bgtsPHihQ9RHZlGNPt8pF/e bsby692g+5nKmtZpLyllKFokFftT5eBNXOUIvkmvaUtgB/yBHxe72zEgjaplGbShTcfFwr ZQRfvdR/3ILNmfLK//quRFqfblCBPO3gOeANEsB9+Pv0RKVC8B/n9qfQIlzieHqQMNQZeK /S89wVx/ciWBRGbirRH4ZHGBPWv4tEhPkDLzpCqixKaCGOz94yuGJH3cPw/mQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |rmacklem@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jun 12 15:21:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D2556842247 for ; Sun, 12 Jun 2022 15:21:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LLdhY4t4qz3vcT for ; Sun, 12 Jun 2022 15:21:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8885D23AC8 for ; Sun, 12 Jun 2022 15:21:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25CFLXEh025329 for ; Sun, 12 Jun 2022 15:21:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25CFLX3q025328 for fs@FreeBSD.org; Sun, 12 Jun 2022 15:21:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264617] Panic: Invalid dnode block MAC in ZFS Date: Sun, 12 Jun 2022 15:21:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords short_desc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655047293; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TSURcVLOay/f0e3OzuvJ6gVmP0/bdGJ0buHT/eehO4U=; b=EgJD9GhiW94lL/9LdKx42aHSYteC3tMkYocN3nXzPA0o+jhHOlg7mBMv/pPJmg+utR0ZRo WRT2oKuN6lojFt1vNENjNkrnhgL93ieg9UjVFJ947UO5rwSlTTlpG1fi+Uw2Yed/4PPL3Z XbTfE1HsezlWEmEW8u8Iz6+sXm7kkTneFqvr36p7ikE80iTmw3pgUBToAVp7+818VyChnv EKHjeB+tOdLR+1HrcjZHcnKWZ/x7saAjFvmQK+zWqA5/X3AGTNltJtXYmHle1B1F4+Ujw7 4OXH+vXck1O8n9AIVSqBWwoS+D4fkq3tw2iL4v0Xz1PfknXl9KXstRXQChMvnQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655047293; a=rsa-sha256; cv=none; b=lccwG6Dwvhag4sQE2/mx9HqRV/pjX3aRMG7YwkD3j7Wt+h8P77+is/dXhDdSCip/eQ+xtB ns/tcRCe6iAA/pHxBNu/V9ptNIdCLNPF9pkRtMldJVHFMorzqbGNsxC5SkRjHk3TNUPp7U G+AXhHX4Ya24fUZdqVAyMpr3Rhg8XQqKWTnewgtxJlWagkLzJe1HoGAgODqn1sNoROP2YS J3bxoqj6dCkEQ3Z143i3fKg5aFe81oRreS+DpGObnb49886a9PGTKN+z1zZcZ4wnNTmf8O 1Y5THT75wtOxJG1n95wati4v/26ZXOfeWfJq/c+ztw+Wfzr1vVL3Er1OZWWsXA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264617 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |panic Summary|Panic: Invalid dnode block |Panic: Invalid dnode block |MAC |MAC in ZFS Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jun 12 21:01:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 120A48350B7 for ; Sun, 12 Jun 2022 21:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LLnDG6t0nz3pmv for ; Sun, 12 Jun 2022 21:01:02 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 082D099A for ; Sun, 12 Jun 2022 21:01:02 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25CL11Pf097775 for ; Sun, 12 Jun 2022 21:01:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25CL11pQ097774 for fs@FreeBSD.org; Sun, 12 Jun 2022 21:01:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202206122101.25CL11pQ097774@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 12 Jun 2022 21:01:01 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16550676612.C7ec.95617" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655067663; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Gue7WkzpNUA0Lw2WvLxha/LizNor4AO5UuadNpS1FmU=; b=OGczMGmwsqpi1PxrvCqk/y4EY9WHp83apflbSd9siByiUF8BiSEJc1Sjwz56NFBEZDhPs+ j0nfAO5BoSv5tP9XuAJM/hhhAGhrlWYyaUW3PKFUJuxedOfpgiRxUOtNt4s2WRtUVfLTmT LggBTCyej4zpZC5eU/GyoObSnOVEwsTxLtAqvjZap5Bc+yKqUGVJqCOeG+Bbp25G6PY2nA 6bgxD0O5jaP5NTQDs3XIiFTGHqlmMzvT/1VPA4hZlaUDtf2YS2YuapZdVc79Sifa+No9Co UYRRcvz2asbJk2AgJpMdov5ezpHW2yeuU1SgqN0VOIGrvQpDpkJsokryCcZA0A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655067663; a=rsa-sha256; cv=none; b=cdBNKAAcARC+om1Rn5P4jGltCSw1NfWndjKCECaWODzyVMUNkBSH0RTFS56WASZPNsPc/L wnxF1rRZ8FinqU55umSCi0y4LGhsAa8IpAOFVzCZq1zFM4Wmwx/g9iEKffroA/HZ/l9jvt Yw15ExVj27kMFdvPJdhwIpZjVG+a67iQxvnCZLudI4DDNHiYVuUVFnQfjHG+ia3jXadoYR L6uoCW+azgCxM35b7KnlJfVBPDTVthNjwtI4i09t2KuCVKdeR73pD0QA8+PL5rOx0fGn1L zbpvKuduIyDHdS/C/wssw4I5tr9XkFUHOXSzNjusv6PQdHoguhC43ARLvtaCVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16550676612.C7ec.95617 Date: Sun, 12 Jun 2022 21:01:01 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16550676612.C7ec.95617 Date: Sun, 12 Jun 2022 21:01:01 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16550676612.C7ec.95617-- From nobody Sun Jun 12 22:43:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7CAE58453E6 for ; Sun, 12 Jun 2022 22:43:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LLqVH2FHJz4bPq for ; Sun, 12 Jun 2022 22:43:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2E87D20B6 for ; Sun, 12 Jun 2022 22:43:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25CMhJd9054601 for ; Sun, 12 Jun 2022 22:43:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25CMhJXD054600 for fs@FreeBSD.org; Sun, 12 Jun 2022 22:43:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Sun, 12 Jun 2022 22:43:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655073799; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1hvU+qZ9VWTdyMtZRZrNke+2THzeRQrAQpVVShqXHRA=; b=ExI2A64PjOXJNFmkZjwXtE6wndur/SB+CzrV28+Fthgwu6EDqlahiEHG2j7hBWsHgaSAXI TdMcD8Cqtvs+8W8JKWGHI5DNfmuMUG5/+J1GvUdY46d9i6bCxxFL5wonJGodKBZpHG9Uev ogsMEunwLE1UHTTzfP1nhErAQbEtsS9UAQzOCUuzNcDdaMnBRTe5EADFp+N8eSNtu6nvQA zdbIBicaY4UIHNGnM1tA3/L30Xz3DXLN2fpKY75ZvQJhVrTOxO286UXCSzhj0+LhCwDWCA /fj4NK8PuRAkAuxoFq399Fy7+9vt6fMZ6+4xQQBfZ5ztTaOrp0UNDfpXxe2PBA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655073799; a=rsa-sha256; cv=none; b=RARq62MXYOw/KS3qTcXQR8XtUgWf6qz1Qx/ckqyjZvAvMepqd9+zCVTGfQq3xxSpGl5gyc pGOe4dOf6ArfIIQFfVfJ5p8AQLNNQOfZUrCAGcYp2gYlpQ1/f1xkq7T9VbVqQWTRrHLiNr dflM4H1XeVZz9Yjg7RK5//d5csID1vNo7ZUteLKb6xzmVULdn2wkJWf1vH/mMn/f7hGKSx H6WgpAHVWGsqnaChe2Loe0v/mR+AsuZZzIQd/QoMcyjIXS77LLJZadvMpQYpCdd3sO83vl W0RzqUCjhwKrBRY74TDVeqMEqo+vMknFC199/V+AAbVdREPIIuBSvQnZuwP7cA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 --- Comment #2 from Rick Macklem --- A few comments... - If you are using nfsuserd, both sysctls should be 0. vfs.nfs.enable_uidtostring=3D0 vfs.nfsd.enable_stringtouid=3D0 on the server. On the client, vfs.nfsd.stringtouid is not used. - Since you are using AUTH_SYS (sec=3Dsys), then the credentials in the RPC requests header are numeric uids. That is the "user" doing the create and, therefore, that "uid" is going to be the owner. nfsuserd or "numbers in user/group strings" only affects the entries in Getattr/Setattr for Owner and OwnerGroup and does not affect the RPC request's user credentials in the RPC header. (The only time there are no numeric uids in the RPC request's credential is when Kerberized mounts are being used. For that case, the credential refers to a Kerberos principal, which is normally "user@REALM".) - In "man nfsv4" it states... Although uid/gid numbers are no longer used in the NFSv4 protocol exce= pt optionally in the above strings, they will still be in the RPC authentication fields when using AUTH_SYS (sec=3Dsys), which is the default. As such, in this case both the user/group name and number spaces must be consistent between the client and server. To do otherwise, simply breaks things, as you have demonstrated. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 16:03:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 65924855B05 for ; Mon, 13 Jun 2022 16:03:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMGZw1lQNz4g7B for ; Mon, 13 Jun 2022 16:03:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1CAA718AC4 for ; Mon, 13 Jun 2022 16:03:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DG3qBI035377 for ; Mon, 13 Jun 2022 16:03:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DG3qMM035376 for fs@FreeBSD.org; Mon, 13 Jun 2022 16:03:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Mon, 13 Jun 2022 16:03:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655136232; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Jdr8FbtpBMpLPQqLcqz/rbl4BrTQN8jFbH+wH+YwJOw=; b=QnBkiw47MvYrbHSNEV5WqQHRYRhvdL47h3BFPrZ5dg2qeOv8hZ8v8v0YgushKNztDpS/DH WaZz2gG8ZKPK0pFFabaFRUEYXt8T19yDMc5GiUdYLU4gWXoo2aHNztaHZz93W3aTTA3dmm m77xOsPKsRybtlU2cToiyOcbOcUMTL1KW6Cv287XpSLZvEr+e6iX8KuFMquJfltziiprP3 2I9irDO+XgWrQo94oip7tdrU84XkZM1zyXBtm/NCZ89GwFHGqN3H4G+/HbX2+OuJyoFcE+ BzPKSske4pCGZMt+BHJ56NJGN7R4bMKI4BDSXYwAGWQrJVCRGR6JRfixgHI+Vg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655136232; a=rsa-sha256; cv=none; b=Ww1Fo6zbKx7LaILAEe4o8pM3F/8oL9nsucUwTqlGN7lMSIFsmtDADL8nOrVyjZm4pMXGcI zlXhQvFNFH+ur9K6sZvWqFhAWWn2NIucs+z+/f4YGQ7/ZDTTXxY5vziHxvVW5+pMFRaNxl 7oZbsSkRdOJf/2RS4QrxQMa4oEUM7WGaUFdLNRd95+JT/WnJEZzMQGOvZ73L4u4WjM6Vyb 0hHEpWOvKnj7Jo18EvGmp/o8SwaDHryVcuukbgBs3F5YdfEgvgJMCRRQIbKP+uShHralEy aEcX7Z+kzdLx4h0Vu8Mi2wAOln6JT/Zg0aJwoLmDKKyajO99i1l8o2tDh7S9fg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 --- Comment #7 from John Baldwin --- This looks good to me. I would perhaps adjust the assertion message for the digest case as the existing messages tell you what is wrong vs what is righ= t, so maybe something like "output digest is not at offset 0" or some such? There is probably some room to add some other assertions if not present alr= eady such as rejecting separate output buffers for requests that want to verify a digest vs computing a digest. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 16:04:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4BEDD855DD2 for ; Mon, 13 Jun 2022 16:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMGbt12MDz4gfh for ; Mon, 13 Jun 2022 16:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0399A18C7D for ; Mon, 13 Jun 2022 16:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DG4fcb035496 for ; Mon, 13 Jun 2022 16:04:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DG4fNo035495 for fs@FreeBSD.org; Mon, 13 Jun 2022 16:04:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Mon, 13 Jun 2022 16:04:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655136282; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oUllkDQwuMLCU585ISmzTnt4PZ/hQ9mGuye1tYSLWgY=; b=JgsxBKA/gTcWTd4IiCRU/yU46DrWMNnGX6L7B7VztuuWLBOWQ9Cg7v4xZf5L/FVs4HVUG8 olOdet5yJnxdofbV4xgork1TFZ/Bv/tx4AaIZRXUkyaQEjOBb/S5WMPt3JKnYW13Mn+wnx P5iciXIqoeCI+/PdBdOvCNcXzrHlpHTcuV6yt1rfkZsWV34UGHyYNQoQ6ufSLEuNxtFgz+ LsCXcZq2WeFE3r4X7BoZo43hYzHS/Yv4+z94FWeBzztnfguPvv+YNwpd2K/YVYmGRwzE1U P6VwbYgvZrpJVEDULf/IErKPD+2Xx+mZWmZlsYZkl6Gqf8aCsBYJxTnx+raL9A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655136282; a=rsa-sha256; cv=none; b=J6OzuXrWyTnzX3MisNv4byozGf/ANSwDIs3LZPZ1YcB6QpZXoH4tZWqOEoh9f9Tq6VkxJg q6Mr89H8YJar8WObK4UGwKUR9OQtdDDhQ0/IHDgLHhuPUuKpp9AcpxasD0X+8Vd0JBXrsQ Gr5IkOBdMN3IMdsAgLkEZ1CRTv9J7TtwQwM1OTTe5l3WLsosnHQmUFR6SgJ5wlD222x1QT dtiaA2EOtBg1J2SO69H0iox3DNfAHif1He1UinBCHbvyjA7Ecam/10gn4YaDxMPrWiaEFx +twQOTg4S9qfR6T8BHqEYV865ffZ6EKYwdajXzaVD8mtlxnN2udgkeIxDIPsFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 --- Comment #8 from John Baldwin --- Do you need me to push this for you, and if so, is the e-mail address used = here ok to use? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 17:32:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D12918339E5 for ; Mon, 13 Jun 2022 17:32:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMJY44tRbz4snn for ; Mon, 13 Jun 2022 17:32:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 860001A1F0 for ; Mon, 13 Jun 2022 17:32:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DHWOkh084775 for ; Mon, 13 Jun 2022 17:32:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DHWOxf084774 for fs@FreeBSD.org; Mon, 13 Jun 2022 17:32:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Mon, 13 Jun 2022 17:32:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gldisater@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655141544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/YBBWmtU036hNlsqFsPbSnbTciJCfK+ccpyT/kzpiQ8=; b=cs8v+mo078tm1pKABqXeqTRfNeLakRX96qEc00ALCB2gTbhullqCiIQepxdh2vakOmBbTs 0FscBxA4M0PolWf1NMzdNkTIPlowoznvH5Zd52o1BbGPqo4v5Xti52zTX4ZVeHbdWy2lhv iAxqx+z0mSviQoPCLh1X1qT4l6/3wTehNMiSl+IZB31bnnTNAvyqF74HQQ31JTWzEzKyWA jKghC/8GlyalY7UM53X7C6uulOzlfvuRJ3L7HnkCo7v+FDv+963IPn9tt3j+9kOmXW6Uk1 hllKm4epBa/V5qvWrVdhEvNnvxsCToWxJBa0/47a2KpAXXhjF25m4jqpo3jFNQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655141544; a=rsa-sha256; cv=none; b=KqyFCvULffAyNlZcu9OR8w5rjT/GEVQ5jrQzYZ5TMXRzA7FW/h9p8o8CSyHTH4KY4iUq/X rxEemnblW1zbVRMDK2HHP4iX3Zz+EbxzCG0aqbFooKtjk4wSruWOrV6SdDv4ZuEcKIKW4z /7MlLI40/Ck9GFxNtMz+IcCGaUGvmb/FUgC8ACQsvhYb4jxP7jk9+1LOdXrtiuAF6c/i0q hpZLldNbLY3tpu1LZv+/slQi4Y00jSiIfLqjjmWnTT7c6HZfw7Ah+UEvS9xk49qUgqQtbq H8kSSYJgIkZG/f2spR1AbTnDdzMggV3MFm2tUVTv4ecGfD8KXndbEohOyhDjIg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 Jeremy Faulkner changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #234528|0 |1 is obsolete| | --- Comment #9 from Jeremy Faulkner --- Created attachment 234665 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234665&action= =3Dedit Second jhb patch I'm not a committer if that's what you mean by push. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 18:55:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0B2448454D2 for ; Mon, 13 Jun 2022 18:55:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMLNZ5KyVz3hb9 for ; Mon, 13 Jun 2022 18:55:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 97D641B3BC for ; Mon, 13 Jun 2022 18:55:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DItA4T027084 for ; Mon, 13 Jun 2022 18:55:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DItAm0027083 for fs@FreeBSD.org; Mon, 13 Jun 2022 18:55:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Mon, 13 Jun 2022 18:55:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: georg-bsd@schorsch-tech.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655146510; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RwgLwltzNMNTRyVt7ef4Np+Sd0zt8rmVu3AW4JtyCYk=; b=ZW6MA9Y1h9Ve0M1gxNEODdctNUS908eDi9vbBPWIYYZv+jnaIo4bCpXMPmNJlrjnRM69WO zzwF1CACAvAAJHlic2306J58dAzsOcEyBgZKmBU9Y219kMyktK3uJD5/gvSXxmcu3AZn/g Y1kxpAjlTyl3ZwdmgRtUaXBP+LbvWZL/DT+zOoXRKHu3amRNwSNtMJETKgL5Fy8ZUv3JwZ 1F2vGjWNYZvuI7uUwNW+lPP5dFsyaBDiWuE0pzpWvU3oUE4XfugtZWzwN5XrhQaZeB5RCp PzwDLm7MYG6M3xcmhq0RzwlpUOzArQZi9KjWWrxXBwHbygmYbrkSg0Zn3Qkh3w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655146510; a=rsa-sha256; cv=none; b=J8RwQI5C/auMCqfkJzCWOYtU4s4jQ9hZ5ETW8f9FOx2Hs7xjhV6mYED/hg5T3P9gmCJgS7 GLOgCLUcMwnxvfoeQhrJYNLLG4bZh9vRHaCSEPJ0Py5Ys2MLNXXduwnPctIV2VU0ijzHhn 02ds8Wse77FZCRiWVL2W2H6wTHENnugiSbqFdjQBO5u0CFkMA1c14WXihMg1DQMK314Dys 26AC5NPmv8fAYScbTr5GTaaK/d5HONh8O8Na325AfOcxLzCuQmiH439G+cC8Qicwl7QTcf cEmbQG6zZJ5/WnooT2GU+5Vh1R1Oymkq8zxMjPKzrFZc3Ao1vKd0G4b0kOX2gg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 --- Comment #3 from georg-bsd@schorsch-tech.de --- With both sysctl variables to 0 the result stays the same. root@fc:~ # sysctl -a | grep nfs | grep uid vfs.nfs.enable_uidtostring: 0 vfs.nfsd.enable_stringtouid: 0 admin@fs:~ $ sysctl -a | grep nfs | grep uid vfs.nfs.enable_uidtostring: 0 vfs.nfsd.enable_stringtouid: 0 My goal was to map the different uids,gids of different machines but with t= he same usernames and the same domain with nfsuserd without the help of NIS, L= DAP nor Kerberos. So may i ask:=20 a) nfsuserd + Kerberos5 would achive the correct mapping of the uids/gids. b) nfsuserd without nis/ldap/kerberos cant do that. Is this right? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 19:50:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1A17E85A8DC for ; Mon, 13 Jun 2022 19:50:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMMcN4SWXz4Rr3 for ; Mon, 13 Jun 2022 19:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 766FC1BDEB for ; Mon, 13 Jun 2022 19:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DJoSq8053421 for ; Mon, 13 Jun 2022 19:50:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DJoSbD053420 for fs@FreeBSD.org; Mon, 13 Jun 2022 19:50:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Mon, 13 Jun 2022 19:50:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655149828; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=C7EA0onj/pyTqhksDBqJcz/O61sgklDNrjh1wKQ773A=; b=SD+9QWLCSTg5amRGSrsrlwsH5+EC90xkDuLpsW6Iwd86Ryghhllsjk8dqwgIHcae7Wz1On Lpm/slG7l3iGX0x/PUYUz8s1Eq9gb5s1PtaWvemQEdUl51rAd7cnnSFDPr05wZFuJUGgml Lnt8OafliQy5OMFfC3JottKeceD8uHItkowSMM87YrXaEwSlePZ7nI+Sg74/BltsiRi64N MIPE+eKTG7qCVsMOd7giHwT/4VKSDLzKvgLZy9/hq7mPCCOPm4DxEJBjbtRlEHETW/Jbqt 4k6A6wa6rX7DPV2gSnsJ4rW6nZGPxefl0aVaI72eth9UCe37Fdd+Rzz6hTt5zA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655149828; a=rsa-sha256; cv=none; b=OKVY/UFOPHuejpr1a4/N7kLBHb8P50Pb8W7FoimXztIHjjyXGjSSYc8kOqxiWfmq/FQpjI C6VXo3h+c+FDzjrhtW0EABeNY8QLvGfMwoFOXXh4xsNQ8CD8FPgeJmUV6Wn66xH6C0e7ha DnjwDFdsEk3WXTsXoqkrt0JhqipAAOR9EdPHg0blsJgBOGR3sSV6w+DvB9r/3UKqkScad8 gROvvlIEV4yzYYGyQxZUT6FmeGOfq47I51Ka9tcS8B+vqxuM+VQ3j88W9l7XNEOLG/ausZ RZtF53dqBjvUgCXdIarKthOKYAqkHVdclBvhFuEqtfp223YfFkVPeTvM8pRsWQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 --- Comment #4 from Rick Macklem --- So may i ask:=20 a) nfsuserd + Kerberos5 would achive the correct mapping of the uids/gids. b) nfsuserd without nis/ldap/kerberos cant do that. Is this right? Yes. If you do not want to have a uniform uid/gid space (ie. same numbers assigned to the names across all clients and server), the only way it can work is for Kerberized mounts. For Kerberized mounts, uids/gids never go on the wire. You still need a uniform user/group name, which is also consistent with the Kerberos user principal names (for the user names). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 13 20:20:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5F65D85ED25 for ; Mon, 13 Jun 2022 20:20:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMNHG0yw8z4VXM for ; Mon, 13 Jun 2022 20:20:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 015391C544 for ; Mon, 13 Jun 2022 20:20:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25DKKfjR071203 for ; Mon, 13 Jun 2022 20:20:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25DKKfWR071202 for fs@FreeBSD.org; Mon, 13 Jun 2022 20:20:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Mon, 13 Jun 2022 20:20:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655151642; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=l1LwhIjVm965GYd/V3hb5Ivi9BNstVYvcrM60PQLocA=; b=t9saJc51NM9xekTjH9YIIBde+16fLUqjTIXi7WQIP1kCNl6x6p11BvwtesWLc6F7utvbYP GdAomtM62dH3cc55jrJtMcihIAJSsj9zyaxBIDxWWUekzWTQlXglfjZJoLwSbAxHR4Puvt y3qBaCKSkketk/Fyq5G09kgNCklQPS9Gvnb7vviXS+9lfLBevyBJiCRGPqapI/bO1jGkj8 r6e5HNfW37kRBGcHJ3GqM0PYyaCyM/8wPJmzkm/45O0GmCfm5SHhgKFDDObMjXMpLZggS5 3jMzeywM/WWpUtfZrpR29rYdxS1Sl/Ue52BlPK7IInW+qX7h5cUgjKocKGE83g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655151642; a=rsa-sha256; cv=none; b=G5XioIy49R/y1yppJjx7i1yhFMnduZCDfLL1XlNCQTbBTkjd6OeuyHKDKW3ATiFgDBglea F6/Tgp/EdAlE1DXbMzW5goahGov7e8MlcWE8cZyzDiiSFoPkcei0c3MH/qkiDKKucn/LO0 b+zbi9/ZTStYXoX7DhCSAyUJKx9ntSMaMVJjAwJo/Sk7sm5eUgWGOZ/80Q8Cqt4WZhuhom EuLVRbHhvN157xn3Nqd3R9F6e8zgJWHCYSEQ/im3eP0cKYoBl2fsvWTnm2dnYik1c49Hau KEZJXKMMFUVF78vHtjRvoW61vYfPfJWKKjUuNSnH8fXCmdu3tnR1+uhD+bn8Nw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 --- Comment #5 from Rick Macklem --- Oh, and if you choose to use Kerberized NFS mounts, the setup can be non-trivial. Hopefully this is helpful: https://people.freebsd.org/~rmacklem/nfs-krb5-setup.txt (It does not cover use of a Windows ADC KDC at this time, which is a whole different story.) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 14 13:17:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C7B9583E0D5 for ; Tue, 14 Jun 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LMpr63GKGz4SZv for ; Tue, 14 Jun 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4BE942E86 for ; Tue, 14 Jun 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25EDHA4V003291 for ; Tue, 14 Jun 2022 13:17:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25EDHAk3003290 for fs@FreeBSD.org; Tue, 14 Jun 2022 13:17:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264570] nfsuserd: Mapping of Userids mismatched Date: Tue, 14 Jun 2022 13:17:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655212630; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XZBCQqBplm+ZECsk0hUAFtYgpxFdQ2F7NtoMvMYVLQs=; b=BJmEcGj/TrMns0qMr1lVdo9allBjVI2Rdy1JISZMG1rizLsIEN6hNUA8troX95VYt4a6q/ xK/ZZVwhm1Jse2+S66hQgUi8Hdv5QubB5uxTQWID+8yv/lZB6SrJAuwMm1BOSjufq4C2H1 nLZahNa0Kj31WaHZ9CIFNGWTSGzXNzPe5YrNGuhmgTTkA6C7EuPpLnYqZeyubvQ7n9tTiQ 7/6lIT/hU5vlQPU6LHnnntlfshKDXvPs3HVjSMpta5uPAwv4kxu4fd6oo5Kq5xVcG0P4KB rMcTfo4Aq2bo6jq8bXjVfPI/toMgPQf7ZzqNS3nG5IYkW63OoGxH33nO4+U6eg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655212630; a=rsa-sha256; cv=none; b=MiJwe4SpEP2mfzvnlojU25C+EaRvxb0cOnHD5jXU2FsO/ZKK1efOdjT9mqUAcKciVBMGSd XghPy3px+9fYMv4FaihRSQAkcD/vsnrUeaWlzYIXugR6nHwHsS7UG0fAQHm6srVKKqv7nW glNQMpSsX7igaioZn86vozaZIdSQlIMc9scp9SqKy0EQhexmdMEQ0Rq35REitJ+KQSQ/ss dB22PEaO2cVh88Yx37AohKpSQqAn+Av7xLm52qoZaj+BYggVgefzFtSsx4oA+eiZASecgh Nhkn0DbgZv4LAT4eZ1+wZsKXBdZglQyrYBJjf9K/eXvfWE4ADErNrnfuOTjQ7w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264570 Rick Macklem changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #6 from Rick Macklem --- Described behaviour is what is expected, so I do not think there is anything to fix. Closing this was suggested by the reporter. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 16 23:43:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8374684656B for ; Thu, 16 Jun 2022 23:43:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPJdq23bsz3wNT for ; Thu, 16 Jun 2022 23:43:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 26E6814B70 for ; Thu, 16 Jun 2022 23:43:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25GNhRjT042723 for ; Thu, 16 Jun 2022 23:43:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25GNhRu7042722 for fs@FreeBSD.org; Thu, 16 Jun 2022 23:43:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Thu, 16 Jun 2022 23:43:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655423007; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pk1ivvANZQizPj4JealQ3q8SN6IdGxq6GXsarJvCBQE=; b=uu7uXqbIX+rvcO031ky71HFQ9LqVxcj42yyroQ+ylsdCSigBKIpoxTpVuAjNi4Kk/fTVdV v/9sHNLfn31ZpvNa+caGPBl2sEmJjxU62Ca2CihdlKmsFrctTw+lRN1PrBLOQNFJ3uuWXF FIhPVdkFFS5CK7GI9tYyR9K0PfYS7tSOOHtqv7+/VU4nRNJp4kwo/P56VsZ+lw6kYMtYVn IGXHmGLe0SslpifCPKaRUsAg4tCF/9hnNO4YETztUz1VnjGPFTsZxf5ir+w+ZJuNKg05A1 qtAfpM96ywIuCLuEOAw2krCecK9p3EyLwLGlAOGDOPfQyhWW49hj/jhZm28nMw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655423007; a=rsa-sha256; cv=none; b=KaoSXaJxrzdf/xUFTxRBF5m59Alp7dayCKn9w+KVc2X/DVgh+75nNvNzJ21BrmI8Cq3q7d 7W1Cmk06A22+KOMg+1ikbCaQHEsRNTzGdK8GdBq4l3wAORkJaYB3FnZDOv2hcjh3EQeJLy QUaZJWJilYHhO2yXzhdCX/Xcvnz+v7pq3yUcBw3/JMHLncGwOeYw10Zqsnw89mo3Wa0hRS WVsdjmcBHwPRnE+aVCvpeN/MppWsM6QAJlxAi+9mqO27UvEK1giBYVdi01H1ue1S4gpwPZ +iWmcNZhEbTRnarox0ZAITPYiiSK40WIKYU8RPQ83zh2OWiRWEkcvSeqeponSw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 --- Comment #10 from John Baldwin --- Hmm, the new assertion would trip on ETA and AEAD sessions with separate ou= tput buffers doing decryption. It's only pure-digest verify operations that shouldn't use an output buffer. I've restructured the patch a bit instead. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jun 17 00:00:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 730AB8513E5 for ; Fri, 17 Jun 2022 00:00:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPK14291bz4SS8 for ; Fri, 17 Jun 2022 00:00:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 27CD814E67 for ; Fri, 17 Jun 2022 00:00:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25H008DM051736 for ; Fri, 17 Jun 2022 00:00:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25H008Zr051735 for fs@FreeBSD.org; Fri, 17 Jun 2022 00:00:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Fri, 17 Jun 2022 00:00:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655424008; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7dzNi237SjyX0eu/P3Jum48p3aaC4zyXgqIpTSu356Y=; b=VEUpo9B5Y4/Gk2ZCfFITnTyMyLFDa0qjuZR7YKo3Kb8dfrCNl1+HQ7juy1xi888KIgS7cR Qmi41WBzfwDSyKTwld/5CKSNAdXxXcfXA8+82w1XMSSgDyvMyhx8yZ9O+4XV+HHw7DxpdH d8JwM5CB8eTDv4GcFxlvSaXqZqbZhrmAtA6pjPYD5QHPWMtiPcUeLxxor8wn7/xGXylmZi RbBUUIHWZ2FBrtD+BTk2dNjnPz8ub30KYFmnbNCiGzZE81fuiR47LZt5hdmGjy6YwGA6hN 5ujbvGgTRefDeMRKGwS49ot+7ZPKnHaQ3qFyVqPzQGPfz4LGIDCmpTP3Z8EnEQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655424008; a=rsa-sha256; cv=none; b=TPNHcaMlhMIb5QqJwhqFVxJ9h0uX1FHGMtsU5q3g7Rtb0UPvBV4d879ytC7TqFTC3voPTt YZHKplv0NIlgod2z7b2Yy/rZE/G7CzGrU7UMyk3biDfVIoz9hAJiOGf4O4A44AHIL3k+5l uSUwM9lKmEHNywDMLmHSqWsoJ2wp3LMluK+BhQujjr8fUssxeuSe9BFXugxl0q/PRKOrVt z+wIoC+ytxip9qa8Qmwjs0p8LfPW5epFUNd/vo1SYll6Hyb9TV7wdkznOiybF+Bdh60jg8 u1H3+5KmChzSZQDgIHN7qGOIS4eXOM3k1D86yt4mzsA2pxhZaU0x5eHasiexuw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 --- Comment #11 from John Baldwin --- Created attachment 234740 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D234740&action= =3Dedit zfs_crypto_hash_assert.patch --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jun 17 00:00:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A3B5B8519AC for ; Fri, 17 Jun 2022 00:00:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPK1j0zDyz4Sw9 for ; Fri, 17 Jun 2022 00:00:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9483815395 for ; Fri, 17 Jun 2022 00:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25H00eBF051866 for ; Fri, 17 Jun 2022 00:00:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25H00eDB051865 for fs@FreeBSD.org; Fri, 17 Jun 2022 00:00:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252316] [PATCH] add OCF offloading to ZFS Date: Fri, 17 Jun 2022 00:00:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jhb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655424041; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dWV3MKsyz2fVyVaYwMyt7zHGdvYIOVcr+nDFmRwy+wo=; b=BJJCsfUWHlZ3NPvEjA/H031aQvZ7U1faaqt+6LSTz6PsamKs2X2jd7AtDX5AVi8XkNK+4n wczmOP+4jC5pS0wVfTpu+D/q6aRWdEmio5GWn/C3Ns1HwVHll/9StXADdcohSf0FDNV4t3 pOz+EcrjJ2k99j4ZqgcRt8Gce4UY+PFh2GRdmePeYEOGlBa8bewHfbqYSZOOsmGSyIw0+Z Qi9GzoVMvgaKpBM5pRrIMFRlsEQdrnGAaknJa680r8dhHniWYSNhnDClD+3nchjV+IhSZx nTbJaTda04FQ2H1wJIlwa84rghjEza+IoTvwr0cG+sfJQznYPiUmuoO4lka7fg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655424041; a=rsa-sha256; cv=none; b=pdcBaHr5qTasAyFlGEOgJe9gQDyD2A69UTHAX+4jbd1ZcLkmJ5z8LyIn/w1r9PqMknb4xZ vpc0tdMW7cYxQEZkrzoirGW8DBeOxV0ZP0RHsLTEcS7t0kf72p+9NGQyEta0fe6jfXtqau pHGCxZbp33pr2rv7rqUf2iwqVbY+gV3o3+KUS0rjf8YmDhhNqTgk+hiTSo2+8QDF3+WlNe h51QHYRuutETj77o9JDfSkaHqIWrpHZ1R1BPXwI41RbMga4N2PPggtGHHxBzPZ0qk6EORw AAMiu9UOk/+ef4jPTrjSduRS1Iiy2/RPI0Fl42kOmRCuht82EpRVlEHhIo5ewQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252316 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |jhb@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jun 17 15:46:07 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2199D83E2B5 for ; Fri, 17 Jun 2022 15:46:20 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-yw1-x112c.google.com (mail-yw1-x112c.google.com [IPv6:2607:f8b0:4864:20::112c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPk0q03Jjz3vwB for ; Fri, 17 Jun 2022 15:46:18 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: by mail-yw1-x112c.google.com with SMTP id 00721157ae682-317741c86fdso44539837b3.2 for ; Fri, 17 Jun 2022 08:46:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=+B7wSIu30J1RTDJe5heyaVKY7JdSuCxBdbyO1dcEiYk=; b=hS0/XRtVxP95Ew8RIXToRVjixBYYcslCblN/ANb9yJkaJYieNo48UeMwK1jAJaJDKe caMaak68Ysl7TZdw0AS0QZeyKOVXnIOgTCA+W2qupvIc5mk4Kw9EaAismeKMI6wb4QP7 0+laAUneDdOM7/XvrGZGbK7zQXLOfI9JHcX6m9FTUrIJ/Z+OsBhFqvoK+2Qj7TT7imkE tkL4MAP2E0sFwCYewTpIjOwyUVur6fNH99PgRbLKL220jUYuda4+nR7qCbV6wOq6M2oW 12ODufXLW6mH3kGTSW48+sPaP5JupQHDKE9T670DzL182rVykmF1LL5l8I6PokFHbzco q1zQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=+B7wSIu30J1RTDJe5heyaVKY7JdSuCxBdbyO1dcEiYk=; b=aJjYlhFihBo/f08six5US2dPcx/n9+LP4U4yB654PR9x3EQFdpesWOSDeDjQRoY3JC dSqRY9t9XHeuUoo4HiJUYn2ijqmhRz8pZpjXQrVJu+lokltCAECVOOW5EBlUu121igTm EgI9GFQ/0/Zxd8fQ8Y69w/nPvD0sYwoNhBC598WO/VpLUSmAkhaU1m0MjIKKf+NFVPkh TY+L3vK05hsSemRufVq5n2sDKmHUDCBr3TdUgLNLv6yIRqC9c1mUGEufmxy74FsZuLtx 2p0NME/NxLSbu2bONHKbsqTogUQHU7iSaxyIXvLHEcw+slIW2Bw9JHmDi2zIKEP21G2J IBdA== X-Gm-Message-State: AJIora9wN5987pST/DDMHKgXnzJKgvSerls3pG9iaG7wAVcT42zLT22I bs5a7H7WoQJ9bP0Ar6gK8DSAKDMbkrlSbOz+4Ij7vVLaUUE93w== X-Google-Smtp-Source: AGRyM1uxefeEmT2FkDHc95S1XQD4WVCkXZ6OdPJOdXtgrt7m927bDieHO7NzFMmgiMR0PL7VeW5igrXYL4pq0qR+scI= X-Received: by 2002:a81:7b08:0:b0:314:11b7:e3ec with SMTP id w8-20020a817b08000000b0031411b7e3ecmr12783326ywc.457.1655480778081; Fri, 17 Jun 2022 08:46:18 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Eric Borisch Date: Fri, 17 Jun 2022 10:46:07 -0500 Message-ID: Subject: zpool/zfs-commands hang; ZFS filesystem/ZVOLs still running. To: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4LPk0q03Jjz3vwB X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="hS0/XRtV"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of eborisch@alumni.stanford.edu designates 2607:f8b0:4864:20::112c as permitted sender) smtp.mailfrom=eborisch@alumni.stanford.edu X-Spamd-Result: default: False [-1.60 / 15.00]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-0.88)[-0.878]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112c:from]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; MIME_TRACE(0.00)[0:+]; NEURAL_SPAM_SHORT(0.98)[0.981]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Good morning, I have a 13.1 system where twice now (required hard restart last time to resolve) since upgrading from 12.x I have had zfs/zpool-command operations start to hang indefinitely, while the underlying pools are still actively running/processing data via both filesystem and device interfaces. I am running a custom kernel. There are no what I would consider extreme modifications, just a bunch of disabled drivers, and using CPUTYPE?=native. (E5-2609 v2). This hardware and kernel config (on 12.x) had been running without issues for years. Best I can tell from what monitoring data I have, and the timestamps on hung operations, this started with a zfs destroy operation (cron / zfstools scheduled snapshots); PID 12835 below at 6/16 10:00:07. Of tangential interest, the time and lstart fields for 12835 and 14356 are usually empty when I run the ps command below, but happened to show up when I grabbed this output. zabbix_agentd is a non-privileged monitoring daemon; it periodically polls (among other things) filesystem information, and its last message out before wedging was at 10:10. You can see that the zfs send (14356, started at 11:05) accumulated some CPU time before hanging, while it started almost an hour after a zfs snapshot destroy operation. From the destination side of that send (remote host) the last (zfs recv) output indicates that it was receiving an incremental update when 14356 stopped producing new data. I don't know if there is anything else of interest I can provide at this point, as I'm sure the first recommendation will (understandably) be to try vanilla. The system is still up and running, with ZFS access through the filesystem layer (+NFS to remote hosts and bhyve VM) and device layers (zvols via bhyve VM and remote iSCSI) still actively processing, and I'm not planning to take it down to try vanilla until some tasks that are in process via those interfaces are complete. Let me know if I can provide any other useful debugging information off the still-running system. Thanks for any suggestions, and as always thank you for the excellent software! - Eric # ps -Ao state,time,pid,lstart,lockname,mwchan,args | awk '/^D[^L]/' D 7:04.02 1452 Mon Jun 13 16:09:31 2022 - vfs_busy zabbix_agentd: active checks #1 [processing active checks] (zabbix_agentd) D 0:00.01 12835 Thu Jun 16 10:00:07 2022 - zfs tear zfs destroy -d kspace/users/eborisch@zfs-auto-snap_hourly-2022-06-15-07h00 D 0:05.09 14356 Thu Jun 16 11:05:01 2022 - zfs tear /sbin/zfs send -L -RI @MARK-mr-dewey kspace@NEW-mr-dewey D 0:00.00 23970 Fri Jun 17 03:01:00 2022 - zfsdev_s zpool list Ds 0:00.00 24280 Fri Jun 17 03:32:00 2022 - zfsdev_s /sbin/zfs get -H name system@MARK-mr-dewey Ds 0:00.00 24881 Fri Jun 17 04:32:00 2022 - zfsdev_s /sbin/zfs get -H name db@MARK-mr-dewey D 0:00.00 30957 Fri Jun 17 07:09:58 2022 - vfs_busy /bin/df -h D+ 0:00.00 31933 Fri Jun 17 08:45:14 2022 - zfsdev_s zpool status procstat -k output: 1452 101721 zabbix_agentd - mi_switch _sleep vfs_busy kern_getfsstat sys_getfsstat amd64_syscall fast_syscall_common 12835 100336 zfs - mi_switch _sleep rms_wlock zfs_umount dounmount zfsctl_snapshot_unmount zfs_ioc_destroy_snaps zfsdev_ioctl_common zfsdev_ioctl devfs_ioctl vn_ioctl devfs_ioctl_f kern_ioctl sys_ioctl amd64_syscall fast_syscall_common 14356 101770 zfs - mi_switch _sleep rms_wlock zfs_umount dounmount zfsctl_snapshot_unmount dsl_dataset_user_release_impl dsl_dataset_user_release_onexit zfs_onexit_destroy zfsdev_close devfs_fpdrop devfs_close_f _fdrop closef closefp amd64_syscall fast_syscall_common 23970 100339 zpool - mi_switch _sx_xlock_hard zfsdev_open devfs_open VOP_OPEN_APV vn_open_vnode vn_open_cred kern_openat filemon_wrapper_openat amd64_syscall fast_syscall_common 24280 101845 zfs - mi_switch _sx_xlock_hard zfsdev_open devfs_open VOP_OPEN_APV vn_open_vnode vn_open_cred kern_openat filemon_wrapper_openat amd64_syscall fast_syscall_common 24881 101280 zfs - mi_switch _sx_xlock_hard zfsdev_open devfs_open VOP_OPEN_APV vn_open_vnode vn_open_cred kern_openat filemon_wrapper_openat amd64_syscall fast_syscall_common 30957 101229 df - mi_switch _sleep vfs_busy kern_getfsstat sys_getfsstat amd64_syscall fast_syscall_common 31933 104201 zpool - mi_switch _sx_xlock_hard zfsdev_open devfs_open VOP_OPEN_APV vn_open_vnode vn_open_cred kern_openat filemon_wrapper_openat amd64_syscall fast_syscall_common From nobody Fri Jun 17 18:33:52 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1504183B023 for ; Fri, 17 Jun 2022 18:34:05 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-yb1-xb2a.google.com (mail-yb1-xb2a.google.com [IPv6:2607:f8b0:4864:20::b2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPnkM74F6z4pjh for ; Fri, 17 Jun 2022 18:34:03 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: by mail-yb1-xb2a.google.com with SMTP id l11so8575606ybu.13 for ; Fri, 17 Jun 2022 11:34:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=v8z7sVUrPzxZDpNrj/TRNof9XqQn3Je8Ik3l+8VYy4g=; b=qSiweYoXuB3ZXlWfety9soaYqlbO0XPnu3Ynnxkx7atr82TJdktbdjELNF5Qmwwpd3 60mPEncjYI+0yFeqqs8WUOT48sF+D7HP2ZN83wEiR5t5WK31WRSwLTl8G78pGeIb2Gr3 LF9hXMNieWkrdf+JCeyHCorZjwChav1PTud7W/IBdUpB9RMj4/Jgi6MZa+KfAp/qdpK4 Kn2fTBjA/2ZY8j9JKCUwd7dMGz2k8eLRaiTM7xxB2Z22/TCdw7RPTYwvcdLxz/o3ylnv 5vAvEM0JcEkSrJCWH+fpNhLp4IDTrHAkyWh8d6vd4qEZRV2//OJRUZuhtiObDL/Ce7lu hGmQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=v8z7sVUrPzxZDpNrj/TRNof9XqQn3Je8Ik3l+8VYy4g=; b=ga1YLYqMuNjxkvki7tiw3ARPbvqRILcMQvtVJBN+Hm/x4AIdBoP9Tf/m0DOiM5VtKz oQG+3t0UeRTbTED0vQZLQnaYXa+8EdfC/FKLmi3083HiVZ888XCAgP3WdH9FZnvt06rM sFydxa5mqkFQ3BsdHbcIzvwzQrEwd1Jys52aHRkQjbJDQrRWhnZrq1/tJRfQyAKfiXSn EtS0a6mFGJjIkP6j6dRH7Epm9eCXT1DytmmUYvhfxIYgFmhsVIlJexSo9zzw9vI0rplK 3Mkz6gJZsSvOH8uzoC6HIP8mQH6y//ljDght4c6cZheF8J/89SN26hwsk3uNtJXWJSTL 6Fww== X-Gm-Message-State: AJIora+DkCNYVyuW+0cA6XAddAuyhAg3nrdZh9f+jUyOqgPjSoI9XGOH sPJsxrXbC5FdIu7i9MBAxlkTBsUlPX1pjRc0tdMYvnOYdNUIiA== X-Google-Smtp-Source: AGRyM1sUAT8CPTxsPdGaSz7dZF9I3asyiKZYUKWb8FC19e2Tx3OOglWRBpbCUbSmlYxnTY9t6Hg9MyeeZNLSYqU9l7Q= X-Received: by 2002:a25:c50d:0:b0:65c:b34b:287 with SMTP id v13-20020a25c50d000000b0065cb34b0287mr12885579ybe.334.1655490843256; Fri, 17 Jun 2022 11:34:03 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Eric Borisch Date: Fri, 17 Jun 2022 13:33:52 -0500 Message-ID: Subject: Re: zpool/zfs-commands hang; ZFS filesystem/ZVOLs still running. To: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4LPnkM74F6z4pjh X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=qSiweYoX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of eborisch@alumni.stanford.edu designates 2607:f8b0:4864:20::b2a as permitted sender) smtp.mailfrom=eborisch@alumni.stanford.edu X-Spamd-Result: default: False [-1.78 / 15.00]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; NEURAL_HAM_MEDIUM(-0.94)[-0.939]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-0.70)[-0.703]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2a:from]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; MIME_TRACE(0.00)[0:+]; NEURAL_SPAM_SHORT(0.56)[0.558]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Fri, Jun 17, 2022 at 10:46 AM Eric Borisch wrote: > > Good morning, > > I have a 13.1 system where twice now (required hard restart last time > to resolve) since upgrading from 12.x I have had zfs/zpool-command > operations start to hang indefinitely, while the underlying pools are > still actively running/processing data via both filesystem and device > interfaces. I went back to some data I captured during the first instance, and it also had a zfs destroy and zfs send in perpetual D-state: 11076 - D 0:00.01 zfs destroy -d kspace/users/eborisch@zfs-auto-snap_frequent-2022-06-13-08h15 16564 - D 0:22.82 /sbin/zfs send -L -RI @MARK-mr-dewey kspace@NEW-mr-dewey 11076 190929 zfs - mi_switch _sleep rms_wlock zfs_umount dounmount zfsctl_snapshot_unmount zfs_ioc_destroy_snaps zfsdev_ioctl_common zfsdev_ioctl devfs_ioctl vn_ioctl devfs_ioctl_f kern_ioctl sys_ioctl amd64_syscall fast_syscall_common 16564 190128 zfs - mi_switch _sleep rms_wlock zfs_umount dounmount zfsctl_snapshot_unmount dsl_dataset_user_release_impl dsl_dataset_user_release_onexit zfs_onexit_destroy zfsdev_close devfs_fpdrop devfs_close_f _fdrop closef closefp amd64_syscall fast_syscall_common Note the particular @MARK- and @NEW- snapshots are different now, as they are constantly destroyed/renamed during successful backup cycles, which have occurred between these two events. Thanks, - Eric From nobody Fri Jun 17 18:46:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CD49D83D005 for ; Fri, 17 Jun 2022 18:46:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LPp0Q4kXKz4qwh for ; Fri, 17 Jun 2022 18:46:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7D5F124A67 for ; Fri, 17 Jun 2022 18:46:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25HIkE0V001691 for ; Fri, 17 Jun 2022 18:46:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25HIkE2N001690 for fs@FreeBSD.org; Fri, 17 Jun 2022 18:46:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229829] [zfs] scrubbing prevents shutdown and slows down startup Date: Fri, 17 Jun 2022 18:46:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bdrewery@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655491574; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9v8xfUT4tfPPwoFMYHYM4hTcH7yAY2nFYkKMLXxTh5c=; b=F2UdOTJexzxlj2kl0Pe6aeGB+51CIv5U8jEvlw7qlueBXX6Xoj5honPsF4Fe5INuxKbeIY o5BQ78mlMiD2+SnEb3dCdWNQc5MAj4hjfXsiztSs9ttqBCLMMUv4mpjY1oE028L5q/D0xh bIydfUsyf3memQ25SQW4TRx0lM+M4mm1QQOGnrlwnuTWZx1UXsdmee3fdjKdF+3V9lw2eH JIYM26xZ8oSvoKYedouhvVkDa/AJwkgsx/zgQw/ohGW5yG8xtWeWfdqKzDi5HJFdTreaeG z1yApfgl2wTt99iyhhbIajL/U1SgTlJPQ7hvq0orvldHHfturggerzWBCL+iaw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655491574; a=rsa-sha256; cv=none; b=itD5DWvREa0CBLaO3KyAIpDr9GM/Mq3i8yKUbqvd8C812qHFQUGXAjoTUTZl0M23YJYMn8 DxFt8+zT4y22ltXL382Ktm1suyzLXfKfX1J9bFwYKk4/ibrf79VnnN1ABfXawlsaera/sg Ih+u+Kd+kdGNae8AyWIjsT0LoxYxAgz3M4ltJx3rW4IkXEd20McjkVZzBtxyDy08v+oY+K +6P7JNBpIltykaABmLZjNhBERofspvhfr06JO98Vv0beLV8rM8RiyoMnRE66TcoCeoGKiY xPh4XCN0of+Tf5/T5RUkcYiZDAvqmmhUsXBEcF/rgYci3ncKhgkocPoZ7lA4iw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229829 --- Comment #3 from Bryan Drewery --- I think I am running into this on stable/13 3a0fcdb37dffcd28c21c846d6165f6c382d9aac3 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jun 18 08:00:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2AB8184086E for ; Sat, 18 Jun 2022 08:00:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LQ7cK6VKhz3vnB for ; Sat, 18 Jun 2022 08:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BB96A10744 for ; Sat, 18 Jun 2022 08:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25I801qF048833 for ; Sat, 18 Jun 2022 08:00:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25I801Gl048828 for fs@FreeBSD.org; Sat, 18 Jun 2022 08:00:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Sat, 18 Jun 2022 08:00:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655539201; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KlZxGNTVi/ETJ64cxecIVAhFyp2vKT5JD2LwjkvnBrc=; b=CwGSOVwNy3cflUYeOfJt3uI1U6t1raluWgzn6dwStXgyw97cFN223Cckd3MMBXP9mEWOPl vsu2vdehNyfse+IYR8vjqhPn0LAcW2rIqyJdcwMvSg3wqj4d2nlAWOCMOJeYSGcEmyrVs1 S9mquSjbOAaU7caLTzBxtvTybZbuzz2PtiI2atNeCoMFjWaOMIBwGtsOgC54v1ZFeOVjkI nD2yBEu556R/oHubibS/JQolmMZE9/ia6hb1/oOHfQ4qszzYqnt0nvgUen1R7kTH5GVhQg NniAilKAKs/6HDWrbrY39cYBrRaajwUk4lQiW8qokCzjUArchTFGqzKnpDy90Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655539201; a=rsa-sha256; cv=none; b=OuNyNPUwuPvRpGjkZspiZkFqJKRU3L9lZAkm1fR59jm8DKghYHyjMx96wPIBO59X+b1XTi QYOHQlaRjiiNjRZXcGZkpNbi8a/q1g/2/ksN+J96vIQiY66PBNMRJAfoVX+kRTC8YJAnMS YT6Lrb0goHh1piEwi+R3F/zbsJIpPMB4BynqrSUQLa8IvASrlOdXqz/ZBi0V27pW/e1qbP o8V/UOZ9AJ8iYFzyraU5x0/G28og8ES7SMFcvU+ubErtilgstKvmXwv6pKYAaDEGki0Kwx P1sbVfbMOW+AWq4U5SDfE8KCzABtZ8TFOu0QDzX9trObUHnKPD13szF3yzWC6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jun 18 11:07:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2528F839025 for ; Sat, 18 Jun 2022 11:07:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LQCn4727Gz4rfY for ; Sat, 18 Jun 2022 11:07:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D18C11360D for ; Sat, 18 Jun 2022 11:07:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25IB7q6I059369 for ; Sat, 18 Jun 2022 11:07:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25IB7qLD059368 for fs@FreeBSD.org; Sat, 18 Jun 2022 11:07:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Sat, 18 Jun 2022 11:07:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655550473; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OmNlUDn+3yimhvSQHBLn7amIEpOrnBFWYWcB93RftMs=; b=SjuVMLiKpWEv7nohk4TSsZKEezJI9qliEoYxZTSJo5QWheCizwAsGgTiKRk+NbFkb43CDL d1ov4LaLDJAn+UYleFfCMzaExs0+AUJvHuL7mb9VNLwRBDbwwIZ/sLItdu1d/m1fxthck7 +jfCUMjADsrbPr6jc59ljZbIJsY8z49M03JUWBaG8fcdKwgXHl9YDz5iOKTQJZp6CSe14a tIWYLeNr7rZanOE7yBKgLjKHYE7hK4xmrI+qF5ZSoobqXkTN1kUhWo5i+Ryigsdpb59UuH ElpXQHT3Rxk/qibTnKlVu2rdbJuugR3mDT1afUeH5rb5lq25gTd+4oky/qrULw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655550473; a=rsa-sha256; cv=none; b=KruZdlKFJUjkbw79m9Nhb3ZPcGEEElQlbO8aCaP24FYAdCToFXYtWD3vVPR2vRtsYlfLh5 l+xk1TOB1GuR/w98bTcepBKUJxYmUz9XwUhhUN9XyGZ0KdQgRKJawIGS/NjmKW7X80yeZy BllUo2cCoztwUybTBJjb0gQHIcg2kdsjvKgyja2X6mmoHA9m/dnrVgRom/3KyNAPPr9n6u JSP3C17w24TfRikcu3xzpR2/nOAjvAUwc4OWoZo9uEwafp1W2pvMzG278n0KHkIHmohx1l 4/0ARMIVWdVJsf7qZzABDU9TrBxk/7fI66FBZBb66mT6av/HtxhfHG4PMHPKYA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org, | |mckusick@FreeBSD.org, | |pho@FreeBSD.org --- Comment #12 from Konstantin Belousov --- I do not think it is enough to fsync() only the directory, as jh' patch cleanly illustrates. What it does is significant portion of VFS_SYNC() anyway, so it is cleaner to just do VFS_SYNC() and pay the cost of syncing data even if not strictly necessary. OTOH it is not safe to do any of that stuff while then vnode is locked. We recently got a way to correctly restart this kind of VOPs if they need to relock the directory, which implies the need to do re-lookup of the entr= y. I put the patch at https://reviews.freebsd.org/D35514 to handle just mkdir() for now. Other syscalls like link() and rename would need similar treatment if my patch works. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jun 19 21:00:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 87CAB85EAC3 for ; Sun, 19 Jun 2022 21:00:04 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LR4sw0dSRz4Yqm for ; Sun, 19 Jun 2022 21:00:04 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B0B297C5D for ; Sun, 19 Jun 2022 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25JL03mi057122 for ; Sun, 19 Jun 2022 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25JL03Zr057121 for fs@FreeBSD.org; Sun, 19 Jun 2022 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202206192100.25JL03Zr057121@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 19 Jun 2022 21:00:03 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16556724034.fB07c3.56439" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655672404; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Zh9Tzhsl0wlmi7gANqAGt049+S/8DrKj9zycXPZyodc=; b=KyuAipSOjE4PISbun+atqo4sPPt7dtORv8WFo+Kus+qBfFrr+NBveQFrYBJnL3fl7p/sDw yhtOXZsVU/xGN1ggXf7aFkLCg6xEJxoGjYnuBXAk0CEXiWuBpR4BLtU1JKN8qmx/fnpAs3 wOtZ9Ow8aAZFSj0pjj7tTfOx58oovqyqwmdwC0/JhqtoPHqcD6pogRJkzLOPRAG5FhbN9+ 2pnloMsLVZflX3zJ2jG7cE9IMzx5/pyv/M0alG6ikjd197vWbDdMt8zCYDR5aiZY9DxFfj i2kom8HUFJas+dD4W44XzHPAaLEDn94fidnH9fR3Y/CuoVLVPSmdPFrObYeZVw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655672404; a=rsa-sha256; cv=none; b=qOR0IY4Szt8RWLlOf6iyU8Z4QUqCOOLamJybAyY+lhouXME+fYONpXIDSdOdGjawf/PXPV OuH87G9ioN9kyOA5dXEDz/b9OcZsKv4rxM9FwHUN6mP9GT5S7w4HYyE3NXA3PK8eEA4vUE 7+8GZJOfGf6XAinis35V4KAhmLZ2H7TWudxWMZuxdKp7q9r7TZqO85PZZoTrnrJY0NeXex JlS5PpyEpAy3Uz381zZzvkQfoS5+W49PWFpsrGlnURMYEXDcUbkZ4XAntcNDZR2oy3MtWs Dk1Z228Q0AFpqdb3cTeCTwsrONYjZs6Vab+VnK3LkbJcWx8WHqJXQoLJQgGTaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16556724034.fB07c3.56439 Date: Sun, 19 Jun 2022 21:00:03 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16556724034.fB07c3.56439 Date: Sun, 19 Jun 2022 21:00:03 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16556724034.fB07c3.56439-- From nobody Mon Jun 20 13:42:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 93FDD85BED3 for ; Mon, 20 Jun 2022 13:42:17 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRW6K0j4zz4WVm for ; Mon, 20 Jun 2022 13:42:17 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id E05D34160D for ; Mon, 20 Jun 2022 07:42:16 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id AnTR-zfmCHcm for ; Mon, 20 Jun 2022 07:42:16 -0600 (MDT) Received: from [172.21.35.205] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 4483D4087C for ; Mon, 20 Jun 2022 07:42:16 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 4483D4087C DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 4483D4087C DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1655732536; bh=NMyX2gQO1bvrmgOA/0GQBxhL2MELzHaPBA+yr0OKIyk=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=WAWLIRiehzn+nlGFrl7U0wQDLB9K6r6nzZLlpyAhWvwLutO+7uuTpl4YldAUWTtS7 db8+CLBriFn0lMa8ocTAdq4A7qGjm3vYBjiyWZnTE2cuSK+qS0QuUAc1m/WV5VlHuK 1h+ZFn6IqBUL9ryZJVoeU0emNE1G1jy6XsBynoNg= From: "John Doherty" To: freebsd-fs@FreeBSD.org Subject: "spare-X" device remains after resilvering Date: Mon, 20 Jun 2022 07:42:13 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4LRW6K0j4zz4WVm X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=WAWLIRie; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[jld3.net:+]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N Hi, I have a zpool that currently looks like this (some lines elided for brevity; all omitted devices are online and apparently fine): pool: zp1 state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: resilvered 1.76T in 1 days 00:38:14 with 0 errors on Sun Jun 19 22:31:46 2022 config: NAME STATE READ WRITE CKSUM zp1 DEGRADED 0 0 0 raidz2-0 ONLINE 0 0 0 gpt/disk0 ONLINE 0 0 0 gpt/disk1 ONLINE 0 0 0 ... gpt/disk9 ONLINE 0 0 0 raidz2-1 ONLINE 0 0 0 gpt/disk10 ONLINE 0 0 0 ... gpt/disk19 ONLINE 0 0 0 raidz2-2 ONLINE 0 0 0 gpt/disk20 ONLINE 0 0 0 ... gpt/disk29 ONLINE 0 0 0 raidz2-3 DEGRADED 0 0 0 gpt/disk30 ONLINE 0 0 0 3343132967577870793 OFFLINE 0 0 0 was /dev/gpt/disk31 ... spare-9 DEGRADED 0 0 0 6960108738988598438 OFFLINE 0 0 0 was /dev/gpt/disk39 gpt/disk41 ONLINE 0 0 0 spares 16713572025248921080 INUSE was /dev/gpt/disk41 gpt/disk42 AVAIL gpt/disk43 AVAIL gpt/disk44 AVAIL My question is why the "spare-9" device still exists after the resilvering completed. Based on past experience, my expectation was that it would exist for the duration of the resilvering and after that, only the "gpt/disk41" device would appear in the output of "zpool status." I also expected that when the resilvering completed, the "was /dev/gpt/disk41" device would be removed from the list of spares. I took the "was /dev/gpt/disk31" device offline deliberately because it was causing a lot of "CAM status: SCSI Status Error" errors. Next step for this pool is to replace that with one of the available spares but I'd like to get things looking a little cleaner before doing that. I don't have much in the way of ideas here. One thought was to export the pool and then do "zpool import zp1 -d /dev/gpt" and see if that cleaned things up. This system is running 12.2-RELEASE-p4, which I know is a little out of date. I'm going to update it 13.1-RELEASE soon but the more immediate need is to get this zpool in good shape. Any insights or advice much appreciated. Happy to provide any further info that might be helpful. Thanks. From nobody Mon Jun 20 21:40:33 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C47DE8748A0 for ; Mon, 20 Jun 2022 21:40:51 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f42.google.com (mail-qv1-f42.google.com [209.85.219.42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRjkV260Zz4WQf for ; Mon, 20 Jun 2022 21:40:50 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f42.google.com with SMTP id 89so17801249qvc.0 for ; Mon, 20 Jun 2022 14:40:50 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+Z50xj0rBrnPeAh/D1iZU9htmLFqlw2mZEVWolrjLxc=; b=sTafzOVFn3Pe+VLzYfu/BxnGrvBvlbA0zth++v18aiP+9IE++8sTspzU3H5uA1ii94 CBxImNvK5YrX/hqX0KAStOezeg3mZP21wxU7mJJwzAN2dsshxuV1Ptv2K9S+YAlrszZe ENCPbso1RXu1hJsFB1CPcWy/uxjjf63Fj/db19TAjLTIcGJKYqTiS4EXgn/awRjpeoIN dt9JGs6aHFUSedozMDw5j4d9LTv3fVvhMEJR5ZjmJ49rw523liDgW/v6zHiEbqJMiykX G5nH5PivJpIy+Y6NCkfQIwtpwMSDdGDh6jJmXJkyIjVQuDHVQAcMxRvVEzBxdNxER0K+ EDDQ== X-Gm-Message-State: AJIora+12Ur/eDLun5cBF6/rpkk4CdF6Z5Db1hat9Q99KXPHmkTh9OCE yk/JLhE9LgLumYg0gUm1zUSVzxAXcNQhLxMLJe2iBVx+79s= X-Google-Smtp-Source: AGRyM1vsWD2oJx5e+NggXgmqaoA3vEqQ1scZgvqhPVn6qXnwcSs0F3VysAxYkdyafUKI4PBQ/aJuVFIqYHIzQWWLKXI= X-Received: by 2002:ac8:570a:0:b0:304:e615:275f with SMTP id 10-20020ac8570a000000b00304e615275fmr21257236qtw.139.1655761243999; Mon, 20 Jun 2022 14:40:43 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> In-Reply-To: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> From: Alan Somers Date: Mon, 20 Jun 2022 15:40:33 -0600 Message-ID: Subject: Re: "spare-X" device remains after resilvering To: John Doherty Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4LRjkV260Zz4WQf X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.42 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-1.05 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.95)[0.948]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.42:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.42:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Mon, Jun 20, 2022 at 7:42 AM John Doherty wrote: > > Hi, I have a zpool that currently looks like this (some lines elided for > brevity; all omitted devices are online and apparently fine): > > pool: zp1 > state: DEGRADED > status: One or more devices has been taken offline by the administrator. > Sufficient replicas exist for the pool to continue functioning > in a > degraded state. > action: Online the device using 'zpool online' or replace the device > with > 'zpool replace'. > scan: resilvered 1.76T in 1 days 00:38:14 with 0 errors on Sun Jun 19 > 22:31:46 2022 > config: > > NAME STATE READ WRITE CKSUM > zp1 DEGRADED 0 0 0 > raidz2-0 ONLINE 0 0 0 > gpt/disk0 ONLINE 0 0 0 > gpt/disk1 ONLINE 0 0 0 > ... > gpt/disk9 ONLINE 0 0 0 > raidz2-1 ONLINE 0 0 0 > gpt/disk10 ONLINE 0 0 0 > ... > gpt/disk19 ONLINE 0 0 0 > raidz2-2 ONLINE 0 0 0 > gpt/disk20 ONLINE 0 0 0 > ... > gpt/disk29 ONLINE 0 0 0 > raidz2-3 DEGRADED 0 0 0 > gpt/disk30 ONLINE 0 0 0 > 3343132967577870793 OFFLINE 0 0 0 was > /dev/gpt/disk31 > ... > spare-9 DEGRADED 0 0 0 > 6960108738988598438 OFFLINE 0 0 0 was > /dev/gpt/disk39 > gpt/disk41 ONLINE 0 0 0 > spares > 16713572025248921080 INUSE was /dev/gpt/disk41 > gpt/disk42 AVAIL > gpt/disk43 AVAIL > gpt/disk44 AVAIL > > My question is why the "spare-9" device still exists after the > resilvering completed. Based on past experience, my expectation was that > it would exist for the duration of the resilvering and after that, only > the "gpt/disk41" device would appear in the output of "zpool status." > > I also expected that when the resilvering completed, the "was > /dev/gpt/disk41" device would be removed from the list of spares. > > I took the "was /dev/gpt/disk31" device offline deliberately because it > was causing a lot of "CAM status: SCSI Status Error" errors. Next step > for this pool is to replace that with one of the available spares but > I'd like to get things looking a little cleaner before doing that. > > I don't have much in the way of ideas here. One thought was to export > the pool and then do "zpool import zp1 -d /dev/gpt" and see if that > cleaned things up. > > This system is running 12.2-RELEASE-p4, which I know is a little out of > date. I'm going to update it 13.1-RELEASE soon but the more immediate > need is to get this zpool in good shape. > > Any insights or advice much appreciated. Happy to provide any further > info that might be helpful. Thanks. This is expected behavior. I take it that you were expecting for 6960108738988598438 to be removed from the configuration, replaced by gpt/disk41, and for gpt/disk41 to disappear from the spare list? That didn't happen because ZFS considers anything in the spare list to be a permanent spare. It will never automatically remove a disk from the spare list. Instead, zfs is expecting for you to provide it with a permanent replacement for the failed disk. Once resilvering to the permanent replacement is complete, then it will automatically detach the spare. OTOH, if you really want gpt/disk41 to be the permanent replacement, I think you can accomplish that with some combination of the following commands: zpool detach zp1 6960108738988598438 zpool remove zp1 gpt/disk41 -Alan From nobody Mon Jun 20 22:50:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CE3E385E5CF for ; Mon, 20 Jun 2022 22:54:42 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRlMj6q7Rz4f6Z; Mon, 20 Jun 2022 22:54:41 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 2A94E4160D; Mon, 20 Jun 2022 16:54:41 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id v1B6wULGcZqb; Mon, 20 Jun 2022 16:54:39 -0600 (MDT) Received: from [172.21.35.205] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 8B8B840790; Mon, 20 Jun 2022 16:54:39 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 8B8B840790 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 8B8B840790 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1655765679; bh=7GOJfpFJJnVCsnD0lse5Zih2sIoOIru82SJDl/49y0U=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=b4St5dFpS6jHDVa2tSnkslhoz+qf8m5Sn7d6UIeVJKZyPxwriCZ212DAs0P+R5YXZ KTCsX61C1QQTtU/2h/PuC5ygP/QuuSek7dgAZFFd1pHps002JNCxIjVcX64G7EISfU 7BuN5QfT4r3SQpp3aZkNxMIEhcvcB2EY8TEOJ4+M= From: "John Doherty" To: "Alan Somers" Cc: freebsd-fs Subject: Re: "spare-X" device remains after resilvering Date: Mon, 20 Jun 2022 16:50:32 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <768F3745-D7FF-48C8-BA28-ABEB49BAFAA8@jld3.net> In-Reply-To: References: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4LRlMj6q7Rz4f6Z X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=b4St5dFp; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N On Mon 2022-06-20 03:40 PM MDT -0600, wrote: > On Mon, Jun 20, 2022 at 7:42 AM John Doherty > wrote: >> >> Hi, I have a zpool that currently looks like this (some lines elided >> for >> brevity; all omitted devices are online and apparently fine): >> >> pool: zp1 >> state: DEGRADED >> status: One or more devices has been taken offline by the >> administrator. >> Sufficient replicas exist for the pool to continue >> functioning >> in a >> degraded state. >> action: Online the device using 'zpool online' or replace the device >> with >> 'zpool replace'. >> scan: resilvered 1.76T in 1 days 00:38:14 with 0 errors on Sun Jun >> 19 >> 22:31:46 2022 >> config: >> >> NAME STATE READ WRITE CKSUM >> zp1 DEGRADED 0 0 0 >> raidz2-0 ONLINE 0 0 0 >> gpt/disk0 ONLINE 0 0 0 >> gpt/disk1 ONLINE 0 0 0 >> ... >> gpt/disk9 ONLINE 0 0 0 >> raidz2-1 ONLINE 0 0 0 >> gpt/disk10 ONLINE 0 0 0 >> ... >> gpt/disk19 ONLINE 0 0 0 >> raidz2-2 ONLINE 0 0 0 >> gpt/disk20 ONLINE 0 0 0 >> ... >> gpt/disk29 ONLINE 0 0 0 >> raidz2-3 DEGRADED 0 0 0 >> gpt/disk30 ONLINE 0 0 0 >> 3343132967577870793 OFFLINE 0 0 0 was >> /dev/gpt/disk31 >> ... >> spare-9 DEGRADED 0 0 0 >> 6960108738988598438 OFFLINE 0 0 0 was >> /dev/gpt/disk39 >> gpt/disk41 ONLINE 0 0 0 >> spares >> 16713572025248921080 INUSE was /dev/gpt/disk41 >> gpt/disk42 AVAIL >> gpt/disk43 AVAIL >> gpt/disk44 AVAIL >> >> My question is why the "spare-9" device still exists after the >> resilvering completed. Based on past experience, my expectation was >> that >> it would exist for the duration of the resilvering and after that, >> only >> the "gpt/disk41" device would appear in the output of "zpool status." >> >> I also expected that when the resilvering completed, the "was >> /dev/gpt/disk41" device would be removed from the list of spares. >> >> I took the "was /dev/gpt/disk31" device offline deliberately because >> it >> was causing a lot of "CAM status: SCSI Status Error" errors. Next >> step >> for this pool is to replace that with one of the available spares but >> I'd like to get things looking a little cleaner before doing that. >> >> I don't have much in the way of ideas here. One thought was to export >> the pool and then do "zpool import zp1 -d /dev/gpt" and see if that >> cleaned things up. >> >> This system is running 12.2-RELEASE-p4, which I know is a little out >> of >> date. I'm going to update it 13.1-RELEASE soon but the more immediate >> need is to get this zpool in good shape. >> >> Any insights or advice much appreciated. Happy to provide any further >> info that might be helpful. Thanks. > > This is expected behavior. I take it that you were expecting for > 6960108738988598438 to be removed from the configuration, replaced by > gpt/disk41, and for gpt/disk41 to disappear from the spare list? That > didn't happen because ZFS considers anything in the spare list to be a > permanent spare. It will never automatically remove a disk from the > spare list. Instead, zfs is expecting for you to provide it with a > permanent replacement for the failed disk. Once resilvering to the > permanent replacement is complete, then it will automatically detach > the spare. > > OTOH, if you really want gpt/disk41 to be the permanent replacement, I > think you can accomplish that with some combination of the following > commands: > > zpool detach zp1 6960108738988598438 > zpool remove zp1 gpt/disk41 Ah, OK, I did not understand that spares worked that way. I don't think I can detach anything because this is all raidz2 and detach only works with components of mirrors. But experimenting with a zpool created from files, I can see that spares work as you describe, e.g.: # zpool status zpX pool: zpX state: ONLINE config: NAME STATE READ WRITE CKSUM zpX ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 /vd/vd00 ONLINE 0 0 0 /vd/vd01 ONLINE 0 0 0 /vd/vd02 ONLINE 0 0 0 /vd/vd03 ONLINE 0 0 0 /vd/vd04 ONLINE 0 0 0 /vd/vd05 ONLINE 0 0 0 /vd/vd06 ONLINE 0 0 0 /vd/vd07 ONLINE 0 0 0 spares /vd/vd08 AVAIL errors: No known data errors Then: # zpool offline zpX /vd/vd00 # zpool replace zpX /vd/vd00 /vd/vd08 # zpool status zpX pool: zpX state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: resilvered 456K in 00:00:00 with 0 errors on Mon Jun 20 16:18:46 2022 config: NAME STATE READ WRITE CKSUM zpX DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 spare-0 DEGRADED 0 0 0 /vd/vd00 OFFLINE 0 0 0 /vd/vd08 ONLINE 0 0 0 /vd/vd01 ONLINE 0 0 0 /vd/vd02 ONLINE 0 0 0 /vd/vd03 ONLINE 0 0 0 /vd/vd04 ONLINE 0 0 0 /vd/vd05 ONLINE 0 0 0 /vd/vd06 ONLINE 0 0 0 /vd/vd07 ONLINE 0 0 0 spares /vd/vd08 INUSE currently in use errors: No known data errors To get that pool out of the degraded state, I must replace the offline device with something other than a configured spare, like this: # zpool replace zpX /vd/vd00 /vd/vd09 # zpool status zpX pool: zpX state: ONLINE scan: resilvered 516K in 00:00:00 with 0 errors on Mon Jun 20 16:20:36 2022 config: NAME STATE READ WRITE CKSUM zpX ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 /vd/vd09 ONLINE 0 0 0 /vd/vd01 ONLINE 0 0 0 /vd/vd02 ONLINE 0 0 0 /vd/vd03 ONLINE 0 0 0 /vd/vd04 ONLINE 0 0 0 /vd/vd05 ONLINE 0 0 0 /vd/vd06 ONLINE 0 0 0 /vd/vd07 ONLINE 0 0 0 spares /vd/vd08 AVAIL errors: No known data errors After that, there is no remnant of /vd/vd00 and /vd/vd08 has gone back as an available spare. So with my real zpool, I should be able to remove one of the available spares and replace the offline device with that. When it finishes resilvering, there should be no more remnant of what was gpt/disk39 and gpt/disk41 should go back as an available spare. Or alternatively, physically remove and replace the offline disk and then do "zpool replace zp1 6960108738988598438 ". Seems like either of those will get the whole pool back to "online" status once I also replace the other offline disk with something other than a configured spare. This was all a misunderstanding on my part of how spares work. Thanks! From nobody Mon Jun 20 23:08:02 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7A4B986099C for ; Mon, 20 Jun 2022 23:08:21 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f44.google.com (mail-qv1-f44.google.com [209.85.219.44]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRlgS1cz2z4gcH for ; Mon, 20 Jun 2022 23:08:20 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f44.google.com with SMTP id 89so18052037qvc.0 for ; Mon, 20 Jun 2022 16:08:20 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=3fjh+ZGiMKlzi1aroG3VkvHXMer0XLnk5Nt9TOYDrYY=; b=GFwC1yqIkHTmQ8+ks1nf0iPfKfByLhiVwQyyZQKuuyIMlhNb1rn0T0wD2Z53VJDKak rVHknDD6FfYwFLMXEdmhqFCVL+mTWaVYLLq22yc4Cpbx/Fd+Pnu6m4z3KwH3U87A5Lpx aVKU7VA3l7jdqC+0zlsd83D0GPKJpXWGLz1HRc70HZqdtdhH6gnx03gef1LMb4nKFQeb Td54Idik1skYOlCTl+KcmER48UI76XgQJXJtdPaXehf2caGE4e0t7IED+O7RR4xpvkdn jkeGKOUPuCoRj9Z5Q0g851Q7Fru3/42iNbZqCLrCuljWf5fax/y0RKv1N20pqylcIcCf aJDQ== X-Gm-Message-State: AJIora8Y9mIgH4zPDAJidrFA09fM4E0DQOKgWNF7/7ifWJ+ba8cKfa/H 0ouu6uMGLa0TZ92leWg7CdXXWNzES8nd8hGi7KI= X-Google-Smtp-Source: AGRyM1tn7IXaCnBJhvNYokwLI/aZ78vzFcx3092AuJtd/xwr7wB7PnQb/6hZ7irhDoJqhAJVkxRd18frMt16zPaVbwg= X-Received: by 2002:ad4:53a1:0:b0:46e:7e5f:bc57 with SMTP id j1-20020ad453a1000000b0046e7e5fbc57mr17590152qvv.57.1655766493732; Mon, 20 Jun 2022 16:08:13 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> <768F3745-D7FF-48C8-BA28-ABEB49BAFAA8@jld3.net> In-Reply-To: <768F3745-D7FF-48C8-BA28-ABEB49BAFAA8@jld3.net> From: Alan Somers Date: Mon, 20 Jun 2022 17:08:02 -0600 Message-ID: Subject: Re: "spare-X" device remains after resilvering To: John Doherty Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4LRlgS1cz2z4gcH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.44 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.44:from]; MLMMJ_DEST(0.00)[freebsd-fs]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.44:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Mon, Jun 20, 2022 at 4:54 PM John Doherty wrote: > > On Mon 2022-06-20 03:40 PM MDT -0600, wrote: > > > On Mon, Jun 20, 2022 at 7:42 AM John Doherty > > wrote: > >> > >> Hi, I have a zpool that currently looks like this (some lines elided > >> for > >> brevity; all omitted devices are online and apparently fine): > >> > >> pool: zp1 > >> state: DEGRADED > >> status: One or more devices has been taken offline by the > >> administrator. > >> Sufficient replicas exist for the pool to continue > >> functioning > >> in a > >> degraded state. > >> action: Online the device using 'zpool online' or replace the device > >> with > >> 'zpool replace'. > >> scan: resilvered 1.76T in 1 days 00:38:14 with 0 errors on Sun Jun > >> 19 > >> 22:31:46 2022 > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zp1 DEGRADED 0 0 0 > >> raidz2-0 ONLINE 0 0 0 > >> gpt/disk0 ONLINE 0 0 0 > >> gpt/disk1 ONLINE 0 0 0 > >> ... > >> gpt/disk9 ONLINE 0 0 0 > >> raidz2-1 ONLINE 0 0 0 > >> gpt/disk10 ONLINE 0 0 0 > >> ... > >> gpt/disk19 ONLINE 0 0 0 > >> raidz2-2 ONLINE 0 0 0 > >> gpt/disk20 ONLINE 0 0 0 > >> ... > >> gpt/disk29 ONLINE 0 0 0 > >> raidz2-3 DEGRADED 0 0 0 > >> gpt/disk30 ONLINE 0 0 0 > >> 3343132967577870793 OFFLINE 0 0 0 was > >> /dev/gpt/disk31 > >> ... > >> spare-9 DEGRADED 0 0 0 > >> 6960108738988598438 OFFLINE 0 0 0 was > >> /dev/gpt/disk39 > >> gpt/disk41 ONLINE 0 0 0 > >> spares > >> 16713572025248921080 INUSE was /dev/gpt/disk41 > >> gpt/disk42 AVAIL > >> gpt/disk43 AVAIL > >> gpt/disk44 AVAIL > >> > >> My question is why the "spare-9" device still exists after the > >> resilvering completed. Based on past experience, my expectation was > >> that > >> it would exist for the duration of the resilvering and after that, > >> only > >> the "gpt/disk41" device would appear in the output of "zpool status." > >> > >> I also expected that when the resilvering completed, the "was > >> /dev/gpt/disk41" device would be removed from the list of spares. > >> > >> I took the "was /dev/gpt/disk31" device offline deliberately because > >> it > >> was causing a lot of "CAM status: SCSI Status Error" errors. Next > >> step > >> for this pool is to replace that with one of the available spares but > >> I'd like to get things looking a little cleaner before doing that. > >> > >> I don't have much in the way of ideas here. One thought was to export > >> the pool and then do "zpool import zp1 -d /dev/gpt" and see if that > >> cleaned things up. > >> > >> This system is running 12.2-RELEASE-p4, which I know is a little out > >> of > >> date. I'm going to update it 13.1-RELEASE soon but the more immediate > >> need is to get this zpool in good shape. > >> > >> Any insights or advice much appreciated. Happy to provide any further > >> info that might be helpful. Thanks. > > > > This is expected behavior. I take it that you were expecting for > > 6960108738988598438 to be removed from the configuration, replaced by > > gpt/disk41, and for gpt/disk41 to disappear from the spare list? That > > didn't happen because ZFS considers anything in the spare list to be a > > permanent spare. It will never automatically remove a disk from the > > spare list. Instead, zfs is expecting for you to provide it with a > > permanent replacement for the failed disk. Once resilvering to the > > permanent replacement is complete, then it will automatically detach > > the spare. > > > > OTOH, if you really want gpt/disk41 to be the permanent replacement, I > > think you can accomplish that with some combination of the following > > commands: > > > > zpool detach zp1 6960108738988598438 > > zpool remove zp1 gpt/disk41 > > Ah, OK, I did not understand that spares worked that way. > > I don't think I can detach anything because this is all raidz2 and > detach only works with components of mirrors. > > But experimenting with a zpool created from files, I can see that spares > work as you describe, e.g.: > > # zpool status zpX > pool: zpX > state: ONLINE > config: > > NAME STATE READ WRITE CKSUM > zpX ONLINE 0 0 0 > raidz2-0 ONLINE 0 0 0 > /vd/vd00 ONLINE 0 0 0 > /vd/vd01 ONLINE 0 0 0 > /vd/vd02 ONLINE 0 0 0 > /vd/vd03 ONLINE 0 0 0 > /vd/vd04 ONLINE 0 0 0 > /vd/vd05 ONLINE 0 0 0 > /vd/vd06 ONLINE 0 0 0 > /vd/vd07 ONLINE 0 0 0 > spares > /vd/vd08 AVAIL > > errors: No known data errors > > Then: > > # zpool offline zpX /vd/vd00 > # zpool replace zpX /vd/vd00 /vd/vd08 > # zpool status zpX > pool: zpX > state: DEGRADED > status: One or more devices has been taken offline by the administrator. > Sufficient replicas exist for the pool to continue functioning in a > degraded state. > action: Online the device using 'zpool online' or replace the device > with > 'zpool replace'. > scan: resilvered 456K in 00:00:00 with 0 errors on Mon Jun 20 > 16:18:46 2022 > config: > > NAME STATE READ WRITE CKSUM > zpX DEGRADED 0 0 0 > raidz2-0 DEGRADED 0 0 0 > spare-0 DEGRADED 0 0 0 > /vd/vd00 OFFLINE 0 0 0 > /vd/vd08 ONLINE 0 0 0 > /vd/vd01 ONLINE 0 0 0 > /vd/vd02 ONLINE 0 0 0 > /vd/vd03 ONLINE 0 0 0 > /vd/vd04 ONLINE 0 0 0 > /vd/vd05 ONLINE 0 0 0 > /vd/vd06 ONLINE 0 0 0 > /vd/vd07 ONLINE 0 0 0 > spares > /vd/vd08 INUSE currently in use > > errors: No known data errors > > To get that pool out of the degraded state, I must replace the offline > device with something other than a configured spare, like this: > > # zpool replace zpX /vd/vd00 /vd/vd09 > # zpool status zpX > pool: zpX > state: ONLINE > scan: resilvered 516K in 00:00:00 with 0 errors on Mon Jun 20 > 16:20:36 2022 > config: > > NAME STATE READ WRITE CKSUM > zpX ONLINE 0 0 0 > raidz2-0 ONLINE 0 0 0 > /vd/vd09 ONLINE 0 0 0 > /vd/vd01 ONLINE 0 0 0 > /vd/vd02 ONLINE 0 0 0 > /vd/vd03 ONLINE 0 0 0 > /vd/vd04 ONLINE 0 0 0 > /vd/vd05 ONLINE 0 0 0 > /vd/vd06 ONLINE 0 0 0 > /vd/vd07 ONLINE 0 0 0 > spares > /vd/vd08 AVAIL > > errors: No known data errors > > After that, there is no remnant of /vd/vd00 and /vd/vd08 has gone back > as an available spare. > > So with my real zpool, I should be able to remove one of the available > spares and replace the offline device with that. When it finishes > resilvering, there should be no more remnant of what was gpt/disk39 and > gpt/disk41 should go back as an available spare. > > Or alternatively, physically remove and replace the offline disk and > then do "zpool replace zp1 6960108738988598438 ". > > Seems like either of those will get the whole pool back to "online" > status once I also replace the other offline disk with something other > than a configured spare. > > This was all a misunderstanding on my part of how spares work. Thanks! Ahh, but you can detach in this case, because the "spare-9" vdev is itself a type of mirror. Try that command. I think it will do what you want, with no extra resilvering required. From nobody Mon Jun 20 23:32:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A3231863877 for ; Mon, 20 Jun 2022 23:33:23 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LRmDL5T8fz4jS6; Mon, 20 Jun 2022 23:33:22 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 7FAA94160D; Mon, 20 Jun 2022 17:33:22 -0600 (MDT) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 2-YXOIfPIY4R; Mon, 20 Jun 2022 17:33:22 -0600 (MDT) Received: from [172.21.35.205] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id B0F2340790; Mon, 20 Jun 2022 17:33:21 -0600 (MDT) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net B0F2340790 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net B0F2340790 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1655768001; bh=cG33NQ/asgxeIXyAHRsgAseJqpibYZ8Qu+oJElVuzwA=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=OMyuJVn3zIjKnWbEUnQZhUZy0PAMire6z4JtRB74vOzX0Dh390Co0quoKn2xxTdum x0HA6o73EHQlttFTZ6otMdneTk3llluUJONCyxnHoIJ5VBL7onAglvIZPUCu8ipv0p 2iDq9UkY3GIzMCALVOre1GaESBYuUK95G0y/CtBA= From: "John Doherty" To: "Alan Somers" Cc: freebsd-fs Subject: Re: "spare-X" device remains after resilvering Date: Mon, 20 Jun 2022 17:32:13 -0600 X-Mailer: MailMate (1.13.2r5673) Message-ID: <7B7E61B8-0508-4FFD-B697-FBFB881E2B09@jld3.net> In-Reply-To: References: <34A91D31-1883-40AE-82F3-57B783532ED7@jld3.net> <768F3745-D7FF-48C8-BA28-ABEB49BAFAA8@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Rspamd-Queue-Id: 4LRmDL5T8fz4jS6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=OMyuJVn3; dmarc=pass (policy=quarantine) header.from=jld3.net; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[24.9.144.115:received] X-ThisMailContainsUnwantedMimeParts: N On Mon 2022-06-20 05:08 PM MDT -0600, wrote: >> I don't think I can detach anything because this is all raidz2 and >> detach only works with components of mirrors. ... > Ahh, but you can detach in this case, because the "spare-9" vdev is > itself a type of mirror. Try that command. I think it will do what > you want, with no extra resilvering required. Oh OK, my misunderstanding again. Not resilvering again would be great. For reference or if anyone else is following along, the current state (abbreviated) is this: pool: zp1 state: DEGRADED ... config: NAME STATE READ WRITE CKSUM zp1 DEGRADED 0 0 0 raidz2-0 ONLINE 0 0 0 ... raidz2-1 ONLINE 0 0 0 ... raidz2-2 ONLINE 0 0 0 ... raidz2-3 DEGRADED 0 0 0 ... spare-9 DEGRADED 0 0 0 6960108738988598438 OFFLINE 0 0 0 was /dev/gpt/disk39 gpt/disk41 ONLINE 0 0 0 And you're right, "zpool detach zp1 6960108738988598438" worked fine so I now have this: pool: zp1 state: DEGRADED ... NAME STATE READ WRITE CKSUM zp1 DEGRADED 0 0 0 raidz2-0 ONLINE 0 0 0 ... raidz2-1 ONLINE 0 0 0 ... raidz2-2 ONLINE 0 0 0 ... raidz2-3 DEGRADED 0 0 0 gpt/disk30 ONLINE 0 0 0 3343132967577870793 OFFLINE 0 0 0 was /dev/gpt/disk31 gpt/disk32 ONLINE 0 0 0 gpt/disk33 ONLINE 0 0 0 gpt/disk34 ONLINE 0 0 0 gpt/disk35 ONLINE 0 0 0 gpt/disk36 ONLINE 0 0 0 gpt/disk37 ONLINE 0 0 0 gpt/disk38 ONLINE 0 0 0 gpt/disk41 ONLINE 0 0 0 spares gpt/disk42 AVAIL gpt/disk43 AVAIL gpt/disk44 AVAIL I thought I had tried that but obviously not. Now there is no more remnant of what was gpt/disk39 and gpt/disk41 is just a normal, permanent member of the raidz2-3 vdev and no longer in the configured spares list. Perfect. The pool is still degraded because there is still another offline device that needs to be replaced. To fix that, I can do this: # zpool replace zp1 3343132967577870793 gpt/disk42 Wait for the resilver to finish, and then do: # zpool detach zp1 3343132967577870793 And everything should be fine with all the vdevs and the pool itself in "online" status again (and gpt/disk42 no longer an available spare). This is great. You've been a big help, can't thank you enough. From nobody Tue Jun 21 14:33:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 359878610FE for ; Tue, 21 Jun 2022 14:33:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LS8Bs5QLxz4X90 for ; Tue, 21 Jun 2022 14:33:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9A1FD13B46 for ; Tue, 21 Jun 2022 14:33:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25LEXPaC096422 for ; Tue, 21 Jun 2022 14:33:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25LEXPbK096421 for fs@FreeBSD.org; Tue, 21 Jun 2022 14:33:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229829] [zfs] scrubbing prevents shutdown and slows down startup Date: Tue, 21 Jun 2022 14:33:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bdrewery@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655822005; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=I9uH06ezCu3ijnQnXl2cOmS1UoXbzsqIV0Y7IoAGiGk=; b=vdYI8VdRk4uecmypnirSOMDbJSNWtS0UldCPVi0rnT+BhnJEUKS3sLmCy39F2m3K2tEA85 yYPeo/goCGV1BZ+Am6+24NQ+eJPFEQJSSOYW6dJ03YbyRdaVgmTPw3UvjUpyoxK5xH/QUa od1ZOsn3MtGBo3dnEWk33SATx5a3zwceyK8BlYiuWyNrMg3Q3PbdyooxYzTlf6kS/02kRj ttH46MiUn0S/yxKrdkzKwt9yiGoLi8DFMAMdJlK/IF9ZX2hvzvBowebDVN3H0wwTeH5lt0 5BXWGXUOJQdkD7V1FbmImPONFLIcnBJ9wwqnru56k0/oxwjXdcXyG5dL09j5SA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655822005; a=rsa-sha256; cv=none; b=IVkceZ6QN3/entC1JLcxc1rNkV1n4TyIlqWdgT4tnCgdIDCqv5K3Y1ui6rQfgt9KpIi12l 2Wb4U5he+OE33Gcqr7SvBFfqUgm1wIYqgDkvcI+P3T+ktDN8jtQlxXI+x1UeHsc0nwbUbK iFtXGFNTBv+E7XY+MsiUcTpg9ul5Z2my9Ak07Ezd4mID9Ybhw8ZKK2J+bCGbdXJiDUkC5z q9afD7I6HW/q21q4PXmEK6ytoIS6wZDuGhaTwEtrZbKPgcRNx2TMfTC9UcQLrrubn5E3R0 kvQz2BRTJJ8HHDPe2O1oLrTOe6MVypyTnIXM0X7xdqKXDmQBqBAybkDDVQpcIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229829 --- Comment #4 from Bryan Drewery --- This seems simpler. I might find time to commit this. diff --git usr.sbin/periodic/etc/daily/800.scrub-zfs usr.sbin/periodic/etc/daily/800.scrub-zfs index 8cca1ea4d949..474e070153e8 100755 --- usr.sbin/periodic/etc/daily/800.scrub-zfs +++ usr.sbin/periodic/etc/daily/800.scrub-zfs @@ -15,6 +15,13 @@ then source_periodic_confs fi +doscrub() { + local pool=3D"$1" + + zfs set org.freebsd:last-scrub=3D$(date +%F.%T) "${pool}" + zpool scrub "${pool}" +} + : ${daily_scrub_zfs_default_threshold=3D35} case "$daily_scrub_zfs_enable" in @@ -55,9 +62,7 @@ case "$daily_scrub_zfs_enable" in _pool_threshold=3D${daily_scrub_zfs_default_thresho= ld} fi - _last_scrub=3D$(zpool history ${pool} | \ - egrep "^[0-9\.\:\-]{19} zpool scrub ${pool}\$" | tail -= 1 |\ - cut -d ' ' -f 1) + _last_scrub=3D$(zfs get -s local -H -o value org.freebsd:last-scrub ${pool}) if [ -z "${_last_scrub}" ]; then # creation time of the pool if no scrub was done _last_scrub=3D$(zpool history ${pool} | \ @@ -88,12 +93,12 @@ case "$daily_scrub_zfs_enable" in ;; *"none requested"*) echo " starting first scrub (since reboot= ) of pool '${pool}':" - zpool scrub ${pool} + doscrub ${pool} [ $rc -eq 0 ] && rc=3D1 ;; *) echo " starting scrub of pool '${pool}':" - zpool scrub ${pool} + doscrub ${pool} [ $rc -eq 0 ] && rc=3D1 ;; esac --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jun 21 17:55:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5C90F8619F6 for ; Tue, 21 Jun 2022 17:55:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LSDgw0WHWz3qwt for ; Tue, 21 Jun 2022 17:55:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E22D116888 for ; Tue, 21 Jun 2022 17:55:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25LHtNC3008718 for ; Tue, 21 Jun 2022 17:55:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25LHtNaN008717 for fs@FreeBSD.org; Tue, 21 Jun 2022 17:55:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229829] [zfs] scrubbing prevents shutdown and slows down startup Date: Tue, 21 Jun 2022 17:55:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655834124; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WPfYeBt4Q8CXo/ggXUtLeXf2JPlCG0XI7qjaoEmqkho=; b=kIkV2/PlL7AjcCsfk08v3jjV30UeQxoDIlK+8sIPpz5mJJC3mtQ6hEKkO0+63gjFvBUFGx Q6LcRhMf4cgaDTldZKCjVeOF5vilizwDp1d2IzW4f7ZaquxyK/TwH7jWahG49CHEWwRQmg Ni5SKvdbitPKakZ/MmqxDVQr2XhnTyZdG8SAuB+D3zZ+tpkKhyhLDysVorfigMj9CAcu15 XfJVoFTj5udeGmRHw4a2UXzP5rgxZAbalIuZ1/6R3vO8L9nuXKiiFNrsenAabEyT/uSX6x k2kuDEChCPoGHFiggC2pwuR1++N+pryNKfc62fRdDuiHkOzvi3gqDEr+M39Tlw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655834124; a=rsa-sha256; cv=none; b=cTJSDxIT3rOVGPt+oMTcHbrg6siBwL13a5bvcjPPruE5QwIbWwEDUpau3r3jg30bX5i724 iB4z5Hl+taooHRNpI4SMbRaxNzEkF2HXWQJizuM+5HuHqo+eA3W9eur7p870RAwbpbO0/c w6u1JmTFlfbVe6hrPv1k5tHRGfC8wEQ8eD+83FVnPuvV4//WenP8c6LC/zsbjl/jM+kp1J 6pO1SF0bizizYwvGJYcUx69tgNSjcf9nxrpZokFe2M5i7MTSo4qinLPc74UWVpW7zpEMFI 0WRK9YtTxuy87E0a6XYJ8ef8V15rXLaAL1ao4OakNneFO5rY1Q4WQs6dnn9GAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229829 --- Comment #5 from Martin Birgmeier --- Just my 2 cents: For the issue described in this PR it would be necessary to suspend an ongoing scrub before shutdown and resume it after restart - assu= ming the system does both (especially the shutdown) cleanly. Most likely something like a "reverse" rc.d would be neeeded, where the shutdown procedure checks which zpools are currently being scrubbed, saves = this info, and then suspends the scrubs; conversely, the startup would need to c= heck which scrubs were suspended and resume them. To not need a separate file for saving the info about which zpools were in = the process of being scrubbed across the shutdown/reboot it would be nice to be able to do some query directly on the pool to obtain this information. -- Martin --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jun 22 07:41:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 979A4878F1B for ; Wed, 22 Jun 2022 07:41:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LSb153BZMz4R5Q for ; Wed, 22 Jun 2022 07:41:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4F0442220B for ; Wed, 22 Jun 2022 07:41:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25M7fTsn080697 for ; Wed, 22 Jun 2022 07:41:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25M7fTul080696 for fs@FreeBSD.org; Wed, 22 Jun 2022 07:41:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229829] [zfs] scrubbing prevents shutdown and slows down startup Date: Wed, 22 Jun 2022 07:41:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ronald-lists@klop.ws X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655883689; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2tycH5eFcWAXg0XikONKmiKpyv35kt96tp1+bWHTXtU=; b=oqtpPDgYF68lp7ft7rqL5Yc5umggy1U0CjnLTewyY/35ekvrzZM/lQ3UJiUOFQYF9O9e9b 37Y+2gRNNPN1c3nrfIphktD2I0UnTT7rhfUrfk4Qkcp15YLVWedn4/MMIZgKsJlFGhk0/P w6DeZJmO+RJkKUkOp1Va4KokM1Qa0Vy4cQ9oRcJvaUrcByAPB4K8lPoXBZlhYvRnBuYuOK nlZ0P4zF/2PCMdEDxH1+lc/JqiXbXnTdxuInCMRRtwTzDeTv3A0WP9UYLjiQ7UicM/OlSs 6xfh3ugc7naUKAFODLPLUOqj9TgAtEtsTjMCWi5q50YvOEe3usWrT0U0FFCMAw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655883689; a=rsa-sha256; cv=none; b=B9QttUvuUGiPc2eP1jz+6boVh4BlUp9mIWY/vd8zjHn2MaTumc9C3ySoOOflGK7l5qtsAu tTCW0PWUHja8F+0L9egUERfk4EgRbu4tnfh+x6GEt3Re5Krtf/msJS5pg7AmtQ3ga7bmnW is6Mxmgc5gXb649A36qmWDhUWhtfOQ8z2QTbUlbQEJItlAOmXp5faFD57gUbdBrNkL7K+2 cFNorMJk2mVKMYsauavEuCsc1Qc0vY5eQXa65vkLrtkFeNP52VWjmrXNtL6PHpAsSm7o3Z 76Vus9RGliKhZ3SBlKlz9RWgkO06klNeAGYvDOjkdNibtf9yRlSHLwem/nSp7A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229829 Ronald Klop changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ronald-lists@klop.ws --- Comment #6 from Ronald Klop --- (In reply to Martin Birgmeier from comment #5) It should already work that way. see "man zpool-scrub" OPTIONS -s Stop scrubbing. -p Pause scrubbing. Scrub pause state and progress are periodically synced to disk. If the system is restarted or pool is exported during a paused scrub, even after import, scrub will remain paused until it is resumed. Once resumed the scrub will pick up from the place where it was last checkpointed to disk. To resume a paused scrub issue zpool scrub again. -w Wait until scrub has completed before returning. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jun 22 12:36:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C67E685D165 for ; Wed, 22 Jun 2022 12:36:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LSjYr4Yzyz3MC5 for ; Wed, 22 Jun 2022 12:36:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7D82C2653D for ; Wed, 22 Jun 2022 12:36:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25MCamcA051343 for ; Wed, 22 Jun 2022 12:36:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25MCamT5051341 for fs@FreeBSD.org; Wed, 22 Jun 2022 12:36:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Wed, 22 Jun 2022 12:36:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1655901408; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QTGU3kvB73k6+zOiT5SpcCFqQ4VKSktGhvyYL54FLwk=; b=C9btJwKnf5x+zZv4ytGFSOefL8e7FdxIBsRrZiFHb6k+4SKjeRA++TGqIuCAr+P3RMv4DJ yvCGhukN+IM1M0AYxj2V7vIE20Kazwoecxd9UVluG9lRXXikRjmMbA+nwXzLJZDz2gZZ7C wbxVxT59QHPVdzOM1Io6thnCjdzb7vKO21VgLuJZ0QcIcedrE2VGfRPYqbi7+DYz1Hmneo H4byxW8B9RA1RmmpXDbMMESnQQGnT11NWU88L1Cbn6Wj5qqcPH/RB4zOhQhhdjWZxbs2Jq EXdteunsm8ZZImGgDtht9zfM9V9rjmV7PfpPHQL/njsjGqzYEcRPhl3w7F1g5w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1655901408; a=rsa-sha256; cv=none; b=INAzucENnQjUvRiLRjin96B60oziM+ZdrCftTuMJzYxlNkdDnbSYYngTY1KbfHwQCcjoKY U89MvHCvIOaPToYmD4gyXKHMSQFEPvXOwz/KH1JMZaDW7ROWXR/WHDMRkUz/vrjkuUBrsK YTyYlMnmALZxCrACeSb26lV8Cswr1fBHD+9W3hgWfdTlApyK/oNe7FiUixIf0oG3taJp10 UWXyvk8ZgCcLklk/K4FzE2IvhwbF99uLTX00M+IHy0RtyL4Ll1pwfc69G6gpn4ze3n7hAa 18CCUTq08BiSMrcJKwo4v/bpF+k/Ypn4SjTLW+Bl7BoVmYNht9w75+hmTB0QRQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 --- Comment #13 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D8db679af66b023802139d41e275e41a77= da1c515 commit 8db679af66b023802139d41e275e41a77da1c515 Author: Konstantin Belousov AuthorDate: 2022-06-18 10:59:31 +0000 Commit: Konstantin Belousov CommitDate: 2022-06-22 12:35:47 +0000 UFS: make mkdir() and link() reliable when using SU and reaching nlink limit i_nlink overflow might be transient, i_effnlink indicates the final value of the link count after all dependencies would be resolved. So if i_nlink reached the maximum but i_efflink did not, we should be able to make the link by syncing. We must sync the whole filesystem to resolve dependencies, which requires unlocking vnodes locked for VOPs. Use existing ERELOOKUP/VOP_UNLOCK_PAIR() mechanism to restart the VOP if sync with unlock was done. PR: 165392 Reported by: Vsevolod Volkov Reviewed by: mckusick Tested by: pho Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D35514 sys/ufs/ufs/ufs_vnops.c | 42 +++++++++++++++++++++++++++++++++++------- 1 file changed, 35 insertions(+), 7 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jun 24 14:49:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A422A8795E8 for ; Fri, 24 Jun 2022 14:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LV0Pb3LNpz4qyq for ; Fri, 24 Jun 2022 14:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 549F111A6B for ; Fri, 24 Jun 2022 14:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25OEn76Z011084 for ; Fri, 24 Jun 2022 14:49:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25OEn7Zd011083 for fs@FreeBSD.org; Fri, 24 Jun 2022 14:49:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Fri, 24 Jun 2022 14:49:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1656082147; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uBC7uuwoa/RduXe4YzzJuMN4w7cMnCWeEG49K8IHjvk=; b=BFQB4G1Z4JV6qQNNo/ctUQwy2fTJIWRoXdhhus7OeiMWKfRwHaV7kpFJ5t4xUGQw96axLx clGddcUkeeMKcx72ysGolSqwGoNjBemIw0wbmFvDgfBPQB8So1oxKOMB11Hvnw/VUb4V7J +AGh3khQ1nLoB/fvr9mMmYzqP3ar/ehDUZZKIFzzLILUvcZgxABbc0kv5QEQ+GvEdykbDX 0Le5X8hVutkwFvfg4SekhCGuwOVQJUTaUXOxsswtfj9aLbw7N+sDCmDtcNElJIjRMLUBzD LX/WZlb02LqAGc/qm2BLKK7eJ2ooRHo/sBkIxurFYxKa3gG21ck+A1tLS+SJ3Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1656082147; a=rsa-sha256; cv=none; b=c9iO6xBg6F2AViqxLSNbRZaqXr9Gs65R894nXSvUTZJ/LUeX4iF9B6zyQtaciD8zrzOMZb wxOKVq731sle3b4JaGyO9o/0ZHtaGXKYgkF0RYVyyY4kr/Uwg93a3PPKFRINjKem9Cq7zf M3FmpaK2gqpA6hIxPTHDHVvhn6C3yUmlIwQgjxDdzhaKEuBi0BLxAtYziTALK3NsfXhO9p pfz7DdXXFXomMUQoZiOYGGvr/Gjb6lUBdaHinwNSPc4HwsRCSXlxQvA2SCe/wufOegKtu2 D74wJbzmmUuQvJihsPCUA9WFd5h6WX3mrkj7iwea5IrZsufSd9WbAe0GJUX4yg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 --- Comment #14 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dbc6d0d72f4f4e96b24d0ad558b271cb6f= 483801e commit bc6d0d72f4f4e96b24d0ad558b271cb6f483801e Author: Konstantin Belousov AuthorDate: 2022-06-22 13:54:01 +0000 Commit: Konstantin Belousov CommitDate: 2022-06-24 14:46:26 +0000 UFS rename: make it reliable when using SU and reaching nlink limit PR: 165392 Reviewed by: mckusick Tested by: pho Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D35577 sys/ufs/ufs/ufs_vnops.c | 95 +++++++++++++++++++++++++++++++++++++++++++--= ---- 1 file changed, 84 insertions(+), 11 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jun 25 06:22:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 564BA8687B2 for ; Sat, 25 Jun 2022 06:22:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LVP6k1mzTz4jXT for ; Sat, 25 Jun 2022 06:22:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 468B31F69D for ; Sat, 25 Jun 2022 06:22:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25P6Mb4a063689 for ; Sat, 25 Jun 2022 06:22:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25P6MbxG063688 for fs@FreeBSD.org; Sat, 25 Jun 2022 06:22:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Sat, 25 Jun 2022 06:22:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1656138158; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yfuDQrMoYrscwT7QQarUWLxBvxJbZ+6T2AuypagF9no=; b=az6YGR39CQz6NjGC7g2neR7GBH/ZCKILuGWdnwPRMsRoHX3Xbir4NvKcVKjrFWyfSGEsTB 8oVDAAcZVw7qB0kQxhg7ziZbirN62rAq9jcHTkVlqJxEkxZxlQYjQkZDzIUPW3jbzG0N2T fZBMhAWIiTdBu70+U/+plmdCC/yr1DJsgqPOchimYA9zYvRCjqwlUCVLwzpH5xeAzGweK5 wpwFnOEeTwafnh2pfmzTzuD5X85PjU7S00G6GOxGTORS4no0NoHMvdJfrjk9snv6jJgAYi qwo87T5cpp1ViJ/W0BJV9gpOQFp90rT06EP7ReuO9d+cNc8JDNeyavhuBQ0yjg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1656138158; a=rsa-sha256; cv=none; b=mOn9SFaoMhKj6rx9zMf2DX7fzI2y6SxF9evL9svvH8ZGJFSD5Ub38Nq1GkJV/QsGpkwlXP wFQf2ihyFzwbG+EJqsrbfd9PcM6VNAFMFHc39Ca4ie/kNVZzVVMEcLVDC6mVdPdG9uxENU dxeYQ9mulBCz446oq3D4TEhlWLdSS38bHdpGKpCv19OsqQQax+Gl1VDfq/U8MsQAHD7SBo jW4MJzgaY1DfBAeF/cE9aWitZsn0UXT/l5SlDtlEKT6cocmalJlr8xL1FJwZry9vxoQvpb 1ABHsxPjuGOynHoMRytCKjEr1PeVCnPsJHsgxHy4TR7nn0clbkeBM3tGMik6Tg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 --- Comment #15 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D25a1b1f30c85670b6d970df426b97c07d= 4e0e61d commit 25a1b1f30c85670b6d970df426b97c07d4e0e61d Author: Peter Holm AuthorDate: 2022-06-25 06:21:30 +0000 Commit: Peter Holm CommitDate: 2022-06-25 06:21:30 +0000 stress2: Added reagression tests PR: 165392 tools/test/stress2/misc/nlink.sh (new +x) | 96 +++++++++++++++++++++++ tools/test/stress2/misc/nlink2.sh (new +x) | 71 +++++++++++++++++ tools/test/stress2/misc/nlink3.sh (new +x) | 106 +++++++++++++++++++++++++ tools/test/stress2/misc/nlink4.sh (new +x) | 105 +++++++++++++++++++++++++ tools/test/stress2/misc/nlink5.sh (new +x) | 120 +++++++++++++++++++++++++= ++++ 5 files changed, 498 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jun 26 21:00:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CE409878895 for ; Sun, 26 Jun 2022 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LWNXg3K7xz3KmN for ; Sun, 26 Jun 2022 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5259B1AE70 for ; Sun, 26 Jun 2022 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25QL033B026168 for ; Sun, 26 Jun 2022 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25QL03ZJ026167 for fs@FreeBSD.org; Sun, 26 Jun 2022 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202206262100.25QL03ZJ026167@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 26 Jun 2022 21:00:03 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16562772031.AC0eE.25461" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1656277203; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=5LHxyG15aRYlI5Dh/DsfOVp1TW5ZKlzbD9JH4KOT7gk=; b=Kooua1f3XYT3Vz65hPzProTHf+VC70W9Tyr3UgLO9jmccUhnm9THcT0905snMRONYStP8H zFDwk81FjzFGSyg8a6KlwvhXkWj8ZsS6Xz1SAX+mpVWx1A/hmd8h4ddZp0Uum6jLK7GhUM MpmKFj2WYaCNxyXr55Kz93Ba88+gcGLnYc+HvJ0zmHWRCjhTKLr4/+FhXi/Rq3bj0QRUX/ IU6/tOqBcug7PEZgAE8vmIMLYhXehuUFjMizhlfQ044RH5AqDZ6b9VFFRbSPutP9+G0o3V o/EjPv6VOpaQq2JsvhzKQrjgW/pWMaMwxOrE9+ujc+3DyoowF+7UYHSHQ+odDA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1656277203; a=rsa-sha256; cv=none; b=VA0aN79ET8oG4WoenjDr/SlVfKyiXlZpU1xG5ITa5mNistAScBz+oQur6nuHk0tItVOgsi 5ufe9w5glhnVYydm3cYsderCXOlycbMYQz5RL5vq2kyaoFOqSQADZhKAJAsXtvi6PGKgPC 5yp7cMIqDIoDclywify6RcySbLGiIcm0zwui0JsMRmeXcum5U+IVdmrWxPeraLq7pTaHGx qJidvAOjtBiPgGIE3DvAoH8/R1DbsQvTXCzTFDKNPgOC+2oBVASCEhXWLdIDyjWciRK1BJ 523y8f/pwyw1GnmOUsK9Hnopvr9a5pW3LX/g1nvBU4K6P16c1ns3Wm58M4ONPQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16562772031.AC0eE.25461 Date: Sun, 26 Jun 2022 21:00:03 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16562772031.AC0eE.25461 Date: Sun, 26 Jun 2022 21:00:03 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16562772031.AC0eE.25461-- From nobody Wed Jun 29 09:40:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C36D6874287 for ; Wed, 29 Jun 2022 09:40:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LXxJs49BQz3Q7k for ; Wed, 29 Jun 2022 09:40:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6EF1F6FEF for ; Wed, 29 Jun 2022 09:40:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 25T9eDjg072974 for ; Wed, 29 Jun 2022 09:40:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 25T9eD2W072973 for fs@FreeBSD.org; Wed, 29 Jun 2022 09:40:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Wed, 29 Jun 2022 09:40:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1656495613; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GNjPAKq9gmjgWm5hbKPDVu8jJHiC1POjZF1xWxCPnNc=; b=WLBPrRLiUQ9AvDsUOuC6u8TqBt/D407+uoAjVn09XIthI2qW56k5r3xtG4ZI45N8P/LEPO uz1SHr9ML7FeYXnzF2vAD4aQeTzW+LBwwIbrt5tjt8bZC/ioHA0H3IUUY1m+2YTS1gZXAy Nkb8PpA8E7K9STNo5zq6+46OF9loc/Ps5TMZH0fenmJXnMxYWRlaqn8Yhg0qjxTvmH0Qgc FCYzgK1e4v0fbTwh1OYMtE8PegH2/voBCSHvQEhn1tjiCItl05MroC3E+SsWPQ9wjBlj5t t2aTIF1P5fpZbVEBPUehw2sRRcXeZzYlqUuvBVk+ZNtSHLoG6Pc6UOFlwZ9Qng== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1656495613; a=rsa-sha256; cv=none; b=GVsdRgTPGG90Wlw64dgYcSUg+0Cm6bBsnBeaeKqBosYpMnFSF/1+ubq7bnsMmRrNuYHkAh WIFmnHVSWBpbB9AzhWV1b+yHfkkb5FxADKqi+/snaIBozuNeTZn/TivH5n8tEbf7LA6+56 eF05kLy32WMj2aRstAhSUqcplRaUSn34cyOxKiLwtQwwbbgSS84nVKHyK3NY3YKLkLs1kX 8dwWxNkC45O9t5fv/TR5encb8+gC8Y/bs6CXf3mXjAileAzhprw//JKW51m6iD6f5WELX/ nsAAyliAVGjTeDzC06S9VVH8wshtoWNez0QmeU0f8lWzTbKTFAoyoE2O9H6wVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 --- Comment #16 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D65d8e97c4c23a0b27d9e0bc73e4150ebb= b00b844 commit 65d8e97c4c23a0b27d9e0bc73e4150ebbb00b844 Author: Konstantin Belousov AuthorDate: 2022-06-18 10:59:31 +0000 Commit: Konstantin Belousov CommitDate: 2022-06-29 09:38:26 +0000 UFS: make mkdir() and link() reliable when using SU and reaching nlink limit PR: 165392 (cherry picked from commit 8db679af66b023802139d41e275e41a77da1c515) sys/ufs/ufs/ufs_vnops.c | 42 +++++++++++++++++++++++++++++++++++------- 1 file changed, 35 insertions(+), 7 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 1 21:57:21 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 928A88767CE for ; Fri, 1 Jul 2022 21:57:30 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2087.outbound.protection.outlook.com [40.107.115.87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LZTZd3l0sz4VrG; Fri, 1 Jul 2022 21:57:29 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cHJRVyb9fHhth/AHzKEmluCFv2wd3Din+EQZ5lyy9KYaV50OWLcF8Qi8HecuPFNI4C/OqQhsqZvPsdzDyvO0k9y+AwCFrmH7m8Ut81eoHJ7U6IMXgKwWhvS75FTXMPkfyZSRVeaqXlcozR+2ehDg81Hp56oQ6Nxu/6ciSWl7Bc/ltAj7Lhdxv0qqc2swDWsFie6v/RQ3BSbavRjx26WLES8231O3uzxlBaLyRJL3JBa3D7cReTFRbA0OxuDSSLXe0Mz3766wtWbu1lazTkDYcTftvtBKeLMLptoUANoW1vUqbELKueIXdCgIBambHx+OKSNgBm3lPNiSVeQTkk3UAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=DMEn9XHBzsRP0hGD+xR9v2uXZdnpMDJr3GABtMgpF7Q=; b=GBbne4U5k3P4qTi93Sq1DDuOXw9qBQ0ECMVugrVYwcBshyQ8hey5RtIRvz5YzeDeHIEQWrqZZd2LSg/tFxMeH8AI0Erm2Si88aLvXPUFAevxTLpe3k5A6c35k8fbw2x3weag0RQrdGBzN7XQHq752pTtV9kPLhHntHKylxysIiNIccRIRwjOnuA1Mu8ilc3Zg1Y/+WqtDckKO6Lp6nK2UMbhUUn94QQh3/j1ogm5cpWhR46UHz6i2o5daHkj0/xV2T288RLk5figpz0pjQ7f/uk3zKMEBgYCl5j19UL/wwIrfPWPnqv3fdP3fcF4GPO/vcmc5UiSBxJMWBYCS2xt9g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=DMEn9XHBzsRP0hGD+xR9v2uXZdnpMDJr3GABtMgpF7Q=; b=faWLnyorVNrftQ+LnWUCnCeg8bdWLsdmX03dsgAyxN2BVTmk1wI4v4RWULNQwPt+c0JWKEuCRki0c3nPDvU6s+eLqJ0+R6GOPlqHGNDfsYNna6z88d/ant5qGhiErKoOrIbCGhI8dzRqXGVNVgxBlXFbCmhqVDfWAtHiHHwDFFpoPsfbh/4eE2wyGnS/k2fE5iAO8u9bsOTCavsoKUtIKi0Wc817FfHEroT5dB6m+oC12a9IBRdVfLXn364L9BZnF7+Xdx65xvl08EW35/C4tm4PVV0MmXi4hEkTYc4SVuXjGM9UhYFhqB2sRTZqN1lJ1vByD7JEkYtFy9JQYk5PCg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT3PR01MB8577.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:9e::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5395.14; Fri, 1 Jul 2022 21:57:22 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::c494:e35e:76d4:7d75]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::c494:e35e:76d4:7d75%8]) with mapi id 15.20.5395.017; Fri, 1 Jul 2022 21:57:21 +0000 From: Rick Macklem To: FreeBSD Filesystems CC: Ed Maste , Gleb Smirnoff Subject: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Topic: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Index: AQHYjZRBjJW/UbMaU0uxP2BOexC+DQ== Date: Fri, 1 Jul 2022 21:57:21 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 05ffbd9a-cacc-41d4-aedd-304d63085ad7 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 74660fca-ac0a-41c5-5bdc-08da5bacacc9 x-ms-traffictypediagnostic: YT3PR01MB8577:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 2Iccw4Dmbnm285UAzRGyS0H5FO+mn41e1D+zOsvjRrmEgiNx/SE4sL4OW/3rQHVlBLB4Wk/uFp8b3zl08L3wFWF+5kP69VM9bVPuyh1tcV+R5pW4Xq/qWOP1qaKsEUYr93sw0HGghkvJqLYXst9bJxfJwzah2EE2bx7GEeWZ29yUp8S2qjASa9B3p0zODibAKv4yaRS9rcSsDR2veKu/Ma1X4uZeif/zeVPY2yHFj2PU+YEnBAu5YT+afkDOMaxOXgU7Z7wBvbGVB15bQUXO297pfiOLl9cw7xJPYNDEJIFEHMo5W648S+Lcfe89PVJpUBKgIh/SMR6tF7QZbUZHujpZuuGl7o6zRPAcrsNP7aHIXGCQz+hb42vKy4PqwP3HyuUzHbK3f2cHsjlDb7tRQl9IDs1RlC101fa9GKJpPxWdP4nSfW9Z6etJ51HsAd8QSqJi1b4qUtmAB5yeoVamWVVdnh87fqsC9MAOGmgt7zpMYuDKj5yErkPfUosaCJZNgGmybdYJetscb0yshogXm0L4dBoRBDhZySIU1j4d6nQoUwN8XPJlNdHXgfeslZmNZnCmAqR4udZqtfjkhB1y7GNwjhyTqir2ru724AVeLaaXTNghX5Z7H9qB3zQc86+BIkwnQrPCA/g0A3tWlUoOlwv/McyWWmdMGTJKHoA1UfGmIevQjd8sxdTYZuKuNon/I+6BibSEYFXTt1ZzFYg6pZjI81MXZ4uGN/EVYkupg515J613Qg/rgd0Tnq8Vlp5iRNNd8CzJlkZb+7uN8Hx+yJGhLjdjC3bgZ6UJupf4LUJ4x7k0F2T+5rdZ7mtM/Ikc x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(136003)(39860400002)(396003)(346002)(376002)(366004)(86362001)(478600001)(8936002)(4744005)(83380400001)(122000001)(52536014)(91956017)(64756008)(71200400001)(66556008)(66946007)(5660300002)(4326008)(66476007)(76116006)(33656002)(66446008)(8676002)(54906003)(316002)(786003)(6916009)(450100002)(6506007)(7696005)(9686003)(41300700001)(2906002)(38070700005)(41320700001)(186003)(55016003)(38100700002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?tcY1CiToTsvXod+Zao7JRCFie7PV0KO9jsi/7CGeeDc+cFYIdYYMV9B2Me?= =?iso-8859-1?Q?cKpCg3ZVG3vlIvWHQKTubEn4hLlQHTm9Wl3Qda2t1q6pZI4zWfewvhpW7x?= =?iso-8859-1?Q?9A8ccGXvbhtYxKzFv8aQjx+Z6PT9xfVQKfJDVpZO56cG6yM2VEE5TNXhtw?= =?iso-8859-1?Q?XSqCuGqes0jW4uTKHKpJ8UcA8wJ3TC6gaHp/g0KqaNps7xxfmsWneebWNJ?= =?iso-8859-1?Q?gbkm9C233Rz9ctq6qlvdOzFWsvPb5kHK9cuGnuqNlg6awFSB3vd5z4Xx7n?= =?iso-8859-1?Q?yJShfXzq9b49895WeEo9+TlHpSjxQTLC7Kmmip1IaL3QkdK8qd5TZ8b6fl?= =?iso-8859-1?Q?DXfRUIQ973znyrp+Wd0r2jRz1vaIty54ruG0QYqV65BBAg0YlBIAt85ioS?= =?iso-8859-1?Q?wjeggiO9GEZioe5A9VyJz1idN3xcYJi9m378/rRvaBuCA6EhPm68uPcbSc?= =?iso-8859-1?Q?bV5UFSzZomAbs/+FLuFQOz3vOYLvfr2SqJFEvnCpiXQJ6XcSjBhGrzvhnb?= =?iso-8859-1?Q?C6rVhz2pz+RwFvbVUUbE9ontZKPQn8l1fDJjyeq1+4hcxNxY1XU7mh9EE7?= =?iso-8859-1?Q?bPDrlVOvEApf+ji8AuvGxUHhzRoiI9cxRVV8oYTvwOX0khi8o8cCRPLKp3?= =?iso-8859-1?Q?Rw5C9zsr8Vf2/s+eDrhub/0IdK4cbRncxAMhuK6cGvxQoBqFDzI7BunBs5?= =?iso-8859-1?Q?KbRdwj0WCEAjQ++dhKjp9Z/yNWk0/RcnO0PyowJr43ipytLGvaIW7So/qv?= =?iso-8859-1?Q?ny0pyndHx88FmQPD53+8M0VnN4RWqkFh5rbHA/ThBvy20dw+C4d5rg/R+3?= =?iso-8859-1?Q?c8QB9OP0Wm9van/MAvU+6UnS6gELCEZxK+f1xb9SkXt0m2As9YMaflqO+p?= =?iso-8859-1?Q?zZjW7ltCXJSE7RNEB2SPvrdm/iufqRD8/5QkkZSsbCkFWzzl8NhcppuRXU?= =?iso-8859-1?Q?QWnY0PdjHhiyHM3ICnjyqp/cZE7cZ5io2pODoCq4Ci9nv/NQRjeSJwM/0h?= =?iso-8859-1?Q?rTX1BcPE2RNz8bwgH8FW268BRqHchLii1uEmgpbNwdtVHf6Mz1Hi8g9LUx?= =?iso-8859-1?Q?3w8270qme+57yXwteJ2p75IhszzWEas9w3luQgQYoikQk7Rr0WQw//U+oT?= =?iso-8859-1?Q?YT9jvcCUcPAM8gS5xnOgE2Dg+G+XRe99LRUBxgafRxkZ4ittZpu7NFmd3i?= =?iso-8859-1?Q?5WoHjU5qj+icxLOIBX4cAZYIWozCjIOblEiCbvhavhzDquPQtasQnD1qdp?= =?iso-8859-1?Q?8alAmIW7aEfDnyGqQm1UDNgKvdPE0AI8IdaaUIR/GM2mWD+j6gfbdBEJf1?= =?iso-8859-1?Q?Ld/in0iDQ4Z4gMNsal/rr7BCX1qV2pxO89wmyPvYylwK8TErMd5WrYBUTl?= =?iso-8859-1?Q?xYGy1aXG6XPqBlenOJ4IdQDznk1RBUIFmouuyTimN4HUfx4Xy3W+zklZL6?= =?iso-8859-1?Q?MmUqpNG4erTFyBEkLsGgCKP2ElkJiLhEdSRzMlSNa+AL+T9kGDjfFIibm4?= =?iso-8859-1?Q?ouizc+hiK/6AUxcgcHyT7PWD0700qBCbtYk9EPQOI+6aeOvHHFxgST5mny?= =?iso-8859-1?Q?8bfyBdT3qqE68EHtl0VOPup0bYwtl6gnKJ1yZ8EIE4OR8NvlbAJQHziFm/?= =?iso-8859-1?Q?4qiOK8Xn08Nd4g5VLDdZri8EUklJpYgGq3My3msMuse0Ei1T0m/m4TAjxj?= =?iso-8859-1?Q?VTY8CHpm42PwjHphll7Ern0wXq2RlE/QhSymDJmr?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 74660fca-ac0a-41c5-5bdc-08da5bacacc9 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Jul 2022 21:57:21.7557 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: RNKsLFu35O1SBzDaAOFBsLTEassZmKt2c4RlJhc9Msf35xkj66nqCX/Gom65UMfCuXUnWO86KlWDxcNJKUhKJQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB8577 X-Rspamd-Queue-Id: 4LZTZd3l0sz4VrG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=faWLnyor; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.87 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.87:from]; NEURAL_HAM_SHORT(-0.97)[-0.973]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.87:from] X-ThisMailContainsUnwantedMimeParts: N Hi,=0A= =0A= NFSv4 mounts using the "soft" and/or "intr" mount options=0A= have never functioned correctly. This is noted in the BUGS=0A= section of "man mount_nfs" and commit c0d14b0220ae=0A= added the generation of a warning message when such=0A= a mount is done. The breakage can occur when the server=0A= is slow/overloaded or network partitioned such that the RPC=0A= reply is not received for over 1 second, resulting in the RPC=0A= attempt to fail without the RPC reply being processed.=0A= =0A= Breakage of the protocol has become more frequent for=0A= NFSv4.1/4.2 mounts since, when a syscall returns before=0A= the RPC reply is processed, it leaves the session slot for the=0A= RPC non-usable. When all slots are non-usable, the mount=0A= is hung.=0A= =0A= During review of commit c0d14b0220ae, emaste@ asked if=0A= NFSv4 mounts using "soft" and/or "intr" should actually=0A= be disabled, so I am now asking others for their opinion=0A= on this? (Doing so will cause many extant mounts in fstab(5)=0A= to fail.)=0A= =0A= Thanks for any comments, rick=0A= =0A= From nobody Sat Jul 2 02:45:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 371AF87A470 for ; Sat, 2 Jul 2022 02:46:00 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from relay.wiredblade.com (relay.wiredblade.com [168.235.105.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LZbzV5SL8z3CbM; Sat, 2 Jul 2022 02:45:58 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from mail.distal.com (pool-108-45-159-88.washdc.fios.verizon.net [108.45.159.88]) by relay.wiredblade.com with ESMTPSA (version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256) ; Sat, 2 Jul 2022 02:45:50 +0000 Received: from smtpclient.apple ( [2001:470:e24c:200:ac1a:c41f:4234:6f28]) by tristain.distal.com (OpenSMTPD) with ESMTPSA id d6e01b61 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 1 Jul 2022 22:45:49 -0400 (EDT) Content-Type: text/plain; charset=utf-8 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.60.0.1.1\)) Subject: Re: RFC: Should intr/soft NFSv4 mounts be disabled? From: Chris Ross In-Reply-To: Date: Fri, 1 Jul 2022 22:45:48 -0400 Cc: FreeBSD Filesystems , Ed Maste , Gleb Smirnoff Content-Transfer-Encoding: quoted-printable Message-Id: <8D9B4F06-9C39-4EE3-95E6-154608B83E29@distal.com> References: To: Rick Macklem X-Mailer: Apple Mail (2.3693.60.0.1.1) X-Rspamd-Queue-Id: 4LZbzV5SL8z3CbM X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of cross@distal.com designates 168.235.105.136 as permitted sender) smtp.mailfrom=cross@distal.com X-Spamd-Result: default: False [0.18 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:relay.dynu.com]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[distal.com]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_SPAM_LONG(0.98)[0.975]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:3842, ipnet:168.235.104.0/22, country:US]; MIME_TRACE(0.00)[0:+]; TAGGED_FROM(0.00)[freebsd]; RECEIVED_SPAMHAUS_PBL(0.00)[108.45.159.88:received] X-ThisMailContainsUnwantedMimeParts: N > On Jul 1, 2022, at 17:57, Rick Macklem wrote: >=20 > Hi, >=20 > NFSv4 mounts using the "soft" and/or "intr" mount options > have never functioned correctly. This is noted in the BUGS > section of "man mount_nfs" and commit c0d14b0220ae > added the generation of a warning message when such > a mount is done. [=E2=80=A6] > During review of commit c0d14b0220ae, emaste@ asked if > NFSv4 mounts using "soft" and/or "intr" should actually > be disabled, so I am now asking others for their opinion > on this? (Doing so will cause many extant mounts in fstab(5) > to fail.) It sounds like failures are likely with them, so I vote they be desupported. While I worry about systems becoming stuck on bad NFS mounts as much as the next person, if we can=E2=80=99t reliably get the desired safety from soft/intr, no point in pretending. - Chris=20= From nobody Sun Jul 3 19:46:17 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 37A978B66B1 for ; Sun, 3 Jul 2022 19:46:25 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2057.outbound.protection.outlook.com [40.107.115.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LbfZS222yz3KR2; Sun, 3 Jul 2022 19:46:24 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oO7MXV5EAB9fH1bsYQa4YfLanFijHh+59NfIAUBxWbDEMwsyns5CAsziJgRM0/quzCGZGqVkv7E5NXddaq6Bh6BkmLNtmHybVunvgN7kj+AiaYYJDUUASmRvddRxoclneQQ6aU/zpaSXB5WfyF/XIgj9PW6tvEBtlVFqW3YDjhHZeQJmadE6whJJl0WCoQMveGbILyPl0OY8R2QirYOKxnTWKU9iYCxVUTnLHfUwd1k+eaGFibS4Eoj7KooKZKnJ/VrbZ9/PiFatG53RZWPI4Eyb/feb7oJfL7E77ENdTYY0AeGedkLfJ1CyfcvmVWPc92Mao58rVP+Rzq1OD8FdaA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1J/w4wlQG8dCqbdmxhfq3SzWIqGdvFfvZVUvF8v0pcc=; b=Lw4MVQVBiWhgFqoDJg3p4hdA2RBxZ4SOopFZGECRzbZyRTu5dzCuOBQpL/G9CHC+gBkwlyl1AY7mWAgZ5hJcM6LX8ogaUzZmbIGKxNi6uf6bcNu52m4Ae0M5zCM559D4LHZk3k3puHlieOslIurBeABCOWtlkGCOoeywduDBp3PzsFxZsF2JtK8IctVbZX8qP0On6z2U3gfZgwkirdYr5abuDi7dGU4uqbyf4maaX0lX7r2Mq97cEFqfnr8HPKME93frM+XKzYSg8R/cxbXRxH1AXyVp6qNBlmb8AEoAvENrxZ6O/ZFgkIFswpoUnQrol9mi++aMgKTc9yNrZ+Oe4A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1J/w4wlQG8dCqbdmxhfq3SzWIqGdvFfvZVUvF8v0pcc=; b=JfyOB+dChqKEZJAYwBP+bQwGpYMJG52J/4UIhuxSAuy6mtvTaK7sucaAjz9T0QeGjSDyLE5kZnSz1bPGEE9oPiONjZcYuA1b4RwAN3kIiai4FzL/QaMUP50eYKHc5BEdybXEOosT8cFG390YPxG0PSCwjkuVKbrKuFeXmXoDpCExXlGm3oYSuDvQbjGITnCzHfO/EOo7lf7K7vb/iYUWxfEAsnxSxjpt73XHuh6Iptjf3egGVQC2q1X7+UB/khkc/qIKWxvGJTZXDFxG3bCvDLEYrbRzpPFHSCnqZdWAM5bsGsqmQWwpL5r2O24+q0/GFunjq08XfnfeojAKkGpytg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT1PR01MB8395.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:c3::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5395.15; Sun, 3 Jul 2022 19:46:17 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::c494:e35e:76d4:7d75]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::c494:e35e:76d4:7d75%8]) with mapi id 15.20.5395.020; Sun, 3 Jul 2022 19:46:17 +0000 From: Rick Macklem To: Kirk McKusick CC: FreeBSD Filesystems , Ed Maste , Gleb Smirnoff Subject: Re: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Topic: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Index: AQHYjZRBjJW/UbMaU0uxP2BOexC+Da1s1aaAgAA2UJ8= Date: Sun, 3 Jul 2022 19:46:17 +0000 Message-ID: References: <202207031617.263GHZpZ000763@chez.mckusick.com> In-Reply-To: <202207031617.263GHZpZ000763@chez.mckusick.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 9917ea3f-79f6-c3d9-943b-4ce88cc51c08 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e3b1bb0f-d4c2-4113-3307-08da5d2cb20a x-ms-traffictypediagnostic: YT1PR01MB8395:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: HI0tv7WSIQ7ppQEKI5srKqIkO1GcmAs/hN3q6u34Oj6m1sxCNltfi40ElkPYTL1U7GWnNy5cHRXVtbwuzRD0ODe3Ji34RzH3c2Ir51D+RkSe0JcRYWAKKkn1x9LtQFPVz82LtJ/nW/HhAS+FUgb2HgY6odFtxNekk1BXEBhvnI2hR1H4+PU7a209bNbPD2H6CZ7aM97IgyO52xDVR3lFRdNEn40RIiY0GrxG4fedLfd8fgE1j/2dIINCVe7wwCqRk5EEbFjAwRRX3PO9AV5uaq27EdlbM8LZ9TohMtOJwuW04q07ILvYVvSze6H4kgEMYu38L8tFVZ2zT5mkCFgXNlbKjoM9b9R7Vp0jZcyfNAmmtxTfBcSRZuC4VVvV3hgH/iyPk0dR7xIjPmz9O6X3OvPm9S6xA6cEpwkaFj5UDrTiZwQB7w3U0ggxHB5h+pP2difi1ENyhsgHzCChSwluIn7jb9DnqKwM2TFj7DJTsPwX6c+LL+it9TbmpvgX8FTOZmBlu2LkHZGaMym3nWTke/E6rMlREWP9SCzWJ+M6VLPV++OjYk41Qp+3SthAeRcMNJWt9Tdc13HM8obuHFHZgQ9HWDnKA8EHmb2mewfrdrP2qkb7aDBaIsR8mmErrUji/gvbdOFvWpITExy0oHbN3wq8ZXNouDcPIpOVfXMr4a4Y3MJLzzGsWp94LXNmUVyG2EzA7+wv7Q546zXIZ3kt9nDwlm98Vjh8Ujrgv83p0qrf27nTLVJu75JTF54yn37hWyMUBraa+nZjtof64w3G1F6pPLh8bJglFM2WFZNb/5BZz6XGYMq6SePbrogHNgj9r4l3+bz7jpx/Ps5VeWcdYy8gMn9AzMh8sD6BKxbaStU= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(346002)(376002)(39860400002)(366004)(396003)(136003)(478600001)(5660300002)(8936002)(52536014)(41320700001)(122000001)(6916009)(54906003)(38070700005)(316002)(786003)(33656002)(86362001)(966005)(71200400001)(91956017)(4326008)(8676002)(64756008)(66446008)(66476007)(66556008)(66946007)(76116006)(83380400001)(186003)(9686003)(2906002)(38100700002)(41300700001)(6506007)(7696005)(55016003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?y+AAYumwK38bZ5Wpltgv/5tMirfpaKJv8GcsdfK2KkGZHvYHq+xxOj2DPp?= =?iso-8859-1?Q?HpuCBwdbW0WIH7dqiNvuWA1rG9ihWCKfdxmoZtTWXjK1bpPSTxf1Z4P2WY?= =?iso-8859-1?Q?U8WtldKrLpDPI6jRVsdvFalLYJuORunzNwf0v0zmDsTU6ZjzXauH8P14bY?= =?iso-8859-1?Q?IQ3VYxrIi0Npz5VYwM/3JBPAEdYyY4ZLNTseSlAgGoL7QxcBo529p5xVEO?= =?iso-8859-1?Q?GYLrwDoTdPA3nDZcHsadmnV5yF8gVfSQvRFrXCJGHxnMvNsitNf2VUBf0C?= =?iso-8859-1?Q?KJ+S7KwlIZZFknbU6lrd/a5tP5+eP9KRBmxyWiWMK+fX7AKqJSoLMjFA8M?= =?iso-8859-1?Q?5F63XrbHgfY8bRTdVoRFxepyt2dy18iWQ569uc04PxyuXYtuPd2lEL3HB8?= =?iso-8859-1?Q?6iFOOrlGQLCf2j/VIvIHORJX3IkjIzt7Oym2MlFaVOwVXXS+nPXynWSYye?= =?iso-8859-1?Q?KMhpneP+hMzPZGt79rEVulvFWpfbmWAHgKm2bHF5vsd7lDtDrjfAdpOPBl?= =?iso-8859-1?Q?osy5IDOCFR/o+BYa0ndgROxhqPk51msmo7CODuLV69aHXVzJSyWZhukIMT?= =?iso-8859-1?Q?NLO+UKi87gd4a+ew5zmV4C/aLEuEkacTAYh8LfslVZWI4j1/np1tyGmr7e?= =?iso-8859-1?Q?R37aiDyEzdslv/El1IaINVy5qcu0JruZbOtH7AS7UY++h3399UzHU5dtTh?= =?iso-8859-1?Q?pH6V19C7aO4cgGridmFCXMvUEGAkfdIJGP+JinGa9f7uaq0FDzYNLiUxuP?= =?iso-8859-1?Q?9WEkPz7K4jzoX4cjSHrRh+jS5rACji1b8iEYlTBlTBMulKwId4onpz+nle?= =?iso-8859-1?Q?9vGXrgsSFy0UUEomoRZfFLpIC3U+PAqFxbIgkx4p3H3gH8EVsHk8cr5Kfv?= =?iso-8859-1?Q?/ZVMpG5YDCBWYL23mdxBLREGDJ/TTD9OXiKTE7A4lBlv8NWnzeHHae28CF?= =?iso-8859-1?Q?x6RHNmrMHYqiMB/UKyJTnf7xj1/+8ZcmXWhduqGb8cC/symeEeMVD19giw?= =?iso-8859-1?Q?tftMuaWQ5JYmxw0Ss2SG2GaSRRJblQ0BNn2Zi5W47wJ/3JHXJ81WS2cI7F?= =?iso-8859-1?Q?SZzPkMrnYoQPMB1ByxlbX/k+DETmL3AYrarwZ/IFfCYhG8N+JSTr4DiYU+?= =?iso-8859-1?Q?K5WbHuwSDaapn6aiAxXPh0IILXZNjVESmNUqZok/fb4JV13nePnHQcfZxa?= =?iso-8859-1?Q?xdcjlG1rMoJwQodGwGUzFPrxOu36cu8s4GxdQct60YzkDPitlGvuwqghCe?= =?iso-8859-1?Q?lSaWoLNvvi0bdKMFxvfR9HQbx3ocjY5/wzqmis0ZSHC3CGQf2gZj5D8Nwc?= =?iso-8859-1?Q?5iySM5IiFuPH0g9BFQXQqVYHMaK4k/+fNUK67NYt76We+89SvgY/OIhvq0?= =?iso-8859-1?Q?t8kWBUneoCMXASHbA2MUGhOy30Hu4kiJzgKktKxNF64nNWGpvVXcTMkmzY?= =?iso-8859-1?Q?jkFgBuUDJZdchSzKqNxQ/TY7vRp1TMKjUbN2tlTmHf4ekmkm/QlDacWSqb?= =?iso-8859-1?Q?cnqBXLgTJiMlJHdpNs+D97pDduTnSJGsck+KlYe9D5DYKCc3/0Sunb4tRQ?= =?iso-8859-1?Q?aOadDYeEFq8ddBgaVkL7yH4AEacynKYKtAfwQjdI061v+KUNt3knw8rNfd?= =?iso-8859-1?Q?76yFswfoDWCNl6sidnrWsC6WIt7nEMx9aA5jhtXFE9LQfCnujXVf9ZPl9q?= =?iso-8859-1?Q?fVIgzTHch4N2W86qEKa1V3gRiOSxTrv+ucXCuAaX?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: e3b1bb0f-d4c2-4113-3307-08da5d2cb20a X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Jul 2022 19:46:17.3147 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: QIeKDBhrzM5C9NSs2prwQNRWK7Lx5Uek/GL4CVas0D+NGGUdZvfwamHLWi0R/R/3sZh1PXowk7cJZ9u4hF5xFg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT1PR01MB8395 X-Rspamd-Queue-Id: 4LbfZS222yz3KR2 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=JfyOB+dC; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.57 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.57:from]; NEURAL_HAM_SHORT(-0.98)[-0.975]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.57:from] X-ThisMailContainsUnwantedMimeParts: N Kirk McKusick wrote:=0A= > > From: Rick Macklem =0A= > > To: FreeBSD Filesystems =0A= > > CC: Ed Maste , Gleb Smirnoff = =0A= > > Subject: RFC: Should intr/soft NFSv4 mounts be disabled?=0A= > > Date: Fri, 1 Jul 2022 21:57:21 +0000=0A= > >=0A= > > Hi,=0A= > >=0A= > > NFSv4 mounts using the "soft" and/or "intr" mount options=0A= > > have never functioned correctly. This is noted in the BUGS=0A= > > section of "man mount_nfs" and commit c0d14b0220ae=0A= > > added the generation of a warning message when such=0A= > > a mount is done. The breakage can occur when the server=0A= > > is slow/overloaded or network partitioned such that the RPC=0A= > > reply is not received for over 1 second, resulting in the RPC=0A= > > attempt to fail without the RPC reply being processed.=0A= > >=0A= > > Breakage of the protocol has become more frequent for=0A= > > NFSv4.1/4.2 mounts since, when a syscall returns before=0A= > > the RPC reply is processed, it leaves the session slot for the=0A= > > RPC non-usable. When all slots are non-usable, the mount=0A= > > is hung.=0A= > >=0A= > > During review of commit c0d14b0220ae, emaste@ asked if=0A= > > NFSv4 mounts using "soft" and/or "intr" should actually=0A= > > be disabled, so I am now asking others for their opinion=0A= > > on this? (Doing so will cause many extant mounts in fstab(5)=0A= > > to fail.)=0A= > >=0A= > > Thanks for any comments, rick=0A= > =0A= > I have always been of the opinion that "soft" mounts were useless=0A= > and would be happy to see them go.=0A= >=0A= > I find "intr" mounts to be preferable to "hard" in almost all=0A= > situations. Being in an editor or some other application and=0A= > being unable to ^C out of it when the server is not responding=0A= > is extremely annoying. I know that quite some effort went into=0A= > making NFS able to support "intr" and I think it would be worth=0A= > the effort to continue to make it a viable alternative.=0A= Well, I have a patch that is the last attachment in PR#260011, which=0A= keeps track of broken session slots and then does a Destroysession=0A= when they are all broken.=0A= This works ok, at least against a FreeBSD server (haven't been able=0A= to test in against other servers yet).=0A= --> I think this fixes the more common session case, so long as the=0A= Destroysession does the right thing for non-FreeBSD servers.=0A= --> If anyone can test this patch, please do so. (Unfortunately the=0A= patch looks different for main vs stable/13, so email if you need=0A= the one for main.)=0A= =0A= As for "intr" allowing a process to break out of an RPC,=0A= even with the above patch, it would break that open lock,=0A= but since the user no longer cares about the open working=0A= (the close might fail, but that is only a problem if the server=0A= does not do any cleanup and accumulates them) then=0A= I think this might be ok?=0A= =0A= > That said, it appears that Linux has deprecated "intr":=0A= >=0A= > https://access.redhat.com/solutions/157873=0A= >=0A= > Though they do still allow NFS hung processes to be killed with=0A= > SIGKILL so if that option is available it will (painfully) be=0A= > possible to get out of hung processes.=0A= Yes, I think the Linux client folk have disabled "intr" for the same=0A= reason (it screws up sessions and they have not figured out how=0A= to deal with that). Since Linux defaults to NFSv4.1/4.2 mounts=0A= for any server that supports that, their users probably see the=0A= breakage more.=0A= =0A= rick=0A= =0A= =0A= Kirk McKusick=0A= =0A= From nobody Sun Jul 3 21:00:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6BFA787861A for ; Sun, 3 Jul 2022 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LbhCc3hJ7z3jyy for ; Sun, 3 Jul 2022 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id EB36A2B7BD for ; Sun, 3 Jul 2022 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 263L0BxP011462 for ; Sun, 3 Jul 2022 21:00:11 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 263L0BNN011461 for fs@FreeBSD.org; Sun, 3 Jul 2022 21:00:11 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202207032100.263L0BNN011461@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 3 Jul 2022 21:00:11 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16568820119.AA13.10546" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1656882012; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=HMEyQoM10D83+B7ULp6frZHNGk74c00TR6zxCS+JEQE=; b=Ttc2RAtKJFFuvfxHlioSVEkm4nCgXKW0G9YEN6c8IeArSf2yvYuV9Ep8GmDJyZMgzSILKR M94OIYOz0x2sZPjhyUAEQ6GKboKgI51jni+hJIIgoYKBm7nM3g627+eCsKmzfpDZXU9eih YAAKOwDeMxSlWIMgLMkigsis7XrT+zlc97Shj5RWluCyZDxv/h4m4cYA9TgAiW3U6y2JDa r3LbXmUrWNC+coWHKrQtZi1tk/Xl42tC6hCL2cGKB1zEXNyv79uQAtYAdV2fIEttumKBV+ pEdpZGwg+fqV4gf8Rm7ZqsGN8OKlLTk0cZNAvggVZsJPQJLG2LiUZsxZ5D0Vkg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1656882012; a=rsa-sha256; cv=none; b=FsRHEFMPZnuONcqTYk5EyodjhoEaIosdwEgX1ScUXIP1/kZaH0FPsYpUzSKyd9/pjuDd19 anZSLgbz1oshKsT1MeTsmRjHGTFjMlllRyqsxFDIUTomjGd0PZAPlLCzfOHNqGopd7Yans PPDO7RQjurL6Oia/ca490X3hmkXyzWTflfI+vETPwyWVDiv1xHWRftA0qZaCmEIf+cuy1L RmL2mACrGwJCLVd4IO2rxThZpELdb6qAKVu94/39xslsytvex07lPTD3pRnSrATFUjO2T5 Tl5gUgE032Y3WMWqqcV45iUuXxGsCMrcSgmgCB02Ja/wDSgHTXKmSuaWIZrpAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16568820119.AA13.10546 Date: Sun, 3 Jul 2022 21:00:11 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16568820119.AA13.10546 Date: Sun, 3 Jul 2022 21:00:11 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16568820119.AA13.10546-- From nobody Tue Jul 5 21:48:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D3F311D152B8 for ; Tue, 5 Jul 2022 21:48:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LcxBP4vQcz4Rtt for ; Tue, 5 Jul 2022 21:48:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 88E6759AC for ; Tue, 5 Jul 2022 21:48:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 265LmTnn052078 for ; Tue, 5 Jul 2022 21:48:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 265LmTjJ052077 for fs@FreeBSD.org; Tue, 5 Jul 2022 21:48:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Tue, 05 Jul 2022 21:48:29 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dgilbert@eicat.ca X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657057709; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rO58VzDKE/DZtyMrCPOyFEX3nMNmVfbt2drfG/GQpv0=; b=mNhKqWjsCJlREwI81s4aiNGNBiEffUh9catvjFG/4ZFo91yB/4BqfycxS4HwHuARuC3KUC lC05Q6UZ/ki2SPW0+uAlbCvGankusa1m2WEwKcmt5fxBRyOC6c/3D8ZBLtASTvlBpB+J3a K89HO0SzKvhBgKk/fvYoD/AC4OFSE8J4kdzKLvFwtkob1d9OAvvidmJijJiv8RtvYR1GyK B1gwOEuVVmpWcQO3Qi3E2nZ20RBzD0Z9GctcKxcYGJgGpinta5LZh+T6ZBxdalcSdN9rnG s4RakulLZATlmULcONwhdsMqMPiUZqH/yODToJQnl2SM35bJyhweSrnI1W6B5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657057709; a=rsa-sha256; cv=none; b=LKMK5Yh540+p5e0/2uQpWw3wI3Ra5rnwWc2rgyYEmspUeJJlyccHmHC60LHsHZxuQC9y2Q kmOqwRaqUlHm2OmB+GhYVHGqF9sF9pJRZfNHEXSCcr8bEEC2tI8z/7hKgh22/bB3d01EY5 G61d4Dc4MEQQlcwbL8uyJZJ5bkKTSO3uCDn1NChUdnLLJeSWW2xmKCq+pFM++4WkZi5iBd o9qhBdxIznBl64+jbsL8xqkpYwilZ9248fBWmbnCj61fAf71ZkzPLMUWumO7CuemZfLuHN d4b//IHfoJxc9vTvjNRLUj4IovsS6/oOSLlNTDJt7EEcotYV8JGdZnptSCpRVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 dgilbert@eicat.ca changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dgilbert@eicat.ca --- Comment #22 from dgilbert@eicat.ca --- Here's a theory. Moderate load crashes my SN770 --- WD Black 2T that specifically has no DRAM. theory: FreeBSD is stomping on the host DRAM reserved for the NVMe. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Jul 5 23:04:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 925A31D00343 for ; Tue, 5 Jul 2022 23:04:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LcytV2G3Yz4f00 for ; Tue, 5 Jul 2022 23:04:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 292F46962 for ; Tue, 5 Jul 2022 23:04:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 265N4otp093866 for ; Tue, 5 Jul 2022 23:04:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 265N4oVA093864 for fs@FreeBSD.org; Tue, 5 Jul 2022 23:04:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Tue, 05 Jul 2022 23:04:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657062290; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/4dp0F9ls/qbEf5ttv0IvTohE4fegWOBWWwJiywEd48=; b=NUb/++AZEspl6yjby6og5Ux0eme5OEIKLdebSm5Q5CF5a18zmxWsfUABeeveKX2UZmQ7VB QEXH5EWZ2gJCwXmTFmvkSGKx5Y3Uy0HbVJPx7mzVyfdGlXVp1UlmehvSCRL5wYhLH+X6a/ m8rxC3/vqSHl926+KkUKxQhlsdmmMEn2Gb3pkGANmLq8nN37gvYC+eLO+67Nkw6odFdS19 4kA3aDqDyZhZ6yKlqryHvFcM5LamsyGN69g5liJLfY1CcFkMMUOUHSV2O3Meuw6NICfi+6 9YZf/KtcC5/lZjuwlOVOAsrlx6dto/97Ec23zpNGey3n4FlT+P/yBI1/6cogJg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657062290; a=rsa-sha256; cv=none; b=yfog3L3Xpwjl3CigAuI7vcuhn+JzYN5grT7Q3OG+wznQWJkm0YDAYhA68rQnYF3JfpOiEM 1MKNkAUEwS/THB1bVrrtYnl0Qe+lahEaomZWJ13RzGoUL2bTDEoKM1nGlH56fv69AyNHhL wHRwemSgvsHLJqdBcUa9+pvI7OifDsKmVETHPrN1RMS62eIVfGueZb8o4tzeXhvjRFTwl/ nZIypv1UWj+RYTngE5TLQBakJaE3qaNoip4rdYW1xQT/Za0849NsWSOoR4xw2aAebxZLjF EZwk8EfGhKLxoPJIaHRHtWWz+Hh6TLWURKWBGKpwoMZuiENu4LbYk5Yqtq6hrQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #23 from Warner Losh --- (In reply to dgilbert from comment #22) > theory: FreeBSD is stomping on the host DRAM reserved for the NVME There's no host ram reserved for nvme, per se. The driver will optionally allocate memory for the drive to use, however. Do you have "nvmeX: Allocated %lluMB host memory buffer" in your dmesg? Without it, you're not using nvme memory. You can set the tunable hw.nvme.hmb_max=3D0 as well to disable usin= g host memory for the DRAM-less cards at the cost of some additional latency if you think that this is the cause of the problem. This would rule it out as a problem. There may be some cards that lose their minds when this is enabled= as well, though I've not seen reports of that in Linux world (I could easily h= ave missed them). Ruling this in/out would be useful... But corrupting host memory seems unlikely to be a cause given that the card drops off the bus and has its memory BARs reset so it isn't decoding anythi= ng (which is what's indicated by the possible hotplug messages). This indicates some kind of power or connection issue to the card, a faulty power controll= er on the card or wonky firmware in the cases that I've diagnosed. There might= be a possible additional cause that's still unknown, but absent better evidence I'm at a loss for where to look. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Jul 6 04:42:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9B5911D0B4C4 for ; Wed, 6 Jul 2022 04:42:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ld6Nb2WXnz3qM0 for ; Wed, 6 Jul 2022 04:42:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 36724138C2 for ; Wed, 6 Jul 2022 04:42:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2664gtFY068871 for ; Wed, 6 Jul 2022 04:42:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2664gtuo068870 for fs@FreeBSD.org; Wed, 6 Jul 2022 04:42:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Wed, 06 Jul 2022 04:42:54 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dgilbert@eicat.ca X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657082575; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qH81zIQ+1MAW8IjA5vjVhbPKeSbQ9pMCmx+Btb1pykA=; b=TRmwIGtlPQ6w7G2AaqpYAQ9wIW5BILsflmZ138w+YSdfzwu8fh3z4rK7Ip8DvBeqTL3rJG p9Jw4kgoeKUcj5UdSR9Csx2F0kWlDhOTUKsg0vaiAA+s3QMKRjE4geEy9owAj/3VhTK5ED Y/nhtFrnGSt2GeDuYBXW37CsLtZKaiCGeZqT6D3W3JzT3LqanUzlLgYVXLDJ5irdhGhJui DfUUoAzMnZn/SmaS3FMBMO3Thf0Hv/22yNA5rx1QIqah/5EknVCIEyaijBd0FlObgs9/Pj vp6oxdvBvKJgWfE93qOpDzBZke7ie3lUeBDumUT5AuRw+YyQpDSv3XPAkzfugg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657082575; a=rsa-sha256; cv=none; b=aIFb0rtlcVY80MzN6Vw0rSFzstwRt+hjOvWMP/eHWY+wydHpCrRUWrqA40lPBM4g6u8LJC oLeZTheHOIUMb7Ve7LLrCTeyLA4g/m+iGkgqLX+Y9S/wnoJv5/FsRDF9zW/bj5sUw3F0lW HVQ9/IxoTUEhw/XR9p++7uBM10dBq2URC+K2eaNnmuAIVptDDAC8aSm2982kUqB8Adg7TY sf80yPehtxuMXuKNnmPX2muHT4dU/jaYrzDGUo29IeSRUDCMy7Ta11VeoW7pINARFhBTpJ A4LIn1i2cQuKxq+a9lVw0HGMaLR6q1uwZhcmq2aLbkm+ji9aaQWk9gMP2JgjJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #24 from dgilbert@eicat.ca --- (In reply to Warner Losh from comment #23) ... so my messages file back from yesterday says: Jun 15 22:46:17 vr kernel: nvme0: Allocated 200MB host memory buffer ... the trouble starts with: Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_START 459377299057992 vs 459376982792873 Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_START 459377569149703 vs 459376982792873 Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_START 459378788907460 vs 459376987085573 Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_START 459378788907460 vs 459376995708726 Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_START 459379058646386 vs 459376995708726 Jun 17 04:28:00 vr kernel: nvme0: Controller in fatal status, resetting Jun 17 04:28:00 vr kernel: nvme0: Resetting controller due to a timeout and possible hot unplug. Jun 17 04:28:00 vr kernel: nvme0: RECOVERY_WAITING Jun 17 04:28:00 vr kernel: nvme0: resetting controller Jun 17 04:28:00 vr kernel: nvme0: waiting Jun 17 04:28:00 vr kernel: nvme0: failing outstanding i/o Jun 17 04:28:00 vr kernel: nvme0: READ sqid:1 cid:118 nsid:1 lba:2985560513 len:256 Jun 17 04:28:00 vr kernel: nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:1= 18 cdw0:0 Jun 17 04:28:00 vr kernel: nvme0: failing outstanding i/o ... which repeats ad-nausium. At least in my case, this was a zfs-cache drive ... so I have a log. ... but sadly, I returned the drive already. I can't afford a $300 non-wor= king bit of hardware. Had to return and order a new one. I can tell you that another NVMe in it's place does not _ever_ do this. An= d I can detail that I RMA'd the first one that did this, and the replacement did the same thing. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Jul 6 19:03:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DD0381CFE3C5 for ; Wed, 6 Jul 2022 19:03:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LdTTb3gZwz3lYW for ; Wed, 6 Jul 2022 19:03:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5F9FC200CF for ; Wed, 6 Jul 2022 19:03:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 266J3VE5039811 for ; Wed, 6 Jul 2022 19:03:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 266J3VRc039810 for fs@FreeBSD.org; Wed, 6 Jul 2022 19:03:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Wed, 06 Jul 2022 19:03:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657134211; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=voEfVCr8LRHHBIjCtBjk+eQsaj4Rr9ulsufkdm/ZkCc=; b=XZeI2bdRrUYPV6QDT49ODa5jsfjKT7aZWvlhd/6W+UY2JrLadBdaIE/H1rBD8wR3twV7ch rPBP9i+dhpbKoZwESf0hbIBTmuLQxn8k1xaTN0JlFAiAUXfvBUcSuSxkEpuf8FXLdwOXaJ m/8X7OQmN6/r8+Wji5X8ErzBWFhQnZJXH9UQE8I/pEWe68njFobCRLS7eUh9eswCAy3qVs ydk20DuP1cKPj+452kbHdAgfgbu9UsVk1Pp24DpapITqYvsLjDLPDWzHW8a3EEqlFmuEMm Y8WhqurRTc7XY0yi0qWy5I1gH789Wevoi6DVinkmMTX7DUcYSHWdOi/NU/1ZGQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657134211; a=rsa-sha256; cv=none; b=sM8Xpsb+RToYKvgXRMyICK7HNhspgCjsAgZBWmf8cjHULZVRamqCkUWzoM6QrgRi9sQreK qW4Z5tGlBGdR7aj/ITzHaejxV16qA2u1AhpgG6giqmAY3p+F7QlVvSY6D1A7CKot+MzmYw RWNj3PnqbodZcD9/DCVgbe8Y4zOkeGy0ayNT3UfPL3EbSk4tWPUuRHhq0NSeeClw84ZS5G dkBilMh7O0HNFAVR/OkvZVFC2sBdhhvzHMI+T8wmbpKLhJdfxuV9Q5vk4ppt98m4VG3HLS X57MRLCuOS3AgiKpSY+Nw7xhYUjGSGybBhoohY70TqOdbPaD4f5vlw3naK6qPQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 6 19:03:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 36B1C1CFE43B for ; Wed, 6 Jul 2022 19:03:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LdTTc5r0lz3lcL for ; Wed, 6 Jul 2022 19:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9C20F200D0 for ; Wed, 6 Jul 2022 19:03:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 266J3WTQ039849 for ; Wed, 6 Jul 2022 19:03:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 266J3W3o039848 for fs@FreeBSD.org; Wed, 6 Jul 2022 19:03:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Wed, 06 Jul 2022 19:03:32 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657134212; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=A7CrBB6wBYdVn81Db7hpA5Sd9mohj2r8IB1iyOiqtqk=; b=Sm5dOh3Mq68kTF+1lGz6yINgZpL10ydnGARtoxizLOja+z259MXRRO/uA+pqjHLWqiiGji G6J3yAUcPOurkxHalRelPTGpcpj12B97eTGljYGOyYDlX3TEe4FPonNgI5FiaXkNH9PneE FyulTpEt5ekRdgj3BZWXRg2X3HfysPn92oBC1gZHWrNh1XEaeWJJ+2h1iud2O/cez8mE7D m1V0J7dXhazh88SQJSoEPSh34qjL2hEy2JMcquAs1ATW+G1RbRvHrxK+J1gTcC50TW2sHH wB8icpefYjAfRDO20ZXXbOkB/vtCh8zTQPOuWWtnBJCn84bmXAJzNtW252KWXQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657134212; a=rsa-sha256; cv=none; b=PcLjazC1OAUSInv2c/93l261LsUs1MgloNn8nkhcdk6X0h7X1sw8T3tW4ZT1Gk3Nm7RRg+ jRsVIf5BjswLx+pTFZ9RbVXJB6bo6NnWaquEXE8WpmihRaiYgLThJuGa7Xp/h1ulyOpZXe w5X8kDQpdA6JNjZouOcOGFZ0n75kN6eQMzCzgoxjhhJQf4e0mASb0bT4au3y2qsLLo8soS lYCq4v3ESUSf7quiXrKVUnfTMlT/THALD++cqXEiI7p2cwuZkMZO5RQd5EgoVkvQcjCHEM XDrgGEBfBWHAItzM2E3Ksx4t1e3HejygHvqd5VwN9sz9mkqCV1qsHNchASHDYQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263765, which changed state. Bug 263765 Summary: panic: ffs_sync: modification on read-only filesystem https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Jul 7 09:30:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 891AC10F90F6; Thu, 7 Jul 2022 09:30:29 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smarthost1.greenhost.nl (smarthost1.greenhost.nl [195.190.28.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ldrjw0VlKz56j5; Thu, 7 Jul 2022 09:30:27 +0000 (UTC) (envelope-from ronald-lists@klop.ws) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=klop.ws; s=mail; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:From:References: To:Subject:MIME-Version:Date:Message-ID:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=ZUYlyrXG7EUqmzxgHbbFDNwEBYbTFdztQUFVSpcji9I=; b=HfwVADl+ur5WD4uQ/KRzFZ8a8L EdjE2dCCN7ghOyZOYeBDrW4LrJoIGD3+JTPICbDdxl2zbpoVbEcm2KCjYiWcwOxkP2C6jfv2Y0ZQt GR8kBB8hjtfmZYOGnG/k0hkiC3V7tzQOYxK3n2+ZTYv4IEA4CjNZ3nGUo36kzy7j6BhI=; Message-ID: <1d44f820-da80-8a65-ec5f-35632a7dd971@klop.ws> Date: Thu, 7 Jul 2022 11:30:20 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Thunderbird/91.11.0 Subject: set timestamp from ZFS-root - (was: Re: RPI4 + ntpdate + unbound) Content-Language: en-US To: freebsd-arm@freebsd.org, freebsd-fs@freebsd.org References: From: Ronald Klop In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Authenticated-As-Hash: 398f5522cb258ce43cb679602f8cfe8b62a256d1 X-Virus-Scanned: by clamav at smarthost1.greenhost.nl X-Spam-Level: / X-Spam-Score: -0.4 X-Spam-Status: No, score=-0.4 required=5.0 tests=ALL_TRUSTED,BAYES_50,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.2 X-Scan-Signature: c74461a82029b6293650421ecb57b64a X-Rspamd-Queue-Id: 4Ldrjw0VlKz56j5 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=mail header.b=HfwVADl+; dmarc=pass (policy=quarantine) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 195.190.28.88 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-1.00 / 15.00]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,quarantine]; R_DKIM_ALLOW(-0.20)[klop.ws:s=mail]; R_SPF_ALLOW(-0.20)[+ip4:195.190.28.64/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ZERO(0.00)[0]; MLMMJ_DEST(0.00)[freebsd-arm,freebsd-fs]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[195.190.28.88:from]; RCPT_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[klop.ws:+]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:47172, ipnet:195.190.28.0/24, country:NL]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 7/6/22 11:47, Peter Jeremy wrote: > On 2022-Jul-01 21:02:05 -0700, John Kennedy wrote: >> So I've got a RPI4 (no system time stored in NVRAM) that I did a stock >> type FreeBSD install on setting the time with ntpdate and the unbound >> DNS server (aiming for DNSSEC). As many people have noted before me, >> that setup is sort of broken because you can't look up DNSSEC hosts if >> you think it's 1970. No NTP time servers == no date reset == no DNS. > > If you're running UFS, the system clock should get set to the timestamp > in the superblock. That will be the last sync before the previous > shutdown so it'll be minutes to hours out of date but that should be > recent enough for DNSSEC to work. > > Note that this only works on UFS - see > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=254058 > > As an alternative option, the RTC in both the Rock64 and RockPro64 > are supported. > This is a nifty feature I did not know about. Cc-ing freebsd-fs@ to try get some attention on this. Is it possible to implement this on ZFS? Ronald. From nobody Thu Jul 7 10:29:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 874EC3E2025 for ; Thu, 7 Jul 2022 10:29:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ldt2R3Zlgz3LKX for ; Thu, 7 Jul 2022 10:29:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ldt2Q5MqXzffH for ; Thu, 7 Jul 2022 10:29:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 267ATovU012240 for ; Thu, 7 Jul 2022 10:29:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 267ATo1b012239 for fs@FreeBSD.org; Thu, 7 Jul 2022 10:29:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265071] ext2fs: fix potential memory leak in ext4_ext_grow_indepth() Date: Thu, 07 Jul 2022 10:29:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657189791; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3p56uPS4fq5XwPk9Tocx++BdQDFdebeMBju9tLfELs0=; b=fEjHWUjtKjp/w3mJ8QMDRYx2WKpHwCQGZbNCvvuS0BzLFOA0NdELe13kNfXoLhHnVi4gxt JFOt9Vi+vBh9QxizlxhzqLsiylBGopGV5QDWTMjAZyWocvePXQ5rvwPwBiFQFpt4fts17/ NzdwkJN/OTFcApads0t8bU+hqQ8qWaNP+vfJsbNfQGEhLcU5ybeUpoTxgjEV7R8j/ex2Y6 NfDnnuF49/PGVZhJ/J3rBXAuUq3Z2PG//v2VBbpHRYClTKEdj862XvmXVnOZ/cNrbB231U inuJurbbUEsai4lOQQmnWf6zpZYU/6vkd4ClvtRw2nFn4lh7yBEfiq4jwlggwQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657189791; a=rsa-sha256; cv=none; b=oGAE8840PRPDhcgJE2/Qpdz/o3c6LqdI1QmbKIA5W2KCSLDf/8ihbJOJg8uOkauPFUBdxX OIPeXQkIs7IgExDEb6rwV7MWqbpTg6QMFpLFcP1GWkATZ7ds5G3+x5mlxL3YxGa+iopvFN 3DU1MQjku1j8TuoGUTbQQl8wgD20Qoq7T3EqoE6ranJc0Q7gyXXknc2dEWKtRnB4X4GR9Z 70NNpVGBryeq8aupG6n1g2LjTGZMnAOfuwGB1VFdTwitIry9QkTfX3Z3DAACuJV5XF5qYs PoNsAhkFlH6tkdma1JdIT+2+lMnrROpSgqVkdCfXY8a3qwMuwlguOLn1DlXMtg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265071 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 8 20:36:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0718A3E74F6 for ; Fri, 8 Jul 2022 20:36:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LflSL6J7lz3cw6 for ; Fri, 8 Jul 2022 20:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LflSL5MB1zKfp for ; Fri, 8 Jul 2022 20:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 268Kaoqe016547 for ; Fri, 8 Jul 2022 20:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 268KaoCc016546 for fs@FreeBSD.org; Fri, 8 Jul 2022 20:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265071] ext2fs: fix potential memory leak in ext4_ext_grow_indepth() Date: Fri, 08 Jul 2022 20:36:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: pfg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fsu@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657312610; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CL2VKAT7FcWYyD3YuPdNn4zpWd6NJ0OMziRJH/WEOY4=; b=cfMs4xzgkTe3p3I491iPhYvNpIunu8YGK6R0NiHGG7RSqHz8sRLxznOYm+d7vWlZ4Vbdez 1pVUj44hYOUU9E02WeRJ6etp5mJ/4mD7eG/3hl6f0xyGCfnRhHLd7tWpu3t/S4hqRP6tRy Q7yf5E/uKvEV0YEaJCnJECH7vcjS035648ikgINvl+FbVCcz0OsPqWYJgU/qQdUr9DkccL L+qokWc8s9fzDJfmOApWMuxkHrZuXcMEt8xTy3xaveZCRDM/SYwjibzCDBu1rsWAj52uVg G8W5BO1DzuIUIbIQg8coV7cPNrcmKzu8AGDdY7z86Be3582+bF4pyG14uhykWA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657312610; a=rsa-sha256; cv=none; b=OQp8vbElYEFDToOqNeCIgr36AGiO7j3nC2zaO3n5dDHbM41PyroGMcCbEiHD0s/BDkba+8 1qAWiA9GZTY7xo5d0vbWVr2htLxspK30p4wmuCX3zxx2WXDtoKORdOEW6PCtifevScvI8r 3vzgHm57OEyw4g5KZEBW65HMfGaXHRrn2vw0wVZBX6w1HdjrXl/9Y7owQLUk9KyuvCkZo+ 0aUhT0NpYjf2ue5q2zP8J4iw8o2nRRy6yuQGWS5ED3hoyb4CJitSzbHtLQifvcIPTnWUPO k+YhOtYPfd3dMWElJFKW2eC09LiTx8kEI6uHzseSLcO6G2RZs0Qq8ZwY2ck8nQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265071 Pedro F. Giffuni changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |fsu@FreeBSD.org Status|New |Open --- Comment #3 from Pedro F. Giffuni --- LGTM, but Fedor wrote the code so he should approve. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 10 10:06:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8B3321D0A5A1 for ; Sun, 10 Jul 2022 10:06:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LgjNJ2C1rz3fx7 for ; Sun, 10 Jul 2022 10:06:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LgjNJ17D8zLdk for ; Sun, 10 Jul 2022 10:06:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26AA6eBV082096 for ; Sun, 10 Jul 2022 10:06:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26AA6edV082095 for fs@FreeBSD.org; Sun, 10 Jul 2022 10:06:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 195278] gjournal UFS: svn update /usr/ports panics with corrupt directory emulators/aqemu/files missing `.' and `..' Date: Sun, 10 Jul 2022 10:06:40 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657447600; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tewmyT/wa9osx2Dg6mQ24G3NgHfS1DO4mSHrbXVyVlU=; b=OsfAnOwssVln6M0Lvv3fnhwFBDrmi+P4HlMJc2OAqd0Ft+SB8yJGe+r3jaXVHWDx8Y+/JH R57Dmr31CvTbrzjIy93XQf5a9vsjQK2AKlJS8txfPMhEP9KPTJHGr/fnNu5j3JfLfmuk29 tsG9/a09hcncITeL4i+hyVsbAn9IBbRSLGK1kb+z85ERypZhWg8To4+K4VhRj4AAqV7TYd YelFXeRkleSGSZ0qajcsDha0mcLkij0uBPJf8/PimWP0vOfWehKZCLt4JLX5KTCdcNagG+ wB/I3ZAyDTzlX/l9OvUq/yaYrPOkyunjDXkXVXKKW6b1Rokh1JgFyn4gsxU6Bw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657447600; a=rsa-sha256; cv=none; b=aM6g+7LuuIaXhYvcNb5qVZeCKEYF1LUyT92Mdz7ASF47yVELhEwZ5jxqGLsOaTDeL3sJ6x 3/eabHB4mHfXgc8CWBV+o/kdE6Q1yUeicUVG2fGRJjyCkpsCzVRsRMWIDE1OdVMgZEkBQb gmDKr+MHP9lskf5FzJcVXbAfjYtYyh7kGDAp5gOqPC6Q8Ok/mgvJtEyfpuPRHO5nnzs1zd xfUf8pcbsv+4urviRxn52oGktb819EGj8De12kuG6GpcIyohwX4EUIH9FXCwymUhCEA3FE unz2Mi0uQyaDw7B8hVcHccErgn7un3/3J8Bl+Vvout9xkLAVIvqclQBPwcL2tg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D195278 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org, | |grahamperrin@gmail.com --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Jul 10 21:00:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 990D117FE587 for ; Sun, 10 Jul 2022 21:00:22 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LgztZ2Vvhz3vP5 for ; Sun, 10 Jul 2022 21:00:22 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LgztZ1dLvzdxd for ; Sun, 10 Jul 2022 21:00:22 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26AL0Maq025185 for ; Sun, 10 Jul 2022 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26AL0M1Q025184 for fs@FreeBSD.org; Sun, 10 Jul 2022 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202207102100.26AL0M1Q025184@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 10 Jul 2022 21:00:22 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16574868220.A7A7d837E.24073" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657486822; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=l8ebWlCo3m5ecBv5KciJ8IWBtyFMS//LtXZBixOYkJc=; b=rH4+5EvM6a0D++UKW+KuCRiygnrS9KlssD+DpDrJoiWFjWY4+TZyRSuLvdXPwO3YojzRDO /J0sTPZAnB6HqVa8t5Da/iJJYlsshOKu7qHWPHi1C/iFrjsx4jWD6PhAuKC/6tj/dJJy+N 9ocu/X1uWrHDDWPFvZexj8Rm6baa9K6Uh3CTC+ymH4T5rjZ6HndemN8AWyJyn5BaZfn2Eq NHgsKljenpPPlksgXhiqrwc4FvEaxCu3W5BJCVZ75IKDLwYX67EpKsv6r5PmVEm9x48t3u mTfaAYkDUbpkva1AvX+x0bKF6Zn3sSz3mKLuFLFetzimHL5cQTF893ZE7j+uQw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657486822; a=rsa-sha256; cv=none; b=EJqac/sIqYgZ+QBwGzXdofVfDIaeaIk+vG28307JwANSgPt3ZNq4ATw0hHEIgIZ0Xf6I/X +F/urMLhPjKMHccWvdSxKSvjAEPoiejGgwtWhJbxRXPSRs8CnLhPGldFW9gz1YvHo+0VaM t8ovVbhbwy2vzHXbiQlngkK75Vj450W4l2WwVjQO0AVRCtXyS8jj04nlYARAFj5M8BVZBP eA5xiiepYvwhn0wyuCCf5np9cgBUT73xJx9+J2H4DCIBK1W4bUGSEYeIjDV8lJ2Zry+ARQ 6BqvY4uIo8/8vxXs4Mf/UdmA8Ne9KbiYMpr3OE4F4WEry30dqbd7yF998uYwRQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16574868220.A7A7d837E.24073 Date: Sun, 10 Jul 2022 21:00:22 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16574868220.A7A7d837E.24073 Date: Sun, 10 Jul 2022 21:00:22 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16574868220.A7A7d837E.24073-- From nobody Tue Jul 12 05:49:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4755617FFE36 for ; Tue, 12 Jul 2022 05:49:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LhqZ80dYRz3x3d for ; Tue, 12 Jul 2022 05:49:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LhqZ76qSBzXSg for ; Tue, 12 Jul 2022 05:49:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26C5n3i2090386 for ; Tue, 12 Jul 2022 05:49:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26C5n3w3090385 for fs@FreeBSD.org; Tue, 12 Jul 2022 05:49:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265148] smbfs: fix potential memory leak in smbfs_node_alloc() Date: Tue, 12 Jul 2022 05:49:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657604944; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ThdVphes78lx+juHrYooC688YGhxAzPD/cgWiLI3hmg=; b=Vk/mxNsBEaCeeCJfiFXYQi35S+B1RNToG5kPeukZ/DTuT/Az81Gnr8MfvsxItr8vjdFDfU oqlYP+hE/rrK4+3yd62rCDBT5f68YKAa5P7qtJXs+4v7WNtgJUE0Thar55aMnq7u8Bsk0/ cxv05r0Edp7s5ZQ7PNPPYOrRC5rjtHlWxrAC70v86GElN0dQGvnMNQ4o/NGr1Us0Apk0l7 E87oxfKS8jb8MGAkJOh0g+s0OjxawxVVmhmWFGrPCi21uNmDWT8wzA17tup4ghF/V9RAjZ neOOCUVTbA4wG6OtxbQoAN4OLwVf7oCBmZWXnOl1EtRIzjPsABnyt8X+GjoyxQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657604944; a=rsa-sha256; cv=none; b=ll4ya00MDiKad8k3kTaP18aK8v7Wx1LtOzc7kiRMjto37GMl/3FeAiNfqwezADx6wNiY2C dQxMWAp4QJku6a+BPBvirnz8gS/EaS5IiWdvEpinaZouyHZERYv2KHmT5JvRcGYcNLmtV0 lZQz5f1hbetrn9RDNOqPP5xDg5MQNzG+i2nogrLXngGdm7vTCAjXg/h9CmzerXCYY8suTb hWyccoA2oUfiWiXiXIgmlvxJzYtWMypnjYzZAPXyo2NHL9yvrOkOBbs/u2RrqmLXGiIvw7 hR0QFPVxifiFceUahArOwoyip5No8ZWuVS7mnSmrXQdHQ5tQzHzGwO7x6hyizA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265148 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jul 12 05:49:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 234BD1CF8D0B for ; Tue, 12 Jul 2022 05:49:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lhqb56bVcz3y5P for ; Tue, 12 Jul 2022 05:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lhqb55jb6zY2R for ; Tue, 12 Jul 2022 05:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26C5nruI090599 for ; Tue, 12 Jul 2022 05:49:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26C5nrxj090598 for fs@FreeBSD.org; Tue, 12 Jul 2022 05:49:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Tue, 12 Jul 2022 05:49:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657604993; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=u9grYD+NVxEcsGqP3XHzCHN/8yahThV2tf6UaiOddkQ=; b=f6Yc5IyH8drvZfXOpUC/E/34Cu1HW04L1y6mw8rD+c+F48U8Coip9sgfP2PYPsYFrdiiCh 1gwMVL4Y/JH62Nx5xhie3+sHLDTEqKeGwFIPPonmhbQ3bE18BSf4GK1wWxb3mpcf9YwwQ1 aZnYp5MfQRjKmf4PXusQ2DYvAKpMYtmF+1DfYFQKDx9/oAnYjr9fpAqY1Qlj/V1b+AYZua MJHSLCs/shWjkvJbvDTZFx7AIQv42Or/TX2vmKVFA5Y4L69YTKhluhejK8e/A32aYsAyjb pw1vZn3odcXmBjSezg0kg9PxDOI7JhzANsYhGcG+grO4To7PgKZpveVLsKw2AQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657604993; a=rsa-sha256; cv=none; b=IGb1LDk90W9uJyJkWbCFyNrsIkgwcdDmODyfSfFdkj/t8H1WMhCOjlfs2kJewLl+Gmg8mK iDT+6b6YlS0eaU0IkTz12/9JbKbUvXSJ2oNUNxtv9dD81TaiLjaRg9HGTQ5F0NIW0SkbJg XJpa/p41gs8jfK7yMcxeJvIWIDP5qMf4fHcpqxVkPRfiuBC9w4txBqZSxH7YkERq6KNR3S v/JN3z3lMPiEvWroXhLBq3GlrUtJHbfzS4sjnnyFEFwI4FCvJ7TOF/gj+ZmQGwOsu7JUOX w3U/2BBCkzCEczvmUqF1BYbTNRg3r+tj/howqMgHK4BhcJMhKEl1pEtP53gs7w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jul 12 12:45:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AB05E17FD080 for ; Tue, 12 Jul 2022 12:45:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lj0pW2lFvz3sB1 for ; Tue, 12 Jul 2022 12:45:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lj0pW1pTczkhM for ; Tue, 12 Jul 2022 12:45:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26CCjNhf023910 for ; Tue, 12 Jul 2022 12:45:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26CCjNNX023909 for fs@FreeBSD.org; Tue, 12 Jul 2022 12:45:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265148] smbfs: fix potential memory leak in smbfs_node_alloc() Date: Tue, 12 Jul 2022 12:45:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657629923; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aEldZK4n7gXhoI6XhZBClNQ7ndkdjPrvzMNW6tKPz74=; b=GECiit23P3PixlRkU8jlYOkI16M1vPPuP87F+CWDpzHc25L5P/C3QsXIi4vGuSW/G/BVPl fvp7Nju3N6lHHsUkgaEf8p9TLxPLdzkrknYnvcOz8FOuybJY50DF2L9YDrqKckGieJ0VVp cvCkVkInjvzjCJAhOv6AwSgT/MAzBVuIlNPMIXkov2Bgaxv8NA+p4m3J0OK06pahnqBttJ XYZwpVnQ5qBb4ePb4yTKScBAR2FnTKQoJGP8iDCf0Y/AMC9A3MtuIzrz0q7dTqayWS6e6B PoShDFH53x1xSssxtwLLQSRvZAd1Rt0foOZlvs+OPDHNeokqul8XZkve5S07vg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657629923; a=rsa-sha256; cv=none; b=uzExz3yDqI+rmgY+LWspXRyqNZXItT8Y6l+MjZMpelAq5ewiU/Ihk7V67szuRVtsspgyV0 GjzsK6niTQdAeJoooFE6S2Wt4akrUph5vPR2UZiv8ywltUqoUO/y5A2ptBQStUN7yWMT25 3AeljWUce+c4KJ579/U4cYo11uMl1fDbwWO9n0esK9ig/VkrrkGBn65rGm+ncjOueGNGxM /usIrPAHblBpMGjoQLehrUlBGW9M5vIB5MJq3cRJA+Jr0MBuvB2xaLeoTdvDg4H43NEDDv koTIuKkDwZVf0qXBZp4wgFPKKROXat2autTAYBWRVg6bRYiVV7ALnH5zlb37vA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265148 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |markj@FreeBSD.org Resolution|--- |Not A Bug Status|New |Closed --- Comment #2 from Mark Johnston --- When insmntque() or vfs_hash_insert() fail, they call vgone(), which invokes VOP_RECLAIM, and smbfs_reclaim() frees these two buffers. So I believe the patch in fact introduces a double free. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 06:56:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AC73D1D0BCC7 for ; Wed, 13 Jul 2022 06:56:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjT1D1NVnz4Q3v for ; Wed, 13 Jul 2022 06:56:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LjT1D0M0yzFD9 for ; Wed, 13 Jul 2022 06:56:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26D6uFj1000946 for ; Wed, 13 Jul 2022 06:56:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26D6uFp0000945 for fs@FreeBSD.org; Wed, 13 Jul 2022 06:56:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Wed, 13 Jul 2022 06:56:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pho@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657695376; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lzmB0WD3Si3pNAG4kzpCDTa/QA/+SWi75PlUY7Gd4dM=; b=hD+xPnoqAgTY4Y9WnokOBCE1ep4b0yaCqZ43orU42H9+0E+T0DFjFOFdnTazC7KJ/OaZGn lC5WY0NuaoYRFxTeaMmQXnKwg8zmiWnjXzM21TSWtthnSugWGI+aXoUz8iEW4yeZJpQ6MK WWfV0V45dK6T9NXRjLZvIYhwn+47JGiKNNVS7E0v3sQUZikY3F9fTa2Y4uJCjMFsYVNjey r4NePaOB35iikbK0m/RTUkHyw7EuWfTTlyZ4K1YHWrFc7m4HVEk0lyuPff4mTuPD91Q30E 56Mb5f67XMWH0gtncnSPctm7aswMZ97Zi8E3DoQ3xEHXfMZhoBej1tZx3eGWmA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657695376; a=rsa-sha256; cv=none; b=pOs6IIeg0jOuQWlIAcIWPrDMCZSvGSeVBn+ag6dVxGiV6DK1k+xEABF/3JFv7Y32Cffx+N X0n+LhSJtVO1zMkRgl6u1uDpN38H8sH5co0aQIkbMGqnu/YbJm+wEGS00lV/wBUOphSDhR A/A+cNWPkuHHap76uEnY1n+46da07nS8d+kK8Co9Y/M9LiWkFV/9zV4mcwDQcthr7BDJ0U CjyLj5rN1F994louAh+oN0SB6jW0T+NdupfV2t4SflJ5bcKcexuO84DVlp4mfJ767bfzo7 WLdg9YvaQGe+7ee/LAZRdaQoxv3UBCJs8K4sgxojDUcH3EfgnFAxmYE56CN2/A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 Peter Holm changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 08:33:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 54D8D17FA1A8 for ; Wed, 13 Jul 2022 08:33:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjW8x1MzMz3QYn for ; Wed, 13 Jul 2022 08:33:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LjW8x0R1YzH8n for ; Wed, 13 Jul 2022 08:33:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26D8X5Ie055391 for ; Wed, 13 Jul 2022 08:33:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26D8X57t055390 for fs@FreeBSD.org; Wed, 13 Jul 2022 08:33:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Wed, 13 Jul 2022 08:33:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: salvadore@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657701185; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kHmfxQBwgQUjJ1pDIxP/QSc5jo9EroMuXHFFqngAs4w=; b=vrsi+MbklfrGUvK07txiPkvPrbH1gPsfS+xaipecxD2UGypgVmEHCbAV8WN3gsAMh2pnd+ TeYKOkTG9BWHD7JFduOsv01lQSpBbY8jhpJ6YollzmBO6WI5uKdKEZ3Zrh5WJ1wh9ExZNV W9g9+g+miD2lQ9vx9QpR5UrRX5x6khD7f+IvZX18dcBUKzXGTm469HUlxdxjAenHY9CdNp teVekD4dKJM4Mg9VH23mAkYak4tjfbH6mUBkveQBwQftM4c5Hmpow2lwwtiJqJbVIiBKxD jv3EQyRCqIBOI9cvf+SF/ba4cYG8bReYjR+ALxL3RRrhY9t1K/olpaWn0Qe8hg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657701185; a=rsa-sha256; cv=none; b=AWBb1r6LYPNruqdWIejg/MUYr8TcV5MLGes4q8nvpX8/RSzv6seegmtjvOC2w7jIl1j+d4 p0UmtnbJZXrewyI6FebUKC0l6hCW/4FvYgz876yV3nQ7E0X9yvm0jNNdksUH6Jtfbu5wCB 8WKBykSMRVfH7Tl/gqQovGQee1MomCW7OtoRlN+OyFgDZnS8DA7q4iSHdrmB70dSyx2sQm QQ//ipCPtIZEglABaETUshoHQkP4sexIlCBI4rt1PFEKn5RhcurmyVG9kvh4UOjGCGyI6g Y8Wk3IDX4Lzhzm8dRH3sq+f5CbS685G03+I99CyEEoiQ4E/a8eQ9T/Gjf3tamA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 Lorenzo Salvadore changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |salvadore@freebsd.org Status|New |Open --- Comment #1 from Lorenzo Salvadore --- Looking at our last quarterly report, I think McKusick is probably the best suited developer to deal with gunion, so I add him to CC. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 08:34:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DB5C117FA911 for ; Wed, 13 Jul 2022 08:34:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjWBC5KG8z3RGc for ; Wed, 13 Jul 2022 08:34:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LjWBC4P9GzHHs for ; Wed, 13 Jul 2022 08:34:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26D8YBAP055589 for ; Wed, 13 Jul 2022 08:34:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26D8YBWd055588 for fs@FreeBSD.org; Wed, 13 Jul 2022 08:34:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Wed, 13 Jul 2022 08:34:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: salvadore@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657701251; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=g4LFpa+BX2bfpBOvPnZsbOu9almITwe+zC7kk5gssuM=; b=O1O6rFlsdbkUh2sefwHew8PdQ5N7nJvj/j6mp896MWoMKGJYvr6BR6FCXzdJg67gIt33TL cElzKiNBFm4geLdfma9Lng4mRjw24udXzlJrfD9dSfdbHy4FbKCfkDuCln58iMT81FpfwD Wx9MFfXJ3un2RwEneKRTaufaAE4A2q3CGscL5o7okmlHk/MdPdWAoB1s3UzKhJDbu3JaT0 x6w+jH68/tNaIHr06xqT8Zt9Q17vAbs7A/xpm/Z6QR+JjQUzndzMCRu1IcMRsCwoK0LoyS IuSb8YqcvIMbDoaw94rjcMQi1uBEj+lQz5SnGb+aOSxStjuQoRj110lgVzVOlA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657701251; a=rsa-sha256; cv=none; b=JtyNvAnWfui3c0yyVQ+9muyQAsoxj1z9B9PbF4qGo91cDXqnZWOhOwiVF3hE8uWrIrAPDO Oq3U3q2BvXA2o0wVdla1sqgddbeThas8RdJRJMzRMYI2hQYv5MDN8//0bsaQ8iccDXRw1h ex50k7KLDX6eEg597aqR0cT4sNWpBxbxhPVbc8a0BAJBH9vdcy75OuYZ3i6QkKqCIOFA+t XtvJ9US9BIIY/y5I5AN2qmNp20SXtdn6F8rrsVKYFfdC+OcO8Ir3yilEI3M7O7ircPtZkn aJ8QB+pkQwbQ3s/GShXNN+Cmy5cHb9EOfsZwBOLQeIssTN4mUoeh6ZnnEp8w3g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 --- Comment #2 from Lorenzo Salvadore --- Oh, sorry, I had not noticed that he had already been added. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 08:49:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6B01217FD5E5 for ; Wed, 13 Jul 2022 08:49:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjWWg24njz3TGs for ; Wed, 13 Jul 2022 08:49:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LjWWg19R9zHFf for ; Wed, 13 Jul 2022 08:49:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26D8nJJO060808 for ; Wed, 13 Jul 2022 08:49:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26D8nJXb060807 for fs@FreeBSD.org; Wed, 13 Jul 2022 08:49:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Wed, 13 Jul 2022 08:49:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657702159; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LCWci7qVV5IUTh0JlPMvAVb+Qkm6HEE0hUBgT7/Ekiw=; b=aoOOgy5aCjeIdyYlde0OekR1CcH90HrHpDfhgIPCJ9Q4RW8mBSLKrffVxaKXmRwTxbSJyK F37u4Bz8h5Lr7gMwIeomoVmW0JYWBhFPJb4VuG1HunHq9uSYdr29Fnl2GbIubCvqwFmZXo wG+p3O5iymMgpO52D9uoyHj0nrdcIbm/pYqnd/sTR5vBVbgAkzHBUcx6nUDwDgmzmjb71L P9EVuSUnBCN2jow7z2mt08nl290fYYl8kzhUQCJKVktLqnsSpKU5ubxvwkf7ZVMErqigeL StKRJ42oTaMygByQgLlqj0rMVKzBMP/0bNGsczBfm69WWN+KSCqfnr38G2uM8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657702159; a=rsa-sha256; cv=none; b=o9uI0CU+w8HqPaBd8vLBs+6H3KeEnD7vuyUStVyMOYWEoQpJ8kSOd3RJbeLa3QeXC6Y/SK KVA5L7rmboWqURhbfE9mdaKD4icgXfU8f3VvQDldZW3dALgtMe1svAPTV8nM44oH7uYp7T EXxEiumqUFhziiCTuK580r5kcORD4gyfKYZeR86yp/yj0whMLws7UPUNkFQaOrncp3kUK0 FgS5gYin+oNuW3ASo0ow857ju3xgGtLPo0DCXT652/tB07UGGsDIEPLJmZ50bvB21EZtQM QtdnbN87HQrbmIyOrQomgV2B0iKRL4xjIk1Z8RFJ5NlgOhRD3RHNq2lZyyJrCQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 --- Comment #17 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D0aa68d5fbedbd191bd00f07f3ce9dd5ec= 4679ff6 commit 0aa68d5fbedbd191bd00f07f3ce9dd5ec4679ff6 Author: Konstantin Belousov AuthorDate: 2022-06-22 13:54:01 +0000 Commit: Konstantin Belousov CommitDate: 2022-07-13 08:38:01 +0000 UFS rename: make it reliable when using SU and reaching nlink limit PR: 165392 (cherry picked from commit bc6d0d72f4f4e96b24d0ad558b271cb6f483801e) sys/ufs/ufs/ufs_vnops.c | 95 +++++++++++++++++++++++++++++++++++++++++++--= ---- 1 file changed, 84 insertions(+), 11 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 09:24:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8D8981CFA6A0 for ; Wed, 13 Jul 2022 09:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjXJn34LXz3XPf for ; Wed, 13 Jul 2022 09:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LjXJn1vYFzJ60 for ; Wed, 13 Jul 2022 09:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26D9OvUm081622 for ; Wed, 13 Jul 2022 09:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26D9Ov7v081621 for fs@FreeBSD.org; Wed, 13 Jul 2022 09:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 165392] [ufs] [patch] Multiple mkdir/rmdir fails with errno 31 Date: Wed, 13 Jul 2022 09:24:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657704297; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ztExLZnplmhb+poxsSLJ6oLDz/PKUrjCmaBXzxABNvg=; b=RE95Y5eHJOI2AER0h7F6NfHorlQFYwqnFJn74OTEM8ndnrgOgfuD4/Ib2gyxeg9L7gwfBB uv/0x/wuuXfp9Fk+tRuewmiYskw+OYHvSmDgm/68yHa5rbASsoTNxFwSMPErIExPcHbQJf 30rEboJV8S3VUrJ+My+70Z7EG+QsY+3Pe1NqV11clBmPqCNboS+hlyN8IVPOlHtvEtmDAA 6zPoGiq0v+FA4fYy7oQwbreU8Wf0C45kD1lmAcKClf8TqBvFRi/+te+Lq4lW7L7KvnKiaZ 1zv821KMOEOO5+C1da/RlIANK8BftTY6sX/w11Ld0tzJsODXii3irqo2yL422g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657704297; a=rsa-sha256; cv=none; b=LR2dhpsqExOFfqrhdnxGBPeOdkCSWkMxJYwCnqVE0xDLUI+ha/qYdjdIqdJQz5qdEfSHro 9JJ7f9ln6hggz2h5cf/WP0RJWqcPe2r3zYubNO/CXXc/H6b24OviAgFuHxWGyRC1IpAQYY +S48yBsEVeNVHzMW++LvBwjkfK8P/YeD/6MfiZuTm6zVMM2hQrL6yrBLHP0oGTUYRCeqBF Ypv1CXI9nUYiMB3eqKVrwSNSwmTdoVHQeumc045JNsL0ML84KQYSXC5ouA2cUw31DG//nQ GxtC4nGfGMBpdJy0nQcBHXODdfXRrD+2kP0t5IW2qhOyL3SeJ06Ney3qr7ig+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165392 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 13 23:44:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 395AC1D0B01D for ; Wed, 13 Jul 2022 23:44:52 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on2060.outbound.protection.outlook.com [40.107.66.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LjvNy51l7z3by4; Wed, 13 Jul 2022 23:44:50 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cKWjsPcVAmYSOtNBS3bSw7efG9OC+wQM8JPecxc3Fi3QTlIZREDNoQsADTYwNHDsrofh7oztq1depdPpyFyY5DaOrNNFIXg10Kd0YFCi+FwckStpxGnlF6UbsePaMQTiOwUsxR15Rdu04QESiQAFyjsbv18HUu7GOrWhVtZ+zEf5QJTv3tYuuXg0NiAb4Hf2RwUtLiCzmX2BHeHsWIl5O37xM4LH1QWldBunVlVfYVh6rBrsu7BbCJmvz60xrUqS2peBTmiB/tw4J4xuB4PJREqRcxi4CetqSP7aEsfWSg73+06FQeRAPR7PEbJsNlR9Ro5V1aRP4vHMcnWyfhp14A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=dvcXK4eMPJ21XxRynl9Gi9gIu5xxcl8OYdCoLEfqvqU=; b=Fwq4PFiShdHZA3P/WH0vtfDr9TDQEBxwzxW6NzztHt8xW8/YgMBo71Z3FVoOP568dxXh1tk2yPWZsbPvpW7bws34ZmhEtXjn0j4cRQbQQW/ODuvXOsHd4Zx3TiBvRwUVHbkWvVkYvJJdZ+WceTv4QIypE152nIMpfRtMPLf8wiAibkvoPNVmlIlLy6fxdkRmbfvllX8xZwkDfVTK2rtXbNlNKGmXAT933S/gEsRM0OQ6MjhdWGhXBTVKKXM4J5a50rY8a6VjSCkTE5EVsPvbt+3VLHsC4NHUGyRVVndAhRgr1pfGvY9zCv/A2kauvDDNweWQaZbLdWDvUqG3F+P40w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dvcXK4eMPJ21XxRynl9Gi9gIu5xxcl8OYdCoLEfqvqU=; b=UPk+PlppIGq5P404g9tPXf0e+UxAKvIaaVW1vmtPkrLp1Bh6O+vciPD630Gf0wnMJuHIZrmkaNnHCY54v9Hsb4Ft6VRjLw5B58oDy0D/yf7/2VbJYcZiXniHTa/vVtunix6EXssvboZkz9TvfO3TBiQ74BN+XbbdqVlRw3DPhY34OA6QXxdgykxq3KzG5iumqbKnXW0SSGsoqfnJqWRd6uO8485VyineBu0jgMVldOFlhOAgnJTsVkS1fjQQAlDhnAorWNkNPggwSibl9en9hnYxgXynhrKKq/HFINeQkUjeuDENxCg0tzm+5LW5mzE3ZQY6T594hLRV5G5w/JHKxg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YT3PR01MB9474.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:a3::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5417.20; Wed, 13 Jul 2022 23:44:48 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::51a6:243b:f3db:61fe]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::51a6:243b:f3db:61fe%7]) with mapi id 15.20.5438.013; Wed, 13 Jul 2022 23:44:48 +0000 From: Rick Macklem To: Kirk McKusick CC: FreeBSD Filesystems , Ed Maste , Gleb Smirnoff Subject: Re: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Topic: RFC: Should intr/soft NFSv4 mounts be disabled? Thread-Index: AQHYjZRBjJW/UbMaU0uxP2BOexC+Da1s1aaAgAA2UJ+AD/tMDg== Date: Wed, 13 Jul 2022 23:44:48 +0000 Message-ID: References: <202207031617.263GHZpZ000763@chez.mckusick.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: dca3c330-444e-714c-6ce8-4db00fc5afc8 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 077cd4f2-1c7d-419b-d9d2-08da6529ac81 x-ms-traffictypediagnostic: YT3PR01MB9474:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: VFc3smWY7s+nfL01/XYB0n1Ich5THlfw95FFLuAaw+tglm8i1+6NlPi+aCONM7EcOzx7O+s0nHr/YyxWPTus4bMmt0nzn6pILWwX0qWN89JaHauh571VX2ttzzOURsriNHWJc0tLWKbdmyTr/vWQ1E9wP3EOukJH4dDxAVYikfDs2XtnmprCTpMWYz+efJr/Gr7Cli9bcLcokBmmbBOKJTHDtMCl2B0WDC7Q65MVt3j7OdF8iaaKmAJpiYn9lKApipJf24P4d5OpRD04Mr7RcoyRjeL1fhCCDjiO08yGmI1bKfv14BYj7tP+tp8R8JLvKEq5ALaZ8alay19QhW5FG05+gbg7/MBw2BaKhjq7zRp/0EOtNSgi4JGpJfHLzN/expVeOG0j9r2ISY1BYgppcwX9Ew1i+tJRmCKjTWvglPgU9zS+uuCqiVMwHvfeDWBZinEylFdZYuC8M/XGQ6aI20Kpxwv5mZ75t71MpdlfTt40Fz5oqigRxRxikGBk/L+dvh4zK3uzgRtrKmkdKoXWnovBreS7304LnBCF9SwPofKFTsAW8avOO91JXnp0C/GqqCZbS6gcAIT7Aj5hTTcbp6L3TuCLl5vsZ/US9vF9P/9AdRi9VYrTALK/qvGTvzJyV5a9aSfF54cXGMCekhGwLtmnm2VpojtsJbAyOw+LwWENs3M2KwY31jrON5VD0GzD/fOp3WzoHK9Za0kh3s5tnTyHD/ae3SWkSO3mK+1R4VEGwg02UPQ+L6R9x6LHqUE2O+s/p9pV9N604Y4Bgk/2gi2kDKvHOEQLf+A+Q1g54b6OdAIp0ZMotVA5P7MxVOmOGl2+3rYyN/XzGSXu6zbdF1XXTd1IO8nwXRMiyhq7AQA= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(396003)(376002)(136003)(346002)(39860400002)(366004)(186003)(38100700002)(8936002)(38070700005)(66476007)(122000001)(786003)(83380400001)(5660300002)(86362001)(41320700001)(478600001)(55016003)(71200400001)(966005)(53546011)(9686003)(316002)(76116006)(66556008)(6506007)(66446008)(66946007)(33656002)(52536014)(7696005)(2906002)(54906003)(8676002)(64756008)(41300700001)(6916009)(4326008)(91956017);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?aEdaxW3CbtK6hHWdQLO9FbVTLl/uUDAB1wf+br4A38uc0wO1jW4rwMThihFc?= =?us-ascii?Q?XdjhZRJ2zV4kSRDn9PVytbPqyurYh4NCzHd5SZgSPmCGspHN1PxQl7VLySsM?= =?us-ascii?Q?c8BFdegpUzYL9Di2rYt0ige1JpWJEHxhHM1njCmV3sS2kq7PQIMqGthTgsnl?= =?us-ascii?Q?pftH/pLDHJr994goBHXVEx2/TKlUqe9biiFn0ag2JyPs9+M6y4zSgEzEoB9q?= =?us-ascii?Q?4ssYlwl/59HbUZcQR5MzD2vuaJhS5cRPrCq0ZGH3n3tnongw+BoHaebm8Xpz?= =?us-ascii?Q?8OFkb5VFR/+YL7UM2KhK6Atc/jyudcpiGu6xI5+Ib/8gInmsYvxShQzhrYAw?= =?us-ascii?Q?PEhPP5pol8bpQcKWDLwAy35+mO/F0V6StMrPskDVyjqXth+7HLd/2EL1KOlr?= =?us-ascii?Q?ZYXJv3S00LCqV/uzOEdULJCeneWgpPu79n1z5cuizfT4toLfJV9Bo7j9JbBH?= =?us-ascii?Q?QH1QjOa5RMtoXX0xXOFZc+qaLj/9pO1tGYVjEwSWwSxvqhTkWh42LAoWNoTz?= =?us-ascii?Q?CY1BkhBX0Gcd7Md9Cq6q3BD2xZS8JwnPizZYsVbRvSxyRBOvNBKIYPj/oe0Z?= =?us-ascii?Q?Qz/1e3Fa8RwM9Gh8K5ef0wvteQNsq0bJ2u3m722cxqhK56esgWpXzci/xs88?= =?us-ascii?Q?cleNDpSOA6mL2qhjIm1yDGgQ1oXcZI7QJ5uufgU52Gdcfc5FyIUjhfrO3ygz?= =?us-ascii?Q?6WzlHt8aZKPaMjdkQSMSY1SP8Kd1mS68r3FJFjdrzHHpYJ1yn8JA9T6yBOYL?= =?us-ascii?Q?oMb9Fqb1DKmo1vtaSqo12+DJJZiChv9HCh14QQgcko1a2lUekpKUZ4HTlw0u?= =?us-ascii?Q?5A7/1RRoLfQ8jo82SEmQ1TYpcjBTgXJxi4J77MiQNDZ8ifgTYrF1cBy0fUIN?= =?us-ascii?Q?+A7i/R4wkq3g2rwl3iLgiGMDIN0eX2LB/pswUsYNpMoaGy3aw1ZO0mrccKvO?= =?us-ascii?Q?j6INIMMy44Ix7rgrxsgZkuM7VSDaQtbPUzrtAxLwKq3Z2SRmvds66YKN0sfE?= =?us-ascii?Q?n5R3ES31xUh6pyLtB2rZ/xsTlTcRai6PvIPOl7Rs/7TrFoSxVBnfNZzdJRo8?= =?us-ascii?Q?sS5USgsvSKi/8jHHcsEVmqMo72kXs5fwMqDmjD7BPGSYkpBF/cXykFExg4QB?= =?us-ascii?Q?k9cog4Ah0xOsTczmNjaWSb/TK8/UWuwiwwvGBRyOlSlAj4T/XcxPgjDDMw2H?= =?us-ascii?Q?jSB6rO92JHu7b1n0o813BDAcU8MP6D/c6rsn2yMUdW1sryz49dJ41uZgIjuW?= =?us-ascii?Q?jayrmLOcka3rMSeOrIU7/WTXbBjjlN06+sDMcEVf2tTA16ybYCsqPDVA9GNN?= =?us-ascii?Q?NlWJhT3NR+gRLCX/v8i6FoSkoRKAoEjwwubA+BwcEVVyTe/iFwOWfYpmrh8C?= =?us-ascii?Q?rPamMhdqLxT3kadt04D2+C0HupnppAkxciRqUFd7tCgpBy1mhE7jxE5ul0By?= =?us-ascii?Q?gHaaOvs7b4590Iv/BMArerxlCDhj9SZKKNXb30npE5TXxiG/KgQC4VpcLHqm?= =?us-ascii?Q?XcSG28+7vsQN4jXMSZW99mtcyOY4WT91AKSRyfI21Pm/gtag0puXcONP6eRu?= =?us-ascii?Q?BScd93MRB/M7QsrO2VTgwHZJwcDae3RL+C2AzYrystX5mgioQovwsuZezPt6?= =?us-ascii?Q?5a1HjTIP4fUnOceQ9iKgb5DYVPNv1ISpw+Ysznn455Ge?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 077cd4f2-1c7d-419b-d9d2-08da6529ac81 X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Jul 2022 23:44:48.8132 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: DctaylWDWZ9zRFQtN4PiJB+dSl9vRV+T070vsTX4wQYHKlPw7nK22tHIJiWO249iPDpphxEOSSbzlVoDuaU94Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB9474 X-Rspamd-Queue-Id: 4LjvNy51l7z3by4 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=UPk+Plpp; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.60 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.60:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_THREE(0.00)[4]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.60:from] X-ThisMailContainsUnwantedMimeParts: N In summary, it appears that most would like "intr" and/or "soft" mounts to be allowed. Recent commits to main (which will be MFC'd to stable/13) improve the situation for NFSv4.1/4.2 mounts by fixing the situation where all session slots are potentially bad, causing the mount to hang. A lock can still end up in a non-determinate state, but at least for "intr" mounts, the process will likely have been terminated anyhow, minimizing the impact. Unfortunately, to fully benefit from the above client commits, a FreeBSD server needs the patch committed to main to-day as 088ba4356a11. Without this patch, an "intr" and/or "soft" mount will do a full recovery, including acquisition of a new ClientID when all slots are potentially bad. Acquisition of the new ClientID throws away all locks, but is still an improvement over a hung mount and will only occur after about 60 RPCs have been interrupted. I don't know of more that can be done w.r.t. "intr" and/or "soft NFSv4.1/4.2 mounts, but I will update the BUGS section of "man mount_nfs". Thanks for your input, rick ________________________________________ From: owner-freebsd-fs@freebsd.org on behalf= of Rick Macklem Sent: Sunday, July 3, 2022 3:46 PM To: Kirk McKusick Cc: FreeBSD Filesystems; Ed Maste; Gleb Smirnoff Subject: Re: RFC: Should intr/soft NFSv4 mounts be disabled? Kirk McKusick wrote: > > From: Rick Macklem > > To: FreeBSD Filesystems > > CC: Ed Maste , Gleb Smirnoff > > Subject: RFC: Should intr/soft NFSv4 mounts be disabled? > > Date: Fri, 1 Jul 2022 21:57:21 +0000 > > > > Hi, > > > > NFSv4 mounts using the "soft" and/or "intr" mount options > > have never functioned correctly. This is noted in the BUGS > > section of "man mount_nfs" and commit c0d14b0220ae > > added the generation of a warning message when such > > a mount is done. The breakage can occur when the server > > is slow/overloaded or network partitioned such that the RPC > > reply is not received for over 1 second, resulting in the RPC > > attempt to fail without the RPC reply being processed. > > > > Breakage of the protocol has become more frequent for > > NFSv4.1/4.2 mounts since, when a syscall returns before > > the RPC reply is processed, it leaves the session slot for the > > RPC non-usable. When all slots are non-usable, the mount > > is hung. > > > > During review of commit c0d14b0220ae, emaste@ asked if > > NFSv4 mounts using "soft" and/or "intr" should actually > > be disabled, so I am now asking others for their opinion > > on this? (Doing so will cause many extant mounts in fstab(5) > > to fail.) > > > > Thanks for any comments, rick > > I have always been of the opinion that "soft" mounts were useless > and would be happy to see them go. > > I find "intr" mounts to be preferable to "hard" in almost all > situations. Being in an editor or some other application and > being unable to ^C out of it when the server is not responding > is extremely annoying. I know that quite some effort went into > making NFS able to support "intr" and I think it would be worth > the effort to continue to make it a viable alternative. Well, I have a patch that is the last attachment in PR#260011, which keeps track of broken session slots and then does a Destroysession when they are all broken. This works ok, at least against a FreeBSD server (haven't been able to test in against other servers yet). --> I think this fixes the more common session case, so long as the Destroysession does the right thing for non-FreeBSD servers. --> If anyone can test this patch, please do so. (Unfortunately the patch looks different for main vs stable/13, so email if you need the one for main.) As for "intr" allowing a process to break out of an RPC, even with the above patch, it would break that open lock, but since the user no longer cares about the open working (the close might fail, but that is only a problem if the server does not do any cleanup and accumulates them) then I think this might be ok? > That said, it appears that Linux has deprecated "intr": > > https://access.redhat.com/solutions/157873 > > Though they do still allow NFS hung processes to be killed with > SIGKILL so if that option is available it will (painfully) be > possible to get out of hung processes. Yes, I think the Linux client folk have disabled "intr" for the same reason (it screws up sessions and they have not figured out how to deal with that). Since Linux defaults to NFSv4.1/4.2 mounts for any server that supports that, their users probably see the breakage more. rick Kirk McKusick From nobody Thu Jul 14 07:44:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lk62C2gjKz4TLK4 for ; Thu, 14 Jul 2022 07:44:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lk62C1SWhz3S2R for ; Thu, 14 Jul 2022 07:44:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lk62C0YHczvtW for ; Thu, 14 Jul 2022 07:44:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26E7iJKC087766 for ; Thu, 14 Jul 2022 07:44:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26E7iJoh087765 for fs@FreeBSD.org; Thu, 14 Jul 2022 07:44:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265209] fsck(8) seems to ignore a read error Date: Thu, 14 Jul 2022 07:44:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pho@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657784659; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NBPMw3Q005IaMXzh7ifYFCJz/fyOB3bTHT3jQrkwbG4=; b=HjNet61ysaXGuvEWGqIyzAvnmQUYqhI1uXOv2xLp0FsnYSWBuXXyAiGGPo23x4h8i+g0Uu jslMyuSHsgqvCTDvkSc+7R8J0WwVRfck+d3T1ECUHGfucdAFa0HzEyWE2760kC+zZ3FAdV +mHfOhxxyCys5L7OF1Ka6FSx2LeAFx8LBoWlnn0xRyo/aVk+1kmG9VBcwxbbuttq8PvG2E hOFB825SyQVWjXMHGTtI+VqqmaMhSAunnMYyogA5JfR8R/KyQH0V4+H+eoUnYcfi9Mp+7v pViU0TPQUdRmTCKJSgknW4yKxK/S+tbrO8xPhWNvDc9won4OojI8yQMN4j38Ow== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657784659; a=rsa-sha256; cv=none; b=ljyiUXSsN8lJ7gHnYtrh5EiRj3N2YEM/d32aIEC9HQAhQrvHoOOCSVzRqzdGOrC1pQPQBe hzGaZyr/eOhZc7ctA2l14OUtPzr/ss/Pm0W/1bpR8MKxgy+Jcl7gZEk7L24rrwflYQ71YC 7UH0/d0Yh7jK79KlbXHTZeb6Ry/x4KXL5iJk+qe2zSkY7riJu+Q0x5VrgVGoa0qDnTceS8 junHObwZMNdHroccCFoMUqSKKQRPa0B8+S4I2yaI3gUnLZO1hMNt2znr+GI7HTbDTTUpuF Obw3xFErx8Qbn66DizGCAR4wkC5ZZ3HSPTVHzjP/6eSsb0cvgfogYVBzX4oG7Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265209 Peter Holm changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 15 05:05:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LkfSY4jMLz4Wspr for ; Fri, 15 Jul 2022 05:05:33 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vulpes.vvelox.net (vulpes.vvelox.net [98.102.84.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4LkfSX4Vvwz3DmK for ; Fri, 15 Jul 2022 05:05:32 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vvelox.net (localhost [127.0.0.1]) (Authenticated sender: kitsune) by vulpes.vvelox.net (Postfix) with ESMTPA id 8DFF1F07B3 for ; Fri, 15 Jul 2022 00:05:17 -0500 (CDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Fri, 15 Jul 2022 00:05:17 -0500 From: "Zane C. B-H" To: fs@FreeBSD.org Subject: ZFS dataset stats Message-ID: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> X-Sender: v.velox@vvelox.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4LkfSX4Vvwz3DmK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of v.velox@vvelox.net designates 98.102.84.2 as permitted sender) smtp.mailfrom=v.velox@vvelox.net X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip4:98.102.84.2/32]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:10796, ipnet:98.102.80.0/20, country:US]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[vvelox.net]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N So was just looking and for some reason nread etc for the ZFS storage stats. Below is a example of a ZFS dataset being used by CBSD to store a raw disk image, one that is running currently, but for some reasonn the R/W stats don't seem actually update. kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: storage/debian10_test/dsk1.vhd Is there any way to get ZFS to actually keep these up to date for use cases like this? From nobody Fri Jul 15 12:59:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LkrzB5wGSz4Wbdf for ; Fri, 15 Jul 2022 12:59:18 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qk1-f176.google.com (mail-qk1-f176.google.com [209.85.222.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lkrz975W0z3qLh for ; Fri, 15 Jul 2022 12:59:17 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qk1-f176.google.com with SMTP id h6so662897qkl.12 for ; Fri, 15 Jul 2022 05:59:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nm8cLjEm8nMCDhpW/IK0qYvwr52Uka5cObYrZuEea3A=; b=n3f5VmGa08+fedXzH6TDHjpLzR5UGZk8i2SJgHNuAUcgScgIfETHJl7tkJFDcJliNh kWmisNeU9X1Pw4KUXa/7LNIoqYLlvih0Gwbo8fOYoTPZVEIdk5TRlL5nJeLm/lOxZ/Kf CHuFCuNor2Ff1EyqyNurI4QUb65MwS2NFdjKtkq4CbVNOpPWIq6nl9IwvCj8LeBQL0Rp xcz8yNFD1Uq41nESWiIPn+CBJkW0LFYyIjqGbe20es4ugITa6wGF5OQosr/5I46SGnJd MSDEJ0vVPGYQ+GRKYRjfEA9i8oAaSsbbupEccRlkE2l3dDs2dzCQKAVr36iqIXyljQyh nF/g== X-Gm-Message-State: AJIora8EEdvMOsaioNudBFUC+JPKZ/bUpB1L5KmnYnHM/cWx2270oWmd h28iI4pZleUdTc3N0eipt0dXWHKa9O1CzlYY2GLtn4T9 X-Google-Smtp-Source: AGRyM1teI/8HVPmCysZF4nb+o2KlUnonPYaQ3qwKhmrPpiN5A9Yo8nlqXlGp5BhtDFlJXm0WfpA+Dy4xPoSqhPeDMa8= X-Received: by 2002:a05:620a:102e:b0:6b5:c925:788d with SMTP id a14-20020a05620a102e00b006b5c925788dmr4023412qkk.517.1657889956916; Fri, 15 Jul 2022 05:59:16 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> In-Reply-To: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> From: Alan Somers Date: Fri, 15 Jul 2022 06:59:06 -0600 Message-ID: Subject: Re: ZFS dataset stats To: "Zane C. B-H" Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Lkrz975W0z3qLh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.222.176 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.987]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.176:from]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.176:from]; TO_DN_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N You didn't say how you were accessing that dataset, or what FreeBSD version you're using. The dataset stats to update as expected in response to normal user I/O, but not zfs send/recv. Maybe there is another path that bypasses them too. How are you accessing them? BTW, sysutils/ztop from ports displays real-time measurements based on these stats. -Alan On Thu, Jul 14, 2022 at 11:05 PM Zane C. B-H wrote: > > So was just looking and for some reason nread etc for the ZFS storage > stats. > > Below is a example of a ZFS dataset being used by CBSD to store a raw > disk image, > one that is running currently, but for some reasonn the R/W stats don't > seem actually update. > > kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 > kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 > kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 > kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 > kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: > storage/debian10_test/dsk1.vhd > > Is there any way to get ZFS to actually keep these up to date for use > cases > like this? > From nobody Fri Jul 15 13:14:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LksJx2QwTz4Wdvd for ; Fri, 15 Jul 2022 13:14:41 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LksJt6CTKz3shg for ; Fri, 15 Jul 2022 13:14:38 +0000 (UTC) (envelope-from olevole@olevole.ru) Received: by mail-ed1-x536.google.com with SMTP id fd6so6237034edb.5 for ; Fri, 15 Jul 2022 06:14:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=olevole-ru.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=6aJ5DhSAbZ8zSz/+V9qNyD31t9+OsUzVOIe2IallrJ4=; b=1Jkc4h3YC9dRQ8QConN8VvCUO4d4KdxXRzPaW5pt6zlIqQuvktVyF8D4dIDMZ4WHeA nCCZW2i+22Pso4XoH2V5wqYuzGtKg0iE0azG+3w6Ed9AmV9DLA7BBOrcJ6J4Y9gGawzG ZiUTQNGCiNrlflTcffABJkuVzOcLgrCUhoGHCZj9lAJw2MoRW+eF/nqUplLsM192tdVR cP60NYp6m1BxtDclv8/qT3YrWgkMGEjRoVVXgnS5rxI3FkZVkKd49q76s0bU9tXZkju3 coWsc/uY8jlZ1oidOXEzSqYSEmv018Rkxb5gFTeIL8s0dXjppcMFnHZgo0aMSC7zeRsP V/PA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=6aJ5DhSAbZ8zSz/+V9qNyD31t9+OsUzVOIe2IallrJ4=; b=276/sQp7ftAKZFCj64O6jqqMCVct4kDe6/4RRR5SS1Jc9q7JA1dqzJ6u+zhe/DNreh 9lmNMme6+Dcaw9HH+fMFVj7bK4cSWy/LWhjxHSEcZ0SsaBPpGNObtlKrk4ectvtV+FrQ CMBPM1ZUv2oLe24GvX9fq/mKl5oOsyN2tgaq5PHJ4xG94i/muu/S3Mbt1CBDIxu8E4Hm K94tMpmNXjkDg4I6onSdPQFkCLWLZIOXJOBe8pTqsmF8Yrx/zET0Lp0eng0+S9nW+sA9 G7duxeMiPadTq1wM+r0y/kpneR4E4Pn36tKrf8+SSdAmNBZNox+WpF3N+W4kEDBxHIOd iNXA== X-Gm-Message-State: AJIora+BZuL2I0bFDfvYgm+Kvt3ezwTaawHB77Lko4+oEpibE+8yap4Z VylxGUHCqKPd23to3DDK9Xae2C8RQo99oaypO6xbsLjnwZ3MyRJv94s= X-Google-Smtp-Source: AGRyM1s5fZLcTBgiq/5dxCZeFw40U5s5eGOEwjcqZHQRX+gsimQ88Ad7aFtfyJmLWG3CoExT+CwT4H/uexD2Wlb5fNo= X-Received: by 2002:a05:6402:26c8:b0:43a:c404:a553 with SMTP id x8-20020a05640226c800b0043ac404a553mr19094123edd.53.1657890877314; Fri, 15 Jul 2022 06:14:37 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> In-Reply-To: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> From: Oleg Ginzburg Date: Fri, 15 Jul 2022 16:14:26 +0300 Message-ID: Subject: Re: ZFS dataset stats To: "Zane C. B-H" Cc: fs@freebsd.org Content-Type: multipart/alternative; boundary="000000000000d1a65b05e3d7cc3c" X-Rspamd-Queue-Id: 4LksJt6CTKz3shg X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=olevole-ru.20210112.gappssmtp.com header.s=20210112 header.b=1Jkc4h3Y; dmarc=none; spf=none (mx1.freebsd.org: domain of olevole@olevole.ru has no SPF policy when checking 2a00:1450:4864:20::536) smtp.mailfrom=olevole@olevole.ru X-Spamd-Result: default: False [-3.29 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.987]; R_DKIM_ALLOW(-0.20)[olevole-ru.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[fs]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::536:from]; DKIM_TRACE(0.00)[olevole-ru.20210112.gappssmtp.com:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[olevole.ru]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000d1a65b05e3d7cc3c Content-Type: text/plain; charset="UTF-8" On Fri, Jul 15, 2022 at 8:05 AM Zane C. B-H wrote: > So was just looking and for some reason nread etc for the ZFS storage > stats. > > Below is a example of a ZFS dataset being used by CBSD to store a raw > disk image, > one that is running currently, but for some reasonn the R/W stats don't > seem actually update. > > kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 > kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 > kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 > kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 > kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: > storage/debian10_test/dsk1.vhd > > Is there any way to get ZFS to actually keep these up to date for use > cases > like this? > > Try to switch default ZFS volmode properties in CBSD from 'dev' to 'full' ( defaults: https://github.com/cbsd/cbsd/blob/develop/etc/defaults/zfs.conf ), e.g: cat > ~cbsd/etc/zfs.conf <


=
On Fri, Jul 15, 2022 at 8:05 AM Zane = C. B-H <v.velox@vvelox.net>= wrote:
So was j= ust looking and for some reason nread etc for the ZFS storage
stats.

Below is a example of a ZFS dataset being used by CBSD to store a raw
disk image,
one that is running currently, but for some reasonn the R/W stats don't=
seem actually update.

kstat.zfs.storage.dataset.objset-0x1d41.nread: 0
kstat.zfs.storage.dataset.objset-0x1d41.reads: 0
kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0
kstat.zfs.storage.dataset.objset-0x1d41.writes: 0
kstat.zfs.storage.dataset.objset-0x1d41.dataset_name:
storage/debian10_test/dsk1.vhd

Is there any way to get ZFS to actually keep these up to date for use
cases
like this?


Try to switch default ZFS volmode prop= erties in CBSD from 'dev' to 'full' ( defaults: https://gi= thub.com/cbsd/cbsd/blob/develop/etc/defaults/zfs.conf ), e.g:

cat > ~cbsd/etc/zfs.conf <<EOF
default_ci_zvol_volmode=3D&q= uot;geom"
default_vm_zvol_volmode=3D"geom"
volmode=3D&= quot;geom"
EOF

in this case= , new VMs will be created in a 'geom' mode:

# cbsd bcreate j= name=3Dvm1 vm_os_type=3Dlinux vm_os_profile=3DCentOS-7-x86_64 vm_ram=3D1g v= m_cpus=3D1 runasap=3D1 imgsize=3D10g

# zfs get volmode | grep dskjails/mybbuilder130/dsk1.vhd =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0volmode =C2=A0 default =C2=A0defau= lt
jails/pxe1/dsk1.vhd =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 volmode = =C2=A0 dev =C2=A0 =C2=A0 =C2=A0local
jails/ubvdi1/dsk1.vhd =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 volmode =C2=A0 default =C2=A0default
jails/vm1/dsk1= .vhd =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0volmode =C2=A0 full =C2= =A0 =C2=A0 local
jails/windows1/dsk1.vhd =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 volmo= de =C2=A0 default =C2=A0default

if you are using cloud/gold images, = you may have to delete and get them again
--000000000000d1a65b05e3d7cc3c-- From nobody Fri Jul 15 13:17:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LksMp5LSHz4Wdp1 for ; Fri, 15 Jul 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LksMp1s5Tz3tZt for ; Fri, 15 Jul 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LksMp0fQYzjcP for ; Fri, 15 Jul 2022 13:17:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26FDHAK5015339 for ; Fri, 15 Jul 2022 13:17:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26FDHA0B015338 for fs@FreeBSD.org; Fri, 15 Jul 2022 13:17:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265222] T480 zfs checksum mismatch error Date: Fri, 15 Jul 2022 13:17:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657891030; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XuFXV+ai79ehYhfuoHqMW5VBCFw+KLJ619ZrD77W2I4=; b=R/EbF1TOjW6C6y8CGQOLsmVWXs0BTC1gMtDlSUa/Z2Ag6r+xOzdlCYEVgkj4u3MM8JOA39 G0tDxrJLkYuZcILXhRTl5YQfvlvTXWSsGFYYD1hSSX2qugY3kBWDjHoJPSOm69cNDXnsAb OYaCQdgkFS7ZLvvWVLRHKs6WUdO0rGA6dPjQi9T8g0zXfVWxFf2Xxfj/8wrlw8AfWlGUXU 70tOKqucoFeM7iuJgB757U/fEXBIIIkJzWmguXnQSieZIDykCNNelwxSW504/XyyhueDZC 64apm8hrwY6SPgHngOm5415GXWT7DEp4eHn0n9SySY1CyHaDNc6stth3lTzTtg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657891030; a=rsa-sha256; cv=none; b=YLNfUngoINnnEVLtDLD5+ys/mhQqBYoGMspB8Px12uHBlvyC1e1scupZ7WDXFrNDP4B3dh VmpgS9Lj0iT53HdlqDPUXkvt7YJW/F+92/32osTGTrXAlbVhN4Al/erlPNFRLg3X6qv0Qz y2E70R4MC5N/ngfzABp8+bUiZz3ZTkCExil3x6lBTwWuFjnQDLFMFEKMbqfJs5H/8EQi5/ 4B1LJ0NTMcLyEleUZjCb9QoS8wAv+0fYVqTowykE8ISKBsmXeeZ5xqJwnNLWc+F9+FkOf4 B2nAy5QMnTeT6RGMl6x1xWwnc2OcaQLS+/k9l0UqFi0Rq50/jbAfyMrHbvtfmA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265222 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 15 15:49:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LkwlR30Jzz4WwYZ for ; Fri, 15 Jul 2022 15:49:23 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vulpes.vvelox.net (vulpes.vvelox.net [98.102.84.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4LkwlQ1HhHz49fv; Fri, 15 Jul 2022 15:49:22 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vvelox.net (localhost [127.0.0.1]) (Authenticated sender: kitsune) by vulpes.vvelox.net (Postfix) with ESMTPA id D93AAF07B3; Fri, 15 Jul 2022 10:49:10 -0500 (CDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Fri, 15 Jul 2022 10:49:10 -0500 From: "Zane C. B-H" To: Alan Somers Cc: freebsd-fs Subject: Re: ZFS dataset stats In-Reply-To: References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> Message-ID: X-Sender: v.velox@vvelox.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4LkwlQ1HhHz49fv X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of v.velox@vvelox.net designates 98.102.84.2 as permitted sender) smtp.mailfrom=v.velox@vvelox.net X-Spamd-Result: default: False [-3.19 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.99)[-0.994]; R_SPF_ALLOW(-0.20)[+ip4:98.102.84.2/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:10796, ipnet:98.102.80.0/20, country:US]; MLMMJ_DEST(0.00)[fs]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[vvelox.net]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N ZFS with the volmode set to dev being used by bhyve on FreeBSD stable/12-n234444-680eb3fd094. /usr/bin/lockf -s -t0 /storage/cbsd/tmp/bhyveload.debian10_test.lock env LIB9P_LOGGING=/storage/cbsd/jails-system/debian10_test/cbsd_lib9p.log /usr/bin/nice -n 1 /usr/sbin/bhyve -c 1 -m 4294967296 -H -A -U 2bc5ac97-8438-11ec-a89a-90b11c06ff98 -s 0,hostbridge -s 1,ahci-cd,/usr/local/cbsd/upgrade/patch/efirefd.fd,ro -s 4,virtio-blk,/storage/cbsd/vm/debian10_test/dsk1.vhd,sectorsize=512/4096 -s 5,virtio-net,tap9,mac=00:a0:98:5c:63:1f -s 6,virtio-rnd -s 8,fbuf,tcp=127.0.0.1:5909,w=1024,h=768,password=cbsd -s 30,xhci,tablet -s 31,lpc '/storage/cbsd/vm/debian10_test/dsk1.vhd' is just a symlink to '/dev/zvol/storage/debian10_test/dsk1.vhd'. And ztop also fails here as well. On 2022-07-15 07:59, Alan Somers wrote: > You didn't say how you were accessing that dataset, or what FreeBSD > version you're using. The dataset stats to update as expected in > response to normal user I/O, but not zfs send/recv. Maybe there is > another path that bypasses them too. How are you accessing them? > > BTW, sysutils/ztop from ports displays real-time measurements based on > these stats. > -Alan > > On Thu, Jul 14, 2022 at 11:05 PM Zane C. B-H > wrote: >> >> So was just looking and for some reason nread etc for the ZFS storage >> stats. >> >> Below is a example of a ZFS dataset being used by CBSD to store a raw >> disk image, >> one that is running currently, but for some reasonn the R/W stats >> don't >> seem actually update. >> >> kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: >> storage/debian10_test/dsk1.vhd >> >> Is there any way to get ZFS to actually keep these up to date for use >> cases >> like this? >> From nobody Fri Jul 15 16:08:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lkx9B59Qqz4T1cS for ; Fri, 15 Jul 2022 16:08:14 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vulpes.vvelox.net (vulpes.vvelox.net [98.102.84.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4Lkx994z8qz3CsF for ; Fri, 15 Jul 2022 16:08:13 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vvelox.net (localhost [127.0.0.1]) (Authenticated sender: kitsune) by vulpes.vvelox.net (Postfix) with ESMTPA id E432DF079E; Fri, 15 Jul 2022 11:08:03 -0500 (CDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Fri, 15 Jul 2022 11:08:03 -0500 From: "Zane C. B-H" To: Oleg Ginzburg Cc: fs@freebsd.org Subject: Re: ZFS dataset stats In-Reply-To: References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> Message-ID: X-Sender: v.velox@vvelox.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Lkx994z8qz3CsF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of v.velox@vvelox.net designates 98.102.84.2 as permitted sender) smtp.mailfrom=v.velox@vvelox.net X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip4:98.102.84.2/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:10796, ipnet:98.102.80.0/20, country:US]; MLMMJ_DEST(0.00)[fs]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[vvelox.net]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Testing with changing it over one one of the VMs and that fails. zfs set volmode=geom storage/debian11-1/dsk1.vhd Even after that ztop and gstat show nothing. On 2022-07-15 08:14, Oleg Ginzburg wrote: > On Fri, Jul 15, 2022 at 8:05 AM Zane C. B-H > wrote: > >> So was just looking and for some reason nread etc for the ZFS >> storage >> stats. >> >> Below is a example of a ZFS dataset being used by CBSD to store a >> raw >> disk image, >> one that is running currently, but for some reasonn the R/W stats >> don't >> seem actually update. >> >> kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 >> kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: >> storage/debian10_test/dsk1.vhd >> >> Is there any way to get ZFS to actually keep these up to date for >> use >> cases >> like this? > > Try to switch default ZFS volmode properties in CBSD from 'dev' to > 'full' ( defaults: > https://github.com/cbsd/cbsd/blob/develop/etc/defaults/zfs.conf ), > e.g: > > cat > ~cbsd/etc/zfs.conf < default_ci_zvol_volmode="geom" > default_vm_zvol_volmode="geom" > volmode="geom" > EOF > > in this case, new VMs will be created in a 'geom' mode: > > # cbsd bcreate jname=vm1 vm_os_type=linux > vm_os_profile=CentOS-7-x86_64 vm_ram=1g vm_cpus=1 runasap=1 > imgsize=10g > > # zfs get volmode | grep dsk > jails/mybbuilder130/dsk1.vhd > volmode default default > jails/pxe1/dsk1.vhd > volmode dev local > jails/ubvdi1/dsk1.vhd > volmode default default > jails/vm1/dsk1.vhd > volmode full local > jails/windows1/dsk1.vhd > volmode default default > > if you are using cloud/gold images, you may have to delete and get > them again From nobody Fri Jul 15 16:14:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LkxJY1CHmz4T2hQ for ; Fri, 15 Jul 2022 16:14:37 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f46.google.com (mail-qv1-f46.google.com [209.85.219.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LkxJX296xz3F0P for ; Fri, 15 Jul 2022 16:14:36 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f46.google.com with SMTP id l11so3997106qvu.13 for ; Fri, 15 Jul 2022 09:14:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=iHOfamwSwnMmgZKDjv2KKoe6gxTYWeP5ty5KyUJefWA=; b=AclZakXG/X87+qWKylkSJmbx+g524pf81IWBkZBGMjM81PaM9mlZxMz38X95Y/FtZ0 xs1FBl2/sd2lU3zi2qZwsWDJi/zPBQUEKHPNal8ZcxIycYRoOeJDfoQR7GfFSJ47eEwZ VX4wtR7LQ3oRpApPIUw55TaqkQLJQuvZpFC1BSfemsW9AjLbeOy3eMcDlyNBt7Hlbcr+ +32Ld7jY6IBQBvJiUE4vZwKEYVQ0Ks8yHtJiugid2DhuQlVUKBomgOcmsMZQO0j34DZ4 yHHxGE20EyT1ty3mET7yDkgm2yZ463LjDiQ1aomL8+UfXN1Y45fSwAvF7eXJV7tvA2AK 8PXA== X-Gm-Message-State: AJIora+ri0XWJ8y7lV2DWacsmhHaFyeko4Uz0YYMB4YTbEWFCJqYJMxJ lLsyYsfFP09FFokFxbU9BpWxEnU7pkPgp426QJL7vURThC4= X-Google-Smtp-Source: AGRyM1teyZklcluChodOqf6JRTq1o0jWIU4c1uzYk6/mjNLxHEGSB/dK0QjVwBmzt0qhwT8UdNEXYs6dKf2nhPI3pic= X-Received: by 2002:ad4:5fcf:0:b0:473:6fb:ea30 with SMTP id jq15-20020ad45fcf000000b0047306fbea30mr12816745qvb.131.1657901675060; Fri, 15 Jul 2022 09:14:35 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> In-Reply-To: From: Alan Somers Date: Fri, 15 Jul 2022 10:14:24 -0600 Message-ID: Subject: Re: ZFS dataset stats To: "Zane C. B-H" Cc: Oleg Ginzburg , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4LkxJX296xz3F0P X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.46 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.46:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.46:from]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; TO_DN_ALL(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N You still haven't told us what version of FreeBSD you're using, but I think you're running into this issue, already fixed: https://github.com/openzfs/zfs/pull/12097 On Fri, Jul 15, 2022 at 10:08 AM Zane C. B-H wrote: > > Testing with changing it over one one of the VMs and that fails. > > zfs set volmode=geom storage/debian11-1/dsk1.vhd > > Even after that ztop and gstat show nothing. > > On 2022-07-15 08:14, Oleg Ginzburg wrote: > > On Fri, Jul 15, 2022 at 8:05 AM Zane C. B-H > > wrote: > > > >> So was just looking and for some reason nread etc for the ZFS > >> storage > >> stats. > >> > >> Below is a example of a ZFS dataset being used by CBSD to store a > >> raw > >> disk image, > >> one that is running currently, but for some reasonn the R/W stats > >> don't > >> seem actually update. > >> > >> kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 > >> kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 > >> kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 > >> kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 > >> kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: > >> storage/debian10_test/dsk1.vhd > >> > >> Is there any way to get ZFS to actually keep these up to date for > >> use > >> cases > >> like this? > > > > Try to switch default ZFS volmode properties in CBSD from 'dev' to > > 'full' ( defaults: > > https://github.com/cbsd/cbsd/blob/develop/etc/defaults/zfs.conf ), > > e.g: > > > > cat > ~cbsd/etc/zfs.conf < > default_ci_zvol_volmode="geom" > > default_vm_zvol_volmode="geom" > > volmode="geom" > > EOF > > > > in this case, new VMs will be created in a 'geom' mode: > > > > # cbsd bcreate jname=vm1 vm_os_type=linux > > vm_os_profile=CentOS-7-x86_64 vm_ram=1g vm_cpus=1 runasap=1 > > imgsize=10g > > > > # zfs get volmode | grep dsk > > jails/mybbuilder130/dsk1.vhd > > volmode default default > > jails/pxe1/dsk1.vhd > > volmode dev local > > jails/ubvdi1/dsk1.vhd > > volmode default default > > jails/vm1/dsk1.vhd > > volmode full local > > jails/windows1/dsk1.vhd > > volmode default default > > > > if you are using cloud/gold images, you may have to delete and get > > them again > From nobody Fri Jul 15 16:17:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LkxNP6Ydrz4T2X4 for ; Fri, 15 Jul 2022 16:17:57 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vulpes.vvelox.net (vulpes.vvelox.net [98.102.84.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4LkxNP0Vm0z3FM4; Fri, 15 Jul 2022 16:17:57 +0000 (UTC) (envelope-from v.velox@vvelox.net) Received: from vvelox.net (localhost [127.0.0.1]) (Authenticated sender: kitsune) by vulpes.vvelox.net (Postfix) with ESMTPA id A5095F079E; Fri, 15 Jul 2022 11:17:55 -0500 (CDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Fri, 15 Jul 2022 11:17:55 -0500 From: "Zane C. B-H" To: Alan Somers Cc: Oleg Ginzburg , freebsd-fs Subject: Re: ZFS dataset stats In-Reply-To: References: <42b403fd492b631ad14e97b7e8a9778f@vvelox.net> Message-ID: <8b398b92ba4aece1b52841f6cc267b33@vvelox.net> X-Sender: v.velox@vvelox.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4LkxNP0Vm0z3FM4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of v.velox@vvelox.net designates 98.102.84.2 as permitted sender) smtp.mailfrom=v.velox@vvelox.net X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip4:98.102.84.2/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[fs]; ASN(0.00)[asn:10796, ipnet:98.102.80.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[vvelox.net]; RCPT_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Ahh! Sorry. 12.3-STABLE stable/12-n234444-680eb3fd094 Hmm, looks like it has not bad it back to 12 yet. That said need to look at updating this all to 13 any ways. On 2022-07-15 11:14, Alan Somers wrote: > You still haven't told us what version of FreeBSD you're using, but I > think you're running into this issue, already fixed: > https://github.com/openzfs/zfs/pull/12097 > > On Fri, Jul 15, 2022 at 10:08 AM Zane C. B-H > wrote: >> >> Testing with changing it over one one of the VMs and that fails. >> >> zfs set volmode=geom storage/debian11-1/dsk1.vhd >> >> Even after that ztop and gstat show nothing. >> >> On 2022-07-15 08:14, Oleg Ginzburg wrote: >> > On Fri, Jul 15, 2022 at 8:05 AM Zane C. B-H >> > wrote: >> > >> >> So was just looking and for some reason nread etc for the ZFS >> >> storage >> >> stats. >> >> >> >> Below is a example of a ZFS dataset being used by CBSD to store a >> >> raw >> >> disk image, >> >> one that is running currently, but for some reasonn the R/W stats >> >> don't >> >> seem actually update. >> >> >> >> kstat.zfs.storage.dataset.objset-0x1d41.nread: 0 >> >> kstat.zfs.storage.dataset.objset-0x1d41.reads: 0 >> >> kstat.zfs.storage.dataset.objset-0x1d41.nwritten: 0 >> >> kstat.zfs.storage.dataset.objset-0x1d41.writes: 0 >> >> kstat.zfs.storage.dataset.objset-0x1d41.dataset_name: >> >> storage/debian10_test/dsk1.vhd >> >> >> >> Is there any way to get ZFS to actually keep these up to date for >> >> use >> >> cases >> >> like this? >> > >> > Try to switch default ZFS volmode properties in CBSD from 'dev' to >> > 'full' ( defaults: >> > https://github.com/cbsd/cbsd/blob/develop/etc/defaults/zfs.conf ), >> > e.g: >> > >> > cat > ~cbsd/etc/zfs.conf <> > default_ci_zvol_volmode="geom" >> > default_vm_zvol_volmode="geom" >> > volmode="geom" >> > EOF >> > >> > in this case, new VMs will be created in a 'geom' mode: >> > >> > # cbsd bcreate jname=vm1 vm_os_type=linux >> > vm_os_profile=CentOS-7-x86_64 vm_ram=1g vm_cpus=1 runasap=1 >> > imgsize=10g >> > >> > # zfs get volmode | grep dsk >> > jails/mybbuilder130/dsk1.vhd >> > volmode default default >> > jails/pxe1/dsk1.vhd >> > volmode dev local >> > jails/ubvdi1/dsk1.vhd >> > volmode default default >> > jails/vm1/dsk1.vhd >> > volmode full local >> > jails/windows1/dsk1.vhd >> > volmode default default >> > >> > if you are using cloud/gold images, you may have to delete and get >> > them again >> From nobody Fri Jul 15 22:39:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ll5s964yGz4WqCK for ; Fri, 15 Jul 2022 22:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ll5s955Thz3DRM for ; Fri, 15 Jul 2022 22:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ll5s940m9zy9N for ; Fri, 15 Jul 2022 22:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26FMdv0F017044 for ; Fri, 15 Jul 2022 22:39:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26FMdvBd017043 for fs@FreeBSD.org; Fri, 15 Jul 2022 22:39:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Fri, 15 Jul 2022 22:39:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657924797; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qLKERxOLrfnfZky1OuAqm9hvgKcPPNIDb3D3FyAfjcI=; b=e349mueXiFzwfJG6piO9JQUmYyU5G6pqkTlirfeC3XqIwlVAeab4UsaEMvMOutophqw9Fc OT5hTWIKFhv9SzY7bgOWDOkALgEp56vBHNJtyMcfBkB91jqjIaMVe7lqxUQTG1iPY7W9mb Mb+fSkIk8v11ry1HlyIXHZWOf8Gw4TPjNQEeJm7xx70+EdxY8kkppTgOZOV9kqqkRWUIg6 CKgCZoqg5rOqGQEASvoqdtaElCB3fuUQTkd6SflvRaQydaM6DnP5OUOA0ZjDGoGcXVfIo7 utQZFg9N3GvtR6FXzgEWe8q52f8IffWvP76GVoyOd6BCggXbjThLc2VRRrrkTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657924797; a=rsa-sha256; cv=none; b=WO/FUcah7skcwVbYinWmyCHIrQTWngYrvG+aZzb0/u1+3aSjyLi53phcrmyEsyU14VaF9s RDGgYN65PjZqm4tMmE8WZgYXnxytffQb4+SZ7v5iRn1ac36x/y6BLJKfigwcBxgLWfWjyB umzfUfH89ATTslInuwlr863h7S6cm7hDb/7tHTCxGoeJ6wcyjkkGyjpyGneLS1YK6JTTlY AsofoZCr7i3EEzsneMY9v/gEzBXsTdlJqfaSRV5ft143wq3L8yW5FBKz2s3U1H4f6xRfyB C7Scos8Xb7rsvhtXqvJIRKEHq4rbVBIEI3+1NH4CpZzICOWoumo5GwGIjEyEog== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 --- Comment #3 from Kirk McKusick --- Created attachment 235283 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D235283&action= =3Dedit proposed fix This patch is my proposed fix for the bug. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 15 22:40:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ll5t74rB7z4WqfN for ; Fri, 15 Jul 2022 22:40:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ll5t73rw1z3Djb for ; Fri, 15 Jul 2022 22:40:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ll5t72xzkzxyW for ; Fri, 15 Jul 2022 22:40:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26FMelfS018079 for ; Fri, 15 Jul 2022 22:40:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26FMelnL018078 for fs@FreeBSD.org; Fri, 15 Jul 2022 22:40:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Fri, 15 Jul 2022 22:40:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657924847; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dhq1ptKhrV0NI4+8lgnks/1khKCZWlW0TK8CJw87hwA=; b=BtEM1DBzxYEjU863TiVgn1hJvPefnoPzZR2Us73gYOqjIHykzrdRGzEMpSywiraWu/VrtR xHeJlT+O4fB6T0ofqUvs3gGqpkLNFUl4Tk85fIvGArX1JW60w0kAdJS+d5Tia0y5CC1uRU DIzYF8+gy6MnA+/k03WHy3NHW/HoHfiNSngQEnoVtpx/Yssuzd3o80ebOJ1oHi+wsRujnb b59lcu4YJBDHoVxY4Ni6//UjYaWveMc/TnhoRXJj+sRVisJrWG9/0Lx67FEK/350rUTzgp W5MsN7mHrWAD2RcYEzI/q7uIXZMjZYj6PqWqjEFnsk/rtBjnt3Lh6QhS6WeAcQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657924847; a=rsa-sha256; cv=none; b=vg2OJPBGyC9aQkkb8ZIkks4QFNbJrNmgWUsXygzA+td5tuZF2Xo8V1EQt+UFxEKyDTwGq0 kvj7mny27W2Dse0tSHtIHXmsMxdIO9cWE7I562VUwLEXLJ804SCqG23jPR+QkE1zKhXZKw WvljganX6vFAiShln/mHYrhONSHfpwqz5LwdWW8W3vaHJ2D2Oswn4ijTN9k8Lu/5cumhXh Yovf3ypdt5oyFljTQzMU2hiDnf/KiX8Rt73YFtwA5Cg8xfh8f3U9OQBCncPLk7+4PRcwgh 4rsduK01KubGzbZR62qiGU2cBfDIWws9UqqPNB6xEZ6yVx9Zv/LCF/ntdAPJCw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #4 from Kirk McKusick --- Hopefully my proposed fix will correct the problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 00:38:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ll8VF414tz4X45r for ; Sat, 16 Jul 2022 00:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ll8VF2lnhz3Q8k for ; Sat, 16 Jul 2022 00:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ll8VF1h5rz12C9 for ; Sat, 16 Jul 2022 00:38:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26G0cjhp078701 for ; Sat, 16 Jul 2022 00:38:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26G0cjlG078700 for fs@FreeBSD.org; Sat, 16 Jul 2022 00:38:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Sat, 16 Jul 2022 00:38:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657931925; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SmvxhLCftLlWoyi6eF1IbmcyXzGzYhHEyXMYiwga64k=; b=J4sAiZznOID4kTSqBjTjQs/TMH/0dN2TlqST4ak4CZezp1f/wpvDD6o+Ak1nL32lZAwzco EhYMi1fYsds0SOFLklxyCckuiWIcXKYiBirJsoKqqmf3HIw7L20uBiILL+/dViNW5inz1I Dka51GYlxHvOsQAxh+pU8wJmjHoKAxhz/E/yiP08+buQs6QyR1aKMDaEKEla4g587CaNjR IV1iqU6yEXK3+0X03AMgnXk/n2BlOuimxbvLo6SsQ/chwDThvWZI9RFdF97h8h8wPOUkJR FXah1OAZ/IT6vdjo9Qk+XPfbjn+RxrDF5My4jntxVsLVq71cqRI0Nroj/5FbLg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657931925; a=rsa-sha256; cv=none; b=JhdTjZ9F+zFrAiDZt/+YF9s06FzqQEOhNewKOMYHd7LvL3AR4sedtmw/ZGIlWWq2AVAd28 +kj9Ftvzf4xBEM1PLiZJ1WvWVjxcKmiVCvglsjqvT59q6TjI3FAn9zaY6q1Wyfq3PQBuU0 QSxhkLVlokE8GT8REZpLTRshIOV0Prh3HvOIMNy4ZX91Yzd52qwYe3VBLEQWtgF/2k1/f2 EZgR1K1IEni1IERWTmEUnFfMZRdbee2SDrQZergDhMUl1BKqcva3N2HIgYWhcnKgQ6iETS iQF36iSplDuoAHibo+87fdAtP12FygfJXlV1RHpWwQn1QkoCmXc2+nbAmaWUzw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- Created attachment 235285 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D235285&action= =3Dedit Proposed fix This adds a check to the superblock validation code that checks for this ca= se. The result is that fsck_ffs bails on the filesystem because it does not know how to fix it. In this case the only way to recover is to specify an alternative superblock. This particular filesystem image does not have the parameters set up to allow fsck to do that itself. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 00:39:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ll8Vx0zZsz4X4Hx for ; Sat, 16 Jul 2022 00:39:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ll8Vx00XXz3QY6 for ; Sat, 16 Jul 2022 00:39:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ll8Vw6BySz11cw for ; Sat, 16 Jul 2022 00:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26G0dKX7078805 for ; Sat, 16 Jul 2022 00:39:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26G0dKWo078804 for fs@FreeBSD.org; Sat, 16 Jul 2022 00:39:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Sat, 16 Jul 2022 00:39:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657931961; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=veBWEsOx3KSBH1Sai56QsRWV3fatz5Hoai7W2xi0EI4=; b=O8P3vaSW2AVwV2K29YVxyt/2yM6Wga1Rq1lu9Zjf4vI7d1lNtDFgB9+L7TVkAyZRwDEJcP DGq/hHHgQlRKzmFECpTNT7QdTonweZrZJ2T+4xuamLpblpxITLwyBvG+YijTTh1Mma8GJt MSB9y30clCSpodg3sx87BZALjbSP693n83EEc+Nbp0lD9E5QxSGJvuGtrZSAaYENoYuRAn 0QIk4S0k8E8n+XcDUE+JZZDw8OvdRrdnqclwkZOC1Vb5QfIf4f7H7YzWScqKfIuO9b/XR4 PneI38BQkcLEbuCg1A/qOfns6xcRu8bYP4rpDFJBONa8/XP4LEyIFXmo368wxw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657931961; a=rsa-sha256; cv=none; b=ChHZS1to/sm/1y7MW3JpF+MZN6K03UV6MQ2b3YVjuCO4uj1DE/ycShS7LrKbMuMme1XqcH NdHCHvqMwlsaFgbeTSt/16Z2HFxkU2lC0xp8J4wn+v/nAisHaN8hFCVNEO7cW3pPVJ8JWB nXKG32fjcK/5n9Ihcsj57E+jAzS3UM8/9hT4ebuPcpTsYVv1wzghv//ymrzKs8Tu11f/k8 LZ3nnddIcDIlee4uwKZw+6HOba5oPSfH8zUxr/7feN29ENL2QSeVFP5/vEH4oxIFGQfm6M 99ms1ug3LZYK+zV97avUrTT+h1jEqGpNNQ0PBGErPDDWuH5mf5xaNQ2GInsoCA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress --- Comment #2 from Kirk McKusick --- Let me know if this fixes the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 06:58:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlJww3R1Gz4Wg3s for ; Sat, 16 Jul 2022 06:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlJww1Bt4z3wn2 for ; Sat, 16 Jul 2022 06:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlJww0G6hz1C5b for ; Sat, 16 Jul 2022 06:58:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26G6wtDU082715 for ; Sat, 16 Jul 2022 06:58:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26G6wtqS082714 for fs@FreeBSD.org; Sat, 16 Jul 2022 06:58:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Sat, 16 Jul 2022 06:58:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pho@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657954736; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cdcPUUk2UHpRVLBEoCVg/deAbShQ3BfTdnx7GxtHYZs=; b=dQM3DJcAFp7NF55i6cOsVBb6xAtDojJK+fKIeRImTy56YWSFKxdDOkAe9TWbTwBngoU0DT FqDPYfALLXeUc3wq9sGyea7dI5Bi0N98j0mX/J5LnkvgdmLzDc4vjuE5AzorV6z4G+2zFs scxzAap6Tu368qVfL6vC2GoQhuhDFuPqEg0YI5n/3iPbj8rGV+0T2EtbzPD/hDyqPBSFrc X7WCi7tcHQZc4oSo6SSjyO/Y+Ey3U1lSmvFTiTPcx2nYiJGzCx/WYlSiu58rS1yEBGNlzD KEdVGNe9xfsf6DDFMCdFTUVC8oF6MjGQyhXPJxu13BDMyl/T2jCx0JOSXqJJcQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657954736; a=rsa-sha256; cv=none; b=NUJLBsDAkQxvO8NRxtDVQXMI8XUD4uTCmbyE502US9G2zfMuhkLq+encEJhlJhe7eL5W2v /Vf7MGFHj4z6Fchghl8cQ6HQOaz7dAHnFG/p/H2PAHs5MLtQFyKr0mn3j10Bn0HLjXo2C1 T/+lBhYnORY+Goo8U2zOoNRPb4WvjPa0OJUFg09KgPQ+PsadkEVtPetu6MSWuntWuuEEyv gUmj/B4TcfgJeMPPGEGOx5YxJYTUKFRWxhUCVZ/cFMKYdBTgAGvdKMVdok4bTY5RDHj9Si T5kOm23XDDe1l4wzn6QKomQwiKlDjM1PFoDL+F83r4C5SAmOIaePRuPk595v2g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 --- Comment #5 from Peter Holm --- (In reply to Kirk McKusick from comment #3) The attached patch fixes the problem for me. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 07:00:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlJyB0LkNz4Wfwd for ; Sat, 16 Jul 2022 07:00:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlJy95cVfz3xBS for ; Sat, 16 Jul 2022 07:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlJy94h6Jz1C5c for ; Sat, 16 Jul 2022 07:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26G70169083580 for ; Sat, 16 Jul 2022 07:00:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26G701qe083572 for fs@FreeBSD.org; Sat, 16 Jul 2022 07:00:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Sat, 16 Jul 2022 07:00:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pho@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657954801; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WMImo4naWX75NJ6J0vwnvvgYGVviM4ccTu8EqhCQbZQ=; b=wlYXgjkiZqFCDL+kLgXmiVcDKTeWyRJM4y1yZ+evABKDxC35+COzNgTeVo/lwmjCl/SLOt 8IKSxthJtL02+UWnZ8hLYU6xcxmzSdZxjLmGrgmSxCT41f28i8P5+C5eH5pT6h5wSa2d3s seGYgmHJJDbhYONIlF04YzfFbjun24UqQMZTapPlqke3O4WweRUiU7BH1dRB+UFszM1BUm lLC2BrVL+KR0JwWb0rWlDdFHefyBvMmQ2aegJKNC8t6N50FjuITbXMOGLJMbANtxIJlJ1g bXmsT1yALFaAMNvT7hnYojtNOVNS7cOMTj6cUaQ+hiFTSqVOBkwjBoQ5LhfTOQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657954801; a=rsa-sha256; cv=none; b=hWIxJ6UegvsGnFoxtr1lN8KlesTGd4t6FsFjPt8Ohho5qB3S45sngPY/f8XCSpYMLtRBDJ TlQv5bPr6+83wAE9mshCoRw1ktakwuYskIwbzKzEeelHaXq720hEUA+CRSspf0OAvL26gl FLiIwATBJFTM98kyjPCWAUBbBDKs8S6ot+bodZoAFI9AmwGegTgBvTjVjpytNYAFTbdN9o OHMxhtsZlE0uO+d9AAoWFaffrD7s9u7JBUbZapaIHf4gKm5j2Adyw5ZsSgxcggV/eWQ8k0 EQax0iySG0IPwNT/LZv4hpKqqZf3s9wrXNLYeoYp27VN43x64Tlgqnbh//Toug== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 --- Comment #3 from Peter Holm --- (In reply to Kirk McKusick from comment #2) The attached patch fixes the problem seen. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 16:00:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlXyM21p9z4WssH for ; Sat, 16 Jul 2022 16:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlXyL6n8lz3fHL for ; Sat, 16 Jul 2022 16:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlXyL5rHwzRLK for ; Sat, 16 Jul 2022 16:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26GG0wxj084052 for ; Sat, 16 Jul 2022 16:00:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26GG0wFq084051 for fs@FreeBSD.org; Sat, 16 Jul 2022 16:00:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265222] T480 zfs checksum mismatch error Date: Sat, 16 Jul 2022 16:00:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657987258; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EzOHEVuo2tFiBdSNNghyGIEs/Jc3oNGYgQfaa5WNqOM=; b=rJ1Xk1ke0KJJbIV8hGZZRCfD3iU5xCR4lEhbYANWqpK+pRhchAiYmJMcuN4gPijLJEkB5v EsUILkLaMpg9FnMdoqAWj1aRhZcn0k02n9G6MoxtbhnzMlJ6XnSrx2aiuvpv72kssBzd68 KCIqFuFwJJitwiI+CUxjs5TpDTY4MKFVh7yZkQ4fbl3aRMukHR1UAsjioxk6bHNiGak2A5 ktSBadWGPSSwRaRBTVFyKGGshkWZHaiSYlCessGN+F3/RMy2MsvZoPy0kRIGAq+v1xtu1N yBJs+qHyJicDwPmewUu/WR3wQ+cBaEFjXaXKQqek+dnjZrqHi8pwLJNeSYHTxg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657987259; a=rsa-sha256; cv=none; b=mx+1PAsk8goHGUKWoK6SMHP70UikqiZm0iP4ZAazFrmS+qWkl13V3KCc768ILzF61MUXfA 3YZ60CQdVwsbB9vJkQYFy/GJIc6GXNCDzRVCF89gTxh5iUEjlJRPfoWtlSljlLXMoYZsSa 3HKzmA5nZBIUqq48jXAdpK7X1KRq5bDgTFsKK0thIxc6h9TVAQVphkdThq6I7grEgppkzE 8qBenkSWsrLFnMo6894BpyHzj/04MUCAfiBwZNmJpJo3Cr0gLIPDlwovpA4VQB+sBU5JE2 4UBaHaehVm0d8zkndwLN7vsLSZE4CCOah0lLOQyjKS2RPwpUCulhP5EXaRX3BQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265222 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@gmail.com --- Comment #3 from Graham Perrin --- (In reply to Mellowlink from comment #0) > =E2=80=A6 no error was reported by smartctl =E2=80=A6 Try giving the entire disk to UFS, then use StressDisk for at least one rou= nd of non-stop writes.=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 17:27:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlZtM322Cz4X3QH for ; Sat, 16 Jul 2022 17:27:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlZtM20BNz3r7T for ; Sat, 16 Jul 2022 17:27:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlZtM143LzVGt for ; Sat, 16 Jul 2022 17:27:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26GHRdKt036907 for ; Sat, 16 Jul 2022 17:27:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26GHRdZW036906 for fs@FreeBSD.org; Sat, 16 Jul 2022 17:27:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Sat, 16 Jul 2022 17:27:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657992459; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oiGOKQl5s0bxrWnCbdcaJFrFCAlYlXbr8NhXOmWSq9Q=; b=K7k+DQNuFpIVTrBWGevMnBqicgLdnpd2Hg+j7zsP5gHAe+nqw2x8epGnyIDoq8B8iW3ysw kqobwF/BtdZOIkGll4zWbes06NF81sgWzUS0lhKJNenmPjZnFiULhyMwtYw3HTwUxKVP6J MTuel6d5xYIcPxwJ8DE0iyO8LaeG8T2+DAB6hI81SmoF7GI8cmi8IuDwY3PS3ER5hcl7hM kJe8v54oxOYpOcOdiuG8aCd1mkP80w0V52g4UcP7/+JcmXj3ukRXKKKpqpvqj+QNccdM51 GZUMYqdnhV6dHDr7+8+FWRfG4A9uG2XF6ndvcwUZ0oUJzOhkrvyg6xeCFfLrTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657992459; a=rsa-sha256; cv=none; b=vv1ZoYWGS745pvtiFmECvR+By1tJYSdI/a4nzBCyqY5IqYRcLvGmWOBRlTk65cYbs1w9OC WyBBbI7q2fm4Xoj1DJje6fHbMleVRE+jD6gotSdZn4V27jMfp1WMGPB9sV3yBqkTYipdLJ Xxa+0XyyGsMxqggs/NZ3OKzKMglK5hwsP/Kz9xaG5uJP3wOjq7SVGjfTfLyDGZ+MAdf2mU m8LLbEffw16Y83FMthmAhsnUIYb4whzkBSENrM7rROqonbahMaosyknqe7RITI/ofPDl3p PDtRMIrvit6wJbC79BhznTUPeAbDc2k7qGK2zwRJXvThg0JafQigrAXxyE/jFQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D90e29718cffcec987769ccbe393083572= 02c46d5 commit 90e29718cffcec987769ccbe39308357202c46d5 Author: Kirk McKusick AuthorDate: 2022-07-16 17:25:22 +0000 Commit: Kirk McKusick CommitDate: 2022-07-16 17:26:51 +0000 Clarify when GEOM utilities exit with success or failure. Historically, GEOM utilities (gpart(8), gstripe(8), gmirror(8), etc) used the gctl_error() routine to report errors. If they called gctl_error() they would exit with EXIT_FAILURE, otherwise they would return with EXIT_SUCCESS. If they used gctl_error() to output an informational message, for example when run with the -v (verbose) option, they would mistakenly exit with EXIT_FAILURE. A further limitation of the gctl_error() function was that it could only be called once. Messages from any additional calls to gctl_error() would be silently discarded. To resolve these problems a new function, gctl_msg() has been added. It can be called multiple times to output multiple messages. It also has an additional errno argument which should be zero if it is an informational message or an errno value (EINVAL, EBUSY, etc) if it is an error. When done the gctl_post_messages() function should be called to indicate that all messages have been posted. If any of the messages had a non-zero errno, the utility will EXIT_FAILURE. If only informational messages (with zero errno) were posted, the utility will EXIT_SUCCESS. Tested by: Peter Holm PR: 265184 MFC after: 1 week lib/libgeom/geom_ctl.c | 6 ++-- sbin/geom/core/geom.c | 5 +++- sys/geom/geom.h | 2 +- sys/geom/geom_ctl.c | 10 ++++++- sys/geom/union/g_union.c | 75 ++++++++++++++++++++++++++------------------= ---- 5 files changed, 57 insertions(+), 41 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 17:33:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Llb1K3mj2z4X3vB for ; Sat, 16 Jul 2022 17:33:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Llb1K2RrHz3sY5 for ; Sat, 16 Jul 2022 17:33:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Llb1K1Vw5zVhg for ; Sat, 16 Jul 2022 17:33:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26GHXfqm040860 for ; Sat, 16 Jul 2022 17:33:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26GHXf4Q040859 for fs@FreeBSD.org; Sat, 16 Jul 2022 17:33:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Sat, 16 Jul 2022 17:33:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657992821; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ibKvRtMV8UdTWtrA4nZdvJzOs+4AcvHI0+pY3bGDsbY=; b=jhONjROiEbb11xI6fnRopwanAzXwWIQvtbW2GmpNEyi/FRSp8h30PL/9SSQNKIZKnhhrxk WhFkh4PFubTMmxutWgkijdxG5jWssebzbKATiRw41qDwIEDmMn1XkZbHa3usQLKMNKQf7Z nUcls8HIGUBnofA+ZDICfX9kPhHgwAEXP33MDv2CXeSkVadLzcC+NpchTqS/5Uxu/ou9sL j9ffFt3QHtFaoqrfSrWS/UTjJbxZtYkFjRCpmLy0x6F3x7jFcqTzVJp6xTjrblJQi9yloR 1ZljTKSGbyimmVmeMERYO4sP9KgVcTAcGToc+8RpPzgMJAC9sIZOAggzHe0cVg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657992821; a=rsa-sha256; cv=none; b=w924i3pY6QcagTiMhulT4q1rNNCM4LpPc6mZEFlD/8vn4dpm9Ub95K0+j0z+qvWD45X6fw hq0Hko1h/B/2agRSZr5/GnOUGWuMsoe0n8sCpd7m0vKXAUQYFoEGh6bCUxg1F1GgVtbkuM GiuHCpZb2qSvtJQqPXY//EdSX5kpRFL+kKrpv6m6C5NXwLI1w+/LnDBvvepS5FdtA6hCls urQVYHv4gAadrfwa9UTdqqm3McyRawFRQHbkrEA05UNaRcRM/CHDvPTDlmYj8G6WvhRC+T U/gsxZgwfGzrH19VEH9RHpSbCogwFcuXMWmbwSJ5f2+fBEjuQ2+AWamqasyiEA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 --- Comment #4 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D904347a00c1f9a29f3b17e6e676805036= d2494f1 commit 904347a00c1f9a29f3b17e6e676805036d2494f1 Author: Kirk McKusick AuthorDate: 2022-07-16 17:31:52 +0000 Commit: Kirk McKusick CommitDate: 2022-07-16 17:31:52 +0000 Additional check for UFS/FFS superblock integrity checks. Tested by: Peter Holm PR: 265162 sys/ufs/ffs/ffs_subr.c | 1 + 1 file changed, 1 insertion(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 17:39:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Llb8T0DX3z4X4Xx for ; Sat, 16 Jul 2022 17:39:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Llb8S5BLgz3t0s for ; Sat, 16 Jul 2022 17:39:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Llb8S40ZxzVVc for ; Sat, 16 Jul 2022 17:39:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26GHdqW2042116 for ; Sat, 16 Jul 2022 17:39:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26GHdqOQ042115 for fs@FreeBSD.org; Sat, 16 Jul 2022 17:39:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265184] gunion(8) create has exit code 1 on success Date: Sat, 16 Jul 2022 17:39:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657993192; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vl3rN6w/92UrWb0VdhvKkaK0VFCOuaUQibIDwWMzmWA=; b=TR0RaqlXJzhv6nuD21W8EVuXj+oxSlnVAKiqmx5kNWHx6hFgYGbeTGi6MBvXGdMKsengUD wIYqzfWFqFY/NMjGEv6QvhZbB+pKpnb2MdtSm0sBHU3a1Ag0xUYGfYFv15d+Sj5yJJJhkH 00abyNjR4kzIKYza1EKAN5nX1QppQpt8bFJA/ch3nEon7QFdIXIHSdY2j9sljRmMQz9nc0 3SgHnqP6FkNyOs7HAZ5lrMTIw9tk2DQ9ws4O9DxZ9E1KGy66O9iR6Oeq+XQnS+56CFJnzc WCkVWxcKp9Ay3Nmf5PrMf+aidomVKeF/7TEcA0nZs7VOlQd9p4EpngXjS2O5ZQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657993192; a=rsa-sha256; cv=none; b=m0wG+K2VINJ+oeUNFQkzyawArwkjdfoynwEIMzxvHqtamKKwl6bQxwZvJlZvMaNsuaikAv VoNX6wOQIzMbH9VxsO/R5zcu8Du8o5ZxchlKHVuC5SVYorOR8MzU8rNO9e8bV8NxfF8CAh RUZC/ndyj23oT3mlnk2RNVDldKgpNnsdkqkC7fXs/Xd631FkJu9BG55T9kzuKBI9VM+Kl3 zsgNYkScnQbnlH+0Bu2MFbGzzfbyx8MswNT5fh5GNHfmg5XDlGbmdRaLGfRpmY+H2OSYBK yPzLcs2WO8bMRskC8xaq1BQUHzm3euy3qbVD6MInaxj9+Kibcqbi1BwZdMUzqw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265184 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #7 from Kirk McKusick --- These extensions to GEOM error reporting are used only by gunion(8). As gunion(8) is not planned to be MFC'ed to 13, these extensions will also not= be MFC'ed to 13. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 16 17:42:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlbD04mQbz4X4tV for ; Sat, 16 Jul 2022 17:42:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlbD03jFCz3tKY for ; Sat, 16 Jul 2022 17:42:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlbD02myLzTcV for ; Sat, 16 Jul 2022 17:42:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26GHguBZ045855 for ; Sat, 16 Jul 2022 17:42:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26GHguwI045854 for fs@FreeBSD.org; Sat, 16 Jul 2022 17:42:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265162] fsck_ffs(8) core dumps with a mangled FS Date: Sat, 16 Jul 2022 17:42:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1657993376; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1CVT92g8g2GkWmdaS7X42+0O0UmQ0Fzu/hdUHTmLaJs=; b=kDjHG4KjGBowkKqLyuudDH/iUini4avFJJvGp9tCoAbW1ATj43ciryLWTMIeFhrJ4/IyAc Bilu207H9+VNylb9gSj+CSPYp3CU1LWzDGQKzO3jedqYkycGgn0gQDS3tBFpDRJaXEQRrq jhsZRdlxGusatvzOU2lPz+4xQ3EaToPSke4LvhSDDTE2YtaGIHIUSSW7xdICuG35TFp/mZ aCOWF7xaE0rMd+fZQ61o2vDQKdG3SuECeyW3LFiIOztvDjbi/vQfyjpBZS++DIiobErmkN iIqOP4ZhnyHj4meCYIRVhRFAFDl5LA3pEV6e0ediI/IRflYnf5OffTJ1iBWrlg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1657993376; a=rsa-sha256; cv=none; b=xGVbM+7KlpxIAFdGemW+Bkix+BblRTsR4sIKIy3ji9SIZkk/Bk9d5BkeC2BlmFgVkdQ2Sp rIz92vqattaD+n180L05H0NGbbHe1aHCCCpniWFeXWGcfawEgsgoDvlD0okTqZAI/TwWWf VW62b1Xu02mYnbWkds7IaJQECt7JqpUvjIV39Be+SIWUFr2E4tPK7jvuz0iKKlTB8KJjuf U+RGXMnmtIjWo98JTAN+hkymAEbzlLFXrdcRYyFpr0LjFCFw2CKlQSDcQvD1dQ2aNc5y1u O5Za5+6aghcwCrZoEdHUiY4ogV5Gs2704Cpp6MTMh9cbsCT+kAclAun8BQxpuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265162 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #5 from Kirk McKusick --- This patch will be MFC'ed to 13 as part of the larger MFC of the superblock integrity checks. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 17 21:00:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LmHYM42k5z4T5fx for ; Sun, 17 Jul 2022 21:00:23 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LmHYM0zCWz3PZp for ; Sun, 17 Jul 2022 21:00:23 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LmHYL5cC1zDhj for ; Sun, 17 Jul 2022 21:00:22 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26HL0MlY043372 for ; Sun, 17 Jul 2022 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26HL0M6m043371 for fs@FreeBSD.org; Sun, 17 Jul 2022 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202207172100.26HL0M6m043371@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 17 Jul 2022 21:00:22 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16580916226.eb089faFf.42306" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658091623; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Fy2/RzPQSdCWoLoBITxO5CkCjsssOhZ1T9+hFAtPcko=; b=TmdT9C87z7F+C0oqOegT6fU+7X5iW0nKzt7g7Qew2tjljRbSW+44jflx6c9O6/UU1Ue7Xv Lo49P35J/YI6zbBJ73+8UPG7tbJoM93SKQ62n7f6JXOUE4DkFb84QsfTeeOWlIUVopw5hD 4yc078lv4NzcvBqkRp8ZKdIyFY6u56clkdfg3gjG9WnoBDNHFQ61GpZkk1opLCHW2M8yq8 Mbyz89zMRmoYbOsxnjYoCShw4k5FBIUWREsv0rh6U989ROwPiaxBsEja/mKALT0DSCiHKM rc8Sdfj2rw4IFFaVgWvfDTQsPQRaab03VPxhe46iRqllD5C1nljRAFWfSyg06A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658091623; a=rsa-sha256; cv=none; b=qsU72Pa2YZo2r1cui0yX/HEUPldv4bK3eLmX5xYJqgo9x6IOhA2429MR3qDxVfp+QfKUkk xcsrcRl1glbi4MM2Co4W44ar0vBD/6nDpFsnJF4t4ZtzrS8bB0XTWACbfkefghzoVs6ctC Eravwt31LboED4ep5mjVJnPpiA6efrZYUxwbr4svIklOwkEuqEByP4NQ6oUMZ7YyINWveD 4S1F0KsdJhGVQE0FAnKobhXyEzt8T4Llcalk+Y38Sl9xO2R194AP+nVOXm7Q/90Ne9gu8C 6jIyGGk7gbaPmyFGTyD3MpRIY89tIGRO6GfeS58/VxfSWJmp2j4W7jl+c3cLUw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16580916226.eb089faFf.42306 Date: Sun, 17 Jul 2022 21:00:22 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16580916226.eb089faFf.42306 Date: Sun, 17 Jul 2022 21:00:22 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16580916226.eb089faFf.42306-- From nobody Mon Jul 18 20:30:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lmtr336D6z4X5h1 for ; Mon, 18 Jul 2022 20:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lmtr323bNz3qLm for ; Mon, 18 Jul 2022 20:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lmtr316Z1zs5w for ; Mon, 18 Jul 2022 20:30:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26IKUBTe013412 for ; Mon, 18 Jul 2022 20:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26IKUBFp013411 for fs@FreeBSD.org; Mon, 18 Jul 2022 20:30:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 260507] FreeBSD 13.0: zfs snapshot does not store a snapshot in the .zfs/snapshot directory Date: Mon, 18 Jul 2022 20:30:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yonas.yanfa@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658176211; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YJchkgGUTHd9rTR8069qC4LAeSld+eCfeu14sRC0U4U=; b=dhizbf/G1TMock1Bcclek/wFzyvm9lCdiTJlaf/NB6IH62bcjRfSrpok4AofVHGIUWRBvq r2gA3K5uwDzw03yF3BB1irk+nMbSQ/ppOxB8CPBBiHi6B4bO4QzgC6M2439l7aXL3ZMAU3 snXAqcaHQsHQ+4oIvpshrHPThd8AQOdw+XFU15SZWgBh5TFIBXDDuIM7DSikmkWob/H4/z br1icl5q8/QssoLYI4q2DdCMdr0Mbxr/5wNEG6n6tTV5be+vbMzAw23Zklxi2IjnTaxnKz DD18IC1LYACSPz0aumcPmnUaCfbMxesI5nvXypUASH5bR8hzTUs+EJz2Qq4/zg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658176211; a=rsa-sha256; cv=none; b=dB3s2pEdmzgjDeSOYiR9G6g0gRbSQlkhpMV7S1Z5ZIDBh4VA2vlTnK2XI1na4diXoOAfr0 I+cPjY3JTFoPMT4l1AngZE3IWtrtZ50nLw7YiMxYvl1R8cRuPGEpSuGzp+y/sX8gCBT/kX vZEkn8eZKS8BMfdGu9P096Vo6/g+/T4mjfQ+K02Q78VTCntuVEHuvmaR3+wHWAL257Jr/R lbQ0yNOPAWZ9Kfg9nszlsAn6HA9qrQzdi+LIpph69S+538Ej3rnNzYJ9InvTAUPc96I0Uw Tt9QFYVs8tr0M+v6JfVaSMD7XuPyMc42cqsAyffZujze928nXazP8dtp8Puj3A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260507 --- Comment #7 from Yonas Yanfa --- (In reply to Andriy Gapon from comment #2) Are you able to reproduce this? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jul 19 19:35:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LnTZf10Vkz4WsJH for ; Tue, 19 Jul 2022 19:35:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LnTZd6r5xz4L7M for ; Tue, 19 Jul 2022 19:35:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LnTZd5kYMzWML for ; Tue, 19 Jul 2022 19:35:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26JJZbFK024781 for ; Tue, 19 Jul 2022 19:35:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26JJZbMK024780 for fs@FreeBSD.org; Tue, 19 Jul 2022 19:35:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265222] T480 zfs checksum mismatch error Date: Tue, 19 Jul 2022 19:35:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mail@malisek.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658259338; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GHoR4d8UPWYi+ppI3A7TsD5x5tyms5JaAMkN2Tq2Trc=; b=Nl27pogGiqnEVYDmlZ7OLAXTHHog4fcJHmch+ytc1bP6ET78MJbZ6HIHQxS64b3hni5Dy0 5h+WfGuX9GMoUR8M1wmiJJCLAXkVOf+L5CrS8d0EXjA5jPofBVo/8uLjlnGIyydCew/qPy e7GWSuCY1fKCwA9nZYJ0LorqllQckCDdnBhT07YWh6tt3apH5qO1SUZ2A92YEroPNLs0w/ THA/Vc9dHiZutecHOdyF+2z6L+PFFmpFWTEoyHpqbEYTMBHrHgnAdDn0j/vk1XutRNPhqk 4GOmGckVz7bHwyVpu/PG5RvwfAwIe04Uudv6r0SzRv6956IeDlgVnzOGb2KzSA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658259338; a=rsa-sha256; cv=none; b=elfHCRDhelWHw6jTqhQM3kOIKmQRKHpopLNCILStOcWro7AbWp0ZJdakeTgSXUS/Cf3xUi GEinPWe2jY26Ilhsdo01imXymBXBJ4fbJ16qXxy0lgY0/D5ks2H+6n9dBsjYSNFugAjX5S 7GEeUG5j6PnSvfoU9f0pGeO7WdvEdkieIH6Sx5ja4df/EKrprdUEBXypSKEdfoLq68Crum OmNNPDxI48z6XUr1zSUjdcW/3Y5khKel+WiW4vNzePlVzTkPdnOox9ov+R0gcMzzBuLNff OL+b5O6TLxRIhFVUVx+zpyppDjPb3Ozz/Fwnvr/MQPOLt2xBFDNeJ9xgc0B2Ww== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265222 --- Comment #4 from Mellowlink --- (In reply to Graham Perrin from comment #3) > ... use StressDisk for at least one round of non-stop writes. I din run stressdisk on another system for both the nvme and the sata ssd I= 've used for the T480. No errors reported either. > Try giving the entire disk to UFS ... Good point. I installed FreeBSD on top of UFS on the T480 with nvme drive. On UFS pkg doesn't report immediate checksum mismatch when installing packa= ges when X11 is running. /var/log/messages doesn't print errors either. But after I've kept the system running for about a day and then I've run for several times: pkg check -s -a=20 It prints checksum mismatch for different files each time i run the pkg che= ck.=20 I've tried manually getting checksums for files it reported with mismatch a= nd I've found interesting. root@ltop:~ # date Tue Jul 19 20:48:18 CEST 2022 root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 7c0a80ce2f115366b4020f83015a888234cbf51e0691ad26f47548d4b3181cc1=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 7c0a80ce2f115366b4020f83015a888234cbf51e0691ad26f47548d4b3181cc1=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 354758bd1937640e7559f60517a25787d65d7cd98bc7f32d38c440d385dd7436=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 7c0a80ce2f115366b4020f83015a888234cbf51e0691ad26f47548d4b3181cc1=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 354758bd1937640e7559f60517a25787d65d7cd98bc7f32d38c440d385dd7436=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 354758bd1937640e7559f60517a25787d65d7cd98bc7f32d38c440d385dd7436=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 7c0a80ce2f115366b4020f83015a888234cbf51e0691ad26f47548d4b3181cc1=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 7c0a80ce2f115366b4020f83015a888234cbf51e0691ad26f47548d4b3181cc1=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # sha256sum /usr/local/lib/dri/i915_dri.so 354758bd1937640e7559f60517a25787d65d7cd98bc7f32d38c440d385dd7436=20 /usr/local/lib/dri/i915_dri.so root@ltop:~ # date Tue Jul 19 20:48:34 CEST 2022 As you can see static file such as this outputs two different checksums wit= hin small timespan. This seems like an i/o error.=20 What could be possible cause of this? As I stated before, the t480 both motherboards, drives and cables for drives are new. The BIOS version is 1.44 (also newest one as of today).=20 Could that be possibly caused by drivers? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 20 05:20:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LnkYB5cPlz4X4Dq for ; Wed, 20 Jul 2022 05:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LnkYB3nRmz3ndR for ; Wed, 20 Jul 2022 05:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LnkYB2cvGzmVF for ; Wed, 20 Jul 2022 05:20:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26K5KEKE073524 for ; Wed, 20 Jul 2022 05:20:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26K5KEnB073523 for fs@FreeBSD.org; Wed, 20 Jul 2022 05:20:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265222] T480 zfs checksum mismatch error Date: Wed, 20 Jul 2022 05:20:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658294414; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=07+a6oByh1U1JEASCyMB6825QvNHwozjLu1ZFI0ctJs=; b=v0703/a4R+p5devWXh0+eKclgIwn2NAECr+3teRWvbNroU76Mj3x3kQGazA6NhBFfposR/ 6rS2bMAoB8hQm6spHE0T9CkhDMjwwqiEaitxNN29VJ/nnm8YGDApjOJIX1mhugjil5WKxR cqR3b9CR9aYSkBMzMApYf18/MIuwJY7urZsOlwMKkuenSMjUzZIL/0st6Okfq6Ox1jAD24 2tK7a1gtrflHIdgFr/MKxneS3/dATr0QE+vJ9XkQ2hym6/xmHdYNaiGh+zXkWj8VF+viUR XNgrEeJ656yL5UzLe5uRJUYvi+KQxqCv1M6nqoeO0GQaF+rRo+j748pLmZHBQw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658294414; a=rsa-sha256; cv=none; b=YHlYTbzSUDiKxf9ZJxd6FuproPDkt1XfFfJwMOTOAwCgLxiiNKgy+rAU1szR4NXCJCXy+A tzfmO/hyR34+ShR9dIUR3ocF8wHJxayboDCugh6dBpTJ3h254S3q658wttVFfRLfrkyrsY DCuUff4BIKhwWDlpFwnQZmU/eVyPTwAIef1/MI+F44NxpiQqyZ6GMAuVWkPdSqoZYBXnmH o9ncStVMYSzS1EZiC8wQEWsO83UfdIw8VLJTr5wGU1bKlXI7xY5J3I2DM46dbq/65vQq6d uWOJw/Cjk8rlx9OJwaXp8zaguXBl6tCkqoGaVmNDGiEwfo7JniQwFtwbt+a7sw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265222 --- Comment #5 from Graham Perrin --- (In reply to Mellowlink from comment #4) Thanks, the USF suggestion was in the context of StressDisk (i.e. to not use ZFS for this). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Jul 20 05:20:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LnkYq1lL9z4X4CX for ; Wed, 20 Jul 2022 05:20:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LnkYq0kz0z3p9V for ; Wed, 20 Jul 2022 05:20:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LnkYp6vnkzmH4 for ; Wed, 20 Jul 2022 05:20:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26K5Kk8a074460 for ; Wed, 20 Jul 2022 05:20:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26K5KknK074459 for fs@FreeBSD.org; Wed, 20 Jul 2022 05:20:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265222] T480 zfs checksum mismatch error Date: Wed, 20 Jul 2022 05:20:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658294447; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=A0IiK/TC4QQ7YKYd+WnqUfSc3gmYnJHFu+DG0p4eAE0=; b=TQM8qs+Ye6gpZJI8RjDvo0T8J+0hEtIlCxXmPvK9PAeBGTDMLjvwIphItQIDw5zMj7hxiy /F21G5bwxKHKk/KCf3joIjU2tF58OiPvK2U9UpWhAsDfyHwGqGo2tWu7T3d0Ywc/cKiblc 4Q6o2CY5NCfQPWa8CMqAtQSw13RkQyK4MlKyDOz5doN43WNU8lw23NDolQkiEo2UUJNx9e yZ8bSjzuL3j7Ux3itRow92mMLrWOX1hpDFuY2CE5gMzxN5d++1mXS9Jsqz/PMeeA69JopU ml6MHUK9ZJvz3GhTqPhMvash8khXCLUkJxtTuwKUoWmDD9tWtf+wdiYY6jFbKw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658294447; a=rsa-sha256; cv=none; b=IhdROrFqQUHLeW5Dj/zzVpA8fnpfhijzxO1kfaLCZKEbLA8bTiArM8bR97+z4Wpp40jdiJ QLE/9IDcV5FPJvn0iFghqh6O2wBuDOO/CuZcE4EsWshei6iFibmL/HxyflViVFpqKJoUfn cP48CA4pMynEFKi3RbUaq102beV0+ycrQuG7C4JIkDuM/ubpLZfsqCp1FnTI8NWnoPagW0 oZIxcm9hG/mZh78Mgc9fRkPfIrTdqZRSuor7JvA1dNk62bjwanvzJlVUbSlVRPOhfBZsKz j0HUuHS6fttJhdSR96/TY533RKX/+4Mzd8s4dJS88PfplQSyVxxgmexKAuc4hA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265222 --- Comment #6 from Graham Perrin --- (In reply to Graham Perrin from comment #5) UFS, not USF. Sorry. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Jul 23 08:33:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LqfhL43msz4X4FN; Sat, 23 Jul 2022 08:33:06 +0000 (UTC) (envelope-from bogdan-lists@neant.ro) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LqfhK69Lfz3Zfp; Sat, 23 Jul 2022 08:33:05 +0000 (UTC) (envelope-from bogdan-lists@neant.ro) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 67CD35C00BC; Sat, 23 Jul 2022 04:33:05 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Sat, 23 Jul 2022 04:33:05 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=neant.ro; h=cc :content-transfer-encoding:content-type:date:date:from:from :in-reply-to:message-id:mime-version:reply-to:sender:subject :subject:to:to; s=fm3; t=1658565185; x=1658651585; bh=UXBBzg3cvI owHKiAVE84bpcjil0hhP+WhPNmicmAEaQ=; b=nvdlyQnAsWzSZC5sTC399+rKTS puENflWsweOm2dncfrjBl1kS6THU1G3NzNQsZ77azlu5e+k0Fpdl1DuK6OqiRGOS Ym/HQqbRVg6KvmlNBAdt4LURlcaxRECsupQccFVRza2DngvmS4UhHyuMgb8vkf1H /RfF6tdMaCmToo4qahBMLmP9vVMVrgUTec/Lyfeflv7Iv8vG1QHgTEZF3SgAyKEB mXX6BxHKnFmthtwd9u24jwEc/Kg/lViQkFmD05eRapZAOB3ErPATH1HhS1XJfg4l KxAmymNYNVJRsM/kichZywPrwrLvTZQ8JwhjqPWC/sYwli5B1pFdm+MF0HQQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:date:feedback-id:feedback-id:from:from:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1658565185; x=1658651585; bh=UXBBzg3cvIowHKiAVE84bpcjil0h hP+WhPNmicmAEaQ=; b=PPKCtEdRrPcy+nL9c9oWJKHlbO3Npm6KcrMCJQO6V7e9 G8NXck2QsW5X/ykoaeVIweNk6rreBE30cKiaUjQ3J8FXUFc39iyGWVWsT2jwXHl/ 13FuSRyIPPYtmi6A0nA/sXp4PegJ63SIct0U+tV9rQOHBdN0nP9heozzxng+dngL 0BN21mPDx0i8f/W64JDqacvDmhAlTDn+QpJUlYA0MwRtWs0RXxJgGhbEDoZYhcAn WRCHUdYCvItAR7PHv1hLD9qjVPXTU2SAacBFNzbCY9Nsb64ZUa3+uhyo+UErae9j 3I5wN10K9ut6VxfYxWNQz0BKMyWZ5/lGI5D5Bu5CqA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrvddtgedgtdejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefhtgfgggfukfffvffosehtqhhmtd hhtdejnecuhfhrohhmpegsohhguggrnhdqlhhishhtshesnhgvrghnthdrrhhonecuggft rfgrthhtvghrnhepkeevvdekheehleefteefheetteefueehkeffgeeitdefueegteeuje dvueevueejnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepsghoghgurghnqdhlihhsthhssehnvggrnhhtrdhroh X-ME-Proxy: Feedback-ID: i61d94637:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sat, 23 Jul 2022 04:33:04 -0400 (EDT) From: bogdan-lists@neant.ro Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.100.31\)) Subject: AWS - UFS corrupted when restoring from AWS Backup service Message-Id: <11F07F6C-E93B-42E3-BD27-3FEC4E342B1A@neant.ro> Date: Sat, 23 Jul 2022 11:33:03 +0300 To: freebsd-fs@freebsd.org, freebsd-cloud@freebsd.org X-Mailer: Apple Mail (2.3696.100.31) X-Rspamd-Queue-Id: 4LqfhK69Lfz3Zfp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=neant.ro header.s=fm3 header.b=nvdlyQnA; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=PPKCtEdR; dmarc=none; spf=pass (mx1.freebsd.org: domain of bogdan-lists@neant.ro designates 66.111.4.29 as permitted sender) smtp.mailfrom=bogdan-lists@neant.ro X-Spamd-Result: default: False [-4.10 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[neant.ro:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-cloud@freebsd.org,freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FROM_NO_DN(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[neant.ro:+,messagingengine.com:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DMARC_NA(0.00)[neant.ro]; RCVD_VIA_SMTP_AUTH(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hello, TL;DR: We have a bunch of EC2 machines in AWS running FreeBSD. AMI from = Market, file system is UFS. We have AWS Backup service taking hourly = snapshots of these machines (AMI + EBS snapshots I believe). After a few = months of snapshots we had to restore one of them and found out that the = file system is corrupted and fsck was not able to recover it. We are = going to enable sync in fstab, see if that helps, but it=E2=80=99s hard = to know because it is hard to reproduce the problem, and details about = how everything works are fuzzy to me. Longer version: We use FreeBSD on web servers in AWS. Until January we were doing weekly = AMI snapshots by running a script that would shut down the machine, = create the AMI, then start the machine back up. Which worked for a long = time, but is less than ideal and shutting down production more often = than weekly is rude. At the start of this year we switched to running AWS Backup hourly. It = takes snapshots of a running machine without stopping it. I believe = it=E2=80=99s the same as creating an AMI and checking the =E2=80=9CNo = reboot=E2=80=9D checkbox. It should use the same API call, but I = wouldn=E2=80=99t know. We ran a few recovery tests, we read the docs, we = confirmed with support, everything looked like it should work with no = issues. A couple of weeks ago the EBS disk on one of the machines failed and we = needed to restore it. When we did, it ran fsck on boot (which it = didn=E2=80=99t on our previous tests) and failed to recover it, so the = machine was effectively dead. I know we can mount the disk on a = different machine and recover (some) data, that=E2=80=99s not the point. = We tried a few backups going back two weeks, same issue. We tried a few = more instances, about 5, all of them ran fsck on boot. A couple were = recovered, but it doesn=E2=80=99t matter, it still means it=E2=80=99s = not working as we thought. So now we=E2=80=99re effectively running = without backups on EC2 instances. I=E2=80=99m not sure why it happens. Information is sparse and I=E2=80=99m= making a lot of assumptions. Basically I believe that the snapshot = process is equivalent to cutting off power to the machine and that = happens every hour for months. The docs on UFS soft updates say that = there=E2=80=99s a small chance of data loss, but since that = power-cutting snapshot happens every hour over a time of months, that = chance isn=E2=80=99t that small any more. Still, apparently Linux = doesn=E2=80=99t have this problem, and everywhere I read it says that = data might be lost, but the file system should not be corrupted. And yet = fsck isn=E2=80=99t always able to recover it. As far as I understand, with soft updates and =E2=80=9Cnoasync=E2=80=9D = in fstab (default), data is flushed to disk about every 30 seconds = (according to syncer man page), asynchronously, while metadata is = written synchronously. I=E2=80=99m thinking that maybe that=E2=80=99s an = issue and turning on sync in fstab might help. On the other hand, the = man page for syncer says =E2=80=9CIt is possible on some systems that a = sync(2) occurring simultaneously with a crash may cause file system = damage.=E2=80=9D, which means it might make it worse? I don=E2=80=99t = know. We were not able to reproduce the problem reliably so that we can test. = I=E2=80=99m not sure if or how anyone can help. I just wanted to send = this message so that at least some other people are aware that AWS = Backup doesn=E2=80=99t play nice with FreeBSD.= From nobody Sun Jul 24 16:54:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LrTmP0PdSz4X27d for ; Sun, 24 Jul 2022 16:54:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LrTmN6Lqdz3FbW for ; Sun, 24 Jul 2022 16:54:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LrTmN5Qh3zQPW for ; Sun, 24 Jul 2022 16:54:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26OGsSTf099654 for ; Sun, 24 Jul 2022 16:54:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26OGsSQc099653 for fs@FreeBSD.org; Sun, 24 Jul 2022 16:54:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253428] getdirentries does not work correctly on NFS mounts Date: Sun, 24 Jul 2022 16:54:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rmacklem@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658681668; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bGq/+OPFhHpttvM8IZpONFnfjQgn17e1/9g3NOOcRfM=; b=EIJSlkJjBTVkaV59d8peQkJrrTPeH9kPkJWHiTRhMBOgn0keiahFfaESU25FPx7gQ8F0Zx t9eTyhkOYv7KdU4NEtapSO06ple2PdsbniP/82yCmjL/nsPLubhvSlRsVwxRWPIhSYTW3l k2Z+HDJO/H5vI51VS0rEqoJL7t/ufgdUFfP44LrxMLaTS9E+8488sedYl5a0A9c8F5MgDs 5czgnk7oCrrkMYqgEhdD1jRBjVRcGyxPMEyuMY6iAqoEYQjY8L6VyD6DiGAhbEDFX7DiDY v50r+MaFDXzulYj6r55FCnrknXN1GxlZVfbzzaQ3dzcYemUEvy7Sdcoy89Y8xQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658681668; a=rsa-sha256; cv=none; b=EDMiwFYHOK5ciRsKAss4i9Ul7SGgeo0V48qqGY8MHn/jzCeCNyx4jDrBZcLdWHtbx0XEKL tk2qwCOO10ynPvUSjh43/AM82HMRpReqKgeo4fcEVBdlL8aOMkNmtc/TcxqW6tJdzUnqvh R8ECGneO4hsXBJJvxsrHdX8s3fpoKEdMIR7egCckSs7T/875qrx78gVa1ZqaLl+IoGZw13 GRo0QFrt8o9LDwdZuGt5ZnU4w4q6Bd9fnRNHKFW8hkw2kvcm8xQZz7pRtPcXT7hZAbAqrv y6bwna4wRcQ98IWd9sTrOq5TI8L20iqthXL9wVQBYYboIWCroh9WOtQJ3Jxg8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253428 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |rmacklem@FreeBSD.org --- Comment #15 from Alan Somers --- Assigning to committer. Rick, can we close this bug? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 24 17:46:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LrVwS5dXPz4X7xW for ; Sun, 24 Jul 2022 17:46:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LrVwS2wwCz3MkJ for ; Sun, 24 Jul 2022 17:46:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LrVwS1zXXzRgK for ; Sun, 24 Jul 2022 17:46:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26OHkWST031589 for ; Sun, 24 Jul 2022 17:46:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26OHkWwY031587 for fs@FreeBSD.org; Sun, 24 Jul 2022 17:46:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252700] page fault in zfsctl_snapdir_lookup Date: Sun, 24 Jul 2022 17:46:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bugs.freebsd@benshort.co.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658684792; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=O5OIQSjoCt+E5jArrtVPdhCCBG9Cg2uS4PiMpiYv/OU=; b=mC2ZdE0Ad9FjUrMJvTHvjUJw6kPZC80TcPU18dKmIcggYFLHn0l3I+cxNNcX9kqnDf/0TV GG7SVTMxeEfWFgpArDErNdjN/VNdeghgeuf62ZdD42XOVqNb7qpCkRL3/AyocSP5XAmKvF bAWJSSYYaL6tFzsZr1bYn2F1HvDPBtwKxvtKQxvC7DsdzL6ydJafrNzrE+CESsqtAoelm6 OTUWjzQgvudqYirIxvO8ZGFlUk02qT90UwH/LsT+iC/+nr+UlX/1pGpE3v3vQtNeFr1smH I6EHkpF4EsSyrVQETePCBFf9kTD52/4Ejdy9E/aBXwEWutmrCOt0h35XXcUPnQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658684792; a=rsa-sha256; cv=none; b=yK4sf2iaIOHxDwvu2esOeTTQOXnIHmo/LkdtEXwmHFr3xi1+VSf7t9a5dtFgw5IrImUU8R 3ZCCkZG0kWtHQS6Jp0ZadUgERjnYTW7fxMXpG2uX6tzd0T57xhYtJPB1wN0Po+T84jNOTs nchi8mhgwEJdzX+J8MbPJtCpuxaRzloAwD7H2kGDe7wUms7FtA8tDl1cnproWOlj8m4xeM erOnZzGJsrucsSK9mW2PYHnS56rNsrQreQ77S1DsQiH66MdYkfGM+hQ702WnSOTjghE43F fC5+uq4jugMJSgDCeVzVYmLEReaGSJyB2PIGnhff6Nq7NPDnhinWwLcPidfCFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252700 bugs.freebsd@benshort.co.uk changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bugs.freebsd@benshort.co.uk --- Comment #2 from bugs.freebsd@benshort.co.uk --- I'm seeing the same issue on FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64 GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD] Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.1". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid =3D 9; apic id =3D 09 fault virtual address =3D 0x0 fault code =3D supervisor read instruction, page not present instruction pointer =3D 0x20:0x0 stack pointer =3D 0x28:0xfffffe028bcc8588 frame pointer =3D 0x28:0xfffffe028bcc85a0 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 1426 (rover) trap number =3D 12 panic: page fault cpuid =3D 9 time =3D 1658680663 KDB: stack backtrace: #0 0xffffffff80c69465 at kdb_backtrace+0x65 #1 0xffffffff80c1bb1f at vpanic+0x17f #2 0xffffffff80c1b993 at panic+0x43 #3 0xffffffff810afdf5 at trap_fatal+0x385 #4 0xffffffff810afe4f at trap_pfault+0x4f #5 0xffffffff81087528 at calltrap+0x8 #6 0xffffffff80cf8ab6 at vgonel+0x186 #7 0xffffffff80cf9171 at vgone+0x31 #8 0xffffffff80ce799d at vfs_hash_insert+0x26d #9 0xffffffff8216b069 at sfs_vgetx+0x149 #10 0xffffffff8216bc54 at zfsctl_snapdir_lookup+0x1e4 #11 0xffffffff80ce9bbc at lookup+0x45c #12 0xffffffff80ce8de9 at namei+0x259 #13 0xffffffff80d06953 at kern_statat+0xf3 #14 0xffffffff80d0704f at sys_fstatat+0x2f #15 0xffffffff810b06ec at amd64_syscall+0x10c #16 0xffffffff81087e3b at fast_syscall_common+0xf8 Uptime: 21h32m34s Dumping 6645 out of 130655 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%.= .91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 /usr/src/sys/amd64/include/pcpu_aux.h: No such file or directory. (kgdb) BT Undefined command: "BT". Try "help". (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown= .c:399 #2 0xffffffff80c1b71c in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1bb8e in vpanic (fmt=3D0xffffffff811b4fb9 "%s", ap=3D) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff80c1b993 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:844 #5 0xffffffff810afdf5 in trap_fatal (frame=3D0xfffffe028bcc84c0, eva=3D0) = at /usr/src/sys/amd64/amd64/trap.c:944 #6 0xffffffff810afe4f in trap_pfault (frame=3D0xfffffe028bcc84c0, usermode=3Dfalse, signo=3D, ucode=3D) at /usr/src/sys/amd64/amd64/trap.c:763 #7 #8 0x0000000000000000 in ?? () #9 0xffffffff8117c26c in VOP_CLOSE_APV (vop=3D0xffffffff82438a70 , a=3Da@entry=3D0xfffffe028bcc85b0) at vnode_if.c:498 #10 0xffffffff80cf8ab6 in VOP_CLOSE (vp=3D0xfffff812e9da97a0, fflag=3D4, cr= ed=3D0x0, td=3D0xfffffe0205592720) at ./vnode_if.h:249 #11 vgonel (vp=3Dvp@entry=3D0xfffff812e9da97a0) at /usr/src/sys/kern/vfs_subr.c:4088 #12 0xffffffff80cf9171 in vgone (vp=3Dvp@entry=3D0xfffff812e9da97a0) at /usr/src/sys/kern/vfs_subr.c:3963 #13 0xffffffff80ce799d in vfs_hash_insert (vp=3D0xfffff812e9da97a0, hash=3D= 2907, hash@entry=3D2345438256, flags=3Dflags@entry=3D2097152, td=3D, td@entry=3D0xfffffe0205592720, vpp=3Dvpp@entry=3D0xfffffe028bcc8c30, fn=3D<= optimized out>, arg=3D0xfffff81b0101a000) at /usr/src/sys/kern/vfs_hash.c:181 #14 0xffffffff8216b069 in sfs_vnode_insert (vp=3D0xfffffe028bcc85b0, flags=3D2097152, vpp=3D0xfffffe028bcc8c30, parent_id=3D, id= =3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:152 #15 sfs_vgetx (mp=3D0xfffffe028ae5ab00, flags=3Dflags@entry=3D2097152, parent_id=3Dparent_id@entry=3D2, id=3D, tag=3D, vops=3D0xffffffff82438a70 , setup=3D0xffffffff8216c360 , arg=3D0xfffffe028bcc8820, vpp=3D0xfffffe028b= cc8c30) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:200 #16 0xffffffff8216bc54 in zfsctl_snapdir_lookup (ap=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:954 #17 0xffffffff80ce9bbc in VOP_LOOKUP (dvp=3D0xfffff808e5418000, vpp=3D0xfffffe028bcc8c30, cnp=3D0xfffffe028bcc8c58) at ./vnode_if.h:65 #18 lookup (ndp=3Dndp@entry=3D0xfffffe028bcc8bd8) at /usr/src/sys/kern/vfs_lookup.c:1086 #19 0xffffffff80ce8de9 in namei (ndp=3Dndp@entry=3D0xfffffe028bcc8bd8) at /usr/src/sys/kern/vfs_lookup.c:616 #20 0xffffffff80d06953 in kern_statat (td=3D0xfffffe0205592720, flag=3D, fd=3D-100, path=3D0x0, pathseg=3D(unknown: 0x5592c30), pathseg@entry=3DUIO_USERSPACE, sbp=3Dsbp@entry=3D0xfffffe028bcc8d18, hook= =3D0x0) at /usr/src/sys/kern/vfs_syscalls.c:2441 #21 0xffffffff80d0704f in sys_fstatat (td=3D0xfffffe028bcc85b0, uap=3D0xfffffe0205592b08) at /usr/src/sys/kern/vfs_syscalls.c:2418 #22 0xffffffff810b06ec in syscallenter (td=3D0xfffffe0205592720) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #23 amd64_syscall (td=3D0xfffffe0205592720, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1185 #24 #25 0x000000080134139a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffde18 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 24 21:00:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LrbDp01gLz4XXn0 for ; Sun, 24 Jul 2022 21:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LrbDn50PTz3jDy for ; Sun, 24 Jul 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LrbDn45k0zY6w for ; Sun, 24 Jul 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26OL0vUn049325 for ; Sun, 24 Jul 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26OL0vmV049324 for fs@FreeBSD.org; Sun, 24 Jul 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202207242100.26OL0vmV049324@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 24 Jul 2022 21:00:57 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16586964572.d329eD.46589" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658696457; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=FSxg7p2kM8tlfyIPCSGbqI4I2RxuyTexy7Bj9HnbEG8=; b=mtlVL4who0eINrNYM6QGCzXj6Z9iUJXILLZcB2vxKXY7kbwIG2vAyAqN3m/4w7wFNav7Af OXoXATe2La7p07cLozdpaMbqkFPYJeFUWWmfNfgnnIINleXkYw5lYGuCD2j/Pved1VmLNj SjcYwVjrl2f3BRN3KMwxDGsWA9iaUNgCy/s8RvxPXtnNXNf+963ApKjtGRv3iaz9TY4O8O 6TGZpQOREq6+a8xMkSVVPgTGdTO0ZMoFpVEJTndzvDf8El9+94d5NwQDqu6UBXeuXCA7bm ntD93eWN6crkqKwjKSPFOAG8QxXTHPgxGcoz3A5rv20zYVubFTuykr5DzG1Faw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658696457; a=rsa-sha256; cv=none; b=Y+lo44zb+gzofr/5gECSNw0MEuElNZeKGHP49k6BOiRLN/mWfBGMEdx6Q5F2cWeM+SUaS1 FDKHSVdWLU4vAyLuc/W7BdQHfHZ7FPXF90KQzNvrq+30o1BWuvlEbuVQANcBb3lbG1b0rW rsHuXh7hlK8riy1s8M6WYdfG0q7Yub8Lm9JH4DTXAM6K+otvlUFlfCMiCWHpwKKArxRzTA oNtwX8HSMZeqqGuM5gFiUoyZrpZGkdYIntQgC33zeVbPoKpUpR+OZngd/e43MUwuVqzAOQ WQ5VYmsVrtCUjp8hit2hAHe5+kqcd+dDc6JP2gpIS2JqrF53l9laY/+lk/cwCg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16586964572.d329eD.46589 Date: Sun, 24 Jul 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16586964572.d329eD.46589 Date: Sun, 24 Jul 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16586964572.d329eD.46589-- From nobody Tue Jul 26 07:53:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LsTgW2RsMz4XTRZ for ; Tue, 26 Jul 2022 07:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LsTgW1966z3YFM for ; Tue, 26 Jul 2022 07:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LsTgW0DfwzT7Q for ; Tue, 26 Jul 2022 07:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26Q7rg9C041824 for ; Tue, 26 Jul 2022 07:53:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26Q7rg1S041823 for fs@FreeBSD.org; Tue, 26 Jul 2022 07:53:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265424] vfs.zfs.arc_min ignored in /boot/loader.conf but works in /etc/sysctl.conf Date: Tue, 26 Jul 2022 07:53:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658822023; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dzMVUzrIjI9ZDj+gqIiMP4BmBRYtMHE1axZY9gtieO8=; b=r2YPSmDbpAFiux37/aR8eX6dNh72JjJRcSNz3eifIO7FL+1uhk4gaf5Dc3Gy/CmvPWfYyJ +Hc7ALixKkPmn7JegECfpY30IYtynAIY5Fcl8M87f4jG/imeZEnE4n56lR4CK33FMtkYM2 iwZugwREAa1B25y25iPvhBIE/deWn3BZLLXEH+mL7m+Gb6oNsozVaogDmXtOliGsBtFwDL p+BnTd8UiwRO9/bCEdLjYQkc5pkHkp2x2rytOnxNP+mnqU/yB1H26vt//eeWYg5I0EzEFp NHn40VbvX4X/dbQ60Co0TCzKtIEnTteLZsQFICyjf2xYDILX/b72pHicT2gYOg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658822023; a=rsa-sha256; cv=none; b=DGdvJn7aPV/o6j5MvYgjOvM5tJci2h/7EyCqSl04v1SJFZBm85KXA4AoBX7bF/MvuhqrhW R8v3pFuNYi9u2UYmqr+nnD6MPcT3wpSAU6d+4ZNBmgEP8da1y1+MTSKk6BrAqqYMAxGYi5 FaBfaUZpgzBNemHOxvFNUxrBm65hnom78gbN+gkSbM9B6q25yxbNge2WxmF/ODGYGnRv+r iONNn7lZgKd2DjjnrGter95kIYbnZ+N5FN/QOpOLweTJ6FylixpfGzsvoV1q7sBpStJo+l azRRT31ZkzdHT9iaryAZHLyiXzxOo0vrK2f2iXOYvbT9D0/SO5e72Rq1N16nYw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265424 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jul 26 11:56:02 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lsb3H5tp3z4WpP4 for ; Tue, 26 Jul 2022 11:56:11 +0000 (UTC) (envelope-from ben@benshort.co.uk) Received: from mx1.mythic-beasts.com (mx1.mythic-beasts.com [IPv6:2a00:1098:0:86:1000:0:2:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lsb3G6jm9z3vXZ for ; Tue, 26 Jul 2022 11:56:10 +0000 (UTC) (envelope-from ben@benshort.co.uk) Received: from [81.2.95.205] (port=60170 helo=[192.168.1.113]) by mailhub-cam-d.mythic-beasts.com with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1oGJAW-005dNj-L0 for freebsd-fs@FreeBSD.org; Tue, 26 Jul 2022 12:56:08 +0100 Content-Type: multipart/alternative; boundary="------------7qJ3A30QgeYr3GxV3Dzc66FR" Message-ID: <37cb8864-047f-2895-ce87-f55569f8bf04@benshort.co.uk> Date: Tue, 26 Jul 2022 12:56:02 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.11.0 Content-Language: en-US To: freebsd-fs@FreeBSD.org From: Ben Short Subject: Kernel panic during zfsctl_snapdir_lookup X-BlackCat-Spam-Score: 9 X-Spam-Status: No, score=0.9 X-Rspamd-Queue-Id: 4Lsb3G6jm9z3vXZ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ben@benshort.co.uk designates 2a00:1098:0:86:1000:0:2:1 as permitted sender) smtp.mailfrom=ben@benshort.co.uk X-Spamd-Result: default: False [-2.50 / 15.00]; URI_COUNT_ODD(1.00)[13]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1098::86:1000:0:2:0/112]; RCVD_IN_DNSWL_MED(-0.20)[2a00:1098:0:86:1000:0:2:1:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ASN(0.00)[asn:44684, ipnet:2a00:1098::/32, country:GB]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[ben]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DMARC_NA(0.00)[benshort.co.uk]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --------------7qJ3A30QgeYr3GxV3Dzc66FR Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit |Hi, I'm getting a kernel panic ||on FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64 It was reported previously https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252700 for FreeBSD 13.0 GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD] Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.1". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid = 8; apic id = 08 fault virtual address = 0x0 fault code = supervisor read instruction, page not present instruction pointer = 0x20:0x0 stack pointer = 0x28:0xfffffe0259f2e588 frame pointer = 0x28:0xfffffe0259f2e5a0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 34934 (rover) trap number = 12 panic: page fault cpuid = 8 time = 1658507833 KDB: stack backtrace: #0 0xffffffff80c69465 at kdb_backtrace+0x65 #1 0xffffffff80c1bb1f at vpanic+0x17f #2 0xffffffff80c1b993 at panic+0x43 #3 0xffffffff810afdf5 at trap_fatal+0x385 #4 0xffffffff810afe4f at trap_pfault+0x4f #5 0xffffffff81087528 at calltrap+0x8 #6 0xffffffff80cf8ab6 at vgonel+0x186 #7 0xffffffff80cf9171 at vgone+0x31 #8 0xffffffff80ce799d at vfs_hash_insert+0x26d #9 0xffffffff82180069 at sfs_vgetx+0x149 #10 0xffffffff82180c54 at zfsctl_snapdir_lookup+0x1e4 #11 0xffffffff80ce9bbc at lookup+0x45c #12 0xffffffff80ce8de9 at namei+0x259 #13 0xffffffff80d06953 at kern_statat+0xf3 #14 0xffffffff80d0704f at sys_fstatat+0x2f #15 0xffffffff810b06ec at amd64_syscall+0x10c #16 0xffffffff81087e3b at fast_syscall_common+0xf8 Uptime: 3h48m1s Dumping 5730 out of 130655 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 /usr/src/sys/amd64/include/pcpu_aux.h: No such file or directory. (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c1b71c in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1bb8e in vpanic (fmt=0xffffffff811b4fb9 "%s", ap=) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff80c1b993 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:844 #5 0xffffffff810afdf5 in trap_fatal (frame=0xfffffe0259f2e4c0, eva=0) at /usr/src/sys/amd64/amd64/trap.c:944 #6 0xffffffff810afe4f in trap_pfault (frame=0xfffffe0259f2e4c0, usermode=false, signo=, ucode=) at /usr/src/sys/amd64/amd64/trap.c:763 #7 #8 0x0000000000000000 in ?? () #9 0xffffffff8117c26c in VOP_CLOSE_APV (vop=0xffffffff8244da70 , a=a@entry=0xfffffe0259f2e5b0) at vnode_if.c:498 #10 0xffffffff80cf8ab6 in VOP_CLOSE (vp=0xfffff81e88fdc988, fflag=4, cred=0x0, td=0xfffffe02054e8e40) at ./vnode_if.h:249 #11 vgonel (vp=vp@entry=0xfffff81e88fdc988) at /usr/src/sys/kern/vfs_subr.c:4088 #12 0xffffffff80cf9171 in vgone (vp=vp@entry=0xfffff81e88fdc988) at /usr/src/sys/kern/vfs_subr.c:3963 #13 0xffffffff80ce799d in vfs_hash_insert (vp=0xfffff81e88fdc988, hash=136416, hash@entry=1509092400, flags=flags@entry=2097152, td=, td@entry=0xfffffe02054e8e40, vpp=vpp@entry=0xfffffe0259f2ec30, fn=, arg=0xfffff815afc90300) at /usr/src/sys/kern/vfs_hash.c:181 #14 0xffffffff82180069 in sfs_vnode_insert (vp=0xfffffe0259f2e5b0, flags=2097152, vpp=0xfffffe0259f2ec30, parent_id=, id=) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:152 #15 sfs_vgetx (mp=0xfffffe02494c8ac0, flags=flags@entry=2097152, parent_id=parent_id@entry=2, id=, tag=, vops=0xffffffff8244da70 , setup=0xffffffff82181360 , arg=0xfffffe0259f2e820, vpp=0xfffffe0259f2ec30) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:200 #16 0xffffffff82180c54 in zfsctl_snapdir_lookup (ap=) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:954 #17 0xffffffff80ce9bbc in VOP_LOOKUP (dvp=0xfffff80be30a4988, vpp=0xfffffe0259f2ec30, cnp=0xfffffe0259f2ec58) at ./vnode_if.h:65 #18 lookup (ndp=ndp@entry=0xfffffe0259f2ebd8) at /usr/src/sys/kern/vfs_lookup.c:1086 #19 0xffffffff80ce8de9 in namei (ndp=ndp@entry=0xfffffe0259f2ebd8) at /usr/src/sys/kern/vfs_lookup.c:616 #20 0xffffffff80d06953 in kern_statat (td=0xfffffe02054e8e40, flag=, fd=-100, path=0x0, pathseg=(unknown: 0x54e9350), pathseg@entry=UIO_USERSPACE, sbp=sbp@entry=0xfffffe0259f2ed18, hook=0x0) at /usr/src/sys/kern/vfs_syscalls.c:2441 #21 0xffffffff80d0704f in sys_fstatat (td=0xfffffe0259f2e5b0, uap=0xfffffe02054e9228) at /usr/src/sys/kern/vfs_syscalls.c:2418 #22 0xffffffff810b06ec in syscallenter (td=0xfffffe02054e8e40) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #23 amd64_syscall (td=0xfffffe02054e8e40, traced=0) at /usr/src/sys/amd64/amd64/trap.c:1185 #24 #25 0x000000080134139a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffde18 (kgdb)| --------------7qJ3A30QgeYr3GxV3Dzc66FR Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit 
Hi,

I'm getting a kernel panic on FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64

It was reported previously https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252700 for FreeBSD 13.0


GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD]
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd13.1".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/kernel/kernel...
Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid = 8; apic id = 08
fault virtual address   = 0x0
fault code              = supervisor read instruction, page not present
instruction pointer     = 0x20:0x0
stack pointer           = 0x28:0xfffffe0259f2e588
frame pointer           = 0x28:0xfffffe0259f2e5a0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 34934 (rover)
trap number             = 12
panic: page fault
cpuid = 8
time = 1658507833
KDB: stack backtrace:
#0 0xffffffff80c69465 at kdb_backtrace+0x65
#1 0xffffffff80c1bb1f at vpanic+0x17f
#2 0xffffffff80c1b993 at panic+0x43
#3 0xffffffff810afdf5 at trap_fatal+0x385
#4 0xffffffff810afe4f at trap_pfault+0x4f
#5 0xffffffff81087528 at calltrap+0x8
#6 0xffffffff80cf8ab6 at vgonel+0x186
#7 0xffffffff80cf9171 at vgone+0x31
#8 0xffffffff80ce799d at vfs_hash_insert+0x26d
#9 0xffffffff82180069 at sfs_vgetx+0x149
#10 0xffffffff82180c54 at zfsctl_snapdir_lookup+0x1e4
#11 0xffffffff80ce9bbc at lookup+0x45c
#12 0xffffffff80ce8de9 at namei+0x259
#13 0xffffffff80d06953 at kern_statat+0xf3
#14 0xffffffff80d0704f at sys_fstatat+0x2f
#15 0xffffffff810b06ec at amd64_syscall+0x10c
#16 0xffffffff81087e3b at fast_syscall_common+0xf8
Uptime: 3h48m1s
Dumping 5730 out of 130655 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
55      /usr/src/sys/amd64/include/pcpu_aux.h: No such file or directory.
(kgdb) bt
#0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
#1 doadump (textdump=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:399
#2 0xffffffff80c1b71c in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:487
#3 0xffffffff80c1bb8e in vpanic (fmt=0xffffffff811b4fb9 "%s", ap=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:920
#4 0xffffffff80c1b993 in panic (fmt=<unavailable>) at /usr/src/sys/kern/kern_shutdown.c:844
#5 0xffffffff810afdf5 in trap_fatal (frame=0xfffffe0259f2e4c0, eva=0) at /usr/src/sys/amd64/amd64/trap.c:944
#6 0xffffffff810afe4f in trap_pfault (frame=0xfffffe0259f2e4c0, usermode=false, signo=<optimized out>, ucode=<optimized out>) at /usr/src/sys/amd64/amd64/trap.c:763
#7 <signal handler called>
#8 0x0000000000000000 in ?? ()
#9 0xffffffff8117c26c in VOP_CLOSE_APV (vop=0xffffffff8244da70 <zfsctl_ops_snapshot>, a=a@entry=0xfffffe0259f2e5b0) at vnode_if.c:498
#10 0xffffffff80cf8ab6 in VOP_CLOSE (vp=0xfffff81e88fdc988, fflag=4, cred=0x0, td=0xfffffe02054e8e40) at ./vnode_if.h:249
#11 vgonel (vp=vp@entry=0xfffff81e88fdc988) at /usr/src/sys/kern/vfs_subr.c:4088
#12 0xffffffff80cf9171 in vgone (vp=vp@entry=0xfffff81e88fdc988) at /usr/src/sys/kern/vfs_subr.c:3963
#13 0xffffffff80ce799d in vfs_hash_insert (vp=0xfffff81e88fdc988, hash=136416, hash@entry=1509092400, flags=flags@entry=2097152, td=<optimized out>, td@entry=0xfffffe02054e8e40, vpp=vpp@entry=0xfffffe0259f2ec30, fn=<optimized out>, arg=0xfffff815afc90300) at /usr/src/sys/kern/vfs_hash.c:181
#14 0xffffffff82180069 in sfs_vnode_insert (vp=0xfffffe0259f2e5b0, flags=2097152, vpp=0xfffffe0259f2ec30, parent_id=<optimized out>, id=<optimized out>) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:152
#15 sfs_vgetx (mp=0xfffffe02494c8ac0, flags=flags@entry=2097152, parent_id=parent_id@entry=2, id=<optimized out>, tag=<optimized out>, vops=0xffffffff8244da70 <zfsctl_ops_snapshot>, setup=0xffffffff82181360 <zfsctl_snapshot_vnode_setup>, arg=0xfffffe0259f2e820, vpp=0xfffffe0259f2ec30)
at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:200
#16 0xffffffff82180c54 in zfsctl_snapdir_lookup (ap=<optimized out>) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c:954
#17 0xffffffff80ce9bbc in VOP_LOOKUP (dvp=0xfffff80be30a4988, vpp=0xfffffe0259f2ec30, cnp=0xfffffe0259f2ec58) at ./vnode_if.h:65
#18 lookup (ndp=ndp@entry=0xfffffe0259f2ebd8) at /usr/src/sys/kern/vfs_lookup.c:1086
#19 0xffffffff80ce8de9 in namei (ndp=ndp@entry=0xfffffe0259f2ebd8) at /usr/src/sys/kern/vfs_lookup.c:616
#20 0xffffffff80d06953 in kern_statat (td=0xfffffe02054e8e40, flag=<optimized out>, fd=-100, path=0x0, pathseg=(unknown: 0x54e9350), pathseg@entry=UIO_USERSPACE, sbp=sbp@entry=0xfffffe0259f2ed18, hook=0x0) at /usr/src/sys/kern/vfs_syscalls.c:2441
#21 0xffffffff80d0704f in sys_fstatat (td=0xfffffe0259f2e5b0, uap=0xfffffe02054e9228) at /usr/src/sys/kern/vfs_syscalls.c:2418
#22 0xffffffff810b06ec in syscallenter (td=0xfffffe02054e8e40) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189
#23 amd64_syscall (td=0xfffffe02054e8e40, traced=0) at /usr/src/sys/amd64/amd64/trap.c:1185
#24 <signal handler called>
#25 0x000000080134139a in ?? ()
Backtrace stopped: Cannot access memory at address 0x7fffffffde18
(kgdb)
--------------7qJ3A30QgeYr3GxV3Dzc66FR-- From nobody Tue Jul 26 15:43:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lsh5n1cmcz4XM5L for ; Tue, 26 Jul 2022 15:43:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lsh5n07DHz3Pbx for ; Tue, 26 Jul 2022 15:43:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lsh5m6HrPzjNZ for ; Tue, 26 Jul 2022 15:43:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26QFheMQ026280 for ; Tue, 26 Jul 2022 15:43:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26QFhehT026279 for fs@FreeBSD.org; Tue, 26 Jul 2022 15:43:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265424] vfs.zfs.arc_min ignored in /boot/loader.conf but works in /etc/sysctl.conf Date: Tue, 26 Jul 2022 15:43:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jon@xyinn.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658850221; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qenDf9wltMhbwCn4ZBBpY87WGOMago/XhKZGsj33sQo=; b=kMIg/S4d+TLuet6j/w4Y9J8agVMYwFh8uEy3Y3VlkqrvVjOGlITl2V+KvpBCAvQQSdmTMX JIk13AqAFZ9Lo7+3407jt7TQ09aw7mzDrqIx8djc2AoFOyuwK/WbKJnJvjfOdRgHej9gpI 36DD2EBd2fubdu2JwkjcjmkVRQVxQTTjzESSFYMEvyNnnlUJeiW+6yLJojsMm/u7XgPcJz 5zdbdRVpSGkuICc4QuTIN4A/W+YnM2ChfM3d+pH2+U9TNGQjBK+N1Oo2q+UN0M8tDm9H0y N7wsKX5/x//48lIeT4q58P5bNVLi+469Jwv4+exdDGCE77zgCkxSrlvR9TYtcQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658850221; a=rsa-sha256; cv=none; b=tg5rynRhchK912i57stETLtmBxTw1ZTsCebwrz0ay77YZ4bkLNn4qbBgBJ3dvIm9Rs6v9f x3wSRWc6XXhOeQGrDtMEvuMcmklPfu7o8tVEFP1gf4oddPsbm1oGHWZmiK8yUcr3cWq3pj ZhJlzgK5Z6Fidw+qDVFna1h5FLBSsLuXna/aQthHygzZiaH7FU+EN6Tx0pTU3Hsfvjdpjm Hn44SxYtwTvl5Ac7coXTgPDhNwFSAoFsf350a4w78qTTMsOJATL9u9w2HVGQzWXgeAtAne vwyiqAJSZsrtt/V9nEckR51DCm5WDThFTnK5Pw35W7fUANrnGD+XWuxK2VK+HQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265424 --- Comment #2 from Jonathan Vasquez --- Hey Graham, Thanks for that. I haven't tested it but even if that did end up working for /boot/loader.conf, it's still really unintuitive given that "arc_min" and "arc_max" are valid options as well. Of course one is under 'vfs.zfs' (more= top level) and one is under 'vfs.zfs.arc' as you mentioned. root@leslie:~ # sysctl vfs.zfs.arc.min vfs.zfs.arc.min: 4294967296 root@leslie:~ # sysctl vfs.zfs.arc.max vfs.zfs.arc.max: 8589934592 root@leslie:~ # sysctl vfs.zfs.arc_min vfs.zfs.arc_min: 4294967296 root@leslie:~ # sysctl vfs.zfs.arc_max vfs.zfs.arc_max: 8589934592 Any reason for the discrepancy? Is it a backwards compatibility reason? From the documentation, it seems the options mentioned (thus a reader would assu= me it also may be the recommended method to access that property) is with the underscore (arc_min, arc_max)? - Jonathan --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jul 29 03:05:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LvC8q0dlBz4XqxQ for ; Fri, 29 Jul 2022 03:06:35 +0000 (UTC) (envelope-from bycn82@gmail.com) Received: from mail-yw1-x1131.google.com (mail-yw1-x1131.google.com [IPv6:2607:f8b0:4864:20::1131]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LvC8p2ST7z3CjT; Fri, 29 Jul 2022 03:06:34 +0000 (UTC) (envelope-from bycn82@gmail.com) Received: by mail-yw1-x1131.google.com with SMTP id 00721157ae682-31bf3656517so38228707b3.12; Thu, 28 Jul 2022 20:06:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:reply-to:mime-version:from:to:cc; bh=CnK4zu5GUBc1JLuKNk30FarRgZTBC1MgI3MxuwnZY3Y=; b=mqzMCTxkYGs2GB0Wz5zYalsU00KZjSYs4Fg44mwURHd9naBsoCfxtZN4CFRpr9unvH cjpdIlLcMkmB1OCAkD15PneXaCvNdmRMjCDMoW40vU5LU9Crlxn9FkcomoKDfhCPWxm9 9d1mLxklsLdsgsqZTHHVgG9+zmDrJWYU4GiHGxdM6zsFgTOhgcDGCj65uqz734TWbuY/ mXigmR+8e1XOePwPjIwOIez6HvsDO1zCjUy3stvQYWc/8Ja9fck170J0ktMfvMPYRn4d AOeGELTHUyha+qkRKjeh9uLpDpkKMFCgvT7HQgqZHwvgqDfwhmYvCVDBUmkQaGOTnUMy EEpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:reply-to:mime-version :x-gm-message-state:from:to:cc; bh=CnK4zu5GUBc1JLuKNk30FarRgZTBC1MgI3MxuwnZY3Y=; b=4g25bHFuZc655yKz2cUPZqipKTN95rfUHgKcCja9FpgO+kPoMj+Zi8ocwy/ciiSbCn BBB5ntaRm1GasVEafkFdQ58yGhYi0Hp31JS+lKurlN4904yxRkNL4aKjh2qm6B/5ZtdS qgYc8l0VLJYlVNeqW7tiDaZXogB6Pbl6KcXGN3qCKZGKSqR0ih00i39R5zrulqX7rSej NkutO4cR3JwxSslLV4PrD1wbimxDBJnUIP8lp6gjEwPyeS1NKCd3t2FlKN/X1n9NryD0 A3M3yC+FOv/T8qgXDxxLnPyBigvfXtnADA2LHkGwmHBMFrNGDscRK9mqJFbLcoQRys1U VFdQ== X-Gm-Message-State: ACgBeo1lpXq/uDOsOfO5vXPRfVW0drBd/CNvrDD0yLVKolVtUUhVOSu7 864awn6sm1+u95b3zNj1vmvfXld6xnK2ReahXnMb1oPg/Fo= X-Google-Smtp-Source: AA6agR78LY2kpLKcWp3AFeFwdz2EAzSRMAi7YZ99N/WlNgzK9Hc2fN+BbvgMUoByjbv5E+kgMzMK1aDabwni9/lX3mY= X-Received: by 2002:a81:9942:0:b0:31f:5b81:bbc4 with SMTP id q63-20020a819942000000b0031f5b81bbc4mr1441600ywg.259.1659063993365; Thu, 28 Jul 2022 20:06:33 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Reply-To: bycn82@dragonflybsd.org From: Bill Yuan Date: Fri, 29 Jul 2022 11:05:59 +0800 Message-ID: Subject: How to handle message "provider hast/data has error 6 set" To: freebsd-fs@freebsd.org, pjd@freebsd.org Content-Type: multipart/alternative; boundary="000000000000fbf8b205e4e8ef51" X-Rspamd-Queue-Id: 4LvC8p2ST7z3CjT X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=mqzMCTxk; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of bycn82@gmail.com designates 2607:f8b0:4864:20::1131 as permitted sender) smtp.mailfrom=bycn82@gmail.com X-Spamd-Result: default: False [-3.67 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.98)[-0.978]; NEURAL_HAM_MEDIUM(-0.69)[-0.692]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; HAS_REPLYTO(0.00)[bycn82@dragonflybsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1131:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000fbf8b205e4e8ef51 Content-Type: text/plain; charset="UTF-8" Hello, I am trying to build a HA across 2 machines, but I am facing some challenges and failed to get more explanations/answers from the internet. What I did is a simple failover which means switching the secondary to primary, and primary to secondary. I noticed the status is "complete" on both machines, But, the device /dev/hast/data is not founded on the primary machine. (data is the resource name). After a while, I restarted the hastd service, and I saw these error messages. and a few seconds later, the /dev/hast/data appear. g_access(961): provider hast/data has error 6 set g_access(961): provider hast/data has error 6 set g_access(961): provider hast/data has error 6 set So, I got below questions need your help. Q1. When the status is "complete", does it mean the information in the block device is exactly the same on both machines? Q2. If everything is correct, the /dev/hast/data should appear after the status changed to primary, and does the partition size impact the time (I meant, the duration between the status changed and the /dev/hast/data appearing). Q3. Is it correct that the /dev/hast/data may not appear due to some issue? and is there any way to check whether any issue there? Q4. As mentioned in the beginning, I restarted the hastd service and saw that error message. My question is, what is the proper way to recover from that situation? Thanks! Regards, Bill Yuan --000000000000fbf8b205e4e8ef51 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello,

I am trying to build a HA across 2 machines, but I am facing some challen= ges and failed to get more explanations/answers from the internet.=C2=A0

What I did is a simple failover which = means switching the secondary to primary, and primary to secondary.

I noticed the status is "complete"= ; on both machines, But, the device /dev/hast/data is not founded on the pr= imary machine. (data is the resource name).=C2=A0

After a while, I restarted the hastd service, and I saw these= error messages. and a few seconds later, the /dev/hast/data appear.
<= div class=3D"gmail_default" style=3D"font-family:verdana,sans-serif;color:r= gb(0,0,0)">
g_access(961): provider hast/data has erro= r 6 set
g_access(961): provider hast/data has error 6 set
g_access(96= 1): provider hast/data has error 6 set

So, I got below questions need your help.
Q1. When the status is &quo= t;complete", does it mean the information in the block device is exact= ly the same on both machines?
Q2. If everything is correct, th= e /dev/hast/data should appear after the status changed to primary, and doe= s the partition size impact the time (I meant, the duration between the sta= tus changed and the /dev/hast/data appearing).
Q3. Is it correct that th= e /dev/hast/data may not appear due to some issue? and is there any way to = check whether any issue there?
Q4. As mentioned in the beginning, I rest= arted the hastd service and saw that error message. My question is, what is= the proper way to recover from that situation?

Thanks!

Regards,
Bill Yuan







--000000000000fbf8b205e4e8ef51-- From nobody Sun Jul 31 19:25:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lwrmz3XyRz4Y6h2 for ; Sun, 31 Jul 2022 19:25:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lwrmz178vz3Lbq for ; Sun, 31 Jul 2022 19:25:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lwrmz09PYz14fL for ; Sun, 31 Jul 2022 19:25:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26VJP6El047978 for ; Sun, 31 Jul 2022 19:25:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26VJP6jK047977 for fs@FreeBSD.org; Sun, 31 Jul 2022 19:25:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235832] Add "-r" (recursive) option to zfs diff Date: Sun, 31 Jul 2022 19:25:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: feature, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1659295507; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9YKK2PW14JLoKD0ZztMOHqsJL7ZFmUomaZ+XrwapFGc=; b=XwRjoKkRYQd3s0W7S8WvOqg7CoX8gKUF5FzUbslqyMwaKHDHM1kmi7EiiZ/VUt1tG7vzJG VYB7gS3XE1Rir+ZyqjMAgEJk9gL2huEjkXbQ31bA6mnhW0k17a/TZWM+aDiO7npcN6wESm ylchVSwlzhFQPug1J2WHzbXB8/A6eNBcJM4BCM7uXRJLmDR0JNXMYcY3nFS5dvzDtqghSW /k5I9zhQBZmAYYog+NFpuA6xCvKnAAuOBGkPxm3L8bSkS7kRAj5Ot/gVBnZnE21fpnDhbI Vi7/gQc5vXvuhdpjxaaw6+xywDZQmpKkZ2n/jqlhZ0rvKtT4kv20EFTLJPPXLQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1659295507; a=rsa-sha256; cv=none; b=MhsvlFG2FQTQ7XAh0/UEXkUdG/yGINRjndReckUcEVbOnlWJGGWZgk8xA4ElKucISlf5si kVFRtLA//cTYS8CcQtgmTMFTjgjBl4P7qhIXv+eeHzDR7Ae+OOge+oPWLP+h1s+0T/unXA 6KT1eF+uszdxbRHhQlS0MmahBu0suI1Z5KrrKsQMDdk6vhg9my8DKqPHyEDHr2gmOi3HFa lbUqfhp+LoZDEOmLUPhHNEDwlMTyESuHVZayajiwI5YldqihrZUs0IUfCzGHwetomTpKFS hCR3ShXKHAHXru0HDVWEV/Zw/wwbGrFi3dSzIozA46ddmMLQdy9wUnCTZGL6sA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235832 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |asomers@FreeBSD.org --- Comment #1 from Alan Somers --- You should raise this at https://github.com/openzfs/zfs --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 31 19:25:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lwrnt6MVNz4Y6kX for ; Sun, 31 Jul 2022 19:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lwrnt5Hk1z3M3M for ; Sun, 31 Jul 2022 19:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lwrnt4KfVz14tk for ; Sun, 31 Jul 2022 19:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26VJPsZC048190 for ; Sun, 31 Jul 2022 19:25:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26VJPseO048189 for fs@FreeBSD.org; Sun, 31 Jul 2022 19:25:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235832] Add "-r" (recursive) option to zfs diff Date: Sun, 31 Jul 2022 19:25:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: feature, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not Accepted X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1659295554; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y5JS6SE/v6DYd1xidMFT1Tv3DdQgbAyNji9I6k8iEwM=; b=okRTLQBhhkd646mPS3zlHM5Il62n8b5BJr75D55GS9SGf4Jz2ztvkv2BZfY8/m1k+pCEfJ DnLXS+u9Oa75/gwXqtoO3Vu6RPdDeyFEW610g1M4raRsTgbE6kA/v8ruTlfJkVrYyYqSzQ Ni375nbCDaUFXepXoNL9r83v3KGQAkwXF9xSbLaE+mOGOU+SxAdsNxNlcrpVjqMgxdxTDS XatvKvL5rEx0k6aq9h8ubgbUIoLBpa5xilK79EBaE2Vs8vohAjZkp6w48sUIjp6WqxrAGo /kObxdDbbi/XiNSFMICBkh3MEMH+yW4E7mG71AsK9W+zBU4UWJ2OwXX6Dx03qA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1659295554; a=rsa-sha256; cv=none; b=FaxH0U1SPLOR90/1TRBjU1xmkwA5sz/G0lUUFry2HJT/JNgcipGPkMsMjJHo12+THJ9F5k b8a+bCkMlqA6zAIymWfh2m34lfV9aQfhMzcce8/DihToIf9WGIyu7uJSpg08+uqECcnNs/ ROnfT87t9ICGPEp3vGcth+x9xT3lfeFbTY/Ev94STrSOJO6oeO5z4ZBerU//RR02aQ4DQF 6f4NwVNTN2HjjHvN6QKJF4RKYf/SERSw2PnQPvfTEXUZ3COchXa03zebE7SW22mSXGh4gS hjIy6gWiFYckP+6iIZ4wmrnpWX6CFPgMz4Yx1LL/QlcMN+aM9rvD0j6gVmja0Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235832 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |Not Accepted --- Comment #2 from Alan Somers --- Closing the issue because FreeBSD is the wrong place to implement new ZFS features. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jul 31 21:00:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lwtvb6MbLz4XQvr for ; Sun, 31 Jul 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lwtvb495Fz3c09 for ; Sun, 31 Jul 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lwtvb3579z1736 for ; Sun, 31 Jul 2022 21:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26VL0xiO007508 for ; Sun, 31 Jul 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26VL0xlO007507 for fs@FreeBSD.org; Sun, 31 Jul 2022 21:00:59 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202207312100.26VL0xlO007507@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 31 Jul 2022 21:00:59 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16593012591.3e69F2.4587" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1659301259; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=WN0GjmHBCpZu7ZJR9InWPaObG+LssTdRxT81TeH8rME=; b=BkcL5Csh5HpnFjz56do8mw9jrdVIzJnsErqemBVaaXCeUNOzf9xuSuNhKaRfmSyi1umIb+ mdXG/uv/xqqu9Sr9gTzjIjHDRmC2spblh8DEfn3pH1y0UMyLCDu0SxvG+2S/O+J+B6G8/m FjZtM/98zGZwzEXFOFEIebAUS3qpj4Ly7CHEjYXZfLkmbfpinNFoRrMjXvNy+qo9WvrWCt VCk+zSBEjA/9X6ahpvvkoe0BlwfqwPVSKUPWf9k6SsVFOwdZyFKS5fMkGQhsx/NuwMNIJH /EQpmSJMcRvHirUf4BjmWF/NWAqDYSvxC40+gacpriowHZmhUgKr/UNgi6fjHA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1659301259; a=rsa-sha256; cv=none; b=LITdIxnGB9p1rRm76zeMPeG7lskhdDe9JwVzsoMouuaXip9pQMgJ85Yq3+OpnzaFm+2TnS jyEBErSWfkRchxuy1F4hBdRkdMxdlwazJgCEI/K1MKFVrKL49wFsp+AI2sk1VqvsaCKAuz OFJknJoMjU0KNtOitvS15mafcP9w4jaXAxatmFZMFzWiKk82O1FAtbGltJwzMJgelM5Z7F RkjroHCIyW31q1n3ECypEhtStedE5P6Sksgr4Esk9HUE4rZjd319CZSmCwpNuAk2MMvd0+ LXrdvRYoYpAnAh+zN2xGlKaQn6Pt3NU5pm0JDPxlF75JCEmOHQyxCYRzgF6nWQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16593012591.3e69F2.4587 Date: Sun, 31 Jul 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16593012591.3e69F2.4587 Date: Sun, 31 Jul 2022 21:00:59 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16593012591.3e69F2.4587-- From nobody Fri Aug 5 08:25:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lzdvy3wzrz4YG4T for ; Fri, 5 Aug 2022 08:25:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lzdvy2fhTz3pJZ for ; Fri, 5 Aug 2022 08:25:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Lzdvy1fzQznG0 for ; Fri, 5 Aug 2022 08:25:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2758PoJs001133 for ; Fri, 5 Aug 2022 08:25:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2758PoC6001132 for fs@FreeBSD.org; Fri, 5 Aug 2022 08:25:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265625] .zfs/snapshot directory is always readable (also by non-privileged users) Date: Fri, 05 Aug 2022 08:25:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1659687950; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VKuyHfRTff5QiV3vi8Z7Jow+ix0LQJn1/odv6mhS/+8=; b=ol1bI7TehERBs+BJz6vmTHakMtDQU+GoadgF1SLNuSJPf5Lse74017Ga1vYrhSGCRsSEnd hnSdqwdEDM5JnP5cpBCWMjbOjX6zODbDvhDqLtHqOxtrpNE4jaRNtL7ngCpfJNPr84gXYJ fLOVsYqpXurXBjqFXB4zX3I87OqatFi4x/7lcKV+kvEG1DMGZx3PiWko7PpftfFH5wiMVn OvLLmA+aeajy9hQxjjvtK3817bOaVfXqVC8cTYB8SSF2np/I3gHMGGjMnFM3E+7aQhGLbv xJCkPZ61ceLqLqy4T8dIVWfWopybhjZTdvb22FOfWruEu9B8yX8qOKX1VX5iVQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1659687950; a=rsa-sha256; cv=none; b=hWI64y5ARuUkbSDeAhxBDe9JXC//JzJmNNRwT6hlAsXbu0o/Sebn1uM9gc46Ll7yIN05YU JglRiGzocr8v6/KE9KCPX+oZSMwGUhVM91nMrxDdeprQt/hCFKjYYhY+ZV3Lnc4cFz3Hi3 q5VjH1mHIdoWlL6BN4+n2Hvgm/4bo+e25ekYKLSCY2W17SVnUBGppabjs88XcXYyRI8nP3 OOsyMBklUKKZnwvVsUBabx5OgQWypxwX+b8DSpwMubr26w0PiABJ9Q+Uzf34e7V8OpFq72 uxeUMWYwnVlCfbO0jr5GIB/kSPq8NTKU6oxig7IlJOAkdz64t6LCCDxocr02Gw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265625 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 7 21:00:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M1BZB0wlxz4XlKh for ; Sun, 7 Aug 2022 21:00:50 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M1BZ95LCGz3Py9 for ; Sun, 7 Aug 2022 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M1BZ94RmzzRPk for ; Sun, 7 Aug 2022 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 277L0nJU087869 for ; Sun, 7 Aug 2022 21:00:49 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 277L0nVH087868 for fs@FreeBSD.org; Sun, 7 Aug 2022 21:00:49 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202208072100.277L0nVH087868@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 7 Aug 2022 21:00:49 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16599060498.622EEA2bE.85182" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1659906049; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=o4JmPh6VJk954G6RDR5T6xROciSkkH9Rw3wZAPqPTKY=; b=snBrRj0OQUw5H0n2Z8ukk+H+yxAQ7oMB0gCI7SCw1sW4WlLRigMH+zm2+iAhQKixNoLCpV Dlft9bIPwKdtpzbMza5aspPjHebfemevqo7h7HQ4h22+3nEA2W/znBk3zB/VYI3rQX+N85 yVuPWUrIq8tbAWBaoJJu7S5SHgJ3VHIgmgYrv58On7jABVQ9U260afay7We6eyBycUc+Dn zL1Yi0hQL1F+Ca0quKqeZIWHXoXaN/+f6EGcOEROZwM7E4oIdY0cUcuHBWPIdUZhMXYWud HMbSxQ3TLUg1h/1teDeXshT95HwxheYDCjxET5Y2Awm295aLbHsKquLuiVUmgw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1659906049; a=rsa-sha256; cv=none; b=FHHf2NbxmYaztuAPnOi51d/BPYPpmuybU4qOskcJZGBuMfxrlu1tFCr2tkjDAgoFVjk4v2 +msaglaeo0FJ6PY+Ew6A/QlnyH2He32PJUq2Y8/UcPAwqw2ZqD61oiYAWn2C8zqN/usnLJ KAQLP3zJtOBW4PzXrALzKtFYAux5Out4rWZwv0ypLXybOhVGghq7u0i+KGGcdsGHIj5s2u bcXnuIAu2v319zSmNyd1bAU4voD7g0jGt8dI44F+HRlSYdeKzD+JArxG+bgtVvITTD2lAF ebY1t/OFTCkKOxHkHLHM8dauyDl/t4JN3laXYIGjn81HVxQyas9VxThhL+OVyA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16599060498.622EEA2bE.85182 Date: Sun, 7 Aug 2022 21:00:49 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16599060498.622EEA2bE.85182 Date: Sun, 7 Aug 2022 21:00:49 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16599060498.622EEA2bE.85182-- From nobody Tue Aug 9 13:28:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M2DRm2kYKz4Z2bB for ; Tue, 9 Aug 2022 13:28:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M2DRm0wdVz3vZL for ; Tue, 9 Aug 2022 13:28:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M2DRl6r61zYS0 for ; Tue, 9 Aug 2022 13:28:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 279DSprS031627 for ; Tue, 9 Aug 2022 13:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 279DSpkc031626 for fs@FreeBSD.org; Tue, 9 Aug 2022 13:28:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265625] .zfs/snapshot directory is always readable (also by non-privileged users) Date: Tue, 09 Aug 2022 13:28:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jbe@magnetkern.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660051732; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=l1KZVeCi7V5UZ0wPL/I8NkthR7oHJYY28aLwMzVgf3c=; b=Y9DjZ8TOAM59wfKmSF6EoNwFluxGlEmgh11GJ3+AaEoAdg7ekVydzeQRoBejHzK8Y7umti 4hdx+WjrAJ1y1g3QubaPYFKWT+3BdONiUfeCUrw8HCMe0Zp0wAx25DaLKY/TaWj/TFRFGI 7QhSgexZQGYmP1YkMhAm0qs4nkiqzlqsRosQNeUU2aNoHRAcEk8KxPP1/u76kiAd0OC6QZ aXNcQ48j1ebweAVS7IAYzjs7qvqd9U1uT9FCrOlDPeT9WxQ0jTtIIbqM/Ke8RvDwYIMQoj t57VadMEWFnPp0JAmuAaOuYuUapjQIXV3yXdRGRG+R+5HGh9AgunqzrjOkWYHA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660051732; a=rsa-sha256; cv=none; b=h8AnnifwyxobwbjQdsh2Bh6ekhXiFWRT/BMqpPH/8CZlSQJnvI/QWz4M0WJOAEJAOvLaLg wkpLwggrFkHjktyHFkD9vINNqVmiiLAQNKpjN9DJa95X772f5mI6K4huWgFXSt3PX4WQIw bTcPfDcu6Cjv7f8PB05m7tK/dm7IIJXuMWrMQ+ZOwYKvVPbL4QtClYD4R8x8smQJIpcA0Z eGcsrKyFvnfF8qJ0xmg/F2NhP+b/so7QLhD5uxlgkCxNDhdYwdZCylyuSuOFrcTutokwwQ 08l2r++OGj4hLv4CaJmvYfBMW2rUUk2MY7CaCEHKCQQ9eILVewQTegvSX7L8DQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265625 --- Comment #4 from jbe@magnetkern.de --- See also: https://github.com/openzfs/zfs/issues/3963 (which I believe was wrongly clo= sed) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Aug 10 22:17:36 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M347S1WFJz4YpLW for ; Wed, 10 Aug 2022 22:17:40 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2081.outbound.protection.outlook.com [40.107.116.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M347Q6N6lz3DJV for ; Wed, 10 Aug 2022 22:17:38 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fPyvVW3eKHxYcsNOY8QCUfRHHTxztP4mum0RrBmiGgmru3KV2CFvE/wTdTIrF0BXPPeFW+gpOUtsbeU5ECNpuJRsbKfFgjXAO5xwmk9/BQYZG9IVQ6jOG1MGGnlOIrlkpQLWdeTQjMxmDvWwoydm/L0ocixWYVtXmLCeoBDNeMNIIEe4JpYpur6D5HBp1jILJ9YAzcNN9YKlp/34G1de+2cRLBEdIDFbWyyOJW9zvdV6B47wKJZOSDEVvUrBWYVE6o96NFQrL3y+m+Q5I7BgDYLnsi8dUtmOUC+DGiFD8yc2vT4xHvGBCFX2lRPsTb4n+YMSofAjyo/8RfbFqmiiqg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Kd7inJt0N+0iNgDGTEcuc6JK4utFanPQNltmO/pSaHA=; b=GmjqtL8o9DmGPIZrD7N0zIQbCg2KLKepVpo3Eg77oWrEci+DojHedvaHzBnNn2Dj9w9PJGLBosdgYR9NDimTcGamm3Uq0BEN30UIMb76LtlHNBJBNWRK5nEvSxUj6B+8lEZdUCK2+jpNzt7JaTiW136nH65YCpJWkMDb4PWHL9/09XcBaxl1Kf5NEqpeVslodtwkE+GU9WsTju06WLAN6vlaRrzWwtMcSlxgDD2oYJ7mhieIghyspHojSffxCmUVrJvr0+hihGlqNfE/0gbWrS1Gz/sfj1NbA5PJujmCSWb+dunWwlO6UbLJ9FJmf1mO0yo/8Kz+8CzwaTSGvNDUFA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Kd7inJt0N+0iNgDGTEcuc6JK4utFanPQNltmO/pSaHA=; b=crKxYzQ+1KFqhtG3YdCcaqJrHLZvndWCOjBllKjn6c66ysDZ8VUaRdwg6V93yDhz0Kh6mYNOy0JtLMV+N1YCkz09VXF0+FtDTTSn93I2yXhz1Dm2Nx+Mqrk4LpL+AdfOrZRAEntv8Wha3byCdjF/gjQkx4QZVNUKp2fEK5xRB2TZRhQhGdzhBislpGVNIrz1PtCiwT80bVET1cva2odlY0epfFhAuhlRjR+3hmoCrQmscIIqDS+14TPBnTtHgxqtJQPen3BHfXkPE/I4Ihd5MmIoTHvXk6ZsHJDF+bKqBjdsGk31C3xQHfsKtaiopvo1Q3D4EHk3jASdzU8kH3MLkg== Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:81::14) by YQXPR01MB4261.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:10::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5504.16; Wed, 10 Aug 2022 22:17:36 +0000 Received: from YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::fc57:d758:2fe:c5fd]) by YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM ([fe80::fc57:d758:2fe:c5fd%7]) with mapi id 15.20.5525.011; Wed, 10 Aug 2022 22:17:36 +0000 From: Rick Macklem To: FreeBSD Filesystems Subject: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Topic: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Index: AQHYrQY7fWQ5YS0dF02y4OgRBDgrJQ== Date: Wed, 10 Aug 2022 22:17:36 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 803119d2-dd2a-4748-0137-08da7b1e2124 x-ms-traffictypediagnostic: YQXPR01MB4261:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: rwiOBLJrKT0N7Pj4yFN24LHQetZKXnMcPGfRYSTc3yPtEaEP8GqhGGh/usFuDMiKZndGr3CAzi8Iw2vJ3SsKHvygFatDaph7er8RjWOG10xFVwroMxewq23iR6gjZkgHcM9vxagO387CBVIKwNB7kg4dgusECpzzUO2wI3FMG0CCLwhMwEWjObGeEmXJoNd1nj9OfeHB/UVR8Yc1MhuNZrs6YV7oAMO6hc1xbyz/KNRVs1VbdDosV1yBfnhnvqGlfu5mb8+K9Q4WmzwWE5HEJOr6MKYs2RPg6VRewp4tLm8KABEgw2jr/H0x/WdPWnMhxuqu7x3hojwUvqgp3bNEHfITUrJDJSz+DALWFfhYsvS7BvtuH9Pzynlk++Z4xsolZ+NmuBYrZis9oPmimOnR7yM3FlL34VBBgyKnA1Eab0ENpGyWIYCb6CjgHgX0YLbIEswhz68r8nljepVbtvijovjB1xf4TOTOqJWczjc/8u1Fv+wTh0PNPkvM6neCC3Ztz1WNvSpOfPVjwA6uAGWTJO/oZZVWzJNkXIn/cx4ZI2mW7iYFxCNKV2fnlr1oLLgwEGrZI/gXzvAFd5ZXX/kaxIRt5VcewXNYPYVL98XGWkl4QrfaLEOWCshP44PtqKjTBDO3h410c5Rkphjfuf8nbahCOkHYJBQtiPuM4rM/FKf5eETAiymCTla+vyq4wYtyiemip7wuCM6ZmQojbE3CDKC3FdV8sQuYWrT2t4WKYPqOZaU6j6rn25XSDPOuiRzCpcbHPYPyqcaglZBQwZnWIh9qgvOsRXljVCvDE5v9UyuuBZJlbcAgyfK5emDN/lkY x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(376002)(366004)(396003)(346002)(39860400002)(136003)(55016003)(86362001)(7696005)(9686003)(6506007)(66946007)(122000001)(38100700002)(38070700005)(83380400001)(66556008)(91956017)(186003)(66446008)(41300700001)(64756008)(66476007)(8676002)(6916009)(33656002)(5660300002)(2906002)(52536014)(41320700001)(4744005)(8936002)(76116006)(71200400001)(478600001)(786003)(316002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?+in4Vmj3wEmbghw9OeLLzuPzaqaSZb25ji82oEc6l0mRZ5RB4zmXzpEmbO?= =?iso-8859-1?Q?YjveHe3MYE5G+a3Lab+g0LtwSQQEXhiPJltWm37ZxBAMx5etIW+64/LBsT?= =?iso-8859-1?Q?iiSYp004cA8nDT38paLHawrzOwDU5Y4Lnx4eG6LdroYXzvZ+G3lEcm9wEP?= =?iso-8859-1?Q?qeiaBo5iIg1H/TWZDMUiL/ZLuy1wsSjjgLyuSjFY4fhVlCuD63B67ZTG+Y?= =?iso-8859-1?Q?ZFjeUlVLxjKezL6omoVj/JZ7IHKIvC3s4WaqZPk9uudU2xsrG1J7qEWZPm?= =?iso-8859-1?Q?Drzmar776gGHnkmI9QfRxliCak5wA3sMRmuXpXo8qtc7c8fF3lkddoarNo?= =?iso-8859-1?Q?OHhW6V5aFofrCEI8QWq+iYM4I1YdF0l+6nkiPgAERECwzGN13V0WtuKLKd?= =?iso-8859-1?Q?PNpP4EE+KKRvyrwl6513SNmQYVkR9VVUEXOCYzjwgCFeKDoE0g+S2kg1p+?= =?iso-8859-1?Q?4J9y+e2GR3s1nrRyX2RA4ic1jYXps6tJ8mAXDRVbfC82SuNYUZa69xYUdj?= =?iso-8859-1?Q?P/x7Dkttdsg05glWDFb7e16tNUwg0iSajK+rRXi7tY1DWN5Lf0TRjFeP9o?= =?iso-8859-1?Q?VMFu77W4tEYecd0X9cWASMm4Wm4Wp8wV5GRE6P//egwlBYlyiYqz8BlQQz?= =?iso-8859-1?Q?DlRO79/J+0rMouw9S9XJivM4jeC5MpSb0HqXrW+Ei9JRPCg9jqFsZ5VB5W?= =?iso-8859-1?Q?mFQyhtFokTpmfgVMkj1OCthql4xkHEPruJYB3ggBvUXtNUc1o9CxYYZ7+h?= =?iso-8859-1?Q?3+EtwsR3dMkCptm+39Rs/G9CmixgsKtJHi4UIlmrc6YeXLAJJMWRT2r4FC?= =?iso-8859-1?Q?5PO0CP0SXPDuPDWjWSsMkjhsrvePzjt+cYppDCHnXnp2JNwU98MvRBvc3l?= =?iso-8859-1?Q?cJsDr6/HtIL5JHgonJER5Tcik5hhMoq2woPYErMMVJpiNQd7iwf7ETQTWs?= =?iso-8859-1?Q?rg7IJ4Z+T1m6Y3sxq+aaWbz3AcLRF6IqwWu23mPqcbko504pgL+lv31/fT?= =?iso-8859-1?Q?bbemeWLf8WtBEuTRCO4FF82Xtg35EOx9o7tWPWZEod7qjCD6x9b5oGDlso?= =?iso-8859-1?Q?hlGm4U1EEZhI4Vekc/pkz8lCeqZbbeXtDRociG4KVhyjxBf1Kh30rSlfuq?= =?iso-8859-1?Q?vdNjdMWXhEJ5mWWfElVLItdmGt8q/2FGTB4lN8IxsNbLXQJngScZdC3a8U?= =?iso-8859-1?Q?dSvInrdyA1Vd3nUs7747lhq5GoqNaxppZWJJFPAlhF4C+kkc5pxyjrBSer?= =?iso-8859-1?Q?iQ6R6QoP0XLGLBp35vLHCpkEOzEciO5LsJ+1p6wKQDdToYmhyvhtwWpJXs?= =?iso-8859-1?Q?4F8hrXsbHz7WkWUcqkQbYMenTf08mijoQ0qQz6QzbxGipoAO2q3zo5YTN/?= =?iso-8859-1?Q?Ov+yrw7RZfXd3TylXJIdh3UNGBdu29P2uLpF6UEliu5isaWjKK8fbpFOo3?= =?iso-8859-1?Q?U5g6o8Mp8PTQvdqTAsQt/j+1YoiHQyrYLPXYJBZs5gBHS5LAjwJ1Fu8fhf?= =?iso-8859-1?Q?XqrOtX2yshnd0qmKoW+85t2XcvyHnZ1MqSujx8+NEet+Cj4b8YIBNco1PS?= =?iso-8859-1?Q?3Uz9F8ouVZo8llEfkysdsRVRWzswmuaGMXi2RQYRm9vE3aTdsgzqLwFBB6?= =?iso-8859-1?Q?BqmK0I/REbuZGZ9NF8VvA/P24fI9FIyUBywU5ZFO9e8GhGYSVJ/d9spKYo?= =?iso-8859-1?Q?4Y0zaL0XvJmhpG9pffWVKj1Q8iSKVPSHbm5o2yag?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQBPR0101MB9742.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 803119d2-dd2a-4748-0137-08da7b1e2124 X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Aug 2022 22:17:36.1433 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: NrnoN8fB3GzOKZlqvqxeGEiBYtq87CUW9+xBCzFBuZbBOZDBOy6P54oNhtWQvPc14iGk/x3oS+xES2blxVhOgw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB4261 X-Rspamd-Queue-Id: 4M347Q6N6lz3DJV X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=crKxYzQ+; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.81 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.81:from] X-ThisMailContainsUnwantedMimeParts: N Hi,=0A= =0A= When implementing what is called Read_Plus for the NFSv4.2=0A= server, I need to do SEEK_DATA/SEEK_HOLE. However, if I=0A= use VOP_IOCTL(), I need to unlock/relock the vnode.=0A= =0A= This can result in problems if another RPC changes the size=0A= of the file or allocates/deallocates data in the file while the=0A= vnode is unlocked.=0A= =0A= >From what I can see, UFS does SEEK_DATA/SEEK_HOLE with=0A= the vnode locked and ZFS doesn't seem to care/notice if it=0A= is locked.=0A= (Actually, ZFS looks like it might be unsafe, since it seems to=0A= assume it can use the unlocked vnode that might be doomed,=0A= but I do not know ZFS.)=0A= =0A= Anyhow, does implementing a new vnode op VOP_SEEK(), which=0A= takes a locked vnode and does SEEK_DATA/SEEK_HOLE sound=0A= reasonable?=0A= =0A= Thanks in advance for any info, rick=0A= From nobody Wed Aug 10 23:11:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M35L13Dw6z4Z4xk for ; Wed, 10 Aug 2022 23:11:53 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4M35L05JQNz3MT4 for ; Wed, 10 Aug 2022 23:11:52 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 27ANBjDF048600 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Thu, 11 Aug 2022 02:11:48 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 27ANBjC5048599; Thu, 11 Aug 2022 02:11:45 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 11 Aug 2022 02:11:45 +0300 From: Konstantin Belousov To: Rick Macklem Cc: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on tom.home X-Rspamd-Queue-Id: 4M35L05JQNz3MT4 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-1.86 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; NEURAL_SPAM_MEDIUM(0.13)[0.133]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; HAS_XAW(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_SOFTFAIL(0.00)[~all:c]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Wed, Aug 10, 2022 at 10:17:36PM +0000, Rick Macklem wrote: > Hi, > > When implementing what is called Read_Plus for the NFSv4.2 > server, I need to do SEEK_DATA/SEEK_HOLE. However, if I > use VOP_IOCTL(), I need to unlock/relock the vnode. > > This can result in problems if another RPC changes the size > of the file or allocates/deallocates data in the file while the > vnode is unlocked. > > >From what I can see, UFS does SEEK_DATA/SEEK_HOLE with > the vnode locked and ZFS doesn't seem to care/notice if it > is locked. > (Actually, ZFS looks like it might be unsafe, since it seems to > assume it can use the unlocked vnode that might be doomed, > but I do not know ZFS.) The statement about UFS needs more precision. UFS VOP_IOCTL() takes unlocked but references vnode, and the first thing vn_bmap_seekhole/data() and ufs_vmap_seekdata() do is vn_lock(vp, LK_SHARED). Since LK_RETRY flag is not specified, doomed vnodes result in ENOENT. I believe this interface was done because I wrote bmap-based seekhold/data while ZFS had its implementation already in place. It avoided taking the vnode lock, so UFS needed to do the same. I am not sure was the ZFS interface decision due to some internal consistency guarantees already present, or because internal locking causing ordering issue with the vnode lock. > > Anyhow, does implementing a new vnode op VOP_SEEK(), which > takes a locked vnode and does SEEK_DATA/SEEK_HOLE sound > reasonable? You need to make some decision about ZFS first, I believe. UFS and generic buffer cache consumers fs are trivial to adopt, of course. From nobody Fri Aug 12 15:30:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M4717405bz4Yfmg for ; Fri, 12 Aug 2022 15:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M4717243Lz3y4L for ; Fri, 12 Aug 2022 15:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M4717176Vzc5b for ; Fri, 12 Aug 2022 15:30:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27CFUpSe069013 for ; Fri, 12 Aug 2022 15:30:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27CFUpB1069012 for fs@FreeBSD.org; Fri, 12 Aug 2022 15:30:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265695] Kernel panic on ZFS service Date: Fri, 12 Aug 2022 15:30:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660318251; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=00N1qokwIl6gvJGZEChgJRZTbxBlsqoNKhfbXW+Ra64=; b=oVMldgOJktmosAF6G8WgZSOPdrhvGOCiGFFrf5GMOOJT2EbKqu/WsuQWd8jXv7LvKMFz97 yeNPRt27FC0Anje/eTu8fYFBVbSOSWmwrjmYq53jaWjf5JEMwE6Er2ns1Od0tnsygfChlP w22mdOyvuLsq4Z01NhZPh00D2/QtdxrMLTgPmAlT3oQN676/BiwCJ2GZnG7gSlqqqa8kBm SXHWXWWT8StJHozlqPYQYrwMiQ7CXoHI8O97j8DWzv1Szyxuko6Z6Xsfd7kw5eknY+uPM2 kFpwbnDtgF2e6sXrHUUqvWM5xt0EzEV6ItuWZ0+ng1uvtAtNlEV5a/5It0/Jug== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660318251; a=rsa-sha256; cv=none; b=LTBVibOhbFm4XEl349WQK4ne9WuQjZDDfbzR5rByDjEvEXGlMNS1ZTPvg0JkSB2QqRgR3U lgTk1MU/geh4BmfF/pwgN9oKgzkB7XeWTuSFNVcze9Lefy/Mp2c20RWn2jFMe9Xcy69fYv WqiDB3OY6jkpWpLfQjfr9yU4Aa3rvfx/mNE/ghdpULHrAmbfV9AV0qEcyhnDDttUMidol4 fG8XB5Bvp1FP190rikqXOZgxjfJE4wUDhcVIgMczQ5tQ9RXQajMnOGc+PDBXRY8aTelgKt WpdjHbzmRAwU2CPmJ5C8OAjeJM2Zb909L7hkrsrF69zywJJVAwLAQWd4sxVe/g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265695 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |panic --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 14 21:01:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M5VFG1XqSz4ZHtg for ; Sun, 14 Aug 2022 21:01:06 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M5VFF4SrLz3l9T for ; Sun, 14 Aug 2022 21:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M5VFF3Zqwz14Sd for ; Sun, 14 Aug 2022 21:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27EL15qh038617 for ; Sun, 14 Aug 2022 21:01:05 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27EL15Gc038613 for fs@FreeBSD.org; Sun, 14 Aug 2022 21:01:05 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202208142101.27EL15Gc038613@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 14 Aug 2022 21:01:05 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16605108651.178Eb98.34361" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660510865; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=gJhdiksvWtr4RyYHf/h4+/Sk28S95gT90fKdfy0VZME=; b=l/4Ik0Sb/V4K8OHTlav/RPg1W3W4vlgb2cXPkZODrNSqF2BmPRMc5HCbFnafWwUKTnqlsf NzGa/CeZaDjVulHxhwNCznP5gefOHv/EjaxmhKqAe6ia7N3hwCMjfFpYTkI9Yyty2bqBwc AmPJ86cRonPkDziPAhfOieqTBn71T57nk9zIagt4axOo1XZSB70ZCcT9YE7qXGZwURE1qB kPQU9eqDQ0MeKAF6ZaGAN0oCwDNFgzVKf4wwQopdfe5HclsQxDXmqC3h/ILM8m1X8b2zpC dgtO7lJcx0cPRBO0Ezrzp0aVqHg2vFYfgism/Q7QNBTqxOwNvoacABMj+lg7fg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660510865; a=rsa-sha256; cv=none; b=K3hXttrgOnXAbHPFlKpqA5fHQU5bcB0nf88tVh8eyIKRdQT5HLGU8fcCc4ee+LrfPrrIzm Ok1Rhk+F+ZOrvxBmV2B0TQf19Y3+tYpOBN4zQLw0TTbofj6TvRQ92gJgJG1fUUhMojneTG dSM6JGcC1AMQ73D7aQ1OmpCe6J11buR7x5KrFzzIZOIWdFTyl7CBzpvZ5dZXo5pmE4MiK4 ylO9ter3bgS2k5mSrhgeVswrK/2ycSNY0uyoFze4eVVbRs0Xr8ZXYqG8CFejkH7jXuJWLh CUr70CqkdjgCD07tdpoSSrREdbgocOLKki4tYASXm18047TvKUynsB13a5xidA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16605108651.178Eb98.34361 Date: Sun, 14 Aug 2022 21:01:05 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16605108651.178Eb98.34361 Date: Sun, 14 Aug 2022 21:01:05 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16605108651.178Eb98.34361-- From nobody Mon Aug 15 16:49:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M60cg1MD7z4ZSTK for ; Mon, 15 Aug 2022 16:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M60cg0KS2z3vk3 for ; Mon, 15 Aug 2022 16:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M60cf6Trnzcj5 for ; Mon, 15 Aug 2022 16:49:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27FGncUO040979 for ; Mon, 15 Aug 2022 16:49:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27FGncV5040978 for fs@FreeBSD.org; Mon, 15 Aug 2022 16:49:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 15 Aug 2022 16:49:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_severity Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660582179; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sp64J66QusEVzxsnonl5/+AzKhfMldrqcIJy8pg40ws=; b=GywHJ2ubu152AKVnyQowQac9oGwb5oabnFAUI9+ulm501ZIC22BLY7QC17aSuzQ8hnPl8E 4Mt3anTYtMkx1wWcG/2pbvGPyLj8vyDLSRm2JwojoneIR0o+SkGodtT/WcPZqNa4EmOEBl Rolwoop4mWUxstPo2vYLDMl3d1zFDulIT7l3/7ZM6cD9UO57VJLnkq+14zSZmx1HhMNUf+ Ow/aIDJpjTh+T8wfC2GkdrTNP1Lngs7s0VsXDeUQ9Ghvx1bI5tsbBChyznaG130nI/TOHE Glyh/+PX/f/0g6ceSd5pvTuHU59jQjd8s96nVme5Zmdw3F4Y03yAdB8AJYFAVg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660582179; a=rsa-sha256; cv=none; b=X2EgVgEI03xRIvlneI2KlXAzfsWNwI57k/jWahNB+0DFGZcAPFW8yf+BWTEgvDTxBhc1kw eGPDM16KttEwCHmIeNZC060Vln0DtJ4yXv/I0E4ab+tMPzOSZfGSWGIq4h2mPCcJWk6ceA jwkKoQpnuiw/I0xkPxtxoG8WJgiv/NmIfRFmlQmgjxL0w5KvOGG48RZshGWfjPzgToElcV 4oO1r2eLG6UqzOtPpT2yzIg7q4k+N2xHn1hQi4q4rToKPZqL/+NHPEfZrRXhYvnwqXsjxU P+2M3ND2NjiiQ89NO08hZT8pVyHaQTwbBeu5249MBiI6CFdkqpuLUOEGbEcQeQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Maxim Sobolev changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |sobomax@FreeBSD.org Severity|Affects Only Me |Affects Many People --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Aug 15 17:20:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M61Jb0GP9z4ZXdk for ; Mon, 15 Aug 2022 17:20:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M61JZ60Pjz3ySY for ; Mon, 15 Aug 2022 17:20:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M61JZ53tkzcwb for ; Mon, 15 Aug 2022 17:20:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27FHKkTV058676 for ; Mon, 15 Aug 2022 17:20:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27FHKkni058675 for fs@FreeBSD.org; Mon, 15 Aug 2022 17:20:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 15 Aug 2022 17:20:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660584046; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9k4F3ThOCqIv3k0pQma18aGaTivL9Gz/tZRtUrqQy5Y=; b=rCwFmAxwhgGu7+uJywGljXpxaDiytTvrxoluMXgztw6IRckvgp3Bl1d8T4r1ZEITMDV10O gKjVFGamBsn3/QoDWeEHuxcLG0UITQhHmxJN9mImOPFnmizD3TqB+W27YtEXy9j+wyPgxX QjdsO9roZJ9JSeWfn9jNCIyC5oKL/9Q34ECGa3iADdr/CiGBNNRcn4AbdYHTjlhaZtRSNI HJ/Q7NgYHNT1gc3qmrvMywsn2AFds2b/4YRvZ6ZwsVDXmRrNunH5zJSU7ZOHO7WV8HyyJV xo4cNt9FmPBej6VFu4StjP1UXA8QRJ9E55sxItAePtADJsMGWgEnTN2V1/d2Ig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660584046; a=rsa-sha256; cv=none; b=G21LSugi21TzMSL7wI/T5tbtgSOgrHHOJU0HLOXVKsG4+AEfTHjRZkswnf6nhnKmMdyDpQ FecwIUNR4o7aS45kIH2u+RujXutAy05RZnkzT+hWfvBuWJDNV9NaHJYYujC04lmh134bXU L5CkUgeA9cHKb/NF6HQcWHDTs/6pOk4daQ4ZXDLgHv+tDtAzjqp+MTCDbRn9btzpzwCXTO MCRvUwNYp95B8WXfC0Jd/C+ReV5SmrLptIneCZ9wM7fDPEl6RLWVrb8LMi+8GwEXb1O7x+ ig3sBXH23hWyD7X+tr0X9JTGx6Mls7waJbNDbzDnr0IhPWUFvkB+Mcbj6Hpz4w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #13 from Maxim Sobolev --- +1. Upgraded my dev box from 12.2 to 13.1 and it no longer auto-imports zfs pool. The box boots off UFS as its root FS and has a single raidz1-0 pool. Adding vfs.root_mount_always_wait=3D1 workarounds the problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 16 07:17:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M6Msc2x2Cz4ZjN0 for ; Tue, 16 Aug 2022 07:17:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M6Msc1wzzz3gHD for ; Tue, 16 Aug 2022 07:17:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M6Msc0z8gz11P4 for ; Tue, 16 Aug 2022 07:17:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27G7H8cQ047507 for ; Tue, 16 Aug 2022 07:17:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27G7H82L047506 for fs@FreeBSD.org; Tue, 16 Aug 2022 07:17:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 16 Aug 2022 07:17:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660634228; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dSB+YRAd0GgUlkdwScTt2CHQiKrivwO9XfCJn6sBCyA=; b=BObrBaCr0WcbkuOMdygSSynkEV0KeB+8t+jUMnWVfCSropH5e6moOsmUzPOI8NVgzZ3Dgo nSZcPXRk+Y2TQCXgzkSMZulw2J1S9CByLMdhdfBYi4sjYTtNXdJfdKrYKL3TgDoDZv8ov5 GKEFxJCygoF0jb3utOKXm49Ex9oLUdBClh8CuVNiH/tddK1UNxqOMc1gMIArCPxVp10W0e CIc6G2XdFgCIx5FeCnIlDHhXnYmgoHpG1Ygj+ICbxzI7k41iwrvNRNAxi+8X1n9GeH7qQ8 CP5pRBYjhoo4x8V5HIDGFpXUXaYjM0yOuyIDelF7HJquYR9NKpJ16HSmwf+z+A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660634228; a=rsa-sha256; cv=none; b=p0EYR3urecW1lKmdpy4rgNeFehLcxs4S2iBTN6CVhNssl8ZRQFxQqWI3E2gdR+QHxavOOu i/HeicCrLQ/KovF+gfJ/nE18PxB5jcDTUw4HmxZD3PfCcY/CpaI+ezWLdQzMVPMRuIv4Mq 9TNqBc20h/DMtjSFjeFsKTTp3y2R7WiaABwS0PjMjuGHveR7phFq7JcyQIJP2hCVuSV8oS ETrKTkd0owhslm3ifDMroYIorp1H6ahuufWVQ5E9S7/vUZ+Vc9CcSi4fkoEuS/AF8GBMWb VuJO3GRlLtFpyeDBKy75E/usnpUpGvKWFWQS5xT3kriuoyj8W56kNuycpuS8dw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #14 from Maxim Sobolev --- OK, little bit more info about this issue. It also happening on purely ZFS system as well running on m5 AWS instance also after upgrading from 12.2. O= nly boot pool is imported on boot, not 3 more pools that this disk has connecte= d to it. Interestingly enough, the vfs.root_mount_always_wait=3D1 did not help i= n that case. I've done a bit of a investigation: it turns out to be the result of the OpenZFS import. The new default in 13.1 just disables autoimport of zfs poo= ls. >From the quick grep through sources, it seems that Linux has some mechanism= to do import in userland (i.e. "rc.d" magic), while FreeBSD doesn't. ^3b0ce0e28db module/zfs/spa_config.c (Matt Macy=20=20= =20=20=20 2020-08-24 22:48:19 +0000 71) int zfs_autoimport_disable =3D 1; As such, I suggest the default needs to be reverted to 0 (i.e. autoimport t= o be enabled again) until and when we get some other way to provide this feature. Unfortunately, that code path seems 100% untested, as setting autoimport_disable to 0 just causes kernel to panic when ZFS is initialized. Timecounters tick every 10.000 msec calling spa_init()... calling spa_config_load()... Fatal trap 12: page fault while in kernel mode cpuid =3D 3; apic id =3D 03 fault virtual address =3D 0x1d0 fault code =3D supervisor write data, page not present instruction pointer =3D 0x20:0xffffffff806aa7d9 stack pointer =3D 0x28:0xffffffff8167be70 frame pointer =3D 0x28:0xffffffff8167be70 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (swapper) trap number =3D 12 panic: page fault cpuid =3D 3 time =3D 1 KDB: stack backtrace: #0 0xffffffff8061f685 at kdb_backtrace+0x65 #1 0xffffffff805d5f6f at vpanic+0x17f #2 0xffffffff805d5de3 at panic+0x43 #3 0xffffffff808fac35 at trap_fatal+0x385 #4 0xffffffff808fac8f at trap_pfault+0x4f #5 0xffffffff808d1f68 at calltrap+0x8 #6 0xffffffff80580972 at pwd_ensure_dirs+0x1f2 #7 0xffffffff8118a508 at zfs_file_open+0x28 #8 0xffffffff810e0b9d at spa_config_load+0x5d #9 0xffffffff810e9aae at spa_init+0x11e #10 0xffffffff81190bb2 at zfs_kmod_init+0x32 #11 0xffffffff81007db0 at zfs_modevent+0x30 #12 0xffffffff805b3d54 at module_register_init+0xa4 #13 0xffffffff8056674f at mi_startup+0xdf #14 0xffffffff802ca022 at btext+0x22 Comparing implementation of the zfs_file_open() with the kobj_file_open() in 12.x that it replaced, the former is not designed to run before root is mounted. So I had also to disable call to the spa_config_load() from the spa_init() and just leave one in the spa_boot_init(), that seems to DTRT in= all cases (zfs loaded from the loader, zfs loaded from the multi-user). Patch is attached, feedback is welcome. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 16 07:18:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M6Mtj36gjz4ZjJK for ; Tue, 16 Aug 2022 07:18:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M6Mtj24CNz3ggq for ; Tue, 16 Aug 2022 07:18:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M6Mth6kWxz1172 for ; Tue, 16 Aug 2022 07:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27G7I4Ak047742 for ; Tue, 16 Aug 2022 07:18:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27G7I4xR047741 for fs@FreeBSD.org; Tue, 16 Aug 2022 07:18:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 16 Aug 2022 07:18:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660634285; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lX9srEoUCkIwX+NI7e7eZDutcFzyYci6DHHxdBaYWZU=; b=XZizkaq1GrLIey7pIQKd1TUeSaklh8G3+Imj/UPdVTNHwAWnomzh9isL2EqZ1wlMlmOWpY ZTgpA/8qjlI5DxD2qoyGANzd3sgxkFu42FcJXDBF9zjDyV+l1p++Zi0uKX0JHUM49BQu4R y04aZ4Ti9eSxogi6VX5y8zjr9CBjB5hgOGdal43xwrg4Wu0QXUnMxswJACF+2K6eCRXn0T wYFDuWPY7iq9IJChmjcQ4EpYaudunUu7KRPaXzAo57o3bK5/ZagZi9ZcAhn7v97HPtmcsB F4i3TLkeHbWeCJu0s0O7Vvki1DmDTip3mfdle68tsxM5tUlr8X1cU2mS2037JQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660634285; a=rsa-sha256; cv=none; b=wA7cF1noUDILCcm2lcbgSSBZqHIC2e93idFd627LFp8xOCuDRiTjzmem4qI5x5aSyINID2 IpuQ/wIyABPUB0LviiPsrij3SnHTM7hjYw6A6MSEecOYX4uG6/uOImLpvHL5/D4xtFn8oP ra2CXbjNkCJB4SuF+0rLyudgv12k7yjDYohaO8YGmqeluEhYLZDj3k4YadxN1E4qhkNc8l /Lp7UJlJ/7JFs58eAkOfgzUCAnOjbnzgYeT6BhqQPCMUgqOsu6QdECMXfJZabieZgii8SC Ki36WqgV+hG7Ywy4VcHEekqnaKcdVf6mEZ51PSnEOMUnIofad/LO/8lPEF6abw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #15 from Maxim Sobolev --- Created attachment 235935 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D235935&action= =3Dedit Patch to fix the issue --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 16 07:19:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M6Mw74t8dz4ZjXR for ; Tue, 16 Aug 2022 07:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M6Mw72qZmz3gtT for ; Tue, 16 Aug 2022 07:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M6Mw71wW5z11JL for ; Tue, 16 Aug 2022 07:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27G7JJcZ047987 for ; Tue, 16 Aug 2022 07:19:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27G7JJpd047986 for fs@FreeBSD.org; Tue, 16 Aug 2022 07:19:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 16 Aug 2022 07:19:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: rep_platform Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660634359; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vfdqhCqjPA8VXQgvs1+qoNm4h+wUXmUbs0PfVZmNX1Y=; b=P5vQ0/M/2qJB7BvneKUp2LZQo2VRVt59+y3Gmg9dzdEr+qzAUVMdlpCGHRs/jiR/TlbPLE WKId+a/KTUbPMF2W2Z4P53ykoLD36yPfkfWxpZJTsHRfFDQL0VGMsp8GNYNllAk5dYN4Vg dLkHiQ7YyHDT9/KOsvyEwaMTxk0YuY1Z9lU8eyfs3I0VNnHpNXUpNBNrH2d0YuZJHkTsTP H+cLKjyfcOj+HJ2z63HA6x6n7v8L6aan2MKu9FwcG2+RkOVoDOkb0tBwlpzUjpNwgUog9/ W8lheO0kK+x888Og2EPqZ3mzVwfmXR5ZrWo8uiYQSWwMKcZyjPUvuVGTUi4D5w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660634359; a=rsa-sha256; cv=none; b=X7teblyWsx8+dhmhUDhG/N5oSvlpEz0E+kGe4kmATJhSQI1hj7aoIoKGiwRWgdy4+cGwqA qSHqDXf6K/pYfJhcqTMIKseGn2E2EowOFf59uRdU8BUd8d0Yy1TohLjanlBEIu6xaDNfM8 U6b4RW47fLjQ10zxH4sTcBZ4iqOgDRUitFKTXYMp8ZfbmOrysiNTBm8h4fD/OqMLuWFCld 7uztT4alAdO2qSoB0O3omrTvHHVtWm2bwr6ATFUuotJjNfqXiSAK6t2HBk0b0qJ9xodIO0 tGO4zZjYX/MJMv/CID8oCnCgYBraXO16loCb6LUJnueUFU1QqejVvCY7g079HA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Maxim Sobolev changed: What |Removed |Added ---------------------------------------------------------------------------- Hardware|amd64 |Any --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 16 21:44:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M6l6j43dvz4ZWvh for ; Tue, 16 Aug 2022 21:44:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M6l6j33gbz3lNM for ; Tue, 16 Aug 2022 21:44:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M6l6j26l1zPlm for ; Tue, 16 Aug 2022 21:44:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27GLijTd051149 for ; Tue, 16 Aug 2022 21:44:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27GLijM1051148 for fs@FreeBSD.org; Tue, 16 Aug 2022 21:44:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 16 Aug 2022 21:44:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: component Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660686285; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4TxCNNqMUZbIU1xjEC3zLafhj2XzduS24rpW3DbWj6U=; b=AVE9LS+s2JoTuiIe8ozp3cwuESL0eURMk0JwCp0T6BFA7V9C/27cfwn1VhFRW7LYvgkyUs 20kmMPOxYMK+Qp7zcSj9KhN62zMmy5aBjmrGGT7WikU40Gpm+vDx/AQx/EVjR/2X8CPZ/i u0ryUG+ZVUcF6GEkk0jGXezC2ZRHwaCiXYkoGrOGgr2zqoo6tUEWlUVLbBktdFplS6PNN9 /Vbw9qwdcYPlSZsppoK+MJyY+qOZd3aNi2t9pucA9ntcvgNswguNQFNKKQccYtX8q5h7uH +k+PiDvgder11bJqgqRkHcwamfTB/0SNSpQhBEoLAnYgiKEspvSMM6NZZ5eeSA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660686285; a=rsa-sha256; cv=none; b=WCdTSH4h/15njJcL4sRU8RCbo70ItRPFaI4KzhAWWP4UxxVarOz1InqVQIgOkUXT5GlQBD PJWt/+jQapz9i5fK5Maw6OWxGj+Df3wOzDXPjAHaYSPG75TRnkbnfXazoPlacnIGJ/bgPo dA7zjQDJG39XaFrcW9lP0eeryfOi7IIbCsO0yXBdS52vlki6alc/TobQx6QDdqa8aZKpyb K2TkIkK5UgGguWS+CCZxaRKFwVQA29MihXml/yLHBg7w0KHLOqaT2NLpwt61u4Y+2+iX6S +H1j+YsgQRe8VcOgBK5cI8z19lqxe+6XQIr0VK+mItzD/xd+phCvuFaLFMrboA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Maxim Sobolev changed: What |Removed |Added ---------------------------------------------------------------------------- Component|misc |kern --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Aug 18 11:56:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M7jyy43KNz4ZK12 for ; Thu, 18 Aug 2022 11:56:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M7jyy32n1z3lBL for ; Thu, 18 Aug 2022 11:56:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M7jyy22KXz1S5F for ; Thu, 18 Aug 2022 11:56:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27IBuQjU027873 for ; Thu, 18 Aug 2022 11:56:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27IBuQcV027872 for fs@FreeBSD.org; Thu, 18 Aug 2022 11:56:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Thu, 18 Aug 2022 11:56:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660823786; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mnYnpR2yuJ8Ivc0ppcJ640bPNoQKIVixz2bCLP1WRTk=; b=oAuSnj2jL5YF+F4jpObHMASFTE6mAsNQyUiotO4dJogHvWr3ZR8Ej1wYvw5Dceo0iiPuoN pnToKxD3zXq7JW8FyxeZVNoXb0rzNcNW3Tp24Hq5opGtCiaUA17TJr2i9+2ky1TNIzqmhn SikIjPHaYUO4qxxRyCaG6wxrJdAy1qwS4gm7jFt7jSf/U6eNFQCSTdzcjc13uAhZ+P4CYs XDLVXqXy4e4cXLj8BV3xmaIogFzUpKrsTaOb45ptNq6vKNkLG6/ocmEs49TgB8RjIyORmA 7H5YMtWG7u+KZ0hg6FgsFJrcdnF3GrtqqASkBIznqHXI1ulgMYQPDZsw8z7+Ww== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660823786; a=rsa-sha256; cv=none; b=sTBgVqVfkbuENVlT/tgz0n0xORiiltDsKknj8fKm4G+p9ACxRqUT5zeQFRBTURZp+B6/oB fBqyVSt18dMySvhJo9xsyf9iLDigz0pma2Gp2fmqD302B0MtYrYFjvZRrGt06MC9VkMjQ5 MmKUY6cRVKW5+hCWC6pNgwYhJmNwhVCHJmj/X/ukDqkJUgKwvUZffSQRayvNsqUW2R70Gr LmCqhoyTSUAApzWrYa395cYPYLtTJumpOhPMUfJ5Cd7xt5eyG7PFpU5N93eav4wbyiLOJa Yuxmmqmdmd3zMzHnBjVorRlwDXMVV6KIogV2Qprfi5v1EhVlkwgExRzCjEBXqA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 --- Comment #16 from Andriy Gapon --- (In reply to Maxim Sobolev from comment #14) Apology if I am asking something too obvious, but do you have rc.d/zpool af= ter the upgrade? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 20 01:11:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M8gYW2VrFz4YjRs for ; Sat, 20 Aug 2022 01:11:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M8gYW0vgCz47CS for ; Sat, 20 Aug 2022 01:11:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M8gYV4d1nz1Cj1 for ; Sat, 20 Aug 2022 01:11:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27K1BAI3041844 for ; Sat, 20 Aug 2022 01:11:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27K1BAnD041843 for fs@FreeBSD.org; Sat, 20 Aug 2022 01:11:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259607] prometheus_sysctl_exporter: Need better encoding support for sysctl OIDs Date: Sat, 20 Aug 2022 01:11:09 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: delphij@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12- X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660957871; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qok5GLnKZoEUkbj9rpHLYmQu/c4sGA6SYxLKH+pBYtM=; b=mlyDqfMdEbRbpTck7brOrByM2Vf9CqM2T6wLfjLjkuKSUSZsRjWq1HPWhJnaNPUuE2ZFwc Uh7CabnIA0PVpNlBDu2o8Enrqvy7A6R1XDFBkE5w6Fq1flMVdFQF1IEntkKsiQLqs1hLsN YazXvrtG65Y3879ZRnxVCETYnhL6mr4mD+BhkvGpbuRUoJOO6OFs5DCc7TyrSVtg5LMcqY 3vbOj36hzsiEzXmjtQy5PeggTsLyka9XOOnKaATY6RNQT6mcLnhdW1HqirF/B6eKMFmSpo EAkJunP2VST2OqxTSR638I+0jDHfIGuay+Wih4oQ16SxXC0nsnlXA8HAhfRsVQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660957871; a=rsa-sha256; cv=none; b=KcRiX3sBFwT1hrT4WrSkDlYTCOh0+3+pgd/+J585+OD/vavu+PtzLL1RvL6hOdReM61Tyr GA9dLAWwKHn0TG+0W/3Px4TUaj50jCN7tsSfwJi1LGSosUvH02P9im0zP1YO1KKQ9qOMDb hMrJqMnx+2oq6MHDJhkmNVtoVewDnYeRMaEcSgKjxBOTWDepaQThD65wr4apRKM5ora+JG D3qONd30newxBNMQqPAs4GavJB6rrPfyuu4p8vsP05WSXR7dZNOQfsPnE9xQnlILsAtyZd +cb5quqBHOAlhAx4afqTwy8Fr/uw/d8x8zrmqTWpzS1gEx2TjFXw0i0sCcVDEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259607 --- Comment #6 from commit-hook@FreeBSD.org --- A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Db524667411e93d1e828bbaca03d96bb86= 37a5357 commit b524667411e93d1e828bbaca03d96bb8637a5357 Author: Alan Somers AuthorDate: 2022-04-18 21:29:37 +0000 Commit: Alan Somers CommitDate: 2022-08-20 01:03:31 +0000 prometheus_sysctl_exporter: fix metric aliasing When exporting sysctls to Prometheus, the exporter replaces "." with "_". This caused several metrics to alias, confusing the Prometheus server. Fix it by: * Renaming the "tcp_log_bucket" UMA zone to "tcp_log_id_bucket". Also, rename "tcp_log_node" to "tcp_log_id_node" for consistency. * Not exporting sysctls with "(LEGACY)" in the description. That is used by ZFS sysctls that have been replaced by others, many of which alias to the same Prometheus metric name (like "vfs.zfs.arc_max" and "vfs.zfs.arc.max"). PR: 259607 Reported by: delphij Sponsored by: Axcient Reviewed by: delphij,rew,thj Differential Revision: https://reviews.freebsd.org/D34952 (cherry picked from commit 8c47d8f53854825d8e8591ccd06e32b2c798f81c) sys/netinet/tcp_log_buf.c | 33 +++++++++++-------= ---- .../prometheus_sysctl_exporter.c | 11 ++++++-- 2 files changed, 26 insertions(+), 18 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Aug 20 01:49:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M8hPb362zz4YpDW for ; Sat, 20 Aug 2022 01:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M8hPb10GTz3G23 for ; Sat, 20 Aug 2022 01:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M8hPb03hLzFTZ for ; Sat, 20 Aug 2022 01:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27K1nMdt062931 for ; Sat, 20 Aug 2022 01:49:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27K1nMOL062930 for fs@FreeBSD.org; Sat, 20 Aug 2022 01:49:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265893] ZFS mount show nfsv4acls although pool/dataset is created with acltype=off Date: Sat, 20 Aug 2022 01:49:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1660960163; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zgdAfEcnujsTTy8bW1349CBg5zWU4wkww+edBn1PnhY=; b=n5t+gS/mzWBjSQlh7upAuP5BLtaMkJGGfLg4XBpRWJmeDQyGwQdyOSjg8fxSU/OHljM8hT F8D4h6cpGSoDzmLCy++N0jZYp979/emi3Hdq6LdBj7Ko7DPO4FswaLb4oWf3t3oIp2uk2O F5qGtYDObXZhDMA+N+0z8ryGf2sIAyHek94CSzoFox0zLkRD/GwX9me2OcsK3044kZlt2P +PjOnCxHu0yOZzLnoGR1qai6qRTBzqiqvg0/0a+r9ghJJ1fmw4knnVMBD2zSP4R+uUnaA7 Cb8SlXEKIAyr3WQOi6JI0P0+8q6Oh+dFY/vYTGXuxC8grAMzZ67GOihU/aob4A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1660960163; a=rsa-sha256; cv=none; b=ZQbPlML9TC1hZiFZuUyO+i08K2epE9YNe+/WoIfMlfif0yRfQpsW8z3Qltt9YzA3xFSSpb e6CWF1ZLeJyFdxPN3TNaf5fjLsOlC7ltaQCFYwRbKHBLBYbSOb/uHxgdKi3icMC+8Cq4Ac 28UnVlNG6yc0cZ507joE6hQBsE6Cz3sCjbV/mXOadYEQgiwz3TRBO4WU9Bh/AUafWvF4dF EfAj3QZYU/Aaeybn6ZE0HCJaMvf8jsqTWsvKDD/So+oNkTxCUfuYt2wQQlCvRjcWT+TBvy NvSvfs2FCIwhr7rjxSUL92u3qmd2zRwkST25HwbxkDSZqNLF+jgkLoesDZNbXA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265893 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 20 14:09:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M90qb6h8qz4ZPNG for ; Sat, 20 Aug 2022 14:09:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M90qb32hbz3GnL for ; Sat, 20 Aug 2022 14:09:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M90qb1wrVzZtp for ; Sat, 20 Aug 2022 14:09:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27KE9VPK096985 for ; Sat, 20 Aug 2022 14:09:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27KE9VcN096984 for fs@FreeBSD.org; Sat, 20 Aug 2022 14:09:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Sat, 20 Aug 2022 14:09:31 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bblister@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661004571; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Dygox9HW/YRf7mPVynQdeDEn/pW+kmiEhJQ0wVKUOmc=; b=cKzPtQznqb7mmwmuGrI7bNxME1bbPtevkLPArS2Mrn8eg3GuRhcrYScYh72yGwdq1rzdfy xPhO5j/OJnEyGJdIQwmjY+2/WlZgAQ9+U8F9W+mWU1PgN+BhJ0+Ug/cRAkT1v7Uq8ZAjM5 F5l1GPGwbLgTO2KTLlEA4cCZC0pufOqvqtkCrB1JM0buygKG3MDrUa4jA2Zp6nKg5svopI Zrzh7oNVVjn17AlCJLSavnG6jsG6BL5qsCArontd7Ut6RhQoLxXlWRBovab4gpo/2IEJ5x rqZOdMbYsSejoIPVSXYMXqIgwr5y38UV7SdJc5UBGUzex+fUOY5CRoQJT+4Lww== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661004571; a=rsa-sha256; cv=none; b=L3Zg1FdNJNOdyXOw7251drcYdAbZwmzyLbokPHwSiU20YdUjVIEszfPXydRdDf58ePUV2s TMeOEkSi3LJ7CCooBOZRRAxIgnLrQVDZ0piaS+aYGndq30uicj88/sV85gHWyZRMmtvGhP FATESwW0JVRK0TkAvbBdBvLbxS81Q5KymKOj6Gm5CQY8iLcSwlIhNvAaMFm7pRG3ECEWD0 3yH1MgIjLyGQ9YQ7YtzBTSm0GCWVhEmt3no11CC+q1UOS2Bw1gIv094mz4qiySF54msrkL HyWgQeZn7kLHF3ctYp/fU9hAPwV3NhWVRZisTWWBFc8io/YYBxeplxoKtRazNA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 --- Comment #9 from BB Lister --- I have used the FreeBSD 12.0 Live CD to boot this system, and enabled successfully the soft updates+journaling on the large filesystems. Definett= ly, there is something wrong in the FreeBSD 13.0 function to enable this functionality. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Aug 21 00:00:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M9FxH4kFmz4ZdGV for ; Sun, 21 Aug 2022 00:00:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M9FxH2xCPz46mB for ; Sun, 21 Aug 2022 00:00:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M9FxH1zqSzqtp for ; Sun, 21 Aug 2022 00:00:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27L00JQh040595 for ; Sun, 21 Aug 2022 00:00:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27L00Jn2040594 for fs@FreeBSD.org; Sun, 21 Aug 2022 00:00:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265893] ZFS mount show nfsv4acls although pool/dataset is created with acltype=off Date: Sun, 21 Aug 2022 00:00:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661040019; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e0Vf18w+wlM80zDqn42AAjt2T33FmNghUtNC9w2gaEA=; b=Hxk293axHv0eMXP0JIo/ar/+VV1/s2yCtc3ev8L1ick5xZFOk7dq8orglPL86OhpB6gpVQ p8rQ77MLMu4vcPLWz75CsJEqdi4MEAc+dvPojRomPqFyEC/t1moHApr4TUEGfgpH55AFvn 9+AXaqVEuB4BbBeyaESFu1nrxElUY7f9bgh6ATdktOYH19gpCIaO2TlRR0FwxDY7BSCtse dN3x6em/J6gTg0BNHw10FaRNTV+x3j88a74gg4gJMFuKLVj2cFY0geegwu7ypfduGGwCtb 0RDKtE22ge1PO2cIh92mYXpG8ltJGmcNr5eMWpki3U5/+TAuHjytG2M1/KpWmA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661040019; a=rsa-sha256; cv=none; b=F5000I4x8kzqW7SA5JPzey8X7/CYqaflhMMV+u8soGqtKBFwON38npL37BG2FWsHuNu+KO OMvxYzn+PhpxRSZM4QgxsNDg9SPSw2YLPCmOQwlNgq5Qhnj6EmW3pNXw0RaF7DhnkKtaW8 5rDWPqjqb5zLTbfm9xWJtkLSfMg/fAJRH3IhhK7qvNpZwo9ycvbk+UP7NEaOKkjtDEYrQg BJfV5Xni/oSmGwKRLihKByVLVKf/0Evs0EkVYcbJMD0IdPIG1Mx3Fen3LQKklsjo6c/PlB MGJMqEZrOsfsBVw+t+QWtcIoAqM6ZA+B8FWBlYT4ZYl52d6p26sMBOe0RivZpg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265893 Allan Jude changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |allanjude@FreeBSD.org --- Comment #1 from Allan Jude --- in sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c:zfs_mount() it sets the nfs4v ACLs flag unconditionally: vfsp->vfs_flag |=3D MNT_NFS4ACLS; It should probably only do this if the aclmode is set. This looks like maybe it should move to zfs_domount() along with case sensitivity etc. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 21 00:02:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M9G0D6Z50z4Zdvq for ; Sun, 21 Aug 2022 00:02:52 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2078.outbound.protection.outlook.com [40.107.116.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M9G0C5lLgz47VY for ; Sun, 21 Aug 2022 00:02:51 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=GO6Lmx3IOKEFJ1GjYZ0UfiUzv/EDWanJ2+etbBPTduGnljHVG2v9ut2uXKsHoyQFcZWlFuYnQjwzaBHraFm5kBLMmK35wPcJzaA71g76v3/nvy6Uavvj5XlGOIwpMCN02/WBQfvaIVyhefbjCu1CzhQvKv4fpm/Gffgwy9wXFwDBKDP5xRN7GT7aRwxrdJcbCsVR/M/EryKVLSu6Gb1sajGKqiViu8vH7CEWue+mMRiPCzTVAM49f48b7qZU3kLcqWiI6EWH/4OINT3oyPX0FME10FaiuJOlSKG33OtUYeUxGg9b4dwOYyE3eaH/VAVP3fc+NCdgggAeFDJS6z7D/w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=4dsHbxf/Qx6U4WICZFXQB2fdxiRlrJjwsgVQBaNrypM=; b=hX9Jau6juC/JB7TSgxAOM6wv70lsUNvxx+FaZ83SRJMOyV2jOC1zPz9FuiwfCslhiAW/qjYlHR+CBjpnTgLjl2AcUhyOaVRjDepTXiZW5aXaKPx0+t500gKzgK6vXEfs0qV0HilupdWHu4oQEoIcgbrFEn/t+yf68xFgeVzIb122oNm5bU1EnOUadOPDUP4oiFQj0Lyqm4eVDNgsHQ0BxWZpc44rdLPDKno+IbCRTM05eM1Py2HVBC2KmXJfbvaUyBTtsTrs+ByE8UVN+RC8+QpeJFxSsk3oVZqH9hoNDPXOCdkHAGARr/GjujjDsGW61ke1VNnpAe868h7csZB8cQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4dsHbxf/Qx6U4WICZFXQB2fdxiRlrJjwsgVQBaNrypM=; b=QYCRhGvCfpWJ1bOqdrRiKlDnWy9QgzArjFnMbXPefpV4KrhphC2PoArGDgMUHa8UrrHhpdbuZVVjwlpfviN0LBCCOiDFiTZqxTu+IyvoT/QBDtPuRyxHi9mfXNm25IZqOq9O4YucLdt2ez9IaM846eYV360hUhjJO44puKh18+wWGq5fzrh8uI1zxBVWeS6F7ksFCJr7msbhkQi0oSttLVLuo5k1U4EIMTuJRZCm4pSluLgWn+8jXmGC7EhN6FpWu9PEHg2rHbjxCsI/L3UHUj9AxpRATCubdaOV1NlqBS8hHjppG+JIBcnM0qdtGOQx2B76l1V0RAuM92D2awAVew== Received: from YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:e6::17) by YQXPR01MB3126.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:4d::33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5546.16; Sun, 21 Aug 2022 00:02:49 +0000 Received: from YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM ([fe80::4c04:eddf:6168:b3ec]) by YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM ([fe80::4c04:eddf:6168:b3ec%3]) with mapi id 15.20.5546.021; Sun, 21 Aug 2022 00:02:48 +0000 From: Rick Macklem To: Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Topic: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Index: AQHYrQY7fWQ5YS0dF02y4OgRBDgrJa2owxGAgA/DcfU= Date: Sun, 21 Aug 2022 00:02:48 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 22356ee7-b7f1-41ef-bcb2-08da83087bf3 x-ms-traffictypediagnostic: YQXPR01MB3126:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ObyW3NCUmkJKGPEYNo+KrH2atHKKXlvhoUwlLEhv7uZ41+XcWTd9o3F/A0vUS8dLhe5GcyzcCDT/JiIqjG9wIDVvtjVIS3JOB2pi5REqDxq7/WE+K/+1wK6V/DeJFIMbITGFrEQJw/ltrtgES6ZO1hMpcl7J6m7hMKczxRD6HwfyaW7u5/nO/7MDjo6Uhdt39iVcqNhCCevWXlE3S7Xt8pYk2O0AvlDDHTy3v1Q3fFRIW+Hv4LD4tOhEJwyjegqdOE5tJ8rWko4lAXk6eZ9tFWLQxe2eseK1SbA0yyU7pKeysUUcqEXupCgt7t5I4+369tcpGOU44RQ17HYpxsSGFLKxW8fYuOOrmRkF9p1lXWRYpzCJ+nxk/Kq4sIefKxxZM98RGRQ5gvmW1itoIrPU/pmLULqvIN/FpK0KTE5WjWKkUkzf2FnfJ2vhTZOECf6hA2igYMqgGA6TI+ZwyJ3izWCeQpYbakn7iuJ4LIctWhHGzlbd/kl3MLBj7rR0nvKXe+zQ44cE59uXkVKj1F5Z5b2vm1sFfP4gfb3/yk+4ElhBQtiWKhy3G41stBHyg4EidDVHiv54ZG9GWqpjHIML4rTzmwxbu360MIP4Wp+Z+XwUe6tSVEMxSEVPgL4x9p/8/4414ElpWSvNhZmh0s325fnUQosJ6nrBkb8REGTTJ93Ef8gEZxaVGLMqYOqUHxVhjPoFHKk4tA7uovz1d7y8yERYwatiQuJDG7uCBzHDMSAqELde757GdeTpJNNSbsIHxFVki/x/bVf1N3aO5Clp/Q== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(346002)(396003)(376002)(366004)(39860400002)(136003)(66476007)(8936002)(55016003)(8676002)(316002)(66446008)(76116006)(91956017)(66946007)(86362001)(122000001)(66556008)(64756008)(5660300002)(6916009)(2906002)(52536014)(4326008)(786003)(53546011)(6506007)(478600001)(33656002)(7696005)(71200400001)(41320700001)(186003)(41300700001)(83380400001)(9686003)(38070700005)(38100700002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?2BcB8gO4/TcYBuzO20YdYvIPq9RlXmsfrXjel+JSugDlmnhv7RoqUP0/Z208?= =?us-ascii?Q?2lK6bXN8/zj0wzzF6zGz0DMgV85YUyUuStespmzrM/4cN0eMgwmeF6DRlU4G?= =?us-ascii?Q?8YBIIW6Lwp+P26LWz5J9dTX1dLlk5p5FOz+OanVEVGq+ZrESziy/Rm2QIf7U?= =?us-ascii?Q?5ey4lOBnke9kio9tdCihPGiujtpTD0LISjgu/06TRT2aaMMYhG4xpyfWSvdZ?= =?us-ascii?Q?Ol+u3YdsKrVksIPqmMtQkkene9qTGZWyMFg0axcXeza6w6jXC8cVkegiPrlf?= =?us-ascii?Q?JvIvdqnfniMSMqATcX7Ij+rSYU/FKdE6NpcvCa4R5Au7S7UiNluS8GubRBnk?= =?us-ascii?Q?nW0dQuNWvqLR3+c9EvvKFKDDqUSqUfsvgU5Rk9Ifi6qk1awwTuOdJS5CSzGQ?= =?us-ascii?Q?wYRKbe0B8Li6YcnpWh/5C+ZAU3pA9xeTJdQ6pMc+JPDGA/1u4n7Gg56TV7fi?= =?us-ascii?Q?e5cQgK6+7MlWTbEbLYm1iiXjwxh2pHT0NFqaRXVJkONcAd4vs4K9TyeMqRHD?= =?us-ascii?Q?GjZYhlAO2Xki3JxOTXD9dUfSz+bvDjlz8oj6xZwt3RNEZsGnQlx2bxpItXgo?= =?us-ascii?Q?PBg8SGZbNYViv4mRCPtJJbXwX8cd6q9CkRBNtpo66UdmIp7c6JnezxpA1hVy?= =?us-ascii?Q?mavZqUnZuXrwBJ7jtzGwcpAFScMCpz5wtYXluHIb1svSyzqH/O+rVrwrsUko?= =?us-ascii?Q?RZ6tlQGmbSBppY/gigqPqglkg2HSgcKX6DGmngEnGseLOZnwq7YBtqU18uzR?= =?us-ascii?Q?u6nCZXSg16P4nbM7yC5yDTj2Sjcc+/8gE5kcem2ANxAbzXtTbSalbED3awlH?= =?us-ascii?Q?WkbDsmmXP7acU3DRcEtBSpbx2ru0NxHA46DQZqDg4H0fXQjglFjMmqSyAhSo?= =?us-ascii?Q?QTYLJ/Lb9T1+JGDZV3HTCGdsEazvP20tCjK0tWCrG4Nh2NonUTxvPi6rf3mx?= =?us-ascii?Q?3Sx1VWwGy/gvnJd5eWpSBQx0HZvzWe2cij/XS8OZtvf7s1Si+4DtgDcYnBIb?= =?us-ascii?Q?jTJsTW+1WtG0W4job+Bzinn7OIEL4y4f4igmlvVUE/4Sc+yOoCGpkQFjbZ6x?= =?us-ascii?Q?u48DgVCGZBOMd8deXB15mZB5krek9dmMnkjDrX+HyvBE48bhDIlqmVi0tC4D?= =?us-ascii?Q?S1mnOnUAeE1J+hheWr6FP9J8mfdAfm/tHwveHLnqP8WWONS4Zxb7B8Ceq1SK?= =?us-ascii?Q?P+bxLhWV+MySPITGrDGNOro9mQE0opQm2tev6poE5BBy6U9bE3oalRFjj0hX?= =?us-ascii?Q?DdQ1a5xTKhF6V56xRDILSdyBXi0qR/61IU0qeAkHHLRZh/Dmkm/ShlG+ws3P?= =?us-ascii?Q?MHFMP+7vTDKXBBrNIx9Z4uGFLanSK3ET7PHw5uDcwJPDC2ew7wJNHBtpXznd?= =?us-ascii?Q?Q+nurdH6PdLKLZjNutHfKzMoXPo3q3nZGQ+XLU0v0Lnc+fZW2eVcc04xrfKs?= =?us-ascii?Q?7Dt6zj4D6ZKi9Qirq+KxwAkzMRrdArRp7+HssnshH+FA2BEwqURPL0sGfCi0?= =?us-ascii?Q?nKCtj0nQUDWL2VKNLjZz+MIsUGmhYyhZf2WztlTqGDzEFqPwBIz/hU81vZ0q?= =?us-ascii?Q?p6rREA9eeo5AfZVUd+YqHdUvp0lzjMrgKh4MDSQbriixTRLjecCCp6gvSTYd?= =?us-ascii?Q?jwv/tIV6hNSdi978452G6d81QW72pfdNHnTY3s2/tT7s?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 22356ee7-b7f1-41ef-bcb2-08da83087bf3 X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Aug 2022 00:02:48.8425 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: DFPrItX5dExxzLuNsSFkDbHkj2ObEioq6NebOshlGdv20pGz8wu/Lj2uBIibYI3LUzfpp9oyZhFhlnJQzOWSQA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR01MB3126 X-Rspamd-Queue-Id: 4M9G0C5lLgz47VY X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=QYCRhGvC; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.78 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; TO_DN_ALL(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.78:from] X-ThisMailContainsUnwantedMimeParts: N Just to summarize this... I was able to do a VOP_SEEK() which would be called with a LK_SHARED locked vnode and it seemed to work fine. However, ReadPlus (which is like Read, but allows for holes to be represented as in the reply instead of a stream of 0 bytes) seems to be a performance dud. I was surprised how poorly it performed compares to ordinary Read. Typically it would take 60% longer to read a file. I tried sparse and non-sparse files of various sizes and they always took longer. (If I disabled SEEK_DATA/SEEK_HOLE in the server code, so it never actually did holes, it worked comparably to regular Read, so somehow the overhead of doing SEEK_DATA/SEEK_HOLE was a big performance hit. It was using LK_SHARED locks, so it wasn't serializing the reads, but I don't really know why it performed so poorly?) Anyhow, unless the performance issue gets resolved, there is no reason to commit the code to FreeBSD's main. (NFSv4.2 operations, like ReadPlus, are all optional and are not required for an RFC conformant implementation.) rick ________________________________________ From: Konstantin Belousov Sent: Wednesday, August 10, 2022 7:11 PM To: Rick Macklem Cc: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked CAUTION: This email originated from outside of the University of Guelph. Do= not click links or open attachments unless you recognize the sender and kn= ow the content is safe. If in doubt, forward suspicious emails to IThelp@uo= guelph.ca On Wed, Aug 10, 2022 at 10:17:36PM +0000, Rick Macklem wrote: > Hi, > > When implementing what is called Read_Plus for the NFSv4.2 > server, I need to do SEEK_DATA/SEEK_HOLE. However, if I > use VOP_IOCTL(), I need to unlock/relock the vnode. > > This can result in problems if another RPC changes the size > of the file or allocates/deallocates data in the file while the > vnode is unlocked. > > >From what I can see, UFS does SEEK_DATA/SEEK_HOLE with > the vnode locked and ZFS doesn't seem to care/notice if it > is locked. > (Actually, ZFS looks like it might be unsafe, since it seems to > assume it can use the unlocked vnode that might be doomed, > but I do not know ZFS.) The statement about UFS needs more precision. UFS VOP_IOCTL() takes unlocked but references vnode, and the first thing vn_bmap_seekhole/data() and ufs_vmap_seekdata() do is vn_lock(vp, LK_SHARED). Since LK_RETRY flag is not specified, doomed vnodes result in ENOENT. I believe this interface was done because I wrote bmap-based seekhold/data while ZFS had its implementation already in place. It avoided taking the vnode lock, so UFS needed to do the same. I am not sure was the ZFS interface decision due to some internal consisten= cy guarantees already present, or because internal locking causing ordering issue with the vnode lock. > > Anyhow, does implementing a new vnode op VOP_SEEK(), which > takes a locked vnode and does SEEK_DATA/SEEK_HOLE sound > reasonable? You need to make some decision about ZFS first, I believe. UFS and generic buffer cache consumers fs are trivial to adopt, of course. From nobody Sun Aug 21 16:05:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M9gLx5KSQz4Z8ZR for ; Sun, 21 Aug 2022 16:05:29 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4M9gLw3lJjz3DNf for ; Sun, 21 Aug 2022 16:05:28 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 27LG5FZ1064846 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 21 Aug 2022 19:05:18 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 27LG5FpN064823; Sun, 21 Aug 2022 19:05:15 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 21 Aug 2022 19:05:15 +0300 From: Konstantin Belousov To: Rick Macklem Cc: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on tom.home X-Rspamd-Queue-Id: 4M9gLw3lJjz3DNf X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-1.85 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; NEURAL_SPAM_MEDIUM(0.14)[0.140]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; HAS_XAW(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_SOFTFAIL(0.00)[~all:c]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Sun, Aug 21, 2022 at 12:02:48AM +0000, Rick Macklem wrote: > Just to summarize this... > I was able to do a VOP_SEEK() which would be called with a > LK_SHARED locked vnode and it seemed to work fine. > > However, ReadPlus (which is like Read, but allows for > holes to be represented as in the reply > instead of a stream of 0 bytes) seems to be a performance > dud. > > I was surprised how poorly it performed compares to ordinary > Read. Typically it would take 60% longer to read a file. I tried > sparse and non-sparse files of various sizes and they always > took longer. (If I disabled SEEK_DATA/SEEK_HOLE in the server > code, so it never actually did holes, it worked comparably to > regular Read, so somehow the overhead of doing SEEK_DATA/SEEK_HOLE > was a big performance hit. It was using LK_SHARED locks, so > it wasn't serializing the reads, but I don't really know why it > performed so poorly?) What filesystem did you used on server? > > Anyhow, unless the performance issue gets resolved, there is > no reason to commit the code to FreeBSD's main. > (NFSv4.2 operations, like ReadPlus, are all optional and are not > required for an RFC conformant implementation.) Why not commit? It might make sense to add it, but guard under some knob. From nobody Sun Aug 21 21:00:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M9nvT461Pz4ZlNR for ; Sun, 21 Aug 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M9nvT28ldz3gpr for ; Sun, 21 Aug 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4M9nvT18mczPNC for ; Sun, 21 Aug 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27LL0bGT079343 for ; Sun, 21 Aug 2022 21:00:37 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27LL0bwS079342 for fs@FreeBSD.org; Sun, 21 Aug 2022 21:00:37 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202208212100.27LL0bwS079342@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 21 Aug 2022 21:00:37 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16611156371.CA487f0.77796" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661115637; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=fXgxrnUzJNal+tv2CzxdBajp1i538g6HxkXzEAjptxc=; b=C7uhthJHX9rspuXAdUwM+32KPy7Lj2Ehtv7MCN8VPopiWvWA6wmR6540ELx4FpRiNIzwFT 2C5EO6zijxjnTWJDPNVm5A6PQXroXmIzcRwbxE5FglWjKhF7jSrZQOi/3yyzhOw1RrvtPB 7SqYzphRSrk6KiKCe7LR9JIDvhbgj9tkWHfXbcdQFBRUAWaLan20uzo1c7FHTlJo7kvAJi 2VCw3Bkqe4Oa8N51XSYi++gP0OMAOUeAGUYYsNXDzKU/eNPd830hz0J5w8A8MfIpwpQGfO HdIjfy/Pv5CKrONIrt+2pU9GNymLo8/ONuGh/IS5cj8QSH+b9eLOkk1OtszL0w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661115637; a=rsa-sha256; cv=none; b=sRjufAolFa8e7By0gznWYrVncSC/7pvu4UdJ29v7StMb5TuqDK/VqkiuQTHXzjJG43edAG 7IVVGBG3+86h/BFiGOnGfTfLJqKeG8wCUNCF/FBElYqkxN/3iBCWGMC7ywFzbBzVBPwbu4 YTxVgtRKl/nFkvjXQnkDmHFamsIVXOaQCOTjf5SjWKpTybHNrH61hKxDv6m8QjnZDd9oqL WFeLmsYfCAhK07qaGktpEvE/OXYApAt9eUGFnZdQ7BXb0Ay0vCP8VwZt7Hsvknq6H+sCvV KezHOTR4sAozsQajI6/zVpgQjgIFV3utK7T+Fq9R66ymWh8PM2Zq6AyKuc2ayA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16611156371.CA487f0.77796 Date: Sun, 21 Aug 2022 21:00:37 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16611156371.CA487f0.77796 Date: Sun, 21 Aug 2022 21:00:37 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16611156371.CA487f0.77796-- From nobody Sun Aug 21 22:19:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M9qg36jzBz4Ywp9 for ; Sun, 21 Aug 2022 22:19:59 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2085.outbound.protection.outlook.com [40.107.116.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4M9qg22vjkz3p31 for ; Sun, 21 Aug 2022 22:19:58 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=E2pyPqE+x6V+cyVy3uwUTizOvWuClwM3aXVxu1h9P4ZfH8utbbrQGoiQ6dF75z8lFmoBx4j9FSO2mVl8b0SYHF/AUKdGl2J1w8nSVrGUiGMnW163eabiYp0+NCmCRaLPVoFXjUvnsBhjs1I4fdZf3JlWdykvxO06Y0wIS8QDE5hpnB/Q/ojfrQjCpo4i7huc+18ghB5CEOxNEHPDC79oTT2Opl56/xsDpTvbEGNl3Sx6v0z7HnnppcoN89cRcvcagGUuNV9yqeYu3pmGYuzUtI3sDpZX2baq6d6paCE0MzQ931UDD128UtqDbLIQNnifxpnJaAVoYyzs+e8A5vIYiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xPGvHvSuoeGmG2VuHTk8g4Cv38memPSyw3GscAnrk/Q=; b=fVds1Af/e+kk7p1TbPeHA2TN6a0Uld7bjUCONAFNuuhWd0GgNeezjftzJ1IF5s68B58Kb6DhU3GwCDYwWb8/RmVSHN5l7fq7dplRC4CUhzpMQVSFVh8G4RtkDNL3P98lQgg0w2xRN4xjtXKyh5nkCUMjkpDb8j6Z3jxvA7YO0HWUTTWq+qQL2f9i19h6GeAEY2QRAHZztSevkNTHmkTVTgkd2onSknL5NWmnTL68czwsj2BmgLd9iabXvF/WOm8MwknsnqqlVfCmrmi9JSDSTV29VcxIxqqE+4AVQbSGunP5HLRsLe2nKNt3VkC3pCV3kGNPfKqjOAw1O1TOfF2CyQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xPGvHvSuoeGmG2VuHTk8g4Cv38memPSyw3GscAnrk/Q=; b=mtSDOZzTSp9IW6GG06ZObdZfQW9UcUZ/k6lN1oTjFh3AKjb6Ov+PDhHH7ib2QesX7dLSik3uFML9Crpny9uopGZW5gs9o6XRAmlkAIB2pyQHK/Md/v7/8AlNxVPag/oE3zmm5NZT3wDV9dHI3v683DUBZfuq9v3IvRYk9PpVW0k30jrybm1CQOuC7fujZ22nXtsG1cuSSUsH+DKIFLQJJuUw2OuYbwPUs1wb7bDrYi1AePqqBNQspwiNWUtepFahj+JlfRmwiowUe5iu6hKsQ7v1nZeQ5wPgzf9CnNH6HT1qduwPaTZzYJwItw1wZpWxJiit3iIy6D7iCBLl5ob4Jg== Received: from YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:e6::17) by YT3PR01MB5041.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:48::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5546.16; Sun, 21 Aug 2022 22:19:56 +0000 Received: from YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM ([fe80::4c04:eddf:6168:b3ec]) by YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM ([fe80::4c04:eddf:6168:b3ec%3]) with mapi id 15.20.5546.022; Sun, 21 Aug 2022 22:19:56 +0000 From: Rick Macklem To: Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Topic: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Index: AQHYrQY7fWQ5YS0dF02y4OgRBDgrJa2owxGAgA/DcfWAAQ8LgIAAYqWL Date: Sun, 21 Aug 2022 22:19:56 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 63dc8940-3c54-4c94-88bb-08da83c34732 x-ms-traffictypediagnostic: YT3PR01MB5041:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: QAuVSUfNYiUkGcb4hM+sFVToUXcf/6v9uYtum/XvDXY2r0CKoV8vvdMxQMcmDg1VYTm94vRMxTF0zLcBl9dCBjrQ1fxxmyzBtAnqbVUD69TPRTpMb1CiW1RP+jysKInosQVESBH8SB4p+LPoiR/l+fIgveDooRpui2/qLIa7tlGPVDxIsTI5oosv8oRy1HndUr0GbYNpp+gG/PtYn+PkMcclTp75F9RV4X+oLuZgtL3QtPkgnTXDgDtbDzvsQJEFF3/bsLuMc+Xj8MBk6pgbcrlf6qRXOf8o8kyf8IW6DsziKyNlYLjY3AFrIdSyJNjOjuLyPJx+jgq5iraWxA+WPSXCrZrGyFsDDFWvAnFmacEmtiLO8QaWELcfpEsGGaWvjuoeDkJjbpIiJVhtLsGzhYOELAIhuib8ywFe1uCGOtWGPGDlZESr90Yo3a+0UbOVpw+tS7uR0DBOHXmVH8mvseUYJMxI9iQSqfbDsLNDH/0U2Bb3amm/Mhgl3OGnBL3QrYiF1cZwYLzOpv5HUu60PFa5cudiYhXk8cBXeMfNJhsKL3ColaP2oN3iujm8wKwFrNJe7NJBLxdhTidW2khYIqRErw8dGgU5Ww9Ah5H45syOLSr7eAySbfdpeov5VCf7ELKwHHC2e1S84dH5LNC82ZhQ2C7ODZxfDOgbtlO8bc6SWy4NIAZkjFjXovEVp5s/QsT04CoQKA8rXtI6J+y9izmwdkTf2rx7qx3VnHp0ac3GgLAjzd+zkx5gGZqyW9G5gumN6jbdcwNFGuWTQeCvQg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(366004)(396003)(346002)(39860400002)(136003)(376002)(66946007)(76116006)(33656002)(122000001)(66476007)(66446008)(64756008)(8676002)(4326008)(66556008)(86362001)(38070700005)(38100700002)(6916009)(91956017)(66574015)(9686003)(6506007)(41300700001)(478600001)(71200400001)(7696005)(186003)(41320700001)(786003)(316002)(55016003)(8936002)(83380400001)(2906002)(52536014)(5660300002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?JM/s5bT9bLpFmmmER+J0/inibFWR7WdUS3uyjBE9WObqPaOPLOQEHLDw4H?= =?iso-8859-1?Q?St7hRd+/MVrbzobYWccuW9oeZBB8KhcxE1mRs0V+YVB4eSm7Oegc16WOEh?= =?iso-8859-1?Q?LXpb9NcYAhQifOseR3lPX6Q3snVkT5/lbhdxbRnnM6ijgmrzRHY7Izy+tM?= =?iso-8859-1?Q?0x6bMgU+WmO4K2vq5r7ldUjEVhCQbNuDoWgtXREtBOWAcAfveW6QLgUL4S?= =?iso-8859-1?Q?lJXGq+nl7wmHAP6qdDkDqgm9BWOr9AE6qvXlzw4deUPppcy0lEYIuteigj?= =?iso-8859-1?Q?y69Bmd305LG7UWf8aLPl7O9YMgAW+UCO1hwuH7W5OVADd5aI/Smpp37elg?= =?iso-8859-1?Q?aZifnL+6B2M6+UMpTIpiUg59jXMNdMg6JbufOCpPj6v4Zk4LRQMKFrOe4b?= =?iso-8859-1?Q?iDReLcC+N3ViWOwoHJIXnn551TR8atVFApjKkBvc4S4gn4JVUHY5H7cdaY?= =?iso-8859-1?Q?M2m9X67rjXcfFZWGxvjETj13aRy/V6GCJZNdewdcSb8+o4/v4CWna6efw5?= =?iso-8859-1?Q?FQHJwnmzo/HTKYM9jwof9bm2oJd+TMO5+8HUs7dHDVhsf+FSXhubzyhMxa?= =?iso-8859-1?Q?h7LUzrSInj4tnhRSg9T3lqr40leQmyCf1oXkbr34pnseGKPCIaRl0m6b7u?= =?iso-8859-1?Q?Mn/mRiM3DTedaK7lg4d85EiSa00B14aIFCCSaocPW0tky8m4QZp6eb+lB8?= =?iso-8859-1?Q?i0u8bM1PNP4oNOl3Oxepr74K/eQHd0ypLJCVKTjpE0sgUGEVrr9vPaHOUw?= =?iso-8859-1?Q?Pe4LmYFDsfNc++4Seg+J4PxZS6nFG8jJ3pKEgbo4oJIBB66jyiufUEuA1i?= =?iso-8859-1?Q?jkU5mHIpZHBE82F9Sh9yMQHk2Qt7Uw+Dceev+1eXyjg+UpnnOBUsRH7b04?= =?iso-8859-1?Q?DapfIhQAnGEe38IauKo0pUlSgp5tokxqRaS0ZBlNnLgoVddKCcT6/gVFuG?= =?iso-8859-1?Q?QiTCZFJiBqdZSe00IQBZmUstStYutihPy+0taPil37eB1sxt4Z7NASa9Mo?= =?iso-8859-1?Q?78dEqXfCsQcidz/AthObVM/B71eyjwhWfUDFrU2mlp4jRfkD8+1rAh5Xmx?= =?iso-8859-1?Q?c1mSQaBSCchKW93ZaD6Vx4e85sWqKz05AUj9BoPwN90OvQYgN7DeR44xKL?= =?iso-8859-1?Q?BwhKCltWavUeXNMglsK3N7BqJRqVj0OmK+LVTUyum8GMTjO/wfpK/lkcNU?= =?iso-8859-1?Q?SLB8Iz+dzr+XchaWRsjbgWxtXHDu01ra8QmESENY6bvc2RxzNAgnzpARwu?= =?iso-8859-1?Q?qV1AvnG6rNKuGIiQu44pAluGEnPZRdxv8SapT5bvv7T1wQmwaREcKsqDGj?= =?iso-8859-1?Q?rWEc6q/aBm95wpA7gZon5zNMBhRxhu1O6aJ4tHIjm0qduAJkXF1wlZ7VGN?= =?iso-8859-1?Q?5He1QN5I2olOevX9ex7F+2LLwqolmlLOiYLOcYGYtXp30W8LHoCbR8fktT?= =?iso-8859-1?Q?56c7o7AkDr1q+7Qr/4skTKkcQoA5OHVABpkA1XFMG7slbnnl4LIeXl7/Kc?= =?iso-8859-1?Q?PMk2ApYkufycGPa0cCB2jscRKg32GBd0pMigGlXLEaHKKj3gGLKRe7vQAn?= =?iso-8859-1?Q?+Cpsxh/rZVD4INs334e0hPq8CNwRJjcWA6IZyd4tZ+GQS1g4vdNR3qqIuD?= =?iso-8859-1?Q?E99sQZTz0Q7vHxXOtzZzovyyeZgHJLIiM1ylrMJTCiDjNVv3uI2u9bJsrc?= =?iso-8859-1?Q?91kUS2fAJXjmSciap0QlGTCd7MSQsb4eXBx4nZ/B?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YT4PR01MB9736.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 63dc8940-3c54-4c94-88bb-08da83c34732 X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Aug 2022 22:19:56.2077 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: fXbfoitVOEnV7IsX/ZdFAg9tL8VdPN/+cngVJ9UDx2TOkltjlciyP0fe8NszJYG5AKVuyK42BTMCcpGZ7N0FEw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB5041 X-Rspamd-Queue-Id: 4M9qg22vjkz3p31 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=mtSDOZzT; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.85 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; TO_DN_ALL(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.85:from] X-ThisMailContainsUnwantedMimeParts: N Konstantin Belousov wrote:=0A= > On Sun, Aug 21, 2022 at 12:02:48AM +0000, Rick Macklem wrote:=0A= > > Just to summarize this...=0A= > > I was able to do a VOP_SEEK() which would be called with a=0A= > > LK_SHARED locked vnode and it seemed to work fine.=0A= > >=0A= > > However, ReadPlus (which is like Read, but allows for=0A= > > holes to be represented as in the reply=0A= > > instead of a stream of 0 bytes) seems to be a performance=0A= > > dud.=0A= > >=0A= > > I was surprised how poorly it performed compares to ordinary=0A= > > Read. Typically it would take 60% longer to read a file. I tried=0A= > > sparse and non-sparse files of various sizes and they always=0A= > > took longer. (If I disabled SEEK_DATA/SEEK_HOLE in the server=0A= > > code, so it never actually did holes, it worked comparably to=0A= > > regular Read, so somehow the overhead of doing SEEK_DATA/SEEK_HOLE=0A= > > was a big performance hit. It was using LK_SHARED locks, so=0A= > > it wasn't serializing the reads, but I don't really know why it=0A= > > performed so poorly?)=0A= > What filesystem did you used on server?=0A= The 60% slower was for tests like this with UFS:=0A= - I created a file with a 1Gbyte hole, followed by 1Gbyte of data.=0A= - Then I read the file with "time dd if=3D of=3D/dev/null bs=3D10M"= =0A= after remounting over NFS (to avoid NFS client caching).=0A= Here's the elapsed time for 4 runs for a UFS exported fs:=0A= Read ReadPlus=0A= 20.4, 4.3, 4.6, 4.3 18.7, 7.6, 7.7, 7.3=0A= (The first run was right after booting, so there was nothing=0A= cached within UFS.)=0A= --> So, as you can see, it took about 60% longer via ReadPlus.=0A= =0A= Now, what about the same test on an exported ZFS fs:=0A= Read ReadPlus=0A= 6.4, 5.7, 5.6, 5.4 110.8, 113.3, 110.7, 110.9=0A= --> Yep, only about 20 times (or 2000% longer).=0A= =0A= For a kernel build over NFS, it took about 70% longer=0A= when on a ZFS exported fs (I can't remember the UFS=0A= number, but it was significantly longer.)=0A= =0A= So, yes, ZFS is a lot worse, but UFS is bad enough that=0A= I can't imagine anyone using ReadPlus instead of ordinary=0A= Read?=0A= =0A= LANs have gobs of bandwidth these days. WANs might=0A= benefit from the lack of long streams of 0 bytes, but some=0A= (like my little DSL modem for my internet connection) will=0A= compress them out anyhow, I think?=0A= =0A= > >=0A= > > Anyhow, unless the performance issue gets resolved, there is=0A= > > no reason to commit the code to FreeBSD's main.=0A= > > (NFSv4.2 operations, like ReadPlus, are all optional and are not=0A= > > required for an RFC conformant implementation.)=0A= > =0A= > Why not commit? It might make sense to add it, but guard under some=0A= > knob.=0A= Commit it with a "never use this, performance is terrible" doesn't=0A= make a lot of sense to me, unless the ZFS performance issue=0A= were somehow resolved.=0A= =0A= I am now actually concerned about copy_file_range(2), which uses=0A= SEEK_HOLE/SEEK_DATA. There is a patch under review that at least=0A= increases the blocksize for ZFS, but the effect of disabling the use of=0A= SEEK_HOLE/SEEK_DATA in copy_file_range(2) also needs to be=0A= explored.=0A= --> Retaining holes as unallocated regions is nice, but at the very=0A= least, it could compare va_size with va_bytes to decide if there=0A= are holes worth looking for.=0A= =0A= rick=0A= =0A= From nobody Tue Aug 23 14:58:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MBsms16tVz4ZrVQ for ; Tue, 23 Aug 2022 14:58:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MBsms056Gz4KP1 for ; Tue, 23 Aug 2022 14:58:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MBsmr6FnZzYnR for ; Tue, 23 Aug 2022 14:58:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27NEwaC5061248 for ; Tue, 23 Aug 2022 14:58:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27NEwaHn061247 for fs@FreeBSD.org; Tue, 23 Aug 2022 14:58:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 238112] Unable to create ZVOL Date: Tue, 23 Aug 2022 14:58:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661266717; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2SIUNodikmmL4YTZY91SAHqI/gnxqbWkgsw1MMwkbUM=; b=ix7Y5Y+xNPKxkjaV66uWkZJl5kej6SaBmhNDIMeDt9y6Fi09IV/23QGL/oo140wIFhvqBU QqhYlSHu1lmY+kcSdFG0KgEIeu5Nbe8fbPSP/ejqGmMRktcegdnf7E6k+FDiHLXgcbWHAT aLxlSK8owqJSmq7eo2CzQap+VvVRIfRFPPIHzhh9vYpzY0Y7OH/xqcUCUF5n7Z8thwsjV0 P4n7cxpg2RPDXj+Mw6fHfykGOOtay3KztU38I6qvXcNZVAlyDnBwub/cMcAP/mCn0ArSsc eues4lLSjwrog6gNELhim4bofOiIz1zjhsq9NDtJvBI+rpehhWIk8lIo6Vyuqw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661266717; a=rsa-sha256; cv=none; b=uI440HNTVF9YrIvKleqPZUNuIO324PtegapUn4fIFj+PfbV0c0DZeK8RK1fDUM17bqArdz a6GAB5LksInPFlv1M/V+qdkgzGHikJMAn2PbU4NR4WM60XHhk3ibAHxIOTtuLU7h8ozPLD 59E6GLjtn22hKq7iyopPOjV8WFyaz12Cjy178U1EmxV4v22KBrCNUgR8SXexoNGT6RZLTL 4VDAFSLx3/UYbK4SvM+k4/z9QYcLdAIiDlV0+rOQgmzGu1LLy/OHsUqFJT4RiVYArXQCli +nNJKyqk73wGgQoUyNcDtD5Tb3KIslPbMvva3bImeLsKIGyRGkp/OXALMWP3wQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D238112 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Overcome By Events --- Comment #9 from Eugene Grosbein --- I'm no more in position to test or reproduce the problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Aug 25 03:57:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MCq0h0BlVz4ZhTw for ; Thu, 25 Aug 2022 03:57:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-8.consmr.mail.gq1.yahoo.com (sonic315-8.consmr.mail.gq1.yahoo.com [98.137.65.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MCq0f59J2z3DTv for ; Thu, 25 Aug 2022 03:57:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1661399824; bh=HmmdYBXOOwD9R0RRhn3uQiVIg39Link6xC7CCDFSUGM=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=LJXjcww5tIQ4qGBozkK2Rw+OREtBoaXKOd0nXguqvTKWxynt2utsct1evk8msQxlejqndbOF6wbw0GRtnAmqQLnXNEXbU5Xkmxza+ZZdVIFuj25NJSlrhz1vnwJAQGdpXzxV45ClaA5F717PLIi4Nl4RP4wKfZi94ef5Rw2CoAPmqRCbYUbtXtD+cz8LHQQp8QW28gbr4BHIbq7VGugVVzRBx2+QM+vi5fikrhZEda97dNS4Zd3P3Lo1u0Wa8EYH0SzpXk96vV+l7qKqOJH6caMhOG9n7BYqNu6rN7At5FO0zInZvaRGMwY3AD0HBz5WpM7K1xsbUvamsvjUjSFXDQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1661399824; bh=lh0MQajiawQ+vIgX9jL2z2u+HttL+dQBifm0LjtUT3a=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Edx0pdHqJ0QPYRdRSwmVX7Ep5MKsRbNRsPoX+I3SUnw/hgbpaezPE9OMXMVDBeSLmsYLK10e0qNnGCYwmn4o99b+Na4vmuxtUSdRa2IMxKsrkx9Gutf4NuA+fs38UMIhjDOujX9InyFp9uhInCD9xAHuNYxGw5pzUbLElp7igGKg72SRH8846n0PFur4sIgWzUAgJavFexoDUYuBtI9aQniiefM4XZGzAZJqZwf9GPp0Igx1Fn7n5Diytr9ioQYFbT5DXbNhdoegDJpoys1kzh8duD0/gWaLmBYnOy/tB2549X1b0PHMsxvPFuj1wgWhSwwVzEy6uTSpduvzphF5AA== X-YMail-OSG: selVKtIVM1n6Dj3EdxOxTMJE9h2J4iyZ.sxoMZK3PVZ.3Pwp3Aqp5rIourMU2Sf H1ahVJO45VUl7HjMCFs13SEjXr03KOeA368njZH8BCqHGFe.iUS4Zcev2lV4ODS6Bdq2sSqi8s7R ZTt7uDg7WsxK4cDNsqFnJaXTzbTsFhgQc8LuGsffS4JHctXvRy6zv.wkw83imm_tpEvfBUGuHPuR SrsAVloOTG.7c3HK1izt4qZFfN0vqyhUwdLi1ASEfmzrc2PGSDIIBwbWJJ5J2enioW0q5GPTLeIF LxP7W3w6u39YXPQ2wiee5hATXXsbATh4J08JosvgzpM7zFrMBL5WPBvMdSaJlmOMX0NVhgYxuNXM .Au_m5DABt3G2UDf4lXpfAqVFhz5k7c7KhY51RzPvl7I80NbiZa3A6Eoys0IvwjceNFk4ov40Ot9 sg.k2ecbNQik6X0ycnrxFLZqjabZXidW3LTVyspmlDcWyqnKHko5gWLy098XT5tepL_3YdEsbYQ1 WQtZD1TuPnUzzbSSpq6Wefv3hEnp8fCDCE7XhydCVqK090ALNS33XxResY5_oEoxGjOat291MGHP KA2Zf0iE2f_.nXkMSbu4_E_sqBQKQ_YA7oRLP5XlLA5jnCTXafG1Hh8f0qdPuTMLR5jNLEUh07z3 VG2TvXet1UZ4w87ggSF.D9jl6siZcHMWoqDafbzFTqFwsHXAGMtkMYhfhK8ygMubngJ2Yblkk_PY 4MW6.a5wC_U8qM71H0A2juO3b6vV7J264qTZS4No.VnPQhg4O12D6P5zwCCgoTEirvc_YQEX9bSe 2G.bnhqGCo35C12ZmI4ni7sWatkypdz4fcupbg4Iv2VZ0O65xHC90mmYIm2x5smBTMGrXuKHV5ny 83RIe1Df8lbZxvfSmgE8E7G8jp_zTbfPi6gy38l6YxDO223EXG9sVI0WHMG06hFUje40xO8832BC 0k167SJ69tEbWjHj.cyoGsZwjo.iFyPHwSltadINr0Rg87QKj1U7GD4JN.87SE5wYuDuhinhSSYm YJZHeW6bTDZFKRmwshrYv85afPNB36oEV2ilgI2u_RpI6SBwnDfkBTupoB9Sn9C._TQDcLQ0j7SZ KyJ4n6Px5LCYHy8a93OFc.hzxNw.pcjfOhvN0L_defRARRxOILbJkfHgj3Is95GWjwmhS32ohETL 0yh9yImcb7J76Dyr6q47MT1hjvm3d_3MTDOFy_xQnTUx9Jw82myFuHSDFRepf8ztYpKnDRwIK5wV KNLfrhvjsIeZMmNqRzDB0nmwYEnfk2Uuqgn3EhXd7EO7QFzLNO_nMLT76iGxtW5q0I5n7ax_h0sv 6yZ.qewx.dJ2xbp86A9MPa55YcTc8HIwkMiWtJSqggpasxMpvipEPtYn1Dc2s1kCrkJRo.FRm5dr a1EtJecknY_UZYbux33mBAcpnS_Ubs79rsc_4lW2OS9KNgDRO1QsYFuglI.Yd2CKeXZ0fHiSbBFP KUbx.o1OPU0RJ030XOboxS7vjBi57OQ2w3ViDe0thS7PUhNoC9ppST7OXWbit4czhQYCFUc6HR5K FBJIHAUUIYXuJln1sCkJa_g5OA3oIKyxL51mmEnWd5.R34lddyYSTi6HL3IndkFlfD2w_n8IFrpJ 7nI16COIaluurY2vGwSVIqyzVWtDQLvZotPi0o7YQb3sVQRh4LQW5jBRYtKu3PXiVs_99Uy1XLOj mYdqOhf_wwAuNh_A08XWBNCE.sfKbHaK5Tx7j_ZuYrPfQX6SHGkq0olZBp2sbebwpvLokZgXQ8wB NKfOZiyP2.kt7Xyy2l2W9xHtz1YdmrnM082P68ZU9YtAkxqa6yzVJ.g9JTlQaZBgLfcEFRb.C075 wPj4NZfqrYIl.DRwBkaFhRCq0DFKUQaGilcGG_XZJNTYD4Zcp5Jp8_J3aECSqFecM_IayIqZm_TY WfYWzBU2yFBBMRan7l1HHy7OM17sKwH6Lu8z.tcDwCqEYhXH46rbhWNX_M_piEWMW.d5TxtVl024 12xJqDxlSZlC2YCYSetQQx.wSOPTaouD5gdUCJd3p3Nydc.LiURPepXhef0xpSRZe5F7OHPydtlT nIoMFHZFowyxOFwe4OKZCcAOWsz.3kjAFFrpwuSH0MKNLADGhUIupuK1CG13RVxdbDc3d6A386Vf FVfInN7H4FXth3mt6dudTAaVXrvAySfCK5ddzVNMb_q6Ko1tXEVpLwmFWk806AAbemzFNthlIqmK Gmf9exKqsdlyHZBHBLEtUDEdMuJf03yqPadptioVLVeC8GD3mB35S6qM25MpS X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Thu, 25 Aug 2022 03:57:04 +0000 Received: by hermes--production-gq1-686964ccb6-z5t9k (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2bc86e8e7f7c8aaeb13575f9069afd46; Thu, 25 Aug 2022 03:57:00 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: How to get past "internal error: cannot import 'zroot': Integrity check failed" (no ability to import the pool)? Message-Id: <52858985-533A-4D68-A2E8-54251DFB0215@yahoo.com> Date: Wed, 24 Aug 2022 20:57:00 -0700 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3654.120.0.1.13) References: <52858985-533A-4D68-A2E8-54251DFB0215.ref@yahoo.com> X-Rspamd-Queue-Id: 4MCq0f59J2z3DTv X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=LJXjcww5; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-2.49 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.32:from]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N I seem to have gotten into a state where no zpool related command that required identification of a pool (such as by name) can work because import can not make the zpool available. (I give more context later.) How do I re-establish the freebsd-zfs partition into a form that I can repopulate it when its failed pool can not be imported? I'm appearently limited to zpool commands that reference the device instead of the pool (name) because the likes of "zpool import -f -FX . . ." leads to a panic. Note that this was for media that used zfs just to use bectl, not for other typical zfs reasons. For example, redundancy was-not/is-not a goal. For reference: =3D> 40 3907029088 da0 GPT (1.8T) 40 32728 - free - (16M) 32768 524288 1 efi (256M) 557056 7340032 2 freebsd-swap (3.5G) 7897088 26214400 - free - (13G) 34111488 20971520 3 freebsd-swap (10G) 55083008 12582912 - free - (6.0G) 67665920 29360128 4 freebsd-swap (14G) 97026048 4194304 - free - (2.0G) 101220352 33554432 5 freebsd-swap (16G) 134774784 67108864 6 freebsd-swap (32G) 201883648 364904448 7 freebsd-swap (174G) 566788096 2795503616 8 freebsd-zfs (1.3T) 3362291712 544737416 - free - (260G) At this point no attempt to preserve the content of the freebsd-zfs partition seems a likely way of going. But I'm unclear on how to even start over, given no ability to make the pool accessible by name. The sequence leading to how things are went like . . . # git -C /usr/ports fetch error: error reading from .git/objects/pack/pack-8e819c78469vm_fault: = pager read error, pid 1370 (git) c212148fe5d3922cc807e6858768e.pack: Input/output error vm_fault: pager read error, pid 1370 (git) . . . # bectl activate main-CA72 panic: VERIFY3(0 =3D=3D bpobj_open(&bpo, dl->dl_os, dlce->dlce_bpobj)) = failed (0 =3D=3D 97) cpuid =3D 0 time =3D 1661389515 KDB: stack backtrace: db_trace_self() at db_trace_self_wrapper+0x30 pc =3D 0xffff0000007fcfd0 lr =3D 0xffff000000101b80 sp =3D 0xffff0000b49f4ee0 fp =3D 0xffff0000b49f50e0 db_trace_self_wrapper() at vpanic+0x178 pc =3D 0xffff000000101b80 lr =3D 0xffff0000004cef08 sp =3D 0xffff0000b49f50f0 fp =3D 0xffff0000b49f5150 vpanic() at spl_panic+0x40 pc =3D 0xffff0000004cef08 lr =3D 0xffff00000129f360 sp =3D 0xffff0000b49f5160 fp =3D 0xffff0000b49f51f0 spl_panic() at dsl_deadlist_space_range+0x264 pc =3D 0xffff00000129f360 lr =3D 0xffff00000133d4f4 sp =3D 0xffff0000b49f5200 fp =3D 0xffff0000b49f53c0 dsl_deadlist_space_range() at snaplist_space+0x4c pc =3D 0xffff00000133d4f4 lr =3D 0xffff00000133899c sp =3D 0xffff0000b49f53d0 fp =3D 0xffff0000b49f5440 snaplist_space() at dsl_dataset_promote_check+0x648 pc =3D 0xffff00000133899c lr =3D 0xffff0000013385e8 sp =3D 0xffff0000b49f5450 fp =3D 0xffff0000b49f5530 dsl_dataset_promote_check() at dsl_sync_task_sync+0xcc pc =3D 0xffff0000013385e8 lr =3D 0xffff00000135fb3c sp =3D 0xffff0000b49f5540 fp =3D 0xffff0000b49f5590 dsl_sync_task_sync() at dsl_pool_sync+0x3cc pc =3D 0xffff00000135fb3c lr =3D 0xffff00000135251c sp =3D 0xffff0000b49f55a0 fp =3D 0xffff0000b49f55e0 dsl_pool_sync() at spa_sync+0x8f8 pc =3D 0xffff00000135251c lr =3D 0xffff00000138be28 sp =3D 0xffff0000b49f55f0 fp =3D 0xffff0000b49f57f0 spa_sync() at txg_sync_thread+0x1d8 pc =3D 0xffff00000138be28 lr =3D 0xffff0000013a2bf8 sp =3D 0xffff0000b49f5800 fp =3D 0xffff0000b49f58f0 txg_sync_thread() at fork_exit+0x88 pc =3D 0xffff0000013a2bf8 lr =3D 0xffff00000047c568 sp =3D 0xffff0000b49f5900 fp =3D 0xffff0000b49f5950 fork_exit() at fork_trampoline+0x14 pc =3D 0xffff00000047c568 lr =3D 0xffff00000081edd4 sp =3D 0xffff0000b49f5960 fp =3D 0x0000000000000000 KDB: enter: panic [ thread pid 4 tid 100198 ] Stopped at kdb_enter+0x48: undefined f907011f I was unable to boot from the media after this. Plugged the media into another machine . . . # zpool import -F -n zroot cannot import 'zroot': pool was previously in use from another system. Last accessed by (hostid=3D0) at Wed Aug 24 18:05:15 2022 The pool can be imported, use 'zpool import -f' to import the pool. # zpool import -f zroot Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1588]: failed to load zpool zroot Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1612]: failed to load zpool zroot Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1616]: failed to load zpool zroot internal error: cannot import 'zroot': Integrity check failed Abort trap (core dumped) # gdb zpool zpool.core . . . Core was generated by `zpool import -f zroot'. Program terminated with signal SIGABRT, Aborted. Sent by thr_kill() from pid 1716 and user 0. #0 thr_kill () at thr_kill.S:4 4 RSYSCALL(thr_kill) (gdb) bt #0 thr_kill () at thr_kill.S:4 #1 0x00002b0c6f3794f0 in __raise (s=3Ds@entry=3D6) at = /usr/main-src/lib/libc/gen/raise.c:52 #2 0x00002b0c6f420494 in abort () at = /usr/main-src/lib/libc/stdlib/abort.c:67 #3 0x00002b0c69415744 in zfs_verror (hdl=3D0x2b0c76263000, error=3D2092, = fmt=3Dfmt@entry=3D0x2b0c693d3135 "%s", ap=3D...) at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:344 #4 0x00002b0c69416324 in zpool_standard_error_fmt = (hdl=3Dhdl@entry=3D0x2b0c76263000, error=3Derror@entry=3D97, = fmt=3D0x2b0c693d3135 "%s") at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:729 #5 0x00002b0c69415ec8 in zpool_standard_error (hdl=3D0x0, = hdl@entry=3D0x2b0c76263000, error=3D0, error@entry=3D97, = msg=3D0x2b0c6ea23350 <__thr_sigprocmask> "\377\203",=20 msg@entry=3D0x2b0c665668e8 "cannot import 'zroot'") at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:619 #6 0x00002b0c6940687c in zpool_import_props (hdl=3D0x2b0c76263000, = config=3Dconfig@entry=3D0x2b0c95939080, newname=3Dnewname@entry=3D0x0, = props=3Dprops@entry=3D0x0, flags=3Dflags@entry=3D2) at /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_pool.c:2193 #7 0x00002b0be60f3344 in do_import (config=3D0x2b0c95939080, = newname=3D0x0, mntopts=3D0x0, props=3Dprops@entry=3D0x0, = flags=3Dflags@entry=3D2) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3190 #8 0x00002b0be60f3108 in import_pools = (pools=3Dpools@entry=3D0x2b0c762780e0, props=3D, = mntopts=3Dmntopts@entry=3D0x0, flags=3Dflags@entry=3D2, = orig_name=3D0x2b0c7622d028 "zroot", new_name=3D0x0,=20 do_destroyed=3Ddo_destroyed@entry=3DB_FALSE, = pool_specified=3Dpool_specified@entry=3DB_TRUE, do_all=3DB_FALSE, = import=3D0x2b0c665684a0) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3318 #9 0x00002b0be60e9074 in zpool_do_import (argc=3D1, argv=3D) at /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3804 #10 0x00002b0be60e3ce8 in main (argc=3D4, argv=3D) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:10918 (gdb) quit # zpool import -f -FX -N -R /zroot-mnt -t zroot zprpi . . . evantually . . . panic: Solaris(panic): zfs: adding existent segment to range tree = (offset=3D7a001ba000 size=3D40000) cpuid =3D 8 time =3D 1661395806 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x13c panic() at panic+0x44 vcmn_err() at vcmn_err+0x10c zfs_panic_recover() at zfs_panic_recover+0x64 range_tree_add_impl() at range_tree_add_impl+0x184 range_tree_walk() at range_tree_walk+0xa4 metaslab_load() at metaslab_load+0x6a4 metaslab_preload() at metaslab_preload+0x8c taskq_run() at taskq_run+0x1c taskqueue_run_locked() at taskqueue_run_locked+0x190 taskqueue_thread_loop() at taskqueue_thread_loop+0x130 fork_exit() at fork_exit+0x88 fork_trampoline() at fork_trampoline+0x14 KDB: enter: panic [ thread pid 6 tid 108968 ] Stopped at kdb_enter+0x44: undefined f907c27f db>=20 I had to unplug the disk to avoid reboots simply retrying the import and crashing the same way again. SIDE NOTE: Then, on reboot, I saw the following: . . . Setting hostid: 0x6522bfc4. cannot import 'zroot': no such pool or dataset Destroy and re-create the pool from a backup pid 49 (zpool) is attempting to use unsafe AIO requests = - not logging anymore pid 49 (zpool), jid 0, uid 0: exited on signal 6 source. cachefile import failed, retrying nvpair_value_nvlist(nvp, &rv) =3D=3D 0 (0x16 =3D=3D 0) ASSERT at = /usr/main-src/sys/contrib/openzfs/module/nvpair/fnvpair.c:592:fnvpair_valu= e_nvlist()Abort trap Import of zpool cache /etc/zfs/zpool.cache failed, will retry after root = mount hold release cannot import 'zroot': no such pool or dataset Destroy and re-create the pool from a backup source. cachefile imporpid 55 (zpool), jid 0, uid 0: exited on signal 6 t failed, retrying nvpair_value_nvlist(nvp, &rv) =3D=3D 0 (0x16 =3D=3D 0) ASSERT at = /usr/main-src/sys/contrib/openzfs/module/nvpair/fnvpair.c:592:fnvpair_valu= e_nvlist()Abort trap Starting file system checks: /dev/gpt/CA72opt0EFI: 281 files, 231 MiB free (14770 clusters) FIXED . . . Removing /etc/zfs/zpool.cache allowed reboots to avoid such. END SIDE NOTE. For reference, for the machine where I can plug in the media: # uname -apKU # line split for better readability FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #59 main-n256584-5bc926af9fd1-dirty: Wed Jul 6 18:10:52 PDT 2022 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400063 1400063 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Aug 26 00:09:49 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MDKw61kqSz4ZsrZ for ; Fri, 26 Aug 2022 00:09:58 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MDKw50z2Lz41NC for ; Fri, 26 Aug 2022 00:09:57 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 27Q09nFk012604 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 26 Aug 2022 03:09:52 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 27Q09nfQ012603; Fri, 26 Aug 2022 03:09:49 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 26 Aug 2022 03:09:49 +0300 From: Konstantin Belousov To: Rick Macklem Cc: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on tom.home X-Rspamd-Queue-Id: 4MDKw50z2Lz41NC X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-2.75 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; NEURAL_HAM_MEDIUM(-0.75)[-0.752]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; R_DKIM_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; HAS_XAW(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_SOFTFAIL(0.00)[~all:c]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Sun, Aug 21, 2022 at 10:19:56PM +0000, Rick Macklem wrote: > Konstantin Belousov wrote: > > On Sun, Aug 21, 2022 at 12:02:48AM +0000, Rick Macklem wrote: > > > Just to summarize this... > > > I was able to do a VOP_SEEK() which would be called with a > > > LK_SHARED locked vnode and it seemed to work fine. > > > > > > However, ReadPlus (which is like Read, but allows for > > > holes to be represented as in the reply > > > instead of a stream of 0 bytes) seems to be a performance > > > dud. > > > > > > I was surprised how poorly it performed compares to ordinary > > > Read. Typically it would take 60% longer to read a file. I tried > > > sparse and non-sparse files of various sizes and they always > > > took longer. (If I disabled SEEK_DATA/SEEK_HOLE in the server > > > code, so it never actually did holes, it worked comparably to > > > regular Read, so somehow the overhead of doing SEEK_DATA/SEEK_HOLE > > > was a big performance hit. It was using LK_SHARED locks, so > > > it wasn't serializing the reads, but I don't really know why it > > > performed so poorly?) > > What filesystem did you used on server? > The 60% slower was for tests like this with UFS: > - I created a file with a 1Gbyte hole, followed by 1Gbyte of data. > - Then I read the file with "time dd if= of=/dev/null bs=10M" > after remounting over NFS (to avoid NFS client caching). > Here's the elapsed time for 4 runs for a UFS exported fs: > Read ReadPlus > 20.4, 4.3, 4.6, 4.3 18.7, 7.6, 7.7, 7.3 > (The first run was right after booting, so there was nothing > cached within UFS.) > --> So, as you can see, it took about 60% longer via ReadPlus. Could you arrange some local test, without NFS, please? I might try to take a look at UFS then. > > Now, what about the same test on an exported ZFS fs: > Read ReadPlus > 6.4, 5.7, 5.6, 5.4 110.8, 113.3, 110.7, 110.9 > --> Yep, only about 20 times (or 2000% longer). > > For a kernel build over NFS, it took about 70% longer > when on a ZFS exported fs (I can't remember the UFS > number, but it was significantly longer.) > > So, yes, ZFS is a lot worse, but UFS is bad enough that > I can't imagine anyone using ReadPlus instead of ordinary > Read? > > LANs have gobs of bandwidth these days. WANs might > benefit from the lack of long streams of 0 bytes, but some > (like my little DSL modem for my internet connection) will > compress them out anyhow, I think? > > > > > > > Anyhow, unless the performance issue gets resolved, there is > > > no reason to commit the code to FreeBSD's main. > > > (NFSv4.2 operations, like ReadPlus, are all optional and are not > > > required for an RFC conformant implementation.) > > > > Why not commit? It might make sense to add it, but guard under some > > knob. > Commit it with a "never use this, performance is terrible" doesn't > make a lot of sense to me, unless the ZFS performance issue > were somehow resolved. > > I am now actually concerned about copy_file_range(2), which uses > SEEK_HOLE/SEEK_DATA. There is a patch under review that at least > increases the blocksize for ZFS, but the effect of disabling the use of > SEEK_HOLE/SEEK_DATA in copy_file_range(2) also needs to be > explored. > --> Retaining holes as unallocated regions is nice, but at the very > least, it could compare va_size with va_bytes to decide if there > are holes worth looking for. > > rick > From nobody Sat Aug 27 04:01:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MF30X6Zdnz4ZP4q for ; Sat, 27 Aug 2022 04:01:16 +0000 (UTC) (envelope-from peterj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MF30X66mhz3MDj for ; Sat, 27 Aug 2022 04:01:16 +0000 (UTC) (envelope-from peterj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661572876; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=h/SSTUEMRr3E1T61KnIUS3btBIheOo9gWCYcmfWPrlA=; b=YF/t82tT0xajBi/2XRYEra1RYV5P197I8X5Dd/2uInWCkhlkYED+ayuELgvyNyp9DK0c/6 iMrDkzVcwhNpEDmEt9wI7PYbp5yn8WR2xvLMuoGDf7ucBKQG1NxdxOgKE8ira7CLg+JtZY 1rJRfFtBP743KIQHevlgtdvfxkpTR2DpbYMXIRpUMiNPcD6HKR8rXWNjrrScBSWIU9+0m6 ONL+yxRT0sFeuCP/wqu6FIP5cZaTPqgpJSKTlbVQw+z+kCb4cBS5MnRG8q+37qVx5D9FOf 4nBocVaGu8tNanhdktXdqM/2OkG0PZJZQmdBYqcCQAP+zYlYxYaFz2loMneBYg== Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512) (Client did not present a certificate) (Authenticated sender: peterj) by smtp.freebsd.org (Postfix) with ESMTPSA id 4MF30X0Gd2z15qj for ; Sat, 27 Aug 2022 04:01:15 +0000 (UTC) (envelope-from peterj@freebsd.org) Date: Sat, 27 Aug 2022 14:01:09 +1000 From: Peter Jeremy To: freebsd-fs@freebsd.org Subject: ZFS bootfs vs vfs.root.mountfrom Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="SMVHMpE6bcvqhvH5" Content-Disposition: inline X-PGP-Key: http://www.rulingia.com/keys/peter.pgp ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661572876; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=h/SSTUEMRr3E1T61KnIUS3btBIheOo9gWCYcmfWPrlA=; b=udR99UDafYLqArg5zOzWAM+Tl3zLLEdDLRj3s8tbG8aCVGhaHBiGYyP0m7AOosgsjvx5iN SslXw465lKq243FeGz4YWVtxMEFCJkXJue02bJ/fPjgZvqNQOjZAFT3g3F3TSXlZadKK/j V5ZfSiBXZRwMq94Cptkj1xb6A0WICUfN+ekhvPV5XeF+3WiL+F4Hh7iXU3DgnQEvn8e79h XD8kMA9SGnKVIDH2E0XFVrTvIggNrk9hiEZHEgLdtL7MyV1AQ0/09PSEf074QQeFTEKkjY tkayHXovXcegkR4eQUxuxvN98pTswS1KoQzcRA7mZpObSF3VwGdakEFolGYjQA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661572876; a=rsa-sha256; cv=none; b=G1HlILyEQv4PJlzUsGFAl/O2ww6ALtyorouc2IH1k57cTs0C+FknANrZDXuMeEF+Rptgmc Gajd7ZgCPGWC7fzNbaH8GjNEilIwKPz0N8H64sThcIpTRSS4SPfWJ/6KCG7J25xgBWDzlQ fDbtsI/euLeQQgLtHMaW+GVhD3HhKKaAwd3izh9qwrqXbqF3VAMubt8fegIduJsVKqXI74 9sTzvlHaNqZHIR955ONyJiPj+6ysxQT3cM16GvpqczgHxTuaT7CbfSyzyymhqdrR+DfxwI uix0ZfGJpXMRXmD1kXzFXFNNPHpzA1I6fE1973Rn4uF3A94cyCdzLP//PdIsJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --SMVHMpE6bcvqhvH5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable When booting from ZFS was first introduced, the recommended approach was to configure the root filesystem via vfs.root.mountfrom. See (e.g.) https://lists.freebsd.org/pipermail/freebsd-fs/2011-September/012482.html https://lists.freebsd.org/pipermail/svn-src-head/2011-October/030641.html and people wanted to change that to use the zpool bootfs property - e.g. https://lists.freebsd.org/pipermail/freebsd-current/2009-October/012933.ht= ml https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html resulting in it becoming optional in SVN r235330 in May 2012: https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html The recommendation to use vfs.root.mountfrom remains in parts of the wiki (e.g. https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror step 2.6) and on mailing list posts (e.g. the thread starting at https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html). The loader(8) and loader.conf(5) man pages state that the root filesystem is set by vfs.root.mountfrom, with a default derived from /etc/fstab or, for ZFS only, currdev (the boot filesystem). OTOH, https://wiki.freebsd.org/BootEnvironments states "/etc/fstab must be purged of any / mount, and /boot/loader.conf must not be setting vfs.root.mountfrom directly." I can't find any other reference to this requirement. As for the BootEnvironment management tools themselves: * Neither beadm(8) nor bectl(8) mention vfs.root.mountfrom. * beadm(8) refers to https://forums.freebsd.org/showthread.php?t=3D31662, which recommends setting vfs.root.mountfrom * beadm(8) will update vfs.root.mountfrom in /boot/loader.conf if it exists but will not add it if it doesn't exist. * bectl(8) ignores /boot/loader.conf The last point means that switching an existing system from beadm to bectl is very likely to result in the system mounting the wrong root filesystem: An existing system is likely to have vfs.root.mountfrom set, since that used to be the only approach and is still widely recommended, whilst bectl ignores it and will therefore leave the old vfs.root.mountfrom value present. IMO, if setting vfs.root.mountfrom in /boot/loader.conf is no longer supported for ZFS, we need to do a better job of documenting that and removing documentation to the contrary. I also believe that bectl should at least warn if /boot/loader.conf sets vfs.root.mountfrom. --=20 Peter Jeremy --SMVHMpE6bcvqhvH5 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmMJlwBfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzRarw//TJYrKPMr8oRzjBQs0f7ywE55qjT27lwVAQeFRUA573dxF1UvULezfS7I 7xR7OvLfK6R3PQWjFSzvlpTX/sShCuq/cY/ic3Clh6u3dneamLOVs2WoUQQtxWqS Ic5qN0GFpT+esAujv83FsohG7OutfCKOqUf82jgQJIf2sRIW7j4hJCirgie2DeO3 AqNKKcY3for7NCp5Vl0rP4Kd8Y/5yDl0SZCDC/U4wg+x6A8LcycJrhGG9T2Bhh4x H8KXPqJ8d7n/Cjj9dJ2kJeCFsMGqGGKglohS92nA7H7GUUgR0ai+lsXSujtMOJnU K/GB+/LyQSh6uPJ52hwLvoRyHKTl3s2BBY42NX2XOSjhb3Ih/bL8RbrDXfjT8DRu Id8QQ0wZT8r8r/Ykln1zhsxzP/hRoyWZDZHme4IjQMn6HqIFN9/iQZZDA3pKKCAB r5YXwP5gE1hI14U5kluxyZHueEFFWQc2zY3GPzb0+4Fb+GpxCwqWEYVb6mjf0aNu UFT0nQ4UFw3jnux3rHHPK3nqZNV+MzvD1RN/2ZRHc/EvfW8KwqhDlp4YrgpiASLl Kjuw6mH7bteuZgkahXNTBOjOcVy9vPfahYgT4f/fTBjuwcV5H+AGm0I1y1W+a/Ui W8gXe0vivmU9s6SPiTDrBh6AcePHzPx1uEll2ewoT9VkQEHsHEA= =0pI/ -----END PGP SIGNATURE----- --SMVHMpE6bcvqhvH5-- From nobody Sat Aug 27 04:15:55 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MF3Kh446dz4ZQbl for ; Sat, 27 Aug 2022 04:16:08 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vs1-xe2c.google.com (mail-vs1-xe2c.google.com [IPv6:2607:f8b0:4864:20::e2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MF3Kg5hfYz3NJX for ; Sat, 27 Aug 2022 04:16:07 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vs1-xe2c.google.com with SMTP id p6so3417929vsr.9 for ; Fri, 26 Aug 2022 21:16:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc; bh=JikUl2LaMm/29qMeEkFLywcqnwINh+fJtt1z0LllJnE=; b=JZYOLCOfYETkcp8q4PyElTlfQr7xE5eV4vyjyheiCSkccmwZtptUz51RNDJJoTL7XT cBoaadw1K4NwIuxhkkzq62/uYLntWiVOhjC0mgQAKLm4KXHeZnqVAgS1DUOvFXtiqNFI 8DUJTB4zRqDyUveztnse9hw97dITI3bjBGcxHecgV+iWpXVzcoMzZt18tXPx7ipf0tmu IYndoVa4Pg2UoMCzwTNIQzCVGP6KPlKNgscAIaj2Y/OdiWk1sc5DuJAXrB9zPqG+wj7y gjzQHRHILzz0nBq4RkI55c7OLcwBDKKN14PIO9JzJbVQ7NcG3a3SKViWqHQi0ZYDHLOh 55ZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc; bh=JikUl2LaMm/29qMeEkFLywcqnwINh+fJtt1z0LllJnE=; b=N2SW/a36+1ZjqgDfPw6ang7FeRF6j2/d5vr7S3o6Pnb6iO2mInqIAoN7vdaEoc89Hz Wa6a4dqluT6TNH1ozP+OT9HujnPD78eJtaCAbI3fYgLdLyey61YGRH74fKWfvS1vFXPJ atW25e/3JNn0bHistDOQKELH6yux/mVQ3qm+yV5LIgMlepyf6Kr83qac7Ox2q/WQa8Bk wdlvFmMblfTj78ZZMowKmzU46WTTg0o+eoc2PsldRV3ND4bicVUFriPtVH4z6a5Fv4nL ZvLr9FmY9ii9GCiglCnvgahZUUDrRPiAKHK8aDXZm4fYGRl36QLNBzswuU47AH2eXJp0 fQwQ== X-Gm-Message-State: ACgBeo2L4jMGNGEqwM4iC87v0Y/XzEQPaoQKqdN9BJYcnVOqwwrt+ufX 1YumldgAaZIfQJe7g8kqxvdKfs9f/xwqf19YtafzB/uMP7e1oA== X-Google-Smtp-Source: AA6agR4sgpA1X48xv1/8IdWn2pUPpFfd+BBmfnERc18hdbWqDggAJihjPwB3qvrWKIFs9HJ/4CZolxpqkiHnKe2DbA4= X-Received: by 2002:a05:6102:2146:b0:38f:f3d6:51da with SMTP id h6-20020a056102214600b0038ff3d651damr867003vsg.38.1661573766829; Fri, 26 Aug 2022 21:16:06 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Fri, 26 Aug 2022 22:15:55 -0600 Message-ID: Subject: Re: ZFS bootfs vs vfs.root.mountfrom To: Peter Jeremy , Kyle Evans Cc: FreeBSD FS Content-Type: multipart/alternative; boundary="00000000000023f0ef05e7314a51" X-Rspamd-Queue-Id: 4MF3Kg5hfYz3NJX X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=JZYOLCOf; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::e2c) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2c:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_SPF_NA(0.00)[no SPF record]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[bsdimp.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --00000000000023f0ef05e7314a51 Content-Type: text/plain; charset="UTF-8" On Fri, Aug 26, 2022 at 10:01 PM Peter Jeremy wrote: > When booting from ZFS was first introduced, the recommended approach > was to configure the root filesystem via vfs.root.mountfrom. See (e.g.) > https://lists.freebsd.org/pipermail/freebsd-fs/2011-September/012482.html > https://lists.freebsd.org/pipermail/svn-src-head/2011-October/030641.html > and people wanted to change that to use the zpool bootfs property - e.g. > > https://lists.freebsd.org/pipermail/freebsd-current/2009-October/012933.html > https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html > resulting in it becoming optional in SVN r235330 in May 2012: > https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html Yes. This was a total hack at the time. The boot loader normally sets this variable w/o users intervening and this hack propagated into loader.conf files, which has always been a bad idea. The recommendation to use vfs.root.mountfrom remains in parts of the > wiki (e.g. https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror step > 2.6) and on mailing list posts (e.g. the thread starting at > https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html). > The loader(8) and loader.conf(5) man pages state that the root > filesystem is set by vfs.root.mountfrom, with a default derived from > /etc/fstab or, for ZFS only, currdev (the boot filesystem). > Yes. That's how it is supposed to work. The boot loader sets this based on where it loaded the kernel. This variable should *NEVER* be set in a loader.conf file unless you have a 'very special snowflake' system that can't determine it automatically. ZFS root isn't special. > OTOH, https://wiki.freebsd.org/BootEnvironments states "/etc/fstab > must be purged of any / mount, and /boot/loader.conf must not be > setting vfs.root.mountfrom directly." I can't find any other > reference to this requirement. > /etc/fstab isn't used for zfs root. I believe that BootEnvironments is 100% right here. > As for the BootEnvironment management tools themselves: > * Neither beadm(8) nor bectl(8) mention vfs.root.mountfrom. > This is correct. > * beadm(8) refers to https://forums.freebsd.org/showthread.php?t=31662, > which recommends setting vfs.root.mountfrom > This is bad advice. > * beadm(8) will update vfs.root.mountfrom in /boot/loader.conf if it > exists but will not add it if it doesn't exist. > This is terrible. It's part of the continuing papering over of bugs that have long ago been fixed and should, at most, warn that's its set and that it really shouldn't be. > * bectl(8) ignores /boot/loader.conf > This is proper behavior. > The last point means that switching an existing system from beadm to > bectl is very likely to result in the system mounting the wrong root > filesystem: An existing system is likely to have vfs.root.mountfrom > set, since that used to be the only approach and is still widely > recommended, whilst bectl ignores it and will therefore leave the > old vfs.root.mountfrom value present. > Yes. bectl likely should, at most, warn that it's set in loader.conf as an antifootshooting measure, but only due to the all-too-long history. > IMO, if setting vfs.root.mountfrom in /boot/loader.conf is no longer > supported for ZFS, we need to do a better job of documenting that and > removing documentation to the contrary. I also believe that bectl > should at least warn if /boot/loader.conf sets vfs.root.mountfrom. > It really never had been the proper way. One should almost never do it today, except in the above 'special snowflake' systems that still crop up from time to time (we have one at work since we still have some systems that use gmirror roots, and the boot loader doesn't set it right for them since we can't for logistical reasons set /etc/fstab, but that's not ZFS related). We should actively militate against it with extreme prejudice, though, for routine uses. We should rip out all references in the docs related to ZFS. We should warn if we detect it today. I agree completely with what you are saying here. I would be extraordinarily surprised to find anybody with a contrary opinion. Now, who is going to do the work? :) Warner --00000000000023f0ef05e7314a51 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Fri, Aug 26, 2022 at 10:01 PM Pete= r Jeremy <peterj@freebsd.org&g= t; wrote:
When b= ooting from ZFS was first introduced, the recommended approach
was to configure the root filesystem via vfs.root.mountfrom.=C2=A0 See (e.g= .)
=C2=A0https://lists.freebsd= .org/pipermail/freebsd-fs/2011-September/012482.html
=C2=A0https://lists.freebsd= .org/pipermail/svn-src-head/2011-October/030641.html
and people wanted to change that to use the zpool bootfs property - e.g. =C2=A0https://lists.free= bsd.org/pipermail/freebsd-current/2009-October/012933.html
=C2=A0https://lists.freebsd.org= /pipermail/freebsd-fs/2010-March/008010.html
resulting in it becoming optional in SVN r235330 in May 2012:
=C2=A0https://lists.freebsd.org= /pipermail/svn-src-head/2012-May/036902.html

Yes. This was a total hack at the time. The boot loader normally sets= this variable
w/o users intervening and this hack propagated=C2= =A0into loader.conf files, which has
always been a bad idea.

The recommendation to use vfs.root.mountfrom remains in parts of the
wiki (e.g. https://wiki.freebsd.org/RootOnZFS/GP= TZFSBoot/Mirror step
2.6) and on mailing list posts (e.g. the thread starting at
https://lists.freebsd.org/piperm= ail/freebsd-fs/2020-July/028351.html).
The loader(8) and loader.conf(5) man pages state that the root
filesystem is set by vfs.root.mountfrom, with a default derived from
/etc/fstab or, for ZFS only, currdev (the boot filesystem).

Yes. That's how it is supposed to work. The boot l= oader sets this based on
where it loaded the kernel. This variabl= e should *NEVER* be set in a
loader.conf file unless you have a &= #39;very special snowflake' system that
can't determine i= t automatically. ZFS root isn't special.
=C2=A0
OTOH, https://wiki.freebsd.org/BootEnvironments states = "/etc/fstab
must be purged of any / mount, and /boot/loader.conf must not be
setting vfs.root.mountfrom directly."=C2=A0 I can't find any other=
reference to this requirement.

/etc/fst= ab isn't used for zfs root. I believe that BootEnvironments is 100%
right here.
=C2=A0
As for the BootEnvironment management tools themselves:
* Neither beadm(8) nor bectl(8) mention vfs.root.mountfrom.

This is correct.
=C2=A0
* beadm(8) refers to https://forums.freebsd.org/s= howthread.php?t=3D31662,
=C2=A0 which recommends setting vfs.root.mountfrom
This is bad advice.
=C2=A0
* beadm(8) will update vfs.root.mountfrom in /boot/loader.conf if it
=C2=A0 exists but will not add it if it doesn't exist.
=

This is terrible. It's part of the continuing paper= ing over of bugs that have
long ago been fixed and should, at mos= t, warn that's its set and that it
really shouldn't be.
=C2=A0
* bectl(8) ignores /boot/loader.conf

Th= is is proper behavior.
=C2=A0
The last point means that switching an existing system from beadm to
bectl is very likely to result in the system mounting the wrong root
filesystem: An existing system is likely to have vfs.root.mountfrom
set, since that used to be the only approach and is still widely
recommended, whilst bectl ignores it and will therefore leave the
old vfs.root.mountfrom value present.

Y= es. bectl=C2=A0likely should, at most, warn that it's set in loader.con= f as an
antifootshooting=C2=A0measure, but only due to the all-to= o-long history.
=C2=A0
IMO, if setting vfs.root.mountfrom in /boot/loader.conf is no longer
supported for ZFS, we need to do a better job of documenting that and
removing documentation to the contrary.=C2=A0 I also believe that bectl
should at least warn if /boot/loader.conf sets vfs.root.mountfrom.

It really never had been the proper way. One sh= ould almost never do
it today, except in the above 'special s= nowflake' systems that=C2=A0still crop up
from time to time (= we have one at work since we still have=C2=A0some systems
that us= e=C2=A0gmirror roots,=C2=A0and the boot loader doesn't set it right for= them since
we can't for logistical reasons set /etc/fstab,= =C2=A0but that's not ZFS related). We
should actively militat= e against it with extreme prejudice,=C2=A0though,=C2=A0for routine
uses. We should rip out all references in the docs related to ZFS. We sho= uld
warn if we detect it today. I agree completely with what you = are saying here.
I would be extraordinarily surprised to find any= body with a contrary opinion.

Now, who is going to= do the work? :)

Warner
--00000000000023f0ef05e7314a51-- From nobody Sat Aug 27 16:46:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFN0365Hfz4ZmVL for ; Sat, 27 Aug 2022 16:46:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFN034KR7z3nT2 for ; Sat, 27 Aug 2022 16:46:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MFN033H80zpGc for ; Sat, 27 Aug 2022 16:46:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27RGkxU0055969 for ; Sat, 27 Aug 2022 16:46:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27RGkxtp055968 for fs@FreeBSD.org; Sat, 27 Aug 2022 16:46:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sat, 27 Aug 2022 16:46:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: arielmt@thornton2.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661618819; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jzUVGqtdd7oc1k/4xUeD2PTp12GGD7ptgfza80FVZkY=; b=PCfd1rMuF0yHgVvElXY3m3N9I5QP8+lNYkwFPaAomegjeyOkOVxNsbcf1Jqn756ad8Ll7Q FmbKzakRZmY+wqUvE3ZWSjoeV74zH7ZxGTOKkccoTK1mdPLS/LzNLuQJEntdE+dyJeYvNn 0Ww26V6bdq667/1Xc16BavxCkpLJUUqPZHoCTJDPBSo0L0LR5aLAYemtIvoaOvNcii4ljx ksTlQHgKPhqgHFUbMSjFzfe4ppF5jhiLZ920IM+gCY98kofJhIJP64DugI6qM/5dU+lvAZ RMVRtM7yfL1hT2p5Aar5eA5vKJcK22T8+Dbcy81Ueofc7AHvQDMKRZ0Eckz8mQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661618819; a=rsa-sha256; cv=none; b=PmAiwJYO8nllOG5R4eToPTjRNHfYpMtn7x6grDwutXL7fbMN5uv8tYsaBWDlirTqKFDD/w bJbPzNfgFGgi7+q+73jo1FvJFOnah3gofIJIhEpdxzsMTrZKnl3alPQ82bu7W0lyXjN7nN L1IXPkGXJJhSqYF5Xy5/SqflcsQ5k60SsEsxv3Y4rpSy8k8ss5cIy18hHbSuMmgackEseZ 5IDCwqe0RWDE43hk0QCPEbc1j19nlH5F/5IbDzG7nsI2k7Y4Ih0KFkaSNtjDUBvqFHySdu stLMhzMeK4Kuh371t8q1yPbkGhfan+v7E6JRmBIyQbkJV7fR0T70Ws7pkadkng== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 --- Comment #3 from Ariel Millennium Thornton --- New information: I booted into the installer image's "Live CD" option as a rescue system and tried to destroy one of the troublesome zfs snapshots today. I imported the pool with: # mkdir /tmp/swiftpaw # zpool import -R /tmp/swiftpaw zroot After getting the name of a snapshot, I tried: # zfs destroy -d zroot/var/mail@zfs-auto-snap_015m-2022-04-16-08h45 However, this caused a kernel panic as well. I don't know how to capture a core dump when booted into the installer image. The installer image I booted into is the same one used to install FreeBSD initially. It was obtained from https://download.freebsd.org/ftp/releases/ISO-IMAGES/13.0/FreeBSD-13.0-RELE= ASE-amd64-memstick.img --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 27 17:04:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFNN63GLZz4ZpJR for ; Sat, 27 Aug 2022 17:04:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFNN62lNCz3pWR for ; Sat, 27 Aug 2022 17:04:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MFNN61q3jzpKp for ; Sat, 27 Aug 2022 17:04:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27RH4MRs065778 for ; Sat, 27 Aug 2022 17:04:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27RH4MMs065777 for fs@FreeBSD.org; Sat, 27 Aug 2022 17:04:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sat, 27 Aug 2022 17:04:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pi@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661619862; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3+gOYUCJloD+oKTKH406KgzV3TnvQnrl0M6baFujlrw=; b=puXX2jVbZp2qzjrMeAhEQXGglboH90fWhvnHGzfZ0n89s/v2fqGgtIR5fAGlbLdUBdso9m 7FFFwZkteOPkn7PTmQS5owMuwlpfteW/EF2tj0CLzmRss7yM2CdDgVp2ktDVfa188iifvh nCrPBdYWZCvutJITZ+nEdoKTNBTkwUQt8PeXWGw5WaTrlZacsh0wiVQra9XN29ifi5FIk0 myj0XAyktY9ZFke5VrYvp0W0LB4K5tSjZa7EmlF3/PPHC4cB/69XzZDWMWi6RD7UDZMfnC 8l0/oUeVZ3xMegTA4oQgjFpJ7eq4BJ/IqKsVwVMQr6ktC2ate6sJdqg95HVQFA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661619862; a=rsa-sha256; cv=none; b=isT2JVP97SsHdEbnEPguDDgso1mlBEr27LWK///mMSW34ekWdkcpYxP/6oHazJN3G+f2B7 MNI3WXgpkvNNme/ne6ZsF5WewP8BwhAt9WFE2Ah78QT+deXfhh56yufFApS0phidcY0o0b 9lySnJ3tXO0UQDXiZXtWebCPmbuLEdw5d7vnkmBcdqY9gixEG8YyZMelpvTK8s/G5AzrUA PRX4xGQy2TCmHFbS4WX/MR3glPxdSjKBZfbXf2YHztf86fiVVrpAorTwu1rWUIq+r8Dg/g bJfS5P7dvCgMWGQFzT+14uivx/v8bp9QjeaapuYiDh9mGVmiCK9G13hrO6Z67w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 --- Comment #4 from Kurt Jaeger --- Does a zpool scrub work ? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 27 20:38:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFT6h0fZJz4b9GJ for ; Sat, 27 Aug 2022 20:38:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFT6g5hnWz448w for ; Sat, 27 Aug 2022 20:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MFT6g4g25zrcM for ; Sat, 27 Aug 2022 20:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27RKc3qu071036 for ; Sat, 27 Aug 2022 20:38:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27RKc3ej071035 for fs@FreeBSD.org; Sat, 27 Aug 2022 20:38:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sat, 27 Aug 2022 20:38:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: arielmt@thornton2.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661632683; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+3I2XIUfev27ucl3MXR9LMvNxUWAL40XGapJMpMKLds=; b=fdgMCDxAZcGhpXnwyc9UucjtUI5qUx+iix38UlOeMJueG+yA6tDBd87u7WsC52FI7EXLLV 65xSfBHk7+TKFBZWtV0GfoZ62g8tZH+m2wfxKBhMs2LNumWTlel8lzxrKLml/I1gok0TI8 K+7mSvV2rZpFRm2pbAIyogLbOQYHa2bCo5yJgH0MM1xzFg+PhW8x8QaU95o9YnSetJNu5j PgWEKSFdyXvdboge26Dev1TkwHoWcpOZ8ZWBX/ZC+NwH/eBB8H7uhKxBEPPGqKJ2psfllN CfetyCLLxAw7M2gmZTIGL7Nna+4tcjsFsEU9PAkvXJ0LfXQ5V0IoBqVoHwo45Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661632683; a=rsa-sha256; cv=none; b=WHnZ0G7zKx5ppwMUVVXj0KOMd7b1RVaaUiAhl2YXa6HXHJTPwyONdRzhZiznf89q3+LF8w gFWVA9m/1mACRRiO1F6e+yXF3zBcLECaB1XuLn3lIKjkodAtQ/OSaMDr2mXeTEy/XZYqqX BPYVGBE54pSgP9qKIvLavaLNwo9a4w6aQgP1EnAke/3MWHEedQoa5/gPrDMqTinw938KMy KLKFQjI+wCKi2jAaquxguejuul17tmtyMH80gG4zk2/f5+o/vmKred3oMeKA80g2YJe3rT /8vVZja3ALVo1fIARoFMYzBd2f50I1UJ0bC8SEiC/BZiSxZq5iOF4OX6IQKylQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 --- Comment #5 from Ariel Millennium Thornton --- (In reply to Kurt Jaeger from comment #4) Yes, with nothing bad found. # zpool status pool: zroot state: ONLINE scan: scrub repaired 0B in 02:02:05 with 0 errors on Sat Aug 27 13:18:45 = 2022 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 ada0p4.eli ONLINE 0 0 0 errors: No known data errors --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 28 00:18:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFZ0n2tgVz4ZHD4 for ; Sun, 28 Aug 2022 00:18:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFZ0m3cc2z3LXX for ; Sun, 28 Aug 2022 00:18:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1661645894; bh=KnfPdXC8GWRTINlE7RjSFotgUpN4GeqOTdnhKVav4t4=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=m5hMSkZVlEirTend0rd3h5FuCembey62/gq0zphMMKQZ/QSlgjvvyjsQDv9Qc6o8SMM7ihE62smCkr3F34SvoLufHF53rOufq+T9nqiAWnkzQceMig8s0iY/QBd0yOxMalc9CHMB745kidH1c9EllAI9lZQKzg16B964oAqIf0BB39aQNaWU2N3K5oUKFNRF70q35ZcxYSXyYWgoW++QN826jqZWQkdAecoDuxG4FWhvj7NNlRzOD1+hLSuQbO7dQYeAdgs3RO0pFu6WHwvBHFIBgQK+agGlFEYgWGN+QZxi6IKN0GiUspuhXjfF7+tscDhDoy10jQ47Jp9HPNcy2g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1661645894; bh=7eHXYkO4p2BqNAQY4TXlJI0fYPu81XoYNVrMotmNziB=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=gjN+5soQB28fPnYp8F67Mj+9fmiqVJLAHrgKYqpmOBMn6PyvzzUL+Q3l/ypXUDHhBXzd7hoLBiRaLT/yHU7oXjT2ZUX3lAkt/kZZRDrWFBUnWQdNWMU6EO7wUd2hFfEOxlhDgqomXWia44fLhaAbijGEAvuyiGmN6390n7ulH61OCi0zque/EGoAAp04vZ4ekPx03io9HsPUBYRoBd//4ftSIS/hwKKQv5ykOSn2Kwe3OpD3C0mi9epF4bf95ix0rX3usDrUhYr99wwPw631Om048e0m4AJtSvKjr2y5HFD7M7C6t3MXBHs5XqvIBR0D4J90OsHAqQh5CqpH+2UXPQ== X-YMail-OSG: Uj5InxEVM1kWQxDSChHo1jJ36PdQ1s3hvblMDsxxxE8vaZZ0ViU2KwVUuL_rIud 4BXg39y.kbyB.UnN66.ESq6mS024PLO80_h1CRR5ZsrPepKe6uGq1r.Pj3HmLyzdndWu5zBR6nnP sVeLZOm1ePHTxe1WMS2RXkG2wGpV0AjHGEkJxRLcW7_40UdObHsx2EwP.j2c33o0SJABwOv6eIDt psSVBMWjZSPyD6QuDRPaMGOBaRS69OAN.KvhrWj.5pCG1bRpkgkjzn7aWBHRo8FnUJ5iK2SM0vdu RIndMiAhb54SFW0f6Pg2zPHqpsCOkmL3NA37PbHwZdfKwjycPnzSK4VkAGx7O9w4k2iDmE19A2tl GXG_A.vRKnbDrN6nAnfFfm0mEOaEztJvzWamELalOWhL5WqzsrQlL.Vddqg1poaZycJW5PjNb6OO fwZXNyrJm1Em9ASSjOz1.aJ1CTHin4FSC6ASdJy.yW_qEAV10cZcXgnFoUezOJNVgl2OylXLpADu HCen8dBWiIN1o_k35ltl_Tr319UyHpli65_uYHC6MfkorHnoTScoOgTVjTWkCXBz.u7AvZ6CskM. Fw2GUJxra0qeI0MxrUVxtmHo0T0n6EAt9UV7oDvAHV_59KEvDDfv7CsynTY93VGMkphcV9oXYt3O dB.Igcd0MeSxuPurA83f3tgONcxDq1dPo.76bh21WamztNjEn0kipBj4zPm1gQyQ9pUBNGVNkJmt NYhPrt.p0tiWv5NkUEDJG77SNH3.LGB1hUYiMEE3_vreeGewyOBcQMFykhMueOdV2A0UOVA3jDmE XeliTgGkIaKHornZ8hxZNi8KDHobNwlc688Us3iJ1Cjghygy78ve9gLeAOYVoWO6oN42E4vNayDE c4tN7wGxnz.A.WyRPi3imbz41kSJLUZs1clfOpJA6EL81zqXq03BwRMFTd52Q6gphpMenY0ajmMU YSB1.f44VdJV7hTrFfRfFMT_Y9Yj0yt4PcXJRvohCRBlhCg3pgYVqy3QWmGj8MUIIb4k91YDTunq oSe23hCUlxoxNGHzxECCMdjuf3LCpKbVLW2U0U2exkMXqul81T2xgQwnA8YT6TOFp6inuea53hcA ISLQW0Hu.9d12v2vKFXqkxTVwuFAooTpaYbZCeSRntQUfzbPDfaubZixbkJz3vfVOTXXqwju4uUC W11OZtIKSUFi.hLOkvCBjdXM6IwPypO0cOjtky.BRUr7o_FjHE3rxdorBsnk2cKsGvg0bfkB1kdn 3rFWTXfNM0zxbKR_af9YzOuabmlXcTt2HdxJgEGgKlaCGkeEwZS0NYiTq2tjGZwYl0hp29zrAakD fo0Rh54CS2wKGr33aQqR.fXJuAzf8GqY2ehbo3OhXsHnjrr..XkCmJ0CSHIyni188LrpvZpVtgSB he47.xHJhidRe_rvlbUPgDAsYDJZiv0rc96EOjOILmcSVfA.8YBzqjvg2pjDpCmL1rS6TKfd.b.a zNVVbEFA_O.fx6Gw_ABuvB5vhLX5zVxDK_i2zzx0704PNMBlDQr0MdffEMLWHTwhk8CulZPJrd_T RP796yVfq96WFQMEKfEgi1aKjsBCZ8Tt7Nw8bxeF0LPMqWBAlBCtZofM_LyrSSZj1tw_n89XtoHq SMhY7AeWlKTj23n8K2CqTOpVKbhawtnnB3zMmLizrT1Xzy.1f_3SpW9W_6gkMVfop2RPbCUYbmc5 .nfoMDqe1HyANQsWM9HRknSrYa51HVFHSND5laiGvzjg4Y93wEFIOjBfWiGdzvKFnhMtzCl4KYwW ZwHzq8P6Rzofk3IdiYWUYqRUJ3HHv07XGo.4ylFOMwsvyGPPFuSmVIx0dlEaIglPHHjMilYXy92H 40EGgT0mikZrS7ddYV1UVmJWJqw8ZDxVBNpnxhaYuIykKVGN7Y5h5qd_J97nhdznDM.fIkc4NGG1 4FZKUdhMcfZb2xWOB1ToVbFrI6n_eP1GeXR06ZuliMJiAqnVYbFzWDThFq4tZEP8P_7.yE1Uj209 Y_noupREvmRfnBfdGqZgdXQkhV67hFvxtfKCnofg0GK2DYiXo_Hq7Yf3G2ASWL9z.DZqCXQQBjPq H9r7cOjYU__HFvl_5blB5AgJkNMAo6K0W1ivQ.duTAD.RPxyCwBFBgvBM6rKtvpU6hYeKUhsd_.o R2OGPKOplCcQzkNjqMjbzoAV.A6NGWcBi9EB19SQfXnfZXiTEelX0lVFs_FYiEBOYXTLNd.OAAk0 r.ZSEHIh2XalOALfsQIs7e3DpjAU7Xd7VExPm29ouYTAuHXCxR7k6fxBZ.VUi0A-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Sun, 28 Aug 2022 00:18:14 +0000 Received: by hermes--production-bf1-7586675c46-zlq7r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 02fc1b2cc595c451c6c3ca94f0ebefb0; Sun, 28 Aug 2022 00:18:11 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: How to get past "internal error: cannot import 'zroot': Integrity check failed" (no ability to import the pool)? Date: Sat, 27 Aug 2022 17:18:09 -0700 References: <52858985-533A-4D68-A2E8-54251DFB0215@yahoo.com> To: freebsd-fs@freebsd.org In-Reply-To: <52858985-533A-4D68-A2E8-54251DFB0215@yahoo.com> Message-Id: <7B35AACC-2B1C-4E60-8C5C-3A37B8A69213@yahoo.com> X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4MFZ0m3cc2z3LXX X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=m5hMSkZV; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-2.45 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.96)[-0.957]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from] X-ThisMailContainsUnwantedMimeParts: N On 2022-Aug-24, at 20:57, Mark Millard wrote: > I seem to have gotten into a state where no zpool related > command that required identification of a pool (such as > by name) can work because import can not make the zpool > available. (I give more context later.) >=20 > How do I re-establish the freebsd-zfs partition into > a form that I can repopulate it when its failed pool > can not be imported? I'm appearently limited to > zpool commands that reference the device instead of the > pool (name) because the likes of "zpool import -f -FX > . . ." leads to a panic. >=20 > Note that this was for media that used zfs just to use > bectl, not for other typical zfs reasons. For example, > redundancy was-not/is-not a goal. For reference: >=20 > =3D> 40 3907029088 da0 GPT (1.8T) > 40 32728 - free - (16M) > 32768 524288 1 efi (256M) > 557056 7340032 2 freebsd-swap (3.5G) > 7897088 26214400 - free - (13G) > 34111488 20971520 3 freebsd-swap (10G) > 55083008 12582912 - free - (6.0G) > 67665920 29360128 4 freebsd-swap (14G) > 97026048 4194304 - free - (2.0G) > 101220352 33554432 5 freebsd-swap (16G) > 134774784 67108864 6 freebsd-swap (32G) > 201883648 364904448 7 freebsd-swap (174G) > 566788096 2795503616 8 freebsd-zfs (1.3T) > 3362291712 544737416 - free - (260G) >=20 > At this point no attempt to preserve the content of > the freebsd-zfs partition seems a likely way of going. > But I'm unclear on how to even start over, given no > ability to make the pool accessible by name. >=20 > The sequence leading to how things are went like . . . >=20 > # git -C /usr/ports fetch > error: error reading from .git/objects/pack/pack-8e819c78469vm_fault: = pager read error, pid 1370 (git) > c212148fe5d3922cc807e6858768e.pack: Input/output error > vm_fault: pager read error, pid 1370 (git) > . . . >=20 > # bectl activate main-CA72 > panic: VERIFY3(0 =3D=3D bpobj_open(&bpo, dl->dl_os, dlce->dlce_bpobj)) = failed (0 =3D=3D 97) >=20 > cpuid =3D 0 > time =3D 1661389515 > KDB: stack backtrace: > db_trace_self() at db_trace_self_wrapper+0x30 > pc =3D 0xffff0000007fcfd0 lr =3D 0xffff000000101b80 > sp =3D 0xffff0000b49f4ee0 fp =3D 0xffff0000b49f50e0 >=20 > db_trace_self_wrapper() at vpanic+0x178 > pc =3D 0xffff000000101b80 lr =3D 0xffff0000004cef08 > sp =3D 0xffff0000b49f50f0 fp =3D 0xffff0000b49f5150 >=20 > vpanic() at spl_panic+0x40 > pc =3D 0xffff0000004cef08 lr =3D 0xffff00000129f360 > sp =3D 0xffff0000b49f5160 fp =3D 0xffff0000b49f51f0 >=20 > spl_panic() at dsl_deadlist_space_range+0x264 > pc =3D 0xffff00000129f360 lr =3D 0xffff00000133d4f4 > sp =3D 0xffff0000b49f5200 fp =3D 0xffff0000b49f53c0 >=20 > dsl_deadlist_space_range() at snaplist_space+0x4c > pc =3D 0xffff00000133d4f4 lr =3D 0xffff00000133899c > sp =3D 0xffff0000b49f53d0 fp =3D 0xffff0000b49f5440 >=20 > snaplist_space() at dsl_dataset_promote_check+0x648 > pc =3D 0xffff00000133899c lr =3D 0xffff0000013385e8 > sp =3D 0xffff0000b49f5450 fp =3D 0xffff0000b49f5530 >=20 > dsl_dataset_promote_check() at dsl_sync_task_sync+0xcc > pc =3D 0xffff0000013385e8 lr =3D 0xffff00000135fb3c > sp =3D 0xffff0000b49f5540 fp =3D 0xffff0000b49f5590 >=20 > dsl_sync_task_sync() at dsl_pool_sync+0x3cc > pc =3D 0xffff00000135fb3c lr =3D 0xffff00000135251c > sp =3D 0xffff0000b49f55a0 fp =3D 0xffff0000b49f55e0 >=20 > dsl_pool_sync() at spa_sync+0x8f8 > pc =3D 0xffff00000135251c lr =3D 0xffff00000138be28 > sp =3D 0xffff0000b49f55f0 fp =3D 0xffff0000b49f57f0 >=20 > spa_sync() at txg_sync_thread+0x1d8 > pc =3D 0xffff00000138be28 lr =3D 0xffff0000013a2bf8 > sp =3D 0xffff0000b49f5800 fp =3D 0xffff0000b49f58f0 >=20 > txg_sync_thread() at fork_exit+0x88 > pc =3D 0xffff0000013a2bf8 lr =3D 0xffff00000047c568 > sp =3D 0xffff0000b49f5900 fp =3D 0xffff0000b49f5950 >=20 > fork_exit() at fork_trampoline+0x14 > pc =3D 0xffff00000047c568 lr =3D 0xffff00000081edd4 > sp =3D 0xffff0000b49f5960 fp =3D 0x0000000000000000 >=20 > KDB: enter: panic > [ thread pid 4 tid 100198 ] > Stopped at kdb_enter+0x48: undefined f907011f >=20 > I was unable to boot from the media after this. >=20 > Plugged the media into another machine . . . >=20 > # zpool import -F -n zroot > cannot import 'zroot': pool was previously in use from another system. > Last accessed by (hostid=3D0) at Wed Aug 24 18:05:15 2022 > The pool can be imported, use 'zpool import -f' to import the pool. >=20 > # zpool import -f zroot > Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1588]: failed to load zpool zroot > Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1612]: failed to load zpool zroot > Aug 24 18:13:47 CA72_16Gp_ZFS ZFS[1616]: failed to load zpool zroot > internal error: cannot import 'zroot': Integrity check failed > Abort trap (core dumped) >=20 > # gdb zpool zpool.core > . . . > Core was generated by `zpool import -f zroot'. > Program terminated with signal SIGABRT, Aborted. > Sent by thr_kill() from pid 1716 and user 0. > #0 thr_kill () at thr_kill.S:4 > 4 RSYSCALL(thr_kill) > (gdb) bt > #0 thr_kill () at thr_kill.S:4 > #1 0x00002b0c6f3794f0 in __raise (s=3Ds@entry=3D6) at = /usr/main-src/lib/libc/gen/raise.c:52 > #2 0x00002b0c6f420494 in abort () at = /usr/main-src/lib/libc/stdlib/abort.c:67 > #3 0x00002b0c69415744 in zfs_verror (hdl=3D0x2b0c76263000, = error=3D2092, fmt=3Dfmt@entry=3D0x2b0c693d3135 "%s", ap=3D...) at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:344 > #4 0x00002b0c69416324 in zpool_standard_error_fmt = (hdl=3Dhdl@entry=3D0x2b0c76263000, error=3Derror@entry=3D97, = fmt=3D0x2b0c693d3135 "%s") at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:729 > #5 0x00002b0c69415ec8 in zpool_standard_error (hdl=3D0x0, = hdl@entry=3D0x2b0c76263000, error=3D0, error@entry=3D97, = msg=3D0x2b0c6ea23350 <__thr_sigprocmask> "\377\203",=20 > msg@entry=3D0x2b0c665668e8 "cannot import 'zroot'") at = /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_util.c:619 > #6 0x00002b0c6940687c in zpool_import_props (hdl=3D0x2b0c76263000, = config=3Dconfig@entry=3D0x2b0c95939080, newname=3Dnewname@entry=3D0x0, = props=3Dprops@entry=3D0x0, flags=3Dflags@entry=3D2) > at /usr/main-src/sys/contrib/openzfs/lib/libzfs/libzfs_pool.c:2193 > #7 0x00002b0be60f3344 in do_import (config=3D0x2b0c95939080, = newname=3D0x0, mntopts=3D0x0, props=3Dprops@entry=3D0x0, = flags=3Dflags@entry=3D2) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3190 > #8 0x00002b0be60f3108 in import_pools = (pools=3Dpools@entry=3D0x2b0c762780e0, props=3D, = mntopts=3Dmntopts@entry=3D0x0, flags=3Dflags@entry=3D2, = orig_name=3D0x2b0c7622d028 "zroot", new_name=3D0x0,=20 > do_destroyed=3Ddo_destroyed@entry=3DB_FALSE, = pool_specified=3Dpool_specified@entry=3DB_TRUE, do_all=3DB_FALSE, = import=3D0x2b0c665684a0) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3318 > #9 0x00002b0be60e9074 in zpool_do_import (argc=3D1, argv=3D) at /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:3804 > #10 0x00002b0be60e3ce8 in main (argc=3D4, argv=3D) at = /usr/main-src/sys/contrib/openzfs/cmd/zpool/zpool_main.c:10918 > (gdb) quit >=20 >=20 > # zpool import -f -FX -N -R /zroot-mnt -t zroot zprpi > . . . evantually . . . > panic: Solaris(panic): zfs: adding existent segment to range tree = (offset=3D7a001ba000 size=3D40000) > cpuid =3D 8 > time =3D 1661395806 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > vpanic() at vpanic+0x13c > panic() at panic+0x44 > vcmn_err() at vcmn_err+0x10c > zfs_panic_recover() at zfs_panic_recover+0x64 > range_tree_add_impl() at range_tree_add_impl+0x184 > range_tree_walk() at range_tree_walk+0xa4 > metaslab_load() at metaslab_load+0x6a4 > metaslab_preload() at metaslab_preload+0x8c > taskq_run() at taskq_run+0x1c > taskqueue_run_locked() at taskqueue_run_locked+0x190 > taskqueue_thread_loop() at taskqueue_thread_loop+0x130 > fork_exit() at fork_exit+0x88 > fork_trampoline() at fork_trampoline+0x14 > KDB: enter: panic > [ thread pid 6 tid 108968 ] > Stopped at kdb_enter+0x44: undefined f907c27f > db>=20 >=20 > I had to unplug the disk to avoid reboots simply retrying > the import and crashing the same way again. >=20 > SIDE NOTE: Then, on reboot, I saw the following: > . . . > Setting hostid: 0x6522bfc4. > cannot import 'zroot': no such pool or dataset > Destroy and re-create the pool from > a backup pid 49 (zpool) is attempting to use unsafe AIO = requests - not logging anymore > pid 49 (zpool), jid 0, uid 0: exited on signal 6 > source. > cachefile import failed, retrying > nvpair_value_nvlist(nvp, &rv) =3D=3D 0 (0x16 =3D=3D 0) > ASSERT at = /usr/main-src/sys/contrib/openzfs/module/nvpair/fnvpair.c:592:fnvpair_valu= e_nvlist()Abort trap > Import of zpool cache /etc/zfs/zpool.cache failed, will retry after = root mount hold release > cannot import 'zroot': no such pool or dataset > Destroy and re-create the pool from > a backup source. > cachefile imporpid 55 (zpool), jid 0, uid 0: exited on signal 6 > t failed, retrying > nvpair_value_nvlist(nvp, &rv) =3D=3D 0 (0x16 =3D=3D 0) > ASSERT at = /usr/main-src/sys/contrib/openzfs/module/nvpair/fnvpair.c:592:fnvpair_valu= e_nvlist()Abort trap > Starting file system checks: > /dev/gpt/CA72opt0EFI: 281 files, 231 MiB free (14770 clusters) > FIXED > . . . >=20 > Removing /etc/zfs/zpool.cache allowed reboots to avoid such. > END SIDE NOTE. >=20 >=20 > For reference, for the machine where I can plug in > the media: >=20 > # uname -apKU # line split for better readability > FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #59 > main-n256584-5bc926af9fd1-dirty: Wed Jul 6 18:10:52 PDT 2022 > = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 > arm64 aarch64 1400063 1400063 >=20 I ended up doing: # zpool labelclear -f /dev/da0p8 # zpool create -o compatibility=3Dopenzfs-2.1-freebsd -O compress=3Dlz4 = -O atime=3Doff -f -tzprpi zroot /dev/da0p8 # zpool export zprpi and then doing my normal update procedure to the media (sends and some adjustments), making the zroot a variant of what is on another machine (under different pool name). And . . . The media is back to being importable, even bootable, media. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Aug 28 01:25:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFbVk2Jv3z4ZPZp for ; Sun, 28 Aug 2022 01:25:50 +0000 (UTC) (envelope-from jo@bruelltuete.com) Received: from email.jo-t.de (seppel.jo-t.de [45.132.244.126]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFbVh6JySz3Qmt; Sun, 28 Aug 2022 01:25:48 +0000 (UTC) (envelope-from jo@bruelltuete.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=bruelltuete.com; s=bruelltuete18a; t=1661649941; bh=znItd5sobhVri4Fkns/2ceLF1vGxQSmC5M/iDghAxNo=; h=Message-ID:Date:MIME-Version:Subject:To:References:From:From; b=oe31WrsDEqy2zNMQZymj4kQx/xvBcRarBpSDDwo0firpLLpqODnf3018/4MbKvk4X daa4ueUA8lUDkT/m4VJ0FQLYEaO/N8z8KvOL2mTu517CUy0HrTFBh4AXiJisMHHcrZ p2pqS+pb6Fk8eal2htMJ9i3JaUi3gyyeU7ppMfi+6+u3yuOIt7rM0YgyfH2ZVdnscH FqBLkPDzcoVHCUSTD057ybKLdXLDF70Rr+jkfo5F+5yXQZTNVEAdO2B8EiSEjsbUCb kOdyfxoxbj/XwMNQVVloIVNlE6WjXGUUUvT7QDMwKG7BFrgbYkNHK5VGDpg4Ahjou2 eyw2ez5Bn0n9A== Message-ID: Date: Sun, 28 Aug 2022 02:25:35 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Subject: Re: ZFS bootfs vs vfs.root.mountfrom To: Warner Losh , Peter Jeremy , Kyle Evans Cc: FreeBSD FS Newsgroups: gmane.os.freebsd.devel.file-systems References: Content-Language: en-GB From: Johannes Totz In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4MFbVh6JySz3Qmt X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bruelltuete.com header.s=bruelltuete18a header.b=oe31WrsD; dmarc=pass (policy=none) header.from=bruelltuete.com; spf=pass (mx1.freebsd.org: domain of jo@bruelltuete.com designates 45.132.244.126 as permitted sender) smtp.mailfrom=jo@bruelltuete.com X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[bruelltuete.com,none]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[bruelltuete.com:s=bruelltuete18a]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; ASN(0.00)[asn:197540, ipnet:45.132.244.0/22, country:DE]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[bruelltuete.com:+]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 27/08/2022 05:15, Warner Losh wrote: > > > On Fri, Aug 26, 2022 at 10:01 PM Peter Jeremy > wrote: > > When booting from ZFS was first introduced, the recommended approach > was to configure the root filesystem via vfs.root.mountfrom.  See (e.g.) > https://lists.freebsd.org/pipermail/freebsd-fs/2011-September/012482.html > https://lists.freebsd.org/pipermail/svn-src-head/2011-October/030641.html > and people wanted to change that to use the zpool bootfs property - e.g. > https://lists.freebsd.org/pipermail/freebsd-current/2009-October/012933.html > https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html > resulting in it becoming optional in SVN r235330 in May 2012: > https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html > > > Yes. This was a total hack at the time. The boot loader normally sets > this variable > w/o users intervening and this hack propagated into loader.conf files, > which has > always been a bad idea. > > The recommendation to use vfs.root.mountfrom remains in parts of the > wiki (e.g. https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror > step > 2.6) and on mailing list posts (e.g. the thread starting at > https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html > ). > The loader(8) and loader.conf(5) man pages state that the root > filesystem is set by vfs.root.mountfrom, with a default derived from > /etc/fstab or, for ZFS only, currdev (the boot filesystem). > > > Yes. That's how it is supposed to work. The boot loader sets this based on > where it loaded the kernel. This variable should *NEVER* be set in a > loader.conf file unless you have a 'very special snowflake' system that > can't determine it automatically. ZFS root isn't special. > > OTOH, https://wiki.freebsd.org/BootEnvironments > states "/etc/fstab > must be purged of any / mount, and /boot/loader.conf must not be > setting vfs.root.mountfrom directly."  I can't find any other > reference to this requirement. > > > /etc/fstab isn't used for zfs root. I believe that BootEnvironments is 100% > right here. > > As for the BootEnvironment management tools themselves: > * Neither beadm(8) nor bectl(8) mention vfs.root.mountfrom. > > > This is correct. > > * beadm(8) refers to > https://forums.freebsd.org/showthread.php?t=31662 > , >   which recommends setting vfs.root.mountfrom > > > This is bad advice. > > * beadm(8) will update vfs.root.mountfrom in /boot/loader.conf if it >   exists but will not add it if it doesn't exist. > > > This is terrible. It's part of the continuing papering over of bugs that > have > long ago been fixed and should, at most, warn that's its set and that it > really shouldn't be. > > * bectl(8) ignores /boot/loader.conf > > > This is proper behavior. > > The last point means that switching an existing system from beadm to > bectl is very likely to result in the system mounting the wrong root > filesystem: An existing system is likely to have vfs.root.mountfrom > set, since that used to be the only approach and is still widely > recommended, whilst bectl ignores it and will therefore leave the > old vfs.root.mountfrom value present. > > > Yes. bectl likely should, at most, warn that it's set in loader.conf as an > antifootshooting measure, but only due to the all-too-long history. > > IMO, if setting vfs.root.mountfrom in /boot/loader.conf is no longer > supported for ZFS, we need to do a better job of documenting that and > removing documentation to the contrary.  I also believe that bectl > should at least warn if /boot/loader.conf sets vfs.root.mountfrom. > > > It really never had been the proper way. One should almost never do > it today, except in the above 'special snowflake' systems that still crop up > from time to time (we have one at work since we still have some systems > that use gmirror roots, and the boot loader doesn't set it right for > them since > we can't for logistical reasons set /etc/fstab, but that's not ZFS > related). We > should actively militate against it with extreme prejudice, though, for > routine > uses. We should rip out all references in the docs related to ZFS. We should > warn if we detect it today. I agree completely with what you are saying > here. > I would be extraordinarily surprised to find anybody with a contrary > opinion. Isn't a legitimate use-case where /boot and / are on different devices/pools? That's what I'm using it for. bootfs property says where to find the kernel, and the accompanying vfs.root.mountfrom in loader.conf says where the matching rootfs is (in my case on a different pool). > > Now, who is going to do the work? :) > > Warner From nobody Sun Aug 28 01:39:27 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFbpk3MW1z4ZRKn for ; Sun, 28 Aug 2022 01:39:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-vk1-xa35.google.com (mail-vk1-xa35.google.com [IPv6:2607:f8b0:4864:20::a35]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFbpj4RGzz3SNk for ; Sun, 28 Aug 2022 01:39:41 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-vk1-xa35.google.com with SMTP id q14so2325831vke.9 for ; Sat, 27 Aug 2022 18:39:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc; bh=MzcAvg7NCYP6ptReIXbiXcERv3iXWjiQ8lVDHLqrHp0=; b=X30pVrC8WiVhXQKtE3BmeIpP3krnrvfXmNgkSNDQTbr+qcM2TnWPKQGmO2R7qIkkgk aKvlRxKUVXRqfgYpnbDHepW32C2xJXS7EtdECWUsgMvt3GIoWThSOCdioiad4GOpz1V9 1a+KQesRTFVpdqh+vTAXCejtZndD6NDVuwaQI6LJI4B29QZzQet4FmyQnqW20zjs5Ds2 PoV7LIEiqfUMUfkrhIP3LdksqfY/bwzSZ6H+SaLJ8nC/A6TB4C8npbMo63lgXb8SuSaT jhfO3FrLqpQckwqBPZVHPpiiuK+TL5XfeJeVsn8GxUa6/k8yJc1WV5+mjz0fhUI/3Va7 5ovQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc; bh=MzcAvg7NCYP6ptReIXbiXcERv3iXWjiQ8lVDHLqrHp0=; b=CHGvh1Em3nC3FKkq5zZBqdeD2N00NCPnhBp6fCUc0OCH5YtZET03Ulcd6/Q4JpfsCF ddK+Yn1dl8TEaROVt1mm3YatMotZfAm2ySO8tnswd36dzxIrvyr91Rr9Y7bf28u1MWVG 2U9y2X6P1ZzuKfzwqcFIpgP/ZL2kGFWIER0/dsCp3NAAoiXv1taPFQWyxzhCG363p9xs BXVh2hIaG5WIIUhcY3AEBa2iDOKrPNezcDonLxxguoJ+0ILYDQjzCkaJIaqUVqD501Km gs7puSlv8Eey8x2/vb2dKS5Fc8/BuIn9BMQake4kHoTqI/BSxmcKbbtjp8A5lvNTLFM+ fcQA== X-Gm-Message-State: ACgBeo3OhM60mhe6yVklS8XXhGQ0EEwX1aPxkcKfRAL4e+RbMZn6Dbbr 7xpm+LA8zTadGDOuUr5hqOBbycuovIG/ZwkVe9ly+w== X-Google-Smtp-Source: AA6agR666NFaWDOLtP2Re70BoOakIeRbx8ITBRMcFmFpMu9/iLV4qjJUF4Fe1IZxyk/4fIKLgCqJinhnnycgT3vrPZ4= X-Received: by 2002:a1f:5ec7:0:b0:394:4ef0:d583 with SMTP id s190-20020a1f5ec7000000b003944ef0d583mr698409vkb.37.1661650780389; Sat, 27 Aug 2022 18:39:40 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Sat, 27 Aug 2022 19:39:27 -0600 Message-ID: Subject: Re: ZFS bootfs vs vfs.root.mountfrom To: Johannes Totz Cc: Peter Jeremy , Kyle Evans , FreeBSD FS Content-Type: multipart/alternative; boundary="00000000000081963805e7433802" X-Rspamd-Queue-Id: 4MFbpj4RGzz3SNk X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=X30pVrC8; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::a35) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.00 / 15.00]; URI_COUNT_ODD(1.00)[69]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_LONG(-1.00)[-0.998]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::a35:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCPT_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[bsdimp.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --00000000000081963805e7433802 Content-Type: text/plain; charset="UTF-8" On Sat, Aug 27, 2022, 7:25 PM Johannes Totz wrote: > On 27/08/2022 05:15, Warner Losh wrote: > > > > > > On Fri, Aug 26, 2022 at 10:01 PM Peter Jeremy > > wrote: > > > > When booting from ZFS was first introduced, the recommended approach > > was to configure the root filesystem via vfs.root.mountfrom. See > (e.g.) > > > https://lists.freebsd.org/pipermail/freebsd-fs/2011-September/012482.html > > > > > https://lists.freebsd.org/pipermail/svn-src-head/2011-October/030641.html > > > > and people wanted to change that to use the zpool bootfs property - > e.g. > > > https://lists.freebsd.org/pipermail/freebsd-current/2009-October/012933.html > < > https://lists.freebsd.org/pipermail/freebsd-current/2009-October/012933.html > > > > > https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html < > https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html> > > resulting in it becoming optional in SVN r235330 in May 2012: > > > https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html < > https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html> > > > > > > Yes. This was a total hack at the time. The boot loader normally sets > > this variable > > w/o users intervening and this hack propagated into loader.conf files, > > which has > > always been a bad idea. > > > > The recommendation to use vfs.root.mountfrom remains in parts of the > > wiki (e.g. https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror > > step > > 2.6) and on mailing list posts (e.g. the thread starting at > > https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html > > < > https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html>). > > The loader(8) and loader.conf(5) man pages state that the root > > filesystem is set by vfs.root.mountfrom, with a default derived from > > /etc/fstab or, for ZFS only, currdev (the boot filesystem). > > > > > > Yes. That's how it is supposed to work. The boot loader sets this based > on > > where it loaded the kernel. This variable should *NEVER* be set in a > > loader.conf file unless you have a 'very special snowflake' system that > > can't determine it automatically. ZFS root isn't special. > > > > OTOH, https://wiki.freebsd.org/BootEnvironments > > states "/etc/fstab > > must be purged of any / mount, and /boot/loader.conf must not be > > setting vfs.root.mountfrom directly." I can't find any other > > reference to this requirement. > > > > > > /etc/fstab isn't used for zfs root. I believe that BootEnvironments is > 100% > > right here. > > > > As for the BootEnvironment management tools themselves: > > * Neither beadm(8) nor bectl(8) mention vfs.root.mountfrom. > > > > > > This is correct. > > > > * beadm(8) refers to > > https://forums.freebsd.org/showthread.php?t=31662 > > , > > which recommends setting vfs.root.mountfrom > > > > > > This is bad advice. > > > > * beadm(8) will update vfs.root.mountfrom in /boot/loader.conf if it > > exists but will not add it if it doesn't exist. > > > > > > This is terrible. It's part of the continuing papering over of bugs that > > have > > long ago been fixed and should, at most, warn that's its set and that it > > really shouldn't be. > > > > * bectl(8) ignores /boot/loader.conf > > > > > > This is proper behavior. > > > > The last point means that switching an existing system from beadm to > > bectl is very likely to result in the system mounting the wrong root > > filesystem: An existing system is likely to have vfs.root.mountfrom > > set, since that used to be the only approach and is still widely > > recommended, whilst bectl ignores it and will therefore leave the > > old vfs.root.mountfrom value present. > > > > > > Yes. bectl likely should, at most, warn that it's set in loader.conf as > an > > antifootshooting measure, but only due to the all-too-long history. > > > > IMO, if setting vfs.root.mountfrom in /boot/loader.conf is no longer > > supported for ZFS, we need to do a better job of documenting that and > > removing documentation to the contrary. I also believe that bectl > > should at least warn if /boot/loader.conf sets vfs.root.mountfrom. > > > > > > It really never had been the proper way. One should almost never do > > it today, except in the above 'special snowflake' systems that still > crop up > > from time to time (we have one at work since we still have some systems > > that use gmirror roots, and the boot loader doesn't set it right for > > them since > > we can't for logistical reasons set /etc/fstab, but that's not ZFS > > related). We > > should actively militate against it with extreme prejudice, though, for > > routine > > uses. We should rip out all references in the docs related to ZFS. We > should > > warn if we detect it today. I agree completely with what you are saying > > here. > > I would be extraordinarily surprised to find anybody with a contrary > > opinion. > > Isn't a legitimate use-case where /boot and / are on different > devices/pools? That's what I'm using it for. bootfs property says where > to find the kernel, and the accompanying vfs.root.mountfrom in > loader.conf says where the matching rootfs is (in my case on a different > pool). > Yea... that's a legitimate setup, but it is in the special snowflake category... it is a setup we can't otherwise know and configure automatically, but that works nonetheless with the right tweaks of expert knobs. I think you could also get the same effect with the zfs pool in /etc/fstab, bit I haven't tried it. Warner > > > > Now, who is going to do the work? :) > > > > Warner > > --00000000000081963805e7433802 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Aug 27, 2022, 7:25 PM Johannes Totz <jo@bruelltuete.com> wrote:
=
On 27/08/2022 05:15, Warner Losh wrote:
>
>
> On Fri, Aug 26, 2022 at 10:01 PM Peter Jeremy <peterj@freebsd.org
> <mailto:peterj@freebsd.org>> wrote:
>
>=C2=A0 =C2=A0 =C2=A0When booting from ZFS was first introduced, the rec= ommended approach
>=C2=A0 =C2=A0 =C2=A0was to configure the root filesystem via vfs.root.m= ountfrom.=C2=A0 See (e.g.)
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/freebsd-fs/2011-September/01248= 2.html <h= ttps://lists.freebsd.org/pipermail/freebsd-fs/2011-September/012482.html>
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/svn-src-head/2011-October/03064= 1.html <h= ttps://lists.freebsd.org/pipermail/svn-src-head/2011-October/030641.html>
>=C2=A0 =C2=A0 =C2=A0and people wanted to change that to use the zpool b= ootfs property - e.g.
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/freebsd-current/2009-Octobe= r/012933.html <https://lists.freebsd.org/pipermail/freebsd-current/2009-October/0= 12933.html>
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/freebsd-fs/2010-March/008010.html <https://lists= .freebsd.org/pipermail/freebsd-fs/2010-March/008010.html>
>=C2=A0 =C2=A0 =C2=A0resulting in it becoming optional in SVN r235330 in= May 2012:
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/svn-src-head/2012-May/036902.html <https://lists= .freebsd.org/pipermail/svn-src-head/2012-May/036902.html>
>
>
> Yes. This was a total hack at the time. The boot loader normally sets =
> this variable
> w/o users intervening and this hack propagated=C2=A0into loader.conf f= iles,
> which has
> always been a bad idea.
>
>=C2=A0 =C2=A0 =C2=A0The recommendation to use vfs.root.mountfrom remain= s in parts of the
>=C2=A0 =C2=A0 =C2=A0wiki (e.g. ht= tps://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror
>=C2=A0 =C2=A0 =C2=A0<https://w= iki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror> step
>=C2=A0 =C2=A0 =C2=A02.6) and on mailing list posts (e.g. the thread sta= rting at
>=C2=A0 =C2=A0 =C2=A0https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html=
>=C2=A0 =C2=A0 =C2=A0<https://lists.freebsd.org/pipermail/freebsd-fs/2020-July/028351.html= >).
>=C2=A0 =C2=A0 =C2=A0The loader(8) and loader.conf(5) man pages state th= at the root
>=C2=A0 =C2=A0 =C2=A0filesystem is set by vfs.root.mountfrom, with a def= ault derived from
>=C2=A0 =C2=A0 =C2=A0/etc/fstab or, for ZFS only, currdev (the boot file= system).
>
>
> Yes. That's how it is supposed to work. The boot loader sets this = based on
> where it loaded the kernel. This variable should *NEVER* be set in a > loader.conf file unless you have a 'very special snowflake' sy= stem that
> can't determine it automatically. ZFS root isn't special.
>
>=C2=A0 =C2=A0 =C2=A0OTOH, https://wiki.freeb= sd.org/BootEnvironments
>=C2=A0 =C2=A0 =C2=A0<https://wiki.freebsd= .org/BootEnvironments> states "/etc/fstab
>=C2=A0 =C2=A0 =C2=A0must be purged of any / mount, and /boot/loader.con= f must not be
>=C2=A0 =C2=A0 =C2=A0setting vfs.root.mountfrom directly."=C2=A0 I = can't find any other
>=C2=A0 =C2=A0 =C2=A0reference to this requirement.
>
>
> /etc/fstab isn't used for zfs root. I believe that BootEnvironment= s is 100%
> right here.
>
>=C2=A0 =C2=A0 =C2=A0As for the BootEnvironment management tools themsel= ves:
>=C2=A0 =C2=A0 =C2=A0* Neither beadm(8) nor bectl(8) mention vfs.root.mo= untfrom.
>
>
> This is correct.
>
>=C2=A0 =C2=A0 =C2=A0* beadm(8) refers to
>=C2=A0 =C2=A0 =C2=A0https://forums= .freebsd.org/showthread.php?t=3D31662
>=C2=A0 =C2=A0 =C2=A0<https://fo= rums.freebsd.org/showthread.php?t=3D31662>,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 which recommends setting vfs.root.mountfrom=
>
>
> This is bad advice.
>
>=C2=A0 =C2=A0 =C2=A0* beadm(8) will update vfs.root.mountfrom in /boot/= loader.conf if it
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 exists but will not add it if it doesn'= t exist.
>
>
> This is terrible. It's part of the continuing papering over of bug= s that
> have
> long ago been fixed and should, at most, warn that's its set and t= hat it
> really shouldn't be.
>
>=C2=A0 =C2=A0 =C2=A0* bectl(8) ignores /boot/loader.conf
>
>
> This is proper behavior.
>
>=C2=A0 =C2=A0 =C2=A0The last point means that switching an existing sys= tem from beadm to
>=C2=A0 =C2=A0 =C2=A0bectl is very likely to result in the system mounti= ng the wrong root
>=C2=A0 =C2=A0 =C2=A0filesystem: An existing system is likely to have vf= s.root.mountfrom
>=C2=A0 =C2=A0 =C2=A0set, since that used to be the only approach and is= still widely
>=C2=A0 =C2=A0 =C2=A0recommended, whilst bectl ignores it and will there= fore leave the
>=C2=A0 =C2=A0 =C2=A0old vfs.root.mountfrom value present.
>
>
> Yes. bectl=C2=A0likely should, at most, warn that it's set in load= er.conf as an
> antifootshooting=C2=A0measure, but only due to the all-too-long histor= y.
>
>=C2=A0 =C2=A0 =C2=A0IMO, if setting vfs.root.mountfrom in /boot/loader.= conf is no longer
>=C2=A0 =C2=A0 =C2=A0supported for ZFS, we need to do a better job of do= cumenting that and
>=C2=A0 =C2=A0 =C2=A0removing documentation to the contrary.=C2=A0 I als= o believe that bectl
>=C2=A0 =C2=A0 =C2=A0should at least warn if /boot/loader.conf sets vfs.= root.mountfrom.
>
>
> It really never had been the proper way. One should almost never do > it today, except in the above 'special snowflake' systems that= =C2=A0still crop up
> from time to time (we have one at work since we still have=C2=A0some s= ystems
> that use=C2=A0gmirror roots,=C2=A0and the boot loader doesn't set = it right for
> them since
> we can't for logistical reasons set /etc/fstab,=C2=A0but that'= s not ZFS
> related). We
> should actively militate against it with extreme prejudice,=C2=A0thoug= h,=C2=A0for
> routine
> uses. We should rip out all references in the docs related to ZFS. We = should
> warn if we detect it today. I agree completely with what you are sayin= g
> here.
> I would be extraordinarily surprised to find anybody with a contrary <= br> > opinion.

Isn't a legitimate use-case where /boot and / are on different
devices/pools? That's what I'm using it for. bootfs property says w= here
to find the kernel, and the accompanying vfs.root.mountfrom in
loader.conf says where the matching rootfs is (in my case on a different pool).

Yea... that's a legitimate setup, but it is in the special snowfl= ake category... it is a setup we can't otherwise know and configure aut= omatically, but that works nonetheless with the right tweaks of expert knob= s. I think you could also get the same effect with the zfs pool in /etc/fst= ab, bit I haven't tried it.

Warner=C2=A0
>
> Now, who is going to do the work? :)
>
> Warner

--00000000000081963805e7433802-- From nobody Sun Aug 28 02:20:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFcjl2rR2z4ZVZq for ; Sun, 28 Aug 2022 02:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFcjl1H2nz3VJS for ; Sun, 28 Aug 2022 02:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MFcjl06fgzx27 for ; Sun, 28 Aug 2022 02:20:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27S2KQMx037460 for ; Sun, 28 Aug 2022 02:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27S2KQcp037459 for fs@FreeBSD.org; Sun, 28 Aug 2022 02:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: on long running find (zfs issue) Date: Sun, 28 Aug 2022 02:20:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661653227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kd1Bkv7KCec7uuWU4GUAXZHSpWZgkZIRH5M3UvOkBBQ=; b=dlPv1n3haixkDE5Nh/d1svs7MLux4lyW/X4H7jE1OhHmNIpM99mUDYDRL5ZiKCx1cbdyiu vulBnxUiN54ABf+UKrsOK+e1AiMrIEH1IuTQUMII4FmQWsrOT/keJDoW6qUgCQmlwEvUSh OFSXaSkZKKRkidt4CGYtRRR9El/+RQxb6kMZC7mVFPApXrWvJ3twIU8pybfy7y1Qsc9oov UE8gK3Oro87SQ3N0PsCLq167Fe9ywkH1r3o5gX/GjkzrzOYC2C9hDsflBrsE1pMtO7Yp/a HgP0T2IU2593F5rkfx9CtRYWOuFaZLcKrmrK2irinKBbAO6ZtSXuqcrGg3/EPg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661653227; a=rsa-sha256; cv=none; b=HArmaoIgA145dTmkMT0GxU5lQ0C0HPdDZwNJlgunPkrv2ofZYg8jr3hrcBm7+9VwE9Qe2j ELejlGPPnBwXj0rJbmMZ7cB/gn+Gfa8uK9Cy8h763F0VhF4cN2o77szVqMaUy6atpgjmR5 K5vIXGnodoksKYwhfvrx4jer6fNWKRbJd+2+ZtXZPiwX7mlUOERq9BGA2C54yNnKT2j+Of 3oNn9Jga9/gSQLyqBKmL6BargYow6DnCHTG8mzhU0nox4tz/YBQgSKCW7S2lKuvPW6M8l8 PSlQZw2aaMEkMiB7SIpiigOkH7e2pW7NbfdpDV3qyVajbjO8K7ZEKd1sJwLsxQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 28 11:56:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MFsVx2Y1bz4ZS2R for ; Sun, 28 Aug 2022 11:56:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MFsVw5ZdPz44Qc for ; Sun, 28 Aug 2022 11:56:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MFsVw4f7wz14pH for ; Sun, 28 Aug 2022 11:56:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27SBuugd022252 for ; Sun, 28 Aug 2022 11:56:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27SBuuIK022251 for fs@FreeBSD.org; Sun, 28 Aug 2022 11:56:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: on long running find (zfs issue) Date: Sun, 28 Aug 2022 11:56:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661687816; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dutJKqpxk0Ooy9G6gGf1LBFQLrArCiG5BDsX4bnLWMI=; b=coO1xdkhATabPjAYSrSIMHcQrofv2pFpKKPlke984quK90r/0FWa8I7nWPhHecHEezvijl VMjGDjWz0Nh59Y5lb5XGKK5r0j7BBVQzbiStDTD6WE9RbqBl94ukt000VT+RArlj69WSIk 3RISPqVbzkX70MopXq7YWW9r0OFgkO5XlEFMepBdhu7NEuObMHDu8ArbdED+uikqIzK0WT l+JkuqrBQc1knIy89TPlc9ABb1Q3LnWfrgWbvghsD9frza5ENiAsPu9bxHAIQZOAqQhBds loqTzbWR1ojGTzVcBdv4Rs/lJT1Gb5HLBR1vw42AztwkEzR/nWgdHaiWTUbCHg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661687816; a=rsa-sha256; cv=none; b=YRXs3sDUabNqBv9YY4npLybbSkTpiiqNDATW6dsqg77+4CoVtGSsUt8Dm2nmNn1giVrr0G 5cW7Tywh/62MbvC3ajmfBD8NLbfhxtb3VNIx6Vj9I6iwT1TpFvhEuj5QrdxOpDOJsmcEl2 42eO5hP26w685GqYka1d907mbiCAowoQUJ2xNU9ZckAQJmY6wqA4kk0I268y88j4wlkb4s k5lLOVd/tADPOeGXCh3GAR/MhYJw6lgF5+ItCfzuKfzOUZs+RUWxgzDWOsoTIkmozIecGU PeFwAqKJr4wG/tgdGc+NAdAGC/C7cKUMe+p1raxfTUnWTf/fYNbCVi2QC5k26w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 John F. Carr changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jfc@mit.edu --- Comment #2 from John F. Carr --- The number 5 comes from sys/contrib/openzfs/module/zfs/sa.c function sa_build_index, which returns EIO (error 5) if an sa_hdr_phys object has a = bad magic number. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 28 21:00:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MG5ZM11Z5z4bMC0 for ; Sun, 28 Aug 2022 21:00:43 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MG5ZL5QcFz3l8S for ; Sun, 28 Aug 2022 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MG5ZL48Tjz1CFP for ; Sun, 28 Aug 2022 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27SL0gSf089479 for ; Sun, 28 Aug 2022 21:00:42 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27SL0gGs089478 for fs@FreeBSD.org; Sun, 28 Aug 2022 21:00:42 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202208282100.27SL0gGs089478@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 28 Aug 2022 21:00:42 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16617204424.C5Deef.87727" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661720442; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=gPbvWOwNhRcV6gXz6N1+NaXXll+YVKtN/6YswaUlSvw=; b=lhN1+TAyqD5ITs2l3/XUMpBpma4v5Mp4x97dbMJwMPMCNquuFXhogt14YhSObd7OYeJWDB hGAagnzB0eMGOQ7EwCtTIp3BxspGk9Q96+fw8izHW9kbz7qvVkcSrYbspIIGZCueufs2Fb wmsTKlnXlcpLbLWxAOozUuw3JS9mSI+Aye4WpG+QIxLIm8/ispkW0utB8/Af1pds7x32jx fpOu2DVNStF4T4CNRcEx8QV/6YQPVMz7X6IzAOr02HcyWWGlEuDRRcD1Or52+x+ixRDlUW xvTbB8HmCOiueD/++EQ4a/7KMFqATYaafx++x+hcBnUtlt+Fx/E7+rHUQe75CQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661720442; a=rsa-sha256; cv=none; b=QK2WxBBRMQK6I7KAqW7z143NmB+RnRhpEcvJVx7oiaAQueN5PGZfgr1MTRw8uZ0HjBDejL OhJpPah3j3bxDgcyiqs2Nl7xz4zuDYLarFQpK/C9AzAshZnFCHPkkNljDh27eNhm/9QqT4 OVlMuls8eJowFrnE+hlHtmSsgVSL0tAuFJQ0Odjm5xzIQR8tgbquTiWjKAppu75mcB52Q3 LBLYxOaatE1lYfeA4ZJ56V8YQwZC+KQ/dqRMJpZfDe9JOZHwxCbTsh+gOx7SN2kSPqTMp8 jbP0Elo708SMv8FuHoFBd3EreduQi6DqtyvEVEDUIJwuiPjBN0m3W9+MCUCPNQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16617204424.C5Deef.87727 Date: Sun, 28 Aug 2022 21:00:42 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16617204424.C5Deef.87727 Date: Sun, 28 Aug 2022 21:00:42 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16617204424.C5Deef.87727-- From nobody Mon Aug 29 09:05:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MGPfY5JcNz4Zfrc for ; Mon, 29 Aug 2022 09:05:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MGPfY3hrbz3lvj for ; Mon, 29 Aug 2022 09:05:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MGPfY2T2LzNJ3 for ; Mon, 29 Aug 2022 09:05:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27T95P9x084894 for ; Mon, 29 Aug 2022 09:05:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27T95Pj7084893 for fs@FreeBSD.org; Mon, 29 Aug 2022 09:05:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259068] ext2fs can violate some INVARIANTS if file system is damaged Date: Mon, 29 Aug 2022 09:05:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661763925; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FqzIbK+0bo/SI4wWFj8902KHpROmZmZ/8GCb5/Ep1WY=; b=Qw5PUIHLWo2YleMo/scP6VO18FNmQNT+0/KOweWW0DIJfom/lGTxRgbxl6yHnLUSYqxJlP RU1MPrRc7O1QJon08JKqZ2ECpOkXkc1yweRn37VfEtB5d5/yVmOsVsaalvXOoCEuV6NkBw eFYfdOi1Y+e1fCWG3soY6dJU1hAr7HLXz5c/vUZzHSvARHDmKeuzH3lrozZMxD99YBPnKV U+g0R/Qy9dgERWTMilkOz1QRitmKH8UK9uDL3+2ZZBKO8a8U/kLTnYqOfqTu5dV4wPF2cD f2AT8PE2bkIekqYwnQp6Y19ogOGAUorIRh+UB7YUnCg7qxZwtfvUPAeXAqdgbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661763925; a=rsa-sha256; cv=none; b=KNENuRWdOdppm1MgnQW6mEX3vKFm+F4khUE9f1KbAbKngFG+konSxuHDsXfCfvdWjWlCRJ a8sOzIP3vRr+nfwI4WbB6s9ZieXiwtVCQedOyKLDnvkT1l5I0hZCHESstS7MyubJKVQjnx rXjWgpIS3JzoHlL4VHmWfki25L+hOBK10fRBphb5U700ZuhAz4+//yIiPAlsRR9lkogLeC 3siHX+ZJ1eU0W3KdM1SWcsixQeI4znzaqn41Qg9Dgg4OXcDe4Lgm8g8JOgrOtUt06Gd81a sw5l2V/5OjzF1kMyx246RlC8FQ04ovWV1ml17tXPi7T9Bq1O9hRpL9wLCQWx6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259068 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Aug 29 09:06:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MGPgL3jTvz4Zfmy for ; Mon, 29 Aug 2022 09:06:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MGPgL2Ym4z3mbd for ; Mon, 29 Aug 2022 09:06:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MGPgL1cjYzNMc for ; Mon, 29 Aug 2022 09:06:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27T9662M085064 for ; Mon, 29 Aug 2022 09:06:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27T9667E085063 for fs@FreeBSD.org; Mon, 29 Aug 2022 09:06:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from zfs to ext3 partitions Date: Mon, 29 Aug 2022 09:06:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661763966; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=p2ZAhio0HH7jqXTjfaT3Fz7Iqm6xOEP2v5wRaqkoxhQ=; b=gfwO9Rvvm7eLnZ4dRctwcShM4h6FZZQkF1+3Hivfprl/x8uA9+hWZr92uESI7SC1KmmrH8 +fpL5sIKj759aTmnDaIuK8Pe1ZknXza09xqZHiEJBb3SMaZzsq7rYI84MtENslwY/qU6UT UsYf76x4kMOfkPe0dxr3HtVOeMAl6dppIBdDznScBnhx+SKfCGRIGL9TtwP/qd/Vy2QFl1 JVeoauF4ZJ3UfYaBvVSs04t/JSc/tY/mJuvR/BKAmKSq92eGVvaNgLPLcT1wmgaB+P6YA/ Yafbygx8xNU0xa/+S1wzWfDnQpfIZWLD02Ggg0CT9P9l5moAI9Mhc3KSgHNDpA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661763966; a=rsa-sha256; cv=none; b=x5yJtz6OmN7bkoebtjoynZZ5KJ823zc7fXH4nBzRVKuM7EWjwGiP9D17iDs4dcFTev9weQ xwsGMuL//sqVSyC8TBIvdbf4KnLfstWkLAyOcEgjKEGRJIeYvDDhj0DMWZOA1v7z9z/CvO X0Bg6z0XHR8yHgtXlVpsuPsTwDoozwQIFSpC8QSNXga18Iuz9jnbKdq8Sr5bMzgAHtyML/ aDtpN86sWGW7+6OVgxK1xfShdAuE+JUtOTlQ+2b+lUtMc1ezizRAdyDcHy/NR2EYH5vYtJ 8lzg2v6QbstnaKAjzpFF2VxkKSLPGDeB/pWsG2uy6Oi9M0yNBkNKOoLc8hlNDA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |grahamperrin@freebsd.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 30 10:08:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MH31R5Fmkz4ZtHS for ; Tue, 30 Aug 2022 10:08:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MH31R470cz3XRl for ; Tue, 30 Aug 2022 10:08:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MH31R39Jfzkwd for ; Tue, 30 Aug 2022 10:08:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27UA8xis041387 for ; Tue, 30 Aug 2022 10:08:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27UA8xrA041386 for fs@FreeBSD.org; Tue, 30 Aug 2022 10:08:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from zfs to ext3 partitions Date: Tue, 30 Aug 2022 10:08:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: fsu@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661854139; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OQ4bGo5LbKRn7cd51LAA9/ZsLAWGuS+BiPwEaELuzzk=; b=pdH0mWdDFa71hMu6PaS+P+WEGrfs6ix/kVw1/a5UydwRU+72Jh6C7CPUYkNe1ghds39y0B QDU2rdRtWjpyBQZYdzB0UyEE3kg6iDNo4jCvW+0LmZbxUPUJvSiBDDm65vTYA7oSVA+XL1 rDiC3AXNsskG+AAKknJBuifL6+FTO5lCgmSxK5J3PbBiUg3oJIyzOHafTkhyVnTZvuZi7Y 4hplheFzbke67vxmRQH+4czkUc5sDPcgqAn30CcckaYn+tjao0CRr72VlIx9Y+vQOEXhgI z7vnfgIYs5nLL6x9mTCT3Ox6I2gNcsZgXWpoHov8T3pBxJYLk41xEzrHfieCyg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661854139; a=rsa-sha256; cv=none; b=flVQmpJlfYZ/zr0fT3IbyLYJ5Bol2+9ufB4e3wzRI4Q9Ny7fcgio36PnImaCtZyEQIr2YF Hn4QXaNqtm8hVktGEaJrpyrod5Rf8mG9r1xECOLMAdSe158l2nzCu2JLjJOL3IYqbUULzC ESdS2IS1A0sWQDPJqAiKyzmZ5aYM/qJZHEG6dr8ah3Vd85+M788rnSz9DpzJl5Pb7YQs/C KG3qzLo80ja76VkiwdfLyELYkMmA1yD3CAIulPolC7kWhmB8vS7InwdYifhrStLfKlRmSm 8sPXvcAqohx2ysWXlcJAnKd6+35OTWPe6Tb4bAiqda4c0UEs96+giziNkDsAlg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 Fedor Uporov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fsu@FreeBSD.org --- Comment #1 from Fedor Uporov --- Looks like corrupted directory entry. The simplest way to avoid this sort of panic is to run fsck for Ext3fs filesystem after server reboot. It is possible to install e2fsprogs from ports or build it from source and = run e2fsck utility with appropriate flags. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 30 18:27:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MHG555y6jz4b3sx for ; Tue, 30 Aug 2022 18:27:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MHG554VnZz3LN1 for ; Tue, 30 Aug 2022 18:27:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MHG553XZrzs5J for ; Tue, 30 Aug 2022 18:27:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27UIRrdo099187 for ; Tue, 30 Aug 2022 18:27:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27UIRrq4099186 for fs@FreeBSD.org; Tue, 30 Aug 2022 18:27:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from zfs to ext3 partitions Date: Tue, 30 Aug 2022 18:27:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: clear.screen@orange.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661884073; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Lxw4ugPvsT2HCWkrErWZ4uWwuFLqxsQFzRrerPt7neQ=; b=pBE+34Ieac0a3a5aDUVofFLsVuLzYxAbH2jFldI593CV2g04qrVlW4fvqi9wl8dlPRD66R 5OrscbX+bqKRzs7MtUY0DGbPOu4KP4oxVQxSx9+c0yzQndVY6ArnfzT6GKcDUMXIOQRbuz 0yY86iCnATFNli+SYZ4PsxbrAf9oFQvi4rFdxBGIDvPWXzC6jRDN8pVRu8dkAA2zMutCwq kaDoQRbvKllfZD4B46BdblhmEBKPAbHL1P/uPFP9yvwEeMEaGg1xUvfnjF3i27Qwt7Yvov I+1Ne9t91HItBGazClseSNPQ6WC9CCVqkwi8hdZhAPv9wwec1Rr7DMUI+pX2UQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661884073; a=rsa-sha256; cv=none; b=kMn1bnd9jbZnTprfBCcmqqA24kbZFDODbc74UpBKXsyIpbGRYNBfK2JuI5mbiDklADxalb 0VTM6Dayz5vRx9zSgJypP4VoJh5TSU4BEydTdjzzRw2sm4aQItmACvAZtYL3xcRvXGP3Xw Mnh2I6ZqT9gk9LujsONEeFt0VhdgN4KIo4YSRPlcimuNZrv+mtKui6KJ+B76OX8oNLzsCe 5te1WRjy3BGsxdU9FQz4uEYmzcUeo5MvgU/GJeFJXE8Jx+SpJxfxK9BMMkWjKLJwrQR69/ EllKhGmGALY36wTWv/7Ocn4A8RrQ9ctp0WrtATTjOKK6udEAeycffF8PpdSSWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 --- Comment #2 from clear.screen@orange.fr --- Thanks for you answer. The problem is that the filesystem was freshly created on freebsd and the corruption seemed to occur while the rsync ran making the kernel panic unab= le to avoid. There should be some safety code to avoid any kernel panic on this usecase = (as the data disk which hold ext3fs was distinct from the system disk). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 30 19:05:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MHGwK2kRJz4b72t for ; Tue, 30 Aug 2022 19:05:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MHGwK0xpgz3Qgl for ; Tue, 30 Aug 2022 19:05:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MHGwJ72C2zsCR for ; Tue, 30 Aug 2022 19:05:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 27UJ5KY4020076 for ; Tue, 30 Aug 2022 19:05:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 27UJ5K6L020075 for fs@FreeBSD.org; Tue, 30 Aug 2022 19:05:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from zfs to ext3 partitions Date: Tue, 30 Aug 2022 19:05:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661886321; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VLo66edKrrKSyLsRAfLBXGl55VA/L6SrVjBbniCGE5I=; b=WqiDQLzIIEqk3X88apzj3fq8EdsMAul/3zk4a81hXcNFyYWgRYJe3TXt3Z8Cgn96G1sXLc 5kVJkJFgt8ipdzYOpkHLbyE8zmTmMs+uvkX15dJCl68CJWrzCFwkPDHT4W+Fw3/cx/fVW1 5/Thz78JqFqKdvZhCW3hrf5zg7CJH+KJivP4BS3IHrUQO+3yufRMjSuLyPJ39ouldbfziO +jWGjRvqNw1czGO808bA/fS/0Ybv4JmrGWEnDCRw9RwydyoE75NnBp+0SpmaUusBjLJUU4 P9tDcQ1ETfVtaXJQJgL9TS63KAN3pP6+tm2awLj6k5YOz6q4DBPK/fsxTo/j3Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661886321; a=rsa-sha256; cv=none; b=KHe7zQQZnzrnqNSMHYD6NC5gNDKamOxMHppGnRlBGmZc2ck61ZyUBY43T+W6OSvhdrMTtw 1YF92Glb9zrE+jNlP2TT4Z/HjETjM9up3e/jf+XuYilpH/aLu/IpzK8fI1B58x3pe3wFAz JpYtLzbX8BBdWA9k/y4faZl+lKiNYhxqmfYpuCTFTp0+TCtWdorE1yfGDcwXw7ewlJ7bir Sl0Ud/IdbQpbzQXFxkJduczxFcVwBJtpkhPUto+N7uWFqymWsQgNRDnybiV0F+DyvwYSm/ xsxBxfG06/exEnOWQsQgjd6PXrIA+FBJfNcNFFU5a8Ut685AYlsgnlbsmsGt7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #3 from Warner Losh --- > There should be some safety code to avoid any kernel panic on this usecas= e (as the data disk which hold ext3fs was distinct from the system disk). Of course. That's what makes this a bug. There's a fair amount of code alre= ady that tries to return an error rather than use erroneous data, but inside and outside of ext3fs code. Of course it shouldn't panic. To help make this bug report actionable, however, a more complete way to reproduce this would be useful. The description is a good start, but what options do I need to pass to rsync? What kind of files are required in the = ZFS dataset? How many? What sizes? etc. The corruption could come from ext2fs.k= o, zfs.ko or something else that's impossible to guess given the current information. Also, what was the corruption in UFS? On crashes, the superblocks and other metadata, let alone dirty data pages, aren't pushed out to disk (since when= the system panics, it's hard to know if you are syncing good data, junk or if syncing is even possible given the damage). fsck will repair these problems, though. So more information about the corruption on the UFS partitions, and what options were used to create them would also help us know if that part = of the bug is 'expected inflight operation uncertainty at the time of panic' o= r if its something new that also needs to be investigated. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Sep 1 20:31:16 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MJXkb5ykxz4bWHJ for ; Thu, 1 Sep 2022 20:31:19 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2059.outbound.protection.outlook.com [40.107.116.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MJXkZ5P9Rz3pYv for ; Thu, 1 Sep 2022 20:31:18 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LUO/OlRPq3ThW1zo+DGPKOckgnP68NofFh2Q/i0a4Ik7P6bF8tYKCy0+DkPMAz+TNW36dQUL1r7czUs2/AaYrrhZsRe4K6RwRD//dji3tDz4AJiEd/J3+eQkiCQScA0zqiRKU6rRJhUHbeJOlDxRLFGJ+faZa1pBwBzCu7dAgJs0I3RnVJ6ojTShOaDmvt9cCQ0jXbs37Ar2Ql1x/jtoWv7oqUPG0Wpe6r0zYWmgS7/h2hK9ZdNb2yVBtTXMbJ4YwXsjfQrmPk7En1xF8PfKRZthDJsClQDMuXUwJgQ8KuikChheGQyr6Qjby7a6IUod1DJMUcSrQeY/vnvgo+6qfA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=gTliJmIEZiPtA15DtWBppT0vKRiBKubvGqgiCfAqtxk=; b=a3zKS7y/1+QS0m+MKgPY6fi0edj1cu+PBuFSeeu8zHUahqgLMfHT33LVMMt7wB9hAxjz0YnI1XEsX+vUmVvJ7un/at6uSBBtO1apdgXXbUMheFUd+4gUvveAmnrX5Lptc7GdvgBLxB8DnBubMCWx8Plz2HzUQrrzksjUOf9O6jXB5xgFEKfs1wXbD7zjco9nAzHw8YR2vnasD07KoQJxFFDxY9QnBLQm43Ux+WPL8niQkyjcC/xq070dwAsPxQ5JbP3Oc7i2dfEDIrlNqAH0zw2R9cz/twNLeH9MGOhkSJUDNhdzyNqQwa3v5luo1bIW190bUYTSYBFCyPDP9nz0aQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=gTliJmIEZiPtA15DtWBppT0vKRiBKubvGqgiCfAqtxk=; b=qfHUHED+KlX/2DwMVkG9MclvUALSAoJjZBq1qFcxNvNYXdj7GdWxtpsujROC8ABE/dsnQfwQlWHgv2srB1A8gDdqESAP7BUzfyK12MBDMNvxN+IOi3XOB8C2WVwd9evN/3b91uzjre9GG3UV9chwa1Qinfk4bNQiRXltgv47wdTVTycPaClr4bMemEqOy+jVFSfv/cNrkWS/yFcONz7b/c94+TplN3nYbCp4CYPQo2yBufoEyOkRpHnLOeH8QwyYzOfWmkVdhTFdXndC6CluE7oegWgjYmVJrniaWLC7nbvocsdO7n6NVbN7XvFFuQA3C84icejJXmapoyZuxEX8xg== Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::7) by YT2PR01MB8744.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:bb::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5588.10; Thu, 1 Sep 2022 20:31:16 +0000 Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37]) by YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37%9]) with mapi id 15.20.5588.012; Thu, 1 Sep 2022 20:31:16 +0000 From: Rick Macklem To: Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Topic: SEEK_DATA/SEEK_HOLE with vnode locked Thread-Index: AQHYrQY7fWQ5YS0dF02y4OgRBDgrJa2owxGAgA/DcfWAAQ8LgIAAYqWLgAZuEYCACr6dOw== Date: Thu, 1 Sep 2022 20:31:16 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 61a7b2b1-af2d-4e63-a34e-08da8c58ebca x-ms-traffictypediagnostic: YT2PR01MB8744:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: oLZ4dw8EnqGV1pjA4nUJqXf+hdSUO0g2HXHu8fgpxPXpg+J8+hibTPKLBp9Z9a4rTlZ2vpfMeQHM2yGZso25ylhM9FRR2qY49x/gkVeOO5mCGJI3RLCRzcxfIKjTvteP7YrHKa3jolWoWaVJrVb8C4HsgVXAb+BACKy1zpNdUZGjfD5W3/fGxRlheYqjrcOckSM/xloZIkXKzpaUUCVaSa1xoVABSV0UGMhPyRBwUEjhbzRfl247SeOmEjH/JgK/JdFBn0+l2/S4rJ+QJzqtNOwaEztmFbQ6GnCkF16Mf4RDmXHk83+WVwHi3ONq1N1S063OhGhlhtwDFACPkeyGP7ZXbOpcJBOJwUxIwbr7L1Fr9wMvlQsKgFWhBbOzECveSSPexp6cnHZykns3sxfaFIBBcQez5gVZy/movBjBb/l3FiX8ipvRqx5zrLYClcP8s7GlFntVgm5Q03r+yrmWL+qdbt/grdM4XgD3cLlXP8m2azExF9BAMotbsa8JWNHCMC7swH7S+qKhQvQ+yuP0SrKC/dctsJ4CVQ3JsylqB2JE6ODxyyrCjCktOw89ArCbY2ukiKAi1y3zj5aIcxoFy8VLjznaydsQ0KzfWrk7RLyxIrope3T2R2Qe5yUYWpD3bUJzX9kKdFg3Oh2s2wRd2CNVgm9fwhcmr00UU046qysM1ebOMj+38YTdcBEz6F+dkfX9KnfNKvscfjCdEAb2zPkSXtzjyiUWX6Vlp1i5pdJsM3VBstoqbZchDuqVAcG/NsfLu1WiBhvxPWiWbHIR/3VBoIzgMjzhHh1ZLCHlx8w= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(39860400002)(376002)(366004)(346002)(396003)(136003)(6506007)(786003)(2906002)(7696005)(9686003)(6916009)(86362001)(316002)(122000001)(41320700001)(8676002)(38070700005)(66946007)(99936003)(66446008)(76116006)(52536014)(4326008)(186003)(91956017)(478600001)(66476007)(66556008)(8936002)(55016003)(38100700002)(71200400001)(33656002)(41300700001)(64756008)(5660300002)(21314003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?f1Ze8L0wSJM5ZWGpd8psGLBfI6wE0qXlVhacrXg1PNxi4CvXTUXlPmnYDl?= =?iso-8859-1?Q?rooltoshxAYeMCf0xjznjsGPJuvnX+PlxP1GFhl2ZIQ8Fgt+Y1aFMQMcb9?= =?iso-8859-1?Q?9JOL922AbWnm1tpLphcN7BcZ4Flr1jLyd33tf/qj4ThKzcAquhbWOvg0px?= =?iso-8859-1?Q?x/cWcX8YwEU8UO8a0nXqvPlbT/fG9/twGXp6Mu93E+Umayk/bYDDP0dpuI?= =?iso-8859-1?Q?r7yUMsszHtbBVzzaadV7XW6n54t8Xu+NNHbDNZoOaXXumbn9Ehf1csKmtU?= =?iso-8859-1?Q?nY/KKBCqARXp2lqrLM1WF4jkrUwFKMk4gpO8qai/JGrtHOGY/sFCgTCnuE?= =?iso-8859-1?Q?x5eNzUX39/K7pthtavu74Bdf6QI1YWLnQuRMlK4K+oeEb5KcQ9vo+eU79P?= =?iso-8859-1?Q?kythStR5ZKkx+ocu36LTrCCGSkVjdE2yTRYduEIdbMUJUJPp5h/H/gaJkp?= =?iso-8859-1?Q?KW2/QFmj5aE7cCWoPNFB+A53vr7HoUMCfaCAhklnsH0/zI3z1GbLvyBfwX?= =?iso-8859-1?Q?LgQJOXjhy70A0de8r8ziaiwvfmgM+baiiLwMSXJxeOGDlFUZoQv7rCK9hC?= =?iso-8859-1?Q?FvCYpj/G6toaGu4j7xIc/dXzVgmcKN139ySLWYZMF6ENbV7puh3Rhm3f7/?= =?iso-8859-1?Q?Fh8/Lsa+DpLNmMftTLzc9VFxiCQakk5WT3NQRV6BhOMxLxDo5I0g/CTZbd?= =?iso-8859-1?Q?/fLmoEnlv+6vF/7RthSj+V/GwdL1f8GLJZsDeYzcH64t9938YSeDnsVXo6?= =?iso-8859-1?Q?fsr28OPLI6+a70TMQpPtuW3BD/fIYqWDEDexjq0IKHSaBXG4QZ4vE/ne5H?= =?iso-8859-1?Q?hWolcrBYCqWisLNHlJfi1ePp7ksPMEba83lk3HaHqK4cZ1KUlV1/lzFKvI?= =?iso-8859-1?Q?U6if9HJgoSKUgWMidETIZHOvRoIN+tJca1goy60S+VEalDr7qRtVf7hlwt?= =?iso-8859-1?Q?AqmhVyia1PoaGqFuDu9W3z5CI05r1I3BVNv9wAojLaW0fy8q39OzFemzVb?= =?iso-8859-1?Q?MDpmu9tDUDmpa28v4mWplJghKBtUDM+cvRQchzlv3isgBNhi0nF/Z7DxW1?= =?iso-8859-1?Q?OMuOEKTmbVxP0OHXzWbdI0F65oSjcLrFAnOs80BaGlB0SP5uCmYIXiASwr?= =?iso-8859-1?Q?Rf+uEzgKJzmsCzE804seSxgETn9QblIkjXL1n1hz4x1pOxdPlHFFTYapW4?= =?iso-8859-1?Q?Ze1z2ZJ3aj2vELJO69jMxhGUy1srGKyO+BAhLaDisrk8cxFjd87v284Iv6?= =?iso-8859-1?Q?YA0p1RfQFcl/IvMAfyftth5Gz+r/zOqKXAMID+PiMaIfrNQ3bfj8Z8KMza?= =?iso-8859-1?Q?pMZhIRQA+jFqq3sQ1Z5MjVA4x3HlyC+vfNC0DgGiUnIOTeHpwG+nGUo9nE?= =?iso-8859-1?Q?5I+HaoV/blYmx1n1qzeWtS+CscFaFm4gWlDi4yjdVVR1s46Uzsgto0BEt0?= =?iso-8859-1?Q?4MBVDgQZt5Rbd1ZOraSDyWrsbH9BfsuwJgZ2qYaA+HGT4iChKIBd/NE2wK?= =?iso-8859-1?Q?Rh7y3n5Ok47eJce46WXtf8aEUiNihwQ0eJPVsd1QNMT988GjaQaKHLSIiX?= =?iso-8859-1?Q?pxm8mLbLz+SMLeABRsO8p1ly3JzIY5Z+I9WS6ivZ8YRFqRQOKwPS0xxgbF?= =?iso-8859-1?Q?LN0/tbHbRKXo8RY4R/nWqEKZMDwTeMxMa+72IlruUmVwFo/kVkxnpnjqw+?= =?iso-8859-1?Q?jtJ+727yXZQWh17m0OENZ4/YpmidcHZDxYH0mksT?= Content-Type: multipart/mixed; boundary="_003_YQXPR01MB4150BC25A9767E42251730DFDD7B9YQXPR01MB4150CANP_" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 61a7b2b1-af2d-4e63-a34e-08da8c58ebca X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Sep 2022 20:31:16.6658 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: LIMF5P5erKdqsVDLGHV2x6oZzX6Hfo3Jw7rjrsfN1+C88AnZR9PHqXOgYyXqGrA5q1gca+va+5ZzaQbrxLYAQg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB8744 X-Rspamd-Queue-Id: 4MJXkZ5P9Rz3pYv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=qfHUHED+; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.59 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.90 / 15.00]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_BASE64_TEXT_BOGUS(1.00)[]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; MIME_BASE64_TEXT(0.10)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; HAS_ATTACHMENT(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FREEMAIL_TO(0.00)[gmail.com]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.59:from] X-ThisMailContainsUnwantedMimeParts: N --_003_YQXPR01MB4150BC25A9767E42251730DFDD7B9YQXPR01MB4150CANP_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Konstantin Belousov wrote:=0A= [stuff snipped]=0A= >Could you arrange some local test, without NFS, please?=0A= >I might try to take a look at UFS then.=0A= Well, the two attached trivial programs seem to demonstrate=0A= the problem. crsparse.c just creates a sparse file, then readsparse.c=0A= reads the file, either with just read(2) or using SEEK_HOLE/SEEK_DATA=0A= if "-s" is specified on the command line.=0A= $ crsparse xxx=0A= $ time readsparse xxx=0A= $ time readsparse xxx=0A= $ time readsparse -s xxx=0A= $ time readsparse -s xxx=0A= =0A= However, when you look at readsparse.c, you will note that it=0A= does the reading in 1Mbyte chunks, which is what the NFS server=0A= will see for ReadPlus.=0A= If you modify it to do the reading in large chunks, there is no=0A= longer a performance problem.=0A= =0A= In summary, I think the performance problem is pretty=0A= specific to how ReadPlus would use SEEK_DATA/SEEK_HOLE,=0A= so I doubt it is worth exploring?=0A= =0A= Btw, Linux has now decided to implement ReadPlus just like=0A= Read and not look for/process holes. They are convinced=0A= that ReadPlus can only efficiently find holes if there is a file=0A= system specific method (ie. a VOP call for FreeBSD) that returns=0A= both data and holes. Until then, ReadPlus won't be any different=0A= than Read for them.=0A= --> I could do this, but I don't see any point, at this time.=0A= It also appears to violate the intent of ReadPlus in the RFC,=0A= if not actually a strict violation of the RFC.=0A= =0A= rick=0A= ps: readsparse.c works well either way for ZFS, so it was some=0A= other mysterious weirdness that caused ZFS to be really=0A= slow for ReadPlus?=0A= =0A= --_003_YQXPR01MB4150BC25A9767E42251730DFDD7B9YQXPR01MB4150CANP_ Content-Type: text/plain; name="crsparse.c" Content-Description: crsparse.c Content-Disposition: attachment; filename="crsparse.c"; size=748; creation-date="Thu, 01 Sep 2022 20:30:47 GMT"; modification-date="Thu, 01 Sep 2022 20:30:47 GMT" Content-Transfer-Encoding: base64 I2luY2x1ZGUgPHN0ZGlvLmg+CiNpbmNsdWRlIDxzdGRsaWIuaD4KI2luY2x1ZGUgPHN0cmluZy5o PgojaW5jbHVkZSA8ZmNudGwuaD4KI2luY2x1ZGUgPGVycm5vLmg+CiNpbmNsdWRlIDxzeXMvcGFy YW0uaD4KI2luY2x1ZGUgPHN5cy90eXBlcy5oPgojaW5jbHVkZSA8c3lzL3N0YXQuaD4KI2luY2x1 ZGUgPGVyci5oPgojaW5jbHVkZSA8dW5pc3RkLmg+CgpzdGF0aWMgY2hhciBvdXRidWZbMTA0ODU3 Nl07CgppbnQKbWFpbihpbnQgYXJnYywgY2hhciAqYXJndltdKQp7CglpbnQgaSwgb3V0ZmQ7Cglj aGFyIGNwOwoKCWlmIChhcmdjICE9IDIpCgkJZXJyeCgxLCAiVXNhZ2U6IGNyc3BhcnNlIDxvdXRm aWxlPiIpOwoJLyogRmlsbCBpbiBvdXRidWYgd2l0aCB0aGUgYWxwaGFiZXQuICovCgljcCA9ICdh JzsKCWZvciAoaSA9IDA7IGkgPCBzaXplb2Yob3V0YnVmKTsgaSsrKSB7CgkJb3V0YnVmW2ldID0g Y3ArKzsKCQlpZiAoY3AgPiAneicpCgkJCWNwID0gJ2EnOwoJfQoJb3V0ZmQgPSBvcGVuKGFyZ3Zb MV0sIE9fQ1JFQVQgfCBPX1JEV1IsIDA2NDQpOwoJaWYgKG91dGZkIDwgMCkKCQllcnIoMSwgImNh bid0IG9wZW4gJXMiLCBhcmd2WzFdKTsKCgkvKiBDcmVhdGUgdGhlIHNwYXJzZSBmaWxlLiAqLwoJ bHNlZWsob3V0ZmQsIDEwMjQgKiBzaXplb2Yob3V0YnVmKSwgU0VFS19DVVIpOwoJZm9yIChpID0g MDsgaSA8IDI1NjsgaSsrKSB7CgkJd3JpdGUob3V0ZmQsIG91dGJ1Ziwgc2l6ZW9mKG91dGJ1Zikp OwoJfQp9Cg== --_003_YQXPR01MB4150BC25A9767E42251730DFDD7B9YQXPR01MB4150CANP_ Content-Type: text/plain; name="readsparse.c" Content-Description: readsparse.c Content-Disposition: attachment; filename="readsparse.c"; size=2141; creation-date="Thu, 01 Sep 2022 20:31:11 GMT"; modification-date="Thu, 01 Sep 2022 20:31:11 GMT" Content-Transfer-Encoding: base64 I2luY2x1ZGUgPHN0ZGlvLmg+CiNpbmNsdWRlIDxzdGRsaWIuaD4KI2luY2x1ZGUgPHN0cmluZy5o PgojaW5jbHVkZSA8c3RkYm9vbC5oPgojaW5jbHVkZSA8ZmNudGwuaD4KI2luY2x1ZGUgPGVycm5v Lmg+CiNpbmNsdWRlIDxzeXMvcGFyYW0uaD4KI2luY2x1ZGUgPHN5cy90eXBlcy5oPgojaW5jbHVk ZSA8c3lzL3N0YXQuaD4KI2luY2x1ZGUgPGVyci5oPgojaW5jbHVkZSA8dW5pc3RkLmg+CiNpbmNs dWRlIDxnZXRvcHQuaD4KCmNoYXIgYnVmWzEwMjQgKiAxMDI0XTsKCi8qIFJlYWQgMU1ieXRlIHVz aW5nIFNFRUtfREFUQS9TRUVLX0hPTEUuICovCnNzaXplX3QKcmVhZHNwMW0oY2hhciAqaW5maWxl LCBvZmZfdCBvZmZwb3MpCnsKCWludCBpbmZkOwoJb2ZmX3Qgc2Vla2RhdGEsIHNlZWtob2xlOwoJ c2l6ZV90IGxlbiwgeGZlcjsKCXNzaXplX3QgcnNpejsKCglpbmZkID0gb3BlbihpbmZpbGUsIE9f UkRPTkxZLCAwKTsKCWlmIChpbmZkIDwgMCkKCQllcnIoMSwgImNhbid0IG9wZW4gJXMiLCBpbmZp bGUpOwoKCXNlZWtkYXRhID0gbHNlZWsoaW5mZCwgb2ZmcG9zLCBTRUVLX0RBVEEpOwoJaWYgKHNl ZWtkYXRhIDwgMCkKCQlyZXR1cm4gKDApOwoJaWYgKHNlZWtkYXRhID49IG9mZnBvcyArIDEwMjQg KiAxMDI0KQoJCXJldHVybiAoMTAyNCAqIDEwMjQpOwoJbGVuID0gMTAyNCAqIDEwMjQ7CglpZiAo c2Vla2RhdGEgPiBvZmZwb3MpCgkJbGVuIC09IHNlZWtkYXRhIC0gb2ZmcG9zOwoJZG8gewoJCXNl ZWtob2xlID0gbHNlZWsoaW5mZCwgc2Vla2RhdGEsIFNFRUtfSE9MRSk7CgkJaWYgKHNlZWtob2xl ID4gb2ZmcG9zICsgMTAyNCAqIDEwMjQpCgkJCXNlZWtob2xlID0gb2ZmcG9zICsgMTAyNCAqIDEw MjQ7CgkJeGZlciA9IGxlbjsKCQlpZiAoc2Vla2hvbGUgLSBzZWVrZGF0YSA8IHhmZXIpCgkJCXhm ZXIgPSBzZWVraG9sZSAtIHNlZWtkYXRhOwoJCWlmICh4ZmVyID4gMCkgewoJCQlpZiAobHNlZWso aW5mZCwgc2Vla2RhdGEsIFNFRUtfU0VUKSA8IDApCgkJCQllcnIoMSwgIkxzZWVrIHNldCBmYWls ZWQiKTsKCQkJcnNpeiA9IHJlYWQoaW5mZCwgYnVmLCB4ZmVyKTsKCQkJaWYgKHJzaXogPCAwKQoJ CQkJZXJyKDEsICJSZWFkIHJldHVybmVkICVsZCIsIHJzaXopOwoJCQlsZW4gLT0geGZlcjsKCQl9 CgkJc2Vla2RhdGEgPSBsc2VlayhpbmZkLCBzZWVraG9sZSwgU0VFS19EQVRBKTsKCX0gd2hpbGUg KHNlZWtkYXRhID49IDAgJiYgc2Vla2RhdGEgPCBvZmZwb3MpOwoJY2xvc2UoaW5mZCk7CglyZXR1 cm4gKDEwMjQgKiAxMDI0KTsKfQoKLyogUmVhZCAxTWJ5dGUuICovCnNzaXplX3QKcmVhZDFtKGNo YXIgKmluZmlsZSwgb2ZmX3Qgb2ZmcG9zKQp7CglpbnQgaW5mZDsKCXNzaXplX3QgcnNpejsKCglp bmZkID0gb3BlbihpbmZpbGUsIE9fUkRPTkxZLCAwKTsKCWlmIChpbmZkIDwgMCkKCQllcnIoMSwg ImNhbid0IG9wZW4gJXMiLCBpbmZpbGUpOwoKCWlmIChsc2VlayhpbmZkLCBvZmZwb3MsIFNFRUtf U0VUKSA8IDApCgkJZXJyKDEsICJMc2VlayBzZXQgZmFpbGVkIik7Cglyc2l6ID0gcmVhZChpbmZk LCBidWYsIDEwMjQgKiAxMDI0KTsKCWlmIChyc2l6IDwgMCkKCQllcnIoMSwgIlJlYWQgcmV0dXJu ZWQgJWxkIiwgcnNpeik7CgljbG9zZShpbmZkKTsKCXJldHVybiAocnNpeik7Cn0KCmludAptYWlu KGludCBhcmdjLCBjaGFyICphcmd2W10pCnsKCW9mZl90IG9mZnBvczsKCXNzaXplX3QgcnM7Cglj aGFyIGM7Cglib29sIHJlYWRzcDsKCglyZWFkc3AgPSBmYWxzZTsKCXdoaWxlICgoYyA9IGdldG9w dChhcmdjLCBhcmd2LCAicyIpKSAhPSAtMSkKCQlzd2l0Y2ggKGMpIHsKCQljYXNlICdzJzoKCQkJ cmVhZHNwID0gdHJ1ZTsKCQkJYnJlYWs7CgkJZGVmYXVsdDoKCQkJZXJyeCgxLCAiQmFkIG9wdGlv biAlYyIsIGMpOwoJCX0KCWFyZ3YgKz0gb3B0aW5kOwoJYXJnYyAtPSBvcHRpbmQ7CglpZiAoYXJn YyAhPSAxKQoJCWVycngoMSwgIlVzYWdlOiByZWFkc3BhcnNlIDxpbmZpbGU+Iik7CglvZmZwb3Mg PSAwOwoJZG8gewoJCWlmIChyZWFkc3ApCgkJCXJzID0gcmVhZHNwMW0oYXJndlswXSwgb2ZmcG9z KTsKCQllbHNlCgkJCXJzID0gcmVhZDFtKGFyZ3ZbMF0sIG9mZnBvcyk7CgkJb2ZmcG9zICs9IDEw MjQgKiAxMDI0OwoJfSB3aGlsZSAocnMgPiAwKTsKfQo= --_003_YQXPR01MB4150BC25A9767E42251730DFDD7B9YQXPR01MB4150CANP_-- From nobody Sat Sep 3 03:11:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MKKYX1SyNz4c8qX for ; Sat, 3 Sep 2022 03:11:12 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2078.outbound.protection.outlook.com [40.107.115.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MKKYV6d5lz3Tm3 for ; Sat, 3 Sep 2022 03:11:10 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mIxUR/MecxLBuSPTVQg0HyJeP00evGQEFG5ATbf4sNjgyULG/2vfJja0NJkhFkkvQZfbcIIhWtuQVZOqTKwExi1dd+J1FgoG5YZurgCaHVKfHDa+jxEtu39pH+r1m3venchd6hq1itzvCP0CLnRRoI76IpCaerAMtwTD3ISt9gq5DGwKYPAk8eDDzp6WCN6fz+WNkQS9wgTxBvaa4HFKYZDv1mpCEau65Qk3/vSxXk61LKxgXUF9g9SVyVDf9PBWTomXEdQlk2JTZ940PMBI+NWDRPfqxUmiFOZebk5f1rfOxbpO48fuNbp1eLqr4xxMXlKCedVbSFuVHbALF72PxA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=muYfohvB0e3xHatvkhq+gaGcsv6bzmz6hSXlzuRQCKI=; b=VdZEgU/ootbzw+tJ2V+HtZ1HxaH9pGdpq5IXo0++XRFbisYP0PhzquBpl3exkLngI1TY0j+hsGaO69UVsbQOFFU2wpu3ZuXVRJGsOLOpwztKrlo7TBVRvnPxjw8CEjxIbP0AYdxW5aIV+xiKuTfP61hG2F17B8i9NMor2zI1DpM9MyDPQKy8WvWVBsv4y3wmoLINPNqhVvDe0MK7HXtYBnhKoy8LqMUIvU8c9AWW6hQM9HfQ4wiP3bq5qEWY7mD5bv5p2tN6pAae37McJvGhDpymrtcz86r6RLF1nua+Cews2MVR9hQXvmA+HFcYicE5JXkJhGpS4DToE51/V4LTyA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=muYfohvB0e3xHatvkhq+gaGcsv6bzmz6hSXlzuRQCKI=; b=J++kBEwJLXxbB2wdeq6BpDaT7WvcFF7PTabre3WsKHOcRR4xQkxgxmAs4DxNQdjDlfRRh+A+g/bJa0JPHGgXC2Mhm049iL5V4LCyIsEW+nfgXC1wqQQD45IsZoHGMFqEMWQvxmmnKHOKC+RoYdaJ8KoIWvhCtsAJZ00tOxHwuyz7RP3vneSfd3XArcN5gTnXEvPpn7mH3EkHQnhIZCnTdfEs9TILbkAdgAcdmaStVGFdfGM1d3CRgi1BNWwLE4wxccQ9wYyrumZdcHGeI6ZD5a8MqwpCQnEnyCO0geEw9cGshY4Hyk24Bo/HRDtjSTkjjprYf3U1kn+SskBUlEyraQ== Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::7) by YQBPR0101MB8557.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:54::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5588.11; Sat, 3 Sep 2022 03:11:09 +0000 Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37]) by YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37%9]) with mapi id 15.20.5588.016; Sat, 3 Sep 2022 03:11:03 +0000 From: Rick Macklem To: FreeBSD Filesystems Subject: RFC: multiple concurrent I/O ops for copy_file_range(2) Thread-Topic: RFC: multiple concurrent I/O ops for copy_file_range(2) Thread-Index: AQHYv0H/+RMlpemwREiRz9tUi24+UQ== Date: Sat, 3 Sep 2022 03:11:03 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: ec2a3c99-3faf-48b1-c337-08da8d59ef37 x-ms-traffictypediagnostic: YQBPR0101MB8557:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: h4c6v4eLxw3X9X6HmD1FFgd7l5ZILXYvYgk+Clafhso2Nl8BHXe7Ulls++AfbraHuPORHsfhEGWbAh+H7N4S3GullG//hBc2qJ771FMTffYEDFhrxeIbxBr+/djhK2wHJ7yEucL7Z5zR7DYzffBSYQI5wPBkVO84GtNjiYW9tnziQsTzjeikSHxwDFSGTS1G0e5/7L6njcK2Jab8Tdf1B0gxn5aSl+yQyuQbXihCMUqzQBDLfUS9JNBgMbT1CNXA+QFeIrWrrD4iion2u9+n0t1pG3ZIQEMyD9BpcZFF1zP/jR1wT6MJBHdI1PzbP/gSbrI2t6D1ir/SactyNOZ41nqyRC44Pw8Ad0Qdnfb2nBedACI1osLeKdXg8LlTfPN9FAwG9R+JcLZ1CeN5+DJdfDpYwgvbY3RTr18LklUV/t578naKXegZ7Lgtt8Iol2aM3AZUhShOSDweDqnJ3VzuO9FIUL/jksF+ScuVkbSNWEIQMCekS7+KvhI+htgcD0zpYudlQxk5/ZcebqfQLtT9+0tucDUI0zEuxxWBSGqUJAy/EPYdNgSgECei6mPi52cOjBpcvYow5s5/v+qJ/K+T/aYJSW1H7YBAV83RLQy2qEhUhM5+HrrK2nNxodaEQifT92Fl13hmRBEQwUbjNB82BP118hzMzb5S+/ijgGcPcBaGIjWa4BaWZA4ffsdIEi2I9rY7QQBhBi9AXm6JtRstKUdPkTHeLd/N/BB5oJb5cCCoZtK7BVEfUEYpTD4xc73J x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(136003)(376002)(39860400002)(366004)(346002)(396003)(55016003)(71200400001)(316002)(786003)(41320700001)(6916009)(38100700002)(122000001)(76116006)(66946007)(91956017)(478600001)(8676002)(66446008)(66476007)(86362001)(64756008)(83380400001)(38070700005)(33656002)(66556008)(8936002)(186003)(52536014)(5660300002)(41300700001)(2906002)(6506007)(4744005)(7696005)(9686003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?vWmyt7SKB7JIZ84/lhxSCqsO2BRnFjJGxj54eW0CI/vJSgCqrTaeP3Rp1u?= =?iso-8859-1?Q?qKCOJ7dL7NFOavljekxIhsshjr0btVpfnsvCzEAQDRTm8PDCButIBxlYLG?= =?iso-8859-1?Q?XZKU5ZHFmiKLUCpYjQiMXa+Jtw/f0Py66K2kSUbkk10agWy6ig7NgVyyvP?= =?iso-8859-1?Q?cPNMzDmDprEsy2OSEOB0B7bRbYDbE/oFqJep/VwZOkLl+dwtyCwv5IvMcm?= =?iso-8859-1?Q?lwf3eyffEGcCIFpZ1aHR7g9Y8oKssKsCSOVuJds4HXocV9K6uq7oMz1ttU?= =?iso-8859-1?Q?/CohUL2aI2QfE8YVm05UplK5g6RS668PaQsnv1L2w3ikXq+Lz5wuGPjob7?= =?iso-8859-1?Q?E/VUTnRMOmFRzkOmMMYLeh3yplqpucdBhHYk7X4G9A4Cw30QiiFxHtrVvS?= =?iso-8859-1?Q?ZDHbKfWhioBUIX2PyaDmR917aJ+ue+vTBzAMKDc2KNadaGW7F4iFfQ0Dhg?= =?iso-8859-1?Q?UDV6Tn9pCymjgiNp/MCXDvsuOEu3RhXt2Xjl6KGia2JBuGYQtD8HBThi+x?= =?iso-8859-1?Q?aFnXroyoSOYL1wGTNGS9kTzr5n7WYefU+5YBHS9XSW2atdC/aEqUxxROYV?= =?iso-8859-1?Q?HEumc7Sih8oDyVyiwxi48Zl92PWuadwK7v9081s6XwiFLgjZxgFQB2WNNU?= =?iso-8859-1?Q?Vo8UqXntARJVE+OH57Cpo1N12QKoFZ9ZfpYejIQIS9DfsgncaGmYhE7ykV?= =?iso-8859-1?Q?nJWwtqvm0behe2piV2f+ngaLIoxbEP03/HkoVty6d9UyIn8GCzRG3fzb0w?= =?iso-8859-1?Q?9hHyGc/9yRbwhv1ps5jl7PqIy72JYCxGD4sAekiTv8DXOi/0xD0JVfzW6/?= =?iso-8859-1?Q?Cz7SSFWcJy71jcCQVzYqBwoUCtlUsvqFHzO1fMLsg+I+MZAOyEEPza0CXI?= =?iso-8859-1?Q?mg/SDuf50XCZCq6HXW0m3K7p4NCnd04PazrxpzuWwDcurrvsQb+ro5cCp6?= =?iso-8859-1?Q?fHIuPQ4LoMg61GeNJhaLwjFJyZ3H4A7RgQ2tPmbT1ppcVBOQE0/YHMgKfS?= =?iso-8859-1?Q?LiIyzIBzbwhI6Tj0Lh0MpXsPtS+jFqTBxqeXoxdK/hneKRGiqU/3U2SrF8?= =?iso-8859-1?Q?RKwayMUWSajDrXIEkjrJ25FnD6YLtAy4zY32i2ySHWEHQOSqmRwQebKQ3v?= =?iso-8859-1?Q?n90rS8O/+xA1G0Z8aA+cB05MT88hGWJlQe3ZKFBOitlKAhD8hjB6oxfTv9?= =?iso-8859-1?Q?ulGzfIKHO+0eQRjko8oYMexYpnyvdUeEMXDU1fc9Q72xGAKAq4412jwGF9?= =?iso-8859-1?Q?RVDoxUjOJVs0xN/nAAJeJzYL52JSuWq458HoMIhcF9X6qOhSX2r/CdEAaI?= =?iso-8859-1?Q?zyX4ZVmTne8l6e10cmlOjZjaKn5PPX+Fcq/GCWzrVmE9MQp4N/W3V5SqgF?= =?iso-8859-1?Q?mNPevXdmwy4XDLqIvGu4WMfFGvy6OaAaKH4o44bWLDAkL0ptOGyy2Gh13k?= =?iso-8859-1?Q?Z2DAGJuw/wXfLqrb1fZZFFALUg/XxnTZPeLCLXbv6wuGgiS2pBFnvrb46B?= =?iso-8859-1?Q?y4wPAx2XhmugJvuB3GwqdWX4KEUPJddkBclHoQqo4Pg3BMBJyP9Sw+MPl+?= =?iso-8859-1?Q?lRG0gKNJ2p6Jo/Eclp2wIp88NhNBg7c8xS8HGbemZtYuswYlSBHGCWlDBC?= =?iso-8859-1?Q?Dq9nOQosgc8CleRwOzaDytXGbIScQLt8IkD4O65LXkH4VjN5tjA5a5S8wk?= =?iso-8859-1?Q?n1ZvX1Q3R5K4MHz9L5o4S90iySCzAJexNGEUgp4V?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: ec2a3c99-3faf-48b1-c337-08da8d59ef37 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Sep 2022 03:11:03.1049 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: hklakpk7pyp+2+SJfbBYFEZfNBwRP+/5wNKbsbsO+/EqYtxkyLBl8aYIOrVwWGMeu9/JSCN4MGe7z3vzqw6/kw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB8557 X-Rspamd-Queue-Id: 4MKKYV6d5lz3Tm3 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=J++kBEwJ; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.78 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.78:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEFALL_USER(0.00)[rmacklem]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.78:from] X-ThisMailContainsUnwantedMimeParts: N Hi,=0A= =0A= A recent discussion involving copy_file_range(2) performance=0A= included a suggestion that, maybe, copying of subranges=0A= should be done concurrently.=0A= =0A= Although I cannot be 100% sure, I think that this would=0A= involve using multiple kernel threads (taskqueue or similar)=0A= to issue I/O operations on the file system(s) for blocks=0A= (of f_iosize maybe?) concurrently, to improve performance.=0A= =0A= Doing this in a system call is unusual, to say the least but, then,=0A= copy_file_range(2) is an unusual system call to begin with.=0A= =0A= I have not attempted to code this up as of yet.=0A= =0A= So, what do others think of this idea?=0A= =0A= rick=0A= From nobody Sat Sep 3 03:17:26 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MKKhz2djwz4c9QC for ; Sat, 3 Sep 2022 03:17:39 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qk1-f170.google.com (mail-qk1-f170.google.com [209.85.222.170]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MKKhy3J64z3VbH for ; Sat, 3 Sep 2022 03:17:38 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qk1-f170.google.com with SMTP id j6so3101244qkl.10 for ; Fri, 02 Sep 2022 20:17:38 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=72ekmrUOYDEqpnLaOQQWVS80VBDs+LQZIj1aPj4QDsM=; b=srOI7/KYCHGBv/KEj3uJkeL51IW3+6+jWqaGrePQHCJr7Bu+/q8kl+zHGLAtrYzPxF fqsenyHxpzMpMHxX6zMzvdS6ZOErzoMnU+yyfPhji9NgD1Jiu9zLXA8ExSzrRrVj4FbZ biQB6UKPk0+NLCt9xDV0BraM/+Qy4jjPIZtW/VGNpM09+T6Pmy71L3CWwdDVoeQaEEIh BtWWKnbQCFL70vPGSwsJe7AfMAYnQ7hdHCnCl5+TgUnZxbnAZswBEUQkAF1DX9w7VNQU TfYo6GsVvA+/tBLo3NeV4G0jOoc/T7KV/YiQhr+6Kp1R+Ng3WE0rUWKXic4e1wcgMW/n 8Qbg== X-Gm-Message-State: ACgBeo3wOLDIhBL91+GhtX4q67ujP99Z+9Hsj+TxZTQ+TP+/Q/cNAYRH nROHrsXLQ1T1WyRhO16mK7/ACVjXyChdI0DW+80= X-Google-Smtp-Source: AA6agR7UG1Qaz06k/S9jLsMYFZGn6I58aZcJV79KET2kbgDok458fiQvVtDz3Gc39xvW7YGpcsUaA2lG8kXrIJiw6ME= X-Received: by 2002:a05:620a:1a81:b0:6c0:9f02:da81 with SMTP id bl1-20020a05620a1a8100b006c09f02da81mr6116588qkb.286.1662175057037; Fri, 02 Sep 2022 20:17:37 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Fri, 2 Sep 2022 21:17:26 -0600 Message-ID: Subject: Re: RFC: multiple concurrent I/O ops for copy_file_range(2) To: Rick Macklem Cc: FreeBSD Filesystems Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MKKhy3J64z3VbH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.222.170 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.170:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.170:from]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Fri, Sep 2, 2022 at 9:11 PM Rick Macklem wrote: > > Hi, > > A recent discussion involving copy_file_range(2) performance > included a suggestion that, maybe, copying of subranges > should be done concurrently. > > Although I cannot be 100% sure, I think that this would > involve using multiple kernel threads (taskqueue or similar) > to issue I/O operations on the file system(s) for blocks > (of f_iosize maybe?) concurrently, to improve performance. > > Doing this in a system call is unusual, to say the least but, then, > copy_file_range(2) is an unusual system call to begin with. > > I have not attempted to code this up as of yet. > > So, what do others think of this idea? > > rick I'm skeptical. Is the intention to speed up copying on file systems that do or don't have an efficient VOP_COPY_FILE_RANGE implementation? For those that don't, I don't see any point in trying to beat the speed of the old cp(1). Apart from the problems that we've seen around hole size, does the copy_file-range-enabled cp match the older cp's performance? From nobody Sat Sep 3 03:26:27 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MKKvK6lhCz4cBVY for ; Sat, 3 Sep 2022 03:26:37 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MKKvK0SPZz3WHq for ; Sat, 3 Sep 2022 03:26:36 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 2833QSuc039340 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 3 Sep 2022 06:26:31 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 2833QRhl039339; Sat, 3 Sep 2022 06:26:27 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 3 Sep 2022 06:26:27 +0300 From: Konstantin Belousov To: Rick Macklem Cc: FreeBSD Filesystems Subject: Re: RFC: multiple concurrent I/O ops for copy_file_range(2) Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on tom.home X-Rspamd-Queue-Id: 4MKKvK0SPZz3WHq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCPT_COUNT_TWO(0.00)[2]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_SOFTFAIL(0.00)[~all]; HAS_XAW(0.00)[]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 03, 2022 at 03:11:03AM +0000, Rick Macklem wrote: > Hi, > > A recent discussion involving copy_file_range(2) performance > included a suggestion that, maybe, copying of subranges > should be done concurrently. > > Although I cannot be 100% sure, I think that this would > involve using multiple kernel threads (taskqueue or similar) > to issue I/O operations on the file system(s) for blocks > (of f_iosize maybe?) concurrently, to improve performance. > > Doing this in a system call is unusual, to say the least but, then, > copy_file_range(2) is an unusual system call to begin with. > > I have not attempted to code this up as of yet. > > So, what do others think of this idea? > Note that UFS does not understand more than one stream of writes to single vnode. The result could be a severe fragmentation, which is relevant even for SSDs (due to large internal block size). From nobody Sat Sep 3 03:41:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MKLD6094Fz4cCq1 for ; Sat, 3 Sep 2022 03:41:10 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2071.outbound.protection.outlook.com [40.107.116.71]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MKLD45N0gz3XR8; Sat, 3 Sep 2022 03:41:08 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Xfv9kOBNjx8l8hgmUqalee+mEMJ21tXKmLVBqfvqbSqXEMVeYGT+Ez4spq+g+KLpAgJE//D1bVYWpTFID9KhVePmdqh5lIDwfpZ9PJDujuUz6AacCn2OJbW0nlpMXNzrFvWVBJkX5LIdiRfq1N57rsj+CqF0YuGWQx3OGw+eXbhiBtySK6I8C2txMZGlyG1Cnu++zNRpQCeQQbCg8cyX5BMGJPg7neRMk/NP0MldDGGb8i96DmUVWG8F018zqKmGgph+4mv3uvvbrzCbtC4MCokP1CaYA6YyCYBxRVwcFE3gm7uSPLKk4GzU6/RT6WyrTOA6SPhnEHHVNs183Ex/bA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Q0AOUSn698LkW4aHhOfKaNSPO9SmlbXuzHKVodbLlas=; b=LiMAL+hheqhxbi4cCXpCvolQJegux2VSUGXq+GyxqyN0dopp87qtzZI0ZE1H2B+LmIsTo6Rgmth6X4RsL7TUwiXqm/j/MPx5kQ93O7rf9Sp5k9+ccvRi7QiFxQbFY4iBx3GZdxJO8BtZqGRsMM3h4adrFMd5KUIoYFR70jhX7ND0ykBMExLE5396ttOoVEfu7Z6xoNP27nwwNd7/TmOUhckviFlUWlln/qhyu3AEhU1fX1fxFeGY7Bg6j7AWryAZL6lYcTZ7Zzry+BHLgIoJNJ8EHUoKQRGRf4CgYfYWzv0OsvymxDcHVTXgjwTtVgi0qltxj6c35kijCOiHNJ92fA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Q0AOUSn698LkW4aHhOfKaNSPO9SmlbXuzHKVodbLlas=; b=lHWOzwx3BKZLq5wqstwbLGGCkzee8+dLXWzRIN+69q7yBRM7GSmeY+T05c88JWoy8Q65p29Kn6F19mgsCN7TbAmwtKFW+irGdgTU/bLadMcjPfywBBBDn93yHVrHRcWv62DSwVrHhULAKc5Xmj+ZtWRQbhcKJGp1kN4vFjb1ZwNro643LZ5YLWEo3eLMyJlZjXnTfjJpDFaqJ5I/X3R8w9Rc/YF2zNAEbOwluWNXuefS/LHekICT+0HgTTmIxI95h1uKVYPm2S0Ce1qlEZXe+6cREj7IYDWHHyrBY4/QwLJxaRxS+I6fgNHs+UJRm5c9mmKH7daNMXKWUr5LchNdkw== Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::7) by YT3PR01MB6405.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:70::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5588.10; Sat, 3 Sep 2022 03:41:06 +0000 Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37]) by YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::980d:23ea:9bc2:9f37%9]) with mapi id 15.20.5588.016; Sat, 3 Sep 2022 03:41:06 +0000 From: Rick Macklem To: Alan Somers CC: FreeBSD Filesystems , Alexander Motin , Mateusz Guzik Subject: Re: RFC: multiple concurrent I/O ops for copy_file_range(2) Thread-Topic: RFC: multiple concurrent I/O ops for copy_file_range(2) Thread-Index: AQHYv0H/+RMlpemwREiRz9tUi24+Ua3NCN0AgAAEBfo= Date: Sat, 3 Sep 2022 03:41:06 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 5df08924-55da-4028-98e4-08da8d5e2247 x-ms-traffictypediagnostic: YT3PR01MB6405:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: Eb6ecSDlWOGQWFAx7wZja4/ginH1M/L9YDNqWQOrTNVIxcoKdFb2GLpGxMTgb78HSEIm5cqYFeUxjJOPUHKIsXSdkvmqla9VUrEKEfdfFX5m+SgKgmCb64PVP3MhKL8FvYNNoIeeyQZsQIRJNkk/5H7APQnfuMoWF8eKNSppE1tuCbw2G2mY72RpUeIr5Don4916Y5ufhfJMN/nf4hDsGwP/TCVgUVASCVqrgxcqQ9vBZFq5PFZGKnbgbxo4GlUoUgP4Z9y/ytjBGKDGoDbXbGUtV11b/A3Mdwva0z8XieoMeikv+LYVFS3mTsoy1FXksvbmqKH8Wduw6HJdzE48kQJVK/7Yhc2B4nk9VQ/xbIrtmI8BTgfx49WgcB2n88ezV6hdcqYJnXEZCD5v3uXFXAvsjBXxPBUUeqS+kUJrimH8fHEY1H2skA+f53pXrqrmDM0hQSnhHGNKxsKVkXiNlvebSiogGmjNQx5mcF0dzAtjYJP1qPHVvLcDtOdYfezQGnWokLXjvovQAGfbBYsSQsId6EDKU3Y9K1HyenAKS+tniuJWVnrsaD9XpeHTojmDV6CwBJdtQRAtYTenCBuWShs0CPOzbuXClSTnocutpjnovjoqI3Rtk1xOOSNic3mbeKyxAuzgd0GDyMAp6iUhtMrjPtM5TR9ManTlkVzEv5+YZ4/Ai4MuaFOQncuwYVBTc6hQoMTTdzJM5f/WizOtW+46/AOd8XX5LpUoV9KVHoDHnbSbq3g9OLfHaIABunsb0a6PGB4dGcUEAK3qcK6qwwaRGwxydPA/JoMdw8Vyrgw= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(346002)(39860400002)(376002)(396003)(136003)(366004)(966005)(76116006)(786003)(8676002)(66446008)(316002)(66476007)(4326008)(64756008)(66556008)(66946007)(122000001)(38070700005)(38100700002)(33656002)(86362001)(83380400001)(71200400001)(7696005)(478600001)(41320700001)(6916009)(54906003)(41300700001)(55016003)(2906002)(52536014)(8936002)(9686003)(6506007)(186003)(91956017)(5660300002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?54iHmskwzw7+NYDYVSUL5zeXMvHjGwBwzXJbPlqANgZOnhiZA2sK1o6oXm?= =?iso-8859-1?Q?yTJ4GJxZBrB8w66rUOzqidT1yf9k1Pe/KZC3uFzzxXpbLNnD9eSQhl9M9Z?= =?iso-8859-1?Q?SjcJ7+Z+P+Pe49I/qJc7IwPVU6B5LUH4HBqgZ7vH2sNsdFLjwO4GUXZuvz?= =?iso-8859-1?Q?+Weoy+PsxrLS+VuQlCLleS/dT24kh6z/dx9A2z73ZAYKZWjyD1B0yb7PPJ?= =?iso-8859-1?Q?gm6BfBGz6Ch0Mt2FpSIKtttReJ93mlgvVs2EMMP68ez3ehfh3eplgYtQA6?= =?iso-8859-1?Q?OiIk5nEOsa/DKtBhgjzut1Lj64ELqUgL7ner3+o6+wurHgnM20VJ1slWVI?= =?iso-8859-1?Q?2X4QnhJ/qaKjLQGhZfurJOA6leQQ0DTvw5c9uNqtx5Eu4l3al94MDfHFe9?= =?iso-8859-1?Q?QDkHdLdO/LxR89HqQujCwaSxC2Y76bhJuDNoiTGhQURf0y4GEWjelFrc9V?= =?iso-8859-1?Q?qjGC3oP0YYL9H3rZZg/Z82xrzsrdycTw8l7VB+QLYnb8PoPoTm4DZW5iMR?= =?iso-8859-1?Q?T2u0uZqOMMlSLTMmjLtqIkad861utye3mTYmtzV4vQkPu5S3cVCghoNAc8?= =?iso-8859-1?Q?H1q/Wqpp1maXppNDlTRh8spON/+dsrbq/GsPeOSd3AdZpbA46C/TX4XT/w?= =?iso-8859-1?Q?8rmRcca7QtpP1fIOgTn+W8d5Mqd5Vw9oGr0bYxeQRhiZdaRkjr4Can7P53?= =?iso-8859-1?Q?lQkLMgu9JnwY7qvsvapYb9DIddCdKLEfkS5UFTN09a6iEZybhdy3Kv0Nvd?= =?iso-8859-1?Q?N9LQosAjOZY47MAFYbEZnJLuV0HCWYC/BT0M1M4yKr78GFbEMfj3XXMNkd?= =?iso-8859-1?Q?oK4m5z4bFK5C6euB8kSpL4spQzBN887Ezmsjr0oBdpFkgraKRXxSvSENL/?= =?iso-8859-1?Q?/VfC0ystdwSrnSdyvuRjt0wAHU7nfWRIUKG9SemhgWMu99MZL3fM6S93vP?= =?iso-8859-1?Q?KiIZCKAFP4CrjeKoAqUt2EtP/gp4C5DJhf9YfP7Je6wWxp2b64BErQSAvb?= =?iso-8859-1?Q?nf1r87LoNCm8SON7UcR3H0CmX4KL/YLXtWZLM8cg/T/N/hc9Gx+Cr5eHkU?= =?iso-8859-1?Q?B5W7JwBGgaZezhPma21+//gyPoAKl3Wqa265aOmusBr4xe/vpze/Yfww39?= =?iso-8859-1?Q?eVxCcbEPYoUfdLepVFw1sqb3F6Ys+SV3dUA7ExrR/IB2kJ65xnawbzK/f9?= =?iso-8859-1?Q?CLVo8Zr5/S3wMhProAr6M7MaQIIfCzCLU7+pcq2udDmCNFIQ0IIl7jgcPc?= =?iso-8859-1?Q?71KSOV+iBt3vBo8Jvj2wSl9QywBANxgFJpucHc/cQX8jF3dbEZJ4WZMGm3?= =?iso-8859-1?Q?Drs2lTDYdGzuCETyUW5gzAo6L/9RWVnXxlRtz4GsNxUYZiT8WYe7g0oGLQ?= =?iso-8859-1?Q?iIv+CH1Jdu+To9fC6P0qG0L2RiocMX0aDAYVdhFicYcQc0zfFIx8D6l1V9?= =?iso-8859-1?Q?qfM6tuf5o9qXqA3qB3V1uPFspjfmGwFiv7eK3IYluSBGRzciKNDHxz6K8g?= =?iso-8859-1?Q?jet8kLrkDxH9YpY5wYlW6Oz9fsQXMnTB5DRIPwXURWuEMlWjq6ylqrAT4x?= =?iso-8859-1?Q?llbipZw8Ax9MRGpKi3jFCZaiMA7dt+Q6xoB+IQm18GSmy2wEDTKUwjGyLO?= =?iso-8859-1?Q?cl9/UhDQyd1W93e13f46VRQMzBbIV4q2gPjIO76MHo/IdSIvIcma/CV+QM?= =?iso-8859-1?Q?YIT4C0IWgK8zR4JPJnJ61ekSreNLMD7R2WU5JJWO?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 5df08924-55da-4028-98e4-08da8d5e2247 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Sep 2022 03:41:06.7438 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: xWTDxs19EALIXxPGXKeybNUv/caHnN0rNmd7GIh8Fujiiny7eyoUiacnfiu7uwkAtdX3Jx1yX9tKm1C1hejeuw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB6405 X-Rspamd-Queue-Id: 4MKLD45N0gz3XR8 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=lHWOzwx3; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.71 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-6.00 / 15.00]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.71:from]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FREEMAIL_CC(0.00)[freebsd.org,FreeBSD.org,gmail.com]; RCPT_COUNT_THREE(0.00)[4]; FREEFALL_USER(0.00)[rmacklem]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Alan Somers wrote:=0A= >On Fri, Sep 2, 2022 at 9:11 PM Rick Macklem wrote:= =0A= >>=0A= >> Hi,=0A= >>=0A= >> A recent discussion involving copy_file_range(2) performance=0A= >> included a suggestion that, maybe, copying of subranges=0A= >> should be done concurrently.=0A= >>=0A= >> Although I cannot be 100% sure, I think that this would=0A= >> involve using multiple kernel threads (taskqueue or similar)=0A= >> to issue I/O operations on the file system(s) for blocks=0A= >> (of f_iosize maybe?) concurrently, to improve performance.=0A= >>=0A= >> Doing this in a system call is unusual, to say the least but, then,=0A= >> copy_file_range(2) is an unusual system call to begin with.=0A= >>=0A= >> I have not attempted to code this up as of yet.=0A= >>=0A= >> So, what do others think of this idea?=0A= >>=0A= >> rick=0A= >=0A= >I'm skeptical. Is the intention to speed up copying on file systems=0A= >that do or don't have an efficient VOP_COPY_FILE_RANGE implementation?=0A= I suppose so. In particular, when the input and output files are on=0A= different file systems, a custom VOP_COPY_FILE_RANGE() cannot be used.=0A= =0A= > For those that don't, I don't see any point in trying to beat the=0A= >speed of the old cp(1). Apart from the problems that we've seen=0A= >around hole size, does the copy_file-range-enabled cp match the older=0A= >cp's performance?=0A= =0A= Well, the discussion starts here:=0A= https://lists.freebsd.org/archives/dev-commits-src-main/2022-August/009067.= html=0A= For some reason, there seems to be missing entries. I recall replying=0A= to the one that suggested concurrent I/O operations (by mav@, I think?)=0A= that I would post here asking about it. (I've cc'd mav@, in case he wishes= =0A= to comment further.)=0A= =0A= I do agree that doing some performance evaluation of cp(1) would be=0A= useful.=0A= --> The thread seemed to suggest (I'm no ZFS guy) that mmap'd=0A= copying does not help for ZFS and that doing copy_file_range(2)=0A= for small files instead of the mmap'd copying might make sense.=0A= --> Then there was mention of having copy_file_range(2) do concurrent=0A= copying of blocks, which precipitated the email.=0A= =0A= rick=0A= =0A= From nobody Sun Sep 4 12:28:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ML9sh0nLjz4bYcX for ; Sun, 4 Sep 2022 12:28:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ML9sg5cBCz3T28 for ; Sun, 4 Sep 2022 12:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4ML9sg4fskzV7W for ; Sun, 4 Sep 2022 12:28:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 284CS7Vv020514 for ; Sun, 4 Sep 2022 12:28:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 284CS7Lm020513 for fs@FreeBSD.org; Sun, 4 Sep 2022 12:28:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: on long running find (zfs issue) Date: Sun, 04 Sep 2022 12:28:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dpy@pobox.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662294487; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Gt3qmW+RpYLNaXIhVDcoW0wjN0wn+w9o69LlD3DyJ+Q=; b=P+wcRZfk6RfvnumqJ5FIzAS5z0vhRaktG18C3Q4l0kbNLN0pvL38A7DaSTsRpWVLnrtMwf YgQus3ZyVjzKYqAdmEeBLNHOWPwgb9jJW/33bArhWBgqziNH1I2maFShSTSyLn+uQog1u6 3zWqMUE8eLVSaPSuvNcWr+d2nMRWJ7kMUTOZ9rcUg5SsM9xXIQlmXLoMBgizikW8KX3zES /DW7JgIHrjZ4hLNVVJhp6/ocVbi0/wrXFbboU82hUbNak8TZln+0FBT0On6LY69VYzRfFi kWcL5HxHTAj+dHv+aRM93aqAQgzeyiaR4fIymH8r8cxGdqIaClRrXj3P+m2CAQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662294487; a=rsa-sha256; cv=none; b=qVJla/ceVbeX+CVjbT1ywxB0FvMA/IPd/dtwLgq5Z8ORC2yvNqUB6bjQCN7IreStaq9Ql+ m7pBFF6srMB+uB6Aok/Xnh4jutCgeIF1qxDtZ7+hV4gwk/7f4KWUISZ2pHxdvWFkV4RH88 ODTOmEldpCsE4JE58qRJlAIlDVvWRzyfG/nFd/Ox64zzp23kkfQRlsSqxcHja0iRawxX+s VAKi8eUcQQtRQjMbpu9bLJHa0kzgPVFGjSKinuOZYX0d4f/PdyVQQx4RF1BhOfvuEB9VXK up1IP6WnQUnfH/TNtbUB2SmQ+mZ1UNKHt+iWI1i8Il//bpVB9hg4yDgsGtSAVQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Duncan changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #236087|0 |1 is obsolete| | --- Comment #3 from Duncan --- Created attachment 236355 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236355&action= =3Dedit Full core.txt.0 from dump --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Sep 4 12:34:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MLB1V377Zz4bZ9n for ; Sun, 4 Sep 2022 12:34:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MLB1V12jPz3Ts1 for ; Sun, 4 Sep 2022 12:34:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MLB1V00nbzV8M for ; Sun, 4 Sep 2022 12:34:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 284CYrN7032906 for ; Sun, 4 Sep 2022 12:34:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 284CYrlZ032904 for fs@FreeBSD.org; Sun, 4 Sep 2022 12:34:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: on long running find (zfs issue) Date: Sun, 04 Sep 2022 12:34:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dpy@pobox.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662294894; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=j6Fl1++cFrRQcfnR4V1wkCYYfKdwWzmF0w4fo0YXIHY=; b=HAZGZj3pLJ22adn0iBfvxJl4KaDr7Ug7GRe2oWFBOqhQDAFtKCucwN7QEw8D/YvRFLqPoZ Sao13tW/HRbFRStnc34A7FwTcgw877SylBlHho5zowQgDmS5p07zZxAvV2+ABduNQGZwAZ 3OO+f+YsKal9XVRWBz55+rWXKBWdJ5mAR+r2WGnSexpXIO9t9QpwVx7DGdp5fB80VuFlG7 yUXAqJnq4T6JJqd1RJtI5TKhqDEvTryTpHTPFisiJZu5NMO4006ZXEBnA+1mlU+bDYtUvq jUskKgKs3o4FB3Cgi/QG9fWumenhcD6ETCN/qIx4O8D2axMxmJ+HYr+8/9vbEQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662294894; a=rsa-sha256; cv=none; b=IXdj1U2l6qZPie2oMpQztHt4juxLmAhLw3DZbQQoUcicO6ZKA3yh5WK/TZxg2YNiUnVbz/ 4Hik0GCLjlNemxbxEP+CWGiM40TVvajhJNZZTunch0VJt/0T8V0IZhKX9XTvh4eHmhofW8 jWWxWfZWkg71bRlTFE8QeCfjeQSzsTn2kQx3i5Jn/4/Ug9a+3UbATkQY9na9xIw2X/mA5Q Wt028IhTyxmfv5hC6A5NTy6Psv53JMrbhs2TH5M9Bw4lV/uMSbNoatSBteLlAwYtY/J1Er 8p5ZoY4GZHB0ghLjYf1WAYUXMYBSFd6TngG+6SZhRJXGmotlnLZv4W7/nHKHKw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 --- Comment #4 from Duncan --- I have compiled my system from source and caused a panic (run periodic daily (daily_clean_disks_enabled will cause it) ). I turned off all the VMs and j= ails before causing the crash (remove extra complexity and reduce the size of the core.txt file). I also added a larger dump disk and now have a complete via= ble dump. I have attached the complete core.txt.0 file and the following is the starting portion: triple0.internal dumped core - see /var/crash/vmcore.0 Sun Sep 4 20:09:55 AEST 2022 FreeBSD triple0.internal 13.1-RELEASE-p2 FreeBSD 13.1-RELEASE-p2 releng/13.1-n250158-752f813d6cc GENERIC amd64 panic: VERIFY3(0 =3D=3D sa_handle_get_from_db(zfsvfs->z_os, db, zp, SA_HDL_= SHARED, &zp->z_sa_hdl)) failed (0 =3D=3D 5) GNU gdb (GDB) 12.1 [GDB v12.1 for FreeBSD] Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.1". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: panic: VERIFY3(0 =3D=3D sa_handle_get_from_db(zfsvfs->z_os, db, zp, SA_HDL_= SHARED, &zp->z_sa_hdl)) failed (0 =3D=3D 5) cpuid =3D 8 time =3D 1662284816 KDB: stack backtrace: #0 0xffffffff80c694a5 at kdb_backtrace+0x65 #1 0xffffffff80c1bb5f at vpanic+0x17f #2 0xffffffff8500bf4a at spl_panic+0x3a #3 0xffffffff85032c12 at zfs_znode_alloc+0x522 #4 0xffffffff85033c35 at zfs_zget+0x3b5 #5 0xffffffff8501e84b at zfs_dirent_lookup+0x16b #6 0xffffffff8501e91a at zfs_dirlook+0x7a #7 0xffffffff85030a10 at zfs_lookup+0x3d0 #8 0xffffffff8502c11b at zfs_freebsd_cachedlookup+0x6b #9 0xffffffff80cdc4ed at vfs_cache_lookup+0xad #10 0xffffffff80ce0cf0 at VOP_LOOKUP+0x30 #11 0xffffffff80ce0723 at cache_fplookup_noentry+0x1a3 #12 0xffffffff80cddfa6 at cache_fplookup+0x366 #13 0xffffffff80ce8cfa at namei+0x12a #14 0xffffffff80d06993 at kern_statat+0xf3 #15 0xffffffff80d0708f at sys_fstatat+0x2f #16 0xffffffff810b06ec at amd64_syscall+0x10c #17 0xffffffff81087e8b at fast_syscall_common+0xf8 Uptime: 56m13s (ada0:ahcich1:0:0:0): spin-down (ada1:ahcich2:0:0:0): spin-down (ada2:ahcich3:0:0:0): spin-down (ada3:ahcich4:0:0:0): spin-down Dumping 31966 out of 130858 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(stru= ct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c1b75c in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1bbce in vpanic ( fmt=3D0xffffffff8527c012 "VERIFY3(0 =3D=3D sa_handle_get_from_db(zfsvfs= ->z_os, db, zp, SA_HDL_SHARED, &zp->z_sa_hdl)) failed (0 =3D=3D %lld)\n", ap=3D) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff8500bf4a in spl_panic (file=3D, func=3D, line=3D, fmt=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_misc.c:107 #5 0xffffffff85032c12 in zfs_znode_sa_init (zfsvfs=3D0xfffff8027a9c5000, zp=3D0xfffff807415f9ce8, db=3D0xfffff80f7c49acb8, obj_type=3DDMU_OT_SA, sa_hdl=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:364 #6 zfs_znode_alloc (zfsvfs=3Dzfsvfs@entry=3D0xfffff8027a9c5000, db=3D0xfffff80f7c49acb8, blksz=3D3584, obj_type=3DDMU_OT_SA, hdl=3Dhdl@= entry=3D0x0) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:466 #7 0xffffffff85033c35 in zfs_zget (zfsvfs=3D, zfsvfs@entry=3D0xfffff8027a9c5000, obj_num=3D, zpp=3Dzpp@entry=3D0xfffffe03109916f0) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:1042 #8 0xffffffff8501e84b in zfs_dirent_lookup ( dzp=3Ddzp@entry=3D0xfffff80741474588, name=3D0xfffffe0310991860 "tb_pkm= eth.c", zpp=3Dzpp@entry=3D0xfffffe0310991740, flag=3Dflag@entry=3D2) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_dir.c:191 #9 0xffffffff8501e91a in zfs_dirlook (dzp=3Ddzp@entry=3D0xfffff80741474588, name=3D, name@entry=3D0xfffffe0310991860 "tb_pkmeth.c", zpp=3Dzpp@entry=3D0xfffffe03109917e0) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_dir.c:247 #10 0xffffffff85030a10 in zfs_lookup (dvp=3D, nm=3Dnm@entry=3D0xfffffe0310991860 "tb_pkmeth.c", vpp=3D, cnp=3Dcnp@entry=3D0xfffffe0310991c58, nameiop=3D0, cr=3D= , flags=3D0, cached=3D1) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:929 #11 0xffffffff8502c11b in zfs_freebsd_lookup (ap=3D0xfffffe0310991990, ap@entry=3D, cached=3D1) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:45= 93 #12 zfs_freebsd_cachedlookup (ap=3D0xfffffe0310991990, ap@entry=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:46= 01 #13 0xffffffff80cdc4ed in VOP_CACHEDLOOKUP (dvp=3D0xfffff80730da45b8, vpp=3D0xfffffe0310991a10, cnp=3D0xfffffe0310991c58) at ./vnode_if.h:99 #14 vfs_cache_lookup (ap=3D, ap@entry=3D) at /usr/src/sys/kern/vfs_cache.c:3069 #15 0xffffffff80ce0cf0 in VOP_LOOKUP (dvp=3Ddvp@entry=3D0xfffff80730da45b8, vpp=3D, vpp@entry=3D0xfffffe0310991a10, cnp=3D, cnp@entry=3D0xfffffe0310991c58) at ./vnode_if.h:65 #16 0xffffffff80ce0723 in cache_fplookup_noentry ( fpl=3Dfpl@entry=3D0xfffffe0310991a88) at /usr/src/sys/kern/vfs_cache.c:= 4928 #17 0xffffffff80cddfa6 in cache_fplookup_next (fpl=3D0xfffffe0310991a88) at /usr/src/sys/kern/vfs_cache.c:5284 #18 cache_fplookup_impl (dvp=3D, fpl=3D0xfffffe0310991a88) at /usr/src/sys/kern/vfs_cache.c:5932 #19 cache_fplookup (ndp=3Dndp@entry=3D0xfffffe0310991bd8, status=3Dstatus@entry=3D0xfffffe0310991b84, pwdp=3Dpwdp@entry=3D0xfffffe0310991b88) at /usr/src/sys/kern/vfs_cache.= c:6104 #20 0xffffffff80ce8cfa in namei (ndp=3Dndp@entry=3D0xfffffe0310991bd8) at /usr/src/sys/kern/vfs_lookup.c:570 #21 0xffffffff80d06993 in kern_statat (td=3D0xfffffe030c6b5000, flag=3D, fd=3D-100, path=3D, pathseg=3D, pathseg@entry=3DUIO_USERSPACE, sbp=3Dsbp@entry=3D0xfffffe0310991d18, ho= ok=3D0x0) at /usr/src/sys/kern/vfs_syscalls.c:2441 #22 0xffffffff80d0708f in sys_fstatat (td=3D, uap=3D0xfffffe030c6b53e8) at /usr/src/sys/kern/vfs_syscalls.c:2418 #23 0xffffffff810b06ec in syscallenter (td=3D0xfffffe030c6b5000) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #24 amd64_syscall (td=3D0xfffffe030c6b5000, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1185 #25 #26 0x00000008011ad39a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffd588 (kgdb) ------------------------------------------------------------------------ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Sep 4 21:00:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MLPDd4RNCz4bZpX for ; Sun, 4 Sep 2022 21:00:17 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MLPDd2Jnfz3Nlx for ; Sun, 4 Sep 2022 21:00:17 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MLPDd1LpLzc1b for ; Sun, 4 Sep 2022 21:00:17 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 284L0H4n084756 for ; Sun, 4 Sep 2022 21:00:17 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 284L0H0O084755 for fs@FreeBSD.org; Sun, 4 Sep 2022 21:00:17 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202209042100.284L0H0O084755@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 4 Sep 2022 21:00:17 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16623252172.0aFfa1a.83889" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662325217; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=YEuSxOKW5UJ1Km5Rrjp6O8qW3+gaGRCR/NZX9OMjPLI=; b=Vg0ScLRkzfwrsvFRUGUwFa1507DAtLTPeY90wr+BljenzjFsOGizqwHFRiVBvkbNugrMSl RolDs0Mjo4Cgg0t6qFqh0u5XbQuYWPZ9pAxftA3n7MUo/Z3BcUGn0rHegD5648FDtBxlG5 p4BX0U5QKO611rkyZFiTyqC+outCMHJQjnqLW60WqSse1k15tkqB0OY3pRhIpUdW30bo7s DQ/F7ulXUiqvOHMXXghUcgejHbz3PkBNdi+P/bLVeLLma+RMTDkUmhnn9dnqNqL4Zrludp r/i7ygZnXRsiXNj09EToD61hcAOyy/6DN076moGQS653NwVSzTJh2+/hxtg/7w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662325217; a=rsa-sha256; cv=none; b=yoWmCAlzcPwSBAxkKH0xnjQtQMGk6W27brSZ22ULIgqheA0NjKBLNchHWWC+4kQvGWTJ5M HwiO6LCFGanTEqoKYM7uqf8AKFpliFhk3eZxG9CkQxo1NqUYIx6lxwJHmaHXJMcd85feGy dwwlY21d/DGGqy9GObZjxevBtv3zlODaQVRMsS/e0H5nIsw82XHEZCP39esFfV5OdXXf1e hbx1whviYKoU/dgfsqsm9znuyddhM/ZKT/dBcumpoNxcBJCDgU5jt65v2Zz3FAnr5Fr94X Q3g3rjwGvZ3o/uuM2Eee2ety/SKZgHf8TgD6FzvcgEvD0vn3E7Uvd4bxUC9mGg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16623252172.0aFfa1a.83889 Date: Sun, 4 Sep 2022 21:00:17 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16623252172.0aFfa1a.83889 Date: Sun, 4 Sep 2022 21:00:17 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16623252172.0aFfa1a.83889-- From nobody Sun Sep 4 21:35:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MLQ1c1dclz4bgfR for ; Sun, 4 Sep 2022 21:35:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MLQ1c0bmHz3VpQ for ; Sun, 4 Sep 2022 21:35:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MLQ1b6nR6zcq9 for ; Sun, 4 Sep 2022 21:35:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 284LZlqi030636 for ; Sun, 4 Sep 2022 21:35:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 284LZllN030635 for fs@FreeBSD.org; Sun, 4 Sep 2022 21:35:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 167685] [zfs] ZFS on USB drive prevents shutdown / reboot Date: Sun, 04 Sep 2022 21:35:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: vadim.khondar+freebsd-bugs@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662327348; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6mmga+OS6f8/6IWApC1VGTOKav5zbIl6nenY1LnNDGk=; b=G7Bg2jnXxbLQ/wdm1IsLjFCdOtyf6TvsAifOOVvZOvh3Y86xX/AH1kSymj8UXDIeAXb66y vg4I2wpiG0MpfeNB7QgN0zDsrYSv75/TxCJG+PkdmAL4ond5ZFbdD3ALXxXyWU3D3OGv/W mD3VTnfk7Jl8G1MweqP8KXR6xMQTOnOwvDmOCYwVKYLS4FoG5+EqVDc5l2fWh+sJpUA6Ea PYMGei7Cp3EGoa/yDeiNSz1ROvczot9M9i6ajki+ykmPHCGGJ5I/QY2R3GCKczf3DgX9Uv T5qtgNavfxk1OvW+Y8FO0UHTDjgmuUBRcyElKiUqa747jnwFN+QRkuS6Ju6VKw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662327348; a=rsa-sha256; cv=none; b=Ee0vuM+aT14yTyD998odKS8SImTGvH1ITckc1w+wQ1mN5iM0/POnv3lxba2Oa3erEYNOk8 LECm7m+bc+CbcYMAUFgZu0SESD6e5HA/B17vW2ucwgWcFi3uMoFyuZI+6aucuswyWAnLra 55Ee/Aq4OvzqpJBwyg7XemXsD+/0b2TYlnkhwLDv13nDrUP7DjUWpaqbGJO7rBhcZBYi7s z1XeVMNPbMhGbJh6v3QB7Tvyg963LwpzUAs6c4irIMd3G7L1OjU4uF339lK14fNDMfOXL4 ZaONxmT5MMTAde2oyEGmZFKb4GwrimQgNttzYhduFZPlnZaeN/lEleiu9zKBaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D167685 Vadym Khondar changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |vadim.khondar+freebsd-bugs@ | |gmail.com --- Comment #8 from Vadym Khondar --- I just hit this issue with 13.1-STABLE. I have zpools that include USB disks. On reboot, system hangs with messages like "Solaris: WARNING: Pool 'pool' has encountered an uncorrectable I/O failure and has been suspended." This happens after 'All buffers synced' wh= en there is a series of messages about detaching usb devices, e.g.: "ukbd0: detached", "uhid0: detached", "umass0: detached". I also noticed that single user mode with all zfs partitions mounted (doing /etc/rc.d/zfs start manually after logging in) this does not happen - no usb detached messages and system reboots normally. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Sep 5 05:56:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MLd7d44Rpz4cFwJ for ; Mon, 5 Sep 2022 05:56:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MLd7d33cjz3C4h for ; Mon, 5 Sep 2022 05:56:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MLd7d28JzzkZZ for ; Mon, 5 Sep 2022 05:56:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2855ujMk033427 for ; Mon, 5 Sep 2022 05:56:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2855ujYc033426 for fs@FreeBSD.org; Mon, 5 Sep 2022 05:56:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264450] ufs: Partition recognized on 12.3 not recognized on CURRENT (2573e6ced996): Cannot find file system superblock .. Invalid fstype: Invalid argument Date: Mon, 05 Sep 2022 05:56:45 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662357405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WDExmhoO0CqRfxyq11pgJwC+3A0fDsllcr2XcMvbKjk=; b=YV7xg6l+jxz8a0kbGwBGFFkRbq+EQ6EuCivjIYfoe2luZCudpO16oONWunjYabuyO15mC/ iS/QJSzHmiviV0ijmspmizErlXwK4qHRmaXsP1AkqHJVfFz4Fz2FuRkYRsgJcIMfwFuj2v V6LcIKzcxqwjqhB4IMFYPfsL+Sevukh0Rxb2dpJLS6FbxTtcsSbyLMpA3t3s/7rL25fyQh 4mbCzjZ6Kyoq+i/Mx451HSNSxl0zn+AVnmt6gSJswQSzypeDgIT9IIXHbJAFBL2AoYNHQ9 0qDw4g0X+aU8rVN/TaHP5yxgeLTX6Sh5G585ZIuIoDYSHhn91Pj6QYJ1qj+1sw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662357405; a=rsa-sha256; cv=none; b=UZkwTV8uzqrXQ2rT/I7GBYR76EzBvLxE2KepUzKNrxMmElxJ+kykIjbA6hlRkQb943fY3l 6P25fW99p1Ey9jveP3Mp3Ix09W58bsbR0RaHtRlCuSPrE9CfZaEK0Xd2Ra4YYBBVoUjRcg tPudNw+cJ7NMUPuee2twelQ3jRoDgcMfsaydVwvIdWi86pNkTBPoLJXVOleblt4xYXfJzv T6gXNIf6vC8oDFgLiAp3Q32lPta8/j41gGfF8grOvGPXr1Qnal9F8byqYP+oIyO/fmpd0B WguMBKlRJa7A0MXYU0r8g1iizMOpW8pnRglfX9IRfkSq03EBIjFEtazqKkqnuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264450 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #18 from Kirk McKusick --- This fix works. No need to MFC as this code appears only in 14.0. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Sep 6 12:30:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMPqH13B0z4bhvd for ; Tue, 6 Sep 2022 12:30:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMPqG6y7bz3tDs for ; Tue, 6 Sep 2022 12:30:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMPqG5v6Rz19JQ for ; Tue, 6 Sep 2022 12:30:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 286CUIYC016388 for ; Tue, 6 Sep 2022 12:30:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 286CUIEO016387 for fs@FreeBSD.org; Tue, 6 Sep 2022 12:30:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from zfs to ext3 partitions Date: Tue, 06 Sep 2022 12:30:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: fsu@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662467419; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sIqFwduC4AzjNHpsPW8W54li8dl2WTg7WkYbNOQxtlw=; b=C1HzaY2xECCW5oNph9IzRehQKqSse6CYfSjPOvsj/ZxC7Uost6/qreymKiVL2BlS1EeX8j K1WzJALUcrpFSktKUrWfMjyhNuUgwKUKxvVy2mMT9La+0IJdinngDyyD9atNQXjvWbFjU5 yjAg99Hd44wgJWyn3Nd53BhnsHzHR3hl79p33S9D8IFHqrSqgmz1QCPj4dCLxNNlEWnX+2 Zh375DvngqolhCOE+EDj6UbXw+5WiHKzVbPeOiCFF1jgdLL5oqIrbqDoeXQPuNqJdlwWHz yLqURrHZ2Kq6bWQv1UmKNFd4kT5LvMSz3uScFMWnvINXbYkd8dZ6F760aYqjTA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662467419; a=rsa-sha256; cv=none; b=Tiz+XsYLqNHa0D/RBZ/z438aPQWZjtTsBUGmBQamZQM7AD3uQMow9pSZhjPCSafTg5geyg EXiE9/z13FSh6HNlqaEHw7B0HMzhPR/n+xqS6jnXDwU6snY3KWgnh9A6MLiyePIPgiC6eb XVaVAV2rDmT100HCIZKIBTvBkAeOfOcMk0W6j2s4oFWO2uL/fBKwW2ZqSda8bUX8hNhie3 pOzj66VBFggwM4GwqsNV14TgN1Xggp3nFuLmvVsCQAz9UdWOKsMoJ5rXmJ/JbtogaoLx93 I/VjTmZm7jes4K09F1o2WCK2oRtLIYzcNawgJ3rVs0+0LoQ22IoK7sxSI3MY+w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 --- Comment #4 from Fedor Uporov --- Yep, it would be great to have reproducer. The rsync activity should not cause corrupted directory entries. Could you please provide extfs mkfs options: % dumpe2fs /path/to/corrupted/extfs/drive It is possible to try to reproduce it with this information, also freebsd/z= fs version and pool parameters will help. At least: % uname -a % zpool status --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Sep 6 19:55:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMbhb4VQfz4bYXX for ; Tue, 6 Sep 2022 19:55:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMbhb2pXNz3kr6 for ; Tue, 6 Sep 2022 19:55:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMbhb1tc8zH58 for ; Tue, 6 Sep 2022 19:55:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 286JtBKN040498 for ; Tue, 6 Sep 2022 19:55:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 286JtBgm040497 for fs@FreeBSD.org; Tue, 6 Sep 2022 19:55:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257768] Corrupt UDF disk image can cause crash when mounted. Date: Tue, 06 Sep 2022 19:55:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662494111; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iLOwxgrjyEbUVOipns2s9jeBtfUNLLf7xrkCXyFgd5w=; b=KJtQPCvdQFDtWODr77gY/Mkrz7+/O7dSAfVJkmgC2rsOcAphGJKM1/NW6zbEYIGiIt3AsW ZKv0mPGMsQ3ruRSlkhz16S0vyo7AztqW2wAbPDofoov7R5YjqHkQKO4kcQDPLuLmS2296C YDTM8NThhBi7qs/WQCKI+DAWhfwZ1msMHtSkxlWcIdw9u9hI7W6eVbf+mdwaQKLyjk4baC TuMETQnoMwKY0zoHCJkEhokErVUb8d5CgC5/gK8w0OK7hbBYrvBszHmdCouJgmRtxbZ/pE FZAW5ZaqZyWeS7tXNbz6z4xz5Nbiq6mQF9/8GKl4OE2Et+G4PMYWokSax/ZqXg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662494111; a=rsa-sha256; cv=none; b=Mt+ckuH8BVPJCkfpa3X98lEGSRSbdTAaUu1hFMXlodwqKxKsn0SDph0f5yWehauSpNqYYp Zr+MJoGUHOhYhA4Te8v6ITwsqvvAIazBOQs8LSRG6wn0ASh3eWMVrBBo5yGeJvdKxaJPLq qTrQpytp8poGNhYrOj3SN/We0iNt09cPZhleqnuKMOJY8dxd97brzNtPNfwgZGgz7WF6H3 ymT64Kp2GMETGUXDf8SVNcP++j7sgB8w0wADWx7YEcO9RaTqE0pgw6wEUlJzwzsrFCpP0/ 3oyyJgJL5cgVeE2x0SH1Rw88y6K2jxYaZvG/sWN/K8maN7Xj8vx4/GXfzA1nXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257768 Ed Maste changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |emaste@freebsd.org Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Sep 6 19:59:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMbn86pCJz4bZ6L for ; Tue, 6 Sep 2022 19:59:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMbn85jDXz3mvS for ; Tue, 6 Sep 2022 19:59:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMbn84CTvzHKc for ; Tue, 6 Sep 2022 19:59:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 286Jx8ej041954 for ; Tue, 6 Sep 2022 19:59:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 286Jx8kL041953 for fs@FreeBSD.org; Tue, 6 Sep 2022 19:59:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259068] ext2fs can violate some INVARIANTS if file system is damaged Date: Tue, 06 Sep 2022 19:59:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662494348; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/RqIkjxhTPtSWuXE1oINpvwAAWxSmnXtLAkrc3YJXps=; b=hfd5gwRBnQ3BJRCxYzC7FKQzFp/QSLC/4/yc2Z+N05K1q74zVSj/amG1mCZPeYdUtEj4Yj TzMVUDvf33tsc5Lrqv8eWIPOZ3GRNgsRq1eqHLN58UeyO1npvcTe60LzBYjDnRw2yo7P9z KREGG4Byj7E/eDc4zVHNqQku/amTIL6fc/gSKhbmMpVZgpFBKKOjlH1cylq62QjD4x4MEh IImk3Ym+JX/sHe1uD3152pAq1uqH9WiM0m0w0nGnKE10v1IstsNIx7ZXpvPh/g05YjTb8n TETOntQM2KiwOIko6nH4nQzr2l5EwyGfqa5mPD1Rs4HUNeuWwFuZ0dZviDJu3w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662494348; a=rsa-sha256; cv=none; b=Fgf7aubexD0uBql3RR97bgkOPFAsy/rIpDX9RKwsV0QptzYnlOXov5U+jTUSwtdQ+lmWkX HKzmhGxM6vS0O+FRZPpJBsps1gkMwmzkiJniNXQ8T/YqNTUjjY0BXqX80soWe6u8tGKik9 5N+8JBfj1O0DKb4iPSmGAt9RmaEz1G0c/+q6dnvPhssoAQFW7E2+4ZRvihSQMQ73FokWZ9 cwhVe9ImRSQPoE3ZqhR27g6NFBZem8UxpirlSbZ2i07zn/yHOMlcNiRrB9xYFcJk8Z/Rpb 79hOJt5jhY1tMex7ITybXpXIgbwcrL9DYgJ+s15FLU9wvYBuaqyHX0oIpbNROg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259068 Ed Maste changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |fsu@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Sep 7 01:22:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMkyh3nSqz4c8Nr for ; Wed, 7 Sep 2022 01:22:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMkyh2bWXz3FmP for ; Wed, 7 Sep 2022 01:22:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMkyh1PVKzMXv for ; Wed, 7 Sep 2022 01:22:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2871Mqud027979 for ; Wed, 7 Sep 2022 01:22:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2871Mq9N027978 for fs@FreeBSD.org; Wed, 7 Sep 2022 01:22:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from UFS2 (system disk) to ext3 partitions (data disk) Date: Wed, 07 Sep 2022 01:22:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: clear.screen@orange.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662513772; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WIAdAXmr5RNQd4nmXBX4WkTSjiclD6eMIuXLzB0aGOc=; b=b3S5doiKXCgwvgdKu6oMiNd8yc+3ENazTDOwCDSEj0E4gIWmF8UiMAw+/GQTMsLE4EY5h4 UdIxsvafHylZsuH24zo8XDs3vAvw9aJ1SgiqLkKWPzZo6wg7M3urlShRx7i20TH0pfJxLo 42asmaHXeoni5SPvM4woYrebzPd9Mg3P+jeQqpU+SahZ7mEL0D+2IE7WmlBXspJFcPMEl2 tEfNqlOjDe7LsmbBW4auxH5LBRndFDmbPTPlMKHfkH5dFzUn6yXwTzdelfxgLZdSTMK9AK UiThRP9s+8kpp1Ua9+kWjS+GvtKZh4PJWsbJESpGjriX5dF1E7nIt3RFjL8m4g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662513772; a=rsa-sha256; cv=none; b=QTIKTJ3OwFXr9ZGSW4z0erm+G+XmK9RWqEjt8fBBSI4jcnPjcdj/h8C7OqeLQtt59603Yd 3yEeBdcBxsGoKvLIcvlDMxc3D0CRnhohu/GrJKkunyiqJ+g/y6M6ItKClWtgw5cNL64yN6 k2lavFvLpQQ1R9WXRN/tJY6BTpnsAtZAPlZz7CvoMCyo64Y54cT5kDsnCkQJy2uKgWUsrB xQlSr57/j5Nvu/3aqTcOmv2OTk8jwwGIXOOyYcHlkLqHQJ5OBEze3eys+nKAcyA50jY+uZ U8x+vlYqkEfI7I7Svl6cK030zuAKvK90t0spqerJ2zRfLJuUH/GB5MRCI7AxPA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 clear.screen@orange.fr changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|ext2fs: kernel panic when |ext2fs: kernel panic when |trivial rsync operation |trivial rsync operation |from zfs to ext3 partitions |from UFS2 (system disk) to | |ext3 partitions (data disk) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Sep 7 01:32:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMl9P4wpfz4c97k for ; Wed, 7 Sep 2022 01:32:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMl9P3vjqz3GDq for ; Wed, 7 Sep 2022 01:32:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMl9P2s7xzMjb for ; Wed, 7 Sep 2022 01:32:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2871W9eq036683 for ; Wed, 7 Sep 2022 01:32:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2871W9TN036682 for fs@FreeBSD.org; Wed, 7 Sep 2022 01:32:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from UFS2 (system disk) to ext3 partitions (data disk) Date: Wed, 07 Sep 2022 01:32:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: clear.screen@orange.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662514329; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cRJqJvGm8Cs4/kMADJFwNzXkr9v3FGcBFmS/b/dqvP0=; b=Oo0qN28WK1Nj7gSFL0mrzSx2FlY8ZSO4OxvSo/y4SHK7FSGqA+aa0phlDbAYrLh2JnUH23 wMyViE/MrUF9XX9RhWi7QU3Q//djSxW2oY/Dg/uzmALjKp5KIgB8ZTvqOKq40rybBpBRKR VRTMHQZMNPxrDN0JiERaFZSmNqvhAOGYOo6Ev8VJJQRlngI7FGiL68PQFTSsmtVE3KS6Ye ECmB+KPALOnHEqPU9kR+euMaA8kp3WXu0rEPnogi+yfUIPFH27vanLRZrPbGo/odez6Ybq zgthDCpZ0fULkIbwH94aTr+Kccj0HcDfoKTiFdbStXB8Q76YGo100F0rW57IUw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662514329; a=rsa-sha256; cv=none; b=oygHn9Ql7DbNZgMWmRGqkJyNJlu7EEOXO1TMy+dUostQEkj9IPbC26GNdtgYUEWCfBpPW8 o3kcXeuPyl4WZ2Qwc6oY5Z0I3iySEL9mOHWP2Jmtehe5pIOz9t1vqCtFURusGWlAB8G3z4 vuhIaowdJLGuwYzbNGw30uHKzvlsvCHHAs5u6p7Nsai72Q3J4pMfL493QU+/AwZ0PpHF1U eyl4mJrp0RJaVZNZXpFxoRYvkVge16tEpeLHw94+CQsjKxA67+SYlH2ZiDpSlsXJkZzHLl p24ruu9nxfZTS02GK7jnauM+AludDK5j49ONc+57cO98Heohtq5CFQAZIoc6xw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 --- Comment #5 from clear.screen@orange.fr --- Greetings and many thanks for your comment about ZFS. It made me seen i've = done an error while reporting the bug =3D> i've changed the title (from ZFS to U= FS2) ZFS was on another disk too (my bad) so it's not a ZFS issue. The problem occurs from a simple system disk freshly installed from freebsd installer. The filesystem was UFS2 and that's why i was worried of a kernel panic in such a fresh and raw configuration. To test the data disk i did from first system disk (UFS2) to another disk (ext3) a rsync of /etc and a kernel panic occured. Nothing advanced done, and ext3 disk was wiped before with dd. i'll provide "uname -a" result and "% dumpe2fs /path/to/corrupted/extfs/dri= ve" output when the server will be powered on and before it will be reinitializ= ed. (it will be a production server and i can afford to let it in the debug sta= te). But i will try to reproduce the error in a VM if you want. Best Regards. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Sep 7 01:36:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MMlGH1nCLz4c9WG for ; Wed, 7 Sep 2022 01:36:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MMlGH0k7Sz3Gdm for ; Wed, 7 Sep 2022 01:36:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MMlGG6ns0zMgN for ; Wed, 7 Sep 2022 01:36:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2871aM3x038099 for ; Wed, 7 Sep 2022 01:36:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2871aMUw038098 for fs@FreeBSD.org; Wed, 7 Sep 2022 01:36:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from UFS2 (system disk) to ext3 partitions (data disk) Date: Wed, 07 Sep 2022 01:36:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: clear.screen@orange.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662514583; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kFyGUhilTElflNQZ3sROFUsBXw2UxDoQ4sskXwaqQ+s=; b=O48Oo/V4MSzq/MXB76xdBdAzN4elTXBePEgq5S2mfugknJ7vdurEz/dWqFu2Eu2QsO+FUZ nEW0CC5cas3ym3uiuSYdDJClCeqfbhTF4wbPhq1d1ghlth/72drJ/+gnVdjoBETVndTn1D H/g6y/3b63JWbZDLiEiM1TRhVHX52JrjgOM8sQSspDjx6ldnCVx1aablZFt7T/A8HuAUKK SDse4nsHPzM6wmf4vHCE2WWpezcksosQiHuR9X7n0o93ShR4QlPQNnmUfbCsgnkcoPgCm7 Vb8wfmz6ksUHqQ79y6mVseuMFLUqfAkFMJISemAxy8P+oxo0e7gcSeIsBQKkmw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662514583; a=rsa-sha256; cv=none; b=MIrN/eTO7bmIuyF7RGL/LeSHGxd46FG91R8SZCUT/E13NsuBb+RnQzxnDMZAAtihkpFfdA UuCL6I1dg9JV9ZWLKyV1jn6ehXRySzGqJf95aXt/Tctm08zOaJe7i59+utjiG8Hxbudc3E CQSPMOIOeZlegul4wXp1nssJUPaEp3lPDHLvABzu+zPsDCNqcAzDCWHWuOW44GGFdiwrpo 7NKNDBoOUjzxofaDKA+zEvhgwUmRVShwo+WmZz9SmBTviI5Sd72HWBaxgT3jGypJmOGkI1 G6kgCM9YhtZXqlYbMzcXbovLAT/sLtyEilQUbKRn219dfgXUw3XmlqGAQYHieQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 --- Comment #6 from clear.screen@orange.fr --- Really sorry to have done wrong description (made a mess / confusion with z= fs) I think i've done a copy of 1 or 2 files from zfs data disk on another prev= ious test, but the problem occured (now i remember) when i did the rsync from /e= tc (so on first disk which is UFS2) Thank you for your understanding ! And again please accept my apologies. Regards. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Sep 7 23:24:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MNJHs6kxzz4bQBR for ; Wed, 7 Sep 2022 23:24:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MNJHs5bdqz3fnw for ; Wed, 7 Sep 2022 23:24:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MNJHs4flwzhF5 for ; Wed, 7 Sep 2022 23:24:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 287NOfuS098385 for ; Wed, 7 Sep 2022 23:24:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 287NOfbn098384 for fs@FreeBSD.org; Wed, 7 Sep 2022 23:24:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Wed, 07 Sep 2022 23:24:40 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662593081; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=q07EKOSnOyIXv+YPP/dx8c00NcPcwu9ms9s18yjcva8=; b=t/vP+eKKKA9AyK6A4zsQwaKaI0fWp51KXU9pUHbpbm9b1/8gM7ctFJw41xuFTJVbUEEgim KkW4qm1QPV9byQkP/7ti3J8iU4c/GzeRrXC55Jx9SzkuKViZI9+HVAhE/eLF/7+wXl2wdO h3Qz6knjqBwywA8wbktIQupLkgdwaGwPywGYZ1Iy02mUT62zXf5+FlKE7htVcGxCDjPOf/ bFQxF3DnCOzlPhStRQ+sQT9RxXyRqIYRO83SHhIoRmINh0RGquvr8lYWZDnT9eLNG+TZHD 615nzmewyBHaQAtAzsr8hfhNCbt0WaJy8Lo0NzAponmczbbCIe0tqBVH3pFyhA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662593081; a=rsa-sha256; cv=none; b=tZX7TxvP1b6NDPRQUStz7s2aTyIP7PZxmmRAVAHuTuIMPELKqj67QPcD0LHUKePSd2NNU7 sLV89h4fLRlJAJ9tW2Nm510JLfWyTYM/jTsCDKt814yDC6c07BoMsQSHUR54+tnPME5lQe o0QWAs+xw/MZ7uKkeE4csDQaeoQ4NwCSb0hOIuQLkhsM1IPHxoT795TWIstAcE8xBKz3mL uWB6yIiVPoQs88pQAlES17rApb/G9I0uGfTN83m0/vHxKybKCsOH/K6yRzt4o66qhS2gBr UxylmECwyfN0AsOsjql55yHsGZOYmNW6L0YoVn7FWsqd0oXKV4iiFewR9hDcdA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #25 from crb --- I have since acquired a replacement power supply. The SSD seems to have be= en stable for the last 2 days. Power levels in the BIOS seem to be better (the 3.3v no longer shows red in the bios). I'm going to award points to Warner= .=20 I'm quite amazed because the rest of the system seemed quite stable but it looks like he was right. Thank you Warner! I think this ticket can be closed. Thanks all, Christopher --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Sep 7 23:25:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MNJJL3pb3z4bQHn for ; Wed, 7 Sep 2022 23:25:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MNJJK59gTz3g66 for ; Wed, 7 Sep 2022 23:25:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MNJJK4FKbzhGN for ; Wed, 7 Sep 2022 23:25:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 287NP5oK098667 for ; Wed, 7 Sep 2022 23:25:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 287NP5GT098666 for fs@FreeBSD.org; Wed, 7 Sep 2022 23:25:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Wed, 07 Sep 2022 23:25:05 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662593105; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Y8FZR64iqVDQHELCFfqokRKs0QCcDCTy74M3Yi7t7i8=; b=dIXlMRh+jsVWuljrJHJxLskZs7q50tNXzQ7QBinZSVZiq/xnVs+AwXLFbiHo9sNkra2EYM nCno8DRckBypgBt4d4W4dxO0v6qW27kd98uFYgMRH6f31S6acCasjL6tT+ZB+DI964yZG+ dK1K/TJ/ZXfy/HPJieu8hFLLCRRcKdMB0vK4fjgeqVjUATpLk+gbnNj/06S56W6oqDCjJJ Y5eJoiBefe0irWMUU76GFI6CZXgPzAr6ZX7XWbGcclmLMrE26BKLbHaqe4xAOtuBciviPo zbBw4exmjdIIGVhX9+itdYZdefKVstz3+GoIzfKxRUJ0Vfea5fexF+Xb0/fR0A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662593105; a=rsa-sha256; cv=none; b=m53Qmyaw8vcqMqylZe4mrxbCyv0a9Rxwl7TxCd1H/u80AkSOD8W3eSpi4FQBJSKNL6iyFM EDTcH10YN6Y/NHec4rg2/5h7FfLj+taqoQt4vYt9jvgBjms7B2K+EV5Bh3vDbvM4wE/4sd vKhTVqC1YJPATG+926EPfi5L54D5PVlvzvxqP/jBRZmjm3NAUWcCKgGMNWwLrC4EMYQZ52 UxxmE7zsTDAsMbYXbpw5kK2W3Bjl00Su63ucp6aa/KRXvm177AQAXZUvjX3afGpWOKllyN 86419CVes5XDVd25PpAsJNE2IAwldQgcnlX1mOA2wIgW6nAsBLfNGvFnJwS2IQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 crb changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |FIXED --- Comment #26 from crb --- Looks like it was a bad power supply. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Sep 8 12:51:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MNfBx26dVz4c2pZ for ; Thu, 8 Sep 2022 12:51:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MNfBx14vYz3C8w for ; Thu, 8 Sep 2022 12:51:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MNfBx090lzstn for ; Thu, 8 Sep 2022 12:51:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 288CpaQe047219 for ; Thu, 8 Sep 2022 12:51:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 288CpaiY047218 for fs@FreeBSD.org; Thu, 8 Sep 2022 12:51:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254058] zfs doesn't set mnt_time aka RootOnZFS doesn't work without RTC Date: Thu, 08 Sep 2022 12:51:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ronald-lists@klop.ws X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662641497; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UINlhSYOtP1h8xQ6DCVD2MZ7ecPj1A9rTzuaZQ9rxh4=; b=KVt1byumHn7L4UHsKUST5ZmU0wvTE3n8aqaF/whZgdMbUjiFGtvrcfvtjswyu+FtMGs3pK SPkZbXUmrqvRLWi++HUMjH8maXcv2iaCl/eWdF+1pKn0gN5dVnVZSKzrfx4DlsJ/yYLbqb K69+jDAnfH9n30R1bagEKj3qdK0aMDtRuYJpAhmaLv+5ClrFzN4+vdB+6ABGind1FYFmIE 2GneYRS0QfYmziUvYwSET2G6NDoE8kWob18s9cv/KyMjW9wNrV8kYGdvVbRn/Q4ZaJalyZ sRYNFccLYpHJx1FPTulqNi4vwr1F2siFtRN+MxD/+QufacbbcxUIwaAAW0Iyfg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662641497; a=rsa-sha256; cv=none; b=NS9mskvF0FyJjsBNYyTr4Tf3IXJAx6JVOe24RR/93nTUR1+B1Kq1xvh7/ydR1GLK/zS3IA WJBzUlaEoRmh6tixil9qSe7TUmKFnAggRCzFICJAhJCEjZHiMJ6yD4KuUu2qMhUDdlNcPq l9W7DqqsW6WBluCK2CzblgTP+cM5OQ/he4zjh1edrqgaGJjxfu45ZVrA/fCYaSb+/KPIaX tFELnAfs+0jwPxg7T3HP7OLrrxGrONfBAi5aeUv0A0HuoLZ6aUWewo6chwQnEkIGZXO/8O +zo+FnY+vq89+lu9/XacpzryJ0bEg8HyhMOEZqQwOa53X2g8/q7DNCrpZDPcIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254058 Ronald Klop changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ronald-lists@klop.ws --- Comment #1 from Ronald Klop --- Created a workaround for this issue on my RootOnZfs RPI4. https://www.freshports.org/sysutils/fakertc Putting myself in the cc of this PR. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Sep 9 02:10:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MNzwF5gKYz4cKwv for ; Fri, 9 Sep 2022 02:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MNzwF3T66z48Bb for ; Fri, 9 Sep 2022 02:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MNzwF1MZlz145L for ; Fri, 9 Sep 2022 02:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2892A5CS094049 for ; Fri, 9 Sep 2022 02:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2892A5iM094048 for fs@FreeBSD.org; Fri, 9 Sep 2022 02:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Fri, 09 Sep 2022 02:10:04 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ish@amail.plala.or.jp X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662689405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GKowIZBdCQuAhG84hTkFwLhlyVcGGsBv1NFfoRfPCGs=; b=M7VeTWfjWOhLfpKLufHGJr41HhHwo/xYadSjYP89EaWSoOj+r8diMPmLiEeWPp0ronBU/Q /OoLT/2pLYFyJVqAMPs3EmaHALzbf8yZo5SkGp2Evhbwc++r6lydVI+v0SdfboMO54qEds +bl6dinhprE+N1uQNJ338Yu/ryatxrGolOadC7/BQbLuL+4who5pq6ItrOdIJgbNxyR6uM +Udh6Lhma+nTBfcoVQBz+dWuqozHiqerQDTbcoNRHN1rraNqG7iCjc4iMdt0ylElh8SVGa tPdev7UlHUZRumS0/ZLPeyj4uiUW01ZCO5wD/z1gzzB7FNkWgL8cjw6dVBW/8A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662689405; a=rsa-sha256; cv=none; b=sdl56qQkiTD8yB17PS+EmXr4nyejc1Zk4o/Y4ms2ZQG418voK/PUrYTsIrXGT2SHzvFtmT kHydVRP1vuY121ZacY5pln5EPcPLC7zqOYFtQgo123LbtNCgT8kl3793DkkxCQHm1gQaQr QmIliHnkCcceM7nms5TgxJKt+Z7PdlZrTwwYSk/1VGF7XaFNgw9goUo5uIycMpnCxEoDAR in1KjWWvkAHw1Y/69NaDsUDGIx3RRqboAginu2MjGe2lmWyuZVzKaswdosLQlchr9bQSsA N73PW7W5zWeE5ZDmo1q898XNv8rmQ1z1ycEK/Znt3pFyR1G835KMQpO61CufgA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #27 from Masachika ISHIZUKA --- (In reply to crb from comment #25) I'm using two HP proliant N54L and ADATA XPG SX6000 Lite M.2 2280 PCIe Gen3= x4 SSD 256GB (with 64MB host memory buffer). These ssd are hmpre=3Dhmmin=3D16384(64MB). The same thing are occuring about two month in= tervals. Both machine are used ssd for zfs ZIL/L2ARC on FreeBSD 13.1R. I installed t= hese SSDs on 13.0R and they never happend more than 6 months. I don't think hp proliant server has poor power supply and I think you cann= ot judge with 2 days. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 9 02:35:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MP0Td6r0kz4cNGl for ; Fri, 9 Sep 2022 02:35:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MP0Td4tnDz4B85 for ; Fri, 9 Sep 2022 02:35:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MP0Td3TzJz14Tb for ; Fri, 9 Sep 2022 02:35:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2892ZXa6031416 for ; Fri, 9 Sep 2022 02:35:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2892ZXYo031415 for fs@FreeBSD.org; Fri, 9 Sep 2022 02:35:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Fri, 09 Sep 2022 02:35:33 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ish@amail.plala.or.jp X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662690933; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FqhzmaE1GF8ZWi0ttaChfWNi8WeoIdA27mNAVzmWL2A=; b=XxocXhtfzwFD10hwoW+bE0EtDkbVYQOoZJqqKXe6QEm2EyH9+aca5k9ycwKQmFKL9PGFd+ JQV0MEyIBzu/umtfjUGbPSQXeWLMLe7lAhGew8zGkjq4c6cHorIrc5/lebI20dlrdnbRib vZGN7XgPCD9GI7neb8tCEI1jtDCAJ4mVkVoVLkwZ/zrKBMEC3vi2cXmaGyQzuHs2QMX8Tz a6d8CZfr3jVd0Q35djc4MFu4fvzbZFm67Jk9QhuuOcLeYiENOLUdeYsscAJet8ofIVazfD qdjtihNI9AUXcG7bupcAqqYBbq64YrBSsIJsnB9/qB8LCZ9yJNJdQ/dyqTFyxg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662690933; a=rsa-sha256; cv=none; b=h+RqnvDaJOJK1Op4PTXcbOeLBY3kpVTlxx5aW/bZp9MyvAVyqNN9vO9HE1kKazgUL6qAfu k2aTRJAbb3jBMH8/DXbLN8xcN4tr9Li5zsqqq1ekQhsZ3lhQetIk1oaDrYnSqMsRIHXoC6 n0H6NNsjIn+MADjGlfOuev3KJ3siEeRk5G5/gcffBKiBIeBsVZS5YCIJDLUoHuGyvlkpsE +XSUxZ6hzyXJ11qfQvIZJKQTJXVUevGsNrFIWr9qH/FPBG9yTGCFeG3uzCyASPEzRXiVSF RNZ01JHVp7URQkbrTL4dwYKiPFf8Es9ZRMHY3ql5HZZriU+TdAgU1kE/HnF9ag== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #28 from Masachika ISHIZUKA --- (In reply to Masachika ISHIZUKA from comment #27) > I installed these SSDs on 13.0R and they never happend more than 6 months. Sorry, I was delusional. I installed these SSDs on 12.2Rp1 and they never happend more than 18 month= s on 12.2RpX and 13.0RpX. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Sep 9 23:31:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MPXM00fSCz4bfCW for ; Fri, 9 Sep 2022 23:31:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MPXLz6k2sz3gbB for ; Fri, 9 Sep 2022 23:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MPXLz3gNgz1M6Q for ; Fri, 9 Sep 2022 23:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 289NVdq9048819 for ; Fri, 9 Sep 2022 23:31:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 289NVdta048818 for fs@FreeBSD.org; Fri, 9 Sep 2022 23:31:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252700] page fault in zfsctl_snapdir_lookup Date: Fri, 09 Sep 2022 23:31:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662766299; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VD4dCkmXRzhCtuQGu9AUBlmbfylmYw3rZupRSFU3eVY=; b=byzuv/8lIQdELSvOTUKhMn3wBCwc3gTQxWYWrMrBihzN7e7hlFPtaRaEH+E3A5Lm8nb1Gl Ya+CGb8PuyD7icdyHaSpyoHjWpp+TQdzsl0r4Q+i1Zwx6cMrTyy1DjbYxL0U1hU9GFA1CE ZrWdlM5UVow+kRJ4KH4Z60WSEN1JMuz1dAjrWEDoarG7+OgXTPFVRln1D8ldoT2Lvqo31X L5eBeNhYulGLDA/aLyimJe9LGdGve7EEjXEulQ9q4bURlNCXk5TzmPeomy/S+hDGNLaFJa 9FKsxH974zQWK9EUosfGSPkchSjE+PfPqIbnUPeavvHghUmvstzK/A48JqpY9Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662766299; a=rsa-sha256; cv=none; b=X3924MeJWmBZAm8tCbSYq8ekG2tNL0xHRHVuWrykhCfMUdtcT33m3XMZmlbZ0X3HOvaklA YKi+Sxsk/Op/87sNktZY9OC6G9d8haLwDkrp1YBK0D9+vRKJj96MUS+KwFFMSl1Hujcq71 PWc1/5zpdcLdKsy2sTW1Hpyxl6IrlxTiyLirgsjypMoUYy4LPFTVhV3bIVv0f6KWXpr55C AejGNtYnx5lkmuBoAJctSvWHnkiFLBPA7wayET9HXFktsGXzYQxKAWY5LxLKHm6qrBEVi3 Ei8dASsVRr7CS+R4NNK2dMKKe1RrLbzpxrB3pT3r/2KZv9+Esg6xqSNWweQBmQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252700 Allan Jude changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |allanjude@FreeBSD.org --- Comment #3 from Allan Jude --- (In reply to bugs.freebsd from comment #2) Do you know what you were doing to the .zfs/snasphot directory to cause this crash? I think I have a fix, but i've not been able to reproduce the error to vali= date the fix. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Sep 10 18:43:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MQ1vY72nWz4bgrZ for ; Sat, 10 Sep 2022 18:43:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MQ1vY1HnRz3g2t for ; Sat, 10 Sep 2022 18:43:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MQ1vY0L1qzP34 for ; Sat, 10 Sep 2022 18:43:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28AIh4gO028192 for ; Sat, 10 Sep 2022 18:43:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28AIh4fF028191 for fs@FreeBSD.org; Sat, 10 Sep 2022 18:43:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266309] fusefs doesn't support -o auto_unmount Date: Sat, 10 Sep 2022 18:43:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662835385; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2yzZFgtHsh14eOYbjxbxv9dPothLlPAQKOnn2qmltnY=; b=NL1MFEA/JocQ57dNGToz4aaSEEwhqScaml3dJVhbgtNMDm0CBjTW3Ng0yy1YsDuTHRpuIq JjmVhSxNUCLtYtbvCDbatDksAjW0EsEYnahW4rlc7GM3LrOfLv5phaQRKNYj/MrpXrbQug Hy49gttUVVLy4b4ReyKTCApw+gNsL7SYSOcuBYi26ng1eIjpxWt5joTnv/kxnNTonjcUeC VCbK39YgXhnHThB1sg9JAgCDdyIEsbnLmYrIh0rTLWWzcobWzxo6/e1CxzA1H72rAAw71I tcmT2m1Xxf1QYuWJxj3CIr95S642VHKlSAKDOG9QiBjJ12bIOr3Pn/vJh8p8OA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662835385; a=rsa-sha256; cv=none; b=gl5kLZledJPTMqrcaJxk+0WhdrRgiC91hy5ESMS9B5E3MDKTmKy3zV9iVHdhaXV1gFsCWu umZZ7E0yBX2dHqlvDbOVZjhiNdggateR7pWGTSIuBvLztuB030dXtPD7RhHEhkYohMuEBM 7lTQyKYVUax0AvIl0tNDpqVpkFFm3VNl4fhJpLzXmfXx7iomVagPyECWJtKXPfuzuvsvf1 LhEw+VaBwkpNu0rP74Y1vrUDueNzjyij6QhmtmVMSFPcYWEE7jMyCyFRTrEuDfLRn8Wcu4 PkRSwNxKW4HCrGEGh5GNiLmdQeV9seDhZbwF6LhbgtzkyLvX68W+fPHV3kvK7A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266309 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Sep 10 18:43:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MQ1w05JG7z4bgyd for ; Sat, 10 Sep 2022 18:43:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MQ1w036tPz3glr for ; Sat, 10 Sep 2022 18:43:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MQ1w02Cv0zP36 for ; Sat, 10 Sep 2022 18:43:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28AIhSi5028305 for ; Sat, 10 Sep 2022 18:43:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28AIhSQZ028304 for fs@FreeBSD.org; Sat, 10 Sep 2022 18:43:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Sat, 10 Sep 2022 18:43:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662835408; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fc+hPBfIf7mVGVVD0gMG0nYMdovJnkr559KAimAX4yU=; b=I2azvg11K2Ita7O/qVAu8HL5B42dQn0yHFiPqiSa5TERYS+Xxmf4AJEDXhmzA0W+UDAHA4 GoSxYPnsk28Sjh24i1u9iJ8QUT6ZXsc5xt7oes15otOkVYKReVDaPduu8CSlWW9LE/AHKh anz+84Y2b3OuiLrAhbfRyh/el6YX1C3GZal9fTzqWFXlHR0+7ns00E2zIjCqA26wm6V0mx 7640tPnvmkkwolvlSRpJDvzPWPw1BvTk0/N2GIXU+D74BpAe3ZeqC+XIWYw6Oo/VwThzUn L5VG3Uu+Kbhgi0OILrI42b8Bvi4FtA7Jaf3Q/UU+TesLTcZDz917q3iop+QxYA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662835408; a=rsa-sha256; cv=none; b=LiPuqOWcaJl3aF+mq4xi999Pk13VV2mHYj9BQ3c1GW0FgJb5yx12BQ2B0MIhhYPKJI5I1m ME/CeVvDzBYXrhQ7DRurUFZ5OBfGWzsgLFSzkfYLbv0veOuJqQEV+/vWG6LtTrheHRU6G2 jvi3JY6txcgkCp2rhaTk197V6+48j51cjNfAkgd56RI6docrHnO04CMiAnMUyjALr9wQdn eEc8kIOuocixJXUl97ce5jp2Uvh/lrkcU21JZQy1V7YJmTEWT6fBAlrYLNv5A8ODBFXJHO IyTt0foqrO2SdYIjxxM4+l3wFqcbospIWgfjZsPz3Ss8Zsna9jqa7HG6WdVc5w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Sep 10 20:05:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MQ3kZ2FlSz4bssq for ; Sat, 10 Sep 2022 20:05:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MQ3kZ1CnHz3qDD for ; Sat, 10 Sep 2022 20:05:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MQ3kZ0GPQzPv6 for ; Sat, 10 Sep 2022 20:05:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28AK5PSH040576 for ; Sat, 10 Sep 2022 20:05:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28AK5PU6040575 for fs@FreeBSD.org; Sat, 10 Sep 2022 20:05:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266309] fusefs doesn't support -o auto_unmount Date: Sat, 10 Sep 2022 20:05:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662840326; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gdajlQUuLq6f/B2YpaKAQcthewtU+onEsBSR6CH3m2w=; b=gkx0Zg8To4M3bhWSHxB+h24zIHUi+hWER5YUg+kWDbCSIe/JUBv/7OyKtI5VkwG5pZN+v+ Vw218vHopYSaUfalK7N5VfmZOxyGn1eVBJ3oTAS/kXMY31La71GH5V29MILWu1E333DOiJ zkL2HK9fctAhalyWdUgkliXbWa5Hk/Fuhtpf3zE4j3bpQzvJC/iqTzohx+XmChhlv+TQzp tGjeBG7e0dsmhZWJiVz7Fooa/uq63Ml2UVsnCfidOPkVv5bTnO6Nq6mpbFlkn1jVzTE7AP ONEkx6HOdlFccHVzUWWWb+8xisr+Omm4PxbpoVIonqlFkTAtZJDMdi33IzboKw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662840326; a=rsa-sha256; cv=none; b=jFDyt5SWnkhoW1NRggTwDm1Rg9e/6ur7Cz6h4OgrgeAmkZTbc3GGGfj+EUmC20lzWws7k5 /OXIJXbmpvlfVqnn+qFe/NTu3I9+ZHmx87OWrZWYx9ss+dJwIbSGlAYSOX9jt0nw3L1k8c 0VwNj1/fmraPDUPCBryUwb9VzKChzRWx/no9K6Ts/sJJ6FadvLdnmG4KnE22e8p4b4i7Gp 4eMxKA17SBFU8qY2SI1f/5ooy06qc8qvwLJcim9tmxoJrL4j8gT7CcRGAQdOlxoORh0UqL V2xCUsyQK++MCPvclubwljzGjtk9j8g+/0l+cJblVW4x+x7ZrEe8GT2Fo0KbSA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266309 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |asomers@FreeBSD.org --- Comment #1 from Alan Somers --- Not sure. I've never looked into that. But it doesn't sound too hard. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Sep 11 21:00:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MQhw41n2dz4cgQ1 for ; Sun, 11 Sep 2022 21:00:52 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MQhw35h9Wz3XG3 for ; Sun, 11 Sep 2022 21:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MQhw34nrzzmHm for ; Sun, 11 Sep 2022 21:00:51 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28BL0ph8010916 for ; Sun, 11 Sep 2022 21:00:51 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28BL0poi010914 for fs@FreeBSD.org; Sun, 11 Sep 2022 21:00:51 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202209112100.28BL0poi010914@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 11 Sep 2022 21:00:51 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16629300512.D32a35.7189" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1662930051; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=1NZSlXEKlvcjXQJTUkUfDdj+VSyNjawjO+N9hNKq1MA=; b=OVIboQL5d+z29/iXuS5j/FBYc56RSwUJGvbjhzwNkuoS91l7vWsYHFsSP5cloEvL99CIiM Y7Gu3AT9NCFZVmRR9Gu5mjCi2afc58UWzQ+dKrAL4ZN1vYCrDcKiFkIdaa2vwLP2K44AwB Ps1CQbzjTeLbq23KLiFmnJtxNmZElTNLrO8CjT7sqtw1wS1T61SvyblIJ01WJTs0HJKeBC 8xkXMK+0cllxAXwYlmLUdRk1/0VRWTwkXrU+jOjcnriv5fIvZLz+McksufKevmM8Xz+odN BCSNwYlicdhGwq4wB9ngPdkPz4Z2BD9yaIwh6rQG+lGqI4hk2ABSHoczE9NbCA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1662930051; a=rsa-sha256; cv=none; b=INOR0Ip3TtWKPgJR0nDYjpc2XJW0sY9s7y3KZgnucoVO+ZxmyiocQWUoikPiCVJIF+Ad01 /YXz/qieRkYqiM3hlR2P7cySZYgYvtji30/ESyFINE+4Mqm5cJOsnZi857UCRBBgPAXVSm QYXn3yNTr5kEihBfgUqqMB+C6816BDtAUpH4KPAjI9mQ/wQ13dDGN2E+OkCkN+Ed5ne9Yn PRT0Q7NFzh9GeB3xxnlfZ2bcGp1coE7T4CbSwevHBL2P6iZwYOJ/0lU4k1o9b4MLTbStAQ X4Vg0lp0sbulyjGozGouHycSW22/qHL48khhUr0hUOzpQouG6nMPRPxMgFw1QQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16629300512.D32a35.7189 Date: Sun, 11 Sep 2022 21:00:51 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16629300512.D32a35.7189 Date: Sun, 11 Sep 2022 21:00:51 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16629300512.D32a35.7189-- From nobody Mon Sep 12 09:19:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MR1JX1f8Wz4byVy for ; Mon, 12 Sep 2022 09:19:40 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MR1JW1ZPMz3YKm for ; Mon, 12 Sep 2022 09:19:39 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 65db2322 for ; Mon, 12 Sep 2022 09:19:31 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 20aa143c (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO) for ; Mon, 12 Sep 2022 09:19:31 +0000 (UTC) Date: Mon, 12 Sep 2022 11:19:15 +0200 From: Michael Gmelin To: freebsd-fs@freebsd.org Subject: ls on ZFS showing unexpected directory content Message-ID: <20220912111915.12a90106.grembo@freebsd.org> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4MR1JW1ZPMz3YKm X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 213.239.217.29 is neither permitted nor denied by domain of grembo@freebsd.org) smtp.mailfrom=grembo@freebsd.org X-Spamd-Result: default: False [-2.10 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grembo]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all:c]; TO_DOM_EQ_FROM_DOM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi, Situation: - shell is bash - Root container mounted on zroot - extra container mounted on /extracontainer, on USB drive which spins down on idle - cd /extracontainer - cd subdir (takes a while, as drive has to spin up - getting bored, hitting CTRL-C) - prompt still shows /extracontainer, but `ls` now shows content of /extracontainer/subdir - cd .. && cd extracontainer - Now `ls` shows content of /extracontainer Expected behavior? Thanks Michael -- Michael Gmelin From nobody Mon Sep 12 09:23:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MR1Pf2QMfz4c05P for ; Mon, 12 Sep 2022 09:24:06 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: from mail-il1-x12a.google.com (mail-il1-x12a.google.com [IPv6:2607:f8b0:4864:20::12a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MR1Pd4kCwz3ZbC; Mon, 12 Sep 2022 09:24:05 +0000 (UTC) (envelope-from michaelsprivate@gmail.com) Received: by mail-il1-x12a.google.com with SMTP id y15so4215760ilq.4; Mon, 12 Sep 2022 02:24:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=6i0TI1bXxHrw6xubBTyoDV9G6NQPRUWa55wXuXsSaH4=; b=QAXxm2tCNFsNyQ5IKYcP2pDgXTdxXb//CiavVX6TWA/qxIlovEbEGvRCxy7B694hy0 R9zcXRVIfvq23TlonfjBFmqVUemAL02poQ706NlYsJvmmRmdlBaEsvwzmi+DzBgt4qPc cfomDOOv08k3VOrD487aMXuiKOdg+FyTHpOcuffb3kLeYSJie6aToN9GSvImycE/jvm7 PzgJua9c/TuI39ivIHDS8VbKN1H02X7P/webSCylFTcrTJOoQvh91MQ70XEB5qi9bGWc BmsAC75F/IvDl96iZ3nO7/XxhgJ6qYgKvnmfd62xAn3ii4sOAUrHKvP/iQG+HPmCuh1u 0Xtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=6i0TI1bXxHrw6xubBTyoDV9G6NQPRUWa55wXuXsSaH4=; b=sgqxF92yBE+Qaf+kcWhg59Zxm91qRs6ZdxKZb8cRiYMqeNYdoOko6uLQgNQmFsf6KJ QJsbSb1T4ZnZrJpbGA/Uteq4aeRQ5rcRW2kCz2TGpDLS7cMLiKgj0wopbnIZd8T9izns 39flHk7+oOP+QKGF33+cbHjLXUMhePmK9cQsNgNXKX0GSRqcCzs+FL0iTysQBydELiJ+ 2IuUC/VTZVAkVTaCiRfh3BzJs0MlgSQip1JSMfxcGZiZ93pxXdUQHyIGrQI5D5WfHsEu BSRMxWWCZHavE5kXN6rL8Fsk1QHsd/bQvKoGmla1IYJAB5T8mnYcAI6GrjWwiY3s2ObF i15w== X-Gm-Message-State: ACgBeo06wSzSrnpF3Hz4VTjcgveRQjVJt9bn2dmGbMRkAmuDjKlVUNSh WZibvbRdlZbGTEQr8aNB6LYa62Vz3kpndIp1pfDs57Yp7bOxAA== X-Google-Smtp-Source: AA6agR6v9VS2pK4ERgza9QCFN2rQ0qlt9vnt6r8pq6g0KpxqL9xSjiOmzR4jBLH+W+G1H4Y9vIeBeWgae90SSHQfEKw= X-Received: by 2002:a92:da10:0:b0:2ea:e432:99cf with SMTP id z16-20020a92da10000000b002eae43299cfmr10125005ilm.99.1662974644386; Mon, 12 Sep 2022 02:24:04 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <20220912111915.12a90106.grembo@freebsd.org> In-Reply-To: <20220912111915.12a90106.grembo@freebsd.org> From: Michael Schuster Date: Mon, 12 Sep 2022 11:23:53 +0200 Message-ID: Subject: Re: ls on ZFS showing unexpected directory content To: Michael Gmelin Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MR1Pd4kCwz3ZbC X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=QAXxm2tC; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of michaelsprivate@gmail.com designates 2607:f8b0:4864:20::12a as permitted sender) smtp.mailfrom=michaelsprivate@gmail.com X-Spamd-Result: default: False [-3.91 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.993]; NEURAL_HAM_MEDIUM(-0.92)[-0.917]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::12a:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On Mon, Sep 12, 2022 at 11:19 AM Michael Gmelin wrote: > > Hi, > > Situation: > - shell is bash > - Root container mounted on zroot > - extra container mounted on /extracontainer, on USB drive which spins > down on idle > - cd /extracontainer > - cd subdir (takes a while, as drive has to spin up - getting bored, > hitting CTRL-C) > - prompt still shows /extracontainer, but `ls` now shows content of > /extracontainer/subdir > - cd .. && cd extracontainer > - Now `ls` shows content of /extracontainer > > Expected behavior? on the face of it, this looks as if the shell's prompt wasn't being updated. What do '/bin/pwd' and builtin 'pwd' print? For completeness: which version of FreeBSD? regards Michael > > Thanks > Michael > > -- > Michael Gmelin > -- Michael Schuster http://recursiveramblings.wordpress.com/ recursion, n: see 'recursion' From nobody Tue Sep 13 07:46:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MRbCR7094z4cnR6 for ; Tue, 13 Sep 2022 07:47:15 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MRbCQ5py2z3TVT; Tue, 13 Sep 2022 07:47:14 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: by mail.evolve.de (OpenSMTPD) with ESMTP id c2413207; Tue, 13 Sep 2022 07:47:12 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 18db0cb9 (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO); Tue, 13 Sep 2022 07:47:12 +0000 (UTC) Date: Tue, 13 Sep 2022 09:46:54 +0200 From: Michael Gmelin To: Michael Schuster Cc: Michael Gmelin , freebsd-fs@freebsd.org Subject: Re: ls on ZFS showing unexpected directory content Message-ID: <20220913094654.274a3a95.grembo@freebsd.org> In-Reply-To: References: <20220912111915.12a90106.grembo@freebsd.org> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4MRbCQ5py2z3TVT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 213.239.217.29 is neither permitted nor denied by domain of grembo@freebsd.org) smtp.mailfrom=grembo@freebsd.org X-Spamd-Result: default: False [-2.08 / 15.00]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.98)[-0.976]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all:c]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; FREEFALL_USER(0.00)[grembo]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[freebsd.org]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Mon, 12 Sep 2022 11:23:53 +0200 Michael Schuster wrote: > On Mon, Sep 12, 2022 at 11:19 AM Michael Gmelin > wrote: > > > > Hi, > > > > Situation: > > - shell is bash > > - Root container mounted on zroot > > - extra container mounted on /extracontainer, on USB drive which > > spins down on idle > > - cd /extracontainer > > - cd subdir (takes a while, as drive has to spin up - getting bored, > > hitting CTRL-C) > > - prompt still shows /extracontainer, but `ls` now shows content of > > /extracontainer/subdir > > - cd .. && cd extracontainer > > - Now `ls` shows content of /extracontainer > > > > Expected behavior? > > on the face of it, this looks as if the shell's prompt wasn't being > updated. What do '/bin/pwd' and builtin 'pwd' print? My thoughts as well. It's easily reproducible, in-built `pwd` and `/bin/pwd` both show the correct path, the PWD environment variable shows the wrong path (and, consequently, OLDPWD as well as the command prompt). > > For completeness: which version of FreeBSD? 13.1-STABLE last updated September 2nd. Cheers > > regards > Michael > > > > > Thanks > > Michael > > > > -- > > Michael Gmelin > > > > -- Michael Gmelin From nobody Tue Sep 13 17:08:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MRqg00Q4Gz4btTZ for ; Tue, 13 Sep 2022 17:08:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MRqfz46pLz3KkH for ; Tue, 13 Sep 2022 17:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MRqfz2zF9zP7v for ; Tue, 13 Sep 2022 17:08:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28DH8RSu040873 for ; Tue, 13 Sep 2022 17:08:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28DH8RBQ040872 for fs@FreeBSD.org; Tue, 13 Sep 2022 17:08:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265951] ext2fs: kernel panic when trivial rsync operation from UFS2 (system disk) to ext3 partitions (data disk) Date: Tue, 13 Sep 2022 17:08:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: clear.screen@orange.fr X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663088907; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=b1YUQ1zxU/ypUINr8Fl9nNMykaFwr3aEI1lZ3IXqo5g=; b=GqLWPY+XV3jsikKR9f7ADgrNY2R9bo7VVu/QGNDd+WZPLNTg+cIZRSLCt4Koey/VhtcWNJ X1MjiAFwkJMAcBf1MCpA+toGd7tDR+RlYHky5AfDuewFURodO0+m7+rRTiByeUBl9ruDQ4 BVIwE0u890XD9vgBJjjuVjZnN5qpHBCYzMBmJjD842Xeu4hISHJpTkpdFs63al1gudWokI Dl/FjAKmvAgUvB28JSvr/T6ihNsuUqLWwQI+Zgzr09DJtgZsd/rhcQfImv76+ovREYUy40 HVKGXc0IjxkLlEhctE6epw9PDGn7X3m84vfGNCCQ015leUnf/1/JP1ZpwBho1w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663088907; a=rsa-sha256; cv=none; b=kUrJNSAEtJRb5Bw3JmZ8677A8LI8x//vMKoCuOBSruXrvt74c87F5WOQork8xJpTBc/4vk 7GGcS95stlnR5EYwrGlyVJS1cCP38yjd+wEkPQ3Tr4Zwa8+BvcW14sxJ4/lJ3imEkn+Dxq x3Do68++XOsHGDHPnxeI5fQET6XIQG7WzVFq1bMdadeEIkgYouzV43b4Ywnr5nX3l4uMfN VkW6OtMDosU37XC1brern4PHSMy9jYJSiGlzRtjJGbC8zc2G+jXuncElFFrO0kv2LAXZRP 4YeFdzNwjC4zFlZEBg6A568JSm56P+ggaN/Y7pARRV/DxdYOfPnmwghtNkzhOQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265951 --- Comment #7 from clear.screen@orange.fr --- greetings, i've tried to upgrade to 13.1 so uname won't report correct string as it was shown on the bug, but i've found some older log if it can help Kernel version: FreeBSD 13.0-RELEASE-p11 #0: Tue Apr 5 18:54:35 UTC 2022 Regards. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Sep 15 00:26:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MSdKv73Wsz4cbht for ; Thu, 15 Sep 2022 00:26:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MSdKv62Nkz3xvr for ; Thu, 15 Sep 2022 00:26:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MSdKv51mFzqvR for ; Thu, 15 Sep 2022 00:26:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28F0QRf3021820 for ; Thu, 15 Sep 2022 00:26:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28F0QRK7021819 for fs@FreeBSD.org; Thu, 15 Sep 2022 00:26:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Thu, 15 Sep 2022 00:26:27 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: assigned_to keywords bug_status cc short_desc flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663201587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MhM/EMSf7karf23/yR8sxbOZjRLbvMQgHzyCM77bg28=; b=nEM/UOjZhTVUcOLQ8D8iPVJQN49kfNuq7nscG7dbXX/K6yDgwkrpOBPtLal0/UpOCPWLtc lfvpCXmCt7RWyFfACH4dS9R95JHDyw7uMAGmKFDVV65cYZUGsJ8nYxi1ViBTHLMgzSPaNQ jmcDLkf801+I1WKhnYeBakeZmsm3rQtavuUZ4A1hocvZbToaUwlVYg1gvVBrg8PSHnGNIo AQrk3hz8RTI9qxoqSc4c2LIGsSxHYrHpyugB/mIy/znZTX6+LDtvNYtUxuBNNAUH8QpjuR OigodzdUzXA6L4Uml3ggccrKkvtvETXbQIFsLlMdNWzFN2l9OSjxfZQuoem8Dw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663201587; a=rsa-sha256; cv=none; b=MifZIv1DjEo9QiAiq+9GQLJLGthQ9xqwCSdpHKNmh5CQERhOCWkUWx+C7ld5eoCJy76Yo9 mG9IiBrXOSRPk5mQubNM4DgMsINFr3BxDqqcC11wfulLzQq1RwnEsz9aGX+qBx6V+Kmkna JRRuz32r0P5gKRLcQR3YwDd+dXcdmms/oN5zruM/81UiFe7zF+hm03n0t1TCunilZ4Zq2p 7HQ9EHSmmhkyjo37iK5kB7TJV+67K3xxyq4o1qwt3cIB1MlsYLtqzxFc9Fyq9ak5U3bN56 2sGCyjd+3UTX5fddhHH41H782AzJgzduS9etrfKwfmQn0EqGNHhSGpXeKta/Aw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |crash, needs-qa Status|New |Open CC| |allanjude@FreeBSD.org, | |fs@FreeBSD.org, | |mva@FreeBSD.org Summary|13.1-RELEASE amd64 repeated |13.1-RELEASE amd64 crashes |kernel panic |in: sa_handle_destroy at | |zfs/sa.c:1368 > | |zfs_znode_dmu_fini at | |zfs/zfs_znode.c:390 Flags| |maintainer-feedback?(mva@Fr | |eeBSD.org), | |maintainer-feedback?(allanj | |ude@FreeBSD.org), | |mfc-stable13?, | |mfc-stable12? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Sep 15 00:27:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MSdMR0Brqz4cc1n for ; Thu, 15 Sep 2022 00:27:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MSdMQ6Bj8z3yqQ for ; Thu, 15 Sep 2022 00:27:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MSdMQ5CrqzqsM for ; Thu, 15 Sep 2022 00:27:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28F0Rkik022250 for ; Thu, 15 Sep 2022 00:27:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28F0RkCV022249 for fs@FreeBSD.org; Thu, 15 Sep 2022 00:27:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Thu, 15 Sep 2022 00:27:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663201666; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=USiIy7AfRCfVs5vImMsiaKGo7jPANANs+U/Hk6xhqA8=; b=jbB94dX8KT7Ht7sWB16Fkf0WecP2I+AqnyR+lScYWY+fAoShzgSAIy5mYPYeoVwUUYWtbt 3PvoHMO3ItWF+MOLvMb+JxDOUTr7x0T0EsaVjYF4lKeBtYQj63g2IX2u5rt902KKDYpIFy IKEYKCG3xTPn/ZkmT1PnNqJIwGUikWtMxCWo/pkD+1e6mAYJtmTRetc0PVoacMro8tpjsS /Bz2sZ3ioBEjV7M/PjO5MPMe4AT26GD5HflmPfV415+eFAwfIOViQre3qfnXJFNk587rqj 27aJbCAECN+Br4wl9qAG0tmaprYNzQKKNQpAvC/5UeDHMayAv4IOQWg1MGLFxA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663201666; a=rsa-sha256; cv=none; b=oZT54opww8dj99R+xSOKfUzUCDem9QL23hRx7ePohm2c6t24uvaeG9ayCsWzEMLH61QxEl 9KPWKrSsOtg4jVbBJXzeFeK1M7Nj7BNE2Jww9Oike+q6ca70tI6IX9z+TQugXTJFd/imIc xiq7iGTN+9R0oDXDvK3jh8cPin7zrdeG8/sUzbtyhbgk+60Pp4z0YCigcdIYFzsygZTPCM VmTS2D7kLMBrViP/b54FZ9oRjdWDaTIOelQPrpYT/Zr2ci9hGk45LJXqkl9vUSuMOLjYqK EvLoUL5THewOnCp66bMTLEp8fml//D1khL7nhvRgTuI/U5ea4iY0H15YiS4+ug== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #2 from Kubilay Kocak --- @Reporter Could you please include: - /var/run/dmesg.boot output (as an attachment) - zfs list output (as an attachment) - /etc/rc.conf contents (as an attachment) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Thu Sep 15 03:22:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MSjDb0h4rz4blcx for ; Thu, 15 Sep 2022 03:22:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MSjDZ60PHz4DdH for ; Thu, 15 Sep 2022 03:22:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MSjDZ5092zt7p for ; Thu, 15 Sep 2022 03:22:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28F3M63f040549 for ; Thu, 15 Sep 2022 03:22:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28F3M6AF040548 for fs@FreeBSD.org; Thu, 15 Sep 2022 03:22:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266374] FreeBSD 13.1:With ZFS installer reports sysctl: unknown oid 'vfs.zfs.min_auto_ashift' Date: Thu, 15 Sep 2022 03:22:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663212126; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lsLRdHCJxKO5TzX+OGo6HzKP+T/nI2x+CpTBTPRg6nk=; b=QvKDRlTwrOsUej/X0hnhURoUC7sZKKZKO6PBJ9qsDthxQZRp1lRILmhu9xaLmTgJLgDGh+ Le2jTEjPGnVxASVOvB8tB7RqzOHFvAWixp7aZqUFoZe7+xN2QoFiZ1f95gELpiKRyK7kzC EgPuHhLfuw1+DaX5Tu+I40OTJcugTxl7IGeX2zeoWiD0oJmJDOVmjhOOy8f15VP8rszEqt 6tVCb/ECruOivGofKcMR4c4z1GrGqbAzHMac+8ZY9qYSTN7fqqp9gOg4cFsohnAMxAtOZF qka3cYEiLnqP1QOrfQeQRuRX1mCpEBBDPuBTEaKYSTL3gmI6pei5+rJt+A1mig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663212126; a=rsa-sha256; cv=none; b=eLbAQmgALXT81ZmFXOmgZhwHrwRKnpBVtv/9FSgdV81DhXMgXygrqnlQlB2WwXeHC5Upq3 9QetOKONa5iENUH9CrmzKdcqwk3FaqPgI/BnVGiVBLgPzSwT8WWG7BMExmfkcOLzyZjO6d uawaUNHB3tG5AEFidQfFst+lVcDwoN2nkY9oHz1gCg/q6rxmuESCIWfIcmsSj6HB6Fc9th F6RUpl+hd8rWFjHozOQnaD+8Xs4D7qo+Sflo5M8mZKoF5dLtPY8BoE8gmn2YhbhpO3N2ON o6UXmyMnts3ZwYMidA2F6Njwen7YPEYOPeo5W81RQWLbn2+YQNTDKknTGVGxUQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266374 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Sep 15 14:26:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MSzzM6vjRz4cPlx for ; Thu, 15 Sep 2022 14:26:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MSzzM5MVGz45GG for ; Thu, 15 Sep 2022 14:26:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MSzzM4CCDz135N for ; Thu, 15 Sep 2022 14:26:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28FEQdl3049636 for ; Thu, 15 Sep 2022 14:26:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28FEQdel049635 for fs@FreeBSD.org; Thu, 15 Sep 2022 14:26:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Thu, 15 Sep 2022 14:26:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: edavidjanousek@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663251999; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=C+Vn4eA36PmBM2l50jSZ5ta39E1Uj4NZO1n8Vc/A6yA=; b=HSRubN35ZsMxjhJ+mQrbf3sYK/hyo7bxZOlxZRAleNxu5Y3ytQKu3DRnJBXLNU4BuN1Hqa 8Irkoi+AxSCyHA25mWdwYvB0/ypo1e2CQGT18m6TCyOIYRukrcZ3tLtvACdNLw/uKuvePX hI7mr3QE6XpEyEdQzWX8C7RI1sHKYj0FxCUoJSIb6ncv+BTZ07AYamhREEcRH46PyZwwg4 m/nbe7rYUn3ES/yVyMnrfqlWWy9AD70y3tbLu2dgS8IZsMWgdkJbs9xUxL8YueVGtIuqg1 taxbgiKXt9YdxVCjLbJHLND5CwgJojF2g78+vmt7DEBwZgy3X/8ZUk9Xr/5New== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663251999; a=rsa-sha256; cv=none; b=D3vifMBrzTCqQs9YOLX+N1xujpL0/aLBHNT6KkPASY6r1/FvWcsazBGLE/jkdhBc7gA7Ha XNQqdFhtwS4vnxlnGa9xI3PqvQtR4z0DrFxtu0q1Ez1AD5HM4kyj5wbrEQIwdMlcW2QPIt UAE0y6/yIFK6bqgQymgkbYY8jYdihIPbsyGgQnJSon3qxpan8sKFatY8vrlXswuOKySd++ 98ov506eeT4gaEUwhdlanyIm+WvWXbePKJrsx560TSlsCLk98WOtJlKMtY3A//FBW28stY FIGRMH3SlhT2XYNA7bxP5cZ2P3nc5nY23rrzEMlgBwoJxgy2WcnL0TyBYA6PmA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 edavidjanousek@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |edavidjanousek@gmail.com --- Comment #2 from edavidjanousek@gmail.com --- This is very annoying bug. When installing TrueNAS-13.0-U1 on VMWARE ESXI 7= .0U2 you will encounter it twice. 1. On installation (you want be able to select disks). You need to tweak the .iso. My recommendation is to use hex editor, find a text '# Boot loader fi= le for TrueNAS.' and replace it with 'kern.maxphys=3D"131072"' (fill the rest = with spaces). 2. On adding disks to pool (you won't be able to format them). This time it= 's easier, just go to /boot/loader.conf and add 'kern.maxphys=3D"131072"' and restart. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Sep 15 16:27:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MT2fR24nRz4ckHs for ; Thu, 15 Sep 2022 16:27:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MT2fR14pGz3QhB for ; Thu, 15 Sep 2022 16:27:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MT2fR01h7z14NZ for ; Thu, 15 Sep 2022 16:27:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28FGRAu8098564 for ; Thu, 15 Sep 2022 16:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28FGRA3N098563 for fs@FreeBSD.org; Thu, 15 Sep 2022 16:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266374] FreeBSD 13.1:With ZFS installer reports sysctl: unknown oid 'vfs.zfs.min_auto_ashift' Date: Thu, 15 Sep 2022 16:27:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663259231; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5qa9uATlUfD7mgJih5YxgTPmIrT/nV3qMM7PU3U2OZ4=; b=lbfHou/g4FIwl+s3MidRqccuYbBcaXDmxS0qpcQ2003+dthtiRmDs8xP6i5FGqqjaZs8Pc LCuDvg/4lmgOoX7aRY7vgCF2Hzxn1rG9ChF5KgvXaakxN4WvnGDrFcU5gsSAAgJlE0oEBI yvREy3GY0MSJ/LudMuJJtRw2t/5RiPzJHi871egKC3jkgJ2VRA76aoHdRxDa4HEwUPuUoP fw7+grHy2JQSmDi5XPQi8xSd2OwhMZ4/g4RFrgldaPCD6PG1+HneW7NV8hwVYQCAkAFonk sBO2/8tpMzhMp2IBWBJlrszoKV85FZszxM1IoPZu0sOc4efHKzsK2DvMLAP/zQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663259231; a=rsa-sha256; cv=none; b=iMvAMLojYTtcPTgojz3mFszy6k8189fLLsw7ZfLZFfFik7ILaS2EpTLnJnJ/WH3X2r62YA Rl3HgDlSX/pW8yurr9PeNnb+btSLvLzcnS6biBNSvyyH+kfo2aXLPdKf1IAeBt6egn+p2m 2p5j140+Ex66PETvz+UvA/sx2zHoedZwIjuNHeerNpmaRMl10cB7tX3oJn66WJnEaZLNdc ycrDlhmxmouhTd/Ce6SS7k7ryXsBnBnkbbYd0CahYaoLTesNdSphb5kF+nqS40aAmar5yE jg583bK8IGIY0Rz+Pz8yvOEVd9pSEvUeWqyixqU4SoUD+iLsQlLeAFnh512otA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266374 --- Comment #3 from Graham Perrin --- Created attachment 236571 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236571&action= =3Dedit Screenshot: not reproducible Installed using:=20 FreeBSD-13.1-RELEASE-amd64-disc1.iso --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Sep 16 09:02:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTSqq3c6lz4c4tf for ; Fri, 16 Sep 2022 09:06:47 +0000 (UTC) (envelope-from lecocq@ipgp.fr) Received: from belenos.ipgp.fr (belenos.ipgp.fr [194.254.225.6]) by mx1.freebsd.org (Postfix) with ESMTP id 4MTSqp0Cm1z3xKK for ; Fri, 16 Sep 2022 09:06:46 +0000 (UTC) (envelope-from lecocq@ipgp.fr) Received: from localhost (localhost [127.0.0.1]) by belenos.ipgp.fr (Postfix) with ESMTP id B7119196097 for ; Fri, 16 Sep 2022 11:06:44 +0200 (CEST) Received: from belenos.ipgp.fr ([127.0.0.1]) by localhost (belenos.ipgp.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QKJaD5AZnIWo for ; Fri, 16 Sep 2022 11:06:44 +0200 (CEST) Received: from mailhost.ipgp.fr (teupa.ipgp.fr [10.0.21.99]) by belenos.ipgp.fr (Postfix) with ESMTPS id 78C8B196088 for ; Fri, 16 Sep 2022 11:06:44 +0200 (CEST) Received: from pasdepanix.ipgp.fr (pasdepanix.ipgp.fr [10.0.11.2]) by mailhost.ipgp.fr (8.13.1/jtpda-5.4) with ESMTP id 28G96iea050566 for ; Fri, 16 Sep 2022 11:06:44 +0200 (CEST) Received: by pasdepanix.ipgp.fr (Postfix, from userid 112) id 0B40C7A055; Fri, 16 Sep 2022 11:06:44 +0200 (CEST) Received: from wund.lan (ccvisit42.in2p3.fr [134.158.32.172]) by pasdepanix.ipgp.fr (Postfix) with ESMTPSA id C41427A053; Fri, 16 Sep 2022 11:06:43 +0200 (CEST) Received: by wund.lan (Postfix, from userid 1000) id 50CB97EE; Fri, 16 Sep 2022 11:06:43 +0200 (CEST) References: User-agent: mu4e 1.6.10; emacs 27.1 From: Michel Le Cocq To: freebsd-fs@FreeBSD.org Subject: Fwd: FreeBSD 13.1 : ZFS NFS : .zfs/snapshot : Stale file handle : with zfs destroy snapshot process in Uninterruptible sleep Date: Fri, 16 Sep 2022 11:02:40 +0200 Message-ID: <87pmfvadss.fsf@ipgp.fr> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain X-Rspamd-Queue-Id: 4MTSqp0Cm1z3xKK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of lecocq@ipgp.fr designates 194.254.225.6 as permitted sender) smtp.mailfrom=lecocq@ipgp.fr X-Spamd-Result: default: False [-3.18 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; R_SPF_ALLOW(-0.20)[+ip4:194.254.225.6:c]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:2200, ipnet:194.254.0.0/16, country:FR]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[ipgp.fr]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_SEVEN(0.00)[8]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi push here this following bug, which si specific FS. in short, since FreeBSD 13.1 a ZFS exported FS over NFS will hang if a NFS client tried to acces to a snapshot. see bellow my post to freebsd-bug. -- M Michel Le Cocq writes: > Hi, since upgrading to 13.1-RELEASE of FreeBSD I can't anymore access to > .zfs/snapshot folder over NFS. > > When I tried to acces do .zfs/snapshot over NFS I obtain a 'Stale file > handle'. > > Worse : Then if you tried to delete the snapshot that was accessed, you > 'zfs destroy snapshot' process will fall in 'Uninterruptible sleep' > (usually IO). So you can't kill it ! > > I post this bug here : > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=266236 > > A little small procedure to reproduce this bug. > > Install a fresh FreeBSD server under 13.1-p2 > > root@server:~# freebsd-version > 13.1-RELEASE-p2 > > Inside a zfs pool create a vol and share it by NFS. > > root@server:~# zfs get name,mountpoint,sharenfs tank/zfsnfstest > NAME PROPERTY VALUE SOURCE > tank/zfsnfstest name tank/zfsnfstest - > tank/zfsnfstest mountpoint /tank/zfsnfstest local > tank/zfsnfstest sharenfs on local > > Mount localy your sharenfs vol. > > root@server:~# mount -t nfs 127.0.0.1:/tank/zfsnfstest /mnt > > Create a snapshot. > > root@server:~# zfs snapshot tank/zfsnfstest@1 > > Check you can access localy. > > root@server:~# ls -l /tank/zfsnfstest/.zfs/snapshot/1/ > total 0 > root@server:~# > > Try to acces from mounted NFS vol. > > root@server:~# ls -l /mnt/.zfs/snapshot/1/ > total 0 > ls: /mnt/.zfs/snapshot/1/: Stale NFS file handle > > Here we see we don't have access from NFS. > > Try to remove your previous created snapshot. > > root@server:~# zfs destroy tank/zfsnfstest@1 > > This process didn't end... > > root@server:~ # ps aux > USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND > [...] > root 58027 0.0 0.0 18012 7256 1 D+ 12:27 0:00.01 zfs destroy > tank/zfsnfstest@1 > > D mean : Uninterruptible sleep (usually IO). So you can't kill it ! > > root@server:~ # kill 58027 > root@server:~ # ps aux | grep 58027 > root 58027 0.0 0.0 18012 7256 1 D+ 12:27 0:00.01 zfs destroy > tank/zfsnfstest@1 > root@server:~ # kill -1 58027 > root@server:~ # ps aux | grep 58027 > root 58027 0.0 0.0 18012 7256 1 D+ 12:27 0:00.01 zfs destroy > tank/zfsnfstest@1 > root@server:~ # kill -9 58027 > root@server:~ # ps aux | grep 58027 > root 58027 0.0 0.0 18012 7256 1 D+ 12:27 0:00.01 zfs destroy > tank/zfsnfstest@1 > root@server:~ # > > Thanks. From nobody Fri Sep 16 20:26:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTlw45dm7z4d75j for ; Fri, 16 Sep 2022 20:26:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTlw43p6rz3QLx for ; Fri, 16 Sep 2022 20:26:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTlw42N1FzT1Z for ; Fri, 16 Sep 2022 20:26:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKQSYO053991 for ; Fri, 16 Sep 2022 20:26:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKQSNf053990 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:26:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:26:28 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663359988; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WdWYoDNxnQcC6+peT022b7muyqSjxqrvllnwIfIflrQ=; b=rgVJNLYRi6eBW2OckistfNk35fXg2t0rglDymd7teQ/89GTNbE16SL7hQqeN8ztb+H9iqr zatyTMvgAdBD2KIrpAjaXDQJUtTeh9f/1wboz/qUV+mkyZRVM/cZJMrmGdpiBrWfwCLmtp u8mvmrDOgyVbJtWBhz+jkmHVsaaYUtmX88DL3vXJx0uE+AThxd2CU/cbmkRvWvuesQOlYm EmvrxxGoUUemOU+hAaTiMrLpTU9tRMP6+7RblVmU+jUMrj3dmx3UIfUSrQ297SCB+GWuyi SmaC02IBNJTW1uGAhLNyyoh/O8olXAH9kZVKAui7SCyjINsXYzC9vM59Gbgokw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663359988; a=rsa-sha256; cv=none; b=l9GasW2cok49mAfhu7ZSRyK32OTaSSmTN4Huip9Yn7LgJcQEpbaufNh8HFIh6bumCRoMAF WOUGOxeUNDfUwXZXVclMClLGolhemxN6pltpi9pXU0GBWWN0XONjc8vW7hwBX7h0IOev7m 3wawN8JmIkHICMak5C6LRjKOEgIbDO7TaleNHQuJt8ZHDubjiuyEP60tAw8jXdudp/C4IJ 3VSNc2k7bncL27sFhrB8sgn6Z009A5SvQn67Xj66ZOLpKJ3ExVzmGzIcAIT/e3xAa9ta7b E0dKEnIQWlOGmnNEk2gxL+Ubgf/sSC3/KQdnS/cKeIL537dFLhFPioSh9Cjlwg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #3 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236599 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236599&action= =3Dedit dmesg.boot --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 20:27:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTlwt4FH2z4d703 for ; Fri, 16 Sep 2022 20:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTlwt3Ch1z3Rqc for ; Fri, 16 Sep 2022 20:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTlwt1lhVzTHH for ; Fri, 16 Sep 2022 20:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKRAHl054348 for ; Fri, 16 Sep 2022 20:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKRAPP054347 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:27:10 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360030; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xTjHwzQNSloLuW8ZQnSUGWh3fhqCv9qeceQii1JjhaI=; b=GliesRnts3xRlVDJk8ndTApFcOyn+KoEAAWTYdjM//+mO8whPbK4Wu+jC85sAmD8pf+YH8 IP+IDsvQSOjNKU+g/l2Yycfv+SVDbDHl0xRyNBbeUsVAwwoekSFlAaYXek0A1Pg8fln3cH ErECILXcCFeLeURpSBbV5cmZeozxYY5U6YcdY+2zzz3elc8oUT9niow4ReVt+ykUhF4GX3 1N8Se3acxw+04jAwoIrui2nSKQn+2/iHY0gG9SoEvwxmmmzIWykOgiZDgrdjRJDZa9seP8 7tAhr4xE0NX+9cmKE3AfPWQKCOrZjPu2/S3gSaeVOFhiJOODU++sB5AXY+8gzQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360030; a=rsa-sha256; cv=none; b=LDAU3bNKvMkcM0OB6e66ZJOHrOlVUkgrktuutpAhHzGdIPKE1dIrVWbM3wDPocZXt+wdQ1 lcITEtpyuGR4C5+Z0vM93lqdQSfLe0kEyU1CvukUQ1O1C4r6MU61II85FNXlX6LAftlrmB 9BCPdwZsLvQ6I6Xx9mgiWrKDohbxLLsuyPOC4kkDvTzGrFAQsvTjFeGBmMcWom71tXh9XE CYenUmofkT1WohI3/6tM/lMXifkc8hP10zh6rh5ATcVzcuBXPmosxRMvI5DUXIP3e4544w 0WpbfXDHh3beWrWN8KIeI/mGDQ/GBSleLb0saRUHTtrPahCBWBU5eBR9A1FVxg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #4 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236600 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236600&action= =3Dedit gpart show -l --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Sep 16 20:27:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTlxP17BWz4d76G for ; Fri, 16 Sep 2022 20:27:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTlxP027Fz3SMZ for ; Fri, 16 Sep 2022 20:27:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTlxN6CzzzT8v for ; Fri, 16 Sep 2022 20:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKRa2e054532 for ; Fri, 16 Sep 2022 20:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKRaie054531 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:27:36 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360057; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kF1y+w7oLCpOnSwupMf0BCAj7o+3MkZp5bBuJvNF8vg=; b=oQC2GaBT7aexBhfyKLikC/2QHif/bDpmBOLOqg0QTHCj65nW1CBvnVRIROLuKVCb9lCpO2 eHITYNDDQiCLeLdlVUmEzfEO422re/1bMEONJ/N1ZbP5CU1ncvL9uEyd20RD7aO4eQFVPx 3vC1TX+5tZh5T9u4lQOaU96C3hnSv0hOtQw1GHdnEfVjHVnx+1wgUSg22hHkh/ZkYpmYzY ZNfh5FnRV5KsnzWX2AhXpdIKnU/xw9jzXbv/hM4Kc8SXdbulLYUyUWTRhHBYNa6dE4H54g 0tVO7TsnLRz1fOocSwe3dbDpTaZBnGkXqJ/tEtSgkInD30ZPq8UmZcvtQ7PrxQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360057; a=rsa-sha256; cv=none; b=WTr1WHJdGc0JQh4mK/8O5tWLqc5DJK5Sw7CVPiOrbJVawSWTb3bORBmOuzvZELTF7Czgsw +Rsk+aO/9zGeuZRuOmMGmFo+Pw1ffvUdpXkSreIqqvQkBduTljGS5U0cCDwiEf3a6AbAfr i08OXH+o+58/TUrAzFyvAzulEUb1lBttq/wj6czeS9E+bo84EwRXndW3kb21I7XnUhSDxW xbaIAAB1z/ow2RZmqMOhq7FaTNrpBIu18CJ39qEpRuBMSfDQ1oLdmja829q9RJgCzWZws0 MfctZBPkczJwaPLCRgcd508nDnOiGalkZLGJUnazerDxFMEJ/tzKfGpI+4G1CA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #5 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236601 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236601&action= =3Dedit gpart show --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Sep 16 20:28:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTlxr2XQSz4d78d for ; Fri, 16 Sep 2022 20:28:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTlxr0yVqz3StT for ; Fri, 16 Sep 2022 20:28:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTlxq6nLZzT1d for ; Fri, 16 Sep 2022 20:27:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKRx7c054647 for ; Fri, 16 Sep 2022 20:27:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKRxbp054646 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:27:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:28:00 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360080; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4RbEumH7QJHafQEvIuD8aMx0ICsw1Kc9ClPYZt00TkM=; b=RYHD9SBcuaUb8EXYz4+H/RM9XM6gziQNHlAZj6uhzSvr9+/2vfqUByeUEtv0Pc7GIVqOK0 V+RyZ02lWiJyoHqIM6ciIgfrhSimyTCn2cED8ylZmmy1irkD470dkfmc1QOA7VxhZIvDOP 699CNWm+u7Lb907QeSQs5wDQZjDC9F8kbLELHbVyauHl0bRBVmp+sw8LsbpcNbD2HjBXNe StYjw16sovTW2bZggJGi3xdmdS2nOtSGoHRqbq7OVQtdFbTJG3WiCYVEy0ONQYlbGYCoSa p6D1iVxX+pnzSYEMgyIFmTioKnCjDYIfwCwXvJxWRHwqrdgA+7zU91aBIZRuEg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360080; a=rsa-sha256; cv=none; b=ZQGLq5zDiL1/S6S7i5+tuPQ5UI8SCra1S1taGJMU8MuSm0ViYZewh95M/k72EpdgjEDySW XG0Xx5K8EjjVRFIVoXReBuqWF5r00QQZ9VJGYHh1v7CJ1GMFQbtQV8aB5+6iYVVGGhmTfv E6FeMsv/pPeCbj5FNoBbUiqOydrl52bMWHqZ6S2KOy49CGAnTQCP4FL22xEfLadQkOWBOo OygLFgKEA/N9hedEmJgoLGF4vmShkYIB5ygoERqWOHdkL09ZlLbuU+33DgFzuvsYW4yNFj zZBovHDrmZmWYEAcHvO57NPizfRviQhzYv9TDpgcj+vG46eEvu5HAvEV93YKmQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #6 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236602 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236602&action= =3Dedit zpool list -v --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Sep 16 20:28:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTlyV2hcZz4btPS for ; Fri, 16 Sep 2022 20:28:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTlyV0lj6z3TDt for ; Fri, 16 Sep 2022 20:28:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTlyT6yHkzT6K for ; Fri, 16 Sep 2022 20:28:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKSXO9054940 for ; Fri, 16 Sep 2022 20:28:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKSXqB054939 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:28:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:28:34 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360114; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EgzNDDIXucEJGdvuJ9IJovdI3AhvPPRaIuORXHPaA8U=; b=Fo4/igG9CykWq4b5kgag/Z0WhROZTXc6B3i/3Swqkh5vLX2JsrbFzpeS4kOPhre+6RVlUB RKg2qJ7MD5e/GGcLnuIvFntSZhV6w3OyJKcO1PnfzivMtJibreStZksjaVXJbuBzZO9izB kOsoO4zoOSxKsBTTTAJbhBFbH7gnuioD7ntz+YFOyzCisYflGw66AuQ++v0dvumPwCugAl KqiNGCqr3CYj3FbPyETBUprY5E20iZSeio66cGA600Y4g1nqCly8X1bSqF7NWx1uk62PRW IlziXAOMw+dzxDVDzashUUIpmbUwDvJtxlL8k6AU+0kXeBbsUxRVWxC07bnPaw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360114; a=rsa-sha256; cv=none; b=VXz9IFU/cg5sLcnLtwUGzgZn63qyYJuX5iQQ3PFGpBvhx6I4Wzfas8Nu98PZgm96GXt/yQ vXhxggOr2uBKP9o0g4/filuGB8UU3L8NcUYF8HZpGvmGyLQzHpqIqeZ2DLZW+4TMOo5Tb+ YJ3xkNgKFR4LrthsZUG28hKUggNQdu5VS46eSZV+sEDAxc06wG+IJctbwM0N+LMqAYm+dw prZYc0tEAMiKqj/zmgFxsNEfqyFWtfEyHcC50BjxVLKvLMZttGPnh7cYL7rdNfwbwd2cuP btt+pNYwWCWYHHz6VAcJgSJjQ1FQQbyH5pDc6vPuXNqhwAn8fAypK33+c1MFjw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #7 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236603 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236603&action= =3Dedit zfs list --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 20:31:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTm1P5WyQz4bv0n for ; Fri, 16 Sep 2022 20:31:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTm1P3qzFz3Tpy for ; Fri, 16 Sep 2022 20:31:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTm1P2tfRzT4d for ; Fri, 16 Sep 2022 20:31:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKV5xs058528 for ; Fri, 16 Sep 2022 20:31:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKV5EG058527 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:31:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:31:05 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360265; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JBf0Xpefi/DuKrsT5oQO/BPffq2m5UGM9kOK6rNmk2c=; b=wd6uUzEWHdy3ggeT9AY261jf1+g8KQD2Qos9nVXVEnwpJqWYTCs3APXXN57NO58F1Roa4e 38uoj5RXQdK6b4GQOGPtQFuRPKaYVtwYxVQWwPfQ1WHvWS8CobSiLTs53NBAInf4umALjL Sjs5J4YITOV9PLpeQsqnfKUHyRCW6p8nSORb80LNAW12/fItK7aAdC7b6x0RpkYXpty63e Lu7XyVYz+Yk5NioJOxbjxomo43PZSF0Yoasdx5VQHRBr5ZZwLAHCF8Gyy9Siaa4c8P1+FR NjGLqmga606SGhsbqTtNKBZgmfU7+5jCXMIdNm8nXTLqQLqQSYM7pBvjPIv5uw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360265; a=rsa-sha256; cv=none; b=w21W3w1mBAWErqjEld4lglIvpAhgwSoOL9g1DYNk5VpOVtZfCUyJ3yIbuBzw0GNK9bvutd 5ihXbEBTm08bqp0kOkPkdM9J41dXbhkMR6rmUIe6SPAZWOU4bpee1zS9eILcZITxsGmacX FE9b6DtL2UlnqUT18mNpgRT8MXqmyE76Gdw+VGT86c792sLbvK8MqdAVbrs1L7zGTdh+9V epzm6dpC41HASJ8y/6+Q2dsbodq7AdMsIEckhybd+vq0wWO+1IhAqQQT9kWO2OaABvfm3h adwE6LlxawYU6lDbx6jjWeK0Y06rlTTpvTD3pzX0bJIfFUqRezeIa1yFkXxs5Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #8 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236604 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236604&action= =3Dedit rc.conf rc.conf is a mess. This machine started in the era of PC-BSD (FreeBSD 10) a= nd then was upgraded many times to the current version 13.1 with many automatically added knobs. I will clean it after this issue is fixed. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 20:31:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTm1t486bz4bv62 for ; Fri, 16 Sep 2022 20:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTm1t2P5Hz3V9x for ; Fri, 16 Sep 2022 20:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTm1t1TXzzT22 for ; Fri, 16 Sep 2022 20:31:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKVUtj059206 for ; Fri, 16 Sep 2022 20:31:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKVUS2059205 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:31:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:31:30 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360290; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JOtW5H4tuC432G9qUqlh0P5EOFOUrOxRoNUcjrooyJ0=; b=PSYBYF3O5Vq2DcxbKcvkN/oZXnRUTW6e+0uK6xQ+A5JT7xj8j3RCpBb4LZvOLg1N30QYTM P94O4kFWNsuofHUv89xzahvnvvCkrMNfDvTe2daofVU2EiwCh6clM8VgGo/ntjsUVP1g+c jlMe02La3FLnhS58ls+foo9bxFPWib4ejbYpvn6tz/R0pTXASBfG4VFDo9ivdywMLu1uUI uT0s9LMFYyhVJF+5cwLiVRgaIpbPXNubC7guow7BWkXCy1WxaTgc6bAEtsP3w8w60U+Iyh Fji+06s1DXxpUzUkFIcJLtaH9XjkU7CZI5is3Gwcu6ykGF1WZAs0bqcXPGbrgA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360290; a=rsa-sha256; cv=none; b=auFUbqt8aj1upk280bLrUOmBcHYuA265QM6mCb1IXVxuTwdH60SS5CnIcsuWuwkn6bYSO6 dKRpwBXjaZks8XvuRAZfVFWwFfKfLqCL8myyM7DSt2XyNYmY/R5L6a9XsvWjDA9MaRa2Nl jhNYfYlyfbZKg1Zf34T7y8wYmqKAxu+RzgSueDu2KuwfMld2ZEQMiaIm97UnLw5HmUJieG w98LPTpvFN4oRpsccSOyx/ilL2BVb5zyP8kq2XXMU9HGGIUqPTs0SEzFpeTKuYFRTu9oRK woZ4R3f3jmZW9djz1TfH8NVyZaXN+xIeg8eQ17hqel+TfbjDDchHDTsvl9DSUQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #9 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236605 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236605&action= =3Dedit fstab --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 20:31:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTm2J2Rcmz4bv3P for ; Fri, 16 Sep 2022 20:31:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTm2H48W5z3VNZ for ; Fri, 16 Sep 2022 20:31:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTm2H3G0SzTFV for ; Fri, 16 Sep 2022 20:31:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GKVpn8060108 for ; Fri, 16 Sep 2022 20:31:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GKVpKg060107 for fs@FreeBSD.org; Fri, 16 Sep 2022 20:31:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 20:31:51 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663360311; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CpZp61yeC1ly+PaZFVnzlW2KYVxjZdNL6v/iiFCDnes=; b=NJppXEsEA5j4/OnwF5QhYPT+hnxr3jYanbDnSFB6AO/wuCRx04cPrUkdBReutBvp4kFYfE 7v+XhisC7lezm7mDbNshbty7UngO6bf5A4JyabiJgLWOUlvb0Ja6HDWupBpop2/Uc3UJao 1gUOiNfu0dFiKU2QNo04Zt6We5wU0LgWXOg5iMwZUTgKmrRqT3tQ41d3691iKzH2TYflOp PHkeZ3X86ldgrJIuBw8Vfyq/3E10GlMRDfzfkk1t+LMZVgymGgp4bX8yNyTYucaFD01SFw xYA6QksuIicyGEy54JKled8Jbcg1XRTTTQJQ5MmEnAqycpQV3rkue7yv6jQl2w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663360311; a=rsa-sha256; cv=none; b=I0nSy56AnBCWYm4CqDfJLFimA9zkD9ZXO+jqth3JRGcd4ClRUVKZY4T4KKXf+9Zkljy6qX 0SYRw2LELznRc3CrEWourBbnTAqNl0xyg8+oQGum6CY2g3kZr9urm2hFo6BO+VFQmmgQhr 5rdhT/y2F6HvI+oL01nJg/JWLsxvpaUKfxHL55VErxGO/lZ/d6pWR1QGxze7GpyyLGBNsU qGNfXcktZL4rAtPYgAWM893gQtE+L2Q5xKWvHR7/CIYLHkPDDMyYIsXHRWPlixREfqOUU7 nY0hnxqW/nLMI0+WwJl+M2XtL5k9WknW0L9fdP5WwrNgiMBob5OdE63wUBnKPQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #10 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236606 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236606&action= =3Dedit loader.conf --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 21:00:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTmgT2xwHz4c1NJ for ; Fri, 16 Sep 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTmgT1yBJz3ZYw for ; Fri, 16 Sep 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTmgT0xS3zTfZ for ; Fri, 16 Sep 2022 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GL0bJ5089627 for ; Fri, 16 Sep 2022 21:00:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GL0bmi089626 for fs@FreeBSD.org; Fri, 16 Sep 2022 21:00:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 21:00:37 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663362037; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7W0vBdCx8F7xazgAkMm7BbbAmlnGQfdXaCHsY2zyD9o=; b=MC2EJB1gJO/tWvYXM5P2JjxUIP3JmglKCz7jQoC2c83U70Y3LwayTWPTbswz8FMU6r0iUy LarhmaMkfzql9BB2ukapM0keG2h0pC6V+fDZ5GgwxyvzyqrC3F9cJyxybo+JGQlybttp3k zxCuph8JB184/qlOI1V4pFa7H16yEznu90BzsAUFkSY0FOknly5TBw1PSnmnKXrmPaoqp0 Ffwg5zrIg3FwoxLIUfp/cdw5qOXIORm57ItEBtPZv1YXYrcHIVqolOyfDizb4PJ9ob7hCJ sbtsfXhGsyslSNgXDPlWcRI8CBa/vOrxkxtVKy+Y/E56GVJXhhdA7eO6qeP0mA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663362037; a=rsa-sha256; cv=none; b=XX90mmrFE3KU8MMbbUmCcBT3oy7xW6Nh3Ig5FxOUvjBpxbCi9n9vc4kz+4BvuKEX8teHA4 th9N7ksT+pUhkvInCzT1VlXsBuRzJLCfQF4eB9X9k8eH9y14DB7RNoM/u5ZCKh6leRWC+b oMw4ksj5YwztNbnD5QhczrlM1BNa9eLlCVsz2K9Wcb2rndfF3YrEvEd9OghzchErDQff52 qaVKhh5eX0jnhWzPp5PqgXl1JEKRz9Qvc8X5nhrRU6FdOcsGu/fqihiMqKZJzuoE4preR4 2NF/kXFY2Exx7h715OOoKmSecjbtQWQY1dBavetYso2JVleinn9kORU7aoeKxg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #11 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236609 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236609&action= =3Dedit Last 10 back traces / core.txt packed in tar.gz The last 10 back traces from core.txt files saved in /var/crash, including 2 from today. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Sep 16 21:03:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MTml844N5z4c1gX for ; Fri, 16 Sep 2022 21:03:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MTml82NzPz3b7Q for ; Fri, 16 Sep 2022 21:03:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MTml81R8mzTr5 for ; Fri, 16 Sep 2022 21:03:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28GL3mmW001992 for ; Fri, 16 Sep 2022 21:03:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28GL3m8i001991 for fs@FreeBSD.org; Fri, 16 Sep 2022 21:03:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 16 Sep 2022 21:03:48 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663362228; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yKp98DEaJ8gsofWhYyVdWvHSk8j5VgDF3hnMcj4j8Rs=; b=sC4XDbGfkUKpjFZc0Fuy6XUSHo2SRd35oqggGt66qsxh++JNqf4ip8vzMVNql2FufkLfVd WJ1k1tFzgrcMJhgIdeTZE2JkTP5dyGrCy2ogrpAVCedYt73jHQd6cMqJtiq3Eud8gVJ5bT m+8n9tRk0YZTe1F/04JusNggx3ppysWiIIO6N7XjUr+mS/hEFE+dRZVNThuq4cK1dydY+b tPdja3xSkd6OKUdNfnLjo+OjM3IVNM+wNG46gySZe7uhxovCvOgXtHWV+jWGmTPaR/Muou mpR3VWbuG58iG6wwwDxl1c/47YQSvdHG4d6jemxWtp45NL+dC3nECs6TzBIhpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663362228; a=rsa-sha256; cv=none; b=F9XsgpDRcXHbqu8nHZZiCClpfgXgkx2293e1qHJTLSB7yHO2PlTFGKdNkzMQkmvDuvUyY8 0a5pMlu2/+EC9JYt7nvPQ9x0pBHfFA8v3l9ihLZuL6Lb9L5wMZteoI/PdapkkhytF07dDK jxD9jGZJDw70GEbCt9P0v59Y0m9lTlyhEomadDqSZZzwQ0IH7h3aaREf7on/dhwQBTa04n O5yxt6rETxMFSIWNIJnouHRx3eONHuyDK5uuGj4MZBdh/RmMJqQZEXyPx0SfBiLusCDq3A TsEwKNPZT5R0L6+/LFJD/ol0oySQl6CgOeEmSIkPXVp/s5p01MyPwRBJ1+fn0w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #12 from Miroslav Lachman <000.fbsd@quip.cz> --- I am sorry for my late reply. The computer is almost unusable under my main user account. Works fine when in single user mode - I suspected some FS pro= blem so I tried to read all files on all 3 disks (3 ZFS pools) by md5sum - it to= ok almost 20 hours but all files was read without kernel panic. I can work in KDE if I use different user account (tester), but kernel panic occurred when I accessed some files of my main user account (usr1) The machine in question is Dell T20 with built-in diagnostic. I booted in to this diagnostic yesterday, it runs about 2 - 3 hours, all test PASSed. I think the problem is not in a hardware. All requested files are attached.=20 tank0 / ada2: SSD Samsung SSD 860 EVO 1TB RVT04B6Q tank2 / ada1: HDD ST2000VX000-1ES164 CV26 tank1 / ada0: HDD ST1000DM003-1CH162 CC47 Swap is encrypted if it matters # swapinfo -h Device Size Used Avail Capacity /dev/gpt/swap0.eli 5.5G 0B 5.5G 0% Let me know if I should provide some additional information. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Sep 17 17:31:31 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVHzz2B5sz3tkv5 for ; Sat, 17 Sep 2022 17:31:43 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-ot1-x336.google.com (mail-ot1-x336.google.com [IPv6:2607:f8b0:4864:20::336]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVHzy1Gwlz3btC for ; Sat, 17 Sep 2022 17:31:42 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-ot1-x336.google.com with SMTP id h9-20020a9d5549000000b0063727299bb4so17025289oti.9 for ; Sat, 17 Sep 2022 10:31:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date; bh=cgetaj9PFF64ATzjd596R56/s7gkHmtOuVUycC/IGhY=; b=Yie1oX4We7dJHCfJarGzvYBThv5H6QkVYvnfBVgXFIyNyqlTpJdVyGPLfHit7NUis4 6+YME8VdWzqfKVFI6ARfx2b7wNJPPFPWi2Jo1CSpKs1CuOZE3BQ5FUGKs3UI+oXsgHXT dT6fI7QrmI9uzYlWZwg07W3SaeU0g2s4qqV114UWNc54nnTMdH9bdKaLS8AMR2Qm0Olr eDpDOUDJYDg0obMufy/H1TySgf8jESWLvQyGw0x1LlOVhOED8vKKl8PKfyh3ChXTyJJi +jv/KtWAV4TfhQUdIHit7HeqB8IiLZUpxPBStgmort0N8JSxY3KyT87xu+CdbNK/iDHh bFSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date; bh=cgetaj9PFF64ATzjd596R56/s7gkHmtOuVUycC/IGhY=; b=K8RDELO7uEaJfjYB9bvzQnmYW7GUI2TjZz3Lo4+MVrgbQmHsRPtCaAVBLGQ7fJyTzt ing7QT/wpYYA4vsvJFUN+Z3jBNNNljh2fod0gr9+Gy0sPvjnyDUO8MbT15FVeQZJzVHx +R+ek65cu9KXberpyYBEdjTFGFg9CzkbI07/q6fG01CuKVdFUjh+Y9PUP2BhyNfxajEn 2WzrWnn+zzlJmtHEvWpjP9Rq5pm8PMLTOC/+4ehXzpI6IZiuul9YMcX5ktgo0UMdtYiw ZC8gye+LF73OIlvxpFqdizWtnWYKHMdiXBFb6aMJ20I3vpAX0hgjhbh55Y1pF3llAkHT EgSw== X-Gm-Message-State: ACrzQf39sQf8ZFUzM9fuW1vdKJ0v6R/LMEkDUjjnWqdKHORe78BNk+OB 5S2Ctx5pCREdx6rZH1+qXwzqCk3obpgsBvDrCwsR4gRRpQ3fvA== X-Google-Smtp-Source: AMsMyM7gppd0cVvyW3VNVhDhEwSFL+WAa04Q/AOBePrtx+Dn1xNZy0AcOUlSnUjCwVDtcbHNbYUnQ6XW8n9XflqowB8= X-Received: by 2002:a9d:1781:0:b0:639:39ee:9c4c with SMTP id j1-20020a9d1781000000b0063939ee9c4cmr4908536otj.234.1663435900971; Sat, 17 Sep 2022 10:31:40 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: milky india Date: Sat, 17 Sep 2022 21:31:31 +0400 Message-ID: Subject: Need help with live system expansion (zfs+geli) To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="000000000000fbefe605e8e2d9b4" X-Rspamd-Queue-Id: 4MVHzy1Gwlz3btC X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Yie1oX4W; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::336 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.85 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.95)[-0.952]; NEURAL_HAM_LONG(-0.90)[-0.899]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::336:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000fbefe605e8e2d9b4 Content-Type: text/plain; charset="UTF-8" I am writing to you from a live system (zfs+geli) that I am in the middle of resizing to fit the entire disk. Background : The freebsd os (geli encryption) was installed using 290G only on a 500G SSD. The disk was almost getting full - hence the need for more space - can't use backup, hence on a live system. This is the disk : ------------------------------------------------------------- gpart show => 40 976773088 ada0 GPT (466G) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 16777216 2 freebsd-swap (8.0G) 16779264 608362496 3 freebsd-zfs (290G) 625141760 351631368 - free - (168G) ----------------------------------------------------------------- this is the output after resizing : --------------------------------------------------------------- sudo gpart resize -i 3 ada0 Password: ada0p3 resized terminal$ gpart show => 40 976773088 ada0 GPT (466G) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 16777216 2 freebsd-swap (8.0G) 16779264 959993864 3 freebsd-zfs (458G) ------------------------------------------------------------------- I went ahead and did ------------------------------------------------ zpool online -e zroot /dev/ada0p3.eli -------------------------------------------------- However it didn't produce any output, strangely and the output of zpool list also doesn't seem to show that the disk is fully occupied 458G vs 290G - it's the same output as before: ------------------------------------------------------------------------- zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT zroot 290G 270G 19.9G - - 69% 93% 1.00x ONLINE - ----------------------------------------------------------------------------- What do I do next? I'm really stressed and hoping this live system doesn't fail. I did try the freebsd forums and was suggested to ask here. Note 1 : As the handbook suggested for a live system - I have set ------ sysctl kern.geom.debugflags=16 ---------- source : https://docs.freebsd.org/en/books/handbook/disks/ Sorry for bothering you - but really could use some help. --000000000000fbefe605e8e2d9b4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I am writing to you from a live system (zfs+geli) that I a= m in the middle of resizing to fit the entire disk.

Background : The= freebsd os (geli encryption) was installed using 290G only on a 500G SSD. = The disk was almost getting full - hence the need for more space - can'= t use backup, hence on a live system.

This is the disk :
--------= -----------------------------------------------------
gpart show
=3D&= gt; =C2=A0 =C2=A0 =C2=A0 40 =C2=A0976773088 =C2=A0ada0 =C2=A0GPT =C2=A0(466= G)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A040 =C2=A0 =C2=A0 =C2=A0 1024 =C2=A0= =C2=A0 1 =C2=A0freebsd-boot =C2=A0(512K)
=C2=A0 =C2=A0 =C2=A0 =C2=A0106= 4 =C2=A0 =C2=A0 =C2=A0 =C2=A0984 =C2=A0 =C2=A0 =C2=A0 =C2=A0- free - =C2=A0= (492K)
=C2=A0 =C2=A0 =C2=A0 =C2=A02048 =C2=A0 16777216 =C2=A0 =C2=A0 2 = =C2=A0freebsd-swap =C2=A0(8.0G)
=C2=A0 =C2=A016779264 =C2=A0608362496 = =C2=A0 =C2=A0 3 =C2=A0freebsd-zfs =C2=A0(290G)
=C2=A0 625141760 =C2=A035= 1631368 =C2=A0 =C2=A0 =C2=A0 =C2=A0- free - =C2=A0(168G)
---------------= --------------------------------------------------
this is the output af= ter resizing :
---------------------------------------------------------= ------
sudo gpart resize -i 3 ada0
Password:
ada0p3 resized
ter= minal$ gpart show
=3D> =C2=A0 =C2=A0 =C2=A0 40 =C2=A0976773088 =C2=A0= ada0 =C2=A0GPT =C2=A0(466G)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A040 =C2=A0 = =C2=A0 =C2=A0 1024 =C2=A0 =C2=A0 1 =C2=A0freebsd-boot =C2=A0(512K)
=C2= =A0 =C2=A0 =C2=A0 =C2=A01064 =C2=A0 =C2=A0 =C2=A0 =C2=A0984 =C2=A0 =C2=A0 = =C2=A0 =C2=A0- free - =C2=A0(492K)
=C2=A0 =C2=A0 =C2=A0 =C2=A02048 =C2= =A0 16777216 =C2=A0 =C2=A0 2 =C2=A0freebsd-swap =C2=A0(8.0G)
=C2=A0 =C2= =A016779264 =C2=A0959993864 =C2=A0 =C2=A0 3 =C2=A0freebsd-zfs =C2=A0(458G)<= br>-------------------------------------------------------------------
= I went ahead and did=C2=A0
--------------------------------------= ----------
zpool online -e zroot /dev/ada0p3.eli=
------------------------------------= --------------
However it didn't prod= uce any output, strangely and the output of zpool list also doesn't see= m to show that the disk is fully occupied 458G vs 290G - it's the same = output as before:
-----------------------= --------------------------------------------------
zpool l= ist
NAME =C2=A0 =C2=A0SIZE =C2=A0ALLOC =C2=A0 FREE =C2=A0CKPOINT =C2=A0E= XPANDSZ =C2=A0 FRAG =C2=A0 =C2=A0CAP =C2=A0DEDUP =C2=A0 =C2=A0HEALTH =C2=A0= ALTROOT
zroot =C2=A0 290G =C2=A0 270G =C2=A019.9G =C2=A0 =C2=A0 =C2=A0 = =C2=A0- =C2=A0 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 =C2=A069% =C2=A0 =C2=A093% =C2= =A01.00x =C2=A0 =C2=A0ONLINE =C2=A0-
------------------------= -----------------------------------------------------

What do= I do next? I'm really stressed and hoping this live system doesn't= fail.
I did try the freebsd forums and was suggested to ask here.
<= br>Note 1 : As the handbook suggested for a live system - I have set
---= --- sysctl kern.geom.debugflags=3D16 ----------
source :=C2=A0https= ://docs.freebsd.org/en/books/handbook/disks/

Sorry for bothering you - but really could use some help.
--000000000000fbefe605e8e2d9b4-- From nobody Sat Sep 17 17:53:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVJSs09znz3tpSP for ; Sat, 17 Sep 2022 17:53:17 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qt1-f169.google.com (mail-qt1-f169.google.com [209.85.160.169]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVJSq6CMcz3dH6 for ; Sat, 17 Sep 2022 17:53:15 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qt1-f169.google.com with SMTP id s18so15157387qtx.6 for ; Sat, 17 Sep 2022 10:53:15 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=kinmLzjSzpSb39VmoGCBnkKNu2dUD2mVpXPmsL+j02Q=; b=QswdQbQWPvt27frjBKVnn77H/KJ+1xld29ptYwj+FzTsYe/hKlANVKOdaeJIbsEmVP 7luVKH7PBRPDVPXP6l8VdsVpjzAy59ZT2yJrn2YXo1oI3ax7Sq1BnTsJmYpiTe/jLV1d AQm4sHtjUva+YwX9Hp+LKq0Z4fiySG//1uirqlrfr/vPirSC+sNPetV4a8qGHwT3qAjG ELieAK5+AsY7fcFG1w8qVdTfmno5Q4M8tU/B/HchcDlkFHuyhCv0efo+S3MKeV+sgYeb rQSmWxUk0vuOXgilI+Azx2yCgCOUsWEpczKWZpWFTxxXSWM1FzDuc1wfRLHml47pjotS h3fQ== X-Gm-Message-State: ACrzQf0FSksGGx5uYrsH2965jpwzjsgMJAzGW6hSGDIbvjcOJhtxjyOx cYbutTxyub/0SRL/Qt2Ma/iCMQivwF8VjF77FTCZV1BI X-Google-Smtp-Source: AMsMyM6JkIFCmhyPJYVcVaQLO31nFv/AP7A23/gD3EOHo8RNkffJY7Eel4/LhqTl/P84WHfHVYKgazizE9PpdNnYw50= X-Received: by 2002:a05:622a:1114:b0:35b:bb43:a88d with SMTP id e20-20020a05622a111400b0035bbb43a88dmr8917576qty.139.1663437194154; Sat, 17 Sep 2022 10:53:14 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 11:53:03 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVJSq6CMcz3dH6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.160.169 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.07 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.995]; NEURAL_HAM_MEDIUM(-0.98)[-0.980]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RWL_MAILSPIKE_GOOD(-0.10)[209.85.160.169:from]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.169:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 11:31 AM milky india wrote: > > I am writing to you from a live system (zfs+geli) that I am in the middle of resizing to fit the entire disk. > > Background : The freebsd os (geli encryption) was installed using 290G only on a 500G SSD. The disk was almost getting full - hence the need for more space - can't use backup, hence on a live system. > > This is the disk : > ------------------------------------------------------------- > gpart show > => 40 976773088 ada0 GPT (466G) > 40 1024 1 freebsd-boot (512K) > 1064 984 - free - (492K) > 2048 16777216 2 freebsd-swap (8.0G) > 16779264 608362496 3 freebsd-zfs (290G) > 625141760 351631368 - free - (168G) > ----------------------------------------------------------------- > this is the output after resizing : > --------------------------------------------------------------- > sudo gpart resize -i 3 ada0 > Password: > ada0p3 resized > terminal$ gpart show > => 40 976773088 ada0 GPT (466G) > 40 1024 1 freebsd-boot (512K) > 1064 984 - free - (492K) > 2048 16777216 2 freebsd-swap (8.0G) > 16779264 959993864 3 freebsd-zfs (458G) > ------------------------------------------------------------------- > I went ahead and did > ------------------------------------------------ > zpool online -e zroot /dev/ada0p3.eli > -------------------------------------------------- > However it didn't produce any output, strangely and the output of zpool list also doesn't seem to show that the disk is fully occupied 458G vs 290G - it's the same output as before: > ------------------------------------------------------------------------- > zpool list > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > zroot 290G 270G 19.9G - - 69% 93% 1.00x ONLINE - > ----------------------------------------------------------------------------- > > What do I do next? I'm really stressed and hoping this live system doesn't fail. > I did try the freebsd forums and was suggested to ask here. > > Note 1 : As the handbook suggested for a live system - I have set > ------ sysctl kern.geom.debugflags=16 ---------- > source : https://docs.freebsd.org/en/books/handbook/disks/ > > Sorry for bothering you - but really could use some help. After doing "gpart resize" but before doing "zpool online -e", you need to do "geli resize". From nobody Sat Sep 17 18:02:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVJh3390zz4bv5g for ; Sat, 17 Sep 2022 18:02:59 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qk1-f173.google.com (mail-qk1-f173.google.com [209.85.222.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVJh21c5Rz3fTh for ; Sat, 17 Sep 2022 18:02:58 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qk1-f173.google.com with SMTP id h28so18008575qka.0 for ; Sat, 17 Sep 2022 11:02:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=Z+otFQQIu2Xnrh5JH62aEly42jUuJdTnc9+vC5roUD0=; b=11fL9ZJTALIpf1aVpL3tbly8gri1kddAhSVLZpC1OEcKoxUfBuY916/uFfc8Ro2fSm u/RQEMSTytUUq8NQRCbIoGjNosrLuBzMZgwy5gnYpw/JHOynJD6TS4u3glh2VAfuBo0H xSzmw0JqijXutYOlCZ21COq0wJt8yhG6jbJwzyNFbyI/MZOw+ZEo3Cmb0WTYf0iyDjP6 FLEqh/mQTuHcvQjaPUCoHrVV8rO7fBG/+Y2qr/hIrGOaxdQNKx9Jl7Em675xheDfTI9v 927ABsyUtRJtabecVJVl3r9xkSLvSVk1mfvA6VhzIzb4355N1lzjGo/GmXLKardEAg4O YcQQ== X-Gm-Message-State: ACrzQf2lY2YP2CjLxul7QmZgS/WenydefbrLgsrcwehXQsFFX1J4Xo4c 5CESNahYb7AryHfHPoXrN6GiXTRyK0hqri4qzuvvXAqU X-Google-Smtp-Source: AMsMyM66WjqFRkPeHyB6yvv+xMh6SkKPQ2pX55THScoFxnrHAQk0IQVf+vxTJtQ3ck1xJka0UgxnDHDRJKBolUYIlkk= X-Received: by 2002:a05:620a:1914:b0:6ce:5ac8:3b4f with SMTP id bj20-20020a05620a191400b006ce5ac83b4fmr8176122qkb.627.1663437776682; Sat, 17 Sep 2022 11:02:56 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 12:02:45 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVJh21c5Rz3fTh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.222.173 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.98 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.994]; NEURAL_HAM_MEDIUM(-0.98)[-0.982]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.173:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.173:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 11:56 AM milky india wrote: > > Thanks for the reply - I was suggested that "geli resize" wasn't required on the forums : https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581676 .......... was that wrong advice? > > If it was - what do I do now? If it wasn't - why is the zpool list not showing the resized disk but the older values as if nothing happened? > > Thanks > > On Sat, Sep 17, 2022 at 9:53 PM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 11:31 AM milky india wrote: ... >> >> After doing "gpart resize" but before doing "zpool online -e", you >> need to do "geli resize". Just check by doing "geli list". Does it show the old size or the new size? Also, please keep your replies on-list so other readers can see the resolution to your problem. From nobody Sat Sep 17 18:07:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVJn40MvHz4bvc9 for ; Sat, 17 Sep 2022 18:07:20 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oo1-xc29.google.com (mail-oo1-xc29.google.com [IPv6:2607:f8b0:4864:20::c29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVJn30y1bz3fr5; Sat, 17 Sep 2022 18:07:19 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oo1-xc29.google.com with SMTP id h1-20020a4aa741000000b004756c611188so3116384oom.4; Sat, 17 Sep 2022 11:07:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=VBnYx+FnxOx1zUbO4rMH3UjOtLNi55YeOUv+8ePXmTE=; b=Q/4I03DdWT4Ds+Da+a+OUp+i2q/gEwUCT9ArPN6Vgg5JbdkIdaIB/o0Dfmkrg1X5GA KZRQyECbpRIbpo5Ot27vvcPIxmUODz7goeLC6wMnB2ZhHJY4FmyqC8TCLolXG3C0gWWW cXInTMXMtdtBmZjQhUJgLBa1aI0Lr2qYAzqCk4X+D8rdaUGpj2LrBNgDCSsgd7lEzPPE hYvvONciSK/ZZLvJt9/nayV7FRLBT6YebOZcZZCCQJdEXB05SbBMhQ934ua4Qfwyfj7N 1Ov7O4pJFDLIOw4Zij8N9XpJmWatnbLN8bMl0R2HWr8rMh2TCJUo6ADRvi+2YiSHX4hW VBxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=VBnYx+FnxOx1zUbO4rMH3UjOtLNi55YeOUv+8ePXmTE=; b=TDM6gb+9iPvtK+DpQvP0Zdru+bgJ6c3GHWJkjrx+oL1jBdkJ0M5+zr3C/Cvrp8IUJE ASNyrZhJMOosOXrywmdp+iWNU5LNyylH4YLhO+0HH/4PZdJX1GSzLApBaFNBvwDzeQNX V3eguMyUHQ5M+254CabXKZw8AB1NuZhh0F8oenw9eRJXGYOBsR98Ki54gglKqUaaOdrn 0e0d8SVhZDJfbqOcoUiJy/kXW388SUiKIdsqEd8BnyWZ6odh6zLFWg32/BSmqY+ul+No xb5MLYlh/pHowltoDraosAC8URijHP1wLd4ITe8lrfhd0MAouTa+gXsz5vgFXZR+5API 2rlQ== X-Gm-Message-State: ACrzQf2OqHXSrs6LLUaB50uPff7VsMShLqoI6ekDaNAIIR+kAmjwa5CP XG+wXhq/ArkIz/Gw1dYsdMe4X8AtKa78z9oG6vWSHD3m60Tayw== X-Google-Smtp-Source: AMsMyM4i6Abjjb0S9ObmIWHzXroMbqaPpngAoXBjOwmuV8KCs6j3sPB7g1M15f1sjGZrNcw+YPY0OzSrGWH8fGIGbFU= X-Received: by 2002:a4a:d00f:0:b0:475:6612:c055 with SMTP id h15-20020a4ad00f000000b004756612c055mr4171065oor.25.1663438037930; Sat, 17 Sep 2022 11:07:17 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sat, 17 Sep 2022 22:07:08 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="0000000000005b56fa05e8e35992" X-Rspamd-Queue-Id: 4MVJn30y1bz3fr5 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="Q/4I03Dd"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::c29 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.82 / 15.00]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_LONG(-0.94)[-0.942]; NEURAL_HAM_MEDIUM(-0.88)[-0.883]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c29:from]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --0000000000005b56fa05e8e35992 Content-Type: text/plain; charset="UTF-8" Apologies about that - output of "geli list" below : Seems like the provider is showing the old value (290G) while the consumer is showing the resized value (458G) - so now I'm confused about what is to be done and how to resolve this (not very familiar and still learning) ---------------------------------------------------------------------- geli list Geom name: ada0p3.eli State: ACTIVE EncryptionAlgorithm: AES-XTS KeyLength: 256 Crypto: accelerated software Version: 7 UsedKey: 0 Flags: BOOT, GELIBOOT KeysAllocated: 73 KeysTotal: 73 Providers: 1. Name: ada0p3.eli Mediasize: 311481593856 (290G) Sectorsize: 4096 Mode: r1w1e1 Consumers: 1. Name: ada0p3 Mediasize: 491516858368 (458G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 8590983168 Mode: r1w1e1 Geom name: ada0p2.eli State: ACTIVE EncryptionAlgorithm: AES-XTS KeyLength: 128 Crypto: accelerated software Version: 7 Flags: ONETIME, W-DETACH, W-OPEN, AUTORESIZE KeysAllocated: 2 KeysTotal: 2 Providers: 1. Name: ada0p2.eli Mediasize: 8589934592 (8.0G) Sectorsize: 4096 Mode: r1w1e0 Consumers: 1. Name: ada0p2 Mediasize: 8589934592 (8.0G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 1048576 Mode: r1w1e1 ---------------------------------------------------------------------------------------- On Sat, Sep 17, 2022 at 10:02 PM Alan Somers wrote: > On Sat, Sep 17, 2022 at 11:56 AM milky india wrote: > > > > Thanks for the reply - I was suggested that "geli resize" wasn't > required on the forums : > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581676 > .......... was that wrong advice? > > > > If it was - what do I do now? If it wasn't - why is the zpool list not > showing the resized disk but the older values as if nothing happened? > > > > Thanks > > > > On Sat, Sep 17, 2022 at 9:53 PM Alan Somers wrote: > >> > >> On Sat, Sep 17, 2022 at 11:31 AM milky india > wrote: > ... > >> > >> After doing "gpart resize" but before doing "zpool online -e", you > >> need to do "geli resize". > > Just check by doing "geli list". Does it show the old size or the new > size? Also, please keep your replies on-list so other readers can see > the resolution to your problem. > --0000000000005b56fa05e8e35992 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Apologies about that - output of "geli list" bel= ow :
Seems like the provider is showing the old value (290G) while the = consumer is showing the resized value (458G) - so now I'm confused abou= t what is to be done and how to resolve=C2=A0this (not very familiar and st= ill learning)

--------------------------------------= --------------------------------
geli list
Geom name: ada0p3.e= li
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 256
Cr= ypto: accelerated software
Version: 7
UsedKey: 0
Flags: BOOT, GELI= BOOT
KeysAllocated: 73
KeysTotal: 73
Providers:
1. Name: ada0p3= .eli
=C2=A0 =C2=A0Mediasize: 311481593856 (290G)
=C2=A0 =C2=A0Sectors= ize: 4096
=C2=A0 =C2=A0Mode: r1w1e1
Consumers:
1. Name: ada0p3
= =C2=A0 =C2=A0Mediasize: 491516858368 (458G)
=C2=A0 =C2=A0Sectorsize: 512=
=C2=A0 =C2=A0Stripesize: 0
=C2=A0 =C2=A0Stripeoffset: 8590983168
= =C2=A0 =C2=A0Mode: r1w1e1

Geom name: ada0p2.eli
State: ACTIVE
= EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: accelerated softw= are
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN, AUTORESIZE
KeysAl= located: 2
KeysTotal: 2
Providers:
1. Name: ada0p2.eli
=C2=A0 = =C2=A0Mediasize: 8589934592 (8.0G)
=C2=A0 =C2=A0Sectorsize: 4096
=C2= =A0 =C2=A0Mode: r1w1e0
Consumers:
1. Name: ada0p2
=C2=A0 =C2=A0Med= iasize: 8589934592 (8.0G)
=C2=A0 =C2=A0Sectorsize: 512
=C2=A0 =C2=A0S= tripesize: 0
=C2=A0 =C2=A0Stripeoffset: 1048576
=C2=A0 =C2=A0Mode: r1= w1e1
--------------------------------------------------------= --------------------------------

On Sat, Sep 17, 2022 at 10:02 P= M Alan Somers <asomers@freebsd.or= g> wrote:
On Sat, Sep 17, 2022 at 11:56 AM milky india <milkyindia@gmail.com> wrote:
>
> Thanks for the reply - I was suggested that "geli resize" wa= sn't required on the forums : https://forums.FreeBSD.org/thread= s/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581676= .......... was that wrong advice?
>
> If it was - what do I do now? If it wasn't - why is the zpool list= not showing the resized disk but the older values as if nothing happened?<= br> >
> Thanks
>
> On Sat, Sep 17, 2022 at 9:53 PM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 11:31 AM milky india <milkyindia@gmail.com> wrote= :
...
>>
>> After doing "gpart resize" but before doing "zpool = online -e", you
>> need to do "geli resize".

Just check by doing "geli list".=C2=A0 Does it show the old size = or the new
size?=C2=A0 Also, please keep your replies on-list so other readers can see=
the resolution to your problem.
--0000000000005b56fa05e8e35992-- From nobody Sat Sep 17 18:20:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVK4Y5pYwz4bxmP for ; Sat, 17 Sep 2022 18:20:45 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f49.google.com (mail-qv1-f49.google.com [209.85.219.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVK4Y0WXMz3gqQ for ; Sat, 17 Sep 2022 18:20:45 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f49.google.com with SMTP id z9so7574017qvn.9 for ; Sat, 17 Sep 2022 11:20:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=OjcYUnO6niZXIDOnMQZS2/6nBajfT62QXhCWpv470DI=; b=rviQutAfKYq1+iHk3Nj9cYQ/9+0OYLx9+jBPZp91qIlRe75NrrLlHdpYNiVeGFIG+g Fa9KCDFG1tMNDvc4Uk9a8qJd8SbK/nw6ctDii3l+xgzAzFV7Ixs0DD6x+YJ7UEXRp8Qs V+vB0NTKKEaxSzYiWF6lvwK6YHitaRhSE2CyOg0dM4Ay6zvDKZqXA9R6w/c5c3mRnEY+ 53+Uvt1apBZgBCPXQ16zabcI24D9tqX4oGjHmy15Hjhrkck9rboEpBk751ETftUiOl2U hP+6kS0h0C1UArnyn/AF8cmUOlppeXWIwUIvSAMg1fOgmyzFNlaMD3JP7C3XynjgOwuI xZvQ== X-Gm-Message-State: ACrzQf1rkVNzw0c+9bEbJpwDpiNFtEgBjzODcspcylZTTiYN3Co4giMm mB+Fl0z84IoCV4VGobuAABCOxTL949adb2IEvRTfw9MQ X-Google-Smtp-Source: AMsMyM7bXfePAkMQjcayQm5Ly8IMpvQjpO76CpGA5vcBafSfON16lOFbMe6Ezt/JAXKTKhfWt8Me42aUd9mYwR3Bepk= X-Received: by 2002:a05:6214:5295:b0:4ac:ae7d:6a46 with SMTP id kj21-20020a056214529500b004acae7d6a46mr8694372qvb.131.1663438843915; Sat, 17 Sep 2022 11:20:43 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 12:20:32 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVK4Y0WXMz3gqQ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.49 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.93 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.98)[-0.980]; NEURAL_HAM_MEDIUM(-0.95)[-0.946]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.49:from]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.49:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 12:07 PM milky india wrote: > > Apologies about that - output of "geli list" below : > Seems like the provider is showing the old value (290G) while the consumer is showing the resized value (458G) - so now I'm confused about what is to be done and how to resolve this (not very familiar and still learning) > > ---------------------------------------------------------------------- > geli list > Geom name: ada0p3.eli > State: ACTIVE > EncryptionAlgorithm: AES-XTS > KeyLength: 256 > Crypto: accelerated software > Version: 7 > UsedKey: 0 > Flags: BOOT, GELIBOOT > KeysAllocated: 73 > KeysTotal: 73 > Providers: > 1. Name: ada0p3.eli > Mediasize: 311481593856 (290G) > Sectorsize: 4096 > Mode: r1w1e1 > Consumers: > 1. Name: ada0p3 > Mediasize: 491516858368 (458G) > Sectorsize: 512 > Stripesize: 0 > Stripeoffset: 8590983168 > Mode: r1w1e1 > > Geom name: ada0p2.eli > State: ACTIVE > EncryptionAlgorithm: AES-XTS > KeyLength: 128 > Crypto: accelerated software > Version: 7 > Flags: ONETIME, W-DETACH, W-OPEN, AUTORESIZE > KeysAllocated: 2 > KeysTotal: 2 > Providers: > 1. Name: ada0p2.eli > Mediasize: 8589934592 (8.0G) > Sectorsize: 4096 > Mode: r1w1e0 > Consumers: > 1. Name: ada0p2 > Mediasize: 8589934592 (8.0G) > Sectorsize: 512 > Stripesize: 0 > Stripeoffset: 1048576 > Mode: r1w1e1 > ---------------------------------------------------------------------------------------- So yes, you need to resize the geli device. Read the geli man page for details. Also, when you reply please bottom-post rather than top-post. It makes the mail archives more readable. -Alan From nobody Sat Sep 17 18:31:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVKJs0Zm4z4c1Fj for ; Sat, 17 Sep 2022 18:31:25 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oa1-x2c.google.com (mail-oa1-x2c.google.com [IPv6:2001:4860:4864:20::2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVKJr4lWbz3jDJ; Sat, 17 Sep 2022 18:31:24 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oa1-x2c.google.com with SMTP id 586e51a60fabf-11eab59db71so56542337fac.11; Sat, 17 Sep 2022 11:31:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=ZlyIM7kzRyK9HAR25IRO+V3w9pfLSV2dJ7StlDjRlkg=; b=m8zq2z9JWfYhk9mtYeswOR+r1uM9dARVusF2R1sbgFTPrHhm0R+QoaEU9bcVLrwlbp A/+vffmEzZEb/dVBsaWxO8qL/dVlarIT36i8FTXL3jPT128zjubDRQOhGUGG8RBqv1uS 9wsvmc2k5w1YPEkW8uKRFq+sVlVbCrry5xjFsAk9E0L+EI0E4XTgwCEqwuGm/wYhBW1y k8FFdpNMX2TRTnTmj1+LdSoPaoPiLVt307yv/QMTKVpx1Ycxp5UPlhr+39aP0Nrs304T URGLUL1UYB8Gjs9S8sEfVWCGpA7O4FavrIglYQpGgkwSBeYoZ8oQdS3K6oxo+3rQhTjE XVuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=ZlyIM7kzRyK9HAR25IRO+V3w9pfLSV2dJ7StlDjRlkg=; b=EOgDJRSt3NEouRLUFFAenYqDi8otHkEAQkxanosdontVHFLE7M6/DzwT7IuZQ5dgcp ipK+NNuK9B5Jzs+JkAIPAUXXpQR8OG1k6z9waCxo3CyQVJaTdMkUab/9LGsLx9FjkPPd pQ8hXf58BT/899tNtU8SeU1KwmAKcTFj35co2fUhEHXMY5sLdivltm2nJ47adQ4bBd6L 6uHEiivpBzFWeTagUKPphxcXgVb/5EsE8TIfjVBnELMGNTKQ5yYIwLGolTi2eBsZWAtv VFlhwq4DIR3CWD2IAXDMjOQYikLhsC0lfLK7Rpqzo+US8HEP/McOer5+HEajSgYhmSF6 8LAw== X-Gm-Message-State: ACgBeo15iaeDtenS6XPWlO6A+gSLJQ4XiUz99VrJL6cwjY0SptHzi4xX 8Zwy8e39DwMj8cuSGEnk9MvzRlvll+qyjpZtxo8Zi+6GdbhuGQ== X-Google-Smtp-Source: AA6agR4dsfy4dSACtTfta4XMo+q8DKz56dPGqUwqMoiL2RFZaCgXSt8s1bG9ZKhItmx4CbYsZ4CwTkh+0Z/ucjOczL8= X-Received: by 2002:a05:6871:b2a:b0:12b:91ce:e45b with SMTP id fq42-20020a0568710b2a00b0012b91cee45bmr11606831oab.291.1663439483756; Sat, 17 Sep 2022 11:31:23 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sat, 17 Sep 2022 22:31:14 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="00000000000088e49105e8e3afd5" X-Rspamd-Queue-Id: 4MVKJr4lWbz3jDJ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=m8zq2z9J; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2001:4860:4864:20::2c as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.74 / 15.00]; NEURAL_HAM_LONG(-0.95)[-0.948]; NEURAL_HAM_MEDIUM(-0.90)[-0.897]; NEURAL_HAM_SHORT(-0.89)[-0.892]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2001:4860:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2001:4860:4864:20::2c:from]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000088e49105e8e3afd5 Content-Type: text/plain; charset="UTF-8" Sorry about that, again - I'm not sure what you mean by bottom-post vs top-post. Be that as it may - I read the geli man page. I was specifically warned against using "geli resize" since it may not work as expected https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 Is this advise wrong? > "The geli has autoresize flag which will handle the new provider size after gpart resize command." followed by > You are right, no geli resize needed. What would be the correct sequence of commands to fix this - Simply "geli resize" ? (the -s option seems to be additional, will it figure it out without providing s?) On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: > On Sat, Sep 17, 2022 at 12:07 PM milky india wrote: > > > > Apologies about that - output of "geli list" below : > > Seems like the provider is showing the old value (290G) while the > consumer is showing the resized value (458G) - so now I'm confused about > what is to be done and how to resolve this (not very familiar and still > learning) > > > > ---------------------------------------------------------------------- > > geli list > > Geom name: ada0p3.eli > > State: ACTIVE > > EncryptionAlgorithm: AES-XTS > > KeyLength: 256 > > Crypto: accelerated software > > Version: 7 > > UsedKey: 0 > > Flags: BOOT, GELIBOOT > > KeysAllocated: 73 > > KeysTotal: 73 > > Providers: > > 1. Name: ada0p3.eli > > Mediasize: 311481593856 (290G) > > Sectorsize: 4096 > > Mode: r1w1e1 > > Consumers: > > 1. Name: ada0p3 > > Mediasize: 491516858368 (458G) > > Sectorsize: 512 > > Stripesize: 0 > > Stripeoffset: 8590983168 > > Mode: r1w1e1 > > > > Geom name: ada0p2.eli > > State: ACTIVE > > EncryptionAlgorithm: AES-XTS > > KeyLength: 128 > > Crypto: accelerated software > > Version: 7 > > Flags: ONETIME, W-DETACH, W-OPEN, AUTORESIZE > > KeysAllocated: 2 > > KeysTotal: 2 > > Providers: > > 1. Name: ada0p2.eli > > Mediasize: 8589934592 (8.0G) > > Sectorsize: 4096 > > Mode: r1w1e0 > > Consumers: > > 1. Name: ada0p2 > > Mediasize: 8589934592 (8.0G) > > Sectorsize: 512 > > Stripesize: 0 > > Stripeoffset: 1048576 > > Mode: r1w1e1 > > > ---------------------------------------------------------------------------------------- > > So yes, you need to resize the geli device. Read the geli man page > for details. Also, when you reply please bottom-post rather than > top-post. It makes the mail archives more readable. > -Alan > --00000000000088e49105e8e3afd5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Sorry about that, again - I'm not sure what you mean b= y bottom-post vs top-post.

Be that as it may - I read th= e geli man page. I was specifically warned against using "geli resize&= quot; since it may not work as expected=C2=A0https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-e= ncrypted-disk-space-not-showing.86447/post-581642=C2=A0
Is th= is advise wrong?=C2=A0
> "The geli has a= utoresize flag which will handle the new provider size after gpart resize c= ommand."=C2=A0
followed by
>=C2=A0You are right, no=C2=A0geli resize=C2=A0needed.

What would be the correct sequence of commands to fix this - Simply &quo= t;geli resize" ? (the -s option seems to be additional, will it figure= it out without providing s?)

On Sat, Sep 17, 2022 at 10:20 PM Alan So= mers <asomers@freebsd.org>= wrote:
On Sat, = Sep 17, 2022 at 12:07 PM milky india <milkyindia@gmail.com> wrote:
>
> Apologies about that - output of "geli list" below :
> Seems like the provider is showing the old value (290G) while the cons= umer is showing the resized value (458G) - so now I'm confused about wh= at is to be done and how to resolve this (not very familiar and still learn= ing)
>
> ----------------------------------------------------------------------=
> geli list
> Geom name: ada0p3.eli
> State: ACTIVE
> EncryptionAlgorithm: AES-XTS
> KeyLength: 256
> Crypto: accelerated software
> Version: 7
> UsedKey: 0
> Flags: BOOT, GELIBOOT
> KeysAllocated: 73
> KeysTotal: 73
> Providers:
> 1. Name: ada0p3.eli
>=C2=A0 =C2=A0 Mediasize: 311481593856 (290G)
>=C2=A0 =C2=A0 Sectorsize: 4096
>=C2=A0 =C2=A0 Mode: r1w1e1
> Consumers:
> 1. Name: ada0p3
>=C2=A0 =C2=A0 Mediasize: 491516858368 (458G)
>=C2=A0 =C2=A0 Sectorsize: 512
>=C2=A0 =C2=A0 Stripesize: 0
>=C2=A0 =C2=A0 Stripeoffset: 8590983168
>=C2=A0 =C2=A0 Mode: r1w1e1
>
> Geom name: ada0p2.eli
> State: ACTIVE
> EncryptionAlgorithm: AES-XTS
> KeyLength: 128
> Crypto: accelerated software
> Version: 7
> Flags: ONETIME, W-DETACH, W-OPEN, AUTORESIZE
> KeysAllocated: 2
> KeysTotal: 2
> Providers:
> 1. Name: ada0p2.eli
>=C2=A0 =C2=A0 Mediasize: 8589934592 (8.0G)
>=C2=A0 =C2=A0 Sectorsize: 4096
>=C2=A0 =C2=A0 Mode: r1w1e0
> Consumers:
> 1. Name: ada0p2
>=C2=A0 =C2=A0 Mediasize: 8589934592 (8.0G)
>=C2=A0 =C2=A0 Sectorsize: 512
>=C2=A0 =C2=A0 Stripesize: 0
>=C2=A0 =C2=A0 Stripeoffset: 1048576
>=C2=A0 =C2=A0 Mode: r1w1e1
> ----------------------------------------------------------------------= ------------------

So yes, you need to resize the geli device.=C2=A0 Read the geli man page for details.=C2=A0 Also, when you reply please bottom-post rather than
top-post.=C2=A0 It makes the mail archives more readable.
-Alan
--00000000000088e49105e8e3afd5-- From nobody Sat Sep 17 18:42:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVKZM5BMTz4c2wR for ; Sat, 17 Sep 2022 18:43:07 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qt1-f178.google.com (mail-qt1-f178.google.com [209.85.160.178]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVKZL3QBKz3krl for ; Sat, 17 Sep 2022 18:43:06 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qt1-f178.google.com with SMTP id r20so17486264qtn.12 for ; Sat, 17 Sep 2022 11:43:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=FgkvswVmtkFiEk8X8/xiMLU9mx9WWqNSCzmg50gevTk=; b=2Dmk4bWetHxzT/KclN4lhfPkhzQqEJ5PPx/jHCZW3x0qr+qlN5gyKWnU2Snc+axLpc s9t3itsvWL7ccQK+3CsFg040giPnnMvhv0fggJKYM/TxbCDEQoRQFulI/xmwp92zHBen 4bYEBTjs1yYrRrZnWr8q7Ygs5Rg3vP1s2Xly8H627mHGDKaMHidldgYfWAUgvK81iJO8 Gw53HqB/gw08VJwZIIFJpxeSsgG3pF8doJ5pTHUUOtd5j5IplG0/xJrF9tbW7z6NM8po v7xzNFIAdl7VyqCj1zEh5MuTJFvvNTD6oincc2tWujHNm4TaOtWoIj4YqPOaNvNOamA4 Kssg== X-Gm-Message-State: ACrzQf1FTSA9GAMgRHp19IIOl3Nywa1PJy0xA2Oe4JylNm0qb6kZK003 1Y05i9pzNkrBZGYTEipr5uEEhIBimbW0LpIXWLd3Jw0J X-Google-Smtp-Source: AMsMyM7YrvvI3X3MW1ib9Xmj+Mf5JkzbUNgGLA/RErHBf4NhStvTSCnceEWGMvhgCC7Pr+V2zTy5RYsjsL5w2HsAj4M= X-Received: by 2002:ac8:5a8c:0:b0:35b:b2f7:7e96 with SMTP id c12-20020ac85a8c000000b0035bb2f77e96mr9263378qtc.659.1663440185689; Sat, 17 Sep 2022 11:43:05 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 12:42:54 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVKZL3QBKz3krl X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.160.178 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.09 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; NEURAL_HAM_LONG(-0.99)[-0.992]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RWL_MAILSPIKE_GOOD(-0.10)[209.85.160.178:from]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.178:from]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: > > Sorry about that, again - I'm not sure what you mean by bottom-post vs top-post. > > Be that as it may - I read the geli man page. I was specifically warned against using "geli resize" since it may not work as expected https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > Is this advise wrong? > > "The geli has autoresize flag which will handle the new provider size after gpart resize command." > followed by > > You are right, no geli resize needed. > > What would be the correct sequence of commands to fix this - Simply "geli resize" ? (the -s option seems to be additional, will it figure it out without providing s?) > > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: top-posting is where you insert your reply above the previous email. Bottom posting is where you insert your reply below it, like I'm doing. The forum user said that you shouldn't need to run "geli resize" because the AUTORESIZE flag is on. But as you can see from your "geli list" output, it's actually off. So you need to run "geli resize". The "-s" flag should be unnecessary since your provider is already online. At any rate, you can try it both ways. You might want to make a copy of /var/backups/ada0p3.eli, just in case you make a mistake. From nobody Sat Sep 17 18:52:44 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVKnh2f00z4c4S6 for ; Sat, 17 Sep 2022 18:52:56 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oi1-x22e.google.com (mail-oi1-x22e.google.com [IPv6:2607:f8b0:4864:20::22e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVKng3Vm8z3lV4; Sat, 17 Sep 2022 18:52:55 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oi1-x22e.google.com with SMTP id p187so9968058oia.9; Sat, 17 Sep 2022 11:52:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=diqGFsP9Wox38YlhoVVmOiBIWaUCeU+q7EV6WzDyCg0=; b=DW6BpEXZq7jamnTGZjuS5IQhaS2VXHKgdaHT9TS9KXk9sS1meWdRFXjCYYHcpREQlG 9JlBN7XVces8qSN+2al5+lhpWXfdhdgfeyR6h2je9xsOLASt4g0bv0z7XUJ2MAfwjnNd sHy8zyVZQ9f6aZJwVFWNDPx9CrDlSPs53d76hbbFl7wArwUC8tf/H5YK1IJ+QBemiT3u Lp9AS3ddpfTy7HYttK1ikBLktI/fvNEtElrY1Gbtu/TFEGPl7sOBuAwSlsEFzTF1NyDK /G2lNQ+UMRaT0C76qT/2utzejcjKI3AzcsTPD/RlT9DUldb27CjwgszB4oe1FI26dW1h Ve9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=diqGFsP9Wox38YlhoVVmOiBIWaUCeU+q7EV6WzDyCg0=; b=e4MM+JVk59/UWuBH0WyquAuhiWD1w13EwXQpCrYuaVXho9pKJVEs99OS67NSroJowU BcPPnOJQLMNIrtU2ZTz4oq575+KnwlpGj0KPAet1DgRk/EcEshrqTPKIcFtUhSV4Vtjk slU58BTiX1GXtoo1kkBILeoxlu+dsotLN474XrBo9N5OsugQeVLMAq5c6lRjGPYWQSyN LijpyQIOAQlq5B9hEr8W6UjKeGxg8fdMosI4QDNDwX10Y6v+mFT7+G4eA2NZWyKzAyMS 87ZZjGgAjiSwrkW/quFgguutLPBbGxZnh4BlVrmiooeokb08l7JJrZoXkY5SJCY9YfRO fwPg== X-Gm-Message-State: ACgBeo09rK6+HxZ8iVrVsP56xuwwBPDPvkpTyMEV6FyNhr3hQt+PvOEu yfrGvGi97+bxxj5mzctMTQC4Fwgw6elpyUNwODAZg4hyfKEBvg== X-Google-Smtp-Source: AA6agR5wo4fhjCteLfL9qZwBFjIe7EgeNvT9REUWUYhNsMIEmZHc2L+iC2YxH4kokDpfea1J4fj4ZQVFmbnm35xSicU= X-Received: by 2002:aca:ab44:0:b0:34f:6f58:43f6 with SMTP id u65-20020acaab44000000b0034f6f5843f6mr8965165oie.98.1663440774318; Sat, 17 Sep 2022 11:52:54 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sat, 17 Sep 2022 22:52:44 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000754f2705e8e3fc58" X-Rspamd-Queue-Id: 4MVKng3Vm8z3lV4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=DW6BpEXZ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::22e as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.69 / 15.00]; NEURAL_HAM_MEDIUM(-0.93)[-0.928]; NEURAL_HAM_LONG(-0.89)[-0.886]; NEURAL_HAM_SHORT(-0.88)[-0.880]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::22e:from]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000754f2705e8e3fc58 Content-Type: text/plain; charset="UTF-8" On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: > On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: > > > > Sorry about that, again - I'm not sure what you mean by bottom-post vs > top-post. > > > > Be that as it may - I read the geli man page. I was specifically warned > against using "geli resize" since it may not work as expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > > Is this advise wrong? > > > "The geli has autoresize flag which will handle the new provider size > after gpart resize command." > > followed by > > > You are right, no geli resize needed. > > > > What would be the correct sequence of commands to fix this - Simply > "geli resize" ? (the -s option seems to be additional, will it figure it > out without providing s?) > > > > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers > wrote: > > top-posting is where you insert your reply above the previous email. > Bottom posting is where you insert your reply below it, like I'm > doing. The forum user said that you shouldn't need to run "geli > resize" because the AUTORESIZE flag is on. But as you can see from > your "geli list" output, it's actually off. So you need to run "geli > resize". The "-s" flag should be unnecessary since your provider is > already online. At any rate, you can try it both ways. You might > want to make a copy of /var/backups/ada0p3.eli, just in case you make > a mistake. > Thanks - I hope I am bottom posting this as was expected of me. So if I understand correctly the AUTORESIZE flag is present for adaop2 and NOT for adap3 (which is the partition we are concerned about) - hence the advice given to not use "geli resize" isn't applicable here. Am I understanding this correctly? > So you need to run "geli resize" Is this the only command that I need to run to resize my geli partition? > The "-s" flag should be unnecessary since your provider is already online. Ok thanks. >You might want to make a copy of /var/backups/ada0p3.eli, just in case you make a mistake. Don't have the luxury of backup currently. I suppose at the end of it - if this works - "geli list" would reflect the size to be 458G? (vs 290G currently) And that's the output I can trust to have solved the issue - or is there more to it? --000000000000754f2705e8e3fc58 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sat, Sep 17, 2022 at 10:43 PM Alan= Somers <asomers@freebsd.org&= gt; wrote:
On Sa= t, Sep 17, 2022 at 12:31 PM milky india <milkyindia@gmail.com> wrote:
>
> Sorry about that, again - I'm not sure what you mean by bottom-pos= t vs top-post.
>
> Be that as it may - I read the geli man page. I was specifically warne= d against using "geli resize" since it may not work as expected <= a href=3D"https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypt= ed-disk-space-not-showing.86447/post-581642" rel=3D"noreferrer" target=3D"_= blank">https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-= disk-space-not-showing.86447/post-581642
> Is this advise wrong?
> > "The geli has autoresize flag which will handle the new prov= ider size after gpart resize command."
> followed by
> > You are right, no geli resize needed.
>
> What would be the correct sequence of commands to fix this - Simply &q= uot;geli resize" ? (the -s option seems to be additional, will it figu= re it out without providing s?)
>
> On Sat, Sep 17, 2022 at 10:20 PM Alan Somers <asomers@freebsd.org> wrote:

top-posting is where you insert your reply above the previous email.
Bottom posting is where you insert your reply below it, like I'm
doing.=C2=A0 The forum user said that you shouldn't need to run "g= eli
resize" because the AUTORESIZE flag is on.=C2=A0 But as you can see fr= om
your "geli list" output, it's actually off.=C2=A0 So you need= to run "geli
resize".=C2=A0 The "-s" flag should be unnecessary since you= r provider is
already online.=C2=A0 At any rate, you can try it both ways.=C2=A0 You migh= t
want to make a copy of /var/backups/ada0p3.eli, just in case you make
a mistake.
Thanks - I hope I am bottom posting this as= was expected of me.

So if I understand correctly = the AUTORESIZE flag is present for adaop2=C2=A0and NOT for adap3 (which is = the partition we are concerned about) - hence the advice given to not use &= quot;geli resize" isn't applicable here. Am I understanding this c= orrectly?=C2=A0

> So you need to run "geli= resize"
Is this the only command that I need to run to resi= ze my geli partition?

> The "-s" flag= should be unnecessary since your provider is
already online.=C2=A0
Ok thanks.

>You mig= ht want to make a copy of /var/backups/ada0p3.eli, just in case you make a = mistake.
Don't have the luxury of backup currently.

I suppose at the end of it - if this works - "geli lis= t" would reflect the size to be 458G? (vs 290G currently)
An= d that's the output I can trust to have solved the issue - or is there = more to it?



--000000000000754f2705e8e3fc58-- From nobody Sat Sep 17 18:57:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVKvf0yysz4c5D1 for ; Sat, 17 Sep 2022 18:58:06 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qt1-f180.google.com (mail-qt1-f180.google.com [209.85.160.180]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVKvd365zz3m74 for ; Sat, 17 Sep 2022 18:58:05 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qt1-f180.google.com with SMTP id f26so15701611qto.11 for ; Sat, 17 Sep 2022 11:58:05 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=W6oGFoV0Zbb5YOktR5V5WZdUc5cbC4JtXJtMQI45SFw=; b=zNz9/UpcDAr+y3Vpla9R2sEe9Z9puv4LzBw+bVSQM9cJbwn2eRSbXUxl5C7ZXiiRBb lOVoSh/DRJ3bF7zxobaU0nAu+eP+vviQq8mENEGsiQtXoOP2s9IsuU8ew3CUNQlD0sd1 RXhY79sn+TvLnuAC8+l2mLhLruNqbnNwt67CzkuM+gkJkJKpRNLER8sm+rC514NCEGuS FtIWdZ/HN0zFQP7Ukz8UmOCBQD2ng8JceFXOB7l8JMi3khknpuBDLkiYRo4Ykt+FLiou iyB4DJ4HFDWPjeKkRsy/Po7/fAYNG3qKsav8pBSaH0foierhadqJ3ueI12ysJgAOuyGd v7Dg== X-Gm-Message-State: ACrzQf3jFYH6/vd/IdOl8W/dQtmnKWnf/RDv+cl1yrCpwPQoY0N2TQGN +zi+9Tp/Lg6uKRcbS0RhpZ3fqNaSjpHSvk1adqdxkI3+ X-Google-Smtp-Source: AMsMyM5WASp3+2ShfdTSkt0Bj38vk8W9xGReIta7w47r9oDnCET7A1pDHN0cNeDtiLnjvHRcaU/eU2EhFfUVKSpxYj8= X-Received: by 2002:a05:622a:4b:b0:35b:a15d:19dd with SMTP id y11-20020a05622a004b00b0035ba15d19ddmr9273392qtw.52.1663441084757; Sat, 17 Sep 2022 11:58:04 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 12:57:53 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVKvd365zz3m74 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.160.180 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.07 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; NEURAL_HAM_LONG(-0.99)[-0.993]; NEURAL_HAM_SHORT(-0.98)[-0.975]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RWL_MAILSPIKE_GOOD(-0.10)[209.85.160.180:from]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.180:from]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: > > > > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> > >> > Sorry about that, again - I'm not sure what you mean by bottom-post vs top-post. >> > >> > Be that as it may - I read the geli man page. I was specifically warned against using "geli resize" since it may not work as expected https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 >> > Is this advise wrong? >> > > "The geli has autoresize flag which will handle the new provider size after gpart resize command." >> > followed by >> > > You are right, no geli resize needed. >> > >> > What would be the correct sequence of commands to fix this - Simply "geli resize" ? (the -s option seems to be additional, will it figure it out without providing s?) >> > >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> top-posting is where you insert your reply above the previous email. >> Bottom posting is where you insert your reply below it, like I'm >> doing. The forum user said that you shouldn't need to run "geli >> resize" because the AUTORESIZE flag is on. But as you can see from >> your "geli list" output, it's actually off. So you need to run "geli >> resize". The "-s" flag should be unnecessary since your provider is >> already online. At any rate, you can try it both ways. You might >> want to make a copy of /var/backups/ada0p3.eli, just in case you make >> a mistake. > > Thanks - I hope I am bottom posting this as was expected of me. > > So if I understand correctly the AUTORESIZE flag is present for adaop2 and NOT for adap3 (which is the partition we are concerned about) - hence the advice given to not use "geli resize" isn't applicable here. Am I understanding this correctly? Yes > > > So you need to run "geli resize" > Is this the only command that I need to run to resize my geli partition? Yes > > > The "-s" flag should be unnecessary since your provider is > already online. > Ok thanks. > > >You might want to make a copy of /var/backups/ada0p3.eli, just in case you make a mistake. > Don't have the luxury of backup currently. Um, ok. I can't guess why you aren't able to do that, but it isn't strictly necessary. > > I suppose at the end of it - if this works - "geli list" would reflect the size to be 458G? (vs 290G currently) > And that's the output I can trust to have solved the issue - or is there more to it? Yes. From nobody Sat Sep 17 20:03:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVMM4530Lz4cHMw for ; Sat, 17 Sep 2022 20:03:28 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oi1-x22b.google.com (mail-oi1-x22b.google.com [IPv6:2607:f8b0:4864:20::22b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVMM3739dz3t75; Sat, 17 Sep 2022 20:03:27 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oi1-x22b.google.com with SMTP id w125so10096430oig.3; Sat, 17 Sep 2022 13:03:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=gG+zzCbniDj991dD5pOHWyGN6JRj4ICABSF6OGj10rI=; b=OlJTAwXDyagHpyRGb3wN5LD6soAoJgtDtslv/Vt/r43XCjiKsXxPkLgg0NAKsmw7+k DQTe0gnYj37M/9XaytK34YrqBIZAIe6VeKmc7RLO/itiZtds4pWffsY8uQ/8iAix6aSz FL4GhdU0qbWRSsRdxjdDFx7jFo1S99RCe022c9Bhe6jpejlJXR9zOnubPr9P32GpzyQG bcaBoX6C2qlDXcrUEU3Udnk8mFGP5of+VyYcQD/zWjnbnXj637hyGIDl+85htXMYMxIP h5ABYzP5CtrIYUxbblDZLT1/vMhYSJ8B2rlzECbG9wUvuNffLRIsuMSyzK3H75K6TNNS T8rQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=gG+zzCbniDj991dD5pOHWyGN6JRj4ICABSF6OGj10rI=; b=nJ4/89MjxQSg/gUnCbzXs2CkhjG5u2yaGkFYRC3EFhH7seB0TfacC0Htq5BlLEi/b/ RLjd9yO/ex736zEwzKLpUdtvuGLOEL83alRZpZ9VcdxLhIlbKN52BuTitEeg4LsAeIIB rmeHRT2AjZRU5dZ2sd0FVLpGypdesXehC1PgSULQb+NF1uJJ8eMYnRJ6tquKi52x8kDW xix8XoKKj3yWbuYquw28jTLASN69EAS6v6sGtpf6himu4z09S4MgfQDWHuKnu4YU1kqW ln7ntSbtWcO9djwnaQlz+C9L9LnjM4tz9R79jyvYHyRsnWKQvVNlhf8C0Z7NZWEzXoUz ISwQ== X-Gm-Message-State: ACgBeo0Txfdot7qFH8JmSwHQVP++LmdE5jAwFh8oFNJAqpcanhsucJJh QHG/Qe1AS8Y94J231sX2roB5CNbBhzRp1HjzOQdoXTUFA+nGDA== X-Google-Smtp-Source: AA6agR7OpVpgOq21O7Fu0L3j4uNR5ludM5hAbiYVX3abnA9Rs4wYkR8yZtVKpufS9/v+Ssi6yzFGQxLT/P7Ctx1PGek= X-Received: by 2002:aca:ab44:0:b0:34f:6f58:43f6 with SMTP id u65-20020acaab44000000b0034f6f5843f6mr9036713oie.98.1663445006022; Sat, 17 Sep 2022 13:03:26 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sun, 18 Sep 2022 00:03:15 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000affec105e8e4f81b" X-Rspamd-Queue-Id: 4MVMM3739dz3t75 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=OlJTAwXD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::22b as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.84 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.94)[-0.945]; NEURAL_HAM_LONG(-0.89)[-0.893]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::22b:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000affec105e8e4f81b Content-Type: text/plain; charset="UTF-8" On Sat, Sep 17, 2022 at 10:58 PM Alan Somers wrote: > On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: > > > > > > > > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers > wrote: > >> > >> On Sat, Sep 17, 2022 at 12:31 PM milky india > wrote: > >> > > >> > Sorry about that, again - I'm not sure what you mean by bottom-post > vs top-post. > >> > > >> > Be that as it may - I read the geli man page. I was specifically > warned against using "geli resize" since it may not work as expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > >> > Is this advise wrong? > >> > > "The geli has autoresize flag which will handle the new provider > size after gpart resize command." > >> > followed by > >> > > You are right, no geli resize needed. > >> > > >> > What would be the correct sequence of commands to fix this - Simply > "geli resize" ? (the -s option seems to be additional, will it figure it > out without providing s?) > >> > > >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers > wrote: > >> > >> top-posting is where you insert your reply above the previous email. > >> Bottom posting is where you insert your reply below it, like I'm > >> doing. The forum user said that you shouldn't need to run "geli > >> resize" because the AUTORESIZE flag is on. But as you can see from > >> your "geli list" output, it's actually off. So you need to run "geli > >> resize". The "-s" flag should be unnecessary since your provider is > >> already online. At any rate, you can try it both ways. You might > >> want to make a copy of /var/backups/ada0p3.eli, just in case you make > >> a mistake. > > > > Thanks - I hope I am bottom posting this as was expected of me. > > > > So if I understand correctly the AUTORESIZE flag is present for adaop2 > and NOT for adap3 (which is the partition we are concerned about) - hence > the advice given to not use "geli resize" isn't applicable here. Am I > understanding this correctly? > > Yes > > > > > > So you need to run "geli resize" > > Is this the only command that I need to run to resize my geli partition? > > Yes > > > > > > The "-s" flag should be unnecessary since your provider is > > already online. > > Ok thanks. > > > > >You might want to make a copy of /var/backups/ada0p3.eli, just in case > you make a mistake. > > Don't have the luxury of backup currently. > > Um, ok. I can't guess why you aren't able to do that, but it isn't > strictly necessary. > > > > > I suppose at the end of it - if this works - "geli list" would reflect > the size to be 458G? (vs 290G currently) > > And that's the output I can trust to have solved the issue - or is there > more to it? > > Yes. > > The "-s" flag should be unnecessary since your provider is already online. When I try to run "geli resize /dev/ada0p3.eli" it complains. So I guess options s is must ? If yes - do I need to put in the exact size down to bytes from the output of geli list ? Under "Mediasize" ? --------------------------------------- geli: Option 's' not specified. ---------------------------------------- --000000000000affec105e8e4f81b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
=C2=A0=

On Sat, Sep 17, 2022 at 10:58 PM Alan Somers <asomers@freebsd.org> wrote:
On Sat, Sep 17, 2022 at 12:52 PM= milky india <= milkyindia@gmail.com> wrote:
>
>
>
> On Sat, Sep 17, 2022 at 10:43 PM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 12:31 PM milky india <milkyindia@gmail.com> wrote= :
>> >
>> > Sorry about that, again - I'm not sure what you mean by b= ottom-post vs top-post.
>> >
>> > Be that as it may - I read the geli man page. I was specifica= lly warned against using "geli resize" since it may not work as e= xpected https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-e= ncrypted-disk-space-not-showing.86447/post-581642
>> > Is this advise wrong?
>> > > "The geli has autoresize flag which will handle the= new provider size after gpart resize command."
>> > followed by
>> > > You are right, no geli resize needed.
>> >
>> > What would be the correct sequence of commands to fix this - = Simply "geli resize" ? (the -s option seems to be additional, wil= l it figure it out without providing s?)
>> >
>> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers <asomers@freebsd.org> wr= ote:
>>
>> top-posting is where you insert your reply above the previous emai= l.
>> Bottom posting is where you insert your reply below it, like I'= ;m
>> doing.=C2=A0 The forum user said that you shouldn't need to ru= n "geli
>> resize" because the AUTORESIZE flag is on.=C2=A0 But as you c= an see from
>> your "geli list" output, it's actually off.=C2=A0 So= you need to run "geli
>> resize".=C2=A0 The "-s" flag should be unnecessary = since your provider is
>> already online.=C2=A0 At any rate, you can try it both ways.=C2=A0= You might
>> want to make a copy of /var/backups/ada0p3.eli, just in case you m= ake
>> a mistake.
>
> Thanks - I hope I am bottom posting this as was expected of me.
>
> So if I understand correctly the AUTORESIZE flag is present for adaop2= and NOT for adap3 (which is the partition we are concerned about) - hence = the advice given to not use "geli resize" isn't applicable he= re. Am I understanding this correctly?

Yes

>
> > So you need to run "geli resize"
> Is this the only command that I need to run to resize my geli partitio= n?

Yes

>
> > The "-s" flag should be unnecessary since your provider= is
> already online.
> Ok thanks.
>
> >You might want to make a copy of /var/backups/ada0p3.eli, just in = case you make a mistake.
> Don't have the luxury of backup currently.

Um, ok.=C2=A0 I can't guess why you aren't able to do that, but it = isn't
strictly necessary.

>
> I suppose at the end of it - if this works - "geli list" wou= ld reflect the size to be 458G? (vs 290G currently)
> And that's the output I can trust to have solved the issue - or is= there more to it?

Yes.
> The "-s&q= uot; flag should be unnecessary since your provider is=C2=A0already online.
When I try to run "geli resize /dev/ada0p3.eli&qu= ot; it complains. So I guess options s is must ? If yes - do I need to put = in the exact size down to bytes from the output of geli list ? Under "= Mediasize" ?
---------------------------------------
geli: Option 's' not specified.
------------------= ----------------------=C2=A0
--000000000000affec105e8e4f81b-- From nobody Sat Sep 17 20:20:17 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVMkj6Td2z4cKN3 for ; Sat, 17 Sep 2022 20:20:29 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f45.google.com (mail-qv1-f45.google.com [209.85.219.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVMkj14Pdz3vSy for ; Sat, 17 Sep 2022 20:20:29 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f45.google.com with SMTP id j8so8255253qvt.13 for ; Sat, 17 Sep 2022 13:20:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=EcNy1NryKUjrrOu4FRNb2E+UW9Q/BblwGW4gz9rye38=; b=rAK8aRYNBMKGdS5ztdjdgDTLM6zdCJwqKvcxLx3WzCg7+9wBV6BIJVH809gScSHJvz M2+5DR0F8kfOV5FimiXhTLqsBIPAMkm2aIbqoFISRvHsCVJXwPf7HObkjnZWiuYgT7cf qSwmwvxeIMF5ZvQDRlrd7UzqO8bUYSGqoaUae0G+WPK9aKnvQEOV9cl3eN7aCD2Dzf7d WYwTY+XGnh6QmhgOHpSRMTZX6K8updbRWbAa+IQbTdj8HRVjW+rNS3COgYQR4qGIr0fo dx38yDSYXfMI+dMEET1aGi6xIEu+flLBbsQzX+iQhBbRG68j/2x4JzsGefi8ubqOJlsb Oh3Q== X-Gm-Message-State: ACrzQf1hzDW4+tdkR0ELfvaTyNUGdONHKt60NlwDXturHZzHUaoHqm3O UfYRcx+pyfaCsC982VSbHBHapeLkRAituSimNB5TpPtr X-Google-Smtp-Source: AMsMyM7MGc6M8CD23YzDzzHboBHd8dYhNx5JB+kA6tIu4QLfkb+Us6Whakfwv8KHeRL9CTw+QXZv+JyG2ObMjqjPG/g= X-Received: by 2002:a05:6214:2249:b0:4ad:2e1b:4741 with SMTP id c9-20020a056214224900b004ad2e1b4741mr1849036qvc.94.1663446028355; Sat, 17 Sep 2022 13:20:28 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 14:20:17 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MVMkj14Pdz3vSy X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.45 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.995]; NEURAL_HAM_LONG(-0.99)[-0.993]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.45:from]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.45:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 2:03 PM milky india wrote: > > > > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: >> > >> > >> > >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> >> > >> >> > Sorry about that, again - I'm not sure what you mean by bottom-post vs top-post. >> >> > >> >> > Be that as it may - I read the geli man page. I was specifically warned against using "geli resize" since it may not work as expected https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 >> >> > Is this advise wrong? >> >> > > "The geli has autoresize flag which will handle the new provider size after gpart resize command." >> >> > followed by >> >> > > You are right, no geli resize needed. >> >> > >> >> > What would be the correct sequence of commands to fix this - Simply "geli resize" ? (the -s option seems to be additional, will it figure it out without providing s?) >> >> > >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> >> >> top-posting is where you insert your reply above the previous email. >> >> Bottom posting is where you insert your reply below it, like I'm >> >> doing. The forum user said that you shouldn't need to run "geli >> >> resize" because the AUTORESIZE flag is on. But as you can see from >> >> your "geli list" output, it's actually off. So you need to run "geli >> >> resize". The "-s" flag should be unnecessary since your provider is >> >> already online. At any rate, you can try it both ways. You might >> >> want to make a copy of /var/backups/ada0p3.eli, just in case you make >> >> a mistake. >> > >> > Thanks - I hope I am bottom posting this as was expected of me. >> > >> > So if I understand correctly the AUTORESIZE flag is present for adaop2 and NOT for adap3 (which is the partition we are concerned about) - hence the advice given to not use "geli resize" isn't applicable here. Am I understanding this correctly? >> >> Yes >> >> > >> > > So you need to run "geli resize" >> > Is this the only command that I need to run to resize my geli partition? >> >> Yes >> >> > >> > > The "-s" flag should be unnecessary since your provider is >> > already online. >> > Ok thanks. >> > >> > >You might want to make a copy of /var/backups/ada0p3.eli, just in case you make a mistake. >> > Don't have the luxury of backup currently. >> >> Um, ok. I can't guess why you aren't able to do that, but it isn't >> strictly necessary. >> >> > >> > I suppose at the end of it - if this works - "geli list" would reflect the size to be 458G? (vs 290G currently) >> > And that's the output I can trust to have solved the issue - or is there more to it? >> >> Yes. > > > The "-s" flag should be unnecessary since your provider is already online. > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I guess options s is must ? If yes - do I need to put in the exact size down to bytes from the output of geli list ? Under "Mediasize" ? > --------------------------------------- > geli: Option 's' not specified. > ---------------------------------------- Dude, it's easier just to try it, than to ask us. Go for it. The worst case scenario if you get the argument wrong is that nothing happens. From nobody Sat Sep 17 20:24:57 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVMr52chsz4cLLK for ; Sat, 17 Sep 2022 20:25:09 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oi1-x231.google.com (mail-oi1-x231.google.com [IPv6:2607:f8b0:4864:20::231]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVMr44nScz3w4T; Sat, 17 Sep 2022 20:25:08 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oi1-x231.google.com with SMTP id w125so10132245oig.3; Sat, 17 Sep 2022 13:25:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=Cr/k7a4Pa38/FaxguXKaZ+fBgh77mkwpFQAsJ4s/waQ=; b=FFz3QCTuF5vMS1MvSlFR3DXt+CNK9PCTCY2HpNQ2N349+xGoV+kxNUJGN//nstxeSC ows+vGlQjtmCKZ3O0FDyY/+9/mNeaPerReMbn10R2nxjiUoZjrEQboprOBQkK0Wry65m YxkzHzR9iuFriNqFLl9c7dCOTxaLDUQzzZ8oE7da5JMlflCS/bqmMr4XX3FyuLHaj/0O aDfnUxhh7tHfnCyVmzy7EfhQGR1yiMyf7giI7wM/c8/MfE7QmSX4PkJ9oG1Yoz9lABST 7fz4/OJNwtSl+cGOgrulg3Yyo8Hmk8nR4Dt+HrNKVCHvmJ7R4n/a/tx2GLARAC2ci1Uz s60w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=Cr/k7a4Pa38/FaxguXKaZ+fBgh77mkwpFQAsJ4s/waQ=; b=jJb8xo8DCgP9MOLWwnLx3R8uzamdRoSArwiFB+e2yrfJ9FNnrNvfs5W7uiwsYyQd5x 85p3KMj+PgIBgMdfRQAt80+pQas25vV0Ctfqz3wa6dzjqcDP2DZE3g39xGTvp2KYEI40 JuUN20NDFw5YHAFuQ0hJxNoGFGJDqJEG1UiVI6f5Ss2lt79KKmqZDuW55/n3gSt2dwYd d/2NQjv70CN9qGT/NiBrVOjnstSWoYr8LykmVGK9N1fxANg7xxtE/guQBWXThNiph1lK 1Gj+KPqQOFMKCnuximVKyg32/tBLPjJ5I3z55NQQk4RUGD3FxvmIxBzREAd2cSttRTj/ ujkw== X-Gm-Message-State: ACgBeo3Qho3Ix2pRD4M57QHikqXWi+uZ+zLhneONicHzOkdmcYm5gWLo zRYJCGOExV66YtL8AhGoboj79w636zxu6LG5GkUf3XhKj7v8/w== X-Google-Smtp-Source: AA6agR4T4GgSmYjic6Aw1uLT6REgLlvdsgXiG6cRF8a8V2U3IVQ+Snt/HVGLj9byBEYZmfbREklDWtgiVVixoIpcdBM= X-Received: by 2002:a54:4495:0:b0:350:2a7:600f with SMTP id v21-20020a544495000000b0035002a7600fmr9174137oiv.291.1663446307583; Sat, 17 Sep 2022 13:25:07 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sun, 18 Sep 2022 00:24:57 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000443cc005e8e54696" X-Rspamd-Queue-Id: 4MVMr44nScz3w4T X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=FFz3QCTu; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::231 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.83 / 15.00]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_MEDIUM(-0.94)[-0.944]; NEURAL_HAM_LONG(-0.89)[-0.890]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::231:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --000000000000443cc005e8e54696 Content-Type: text/plain; charset="UTF-8" On Sun, Sep 18, 2022 at 12:20 AM Alan Somers wrote: > On Sat, Sep 17, 2022 at 2:03 PM milky india wrote: > > > > > > > > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers > wrote: > >> > >> On Sat, Sep 17, 2022 at 12:52 PM milky india > wrote: > >> > > >> > > >> > > >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers > wrote: > >> >> > >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india > wrote: > >> >> > > >> >> > Sorry about that, again - I'm not sure what you mean by > bottom-post vs top-post. > >> >> > > >> >> > Be that as it may - I read the geli man page. I was specifically > warned against using "geli resize" since it may not work as expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > >> >> > Is this advise wrong? > >> >> > > "The geli has autoresize flag which will handle the new provider > size after gpart resize command." > >> >> > followed by > >> >> > > You are right, no geli resize needed. > >> >> > > >> >> > What would be the correct sequence of commands to fix this - > Simply "geli resize" ? (the -s option seems to be additional, will it > figure it out without providing s?) > >> >> > > >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers > wrote: > >> >> > >> >> top-posting is where you insert your reply above the previous email. > >> >> Bottom posting is where you insert your reply below it, like I'm > >> >> doing. The forum user said that you shouldn't need to run "geli > >> >> resize" because the AUTORESIZE flag is on. But as you can see from > >> >> your "geli list" output, it's actually off. So you need to run "geli > >> >> resize". The "-s" flag should be unnecessary since your provider is > >> >> already online. At any rate, you can try it both ways. You might > >> >> want to make a copy of /var/backups/ada0p3.eli, just in case you make > >> >> a mistake. > >> > > >> > Thanks - I hope I am bottom posting this as was expected of me. > >> > > >> > So if I understand correctly the AUTORESIZE flag is present for > adaop2 and NOT for adap3 (which is the partition we are concerned about) - > hence the advice given to not use "geli resize" isn't applicable here. Am I > understanding this correctly? > >> > >> Yes > >> > >> > > >> > > So you need to run "geli resize" > >> > Is this the only command that I need to run to resize my geli > partition? > >> > >> Yes > >> > >> > > >> > > The "-s" flag should be unnecessary since your provider is > >> > already online. > >> > Ok thanks. > >> > > >> > >You might want to make a copy of /var/backups/ada0p3.eli, just in > case you make a mistake. > >> > Don't have the luxury of backup currently. > >> > >> Um, ok. I can't guess why you aren't able to do that, but it isn't > >> strictly necessary. > >> > >> > > >> > I suppose at the end of it - if this works - "geli list" would > reflect the size to be 458G? (vs 290G currently) > >> > And that's the output I can trust to have solved the issue - or is > there more to it? > >> > >> Yes. > > > > > The "-s" flag should be unnecessary since your provider is already > online. > > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I guess > options s is must ? If yes - do I need to put in the exact size down to > bytes from the output of geli list ? Under "Mediasize" ? > > --------------------------------------- > > geli: Option 's' not specified. > > ---------------------------------------- > > Dude, it's easier just to try it, than to ask us. Go for it. The > worst case scenario if you get the argument wrong is that nothing > happens. > > The worst case scenario if you get the argument wrong is that nothing happens. I'm not very sure if I put in the wrong value of s (old size) then "nothing happens" - I would imagine if I put in a size less than the current size then possibly the data after that get's lost? Or if I put in a size greater than the current size then there is a gap in the geli partition? I sense some frustration in your reply - but I'm on a live system and wouldn't want to possibly risk it going kaput at this last step. That's the reason I'm trying to understand what is the best value of s for geli resize and how to obtain it. --000000000000443cc005e8e54696 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 18, 2022 at 12:20 AM Alan= Somers <asomers@freebsd.org&= gt; wrote:
On Sa= t, Sep 17, 2022 at 2:03 PM milky india <milkyindia@gmail.com> wrote:
>
>
>
> On Sat, Sep 17, 2022 at 10:58 PM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 12:52 PM milky india <milkyindia@gmail.com> wrote= :
>> >
>> >
>> >
>> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers <asomers@freebsd.org> wr= ote:
>> >>
>> >> On Sat, Sep 17, 2022 at 12:31 PM milky india <milkyindia@gmail.com= > wrote:
>> >> >
>> >> > Sorry about that, again - I'm not sure what you = mean by bottom-post vs top-post.
>> >> >
>> >> > Be that as it may - I read the geli man page. I was = specifically warned against using "geli resize" since it may not = work as expected https://forums.FreeBSD.org/threads/how-to-extend-z= fs-geli-encrypted-disk-space-not-showing.86447/post-581642
>> >> > Is this advise wrong?
>> >> > > "The geli has autoresize flag which will h= andle the new provider size after gpart resize command."
>> >> > followed by
>> >> > > You are right, no geli resize needed.
>> >> >
>> >> > What would be the correct sequence of commands to fi= x this - Simply "geli resize" ? (the -s option seems to be additi= onal, will it figure it out without providing s?)
>> >> >
>> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers <asomers@freebsd.org> wrote:
>> >>
>> >> top-posting is where you insert your reply above the prev= ious email.
>> >> Bottom posting is where you insert your reply below it, l= ike I'm
>> >> doing.=C2=A0 The forum user said that you shouldn't n= eed to run "geli
>> >> resize" because the AUTORESIZE flag is on.=C2=A0 But= as you can see from
>> >> your "geli list" output, it's actually off.= =C2=A0 So you need to run "geli
>> >> resize".=C2=A0 The "-s" flag should be unn= ecessary since your provider is
>> >> already online.=C2=A0 At any rate, you can try it both wa= ys.=C2=A0 You might
>> >> want to make a copy of /var/backups/ada0p3.eli, just in c= ase you make
>> >> a mistake.
>> >
>> > Thanks - I hope I am bottom posting this as was expected of m= e.
>> >
>> > So if I understand correctly the AUTORESIZE flag is present f= or adaop2 and NOT for adap3 (which is the partition we are concerned about)= - hence the advice given to not use "geli resize" isn't appl= icable here. Am I understanding this correctly?
>>
>> Yes
>>
>> >
>> > > So you need to run "geli resize"
>> > Is this the only command that I need to run to resize my geli= partition?
>>
>> Yes
>>
>> >
>> > > The "-s" flag should be unnecessary since your= provider is
>> > already online.
>> > Ok thanks.
>> >
>> > >You might want to make a copy of /var/backups/ada0p3.eli,= just in case you make a mistake.
>> > Don't have the luxury of backup currently.
>>
>> Um, ok.=C2=A0 I can't guess why you aren't able to do that= , but it isn't
>> strictly necessary.
>>
>> >
>> > I suppose at the end of it - if this works - "geli list&= quot; would reflect the size to be 458G? (vs 290G currently)
>> > And that's the output I can trust to have solved the issu= e - or is there more to it?
>>
>> Yes.
>
> > The "-s" flag should be unnecessary since your provider= is already online.
> When I try to run "geli resize /dev/ada0p3.eli" it complains= . So I guess options s is must ? If yes - do I need to put in the exact siz= e down to bytes from the output of geli list ? Under "Mediasize" = ?
> ---------------------------------------
> geli: Option 's' not specified.
> ----------------------------------------

Dude, it's easier just to try it, than to ask us.=C2=A0 Go for it.=C2= =A0 The
worst case scenario if you get the argument wrong is that nothing
happens.

--000000000000443cc005e8e54696-- From nobody Sat Sep 17 20:30:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVMy85BLnz4cM7Y for ; Sat, 17 Sep 2022 20:30:24 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qk1-f182.google.com (mail-qk1-f182.google.com [209.85.222.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVMy80Lmbz3xSr for ; Sat, 17 Sep 2022 20:30:24 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qk1-f182.google.com with SMTP id 3so17744799qka.5 for ; Sat, 17 Sep 2022 13:30:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date; bh=k5kwUqRgqxUe6z7Ij8ElcP+iSZv8YNTwJPgoZ23KCB8=; b=nG9X/ULhii5i2+fsb9Sa3s4WAcGwFYv4QV0WK3cYd5D51S/xkSI7CitUyP8FuQJoJS bqxuHsW+sbUNb0GNgaFhVtOpGFop6K/JBKkhqdCOND7+mK9Zp8YT2DTApKqkUiaVgl11 yeouS8p4n7ZiHMx14l157Km+/Qx35JG8C+l+aXN3E65mcSJapmhea7q7fgka8FOPHp4q C3XLK8bYl2MMS4aSvFsoU+23s56K7My40gfAkbLOMewp6qQHrnxwU2R2X26HqiIAIATM QWhBX2zNFUyiVQUSlaHL133gMvIx6/x4EkpOFFq2wonpjRKWVL61zF3eJ8asYwRjFIj6 lrpA== X-Gm-Message-State: ACrzQf1TernXqtSHFeSQ2BcPoUfyzmlSJyWRuAm3QX+oKhp9VFK6NSXA zLwFPet+tyLSrlp7Mwe00gUnykcxAzFRqWohiGQ= X-Google-Smtp-Source: AMsMyM6oO3DTFpgauK8hO39oI/UHr/1teYd2UCAxtpoNfZVnevc6kWqb7ZfNzNmZ2YpHFHVRKe9NH3Unzo+xvicD2t4= X-Received: by 2002:a05:620a:99b:b0:6ce:4c0a:3ab2 with SMTP id x27-20020a05620a099b00b006ce4c0a3ab2mr8311787qkx.250.1663446623393; Sat, 17 Sep 2022 13:30:23 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 14:30:12 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4MVMy80Lmbz3xSr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.222.182 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_LONG(-0.99)[-0.993]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.182:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.182:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 2:25 PM milky india wrote: > > > > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india wrote= : >> > >> > >> > >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers wro= te: >> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india w= rote: >> >> > >> >> > >> >> > >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers = wrote: >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> >> >> > >> >> >> > Sorry about that, again - I'm not sure what you mean by bottom-p= ost vs top-post. >> >> >> > >> >> >> > Be that as it may - I read the geli man page. I was specifically= warned against using "geli resize" since it may not work as expected https= ://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-n= ot-showing.86447/post-581642 >> >> >> > Is this advise wrong? >> >> >> > > "The geli has autoresize flag which will handle the new provid= er size after gpart resize command." >> >> >> > followed by >> >> >> > > You are right, no geli resize needed. >> >> >> > >> >> >> > What would be the correct sequence of commands to fix this - Sim= ply "geli resize" ? (the -s option seems to be additional, will it figure i= t out without providing s?) >> >> >> > >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> >> >> >> >> top-posting is where you insert your reply above the previous emai= l. >> >> >> Bottom posting is where you insert your reply below it, like I'm >> >> >> doing. The forum user said that you shouldn't need to run "geli >> >> >> resize" because the AUTORESIZE flag is on. But as you can see fro= m >> >> >> your "geli list" output, it's actually off. So you need to run "g= eli >> >> >> resize". The "-s" flag should be unnecessary since your provider = is >> >> >> already online. At any rate, you can try it both ways. You might >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in case you m= ake >> >> >> a mistake. >> >> > >> >> > Thanks - I hope I am bottom posting this as was expected of me. >> >> > >> >> > So if I understand correctly the AUTORESIZE flag is present for ada= op2 and NOT for adap3 (which is the partition we are concerned about) - hen= ce the advice given to not use "geli resize" isn't applicable here. Am I un= derstanding this correctly? >> >> >> >> Yes >> >> >> >> > >> >> > > So you need to run "geli resize" >> >> > Is this the only command that I need to run to resize my geli parti= tion? >> >> >> >> Yes >> >> >> >> > >> >> > > The "-s" flag should be unnecessary since your provider is >> >> > already online. >> >> > Ok thanks. >> >> > >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, just in = case you make a mistake. >> >> > Don't have the luxury of backup currently. >> >> >> >> Um, ok. I can't guess why you aren't able to do that, but it isn't >> >> strictly necessary. >> >> >> >> > >> >> > I suppose at the end of it - if this works - "geli list" would refl= ect the size to be 458G? (vs 290G currently) >> >> > And that's the output I can trust to have solved the issue - or is = there more to it? >> >> >> >> Yes. >> > >> > > The "-s" flag should be unnecessary since your provider is already o= nline. >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I gue= ss options s is must ? If yes - do I need to put in the exact size down to = bytes from the output of geli list ? Under "Mediasize" ? >> > --------------------------------------- >> > geli: Option 's' not specified. >> > ---------------------------------------- >> >> Dude, it's easier just to try it, than to ask us. Go for it. The >> worst case scenario if you get the argument wrong is that nothing >> happens. > > > > The worst case scenario if you get the argument wrong is that nothing h= appens. > I'm not very sure if I put in the wrong value of s (old size) then "nothi= ng happens" - I would imagine if I put in a size less than the current size= then possibly the data after that get's lost? Or if I put in a size greate= r than the current size then there is a gap in the geli partition? > I sense some frustration in your reply - but I'm on a live system and wou= ldn't want to possibly risk it going kaput at this last step. That's the re= ason I'm trying to understand what is the best value of s for geli resize a= nd how to obtain it. The purpose of the "-s" argument is to tell geli where to find the old label, if the provider isn't already attached. If you supply the wrong argument, then geli won't be able to find the label, and thus won't be able to do anything. It won't destroy any data, and it will always automatically determine the size of the current provider. Of course, if you're worried about losing data, you should always save a copy of /var/backups/ada0p3.eli, as I suggested. -Alan From nobody Sat Sep 17 20:41:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVNCl2YMwz4cPFg for ; Sat, 17 Sep 2022 20:42:11 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oa1-x36.google.com (mail-oa1-x36.google.com [IPv6:2001:4860:4864:20::36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVNCk4vHRz3ylS; Sat, 17 Sep 2022 20:42:10 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oa1-x36.google.com with SMTP id 586e51a60fabf-11e9a7135easo56888415fac.6; Sat, 17 Sep 2022 13:42:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=+CptSgWP/xTMh6PNnDyf8svv7ak18mXo/A62mvNZZIM=; b=Aci3Cg/U8m81+PrUn5h8QYpyAS+wcX0emDwWGp/sweVbzNBAacjko/2CnNJb442QlR k+sttGk0Qz3clOrON7yhGyMtJO+Zg9VJPVIjUi39Lb8hAnwdBVGPz94FsUpBDJc7nzcI GqXE3KJ4L1+B3R/HGseeEBBQhKxj1XW4qhJyPhA9K2y6Iy0xnCkhIv4Ms5pYmftpp09T xHDtz5QTleVF0+ERJMKEL/f/1hyyMUwmO3QD/ion7Vdt+bVrK7yDsBo0Osc8/dELwgQl 9TJFASTTmAYca60nqp6IV5zK/H8t7Bct69s9t2hnjKa4CmOx1DYLlhb5f7pMvsi76jz4 BAkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=+CptSgWP/xTMh6PNnDyf8svv7ak18mXo/A62mvNZZIM=; b=1wfxmwLqyXJa3fuYoqZjxsOW+txlmDC1YJ8WnD+eHGzhqaDf6xZM/IlGwjykM33NxG 9l3iVcEpZcVu5FV20sIQA6LU6Wj4dQ+dIxGllreI3ClQB0wGuQJJ6zaFbtO6ED26Jv0L yuq3ifX5AFJESwwW2FbMRlZ5kfStp7PUeZCj174HIlIWnNQa4VCfdISIQ59WhBlJEQvM 79Hb/unb8vYX220wHo82lKLod54y3OdW0FDpEhDbhP62vN4b68/+Z+PuUqJT+apYGO/x zxN42k0c/nNovqcTmEe3DUo2DOf33Uh7g+VUavar0tZepOunO5Tze7Z/rK/439YSfo96 BJkQ== X-Gm-Message-State: ACgBeo3YZxYTXEVTdPHQRZ8roTlc3vfrFiBL/kp3XRSMTwVaCZ70id8p BtXcCcYCjyBbfc95Xx8BSOc70vfvycNY35sRQyvBE8AOeROJTA== X-Google-Smtp-Source: AA6agR7T9+ZDxjhmnVEU0XQpe5UXan6eui5KB63NV8B+WpP4+QpI3+nXhFhyz3fjQu3BQ99IULg6ZRHfPi3KZnhTUUA= X-Received: by 2002:a05:6871:b2a:b0:12b:91ce:e45b with SMTP id fq42-20020a0568710b2a00b0012b91cee45bmr11775485oab.291.1663447328822; Sat, 17 Sep 2022 13:42:08 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sun, 18 Sep 2022 00:41:59 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="00000000000023199805e8e58366" X-Rspamd-Queue-Id: 4MVNCk4vHRz3ylS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b="Aci3Cg/U"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2001:4860:4864:20::36 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.80 / 15.00]; NEURAL_HAM_SHORT(-0.98)[-0.978]; NEURAL_HAM_MEDIUM(-0.94)[-0.942]; NEURAL_HAM_LONG(-0.88)[-0.885]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2001:4860:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2001:4860:4864:20::36:from]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --00000000000023199805e8e58366 Content-Type: text/plain; charset="UTF-8" On Sun, Sep 18, 2022 at 12:30 AM Alan Somers wrote: > On Sat, Sep 17, 2022 at 2:25 PM milky india wrote: > > > > > > > > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers > wrote: > >> > >> On Sat, Sep 17, 2022 at 2:03 PM milky india > wrote: > >> > > >> > > >> > > >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers > wrote: > >> >> > >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india > wrote: > >> >> > > >> >> > > >> >> > > >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers > wrote: > >> >> >> > >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india < > milkyindia@gmail.com> wrote: > >> >> >> > > >> >> >> > Sorry about that, again - I'm not sure what you mean by > bottom-post vs top-post. > >> >> >> > > >> >> >> > Be that as it may - I read the geli man page. I was > specifically warned against using "geli resize" since it may not work as > expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > >> >> >> > Is this advise wrong? > >> >> >> > > "The geli has autoresize flag which will handle the new > provider size after gpart resize command." > >> >> >> > followed by > >> >> >> > > You are right, no geli resize needed. > >> >> >> > > >> >> >> > What would be the correct sequence of commands to fix this - > Simply "geli resize" ? (the -s option seems to be additional, will it > figure it out without providing s?) > >> >> >> > > >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> > >> >> >> top-posting is where you insert your reply above the previous > email. > >> >> >> Bottom posting is where you insert your reply below it, like I'm > >> >> >> doing. The forum user said that you shouldn't need to run "geli > >> >> >> resize" because the AUTORESIZE flag is on. But as you can see > from > >> >> >> your "geli list" output, it's actually off. So you need to run > "geli > >> >> >> resize". The "-s" flag should be unnecessary since your provider > is > >> >> >> already online. At any rate, you can try it both ways. You might > >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in case you > make > >> >> >> a mistake. > >> >> > > >> >> > Thanks - I hope I am bottom posting this as was expected of me. > >> >> > > >> >> > So if I understand correctly the AUTORESIZE flag is present for > adaop2 and NOT for adap3 (which is the partition we are concerned about) - > hence the advice given to not use "geli resize" isn't applicable here. Am I > understanding this correctly? > >> >> > >> >> Yes > >> >> > >> >> > > >> >> > > So you need to run "geli resize" > >> >> > Is this the only command that I need to run to resize my geli > partition? > >> >> > >> >> Yes > >> >> > >> >> > > >> >> > > The "-s" flag should be unnecessary since your provider is > >> >> > already online. > >> >> > Ok thanks. > >> >> > > >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, just in > case you make a mistake. > >> >> > Don't have the luxury of backup currently. > >> >> > >> >> Um, ok. I can't guess why you aren't able to do that, but it isn't > >> >> strictly necessary. > >> >> > >> >> > > >> >> > I suppose at the end of it - if this works - "geli list" would > reflect the size to be 458G? (vs 290G currently) > >> >> > And that's the output I can trust to have solved the issue - or is > there more to it? > >> >> > >> >> Yes. > >> > > >> > > The "-s" flag should be unnecessary since your provider is already > online. > >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I > guess options s is must ? If yes - do I need to put in the exact size down > to bytes from the output of geli list ? Under "Mediasize" ? > >> > --------------------------------------- > >> > geli: Option 's' not specified. > >> > ---------------------------------------- > >> > >> Dude, it's easier just to try it, than to ask us. Go for it. The > >> worst case scenario if you get the argument wrong is that nothing > >> happens. > > > > > > > The worst case scenario if you get the argument wrong is that nothing > happens. > > I'm not very sure if I put in the wrong value of s (old size) then > "nothing happens" - I would imagine if I put in a size less than the > current size then possibly the data after that get's lost? Or if I put in a > size greater than the current size then there is a gap in the geli > partition? > > I sense some frustration in your reply - but I'm on a live system and > wouldn't want to possibly risk it going kaput at this last step. That's the > reason I'm trying to understand what is the best value of s for geli resize > and how to obtain it. > > The purpose of the "-s" argument is to tell geli where to find the old > label, if the provider isn't already attached. If you supply the > wrong argument, then geli won't be able to find the label, and thus > won't be able to do anything. It won't destroy any data, and it will > always automatically determine the size of the current provider. Of > course, if you're worried about losing data, you should always save a > copy of /var/backups/ada0p3.eli, as I suggested. > -Alan > >The purpose of the "-s" argument is to tell geli where to find the old > label, if the provider isn't already attached. If you supply the > wrong argument, then geli won't be able to find the label, and thus > won't be able to do anything. I think you're confusing the -s argument with something else - the man page says it's for the old size - that's why I was trying to figure it out and still haven't been able to quite yet. Although I suspect the "Mediasize" output for p3 from "geli list" is what the s value should be - but not very sure : ------------------------------------------------------------------------------------------ Additional options include: -s oldsize The size of the provider before it was resized. ------------------------------------------------------------------------------------------------ --00000000000023199805e8e58366 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 18, 2022 at 12:30 AM Alan= Somers <asomers@freebsd.org&= gt; wrote:
On Sa= t, Sep 17, 2022 at 2:25 PM milky india <milkyindia@gmail.com> wrote:
>
>
>
> On Sun, Sep 18, 2022 at 12:20 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 2:03 PM milky india <milkyindia@gmail.com> wrote:=
>> >
>> >
>> >
>> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers <asomers@freebsd.org> wr= ote:
>> >>
>> >> On Sat, Sep 17, 2022 at 12:52 PM milky india <milkyindia@gmail.com= > wrote:
>> >> >
>> >> >
>> >> >
>> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers <asomers@freebsd.org> wrote:
>> >> >>
>> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india <= ;milkyindia@gmail= .com> wrote:
>> >> >> >
>> >> >> > Sorry about that, again - I'm not sure = what you mean by bottom-post vs top-post.
>> >> >> >
>> >> >> > Be that as it may - I read the geli man pag= e. I was specifically warned against using "geli resize" since it= may not work as expected https://forums.FreeBSD.org/threads/how-to= -extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642
>> >> >> > Is this advise wrong?
>> >> >> > > "The geli has autoresize flag whi= ch will handle the new provider size after gpart resize command."
>> >> >> > followed by
>> >> >> > > You are right, no geli resize needed.<= br> >> >> >> >
>> >> >> > What would be the correct sequence of comma= nds to fix this - Simply "geli resize" ? (the -s option seems to = be additional, will it figure it out without providing s?)
>> >> >> >
>> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somer= s <asomers@free= bsd.org> wrote:
>> >> >>
>> >> >> top-posting is where you insert your reply above= the previous email.
>> >> >> Bottom posting is where you insert your reply be= low it, like I'm
>> >> >> doing.=C2=A0 The forum user said that you should= n't need to run "geli
>> >> >> resize" because the AUTORESIZE flag is on.= =C2=A0 But as you can see from
>> >> >> your "geli list" output, it's actu= ally off.=C2=A0 So you need to run "geli
>> >> >> resize".=C2=A0 The "-s" flag shou= ld be unnecessary since your provider is
>> >> >> already online.=C2=A0 At any rate, you can try i= t both ways.=C2=A0 You might
>> >> >> want to make a copy of /var/backups/ada0p3.eli, = just in case you make
>> >> >> a mistake.
>> >> >
>> >> > Thanks - I hope I am bottom posting this as was expe= cted of me.
>> >> >
>> >> > So if I understand correctly the AUTORESIZE flag is = present for adaop2 and NOT for adap3 (which is the partition we are concern= ed about) - hence the advice given to not use "geli resize" isn&#= 39;t applicable here. Am I understanding this correctly?
>> >>
>> >> Yes
>> >>
>> >> >
>> >> > > So you need to run "geli resize"
>> >> > Is this the only command that I need to run to resiz= e my geli partition?
>> >>
>> >> Yes
>> >>
>> >> >
>> >> > > The "-s" flag should be unnecessary s= ince your provider is
>> >> > already online.
>> >> > Ok thanks.
>> >> >
>> >> > >You might want to make a copy of /var/backups/ad= a0p3.eli, just in case you make a mistake.
>> >> > Don't have the luxury of backup currently.
>> >>
>> >> Um, ok.=C2=A0 I can't guess why you aren't able t= o do that, but it isn't
>> >> strictly necessary.
>> >>
>> >> >
>> >> > I suppose at the end of it - if this works - "g= eli list" would reflect the size to be 458G? (vs 290G currently)
>> >> > And that's the output I can trust to have solved= the issue - or is there more to it?
>> >>
>> >> Yes.
>> >
>> > > The "-s" flag should be unnecessary since your= provider is already online.
>> > When I try to run "geli resize /dev/ada0p3.eli" it = complains. So I guess options s is must ? If yes - do I need to put in the = exact size down to bytes from the output of geli list ? Under "Mediasi= ze" ?
>> > ---------------------------------------
>> > geli: Option 's' not specified.
>> > ----------------------------------------
>>
>> Dude, it's easier just to try it, than to ask us.=C2=A0 Go for= it.=C2=A0 The
>> worst case scenario if you get the argument wrong is that nothing<= br> >> happens.
>
>
> > The worst case scenario if you get the argument wrong is that not= hing happens.
> I'm not very sure if I put in the wrong value of s (old size) then= "nothing happens" - I would imagine if I put in a size less than= the current size then possibly the data after that get's lost? Or if I= put in a size greater than the current size then there is a gap in the gel= i partition?
> I sense some frustration in your reply - but I'm on a live system = and wouldn't want to possibly risk it going kaput at this last step. Th= at's the reason I'm trying to understand what is the best value of = s for geli resize and how to obtain it.

The purpose of the "-s" argument is to tell geli where to find th= e old
label, if the provider isn't already attached.=C2=A0 If you supply the<= br> wrong argument, then geli won't be able to find the label, and thus
won't be able to do anything.=C2=A0 It won't destroy any data, and = it will
always automatically determine the size of the current provider.=C2=A0 Of course, if you're worried about losing data, you should always save a copy of /var/backups/ada0p3.eli, as I suggested.
-Alan

=C2=A0>The purpose of the &quo= t;-s" argument is to tell geli where to find the old
> label, = if the provider isn't already attached.=C2=A0 If you supply the
>= wrong argument, then geli won't be able to find the label, and thus> won't be able to do anything.
I think you're confusing the -s argum= ent with something else - the man page says it's for the old size - tha= t's why I was trying to figure it out and still haven't been able t= o quite yet. Although I suspect the "Mediasize" output for p3 fro= m "geli list" is what the s value should be - but not very sure :=
-----------------------------------------------------------------------= -------------------
Additional options incl= ude:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 -s oldsize =C2=A0 =C2=A0 =C2=A0 =C2=A0The size of the provider befor= e it was resized.
---------------------= ---------------------------------------------------------------------------=

--00000000000023199805e8e58366-- From nobody Sat Sep 17 20:44:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVNGT4xZhz4cPZy for ; Sat, 17 Sep 2022 20:44:33 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f52.google.com (mail-qv1-f52.google.com [209.85.219.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVNGS6r5Fz40T9 for ; Sat, 17 Sep 2022 20:44:32 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f52.google.com with SMTP id g4so19199745qvo.3 for ; Sat, 17 Sep 2022 13:44:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date; bh=ovtFai6JUFAj1DPq9jN6AgcRd6aLSkL0UM1g6FENJhQ=; b=tAQ5KCCeLFU1Dv/90LcoPl1Q3at+HeSo6pj8kjcjjOgmQYyW4epYHgD9uvrBpf65jL UW2fQitw7DCleYqFPJX9G20j/yPxQMKCDpOAcuo8RmnQ5G7/0pngDFjF0ID3gxqFJipu JAvWYrPccVLvY7PsN9U9S9WJi4tSer0yLdmbcZkevy3ILpobgyOBSR6bq25qFObX0OdE fMU5jFmzQbfYsVWRK4m/D62ftaTkUP1IXD/v4IrD6touKJwS4hljwo5DewmbRZ6Ajm+x Eimc5vPrGwpib7NdZGBA8lnocNL3A2RKXdbhAPk1KAvBT1k79Wlic4Rs5H1li4sAq8v5 Bydw== X-Gm-Message-State: ACrzQf2Hh+iYfN4ZAErPLhF9hStWNh8Nv0b9pbrIX1uuWlIxmc1bVWrj HKrfn6PAMLm4lJCQHAlRmDOUSxrqRoIVO1nXQO8= X-Google-Smtp-Source: AMsMyM6MTNt47xLBq4IhEQz+6DqomkfhbeG50XX3Dw7u4CDxMeWV19WBxVxouU5JxvLNJq7D5rnjIf38RpJ4x7FS3Jo= X-Received: by 2002:a0c:f1c7:0:b0:474:725e:753e with SMTP id u7-20020a0cf1c7000000b00474725e753emr9400293qvl.49.1663447472227; Sat, 17 Sep 2022 13:44:32 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 14:44:20 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4MVNGS6r5Fz40T9 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.52 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.996]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.52:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.52:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 2:42 PM milky india wrote: > > > > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 2:25 PM milky india wrote= : >> > >> > >> > >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers wro= te: >> >> >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india wr= ote: >> >> > >> >> > >> >> > >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers = wrote: >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: >> >> >> > >> >> >> > >> >> >> > >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> >> >> >> > >> >> >> >> > Sorry about that, again - I'm not sure what you mean by botto= m-post vs top-post. >> >> >> >> > >> >> >> >> > Be that as it may - I read the geli man page. I was specifica= lly warned against using "geli resize" since it may not work as expected ht= tps://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-spac= e-not-showing.86447/post-581642 >> >> >> >> > Is this advise wrong? >> >> >> >> > > "The geli has autoresize flag which will handle the new pro= vider size after gpart resize command." >> >> >> >> > followed by >> >> >> >> > > You are right, no geli resize needed. >> >> >> >> > >> >> >> >> > What would be the correct sequence of commands to fix this - = Simply "geli resize" ? (the -s option seems to be additional, will it figur= e it out without providing s?) >> >> >> >> > >> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> >> >> >> >> >> >> top-posting is where you insert your reply above the previous e= mail. >> >> >> >> Bottom posting is where you insert your reply below it, like I'= m >> >> >> >> doing. The forum user said that you shouldn't need to run "gel= i >> >> >> >> resize" because the AUTORESIZE flag is on. But as you can see = from >> >> >> >> your "geli list" output, it's actually off. So you need to run= "geli >> >> >> >> resize". The "-s" flag should be unnecessary since your provid= er is >> >> >> >> already online. At any rate, you can try it both ways. You mi= ght >> >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in case yo= u make >> >> >> >> a mistake. >> >> >> > >> >> >> > Thanks - I hope I am bottom posting this as was expected of me. >> >> >> > >> >> >> > So if I understand correctly the AUTORESIZE flag is present for = adaop2 and NOT for adap3 (which is the partition we are concerned about) - = hence the advice given to not use "geli resize" isn't applicable here. Am I= understanding this correctly? >> >> >> >> >> >> Yes >> >> >> >> >> >> > >> >> >> > > So you need to run "geli resize" >> >> >> > Is this the only command that I need to run to resize my geli pa= rtition? >> >> >> >> >> >> Yes >> >> >> >> >> >> > >> >> >> > > The "-s" flag should be unnecessary since your provider is >> >> >> > already online. >> >> >> > Ok thanks. >> >> >> > >> >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, just = in case you make a mistake. >> >> >> > Don't have the luxury of backup currently. >> >> >> >> >> >> Um, ok. I can't guess why you aren't able to do that, but it isn'= t >> >> >> strictly necessary. >> >> >> >> >> >> > >> >> >> > I suppose at the end of it - if this works - "geli list" would r= eflect the size to be 458G? (vs 290G currently) >> >> >> > And that's the output I can trust to have solved the issue - or = is there more to it? >> >> >> >> >> >> Yes. >> >> > >> >> > > The "-s" flag should be unnecessary since your provider is alread= y online. >> >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I = guess options s is must ? If yes - do I need to put in the exact size down = to bytes from the output of geli list ? Under "Mediasize" ? >> >> > --------------------------------------- >> >> > geli: Option 's' not specified. >> >> > ---------------------------------------- >> >> >> >> Dude, it's easier just to try it, than to ask us. Go for it. The >> >> worst case scenario if you get the argument wrong is that nothing >> >> happens. >> > >> > >> > > The worst case scenario if you get the argument wrong is that nothin= g happens. >> > I'm not very sure if I put in the wrong value of s (old size) then "no= thing happens" - I would imagine if I put in a size less than the current s= ize then possibly the data after that get's lost? Or if I put in a size gre= ater than the current size then there is a gap in the geli partition? >> > I sense some frustration in your reply - but I'm on a live system and = wouldn't want to possibly risk it going kaput at this last step. That's the= reason I'm trying to understand what is the best value of s for geli resiz= e and how to obtain it. >> >> The purpose of the "-s" argument is to tell geli where to find the old >> label, if the provider isn't already attached. If you supply the >> wrong argument, then geli won't be able to find the label, and thus >> won't be able to do anything. It won't destroy any data, and it will >> always automatically determine the size of the current provider. Of >> course, if you're worried about losing data, you should always save a >> copy of /var/backups/ada0p3.eli, as I suggested. >> -Alan > > > >The purpose of the "-s" argument is to tell geli where to find the old > > label, if the provider isn't already attached. If you supply the > > wrong argument, then geli won't be able to find the label, and thus > > won't be able to do anything. > > I think you're confusing the -s argument with something else - the man pa= ge says it's for the old size - that's why I was trying to figure it out an= d still haven't been able to quite yet. Although I suspect the "Mediasize" = output for p3 from "geli list" is what the s value should be - but not very= sure : > -------------------------------------------------------------------------= ----------------- > Additional options include: > > -s oldsize The size of the provider before it = was resized. > -------------------------------------------------------------------------= ----------------------- Yes, that's right. geli needs to know the old size of the provider in order to find the provider's old label. From nobody Sat Sep 17 20:48:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVNMs5Y8qz4cQKr for ; Sat, 17 Sep 2022 20:49:13 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-oo1-xc32.google.com (mail-oo1-xc32.google.com [IPv6:2607:f8b0:4864:20::c32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVNMr1j8Lz40nG; Sat, 17 Sep 2022 20:49:12 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-oo1-xc32.google.com with SMTP id t4-20020a4aa3c4000000b00475624f2369so3310142ool.3; Sat, 17 Sep 2022 13:49:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=rHz8neZf3swtSHDswhsLxc8kn2I0tIcsr7r1q8VQKJA=; b=G3ARAGdQ68m77J1TdvSiaQT4uFMnrQJMd5YXFwp6kOckahhKN2s9KwYXGifPmCGNVY ctmBbmJgNAu/d2yFNQGCg/6ZyYMuw4OOsJA0HweOyUlDaK5lPKEnEpZOv8dNwfx2kSIs QQ9vfkVmukK+JfERUSNspcRAgpr150pRbQ+tYq5Lasud052R2nE40lmPbMGcBcwoJy60 FAo0EzHT02rD1X54ro0v5szj9PHl7BVLXwJrxWCFeziBdZNFAdGP+BvoTHRWXktJQ1ln N2rfJ/KdqQyE9555EvFx186SGhF3HnnBMkzVBMjxdNXgVZYS7jQ1W0g5IzdVYwoiAR2r 459A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=rHz8neZf3swtSHDswhsLxc8kn2I0tIcsr7r1q8VQKJA=; b=rLYU6ikGjadS846J4c3RMDN+C/2ArZ+i3C+RxVYAv/Ms9rdSqsc3HBScWwP0twemGb 29u4OWlm80EqOiUtNSN081DytmcRk9v9ArwHqHZjfsjv95Um0CXRr2M7Smqs2ovsBEPc EyUAh4UBJVVNw2I/D1R8/UKFoyw8gUHbS7R2ITWJ38EgxWY3Z4oBKnad/UHY5pHWxFfV KroXfeH+Gm9wZOhRRezamaqFZ9AZoYEVfYjG72GUEPgu0j7suqE5tiCORjPf55MyHWyr N9FsNBd5i+hqN8VbiKg4yJIcA+a7HHaDafT4xoKCfZ8hnh+rJUYTLpdcv8uDiIDxcH4V XJxQ== X-Gm-Message-State: ACrzQf3sLDM4c+5o5PxhOZp7s2iX+aV3cidxdkB3S/MyJnZO35MmXBKo CP1vt8BKDe6NBgAADVyGbEu6imr42pwQgvQqcVx28uxSWJSbdw== X-Google-Smtp-Source: AMsMyM5xk0takWJoHh9J33cwgIuRX/UsHB1SyMPTjc2iLXpoW23CXBdlehqmdifZxPxzj2bdnsGOYyR0SDXnRxg8SRM= X-Received: by 2002:a4a:d00f:0:b0:475:6612:c055 with SMTP id h15-20020a4ad00f000000b004756612c055mr4313272oor.25.1663447748988; Sat, 17 Sep 2022 13:49:08 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sun, 18 Sep 2022 00:48:58 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="0000000000002e57d205e8e59ca8" X-Rspamd-Queue-Id: 4MVNMr1j8Lz40nG X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=G3ARAGdQ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::c32 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.92 / 15.00]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_LONG(-0.98)[-0.984]; NEURAL_HAM_MEDIUM(-0.95)[-0.946]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c32:from]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --0000000000002e57d205e8e59ca8 Content-Type: text/plain; charset="UTF-8" On Sun, Sep 18, 2022 at 12:44 AM Alan Somers wrote: > On Sat, Sep 17, 2022 at 2:42 PM milky india wrote: > > > > > > > > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers > wrote: > >> > >> On Sat, Sep 17, 2022 at 2:25 PM milky india > wrote: > >> > > >> > > >> > > >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers > wrote: > >> >> > >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india > wrote: > >> >> > > >> >> > > >> >> > > >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers > wrote: > >> >> >> > >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india < > milkyindia@gmail.com> wrote: > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> >> > >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india < > milkyindia@gmail.com> wrote: > >> >> >> >> > > >> >> >> >> > Sorry about that, again - I'm not sure what you mean by > bottom-post vs top-post. > >> >> >> >> > > >> >> >> >> > Be that as it may - I read the geli man page. I was > specifically warned against using "geli resize" since it may not work as > expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > >> >> >> >> > Is this advise wrong? > >> >> >> >> > > "The geli has autoresize flag which will handle the new > provider size after gpart resize command." > >> >> >> >> > followed by > >> >> >> >> > > You are right, no geli resize needed. > >> >> >> >> > > >> >> >> >> > What would be the correct sequence of commands to fix this - > Simply "geli resize" ? (the -s option seems to be additional, will it > figure it out without providing s?) > >> >> >> >> > > >> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> >> > >> >> >> >> top-posting is where you insert your reply above the previous > email. > >> >> >> >> Bottom posting is where you insert your reply below it, like > I'm > >> >> >> >> doing. The forum user said that you shouldn't need to run > "geli > >> >> >> >> resize" because the AUTORESIZE flag is on. But as you can see > from > >> >> >> >> your "geli list" output, it's actually off. So you need to > run "geli > >> >> >> >> resize". The "-s" flag should be unnecessary since your > provider is > >> >> >> >> already online. At any rate, you can try it both ways. You > might > >> >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in case > you make > >> >> >> >> a mistake. > >> >> >> > > >> >> >> > Thanks - I hope I am bottom posting this as was expected of me. > >> >> >> > > >> >> >> > So if I understand correctly the AUTORESIZE flag is present for > adaop2 and NOT for adap3 (which is the partition we are concerned about) - > hence the advice given to not use "geli resize" isn't applicable here. Am I > understanding this correctly? > >> >> >> > >> >> >> Yes > >> >> >> > >> >> >> > > >> >> >> > > So you need to run "geli resize" > >> >> >> > Is this the only command that I need to run to resize my geli > partition? > >> >> >> > >> >> >> Yes > >> >> >> > >> >> >> > > >> >> >> > > The "-s" flag should be unnecessary since your provider is > >> >> >> > already online. > >> >> >> > Ok thanks. > >> >> >> > > >> >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, just > in case you make a mistake. > >> >> >> > Don't have the luxury of backup currently. > >> >> >> > >> >> >> Um, ok. I can't guess why you aren't able to do that, but it > isn't > >> >> >> strictly necessary. > >> >> >> > >> >> >> > > >> >> >> > I suppose at the end of it - if this works - "geli list" would > reflect the size to be 458G? (vs 290G currently) > >> >> >> > And that's the output I can trust to have solved the issue - or > is there more to it? > >> >> >> > >> >> >> Yes. > >> >> > > >> >> > > The "-s" flag should be unnecessary since your provider is > already online. > >> >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. So I > guess options s is must ? If yes - do I need to put in the exact size down > to bytes from the output of geli list ? Under "Mediasize" ? > >> >> > --------------------------------------- > >> >> > geli: Option 's' not specified. > >> >> > ---------------------------------------- > >> >> > >> >> Dude, it's easier just to try it, than to ask us. Go for it. The > >> >> worst case scenario if you get the argument wrong is that nothing > >> >> happens. > >> > > >> > > >> > > The worst case scenario if you get the argument wrong is that > nothing happens. > >> > I'm not very sure if I put in the wrong value of s (old size) then > "nothing happens" - I would imagine if I put in a size less than the > current size then possibly the data after that get's lost? Or if I put in a > size greater than the current size then there is a gap in the geli > partition? > >> > I sense some frustration in your reply - but I'm on a live system and > wouldn't want to possibly risk it going kaput at this last step. That's the > reason I'm trying to understand what is the best value of s for geli resize > and how to obtain it. > >> > >> The purpose of the "-s" argument is to tell geli where to find the old > >> label, if the provider isn't already attached. If you supply the > >> wrong argument, then geli won't be able to find the label, and thus > >> won't be able to do anything. It won't destroy any data, and it will > >> always automatically determine the size of the current provider. Of > >> course, if you're worried about losing data, you should always save a > >> copy of /var/backups/ada0p3.eli, as I suggested. > >> -Alan > > > > > > >The purpose of the "-s" argument is to tell geli where to find the old > > > label, if the provider isn't already attached. If you supply the > > > wrong argument, then geli won't be able to find the label, and thus > > > won't be able to do anything. > > > > I think you're confusing the -s argument with something else - the man > page says it's for the old size - that's why I was trying to figure it out > and still haven't been able to quite yet. Although I suspect the > "Mediasize" output for p3 from "geli list" is what the s value should be - > but not very sure : > > > ------------------------------------------------------------------------------------------ > > Additional options include: > > > > -s oldsize The size of the provider before it > was resized. > > > ------------------------------------------------------------------------------------------------ > > Yes, that's right. geli needs to know the old size of the provider in > order to find the provider's old label. > Thanks for acknowledging. I tried to do this using the s value from geli list - it won't let me even do it as sudo : Getting a bit scared now. Should I not be writing `.eli` part? ----------------------------------------------------------------- sudo geli resize -s 311481593856 /dev/ada0p3.eli Password: geli: Cannot open /dev/ada0p3.eli: Operation not permitted. sudo geli resize -s 311481593856 ada0p3.eli geli: Cannot open ada0p3.eli: Operation not permitted. --------------------------------------------------------------------------- --0000000000002e57d205e8e59ca8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 18, 2022 at 12:44 AM Alan= Somers <asomers@freebsd.org&= gt; wrote:
On Sa= t, Sep 17, 2022 at 2:42 PM milky india <milkyindia@gmail.com> wrote:
>
>
>
> On Sun, Sep 18, 2022 at 12:30 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 2:25 PM milky india <milkyindia@gmail.com> wrote:=
>> >
>> >
>> >
>> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers <asomers@freebsd.org> wr= ote:
>> >>
>> >> On Sat, Sep 17, 2022 at 2:03 PM milky india <milkyindia@gmail.com= > wrote:
>> >> >
>> >> >
>> >> >
>> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers <asomers@freebsd.org> wrote:
>> >> >>
>> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india <= ;milkyindia@gmail= .com> wrote:
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somer= s <asomers@free= bsd.org> wrote:
>> >> >> >>
>> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky = india <milkyin= dia@gmail.com> wrote:
>> >> >> >> >
>> >> >> >> > Sorry about that, again - I'm = not sure what you mean by bottom-post vs top-post.
>> >> >> >> >
>> >> >> >> > Be that as it may - I read the gel= i man page. I was specifically warned against using "geli resize"= since it may not work as expected https://forums.FreeBSD.org/threa= ds/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-58164= 2
>> >> >> >> > Is this advise wrong?
>> >> >> >> > > "The geli has autoresize= flag which will handle the new provider size after gpart resize command.&q= uot;
>> >> >> >> > followed by
>> >> >> >> > > You are right, no geli resize= needed.
>> >> >> >> >
>> >> >> >> > What would be the correct sequence= of commands to fix this - Simply "geli resize" ? (the -s option = seems to be additional, will it figure it out without providing s?)
>> >> >> >> >
>> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM A= lan Somers <aso= mers@freebsd.org> wrote:
>> >> >> >>
>> >> >> >> top-posting is where you insert your re= ply above the previous email.
>> >> >> >> Bottom posting is where you insert your= reply below it, like I'm
>> >> >> >> doing.=C2=A0 The forum user said that y= ou shouldn't need to run "geli
>> >> >> >> resize" because the AUTORESIZE fla= g is on.=C2=A0 But as you can see from
>> >> >> >> your "geli list" output, it&#= 39;s actually off.=C2=A0 So you need to run "geli
>> >> >> >> resize".=C2=A0 The "-s" = flag should be unnecessary since your provider is
>> >> >> >> already online.=C2=A0 At any rate, you = can try it both ways.=C2=A0 You might
>> >> >> >> want to make a copy of /var/backups/ada= 0p3.eli, just in case you make
>> >> >> >> a mistake.
>> >> >> >
>> >> >> > Thanks - I hope I am bottom posting this as= was expected of me.
>> >> >> >
>> >> >> > So if I understand correctly the AUTORESIZE= flag is present for adaop2 and NOT for adap3 (which is the partition we ar= e concerned about) - hence the advice given to not use "geli resize&qu= ot; isn't applicable here. Am I understanding this correctly?
>> >> >>
>> >> >> Yes
>> >> >>
>> >> >> >
>> >> >> > > So you need to run "geli resize&q= uot;
>> >> >> > Is this the only command that I need to run= to resize my geli partition?
>> >> >>
>> >> >> Yes
>> >> >>
>> >> >> >
>> >> >> > > The "-s" flag should be unne= cessary since your provider is
>> >> >> > already online.
>> >> >> > Ok thanks.
>> >> >> >
>> >> >> > >You might want to make a copy of /var/b= ackups/ada0p3.eli, just in case you make a mistake.
>> >> >> > Don't have the luxury of backup current= ly.
>> >> >>
>> >> >> Um, ok.=C2=A0 I can't guess why you aren'= ;t able to do that, but it isn't
>> >> >> strictly necessary.
>> >> >>
>> >> >> >
>> >> >> > I suppose at the end of it - if this works = - "geli list" would reflect the size to be 458G? (vs 290G current= ly)
>> >> >> > And that's the output I can trust to ha= ve solved the issue - or is there more to it?
>> >> >>
>> >> >> Yes.
>> >> >
>> >> > > The "-s" flag should be unnecessary s= ince your provider is already online.
>> >> > When I try to run "geli resize /dev/ada0p3.eli&= quot; it complains. So I guess options s is must ? If yes - do I need to pu= t in the exact size down to bytes from the output of geli list ? Under &quo= t;Mediasize" ?
>> >> > ---------------------------------------
>> >> > geli: Option 's' not specified.
>> >> > ----------------------------------------
>> >>
>> >> Dude, it's easier just to try it, than to ask us.=C2= =A0 Go for it.=C2=A0 The
>> >> worst case scenario if you get the argument wrong is that= nothing
>> >> happens.
>> >
>> >
>> > > The worst case scenario if you get the argument wrong is= that nothing happens.
>> > I'm not very sure if I put in the wrong value of s (old s= ize) then "nothing happens" - I would imagine if I put in a size = less than the current size then possibly the data after that get's lost= ? Or if I put in a size greater than the current size then there is a gap i= n the geli partition?
>> > I sense some frustration in your reply - but I'm on a liv= e system and wouldn't want to possibly risk it going kaput at this last= step. That's the reason I'm trying to understand what is the best = value of s for geli resize and how to obtain it.
>>
>> The purpose of the "-s" argument is to tell geli where t= o find the old
>> label, if the provider isn't already attached.=C2=A0 If you su= pply the
>> wrong argument, then geli won't be able to find the label, and= thus
>> won't be able to do anything.=C2=A0 It won't destroy any d= ata, and it will
>> always automatically determine the size of the current provider.= =C2=A0 Of
>> course, if you're worried about losing data, you should always= save a
>> copy of /var/backups/ada0p3.eli, as I suggested.
>> -Alan
>
>
>=C2=A0 >The purpose of the "-s" argument is to tell geli w= here to find the old
> > label, if the provider isn't already attached.=C2=A0 If you s= upply the
> > wrong argument, then geli won't be able to find the label, an= d thus
> > won't be able to do anything.
>
> I think you're confusing the -s argument with something else - the= man page says it's for the old size - that's why I was trying to f= igure it out and still haven't been able to quite yet. Although I suspe= ct the "Mediasize" output for p3 from "geli list" is wh= at the s value should be - but not very sure :
> ----------------------------------------------------------------------= --------------------
> Additional options include:
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-s oldsize=C2=A0 =C2=A0 =C2=A0 =C2=A0 The size of the provider before= it was resized.
> ----------------------------------------------------------------------= --------------------------

Yes, that's right.=C2=A0 geli needs to know the old size of the provide= r in
order to find the provider's old label.

=
Thanks for acknowledging. I tried to do this using the s value from ge= li list - it won't let me even do it as sudo :
Getting a bit = scared now. Should I not be writing `.eli` part?=C2=A0
-----------------= ------------------------------------------------
sudo geli resize -s 311= 481593856 /dev/ada0p3.eli
Password:
geli: Cannot open /dev/ada0p3.el= i: Operation not permitted.
sudo geli resize -s 311481593856 ada0p3.el= i
geli: Cannot open ada0p3.eli: Operation not permitted.
--------------------------------------------------------------------------= -=C2=A0
--0000000000002e57d205e8e59ca8-- From nobody Sat Sep 17 20:58:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVNZV0nN1z4cS7b for ; Sat, 17 Sep 2022 20:58:26 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qv1-f42.google.com (mail-qv1-f42.google.com [209.85.219.42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVNZT2lPqz41cp for ; Sat, 17 Sep 2022 20:58:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qv1-f42.google.com with SMTP id y9so19218872qvo.4 for ; Sat, 17 Sep 2022 13:58:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date; bh=4A0v04KjKcEAjYeUL3wu+qF/3wam821JGYJ9Fie8l0M=; b=zfl8r/nN4j4fJZ2GFgvTUd9o0CH6v/zNjMfRDmeRiHqGFx8UQHlXRb+oHKRXT7ID82 tDP1jNA4OQqhYDhJSEyMHnyX3I5XcQzKIzbUM4qRrlU24IwCqbcaRpb5Wy2um7QHONyC 1ZzF7F4FEB5bVqH+C7tKDJBjsPotLrWz0+THHO3LeVHsICVhdNAvHEn2/wVL44LIK9w6 u8NjuYiUAlV/35CBu81ACrYHkeu2TWgSULlixxgE6S2wxfgSaLpvNzPtN6sRwcxiGqNk sOR4WDBL+VUppEjZ/awSnpZHKjhsYLcRMtSpXkY+BUepj3JuAwMXNMFd/ZC+//iPUW6M EEWw== X-Gm-Message-State: ACrzQf0PI/oOig4lklGqAg3WTE1iTKjZzEWL1Avn2OpNgvecTy4wq0gg faLkPBYBHmMrvoYrhq4v34X1/nhsbP12jGOabG9xNE4X X-Google-Smtp-Source: AMsMyM6Hj9vafkQ+x5vpg6fCzTxgWT5ksV6uEctOe3UmhQDwpYhXPgyuUNqSCjUKrE7aEQUKg3Vnm4+v6P9EKj1dkaQ= X-Received: by 2002:a05:6214:2249:b0:4ad:2e1b:4741 with SMTP id c9-20020a056214224900b004ad2e1b4741mr1921425qvc.94.1663448304661; Sat, 17 Sep 2022 13:58:24 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 14:58:12 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4MVNZT2lPqz41cp X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.219.42 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.219.42:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.219.42:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 2:49 PM milky india wrote: > > > > On Sun, Sep 18, 2022 at 12:44 AM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 2:42 PM milky india wrote= : >> > >> > >> > >> > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers wro= te: >> >> >> >> On Sat, Sep 17, 2022 at 2:25 PM milky india wr= ote: >> >> > >> >> > >> >> > >> >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers = wrote: >> >> >> >> >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india = wrote: >> >> >> > >> >> >> > >> >> >> > >> >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers wrote: >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: >> >> >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> >> >> >> >> > >> >> >> >> >> > Sorry about that, again - I'm not sure what you mean by bo= ttom-post vs top-post. >> >> >> >> >> > >> >> >> >> >> > Be that as it may - I read the geli man page. I was specif= ically warned against using "geli resize" since it may not work as expected= https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-s= pace-not-showing.86447/post-581642 >> >> >> >> >> > Is this advise wrong? >> >> >> >> >> > > "The geli has autoresize flag which will handle the new = provider size after gpart resize command." >> >> >> >> >> > followed by >> >> >> >> >> > > You are right, no geli resize needed. >> >> >> >> >> > >> >> >> >> >> > What would be the correct sequence of commands to fix this= - Simply "geli resize" ? (the -s option seems to be additional, will it fi= gure it out without providing s?) >> >> >> >> >> > >> >> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> >> >> >> >> >> >> >> >> top-posting is where you insert your reply above the previou= s email. >> >> >> >> >> Bottom posting is where you insert your reply below it, like= I'm >> >> >> >> >> doing. The forum user said that you shouldn't need to run "= geli >> >> >> >> >> resize" because the AUTORESIZE flag is on. But as you can s= ee from >> >> >> >> >> your "geli list" output, it's actually off. So you need to = run "geli >> >> >> >> >> resize". The "-s" flag should be unnecessary since your pro= vider is >> >> >> >> >> already online. At any rate, you can try it both ways. You= might >> >> >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in case= you make >> >> >> >> >> a mistake. >> >> >> >> > >> >> >> >> > Thanks - I hope I am bottom posting this as was expected of m= e. >> >> >> >> > >> >> >> >> > So if I understand correctly the AUTORESIZE flag is present f= or adaop2 and NOT for adap3 (which is the partition we are concerned about)= - hence the advice given to not use "geli resize" isn't applicable here. A= m I understanding this correctly? >> >> >> >> >> >> >> >> Yes >> >> >> >> >> >> >> >> > >> >> >> >> > > So you need to run "geli resize" >> >> >> >> > Is this the only command that I need to run to resize my geli= partition? >> >> >> >> >> >> >> >> Yes >> >> >> >> >> >> >> >> > >> >> >> >> > > The "-s" flag should be unnecessary since your provider is >> >> >> >> > already online. >> >> >> >> > Ok thanks. >> >> >> >> > >> >> >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, ju= st in case you make a mistake. >> >> >> >> > Don't have the luxury of backup currently. >> >> >> >> >> >> >> >> Um, ok. I can't guess why you aren't able to do that, but it i= sn't >> >> >> >> strictly necessary. >> >> >> >> >> >> >> >> > >> >> >> >> > I suppose at the end of it - if this works - "geli list" woul= d reflect the size to be 458G? (vs 290G currently) >> >> >> >> > And that's the output I can trust to have solved the issue - = or is there more to it? >> >> >> >> >> >> >> >> Yes. >> >> >> > >> >> >> > > The "-s" flag should be unnecessary since your provider is alr= eady online. >> >> >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. So= I guess options s is must ? If yes - do I need to put in the exact size do= wn to bytes from the output of geli list ? Under "Mediasize" ? >> >> >> > --------------------------------------- >> >> >> > geli: Option 's' not specified. >> >> >> > ---------------------------------------- >> >> >> >> >> >> Dude, it's easier just to try it, than to ask us. Go for it. The >> >> >> worst case scenario if you get the argument wrong is that nothing >> >> >> happens. >> >> > >> >> > >> >> > > The worst case scenario if you get the argument wrong is that not= hing happens. >> >> > I'm not very sure if I put in the wrong value of s (old size) then = "nothing happens" - I would imagine if I put in a size less than the curren= t size then possibly the data after that get's lost? Or if I put in a size = greater than the current size then there is a gap in the geli partition? >> >> > I sense some frustration in your reply - but I'm on a live system a= nd wouldn't want to possibly risk it going kaput at this last step. That's = the reason I'm trying to understand what is the best value of s for geli re= size and how to obtain it. >> >> >> >> The purpose of the "-s" argument is to tell geli where to find the ol= d >> >> label, if the provider isn't already attached. If you supply the >> >> wrong argument, then geli won't be able to find the label, and thus >> >> won't be able to do anything. It won't destroy any data, and it will >> >> always automatically determine the size of the current provider. Of >> >> course, if you're worried about losing data, you should always save a >> >> copy of /var/backups/ada0p3.eli, as I suggested. >> >> -Alan >> > >> > >> > >The purpose of the "-s" argument is to tell geli where to find the o= ld >> > > label, if the provider isn't already attached. If you supply the >> > > wrong argument, then geli won't be able to find the label, and thus >> > > won't be able to do anything. >> > >> > I think you're confusing the -s argument with something else - the man= page says it's for the old size - that's why I was trying to figure it out= and still haven't been able to quite yet. Although I suspect the "Mediasiz= e" output for p3 from "geli list" is what the s value should be - but not v= ery sure : >> > ----------------------------------------------------------------------= -------------------- >> > Additional options include: >> > >> > -s oldsize The size of the provider before = it was resized. >> > ----------------------------------------------------------------------= -------------------------- >> >> Yes, that's right. geli needs to know the old size of the provider in >> order to find the provider's old label. > > > Thanks for acknowledging. I tried to do this using the s value from geli = list - it won't let me even do it as sudo : > Getting a bit scared now. Should I not be writing `.eli` part? > ----------------------------------------------------------------- > sudo geli resize -s 311481593856 /dev/ada0p3.eli > Password: > geli: Cannot open /dev/ada0p3.eli: Operation not permitted. > sudo geli resize -s 311481593856 ada0p3.eli > geli: Cannot open ada0p3.eli: Operation not permitted. > -------------------------------------------------------------------------= -- Yes, you normally would not write the ".eli", because "geli resize" is normally used when geli is not attached. But it seems like you're currently booted from this device, right? In that case, detaching it isn't an easy option for you. If you like, you could try automatic expansion instead. First enable it. If it doesn't automatically expand when you enable that option, then you may have to "gpart resize" again. You can enable it with "geli configure -r /dev/ada0p3". From nobody Sat Sep 17 21:20:40 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVP4N2DRSz4cVsZ for ; Sat, 17 Sep 2022 21:20:52 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: from mail-ot1-x334.google.com (mail-ot1-x334.google.com [IPv6:2607:f8b0:4864:20::334]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVP4M4lHQz43v0; Sat, 17 Sep 2022 21:20:51 +0000 (UTC) (envelope-from milkyindia@gmail.com) Received: by mail-ot1-x334.google.com with SMTP id x23-20020a056830409700b00655c6dace73so14996948ott.11; Sat, 17 Sep 2022 14:20:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=cgTVUOJGo+c7C8aMlfD02vIq4b+WHb0noQ/YYuerNfY=; b=Ts1OceD0VBRABVTVc0nHeBFl41LHx7c3ivl4otYzpHz0odQhyRqjq/KUYag36AU123 kxPX4OWSQ5XwEd2QJxgclWgg+jLRYfIH6FICKlMPgi82ADE5xQT5gLbnzoxzmzSFFewL h0lG+zesByMhaMSjtiiOtnVKYbRrlKEMd3JU1ZwErSzzRV96WgKebvx2BwCRBbzIUzfR bgUrTFVjrUA8nJtN+nxS1aTaBm07sKOsC/5slNozeF+dNm2rWSOIg7v7DcE0AET+DtAt HE9RpVHetdQ7/l3tIoKlCVXfsGp5vZKuprXCvask6uhKEFQdwNoq2Mh8jEM0TGuS34X3 +Bag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=cgTVUOJGo+c7C8aMlfD02vIq4b+WHb0noQ/YYuerNfY=; b=YEGuTXlo1vwRZ+BWGT6vHF0iSgeEinuXJLjhiDEYfAxksYeuNIlEtIymxweDtTaERG yZmg+7JZ+zFPFeGspDVvOWHMtcoVa7GJuBAZQCuNCEyz/FKWhG1GEBqa8nO6VqMW8dhB ddMDpbgXBp3Be+u1c3HwzV49KSof5nEVCStyXsg88hTiHRbmyILYoptzZP7IpxgzjN+p HVuAg1/Cr/A3u3r1KlOo3bYH6mRUPpR/1Jnem4jQ0+fam3YubdyeXmApvFxCgk+y0GXI WEsNEtTj2cBidv+gNp8S5nZbhKMGzo/8bNhMsnUb2cDuWqAWaysBO0lkBoUN6Hm0ERk6 uRgA== X-Gm-Message-State: ACrzQf2Uaz9R2IS6px4NR+Hd78jtfwm+PQ+d4l30Is1IW1DoaByBl1EH IlRj/ywLbCb7QELtpVIQMObcN570aj0m8GchJCcRW5eu1xgCAw== X-Google-Smtp-Source: AMsMyM7SdmAicYgl5UwZ7Frwpkx2iA4hj73WSbFTeCRYeWa5UF+2LnrJ0f7xO+wvbIunt5NWDPqG8l4OFIhx4HIPY7A= X-Received: by 2002:a9d:1781:0:b0:639:39ee:9c4c with SMTP id j1-20020a9d1781000000b0063939ee9c4cmr5175591otj.234.1663449650155; Sat, 17 Sep 2022 14:20:50 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: milky india Date: Sun, 18 Sep 2022 01:20:40 +0400 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: Alan Somers Cc: freebsd-fs Content-Type: multipart/alternative; boundary="0000000000007fd3ae05e8e60d4f" X-Rspamd-Queue-Id: 4MVP4M4lHQz43v0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Ts1OceD0; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of milkyindia@gmail.com designates 2607:f8b0:4864:20::334 as permitted sender) smtp.mailfrom=milkyindia@gmail.com X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; NEURAL_HAM_LONG(-0.99)[-0.985]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::334:from]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N --0000000000007fd3ae05e8e60d4f Content-Type: text/plain; charset="UTF-8" On Sun, Sep 18, 2022 at 12:58 AM Alan Somers wrote: > On Sat, Sep 17, 2022 at 2:49 PM milky india wrote: > > > > > > > > On Sun, Sep 18, 2022 at 12:44 AM Alan Somers > wrote: > >> > >> On Sat, Sep 17, 2022 at 2:42 PM milky india > wrote: > >> > > >> > > >> > > >> > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers > wrote: > >> >> > >> >> On Sat, Sep 17, 2022 at 2:25 PM milky india > wrote: > >> >> > > >> >> > > >> >> > > >> >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers > wrote: > >> >> >> > >> >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india > wrote: > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> >> > >> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india < > milkyindia@gmail.com> wrote: > >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > >> >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> >> >> > >> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india < > milkyindia@gmail.com> wrote: > >> >> >> >> >> > > >> >> >> >> >> > Sorry about that, again - I'm not sure what you mean by > bottom-post vs top-post. > >> >> >> >> >> > > >> >> >> >> >> > Be that as it may - I read the geli man page. I was > specifically warned against using "geli resize" since it may not work as > expected > https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/post-581642 > >> >> >> >> >> > Is this advise wrong? > >> >> >> >> >> > > "The geli has autoresize flag which will handle the new > provider size after gpart resize command." > >> >> >> >> >> > followed by > >> >> >> >> >> > > You are right, no geli resize needed. > >> >> >> >> >> > > >> >> >> >> >> > What would be the correct sequence of commands to fix > this - Simply "geli resize" ? (the -s option seems to be additional, will > it figure it out without providing s?) > >> >> >> >> >> > > >> >> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers < > asomers@freebsd.org> wrote: > >> >> >> >> >> > >> >> >> >> >> top-posting is where you insert your reply above the > previous email. > >> >> >> >> >> Bottom posting is where you insert your reply below it, > like I'm > >> >> >> >> >> doing. The forum user said that you shouldn't need to run > "geli > >> >> >> >> >> resize" because the AUTORESIZE flag is on. But as you can > see from > >> >> >> >> >> your "geli list" output, it's actually off. So you need to > run "geli > >> >> >> >> >> resize". The "-s" flag should be unnecessary since your > provider is > >> >> >> >> >> already online. At any rate, you can try it both ways. > You might > >> >> >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in > case you make > >> >> >> >> >> a mistake. > >> >> >> >> > > >> >> >> >> > Thanks - I hope I am bottom posting this as was expected of > me. > >> >> >> >> > > >> >> >> >> > So if I understand correctly the AUTORESIZE flag is present > for adaop2 and NOT for adap3 (which is the partition we are concerned > about) - hence the advice given to not use "geli resize" isn't applicable > here. Am I understanding this correctly? > >> >> >> >> > >> >> >> >> Yes > >> >> >> >> > >> >> >> >> > > >> >> >> >> > > So you need to run "geli resize" > >> >> >> >> > Is this the only command that I need to run to resize my > geli partition? > >> >> >> >> > >> >> >> >> Yes > >> >> >> >> > >> >> >> >> > > >> >> >> >> > > The "-s" flag should be unnecessary since your provider is > >> >> >> >> > already online. > >> >> >> >> > Ok thanks. > >> >> >> >> > > >> >> >> >> > >You might want to make a copy of /var/backups/ada0p3.eli, > just in case you make a mistake. > >> >> >> >> > Don't have the luxury of backup currently. > >> >> >> >> > >> >> >> >> Um, ok. I can't guess why you aren't able to do that, but it > isn't > >> >> >> >> strictly necessary. > >> >> >> >> > >> >> >> >> > > >> >> >> >> > I suppose at the end of it - if this works - "geli list" > would reflect the size to be 458G? (vs 290G currently) > >> >> >> >> > And that's the output I can trust to have solved the issue - > or is there more to it? > >> >> >> >> > >> >> >> >> Yes. > >> >> >> > > >> >> >> > > The "-s" flag should be unnecessary since your provider is > already online. > >> >> >> > When I try to run "geli resize /dev/ada0p3.eli" it complains. > So I guess options s is must ? If yes - do I need to put in the exact size > down to bytes from the output of geli list ? Under "Mediasize" ? > >> >> >> > --------------------------------------- > >> >> >> > geli: Option 's' not specified. > >> >> >> > ---------------------------------------- > >> >> >> > >> >> >> Dude, it's easier just to try it, than to ask us. Go for it. The > >> >> >> worst case scenario if you get the argument wrong is that nothing > >> >> >> happens. > >> >> > > >> >> > > >> >> > > The worst case scenario if you get the argument wrong is that > nothing happens. > >> >> > I'm not very sure if I put in the wrong value of s (old size) then > "nothing happens" - I would imagine if I put in a size less than the > current size then possibly the data after that get's lost? Or if I put in a > size greater than the current size then there is a gap in the geli > partition? > >> >> > I sense some frustration in your reply - but I'm on a live system > and wouldn't want to possibly risk it going kaput at this last step. That's > the reason I'm trying to understand what is the best value of s for geli > resize and how to obtain it. > >> >> > >> >> The purpose of the "-s" argument is to tell geli where to find the > old > >> >> label, if the provider isn't already attached. If you supply the > >> >> wrong argument, then geli won't be able to find the label, and thus > >> >> won't be able to do anything. It won't destroy any data, and it will > >> >> always automatically determine the size of the current provider. Of > >> >> course, if you're worried about losing data, you should always save a > >> >> copy of /var/backups/ada0p3.eli, as I suggested. > >> >> -Alan > >> > > >> > > >> > >The purpose of the "-s" argument is to tell geli where to find the > old > >> > > label, if the provider isn't already attached. If you supply the > >> > > wrong argument, then geli won't be able to find the label, and thus > >> > > won't be able to do anything. > >> > > >> > I think you're confusing the -s argument with something else - the > man page says it's for the old size - that's why I was trying to figure it > out and still haven't been able to quite yet. Although I suspect the > "Mediasize" output for p3 from "geli list" is what the s value should be - > but not very sure : > >> > > ------------------------------------------------------------------------------------------ > >> > Additional options include: > >> > > >> > -s oldsize The size of the provider before > it was resized. > >> > > ------------------------------------------------------------------------------------------------ > >> > >> Yes, that's right. geli needs to know the old size of the provider in > >> order to find the provider's old label. > > > > > > Thanks for acknowledging. I tried to do this using the s value from geli > list - it won't let me even do it as sudo : > > Getting a bit scared now. Should I not be writing `.eli` part? > > ----------------------------------------------------------------- > > sudo geli resize -s 311481593856 /dev/ada0p3.eli > > Password: > > geli: Cannot open /dev/ada0p3.eli: Operation not permitted. > > sudo geli resize -s 311481593856 ada0p3.eli > > geli: Cannot open ada0p3.eli: Operation not permitted. > > > --------------------------------------------------------------------------- > > Yes, you normally would not write the ".eli", because "geli resize" is > normally used when geli is not attached. But it seems like you're > currently booted from this device, right? In that case, detaching it > isn't an easy option for you. If you like, you could try automatic > expansion instead. First enable it. If it doesn't automatically > expand when you enable that option, then you may have to "gpart > resize" again. You can enable it with "geli configure -r > /dev/ada0p3". > >Yes, you normally would not write the ".eli", because "geli resize" is > normally used when geli is not attached.But it seems like you're > currently booted from this device, right? Yes - on a live system. > You can enable it with "geli configure -r /dev/ada0p3". Seems to have run without any output : ---------------------------------- geli configure -r /dev/ada0p3 -------------------------------------------- But geli list output hasn't changed apparently ---------------------------------------------------- geli list Geom name: ada0p3.eli State: ACTIVE EncryptionAlgorithm: AES-XTS KeyLength: 256 Crypto: accelerated software Version: 7 UsedKey: 0 Flags: BOOT, GELIBOOT KeysAllocated: 73 KeysTotal: 73 Providers: 1. Name: ada0p3.eli Mediasize: 311481593856 (290G) Sectorsize: 4096 Mode: r1w1e1 Consumers: 1. Name: ada0p3 Mediasize: 491516858368 (458G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 8590983168 Mode: r1w1e1 Geom name: ada0p2.eli -------------------------------------------------------------------- Is it supposed to show up after a restart? Or did it just not work? I'm just so lost now - hoping I can even restart the machine and data isn't lost/corrupted :( --0000000000007fd3ae05e8e60d4f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 18, 2022 at 12:58 AM Alan= Somers <asomers@freebsd.org&= gt; wrote:
On Sa= t, Sep 17, 2022 at 2:49 PM milky india <milkyindia@gmail.com> wrote:
>
>
>
> On Sun, Sep 18, 2022 at 12:44 AM Alan Somers <asomers@freebsd.org> wrote:
>>
>> On Sat, Sep 17, 2022 at 2:42 PM milky india <milkyindia@gmail.com> wrote:=
>> >
>> >
>> >
>> > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers <asomers@freebsd.org> wr= ote:
>> >>
>> >> On Sat, Sep 17, 2022 at 2:25 PM milky india <milkyindia@gmail.com= > wrote:
>> >> >
>> >> >
>> >> >
>> >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers <asomers@freebsd.org> wrote:
>> >> >>
>> >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india <= milkyindia@gmail.= com> wrote:
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somer= s <asomers@free= bsd.org> wrote:
>> >> >> >>
>> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky = india <milkyin= dia@gmail.com> wrote:
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM A= lan Somers <aso= mers@freebsd.org> wrote:
>> >> >> >> >>
>> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 = PM milky india <milkyindia@gmail.com> wrote:
>> >> >> >> >> >
>> >> >> >> >> > Sorry about that, again -= I'm not sure what you mean by bottom-post vs top-post.
>> >> >> >> >> >
>> >> >> >> >> > Be that as it may - I rea= d the geli man page. I was specifically warned against using "geli res= ize" since it may not work as expected https://forums.FreeBSD.= org/threads/how-to-extend-zfs-geli-encrypted-disk-space-not-showing.86447/p= ost-581642
>> >> >> >> >> > Is this advise wrong?
>> >> >> >> >> > > "The geli has a= utoresize flag which will handle the new provider size after gpart resize c= ommand."
>> >> >> >> >> > followed by
>> >> >> >> >> > > You are right, no ge= li resize needed.
>> >> >> >> >> >
>> >> >> >> >> > What would be the correct= sequence of commands to fix this - Simply "geli resize" ? (the -= s option seems to be additional, will it figure it out without providing s?= )
>> >> >> >> >> >
>> >> >> >> >> > On Sat, Sep 17, 2022 at 1= 0:20 PM Alan Somers <asomers@freebsd.org> wrote:
>> >> >> >> >>
>> >> >> >> >> top-posting is where you inser= t your reply above the previous email.
>> >> >> >> >> Bottom posting is where you in= sert your reply below it, like I'm
>> >> >> >> >> doing.=C2=A0 The forum user sa= id that you shouldn't need to run "geli
>> >> >> >> >> resize" because the AUTOR= ESIZE flag is on.=C2=A0 But as you can see from
>> >> >> >> >> your "geli list" out= put, it's actually off.=C2=A0 So you need to run "geli
>> >> >> >> >> resize".=C2=A0 The "= -s" flag should be unnecessary since your provider is
>> >> >> >> >> already online.=C2=A0 At any r= ate, you can try it both ways.=C2=A0 You might
>> >> >> >> >> want to make a copy of /var/ba= ckups/ada0p3.eli, just in case you make
>> >> >> >> >> a mistake.
>> >> >> >> >
>> >> >> >> > Thanks - I hope I am bottom postin= g this as was expected of me.
>> >> >> >> >
>> >> >> >> > So if I understand correctly the A= UTORESIZE flag is present for adaop2 and NOT for adap3 (which is the partit= ion we are concerned about) - hence the advice given to not use "geli = resize" isn't applicable here. Am I understanding this correctly?<= br> >> >> >> >>
>> >> >> >> Yes
>> >> >> >>
>> >> >> >> >
>> >> >> >> > > So you need to run "geli= resize"
>> >> >> >> > Is this the only command that I ne= ed to run to resize my geli partition?
>> >> >> >>
>> >> >> >> Yes
>> >> >> >>
>> >> >> >> >
>> >> >> >> > > The "-s" flag shoul= d be unnecessary since your provider is
>> >> >> >> > already online.
>> >> >> >> > Ok thanks.
>> >> >> >> >
>> >> >> >> > >You might want to make a copy = of /var/backups/ada0p3.eli, just in case you make a mistake.
>> >> >> >> > Don't have the luxury of backu= p currently.
>> >> >> >>
>> >> >> >> Um, ok.=C2=A0 I can't guess why you= aren't able to do that, but it isn't
>> >> >> >> strictly necessary.
>> >> >> >>
>> >> >> >> >
>> >> >> >> > I suppose at the end of it - if th= is works - "geli list" would reflect the size to be 458G? (vs 290= G currently)
>> >> >> >> > And that's the output I can tr= ust to have solved the issue - or is there more to it?
>> >> >> >>
>> >> >> >> Yes.
>> >> >> >
>> >> >> > > The "-s" flag should be unne= cessary since your provider is already online.
>> >> >> > When I try to run "geli resize /dev/ad= a0p3.eli" it complains. So I guess options s is must ? If yes - do I n= eed to put in the exact size down to bytes from the output of geli list ? U= nder "Mediasize" ?
>> >> >> > ---------------------------------------
>> >> >> > geli: Option 's' not specified.
>> >> >> > ---------------------------------------- >> >> >>
>> >> >> Dude, it's easier just to try it, than to as= k us.=C2=A0 Go for it.=C2=A0 The
>> >> >> worst case scenario if you get the argument wron= g is that nothing
>> >> >> happens.
>> >> >
>> >> >
>> >> > > The worst case scenario if you get the argument= wrong is that nothing happens.
>> >> > I'm not very sure if I put in the wrong value of= s (old size) then "nothing happens" - I would imagine if I put i= n a size less than the current size then possibly the data after that get&#= 39;s lost? Or if I put in a size greater than the current size then there i= s a gap in the geli partition?
>> >> > I sense some frustration in your reply - but I'm= on a live system and wouldn't want to possibly risk it going kaput at = this last step. That's the reason I'm trying to understand what is = the best value of s for geli resize and how to obtain it.
>> >>
>> >> The purpose of the "-s" argument is to tell gel= i where to find the old
>> >> label, if the provider isn't already attached.=C2=A0 = If you supply the
>> >> wrong argument, then geli won't be able to find the l= abel, and thus
>> >> won't be able to do anything.=C2=A0 It won't dest= roy any data, and it will
>> >> always automatically determine the size of the current pr= ovider.=C2=A0 Of
>> >> course, if you're worried about losing data, you shou= ld always save a
>> >> copy of /var/backups/ada0p3.eli, as I suggested.
>> >> -Alan
>> >
>> >
>> >=C2=A0 >The purpose of the "-s" argument is to te= ll geli where to find the old
>> > > label, if the provider isn't already attached.=C2=A0= If you supply the
>> > > wrong argument, then geli won't be able to find the = label, and thus
>> > > won't be able to do anything.
>> >
>> > I think you're confusing the -s argument with something e= lse - the man page says it's for the old size - that's why I was tr= ying to figure it out and still haven't been able to quite yet. Althoug= h I suspect the "Mediasize" output for p3 from "geli list&qu= ot; is what the s value should be - but not very sure :
>> > -------------------------------------------------------------= -----------------------------
>> > Additional options include:
>> >
>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0-s oldsize=C2=A0 =C2=A0 =C2=A0 =C2=A0 The size of the provide= r before it was resized.
>> > -------------------------------------------------------------= -----------------------------------
>>
>> Yes, that's right.=C2=A0 geli needs to know the old size of th= e provider in
>> order to find the provider's old label.
>
>
> Thanks for acknowledging. I tried to do this using the s value from ge= li list - it won't let me even do it as sudo :
> Getting a bit scared now. Should I not be writing `.eli` part?
> -----------------------------------------------------------------
> sudo geli resize -s 311481593856 /dev/ada0p3.eli
> Password:
> geli: Cannot open /dev/ada0p3.eli: Operation not permitted.
> sudo geli resize -s 311481593856 ada0p3.eli
> geli: Cannot open ada0p3.eli: Operation not permitted.
> ----------------------------------------------------------------------= -----

Yes, you normally would not write the ".eli", because "geli = resize" is
normally used when geli is not attached.=C2=A0 But it seems like you're=
currently booted from this device, right?=C2=A0 In that case, detaching it<= br> isn't an easy option for you.=C2=A0 If you like, you could try automati= c
expansion instead.=C2=A0 First enable it.=C2=A0 If it doesn't automatic= ally
expand when you enable that option, then you may have to "gpart
resize" again.=C2=A0 You can enable it with "geli configure -r /dev/ada0p3".
=C2=A0>Yes, you normally would n= ot write the ".eli", because "geli resize" is
>= normally used when geli is not attached.But it seems like you're
= > currently booted from this device, right?
Yes - on a live system.= =C2=A0

> You can enable it with "geli conf= igure -r /dev/ada0p3".
Seems to have run without any output = :
----------------------------------
geli configure -r = /dev/ada0p3
--------------------------------------------
But geli list output hasn't changed apparently
--------= --------------------------------------------
geli list
Geom na= me: ada0p3.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLengt= h: 256
Crypto: accelerated software
Version: 7
UsedKey: 0
Flags= : BOOT, GELIBOOT
KeysAllocated: 73
KeysTotal: 73
Providers:
1. = Name: ada0p3.eli
=C2=A0 =C2=A0Mediasize: 311481593856 (290G)
=C2=A0 = =C2=A0Sectorsize: 4096
=C2=A0 =C2=A0Mode: r1w1e1
Consumers:
1. Nam= e: ada0p3
=C2=A0 =C2=A0Mediasize: 491516858368 (458G)
=C2=A0 =C2=A0Se= ctorsize: 512
=C2=A0 =C2=A0Stripesize: 0
=C2=A0 =C2=A0Stripeoffset: 8= 590983168
=C2=A0 =C2=A0Mode: r1w1e1

Geom name: ada0p2.eli
--------------------------------------------------------------------=
Is it supposed to show up after a restart?=C2=A0
Or di= d it just not work?
I'm just so lost now - hoping I can even = restart the machine and data isn't lost/corrupted :(
--0000000000007fd3ae05e8e60d4f-- From nobody Sat Sep 17 21:47:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MVPg16j0vz4cZhH for ; Sat, 17 Sep 2022 21:47:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qt1-f172.google.com (mail-qt1-f172.google.com [209.85.160.172]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MVPg10lQZz45wq for ; Sat, 17 Sep 2022 21:47:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qt1-f172.google.com with SMTP id y2so18370731qtv.5 for ; Sat, 17 Sep 2022 14:47:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date; bh=NDXyAUV77LvNCTJ+WJlo7L1c2tQESvFESt/GncBEs/w=; b=xnG2LUZ49tfHE+F3R5SI71qOzJHAIpl3EdAnllLaJm3dy0QKCQSqGLWe3mYPZohEbB E+iAAROazFnQbVjxDnVwK2L7qMH3WK1/PXjWEOy1qQcwzP7FlNY3PIIKgnRV8J8bAkis 3IWNqG1IOOXEwOlloEj0cOuVw+ptvXOJA+oxcKYlOvntxN7MsAfFsKB1QNaRY94uK+/+ qtQjj9PWhPp/A9cnIkjmF8tnSBNWaEABhE6FZkSNMR2k1bXy73td8wbr+XeEIeI2X0nt 7ufepbCYo1N4duJ4BMXT5469GCDoekq39ZK5pHREx77B1qBadIDoxZgytCOFB9eitnyn XUhw== X-Gm-Message-State: ACrzQf1b3pW9/5JLFMy0Qy25c8+TSC5xCaz3thjKaVnxcgp8STIQk38W L1VZOy9nCznKSknerq0xlCMdYQ7RS+lnbTvDBfbfZC4i X-Google-Smtp-Source: AMsMyM4/jrpC3rMSvpkMfmUFU6JlFDVipxQYSvsdZLEpDuPXGXYdNLJDYD6YRsPniiymxGWn8FQGptFUuipqwU3f5kA= X-Received: by 2002:ac8:59c4:0:b0:35c:c83b:a202 with SMTP id f4-20020ac859c4000000b0035cc83ba202mr9434636qtf.575.1663451244132; Sat, 17 Sep 2022 14:47:24 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 17 Sep 2022 15:47:12 -0600 Message-ID: Subject: Re: Need help with live system expansion (zfs+geli) To: milky india Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4MVPg10lQZz45wq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.160.172 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.160.172:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.172:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sat, Sep 17, 2022 at 3:20 PM milky india wrote: > > > > On Sun, Sep 18, 2022 at 12:58 AM Alan Somers wrote: >> >> On Sat, Sep 17, 2022 at 2:49 PM milky india wrote= : >> > >> > >> > >> > On Sun, Sep 18, 2022 at 12:44 AM Alan Somers wro= te: >> >> >> >> On Sat, Sep 17, 2022 at 2:42 PM milky india wr= ote: >> >> > >> >> > >> >> > >> >> > On Sun, Sep 18, 2022 at 12:30 AM Alan Somers = wrote: >> >> >> >> >> >> On Sat, Sep 17, 2022 at 2:25 PM milky india = wrote: >> >> >> > >> >> >> > >> >> >> > >> >> >> > On Sun, Sep 18, 2022 at 12:20 AM Alan Somers wrote: >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 2:03 PM milky india wrote: >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> > On Sat, Sep 17, 2022 at 10:58 PM Alan Somers wrote: >> >> >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:52 PM milky india wrote: >> >> >> >> >> > >> >> >> >> >> > >> >> >> >> >> > >> >> >> >> >> > On Sat, Sep 17, 2022 at 10:43 PM Alan Somers wrote: >> >> >> >> >> >> >> >> >> >> >> >> On Sat, Sep 17, 2022 at 12:31 PM milky india wrote: >> >> >> >> >> >> > >> >> >> >> >> >> > Sorry about that, again - I'm not sure what you mean by= bottom-post vs top-post. >> >> >> >> >> >> > >> >> >> >> >> >> > Be that as it may - I read the geli man page. I was spe= cifically warned against using "geli resize" since it may not work as expec= ted https://forums.FreeBSD.org/threads/how-to-extend-zfs-geli-encrypted-dis= k-space-not-showing.86447/post-581642 >> >> >> >> >> >> > Is this advise wrong? >> >> >> >> >> >> > > "The geli has autoresize flag which will handle the n= ew provider size after gpart resize command." >> >> >> >> >> >> > followed by >> >> >> >> >> >> > > You are right, no geli resize needed. >> >> >> >> >> >> > >> >> >> >> >> >> > What would be the correct sequence of commands to fix t= his - Simply "geli resize" ? (the -s option seems to be additional, will it= figure it out without providing s?) >> >> >> >> >> >> > >> >> >> >> >> >> > On Sat, Sep 17, 2022 at 10:20 PM Alan Somers wrote: >> >> >> >> >> >> >> >> >> >> >> >> top-posting is where you insert your reply above the prev= ious email. >> >> >> >> >> >> Bottom posting is where you insert your reply below it, l= ike I'm >> >> >> >> >> >> doing. The forum user said that you shouldn't need to ru= n "geli >> >> >> >> >> >> resize" because the AUTORESIZE flag is on. But as you ca= n see from >> >> >> >> >> >> your "geli list" output, it's actually off. So you need = to run "geli >> >> >> >> >> >> resize". The "-s" flag should be unnecessary since your = provider is >> >> >> >> >> >> already online. At any rate, you can try it both ways. = You might >> >> >> >> >> >> want to make a copy of /var/backups/ada0p3.eli, just in c= ase you make >> >> >> >> >> >> a mistake. >> >> >> >> >> > >> >> >> >> >> > Thanks - I hope I am bottom posting this as was expected o= f me. >> >> >> >> >> > >> >> >> >> >> > So if I understand correctly the AUTORESIZE flag is presen= t for adaop2 and NOT for adap3 (which is the partition we are concerned abo= ut) - hence the advice given to not use "geli resize" isn't applicable here= . Am I understanding this correctly? >> >> >> >> >> >> >> >> >> >> Yes >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> > > So you need to run "geli resize" >> >> >> >> >> > Is this the only command that I need to run to resize my g= eli partition? >> >> >> >> >> >> >> >> >> >> Yes >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> > > The "-s" flag should be unnecessary since your provider = is >> >> >> >> >> > already online. >> >> >> >> >> > Ok thanks. >> >> >> >> >> > >> >> >> >> >> > >You might want to make a copy of /var/backups/ada0p3.eli,= just in case you make a mistake. >> >> >> >> >> > Don't have the luxury of backup currently. >> >> >> >> >> >> >> >> >> >> Um, ok. I can't guess why you aren't able to do that, but i= t isn't >> >> >> >> >> strictly necessary. >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> > I suppose at the end of it - if this works - "geli list" w= ould reflect the size to be 458G? (vs 290G currently) >> >> >> >> >> > And that's the output I can trust to have solved the issue= - or is there more to it? >> >> >> >> >> >> >> >> >> >> Yes. >> >> >> >> > >> >> >> >> > > The "-s" flag should be unnecessary since your provider is = already online. >> >> >> >> > When I try to run "geli resize /dev/ada0p3.eli" it complains.= So I guess options s is must ? If yes - do I need to put in the exact size= down to bytes from the output of geli list ? Under "Mediasize" ? >> >> >> >> > --------------------------------------- >> >> >> >> > geli: Option 's' not specified. >> >> >> >> > ---------------------------------------- >> >> >> >> >> >> >> >> Dude, it's easier just to try it, than to ask us. Go for it. = The >> >> >> >> worst case scenario if you get the argument wrong is that nothi= ng >> >> >> >> happens. >> >> >> > >> >> >> > >> >> >> > > The worst case scenario if you get the argument wrong is that = nothing happens. >> >> >> > I'm not very sure if I put in the wrong value of s (old size) th= en "nothing happens" - I would imagine if I put in a size less than the cur= rent size then possibly the data after that get's lost? Or if I put in a si= ze greater than the current size then there is a gap in the geli partition? >> >> >> > I sense some frustration in your reply - but I'm on a live syste= m and wouldn't want to possibly risk it going kaput at this last step. That= 's the reason I'm trying to understand what is the best value of s for geli= resize and how to obtain it. >> >> >> >> >> >> The purpose of the "-s" argument is to tell geli where to find the= old >> >> >> label, if the provider isn't already attached. If you supply the >> >> >> wrong argument, then geli won't be able to find the label, and thu= s >> >> >> won't be able to do anything. It won't destroy any data, and it w= ill >> >> >> always automatically determine the size of the current provider. = Of >> >> >> course, if you're worried about losing data, you should always sav= e a >> >> >> copy of /var/backups/ada0p3.eli, as I suggested. >> >> >> -Alan >> >> > >> >> > >> >> > >The purpose of the "-s" argument is to tell geli where to find th= e old >> >> > > label, if the provider isn't already attached. If you supply the >> >> > > wrong argument, then geli won't be able to find the label, and th= us >> >> > > won't be able to do anything. >> >> > >> >> > I think you're confusing the -s argument with something else - the = man page says it's for the old size - that's why I was trying to figure it = out and still haven't been able to quite yet. Although I suspect the "Media= size" output for p3 from "geli list" is what the s value should be - but no= t very sure : >> >> > -------------------------------------------------------------------= ----------------------- >> >> > Additional options include: >> >> > >> >> > -s oldsize The size of the provider befo= re it was resized. >> >> > -------------------------------------------------------------------= ----------------------------- >> >> >> >> Yes, that's right. geli needs to know the old size of the provider i= n >> >> order to find the provider's old label. >> > >> > >> > Thanks for acknowledging. I tried to do this using the s value from ge= li list - it won't let me even do it as sudo : >> > Getting a bit scared now. Should I not be writing `.eli` part? >> > ----------------------------------------------------------------- >> > sudo geli resize -s 311481593856 /dev/ada0p3.eli >> > Password: >> > geli: Cannot open /dev/ada0p3.eli: Operation not permitted. >> > sudo geli resize -s 311481593856 ada0p3.eli >> > geli: Cannot open ada0p3.eli: Operation not permitted. >> > ----------------------------------------------------------------------= ----- >> >> Yes, you normally would not write the ".eli", because "geli resize" is >> normally used when geli is not attached. But it seems like you're >> currently booted from this device, right? In that case, detaching it >> isn't an easy option for you. If you like, you could try automatic >> expansion instead. First enable it. If it doesn't automatically >> expand when you enable that option, then you may have to "gpart >> resize" again. You can enable it with "geli configure -r >> /dev/ada0p3". > > >Yes, you normally would not write the ".eli", because "geli resize" is > > normally used when geli is not attached.But it seems like you're > > currently booted from this device, right? > Yes - on a live system. > > > You can enable it with "geli configure -r /dev/ada0p3". > Seems to have run without any output : > ---------------------------------- > geli configure -r /dev/ada0p3 > -------------------------------------------- > But geli list output hasn't changed apparently > ---------------------------------------------------- > geli list > Geom name: ada0p3.eli > State: ACTIVE > EncryptionAlgorithm: AES-XTS > KeyLength: 256 > Crypto: accelerated software > Version: 7 > UsedKey: 0 > Flags: BOOT, GELIBOOT > KeysAllocated: 73 > KeysTotal: 73 > Providers: > 1. Name: ada0p3.eli > Mediasize: 311481593856 (290G) > Sectorsize: 4096 > Mode: r1w1e1 > Consumers: > 1. Name: ada0p3 > Mediasize: 491516858368 (458G) > Sectorsize: 512 > Stripesize: 0 > Stripeoffset: 8590983168 > Mode: r1w1e1 > > Geom name: ada0p2.eli > -------------------------------------------------------------------- > Is it supposed to show up after a restart? > Or did it just not work? > I'm just so lost now - hoping I can even restart the machine and data isn= 't lost/corrupted :( Like I said, you probably need to run "gpart resize" after "geli configure"= . From nobody Sun Sep 18 21:00:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MW0ZR3Ychz4cDjj for ; Sun, 18 Sep 2022 21:00:31 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MW0ZR0qjMz3y3J for ; Sun, 18 Sep 2022 21:00:31 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MW0ZQ6xG8z18nM for ; Sun, 18 Sep 2022 21:00:30 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28IL0UIH053093 for ; Sun, 18 Sep 2022 21:00:30 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28IL0Up5053092 for fs@FreeBSD.org; Sun, 18 Sep 2022 21:00:30 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202209182100.28IL0Up5053092@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 18 Sep 2022 21:00:30 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16635348305.75fCca4.50743" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663534831; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NnI531EsCgskUYnN51OVzykGHJ+Wsi3gn5fxuSITIsE=; b=oWapI4BrceTmQ2/Jvl9xnQHy3RyCVQentgmA+spjTvts4Jt2PgP1Kw3/s6cT7o45hyyLU3 WJH0i6IjRg58QWMMZW/3pWJd9guMspQP5+w2xHWR7CDo00GBUJmQPmdUe+N9mn4J5SJMWd 31gy2rpSepLAxiRym45pLWnFa2KIIVTX9fc6OlUgw71WXlcNEMLZzfxGBn3ZSse39i4L4u P0r2urW3LaiLCruXv79D+nGZKqYRXuFWFoUUZcygHfnBsxGokUJVSdpAQHEJDz/GGzwDJl UWRwml3ZNo4juLK+PFOLQzdXqgDTGxJjvp38u9ciaTPlQD31DK8krSeZXvzbGA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663534831; a=rsa-sha256; cv=none; b=A4CedAxZH0yaLE7oiALluKNtXeh+3pYZNCaN/gGF5SpzwgFV7ypft8z7LMDinXorTqJyBC VeWAm9nxog1MmqIQwGETi+GH8nA8tDMBlDfV7S7nfkEsSmnnCWV5Q9VPiUQKmMNkPsjI+9 3zA5foUAK1AnN7zm3J5/w94PtcDKcygDtqJtjHzouUYuz1ikxT2YejfFWwWKJGhjdcpW0t yYcct5bJl4yk8ieTbCKLPIwnObLTDASYiwT+Eg5ymkvrnrKRMiqHqJVdc2dRsXyx1wIUya lhTmAzzkRr+zwmMan6eW+U2WfbSkOUx2I5OoIj1caZOvBxa21tW5BSL9KaRXIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16635348305.75fCca4.50743 Date: Sun, 18 Sep 2022 21:00:30 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16635348305.75fCca4.50743 Date: Sun, 18 Sep 2022 21:00:30 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16635348305.75fCca4.50743-- From nobody Mon Sep 19 07:24:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MWGQ55tYjz4cvD8 for ; Mon, 19 Sep 2022 07:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MWGQ54lJYz3nV2 for ; Mon, 19 Sep 2022 07:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MWGQ53qMtzJYR for ; Mon, 19 Sep 2022 07:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28J7ODiF097714 for ; Mon, 19 Sep 2022 07:24:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28J7ODPb097713 for fs@FreeBSD.org; Mon, 19 Sep 2022 07:24:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Mon, 19 Sep 2022 07:24:13 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663572253; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CDDQcvzkggf+RIvYZOfX3Yhuj7wZ4B+/rXCsquHKgxA=; b=ENV8bv+SdaeJ1JpKtLDYBUIH7gmFIeBdTLN4Y7epHjAYJCt5hxq0o5pvXGMbNgdgT6vbzE J+X07RE6lwrgHyXnnIPS+SK/SgfAI7VjsdqhMUipXswAcAbTTVbgS+SI//qbNjJsKdoZ32 9b0fTG6Gl+1Rxtun9PAUzN7HXfptAC1/3cFpemxst9sdpw0seX+dSexx722zgdiPVqrHz4 CTwe5aMc0b6j+3t8lwedQTR2Nom+ilEi7mElys50gj4H1b7UfuPYkRcE7QWF7R7oqvGS/f 1g6r2I9ZgGBevT6Nr3FElojLKusV6aAVeqjB7NZsXwsWMj32XG9m9h9nDWrROg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663572253; a=rsa-sha256; cv=none; b=MB8sJmUNoKzkI3FjKBtPaYGYHe9z8Cpp1CpitUu6s5dHG0dhp8woiEOqlpNs+e1dJ8aKAc BXvJ5QEZlw4UOgjZRKZW5hF96U1g+3Xkm1ZqpO6QE2GbVAr8e9EncutdA+tLptP0L0sFGD 9Oin05XqRpsjbIkyOpMljULsZSKh+uUOGLBpdoWDrd/Zg4WZmQmRbN72AiQffKnmPm6nDo Cb3gOtUBHYRmKCxShUECtY4/5pij2cp9x1c8Gz1ZGeaeYhbCLkRcFGGG9SMFQMZQnGNFKr AlCardr/gEiKvjKDj/xWOBjGh9mVn/+Jlpyfg/x3bJUZlfrabtZusdI3YsZ8WQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #13 from Miroslav Lachman <000.fbsd@quip.cz> --- Additional update - some times it paniced under different user account too = and it also paniced in single user mode when I run locate.updatedb but it does = not write anything in to /var/crash. Is there a way to dump info in single user too? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Sep 19 11:08:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MWMNS4yFzz4cVlb for ; Mon, 19 Sep 2022 11:08:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MWMNS30Rnz461Z for ; Mon, 19 Sep 2022 11:08:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MWMNS1zyHzMNd for ; Mon, 19 Sep 2022 11:08:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28JB88ik066368 for ; Mon, 19 Sep 2022 11:08:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28JB88Gq066367 for fs@FreeBSD.org; Mon, 19 Sep 2022 11:08:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Mon, 19 Sep 2022 11:08:08 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663585688; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3PaRekV1vv2MQHU8msQG51jmKF21B3WwAdDxuLYInnI=; b=B9+nRPmynvpiNMsoICuDEybqeT52V62vMkdb6VqNVwoiGRSgwau1QtxnzJ0vWuOTVlZMEV +HYjnOWlSLABxHlyqnueJgTCoVyI4ZFCg1pytaaLPjtszWQJoeqYNup4b8ffsmY7gpv4w0 nDfwnO2KLP7Ac+2F1BxOD36VM/2Jjhn4dYpy5neaeaBuRiVLQYVcVdVYE29zCPwlj1OhGY KFt/PCY602F+hL309wlyEunc1xZdWsV5KPOSR16pauelR4Hll0+QYY1AExvlI9ILeEWnPP AINZhizDV9oBbzz3Lc5gGJRGkzlcz9YFCtP+dXcQAmnCnsd9cqm1/QQInpp0zg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663585688; a=rsa-sha256; cv=none; b=TaECSFVI1B2M6RbQ6HQ+8ewVjgrVWUrcQPvtSs1XpzWDN6Z2YRqwuJEv7BFNPYEJfgezTC BtdixnS7Utzew5UuYxI0zkqbmeoJgCN8DcravSEqTQSqMBoMV0BO8AF4GWxVd1jreLAwwr PniXURCFD85MEC9wagIGeGIOAQsuuJ6h3Hk5RUIETkMmt2cWNjFSNpb6xVYDr/U/Vf7rcF 08gzzEgQHv2OfNl/pccQNV8soXS8uHA4MlEEwQqbRJrOmcbIlWMggsoiy/Xbv6YqmlK06V Cxv0PPsxonSRzRPu2gyL+ZBPNMY7Y1mFCs/yQHjWgzVSzIntFPYmbv1pDwuU+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #14 from Miroslav Lachman <000.fbsd@quip.cz> --- (In reply to Miroslav Lachman from comment #13) I have a bt from single user panic: Fatal trap 12: page fault while in kernel mode cpuid =3D 2; apic id =3D 04 fault virtual address =3D 0xc3 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff821d7dd0 stack pointer =3D 0x28:0xfffffe00f7640350 frame pointer =3D 0x28:0xfffffe00f7640410 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 74 (find) trap number =3D 12 panic: page fault cpuid =3D 2 time =3D 1663591376 KDB: stack backtrace: #0 0xffffffff80c69465 at kdb_backtrace+0x65 #1 0xffffffff80c1bb1f at vpanic+0x17f #2 0xffffffff80c1b993 at panic+0x43 #3 0xffffffff810afdf5 at trap_fatal+0x385 #4 0xffffffff810afe4f at trap_pfault+0x4f #5 0xffffffff81087528 at calltrap+0x8 #6 0xffffffff8224b7bf at sa_handle_destroy+0x8f #7 0xffffffff821a87aa at zfs_zinactive+0xca #8 0xffffffff821a2458 at zfs_freebsd_reclaim+0x38 #9 0xffffffff8117e09f at VOP_RECLAIM_APV+0x1f #10 0xffffffff80cf8c72 at vgonel+0x342 #11 0xffffffff80cf4d47 at vnlru_free_impl+0x2f7 #12 0xffffffff80cffc38 at vn_alloc_hard+0xc8 #13 0xffffffff80cf5423 at getnewvnode_reserve+0x93 #14 0xffffffff821a78a2 at zfs_zget+0x22 #15 0xffffffff8219284b at zfs_dirent_lookup+0x16b #16 0xffffffff8219291a at zfs_dirlook+0x7a #17 0xffffffff821a4a10 at zfs_lookup+0x3d0 Uptime: 10m33s Dumping 1729 out of 12189 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..= 91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(stru= ct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c1b71c in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1bb8e in vpanic (fmt=3D0xffffffff811b4fb9 "%s",=20 ap=3D) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff80c1b993 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:844 #5 0xffffffff810afdf5 in trap_fatal (frame=3D0xfffffe00f7640290, eva=3D195) at /usr/src/sys/amd64/amd64/trap.c:944 #6 0xffffffff810afe4f in trap_pfault (frame=3D0xfffffe00f7640290,=20 usermode=3Dfalse, signo=3D, ucode=3D) at /usr/src/sys/amd64/amd64/trap.c:763 #7 #8 dbuf_evict_user (db=3D0xfffff800263b4128) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:569 #9 dbuf_rele_and_unlock (db=3D0xfffff800263b4128, tag=3D,=20 evicting=3D0) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:3712 #10 0xffffffff821da0bb in dbuf_rele (db=3D, tag=3D,=20 tag@entry=3D0x0) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:3662 #11 0xffffffff8224b7bf in sa_handle_destroy (hdl=3D0xfffff8004f980900) at /usr/src/sys/contrib/openzfs/module/zfs/sa.c:1379 #12 0xffffffff821a87aa in zfs_znode_dmu_fini (zp=3D0xfffff80035b90760) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:390 #13 zfs_zinactive (zp=3Dzp@entry=3D0xfffff80035b90760) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:1267 #14 0xffffffff821a2458 in zfs_freebsd_reclaim (ap=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:51= 88 #15 0xffffffff8117e09f in VOP_RECLAIM_APV ( vop=3D0xffffffff8245f340 , a=3Da@entry=3D0xfffffe00f76404= e0) at vnode_if.c:2180 #16 0xffffffff80cf8c72 in VOP_RECLAIM (vp=3D0xfffff80058e705b8) at ./vnode_if.h:1087 #17 vgonel (vp=3Dvp@entry=3D0xfffff80058e705b8) at /usr/src/sys/kern/vfs_subr.c:4144 #18 0xffffffff80cf4d47 in vtryrecycle (vp=3D0xfffff80058e705b8) at /usr/src/sys/kern/vfs_subr.c:1694 #19 vnlru_free_impl (count=3Dcount@entry=3D1, mnt_op=3Dmnt_op@entry=3D0x0,= =20 mvp=3D0xfffff80003be3400) at /usr/src/sys/kern/vfs_subr.c:1331 #20 0xffffffff80cffc38 in vnlru_free_locked (count=3D1) at /usr/src/sys/kern/vfs_subr.c:1344 #21 vn_alloc_hard (mp=3Dmp@entry=3D0x0) at /usr/src/sys/kern/vfs_subr.c:1745 #22 0xffffffff80cf5423 in vn_alloc (mp=3D0x0) at /usr/src/sys/amd64/include/atomic.h:416 #23 getnewvnode_reserve () at /usr/src/sys/kern/vfs_subr.c:1887 #24 0xffffffff821a78a2 in zfs_zget (zfsvfs=3Dzfsvfs@entry=3D0xfffff8001cdee= 000,=20 obj_num=3D257193, zpp=3Dzpp@entry=3D0xfffffe00f76406f0) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_znode.c:942 #25 0xffffffff8219284b in zfs_dirent_lookup ( dzp=3Ddzp@entry=3D0xfffff80058c6b938,=20 name=3D0xfffffe00f7640860 "patch-src_init.c",=20 zpp=3Dzpp@entry=3D0xfffffe00f7640740, flag=3Dflag@entry=3D2) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_dir.c:191 #26 0xffffffff8219291a in zfs_dirlook (dzp=3Ddzp@entry=3D0xfffff80058c6b938= ,=20 name=3D0x0, name@entry=3D0xfffffe00f7640860 "patch-src_init.c",=20 zpp=3Dzpp@entry=3D0xfffffe00f76407e0) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_dir.c:247 #27 0xffffffff821a4a10 in zfs_lookup (dvp=3D,=20 nm=3Dnm@entry=3D0xfffffe00f7640860 "patch-src_init.c", vpp=3D,=20 cnp=3Dcnp@entry=3D0xfffffe00f7640c58, nameiop=3D0, cr=3D= , flags=3D0,=20 cached=3D1) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:929 #28 0xffffffff821a011b in zfs_freebsd_lookup (ap=3D0xfffffe00f7640990, cach= ed=3D1) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:45= 93 #29 zfs_freebsd_cachedlookup (ap=3D0xfffffe00f7640990) at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:46= 01 #30 0xffffffff80cdc4ad in VOP_CACHEDLOOKUP (dvp=3D0xfffff80058dd83d0,=20 vpp=3D0xfffffe00f7640a10, cnp=3D0xfffffe00f7640c58) at ./vnode_if.h:99 #31 vfs_cache_lookup (ap=3D) at /usr/src/sys/kern/vfs_cache.c:3069 #32 0xffffffff80ce0cb0 in VOP_LOOKUP (dvp=3Ddvp@entry=3D0xfffff80058dd83d0,= =20 vpp=3D0x0, vpp@entry=3D0xfffffe00f7640a10, cnp=3D0x0,=20 cnp@entry=3D0xfffffe00f7640c58) at ./vnode_if.h:65 #33 0xffffffff80ce06e3 in cache_fplookup_noentry ( fpl=3Dfpl@entry=3D0xfffffe00f7640a88) at /usr/src/sys/kern/vfs_cache.c:= 4928 #34 0xffffffff80cddf66 in cache_fplookup_next (fpl=3D0xfffffe00f7640a88) at /usr/src/sys/kern/vfs_cache.c:5284 #35 cache_fplookup_impl (dvp=3D, fpl=3D0xfffffe00f7640a88) at /usr/src/sys/kern/vfs_cache.c:5932 #36 cache_fplookup (ndp=3Dndp@entry=3D0xfffffe00f7640bd8,=20 status=3Dstatus@entry=3D0xfffffe00f7640b84,=20 pwdp=3Dpwdp@entry=3D0xfffffe00f7640b88) at /usr/src/sys/kern/vfs_cache.= c:6104 #37 0xffffffff80ce8cba in namei (ndp=3Dndp@entry=3D0xfffffe00f7640bd8) at /usr/src/sys/kern/vfs_lookup.c:570 #38 0xffffffff80d06953 in kern_statat (td=3D0xfffffe00f75fc560,=20 flag=3D, fd=3D-100, path=3D0xfffffe00f75fc560 "\300`\264= \026",=20 pathseg=3Dpathseg@entry=3DUIO_USERSPACE, sbp=3Dsbp@entry=3D0xfffffe00f7= 640d18,=20 hook=3D0x0) at /usr/src/sys/kern/vfs_syscalls.c:2441 #39 0xffffffff80d0704f in sys_fstatat (td=3D0x0, uap=3D0xfffffe00f75fc948) at /usr/src/sys/kern/vfs_syscalls.c:2418 #40 0xffffffff810b06ec in syscallenter (td=3D0xfffffe00f75fc560) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189 #41 amd64_syscall (td=3D0xfffffe00f75fc560, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1185 #42 #43 0x00000008011ad39a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe628 (kgdb) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Tue Sep 20 06:13:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MWrp31q0dz4dGbM for ; Tue, 20 Sep 2022 06:13:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MWrp30N4Xz3dgd for ; Tue, 20 Sep 2022 06:13:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MWrp26Ww0zdNQ for ; Tue, 20 Sep 2022 06:13:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28K6DUld036615 for ; Tue, 20 Sep 2022 06:13:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28K6DUDQ036614 for fs@FreeBSD.org; Tue, 20 Sep 2022 06:13:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264141] nvme(4): Heavy load to SSD wedges 13.1 system: Controller in fatal status, resetting ... Resetting controller due to a timeout and possible hot unplug. Date: Tue, 20 Sep 2022 06:13:31 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: crb@ChrisBowman.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663654411; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jxYjs/wIcOzPLMBSZpCUyOtGkFtM8Q8q3gccQk4Uelc=; b=v63rlinFfSjFxHCkVQ/7u2t1oGNTVk3z0VcfmtT5ciPWGwlIxpR8yzhC/rjCAHdIBRskN7 +psGobdKqahtY4GfTg/PV7chPrzUWTrvJRiKJ5fVeRRSbf5nIfexJSFmjvhSZA5WXWauPV cMux28wy59HFhMAAwci/bM3fa6pZPr/tvm9p7vKtwebcJrhvdpHrRdyVeFDQXaryi9qNmf /GeBXZfH/LEQp9Rd1UNgh6Td3D0PE7ssCAMRDDYeB0jDfz/Mrr3rOMuA7FA3qG/wsPGkZT j/+oZpSdgLLiyp3cmMMqCrnKPGmA/jYJVLSqVFjplfz2620a0jZDRWpf1xjicQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663654411; a=rsa-sha256; cv=none; b=vOMRGz9zJYa7PFLtts55kWcdhij/B3ZpiGGGDzEAKRuh9GXYkkwbcGJEmqHaPyetFR0f6f UPYsqmcgFftyd4aXU7vN/YEbJ9bAX3jE25PUEzNKSp0D3YnyvYkCzLrhZS7t/y23ECCYHZ QDaGkgXdkPmIOCrWJBlSdAG2KLI5kL7YD8jsrx8gupMqTs/gd3fh1Mcgxgc8yJglFW0t5r u7hW5XdIvSFFai4DrfUzAf8sBz/F5C53OTTaEQLwWdPzy3uUQhfDI0ajK7FIUiRGC8quWm 6fQ1KXMjvRrdF5swKQ0CP0qsWWfqtKqP/laDI/daeV4WLP5+2AoHRxWYKXwA2A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264141 --- Comment #29 from crb --- 2 weeks later the the system has done many buildkernels and build world and= is stable. Closed from my perspective. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Tue Sep 20 13:24:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MX2M33CFTz4cC4k for ; Tue, 20 Sep 2022 13:24:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MX2M31Yrkz3Mkq for ; Tue, 20 Sep 2022 13:24:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MX2M30Y4JzkV3 for ; Tue, 20 Sep 2022 13:24:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28KDOFCP035160 for ; Tue, 20 Sep 2022 13:24:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28KDOFIl035159 for fs@FreeBSD.org; Tue, 20 Sep 2022 13:24:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Tue, 20 Sep 2022 13:24:15 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663680255; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3g/7cyRNcfry47RYaTmpZBnvU0hTIokAzZpkaZ+v39U=; b=I4da6+cN0Wc+kO7+3BVhrJcpT/hYLkZ0oxaf8zEGFfj+PmgWSZbo5siaxFlQ5S0tiOy8xq 7hXWMQWoPLBvqmQLy3apt/lEoObETUcNrafUjpdB86OWtCORsaqQCIXvjS9KvSJHyrxfO+ vlDndOn/iLsLa9fIkA4lifTFlPtF3szjBNvfguzCR6dfosIChNGiSa9yA6qRrtXakUyvbH l917foTAGIVq1BAzu98r/4bittiY7wIqH6Lt3fQ9d7SMSqhmyS7Ick1NS54OAc7hKujG+r kGpG+9qZYE+33yC+DOh2KbqhorNl1OQmHbxGj4oplDLIYBzGcI3V8bZtoJM35w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663680255; a=rsa-sha256; cv=none; b=cGAZc2xNyZi2xR28zAwdd9fzfCc6DJBurgnJ/FvghlE00CF74FuIRj1ARSlFvoDheamWT/ Cil1RJym5iZWQw2P1T91lvf/6ncpmvJYmAR8aHIm9whbse9jSYcj5dtCaJKnJtfmUujKmA qWpxLTZDIUaHBkTq7qTldZZOlQ4s8Sd3o0zOyeHAjXsTBRWDdPap4WjpSs49abRE/LOXbX zELIgry7GpzkLLwNvfaV5/icpL0IBWW8oaZNhyg/u5sfXU8uQaHn6CIh3SeO2aTGch8GXj Pd3v4lglpkKPqLWZj04MlwvNq0oFE5KC6wVpt/OBWQnOGeNOOWW945otbcwtQQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #15 from Miroslav Lachman <000.fbsd@quip.cz> --- Is somebody interested in this repeatable panic? If not I will try to wipe = it and reinstall from scratch because I need to work on this machine. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Tue Sep 20 18:22:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MX8yr6PY3z4d2XD for ; Tue, 20 Sep 2022 18:22:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MX8yr5PXSz41fF for ; Tue, 20 Sep 2022 18:22:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MX8yr4Tdhzp59 for ; Tue, 20 Sep 2022 18:22:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28KIMCej003336 for ; Tue, 20 Sep 2022 18:22:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28KIMCjV003335 for fs@FreeBSD.org; Tue, 20 Sep 2022 18:22:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Tue, 20 Sep 2022 18:22:10 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: Rincebrain@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663698132; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZfcI8mUEyF0vK1TZYE8vAQefdVUC0OttsCajTrqibaQ=; b=jWE0R5ILyfsKpHFzfR/Dtc2V1XrkrBQPI0zTzZaYn303D1NO9TA3GZByDRs0TDzUBhF0Ls 1a8+F2LuZp1NDC7togPLAJIKARb9SOULBpK9SPzhEntFjwBqMzebj8qmPGYzSwr71oYken 0HzDNUzoBg1rSEKhUx9vdtozyTxqLqmjiXp4ytDOGmqVCdo/Ado5+CjqMdzt+ssjpOzvLn SKdRcVKOHJpL2eq112zrmcnh0/ptWcHh3ALbf9zpbdDQobOcqo36+xKOSUOhb+Z+GGEv5v cUz5UruKojpEfp/mo/VGeqkBc47Xjonk7dm+b/Mp6zhDi76Y3KzQ6QfgQ/PkPQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663698132; a=rsa-sha256; cv=none; b=E1fu86K5+R87UZ6XofEATRsDoe6sJMpjD/jNff9lxRiEHDzBAHZFjoD9Ey+qh4Lqi42g6E 5StiML1F1qJ5nX8NDLexR0OF7i5PjVWw/ienRKf2oNRl1sItkZ8dImEjfNRaOLqkJSjzKU yB4oPIPno81gbGxqip87kdXHZcSp43PaUX8QIEjK3sD0kpv/a0L1PygHdZl6kqdEGdj4Hb GDuoyP5KQSoPYWkVRmKblrYqLk+tu7qDNj33VXrUv/N7+xXGxEzgqGSimOWKQ7ah9hIGwk fuGNaVtHwQiydh4s0vkN28mVBiqFfrP8qGdY8XDnjaEqx4SZgbkrPscYudqv9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 Rich Ercolani changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |Rincebrain@gmail.com --- Comment #16 from Rich Ercolani --- I'd be curious to see "zfs get all" from whichever dataset is / right now, = and whichever dataset is serving /usr/home right now. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Sep 21 08:12:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MXWNP170mz4cgpy for ; Wed, 21 Sep 2022 08:12:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MXWNN6KKlz3Rj4 for ; Wed, 21 Sep 2022 08:12:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MXWNN5QgXz10yS for ; Wed, 21 Sep 2022 08:12:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28L8C47V002758 for ; Wed, 21 Sep 2022 08:12:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28L8C41X002757 for fs@FreeBSD.org; Wed, 21 Sep 2022 08:12:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Wed, 21 Sep 2022 08:12:04 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663747924; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=20+WLqYF9I57Gikcxb9iJbdYK0aHWtp+qK2J1FtnDpw=; b=M3PTc0q6CHkDp+ua/J6GA0UdO+oa6N5qRzLpdHNCF5gysMCFFDAjdVVhiHVSZVy6SUGnHX YA/CZxirNmLkIWEfGDAHYwBnOxKDr0U9q9GvmEvvCUOT7QaPLSmggWMZdL3aIrqLqQQ5Gp GBJS0Oz0inO92d/Zb1qAJJC7OVPS9TdHzLLIB+5X6RBn+9g+FNcqLVbO1F/v2cUR7CmUF+ Nv065jud+pqGsqCfLWj7+YFCMWXbja+1JnRUesxftwDS/JCK52c083wHCcqcHYQ96HrSEn +SSBFSQOiMaTXow0wK8c1PCHu4Lvqja+cNP4MCF+zqFkQ+gl8VplMG5Y0MzV6A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663747924; a=rsa-sha256; cv=none; b=xrrikFt6cW2NG4PNCklZKDPYtXRMdNgOqZv8ydexMi4YtgTD2CwRzPvsOSBt4QW1oFPvf9 fr7hnKn12n6a537rxZep9mmOlfyN7+Xlq4O22D+q9Qc7K55Iq8QHdh3mcI3IbtecH69ztx Q0KldB0Fp3MLjXOBp1/yueNS8vk2FE/tqyE1Tn7ENfi3ZrcQSMbsCcnz1IhOCGI3JAP59S qE0PEBAX0RDbZrJyodimLX8LRHpgZIzPiG31twXWgOttR2Lc//sUVzWVIMpqk0hxOG6Ro0 CV412vSpHpAco1OdPeusMaT+AosncpApSVHF5XOrL3cudw+Zv2zmKUJCwflytQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #17 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236722 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236722&action= =3Dedit zfs get all / --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Sep 21 08:12:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MXWP32KRGz4ch32 for ; Wed, 21 Sep 2022 08:12:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MXWP31KcKz3S6V for ; Wed, 21 Sep 2022 08:12:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MXWP30Nrkz10wb for ; Wed, 21 Sep 2022 08:12:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28L8CdPS005341 for ; Wed, 21 Sep 2022 08:12:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28L8Cc7i005340 for fs@FreeBSD.org; Wed, 21 Sep 2022 08:12:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Wed, 21 Sep 2022 08:12:39 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663747959; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w/lW/t15+UMkNTu7/NWxfoOXzWp0Vqz2iJLG0lgCeAQ=; b=G8RK5IBW9V7tMQw0H+693bCXn+k3VUBjj54DnlHczkVCILGBzzehSd0l8SeDULW0+cfgE+ 8wOVJaYhHcsXtzVdcILlMdmZOYnuFCLTDdq95xAC2BUouaQekYFwxxnPidby1JBCXeXKfa CD2wft0tGzwRlt+pTNAK6jBbLZ8/MPqag/DDr0bt5DGiY2EXauBp33yR/Hjzq9CMQyUmTX eV5ZfkWTYOJwTQBA39aqjXG2EDslJJyzsMPDNMavxl9zX7fd724kpA07SecSyF0sLk0Qyj amddf4RepOnHCcVs8HtAC9XqKEFbUtVvulnHCU4W2hUtd+A1U3YIarh+wEFchA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663747959; a=rsa-sha256; cv=none; b=B9L4qWI/OPnnltBGGmrhRgjU5CXDxz80R9Vlqnfmug2WBfTwI8XoI3cTpnrdjaZDAi363s BwfwVYbSiKiwY2YQ9yVy9cAgjYvLC45/smEe81/vjFucltLWQQu72x6ki2fgXifR5H7ewE qEZU7nFRkycpmlfW+ihZerzgGm9683/e6QdTMWffh/aAf4T1Q1Jkls0IWaEgeRYjeae7SZ jTUFJSdZSTpftqDGHQ4o+Y3b60lgMEezt61fMNooExS6I/knZ9RLuxZHwxU2e7hbevuRl1 IMfr6yLJzvarKJBe/btJCEJbstyifx3jCP3CNyRbqC8JEw8Ld4541x5gzU6BJw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #18 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236723 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236723&action= =3Dedit zfs get all /usr/home --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Sep 21 08:13:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MXWQ15SXTz4chF5 for ; Wed, 21 Sep 2022 08:13:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MXWQ14SBGz3SHH for ; Wed, 21 Sep 2022 08:13:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MXWQ12kT3z10tk for ; Wed, 21 Sep 2022 08:13:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28L8DT0K005744 for ; Wed, 21 Sep 2022 08:13:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28L8DT5b005743 for fs@FreeBSD.org; Wed, 21 Sep 2022 08:13:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Wed, 21 Sep 2022 08:13:29 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663748009; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/xQkm/vFtM/aljaf1+y0g7VGmSMgk+ZUPoq3uTgP+Z4=; b=I2rjJJeQDGj6psOcdrj9exSAT0C75oSKi5qQe3m4bScledUkm91b4UwiFL8J4Ig4IrbyTI GHEtgGvmA6gKr1+3GB18TVbtVzHzy9TDWBM+pJAiXq+6vtK0VsX4mFUtAfXvKaFQytEdii qffyqPQ1PinvSBziU6OGZD2uigGwCYs5DqNYPKXHOs5QD6jXHQcskXGi4pHLGVAnbStLvc lJXQCmgqHyjI5s1OTZPZ6AiffASYkFylw+40SseIOGpx7H/oIE92y92HdZXVo7g2f80+YT njZo17PWnma4hsZE9aD/IHZQowQ8yAbq+C7sJPc86/H2R/sYef6r1W2bbC2ndQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663748009; a=rsa-sha256; cv=none; b=gwX5U79I+ORmBcL0WCXyJyHdrz1ZlroHNj+SiPuKcRxyJwGpNHT9UVC1fvstlQMRjnCyE4 QrwAV6jMytNqsm1SjLYMh+JOTDC1RBZMnHb2vOBQrGI9FJ/hTsvSVc5GihfdhgzRgHYM2E nqxpbnyzWMvVTwKtJn+aVFBxyldvdN5i2ocwMwXGQY1sitiowKD8ldeSICUKd4JpOFfdv4 iXceoXB7euR/06nW34zSpEQ4gfggxTERJDB0QwPApPcGTZjO5GjjKPmBtJPDNi7yEzpZls hnz0dMy5Nt1RJ//XAnxZs6zvYOqv8i8uuAhaVszdoi15BCqSrJNP9FmT+YA4zg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #19 from Miroslav Lachman <000.fbsd@quip.cz> --- Created attachment 236724 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D236724&action= =3Dedit zfs get all /usr/home/usr1 --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Sep 21 08:14:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MXWQq1DMMz4ch5c for ; Wed, 21 Sep 2022 08:14:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MXWQq0DYXz3Shw for ; Wed, 21 Sep 2022 08:14:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MXWQp6PCQz10hM for ; Wed, 21 Sep 2022 08:14:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28L8EAdF005989 for ; Wed, 21 Sep 2022 08:14:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28L8EAvh005988 for fs@FreeBSD.org; Wed, 21 Sep 2022 08:14:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Wed, 21 Sep 2022 08:14:11 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663748051; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=c5IFFlSt6vZD+9eDFtQ2UCCCyWXEyuGLwyYdQX/JZSs=; b=iaOiY/wA7TTF5Xb53aS0J+WZGAogURWr/p2ANg/xHL/w7RN/dNrylV3sX1nElwWNA1hxsG ICHN/gHlIuQGOKCAAwl3Ft/xwGK1EKOTgXUHzL/B0x1ORB8aq7kRsYzxA0aBfFAmjq2KDE 0lu2oBtL3ApIYU7z7bb7E314/gKf4BvdyJCi2eVkr3+JykikN45ll6arJwryu3lKy7U+sB u/TuAoSUSkYuqyf6ej9i0W2gOjD/6Wtj2OpEeqVJpbiGcRlQZ7zRFuhTuVEFe9aDf/kvvR gfYqbKAeuyA/3Y+TALGZnyqyGD3FotGMHS7KmPcdPCRw0a/KYrVBnuSar/SiGQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663748051; a=rsa-sha256; cv=none; b=b0Vbf+Gd8YqqpbEeMktBhenebxKP6BaFLBowiZMLctgQnBn0xsWrkBCJOZfXrS3D7JBtv2 DPRlqI5M8R0JADmN3zjTTEggVrIUj+ReuRs0x1KIvYiiPPKbnpFGZVhyWRZ8KYuTVX0IPz Vk57ADF8Zok2365KXZREfMiClGEiXw7woT7A+A9VCd1t8ZAZuY48K4rs4SMfIxl3R5g7ic c/VH6HDvAGpY8ee/ku+sWkYLurqvYJseRiMX7y+BZNDAYhdWdgSAormmK/deXZ6udIW5vS njnGoHGsBw11mtLkHs4Xbu8ppA1HC8AIrPKSESdFmmhDm3mOo99keqrWcSSCSA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #20 from Miroslav Lachman <000.fbsd@quip.cz> --- (In reply to Rich Ercolani from comment #16) I think nothing unusual. See attached files. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Wed Sep 21 08:50:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MXXDW59GTz4cmBc for ; Wed, 21 Sep 2022 08:50:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MXXDW47m5z3VNp for ; Wed, 21 Sep 2022 08:50:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MXXDW2tvpz11DK for ; Wed, 21 Sep 2022 08:50:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28L8oJUE041281 for ; Wed, 21 Sep 2022 08:50:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28L8oJ9B041280 for fs@FreeBSD.org; Wed, 21 Sep 2022 08:50:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244899] [PATCH] zfs: xattr on a symlink target > 136 causes "bad file descriptor" (on 12.1) and panic on (13 CURRENT) in sa_build_index() Date: Wed, 21 Sep 2022 08:50:19 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lab+bsd@thinkum.space X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1663750219; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JUN7wAfrRacZJczY8UWgfIrIhRK9lt5tgDCY4s2LKmI=; b=vsupKl3k31Q+q4eftmCevfbBKj4Bp4dgHBWt0/Ag2nGD0SS++K1dn4AZMFObcCjsdlu3Br pejLpmNUvR038cO87TJJk1N8DNjXk9+4Kd8Awu1iM3+sSuGi5q5nmo3resSmG/RYZasXjE Khsiz3SL4R7fBK9oWwmJqZQcCccayy4cZ/wYw7QZ5dsGT5htdJWOG4sDPl8iD5P4nB8iwc 7aA0cZrZS4cWAcazkyRqVpDL2je7gzANYax4/d+kQdIpMZxRKdgwnfgTRHKpKFfUmc56+y +clzt2SfWlpqL1fi/hl8dDU7s9frNT+IkysJR9ajkos3LbynwKQaLOjPKEQ+4A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1663750219; a=rsa-sha256; cv=none; b=QnHgTF6bgEqq+NNZ1nnYb/aXW5pnCBCuu4jxxYAiwuQ9u7bk0kygsg9aMxSo5bY9JvvSjw lOlxQSCJVwAhqVe9d0JPimVfAEyMO6ecGZ6KyIkSglNDjW2mkzQYdwBxDftqAEF5W7sxeZ tM8Ba7oFB4uqaPeXeZNU+g9fsVEDPjcbUvZHAKdJ4q6zoTwuJDdAC6jSaO76R+NczskN13 +Xcl6EsWNkbImb1ZUg/vxk6goS/pFu84QecevOGNwn9EEDULoAh7TxhpBmXFSdX6By114T I+J9mgvrE0pksbR72tx+RpgLTAFfd2QzRco9TamF0S8W/W6qT+koQHVIFjUkQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244899 Sean Champ changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |lab+bsd@thinkum.space --- Comment #7 from Sean Champ --- I think this may have cleared up at least in FreeBSD 13.1 (changeset b63021e001d)? e.g uname FreeBSD sol.cloud.thinkum.space 13.1-STABLE FreeBSD 13.1-STABLE #0 build/stable/13-n252436-b63021e001d: Sun Sep 18 22:01:30 PDT 2022=20=20=20= =20 me@sol.cloud.thinkum.space:[sic] amd64 With an earlier build of FreeBSD 13.1 (changeset 41ce229505a) I'd encounter= ed what I think was the same error as here, when building some ports with poudriere on ZFS.=20 With that earlier FreeBSD 13.1 build, the uname: FreeBSD sol.cloud.thinkum.space 13.1-STABLE FreeBSD 13.1-STABLE #0 build/stable/13-n251001-41ce229505a: Sat Jun 4 18:12:09 PDT 2022=20=20=20= =20 me@sol.cloud.thinkum.space:[sic] amd64 The "Bad file descriptor" error, when building lang/rust under Poudriere on= ZFS on that kernel and base system: [...] -- Installing: /wrkdirs/usr/ports/lang/rust/work/_build/x86_64-unknown-freebsd/llvm/includ= e/llvm/MC/MCObjectFileInfo.h CMake Error at cmake_install.cmake:41 (file): file INSTALL cannot copy file =20 "/wrkdirs/usr/ports/lang/rust/work/rustc-1.63.0-src/src/llvm-project/llvm/i= nclude/llvm/MC/MCObjectFileInfo.h" to =20 "/wrkdirs/usr/ports/lang/rust/work/_build/x86_64-unknown-freebsd/llvm/inclu= de/llvm/MC/MCObjectFileInfo.h": Bad file descriptor. FAILED: CMakeFiles/install.util=20 cd /wrkdirs/usr/ports/lang/rust/work/_build/x86_64-unknown-freebsd/llvm/bui= ld && /usr/local/bin/cmake -P cmake_install.cmake ninja: build stopped: subcommand failed. I'd seen a similar error with a number of ports - "Bad file descriptor" - before stopping the port upgrade. Now having updated the local 13.1 build to changeset b63021e001d under stable/13 branch, I've not seen any such error when building rust now. Of course, it will be a few more hours before the entire port upgrade complete= s, if it could serve any test of the issue. If it may show up again, but I'll look at adding those options to my KERNCO= NF and rebuilding the kernel. Thx! --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Sep 25 21:00:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MbJDy70Ynz4cwdt for ; Sun, 25 Sep 2022 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MbJDy2QKBz3Zg0 for ; Sun, 25 Sep 2022 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MbJDy1LS4zYK0 for ; Sun, 25 Sep 2022 21:00:18 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28PL0Ik9035836 for ; Sun, 25 Sep 2022 21:00:18 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28PL0Ig0035835 for fs@FreeBSD.org; Sun, 25 Sep 2022 21:00:18 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202209252100.28PL0Ig0035835@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 25 Sep 2022 21:00:18 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16641396182.7Cdac2EE.33633" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664139618; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jC/92+iTlS0qOYflbCt/qxV9LKdP/Rf0B2SEbtt72bY=; b=JCZx7Kx1Xh2VeqcIeUIV11BhlsB+OzVRZ6xcse88unxac9OA0G5wW4emyhdC9jqq17R7rA ThkF5L6uSBx0vBM2YUQ1OlOK1idN0ZwSAM+3lze0mf08C2VpgI8Ql+rfdR7pyENjKP71fo ideA2jcEV2NWFGHaussY6rHmCwX1shUYE+6EDodCFy3W48NvkwaRE8wu1ZuOj+PMQPEPZR ZgH2PH7AvFSYNP5qjaD3P1612x87IMjHGNWN9beGiLWMQihxavnqEAWkZcOcHn4zwJPBHu lS5d9wA01UQcaFZHLLUysvAFxMuI/HGCJJAjwnJW3tiBkCUa8ToTuhKIFIhCVA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664139618; a=rsa-sha256; cv=none; b=NvBl8QNA56+/4OZr/tJQOlCfSTLhzpUEAxEac8gF/PAZD7l8kkCU2YzGI07MwY1OihNI4s tbnixLtZttiOexM8CN1JRzxQdYlQOZ+nyI6inlt3qLMhi27TeaSyxQj/CGnnyfdb/9ClN5 fz2Y2STZpSyXBJ/gfFikeng0jpiPKCPDk0kNhJUQw3cAg+eqhxZBXYbI5ZE6v9rzmVALf+ GLCwfMk0m1bcW31P9TR5iDIJk3zCVxMkolFJdHL8Ld11l9KasEhYt9KlT7DhvmNEr7F+6o HgEbptwZj/KZt/LrGG7DBnXrcXD4mWSA7LxqaElIBu+cRR19Aoe9Bg97CS4oUg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16641396182.7Cdac2EE.33633 Date: Sun, 25 Sep 2022 21:00:18 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16641396182.7Cdac2EE.33633 Date: Sun, 25 Sep 2022 21:00:18 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16641396182.7Cdac2EE.33633-- From nobody Fri Sep 30 05:47:04 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mdzl06Wmlz4V5sR for ; Fri, 30 Sep 2022 05:47:08 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mdzl060HXz3xk5 for ; Fri, 30 Sep 2022 05:47:08 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664516828; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=VturmrWpG6OUGbm34TFGAjDtJpIhnE3cgX7zwlc5HUA=; b=qu5X1FG3QPbBVdyh+0SE0EmdlCaBiLzHWftAnQMpz04VpFQsIz/E+c4NOhOFK9MOs8gS1H Vkqe7e9wukzLeWZaa1w5zVzLPqoKdroRcvqX8eSJ/S1QkVANFBLVauvun1SsvAZ3aVtyf5 jPU064kYDmW9n9h0Hfg/AcMAWLb0Rb1t8l2NnsxD3IjmnUvs4aOsAN+3tjKvTom6HRX10B N9lyi5AdCmo1K6Qo+rTZHJzimynKd7uqolvwciPgn/oE5FRiSTSCY71iSlQjTNUB0uv8Yw TpiWvIY9/LeWpdFk31I8GT63FlSB8cusAJmndp3Oka7zG5yhuwT+vOduBkBNPA== Received: from [IPV6:2001:470:1f1c:a0::2] (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net [IPv6:2001:470:1f1c:a0::2]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: grahamperrin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Mdzl03Z6rz11Bb for ; Fri, 30 Sep 2022 05:47:08 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) Message-ID: Date: Fri, 30 Sep 2022 06:47:04 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.3.0 From: Graham Perrin Subject: =?UTF-8?Q?266236_=e2=80=93_ZFS_NFS_=3a_=2ezfs/snapshot_=3a_Stale_fi?= =?UTF-8?Q?le_handle?= To: freebsd-fs@freebsd.org Content-Language: en-GB Organization: FreeBSD Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------auyW4CcYbpbebpEchZl8QlNe" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664516828; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=VturmrWpG6OUGbm34TFGAjDtJpIhnE3cgX7zwlc5HUA=; b=UXPKWZjGqcwiBNGfgMsCQGjwI38QPxP2YfwkQiQm1IME/v4RIFucbnmUuvZMH6x/3FPsqo Z7QRVu15QoPPvx+JOjtWW3fWpCiJx8/gKCHagxniX17B4seUCp3+7OovNIld9gQiTp8oUK WaABzV2fggslEf7atnYIHWBsywzPxYR01+1i2/ZQLeDnffbLQ0qJMoeMXlTh7AxnDJgeok Suz/5g1tjwvfuOXqtALialPYO9SizmJeW/xX2oiwoNQVsWPc+XONEuO6aLmLdOVGxgr4uO OIGgn8/zmlNCOIDcBuRi3X/e2hgE4xuV6DRHamEQDJ4jR1gJ2uwY0nRJKRlGrA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664516828; a=rsa-sha256; cv=none; b=smoIKdYwm6mWK4PWosuPk2Ne4S6wydie9DRTbeVAT3hDe1SPy06eIjwNYXkaZXn2ifK2JK 5sbmFzI2jy4/czZDxu34T5dEPAxkd9j2d9M4KLxM2/qp6hNi7ytlyL6/8wawEqJH8EfGrQ aLqucbaGvpL18j9OovCfNy327E74tfAMRcw7m55StGgNu2ml45FnWzz5qB4QAppowa88qe zoTx1SkuDfjZdBh/SHOA2x0POb6m3HlupO+fljN8j6TJa9M1B3L8T32UmWXS4qqBFt8a25 QzvCE6oySLzoh28Raq5tXzCYAPiiFebveUznBEiXB33AFpscKKIeAqyNpzrTuw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------auyW4CcYbpbebpEchZl8QlNe Content-Type: multipart/mixed; boundary="------------4SxvFkhfLIV00b045WvIacjV"; protected-headers="v1" From: Graham Perrin To: freebsd-fs@freebsd.org Message-ID: Subject: =?UTF-8?Q?266236_=e2=80=93_ZFS_NFS_=3a_=2ezfs/snapshot_=3a_Stale_fi?= =?UTF-8?Q?le_handle?= --------------4SxvFkhfLIV00b045WvIacjV Content-Type: multipart/alternative; boundary="------------HnhT6hfsFkGH0pL3RWGSMpNh" --------------HnhT6hfsFkGH0pL3RWGSMpNh Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 RllJDQoNCjxodHRwczovL2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dp P2lkPTI2NjIzNj4NCg0K --------------HnhT6hfsFkGH0pL3RWGSMpNh Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

FYI

<https://bugs.freebsd.org/bugzill= a/show_bug.cgi?id=3D266236>

--------------HnhT6hfsFkGH0pL3RWGSMpNh-- --------------4SxvFkhfLIV00b045WvIacjV-- --------------auyW4CcYbpbebpEchZl8QlNe Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsF5BAABCAAjFiEEWT/lssMHB+28ly8Kt2dIb0oY1AsFAmM2gtkFAwAAAAAACgkQt2dIb0oY1Aub vw/+OXQaItHoNmuM1qkhtmBxHey0MtQ5PHc6IFzOTG9DBn816yjMv27Mt3peY3W+6PLKj7ircJ0t AU8JwGY5nLyM7le2BrpxVaRbFFcZ5nA3FEpCecacFvNZyiaJHT/Qu4PRbMF9ihHKFRivBm19VHpi L33iMgT9g9VNS8W4cHXRnoSSSKAAMv018+SVVzP3KkqLNBGRYapSchuEUaFpEzvA5vKQVhnqmPkk Z6JtRwN2d7nApmUsUcIWSomkeIcWmsY2Yw2XciEd+3CUKTCnK12R6NrKgANFRb82l4PI14nSOPmc xz05W41emNZiGwzWSzwKmi5x3GooyMpnkgthiUZZaHtG8Rr3TciICRTjifgMm7Yznr03DBmftf6O FoMqTy7FDJopcKuutMCTuNjolviQ0joNDTwOeCEff+RqsNHZRCjSYhEJJFL6DqeAWxiGfki4I9Hj 8K6e/qkoHjzADxFsa3ohzTFXmx1NSYXTyV7it8YAsKHEJtTaazB4ZV2XzMrg/nuNgsYhAnAyphZ5 EeO25Hnv3qj6idzd9Ki8NvrhQAu9VI8Vy5/xzwgrf7bMyU5fRlJ+QyP9aAF8FY45+q+msi3I47iW y/Xu4d9iLnCU1T+4r5bR6ox8kYdymS7Oqo+Zppb0hKXYgxEeD+95sOcH5aMl8L+P7O4Tb0T/0b+4 CIg= =DCNJ -----END PGP SIGNATURE----- --------------auyW4CcYbpbebpEchZl8QlNe-- From nobody Fri Sep 30 06:04:41 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mf07H3FBdz4V7Sg for ; Fri, 30 Sep 2022 06:04:43 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mf07H2VHhz3ytJ for ; Fri, 30 Sep 2022 06:04:43 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664517883; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=WXqiG4iDac6zBOmCEUJb+wMiczUmk/Apj8vZJDD6PJc=; b=Xws5TZ6HYmakLstizDCBLiDDeRskicN6JyyvVdp2cDIPVmrh5WCicGVB9zzb6CTfzKaeyU Yeg9P83SDXNFYtk6gXT4J5E0K/R9IEPiQ+1rSQ0ECN0o7DI0PhBcQzThQJ7ujtEtOAZsoT i1xF6YTAdejiTZ31i9xCJJN5uaSGHtAi27BeFPgSAQaezyIiPjI4zXU9/7tNKzQk/QvpQg XhUL254wOOHJBLH6W+2JlRLTCI1viWWHiZy9moKY+NIPJZxCTZjiy+dG26qKfYqlHRxjzd tjQARuNYJHtGMUjBfjgk84LZsa9QkoF3O2E0RnxUApWRqNNPikUte3Lhj53pqw== Received: from [IPV6:2001:470:1f1c:a0::2] (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net [IPv6:2001:470:1f1c:a0::2]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: grahamperrin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Mf07H07Ygz112G for ; Fri, 30 Sep 2022 06:04:42 +0000 (UTC) (envelope-from grahamperrin@freebsd.org) Message-ID: <7ea58963-8396-1753-8f16-bb30bc1a50f1@freebsd.org> Date: Fri, 30 Sep 2022 07:04:41 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.3.0 Subject: =?UTF-8?Q?Re=3a_266236_=e2=80=93_ZFS_NFS_=3a_=2ezfs/snapshot_=3a_St?= =?UTF-8?Q?ale_file_handle?= Content-Language: en-GB From: Graham Perrin To: freebsd-fs@freebsd.org References: Organization: FreeBSD In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------ca4be0BtoWyqll33vqtnpyus" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664517883; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=WXqiG4iDac6zBOmCEUJb+wMiczUmk/Apj8vZJDD6PJc=; b=ttXUXu08zP4JiKbxfF8ZfkBf55dU2xImcvDdQTQVYI+rhxdux4JmuTGpUCL6ZfaW+dID5l Bc/WEKelIbBdBQStBzOqoIpnZNxPhS9KzFvvCzxLkKwRU9Pgs3sEgNU7Yc/vLI23PMD/k/ x2XFdva2cu2QtEf/1uxoORtgVs7h2mQOaMtAqdvcab5saOsMG+qMX8Ur7tdysoB6FSAVcW PgwKyBboz6y+XU9QzaVpL2goDJq7HMM+wlM8MWz9mFSwr/xCdl2lHOXBEvHK9gbQ+a70HA c03v0xdBhSM/l111ppuRbJtCNzvfdrGBvEXEBFjQBhmk1QXDxiBa4SxQFFtgmA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664517883; a=rsa-sha256; cv=none; b=calS+WdtopAzem6tsDWrF1CHv4ISzj7Kf0c2kWs3VNXQ0bYV5z9v/GdrG5NeYumY/bNSRs cW9peIm8FFhVSr8LX2m/YksSxmAlOs87QbsH9Kt7MJsXuMXHm/f73JNyGHCUzF72OfrwPL MTFJK9k5bdI/9rszOKbOcRdVGFArT3COAx/zp8EKulLRpDwPagLUa36AVbIODY5fsV5OzK Qn2yJ8oHLqmFow4mflfAEqfBsa3x7SF+XUXyqAjOENvNhjyxq/4bFCU7w9Ktk342zCVyLo xqVlHxsgPDfEcqtBvek0G67igIN0iyWkSQdUMAMXZLZZpO8YQllYhNZvOA6dgg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------ca4be0BtoWyqll33vqtnpyus Content-Type: multipart/mixed; boundary="------------phwusZ2HRX5tevn4FBjxDuZC"; protected-headers="v1" From: Graham Perrin To: freebsd-fs@freebsd.org Message-ID: <7ea58963-8396-1753-8f16-bb30bc1a50f1@freebsd.org> Subject: =?UTF-8?Q?Re=3a_266236_=e2=80=93_ZFS_NFS_=3a_=2ezfs/snapshot_=3a_St?= =?UTF-8?Q?ale_file_handle?= References: In-Reply-To: --------------phwusZ2HRX5tevn4FBjxDuZC Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 T2gsIG15IGUtbWFpbCB3YXMgYSBkdXBsaWNhdGUgb2YgDQo8aHR0cHM6Ly9mcmVlYnNkLm1h cmttYWlsLm9yZy90aHJlYWQvcjZkcHR1ZXdzZjJrMm54ZT4uIEFwb2xvZ2llcyBmb3IgDQp0 aGUgbm9pc2UuDQo= --------------phwusZ2HRX5tevn4FBjxDuZC-- --------------ca4be0BtoWyqll33vqtnpyus Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsF5BAABCAAjFiEEWT/lssMHB+28ly8Kt2dIb0oY1AsFAmM2hvkFAwAAAAAACgkQt2dIb0oY1AtR /RAAlkbCxqqSuxGmjGKKSV2uLoBltpmixqcYElizgDQ/aZkZGmq2dS/EBahC30Yi4KY7CKw1Pqs3 rh++oizrD6ol86uC52iBnHidttGKU8OO7fNURhXiDpS3DkbDS+qxgXHJyI64NmrMuVjK4aSKcX/+ qV8m00Ny8l2vftCQTh0a9/5EogEVSTOMLbNZ5ddc8Osb7jfXkq/CCx+oS/QDhLNjpXXkRlVsBnP+ j88nEP1qvQqxTkdIRK2VoqoVoC8yQAJls18j1bhkRFE0NbINAtjV6kPZyqvGnP4LiH7JF/xCqGhy Trm1Ug7INRIb9nNbkiFb22mp2nOGLzfo3VWgt9teb9bGizY1frtu0yi6CySNuPdM0rcMi/XxNKNO u7Z2vzHTnmJvHcCYQqnc4IvVtvzsUGLXDRRTh9mnPAUfGtIoptpZBXjgOsGZCwjjZ8jocuQLzMv4 jW9wpZdbxqcMg4r5V0pH2bgzkqRrzorYfbXQgzjtghTk0UwIozbppvvZ6F4tcoojMO+3rSU4wPLC DJOb9AhIq6Yb4zuaAfGljt+EeAPPG6hMb9wcLgeay+6YnvknuupmIkPgas6IXW9qrdF83dLE5LSS QZWifeZp3Z4omW41N7agCT4B04eFKayCGFPlG8ZFZCSfhO+XtGv1O5PgAjrN5Ij2eB5ykYM7S8QL aZs= =vRk8 -----END PGP SIGNATURE----- --------------ca4be0BtoWyqll33vqtnpyus-- From nobody Fri Sep 30 06:32:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mf0lR3PdMz4VB15 for ; Fri, 30 Sep 2022 06:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mf0lR1ylrz42S6 for ; Fri, 30 Sep 2022 06:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mf0lR10tQz1581 for ; Fri, 30 Sep 2022 06:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28U6WZML062602 for ; Fri, 30 Sep 2022 06:32:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28U6WZrG062601 for fs@FreeBSD.org; Fri, 30 Sep 2022 06:32:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 30 Sep 2022 06:32:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to see_also bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664519555; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ahUcrWX1Ad5j3NEYvJd39p0FLY1HsaNjoECje9cavBQ=; b=b6hNTprNJTO5KRDd9WBvocVqgmUKBE62skjHjxsXLYGMNaK6xXgoddPamtlOefQ5iJf2bU +ClZTvPvZ7n1zRjFhobsMQ/Uly0gN8hHqnAIV5sTwF0B2jEdI5vu5SQnZQ08hk/K3bdTlK I8H85Pp5TLSsrVMAZAl8SVPloyP/UBM9TsHxdqxkwRRjF6dZ8+imzAAAvfov5lC47T7oP5 RKhFJhJ5PKW/eH8Pf/zUotYw0Agc34trlxgpTZ8vs5ukHfI0RFhhde2KNUhXiLGW8JisTz ORp9hKup9bgjS1JPMfXFOO9ptoREGvFVhH9oucaQxdvFU3Kd6EOZy1O0bK/Mrw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664519555; a=rsa-sha256; cv=none; b=VeEqBo98KNPyGBGDvDmUmJIQNO/jRhYGJxlKYKflVFPKIhGjGPz0mS+iI5G8uRcv5VY95S 1mEmL86KmyZziv4LbhpcABQwPbE/xNPiiPQ8bVP1y4cB5KrEggRRD6XgWu0yFPlDGlOf8+ YfjRJOmGIEPJUFfsGzMmlQLpWFMB8MufdT78kWuPc0AsGprbDFq27Bf5qwrQs35hB3/4d+ I2sxGoGxI6trK4IEWf7Jkw7G1aJ84lM/ObqLN4G2qXV8qLubKu6s0ArEtKPXJK6ZJfBpi0 MPaZqLca8y11vVpeuorXIFFbEgWC5tN1Q7k5S2Ic0lmlBR9DnvtcVXbmWSmRzQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|standards@FreeBSD.org |fs@FreeBSD.org See Also| |https://github.com/openzfs/ | |zfs/issues/6594, | |https://github.com/openzfs/ | |zfs/issues/8645 Status|New |Open --- Comment #7 from Graham Perrin --- Should there be an upstream issue for this bug report?=20 OpenZFS issues in 2017 and 2019 (both now closed):=20 > Unable to view snapshots over NFS in 0.7.1 =C2=B7 Issue #6594 =C2=B7 open= zfs/zfs >=20 > =E2=80=A6 Stale file handle =E2=80=A6 > Unable to see ZFS snapshots over NFS =C2=B7 Issue #8645 =C2=B7 openzfs/zfs >=20 > I see that there have been similar issues like this before, but they are= =20 > all closed, =E2=80=A6 Cross-reference: --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Sep 30 06:47:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mf1562XWCz4VC4l for ; Fri, 30 Sep 2022 06:47:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mf1561FPDz43PB for ; Fri, 30 Sep 2022 06:47:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mf15607dXz14vx for ; Fri, 30 Sep 2022 06:47:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28U6lrYb076274 for ; Fri, 30 Sep 2022 06:47:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28U6lr9q076273 for fs@FreeBSD.org; Fri, 30 Sep 2022 06:47:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266374] FreeBSD 13.1:With ZFS installer reports sysctl: unknown oid 'vfs.zfs.min_auto_ashift' Date: Fri, 30 Sep 2022 06:47:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jlduran@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664520474; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UOUa4Dtn7tmiCHaS9OM5Ep5WxNC5BtJQafiyNh2nu3k=; b=p8pb7uhiPTzlvt1XRHKIw2LVIyEThjnrE47+RmK6Ind0bAFxGKHOYONdR0A6LiSTaYmis1 hCfdP7YcsP2eH3UVP5HZEpI4sZVxxM2U8+vbzZf/+yhyXYuVHiqzoA6t6oXtRYdpKarzti tZoPoeX3eewhEzXdxn9vJ6qFo9gDkyNGlu9a279x0GiVmQ16R0ME5k3voJloIk7retTZ9n flsw0/bpXJP8sP3xWOZS5Way0OxKstr3clNkSEZitydQiFRwFSGFBOQ49Qv2cqvMYCLSty VuU4GgFrNiqGTYRsxiPIBnbgQPpPRJhrdxo/DYY8ph2cAK8A/uvupkodUggDNw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664520474; a=rsa-sha256; cv=none; b=eaWY5qDqTw2wJsNAkD1U3X20NeQINmicvazjlHhLQJsPkLyJlekHGIguryvYKzZHkuJPVY N+NDf73oV6YgdECCJKQ/zrZ15q8BZquN9PLjwwqEEmOL2kUW/Fo/+RVk5CVWhhTxNP24kV 9n6g9p6dbEgeqAVj2UXMCsFhkTIkL+hQUceo6zPUWuMUFmNNxWOT8GBhYzHp++vuJWUlyf +J8xjPQAv2GEWZi+IRZdvNw3e7WuE6EpuJzvaorR2KdKXMrT/tWnKp8wFJ5Ei3oyDhua60 QGoE2Dw7uTGy1FVOSLNrp+P4KWR0lpuMKvI+uViFtNyQ4mUbOAesv+vBsXJkew== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266374 Jose Luis Duran changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jlduran@gmail.com --- Comment #4 from Jose Luis Duran --- Granted vfs.zfs.min_auto_ashift is a legacy sysctl, it should *just work TM= *. With the migration to OpenZFS it is now vfs.zfs.vdev.min_auto_ashift. # sysctl -d vfs.zfs.min_auto_ashift vfs.zfs.min_auto_ashift: Min ashift used when creating new top-level vd= ev. (LEGACY) # sysctl -d vfs.zfs.vdev.min_auto_ashift vfs.zfs.vdev.min_auto_ashift: Minimum ashift used when creating new top-level vdevs --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Sep 30 11:52:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mf7s05ZDyz4dgP6 for ; Fri, 30 Sep 2022 11:52:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mf7s04VbMz3VPb for ; Fri, 30 Sep 2022 11:52:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mf7s03ZMCz18tR for ; Fri, 30 Sep 2022 11:52:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28UBqqkc042129 for ; Fri, 30 Sep 2022 11:52:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28UBqqLG042128 for fs@FreeBSD.org; Fri, 30 Sep 2022 11:52:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 30 Sep 2022 11:52:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: florian.millet@laposte.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664538772; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MwydzDGzMqflY8wuDG7V724VvETuWR/f8P8RN/ghIUI=; b=oIkfmLM88qUPL4AM/Gn/gELGe/U5ynnjx2jTUYACIc8kP9+NN1uEXBOy5SfNp4h3MJpnAw bi0VhaVnSetAQoY+M7o68oQXnJRIaCTN39VzTiwmJmzzu9cAIQrfW4HumWdOsHbOuY5Vq8 EB+ocJ73aUKqaZ7ucy3ckyDSstzhBOGYY3R4WsVdKcmjvtWrT9qU+HW6sj4fNg9KrGGkNu reXj4V0SlrRH05gmU7bubF3BdgEcvE8mWXUoEjM3ayxfnoXcmQk9OQi31X5ZpKSAH8lFWS E8p4huuNSwoH8UiYDX1KrodWTR4W3FbRpiyEvb1xp8F507TYeZa1q5HCagh0rw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664538772; a=rsa-sha256; cv=none; b=Zwnb87P9d7+1zPj/cbTCJr0HwbS36pis6wTEGqNERE5gEs07YbpOJVSGohlP0/mIqxYS5T 838NokcOwRHGqvsAu1zB3aD9Rxg6BMD9xNb/SDO0GdZCUQefRj5KN+R0G65ndhqJvOHNSu OMGWBLwd1Q4/4njnXWPie2wRpFyeipBfxrW5E07wAHsZy13y3QDPeoG8n13j+bKo1UH1/9 ooSp4wEE7ak/J7UBBBFz1iHI1WF+5CZnlG+i5+leqhIF7qQh/pqLLt/o+L+3yqo7nKetWO RX0Y5KAH0cNaUCKitkmyo5+7qQ/UJtSDPzv0d9G8aaOqAKcVwQpT4Au4D8M0NA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 florian.millet@laposte.net changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |florian.millet@laposte.net --- Comment #8 from florian.millet@laposte.net --- We are hit by this problem as well. I would add that the version of NFS used by the client has no impact, NFSv3= or NFSv4 has the problem. When FreeBSD changed from ZoF to OpenZFS 2.x in 13, there does seem to be a change in the unmounting of the .zfs directory (see https://cgit.freebsd.org/src/tree/sys/contrib/openzfs/module/os/freebsd/zfs= /zfs_ctldir.c?h=3Dreleng/13.1 vs https://cgit.freebsd.org/src/tree/sys/cddl/contrib/opensolaris/uts/common/f= s/zfs/zfs_ctldir.c?h=3Dreleng/12.3) a new function zfsctl_snapshot_unmount has been added in OpenZFS 2.x, and if you compare it to the old zfsctl_umount_snapshot, the logic is quite differ= ent. Perhaps we have a regression here ? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Sep 30 13:26:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mf9wd2Mvzz4dpyN for ; Fri, 30 Sep 2022 13:26:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mf9wd167Hz3cy6 for ; Fri, 30 Sep 2022 13:26:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mf9wd054Cz1B6G for ; Fri, 30 Sep 2022 13:26:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28UDQ8Xj052321 for ; Fri, 30 Sep 2022 13:26:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28UDQ826052320 for fs@FreeBSD.org; Fri, 30 Sep 2022 13:26:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266409] 13.1-RELEASE amd64 crashes in: sa_handle_destroy at zfs/sa.c:1368 > zfs_znode_dmu_fini at zfs/zfs_znode.c:390 Date: Fri, 30 Sep 2022 13:26:09 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 000.fbsd@quip.cz X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664544369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=q72hqqxeuwCt4Talsi7CuIZml+uPugsKgVe/s7IqC9E=; b=b9WKVvMDE7XgWDqcOG4qxeUXC++djtatuINSmr1S3c39TNieyncc4wXE10GWhv0Oa6l3VM zeqGJCqOT7/RphCX5QTAR2C6NPk0iwASwFtM2T2QVrBbRrlvO1N4hGFOV4n5hdNKEWqWP5 IuDq77003MLh67X+iSg+gnPJW1Y3t6E/BDtI96AIxe3Ch62w1SgENh9SvAv6aEF/mAR1rX rkH0CCEqIFFWa3LjxPwfdrquKIbUm9yq81pvMuA+RewSARs/Epaa2ezG4WhHBa8Mo+efMe l1cQm3opw/HvGoaMuY9QWFjixcSalLJyITaSQB5m5w3E3nt3KMgdFLZNhNXLdg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664544369; a=rsa-sha256; cv=none; b=LwnofGg6k4HKg+JMvq+Vih0AzmgqxDDOA+h8kNwCOs5MYHfnyag5QD9m38rw4RnTopC1jX WxlRCafsEr0z7uZd5Pf0AqL1PCxy/4+3PajgChXwd8tQc9igyiPPdL3GM9DhVsYo0xI85i 6dfRGP53zdtlIASmMfId/cDKxHE+tS0XPYrY+IMkGVSsKaSwFECX3Vcbib5+vGyrZ+nNd/ nYjeitthr1dLB3CyTZkP4G5rXNilGWyvGXW6zOGRC5NWjyLP317fsF0RJ6tpNRCOO3g/Gb ynsEuGkDhIRTIe1zn3HgdI7rcDW4iMwHjAmt2yx7S+tp4Vhyz2GXXw+akfAbzA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266409 --- Comment #21 from Miroslav Lachman <000.fbsd@quip.cz> --- I can confirm the panic is related to filesystem content. I moved all the d= ata from SSD to HDD by zfs send & zfs receive few days ago and no panic occurre= d so far. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Sep 30 14:02:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MfBkQ3gNNz4dsh7 for ; Fri, 30 Sep 2022 14:02:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MfBkQ2fQsz3hD2 for ; Fri, 30 Sep 2022 14:02:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MfBkQ1l0dz1Bds for ; Fri, 30 Sep 2022 14:02:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 28UE2Mpb095999 for ; Fri, 30 Sep 2022 14:02:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 28UE2M74095998 for fs@FreeBSD.org; Fri, 30 Sep 2022 14:02:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 30 Sep 2022 14:02:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664546542; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lp98YaCtqi6C6Nb4jiUnm/wo26xstx0WVRks2SMKtPg=; b=P1L8KtitXYUUoruCx4QOFFUWkO3ob293dTShqj94zHqh4CEkdXP70KurtZ12GDHA1HqlBY d7cOuAYiNvuR1bBEPRhhiP56SpwQsbQZPeOmHIEK8u7jKS9Xj8R+qXeOz2cYbE7M9sW287 8mP3INDZOdyuWYHFrTeINZWTXBGddDAy+3ySwaHd3c/hU2dHg8cmTUHrVdONJvFV066n8l KSnk3flswWuMz7fCxLFlTSCBSUCLUz+i8I4JKmavNp1PSQir6NT8CZxX/dNXGdTl1URagw mlngUBUcYeVVbYjMEbjP8kFVhR4+8ISQzh+4ep4RphIOWWrlMkJPe8+abP+80w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664546542; a=rsa-sha256; cv=none; b=XShwPdQaL5S6BugO4RHBhgFvi7ru8QFDmd5/Cqnfsrcui/PW9DVtF+Tlop4JsDn4yxhG/K l4uWWRMlSnRmCu8XgqQQ0Pae++jE46aT0L3XsKnbfGOBdNxDr2NZxpOOqA/pjFHm2FeqaL uG2y6wIkDLSKYWPo8K183vCbNWeqgn12Xco2DnIS8NePakU+QRTDxq/1+sGKcXkAJYvDUk PJEAK6KEY/+jL9uAPmJ391f8E60lto2/RllvNIzz1WMIiUG/rNjdk1P6xbkmqrkPl3hZdH 6qmjB591jRmhCPIJcCm3+1EFJ5xXSRTnApAvOcKvEaHFK+D9PqCAIJ34V2LtTg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #9 from eborisch+FreeBSD@gmail.com --- (In reply to Graham Perrin from comment #7) There is now: https://github.com/openzfs/zfs/issues/13974 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 2 02:17:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mg70d44fkz4dctG for ; Sun, 2 Oct 2022 02:17:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mg70d35Ddz3mX0 for ; Sun, 2 Oct 2022 02:17:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mg70d209Pzjt5 for ; Sun, 2 Oct 2022 02:17:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2922Hrik010379 for ; Sun, 2 Oct 2022 02:17:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2922HrAG010378 for fs@FreeBSD.org; Sun, 2 Oct 2022 02:17:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Sun, 02 Oct 2022 02:17:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664677073; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1z7zTJkjB52Nti6KJMwvIh3lwyXu90mEcK6sEvvYhtA=; b=gBxdZh75jBRFJjMRxXD+sqg4UzjFsT2RK9aVe3nRDB1uRbZUPYkp6ZoW8+wmmDoX2IbsA6 XC3JFPudDBb45GVqtmEgw86R6rGdp0e7/zW4zsSf6XgMONZ2Swbl8nH8rR8T9P3E63CbzP s5TEP00wHaUWfGsto5nBRg6s8yQZh5nA9mjutUtB+g5if6boqMktIsmuJSKsRETK0pOfwz snmfYaQDFySDx7/wIExJvsyEjV4ImWDWWs98WoJRmMgMn0VH3mjDYC0MecGI3/MWo68Nxh 7SaMr+2o9sMUZwQWwd/o/xg7kgL22Yt07kTUebHCl83IIFSd/e6ZGBrK4I18mg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664677073; a=rsa-sha256; cv=none; b=TOTT06AZaTrFqVvT5euEYfyYgLBgzKr6vdE+VNpUaNkmeTgoBxqeg61//1MdFkyIcr/o+1 QuIm2TqvVfav+AcSLNyg+ehRtvLp95NFqOfqieVBC8uOl7KNm88z5ZWdyZ/NFXRdlOW1Mi OHHfx5YAjBUyFtra6FcTEA322u6bYh/7m3DV389su/mzHqasLSYw3mlzwW2UT7+d8sNP9a rigDfgRZKEbXpWNgpy2r5+UViQZUwy4EeuPrUOOtVOTE8tEQFbZXvZabmGUNKCwm3ruzxs A2A9Sz95/I4WjnU9b7V9blJZq1PF0xLuwBzCf2jotaMDI4/QuNP1W14Bnl4FoQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfs/ | |zfs/issues/13974 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 2 21:00:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MgbwT5tMWz4d4Jv for ; Sun, 2 Oct 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MgbwT1gdnz3gSg for ; Sun, 2 Oct 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MgbwT0ccBzywV for ; Sun, 2 Oct 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 292L0vG0050224 for ; Sun, 2 Oct 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 292L0vRJ050223 for fs@FreeBSD.org; Sun, 2 Oct 2022 21:00:57 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202210022100.292L0vRJ050223@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 2 Oct 2022 21:00:57 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16647444570.6541c.45634" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664744457; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ZfMqIJ5kOOUuVCNiCujpRk1rfJM15OWcPkeBL7DkRGI=; b=ClCX63tyvdbq2NLb0AWXWQz4ulWflv/HRJAvF0cMpDXJaZ8rdepa6+ExQHutAg7MH1NOOt tk7K7yzWzluGTzqNITN/y4XvV0fmtU7JmA8XtylvYlDxFdMWS2gKvgqx4d+36XOcDnecqs YqY3P9qAVySnluouKANVeQTUKj27X4ak/dT8a3ImQlCe7Fh0zrsewp/utGFZ9B0c+S8Ejl lcTsQw1aswKayx9ik1ze5e2krzIzJiuB9o0fRCqAbLWR59Pck6Fk0C+ztdhPdKkm0xl/+G rmQJ8uE4MRCMo9FBnLMok5l+P+iHG8Z+fhlrLu9WR5S7xjJlQDA4FnTcoEvqgw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664744457; a=rsa-sha256; cv=none; b=VBUOKnGWcFy5KgcPO6PNFVxT1LrA1SedG/3819/DEJCVY4+ViYwIiW+QIHsBsllmVLL8n6 Kmz5W7Cjru2adjhl5oCWQpgEhD/BzZ34cyDue0m88GKJ1hU8nTQmeO0sD4hcTFXAb+GGkG oOZFPW5vl3Xu9cjEq8rzq7sAyVCzT9ytoCT3NSgZDLOz+0mjx6AlpIf4Gfv7SmLXHoW8ay VxogBnIFyRrFYc7acec39svRged6PUNWgBCMjH8B1Js7eZXDWFfX1vnaHvuJg9xeJTcoJQ GyU7E9QDdZDHuwy97KoMYacieYa5OIshxGeRMPkIX5JeVIGPWbRMcCq4JPcOYw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16647444570.6541c.45634 Date: Sun, 2 Oct 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16647444570.6541c.45634 Date: Sun, 2 Oct 2022 21:00:57 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16647444570.6541c.45634-- From nobody Wed Oct 5 15:18:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjJ9j3jhfz4V2BS for ; Wed, 5 Oct 2022 15:18:17 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4MjJ9h03nsz3fdC for ; Wed, 5 Oct 2022 15:18:16 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from x1 (94.105.105.213.dyn.edpnet.net [94.105.105.213]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 5CED728B47 for ; Wed, 5 Oct 2022 17:18:09 +0200 (CEST) Date: Wed, 5 Oct 2022 17:18:06 +0200 From: Julien Cigar To: freebsd-fs@freebsd.org Subject: zio_read error: 97 Message-ID: <20221005151806.k4b5yf2fpyy56xty@x1> Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="bg3pyh3y7e7u6wik" Content-Disposition: inline X-Rspamd-Queue-Id: 4MjJ9h03nsz3fdC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=PXPv=2G=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=PXPv=2G=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-4.50 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; RCVD_NO_TLS_LAST(0.10)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; DMARC_NA(0.00)[perdition.city]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; R_DKIM_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --bg3pyh3y7e7u6wik Content-Type: multipart/mixed; boundary="g54odslnzqtx3xjv" Content-Disposition: inline --g54odslnzqtx3xjv Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) and it doesn't boot anymore, I get tons of "zio_read error: 97 "with ZFS: i/o error - all block copies unavailable" .. any idea what could be wrong? It worked like a charm before reboot.. I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} but it doesn't work any idea? (I've attached a screenshot of the iLO console) Thanks! Julien --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --g54odslnzqtx3xjv Content-Type: image/png Content-Disposition: attachment; filename="zfs_error.png" Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAzwAAAIqCAYAAADhDk/cAAAgAElEQVR4XuydB5RUVbaGN5Iz guQoApIUEXyCgAQJIiCiBBFEYEDFB6OEEZX0yAMSH4ygIkFEkooMIIISRkBgHlFFkZyDJMlJ 8PnvmVNz+9bt7ntvV3dVdf97rV4NVSd+5xacv/bZ+6T6/Q8TGgmQAAmQAAmQAAmQAAmQAAkk QwKpKHiS4apySiRAAiRAAiRAAiRAAiRAAkqAgocPAgmQAAmQAAmQAAmQAAmQQLIlQMGTbJeW EyMBEiABEiABEiABEiABEqDg4TNAAiRAAiRAAiRAAiRAAiSQbAlQ8CTbpeXESIAESIAESIAE SIAESIAEKHj4DJAACZAACZAACZAACZAACSRbAhQ8yXZpOTESIAESIAESIAESIAESIAEKHj4D JEACJEACJEACJEACJEACyZYABU+yXVpOjARIgARIgARIgARIgARIgIKHzwAJkAAJkAAJkAAJ kAAJkECyJUDBk2yXlhMjARIgARIgARIgARIgARKg4OEzQAIkQAIkQAIkQAIkQAIkkGwJUPAk 26XlxEiABEiABEiABEiABEiABCh4+AyQAAmQAAmQAAmQAAmQAAkkWwIUPMl2aTkxEiABEiAB EiABEiABEiCBVJs2bfqdGEiABEiABEiABEiABEiABEggORKg4EmOq8o5kQAJkAAJkAAJkAAJ kAAJKAEeaeODQAIkQAIkQAIkQAIkQAIkkGwJUPAk26XlxEiABEiABEiABEiABEiABCh4+AyQ AAmQAAmQAAmQAAmQAAkkWwIUPMl2aTkxEiABEiABEiABEiABEiCBRBE8X3zxhWzZskV2796t PzQSIAESIAESIAESIAESIAESiItAyZIlBT81a9aUGjVqhAxWSAXPN998I+PGjZMTJ06EbIBs iARIgARIgARIgARIgARIIGURyJcvn7z22mvy6KOPJnjiIRM848ePl7lz5yZ4QGyABEiABEiA BEiABEiABEiABECgVatW8uqrryYIRkgEz9ixY2XevHkJGggrkwAJkAAJkAAJkAAJkAAJkICd QMuWLaV79+6+wSRY8OAYW+/evX0PgBXdEyhVqlSg8K5du9xXZEkSIAESIAESIAESIAESiGIC I0aM8H28LcGCp1mzZhEbs5MpUyZp0aKF3HXXXWFd3tOnT8v8+fPlypUrnsaRK1cuqVOnjkDo FC5cOKju4cOHBcJn8eLFcvXqVU9tszAJkAAJkAAJkAAJkEDyJjB58uR4J/jyyy/HWyYSCiCm Z8GCBb6GkiDBg2xsgwcP9tVxUlR65ZVX5P7770+KruLtY8OGDTJ9+vR4y5kCjRs3lscee0wy ZswYbx2InRUrVqjwoZEACZAACZAACZAACZAACCQnwYP5+PXyJEjwDBkyRJYsWRKxTxRiiyAY xowZE9Yx9ujRQ86cOSN9+vSJdxwYb5cuXdSrA4OYWb9+vcCbc+TIEf0Nb0+hQoX0d9WqVQOi CN6eSZMm0dsTL2UWIIHkT+DOO++U/v37S79+/eTSpUuBCd9zzz0Czzz+Dbl8+bL++4Ivr27f vq3lCxQoEATn0KFDMmzYMEdo9957r+BsdZ48efTfqI8//lj/nYrNvJY37TRv3lzSpEkjc+bM Sf6LxxmSQAon4GaTnhBEXjwaTz/9dEK6irXuZ599lijtxtco9pnYl1pPDnnhYdp/4IEH5Oef f/a958Q48MW+1y/rGzVqJH379o1vmkHvJ0jwtGvXzvM9O6F+iONaJNOXn4X0TDKOCm7HYX8I t2/frl6huI6roU779u2lQoUKOgJsNCDweMQtlCvItkggughkz55d/vznP0vBggWlV69eAcFj RNC6detkzZo1kjt3bv33Ax7ipUuXyt133y3p06cPTDZLliz6/sKFC+Wrr74KgpAzZ04ZMGCA Cib8e1W3bl257777VDhdv349weVNA7Vr19YsPatXr6bgia5HkaMlAV8EQr1XtA/Cy74wscbi ZQy+IDpUsu4z8QUVvviCeR0LxA7q+N1zWscBweNF9OCOng8//NAzkgQJHngXvFqoH5zkJHiw sahSpYoiRcwPNiFuDSoZ8UowfGM7Y8YMt1VZjgRIIBkRwH9Ezz33nJw/f16/wbMKHggHxAXC 62OsXr168sgjj8jAgQODKHTq1EmyZcsWq5e8adOmekHcqFGjtO4dd9wh8PxDAK1duzaoPa/l M2TIIM8//7yULVtWRduOHTsoeJLRs8qpkEBsBNx+UeyVoJ92Q71vNWP2KjK8ztVe3i52Ro8e LTgJBfM6FrTVs2dPFUxeRY/TOLx+SY99rldLkOAxm3OvnSZV+XfffVe7eumll5KqS8d+3IwD R9jw8MAgdPyk+caxEggfGB5kZnIL67KzcxIICwGInaNHj8q+ffvU7Y9/V8yRthw5ckjWrFlj HDmrX7++VK9eXb0yVitRooTWhYBBe06G9/fu3Suff/554O3OnTurd8fpGziv5fGf6ZNPPqlf AOELnXPnzsns2bPDwpWdkgAJJB0BN/smP6Px066p46e/uOok5d7UCBR8CQbPDr6kgsjww8PM CW3iCzUjerDvjE+4xDYOr2wRF+/VUpTgwZEIc2bRCAqIBBgUKi5OxTed+IF9++23+oMFNYaH pEiRInpm3VrP2ra1LP7s5oEaPny44HgIHkS/iSDsDx82KjQSIIGUSQD/1tkFj51E2rRp9Uja jz/+qLE3VoM4gZdoypQpsQLEv1X4ggZHzYzh30Jk0sFl1HbzWt5aH0loKHhS5rPMWac8Am72 TX6o+Gk32gVPXCLDDw8rdy+iJ1RiB/1T8NiefvtC4j9wkwzAJDJA4BYM3hCo0yZNmggypMFw pnDRokUBwYLXoMgRdGuvZ23bDMOo9/geKLMxQb24PDNu7uGxeoogeOIKHvbzjwXrkAAJRAeB +AQPjp+9+OKLUrRoURk6dGiMxAZIXAAhhC9iDhw4EOuEkS0H/04iHsgYAnwRC4R/y+zmtTwF T3Q8axwlCYSaQGKJDPv+zM24MZbdu3fL//7v/7opHm8ZxFfiKHBSeHjiExnx7U/jncwfBdyI nvjG4aYfaxkKHhsx+0LCM2PSPBshYDw+cMMhExHu7MH9NzBkVsMdOhA4xpCRAvf72OtZ27aW xZ/je6AQ6Gvib5w+ABgzztybcaFNjD8296HpD8dAvv76a6/PEcuTAAkkAwJxCR54dnD0zAiT EydOxJgxsrghpb9TXI+1IL5Uwb8xdg8PkiFMnDgxiKLX8hQ8yeBB5BRIwAeBSBM85ktxH1MJ qmK+IE9sweNGZMS3P3U737hEj5txuO3HlKPgiUfweAUaqvLxPVBIVoAEELF9oMz79vEgaMvp bh/zYfIbCxSqebMdEiCB8BGITfAgC1vXrl31y51x48bJyZMngwaJeJ5t27bJ3//+9zgngH9r 9uzZo1ncjMFrhC+QZs6c6fgfvZfyFDzhe37YMwmEk0Bs+6b49lPxjdlPfdSJRsGDBDa45sQa sxMfn4S87yR60B7+n7DHDiWkH9SNCsETatUel0L282AndBGc6sc3jvgEiv19k5wgtg9gfO8n xhzZJgmQQGQRcBI8qVKlkm7duqnYQXYexMTYDf9pQQi5SXwCT1Dx4sUDx9dwTA7H43DMDamv 7ea1PAVPZD1THA0JJBUBCp7QkE7oXTleR2EXPagfarFDweOwKnHF8FiL2+N58B6EVHzxPE71 rO26jeGh4PH6kWJ5EiCB+Ag4CZ4aNWpI27ZtNdPZqVOnAk3cunVLdu7cqX83cYDdu3eXK1eu xOgG9/vUqlVLY3bOnj2rwul//ud/9A6fzZs3B+7hwRHcGzduSELLU/DEt8p8nwSSJwEKnuhd V6vowSwSw8OU5B6ehx9+OKJX5L333tPx4YgFDNnWrIH/ZvAmuNakhTZ1IHjwA0PyAvyYNvGa Uz0rENOvfRx2aB06dAgcaTP3WVjLmPft9XCkbdq0aUFrYOaJI23IPEcjARJIeQQgeCA8kGDF pKWGiClTpkwQDKSRhucH9tBDD8kLL7ygx97sVqxYMXnrrbdk5MiRepQNVq5cOb0UFDGGBw8e lFmzZgXSWIeivBnDf//3f6vIYlrqlPcsc8Ypj0Bs+6b49lPxkfJTH3VwosZpfxZff07vmz2a 2SP6aSOS6xjBY2LdEXNu0mCHatwbN2703FSC0lJHm+DxTCdEFeL7gCFpgUlz7fQBwEbiL3/5 i6atNob/+BFQ7JTz3PSH1NtMWhCiRWQzJEACJEACJEACSUKAgscbZogM7CXxxXw4zSp24NmB mXt6Qil6KHhsqxyf0EiqhyK+cZhvYjEePBCxXRjqNi21uTcId14wLXVSrTL7IQESIAESIAES CAUBCh73FK0iw5xGcl87dCXtYuftt9/WxvGFfahFDwVPPIKnWrVqgdTOuFAUZi4ZTeiSO7Vn MhzFJ3jQN7IimQcioRePmgCxQYMGJXRarE8CJEACJEACJEACSUqAgicm7th4OIkMp5M/ib14 cY0D74Va9FDwxCN4rDE88cXfeH04YosDQjtuBA+8N8Yz4zf2BufoH3vsMR16XJ4ir3NjeRIg ARIgARIgARJIKgIUPPELnmgQO2YWoRY9USF4rEH/ofjgxBX0Zf/AwMNj4mAQ8A/D/TehMKf2 zFlKN4IHY7AmJ0CyAQgft2aNA4otmYHbtliOBEiABEiABEiABMJFgIInbsETTWInMURPkgue //qv//L8WXj//fc914mrAm4Lj81MX3GVCelgYmnM7TgyZcoUcPuhKVz8hyxs9tSw1m5QB9mL THwPgsRwbjKuOkkxZ/ZBAiRAAiRAAiRAAn4IxLZvcrufCuW+EH0ittrEpPiZj7UOjndhz+Zl b2qdN/Z9OBFkwhfCtefzMw7rPtdkb/OzX/3nP//peRkSlKXNj+DxPMIEVEjoByMBXceo6mUc dgGDs5i4wA8PBsTMoUOHpEiRIhrvg4cdXisofRg+kH/7298odkK1cGyHBEiABEiABEggyQlQ 8MREbni8+uqrUSt2zIxCIXooeGwfSaOiIRbCEcSF4UCMQJh4/XbgySef1BSDRszE9a8N5ob0 0yZJQpL/y8QOSYAESIAESIAESCBEBEJ9Gsg+LK/eFeyzQpX1FntC7O28jgFzwBjC7dnBOCpW rCivvPKKfhHvx8NkFT0I//C6f6XgsT3RWBDExbgRDSH6jDo2gw8KjqZt3brVUze4xRyi5957 71WPjt3woP3888/6oPhxCXoaDAuTAAmQAAmQAAmQQBIQiDTBkxhT9iN4MA6/IiPUc8AeG3tQ v/tPiB7scb2KHczDl+DZtGnT734hdOrUyW/VJK2HI2DhEj0QOziGFgoz8whlm6EYF9sgARIg ARIgARIggeRIAF86J4ZBLLi1KVOmxFs0Wvbk8U7ERQE3POzNJOsYHhfMWIQESIAESIAESIAE SIAEIpaAG4+XF49RxE7U5cB8eXh+/8Ncth9ULNKTFvidF+uRAAmQAAmQAAmQAAmQAAlEHoEk FzwPPfRQ5FHgiEiABEiABEiABEiABEiABJIlgf/7v//zPK8EHWmj4PHMmxVIgARIgARIgARI gARIgAR8EqDg8QmO1UiABEiABEiABEiABEiABCKfQJILnpIlSyqVS5cuRT4djpAESIAESIAE SIAESIAESCAqCWTJkkXHvXv3bs/jT9CRNuTghu3cudNzx6xAAiRAAiRAAiRAAiRAAiRAAm4I lC5dWot5vdcSdRIkeB5++GHt2E+2hPbt20v58uVl+fLl+pOcLUOGDNKnT5/AXUC4hHTHjh3J ecpJOrdWrVqJPZ7s2LFjMmbMmMA4evToIQUKFHAc19mzZ2XYsGFJOmZ2RgIkQAIkQAIkQAIk 4J6AyQ69ceNG95X+XTJsguf1118XCKa5c+fKvHnzPA88miqkTp1aKlSoIF27dpXs2bPLiBEj fInEaJpzUo21devWUrNmTfnuu+/kj0t0tdvChQtL06ZNZfPmzTJ+/Hh9bdSoUXL33XfLkiVL 5IcfftDXcCTz6aefll9++UW6dOmSVENmPyRAAiRAAiRAAiRAAh4JRKXggXfnrrvukgMHDuhP SrBJkyZJnjx5KHj+vdhwTdatW1dOnTqlwtePDRw4UD2FU6dOVTEDK1eunAwaNEguX74s7dq1 09cqV64sOPuJ45cnTpzQ1/DB6d27NwWPH/CsQwIkQAIkQAIkQAJJSCDsgqdYsWKxThffnq9e vTrG+7Vq1dKNPwxHu5yOdzVr1kzSpk0bo96uXbtk27ZtntDmyJFD6tevr3UWLFggtWvXFrzm 1HemTJmkcePGQe3jrKA1QMrapim8bt06OXr0aFBda5toO3PmzL4FT8GCBaVatWpBfaxatUpF AwybffyAO1iZueM9HB389ddfY5TDmMEVXIwtXrxYrly5Evg7PCEmXsvaubUcHkI8B2gLYzHj vHnzpqAcftsNz0G3bt1k//790qtXL0/ragq7FTxOjVPw+ELOSiRAAiRAAiRAAiSQ5ATCLnjw LTls/fr1cubMGSlbtqwUL15cDh8+LF9++aX+WO3xxx+XJk2aSL58+YKOtGXMmFHq1Kkjbdq0 EZzRu3DhglZFm1evXpW///3vgaNLbkjnzJlTnn32WXnsscfko48+koYNG+qmvFChQnL69Gn5 7LPP5McffxSUq1evnkBorVy5MrBBh2fg4MGDKpaM6EFZHJkyVqNGDR0TxnbkyJHA6/Y2UQ4C yM+RNhzHwtgfeOAB5WwMrP7xj3/IokWL5OTJk/o+2ObNm1f5NWrUSJYtW6ZMTbyUKYfjXPB6 YP44FrZmzRoth7l+9dVXgtgWcIdQQ/zL9u3btVsI0QYNGuhRxKVLl+oaVa9eXfuCsIEHBeOA 4MLr8+fPlxUrVgTW0oy9RIkSAiboZ+HChW6WM6gMniX8IGbHCOf8+fMrK6uHx14R6//kk0+q 5wdzwBhpJEACJEACJEACJEACkUkg7IIH39TDZs+eLWnSpBEEkSOOAkeMvvjiC0dqscXw5M6d WyZPnqx1evbsGTju1qFDB914YxM/cuRITythbRPxG1OmTFHBAq8GvA9IImCOQV27dk37v379 uvYBAVSqVKkYwgyiBceojCEBAwTGhAkTAt4seIEgsp555hkdM9ocN26c7yNtEBMdO3aUQ4cO KWdjL7/8clBckPGcYMNv4licjtOZNiFYMMYPP/xQxwkvVP/+/VVAGO7wIk2cOFG7xfxnzpwZ tEYtW7bUtT937pwKnK+//tpxLT0tnovCTzzxRIz1yJYtm5QpUyZWwQNPGQTbI488ImvXrpXp 06e76IVFSIAESIAESIAESIAEwkUg7ILHZGnDkaa2bduq5wZCwu7ZsQIKl+AxIgpCxnhLME4j eG7duqUeIPy2Gjb8OJqXNWtWjf3o1KmTloPdc889moHNKnicjkslJIbHiBOIGBwBsxtEkEkP 7nRUrHv37nqUz1rOtAkROGDAAEE2OZTDb4hAxFb5ETxGlKI/tAfD3E3sTGJ/UJxieEyfEDtm 7SHKrOIxscfF9kmABEiABEiABEiABPwRiAjBc+eddwpEDMQOvv3HsbC4LNyCxz426yYZXhNr DIu1rJOQMRnAkkLwGHESF1u3sTF2wePUZkIET3yPM4QVBORvv/2mXqFQWVyCB5ny4NmzeqxC 1S/bIQESIAESIAESIAESSBwCYRc82IQPGTJEj2vhSBSOCeFoW7p06eT27duCY2J2ixbBkz59 ekFaacSm4CfSBA88S6lSpdIjeMYrFS2Cx+04vXxs8NwhBTjiyhAbBPFqNQoeLzRZlgRIgARI gARIgAQig0DYBQ82kfi2HsH4CGzHN/bIDobjbT/99JMMHz48agXPq6++KpUqVdJAfvxEmuAZ PXq0IEYJ8UFbtmxRzm6FRLg9PG7H6eVjhiQJEDnIUte3b98gTx0FjxeaLEsCJEACJEACJEAC kUEg7ILHZGk7fvx4wJuDwPFcuXLpJY+ID7EaLnmsWrWqBsfjKBMygpl7WPANPTJowWOEb+hv 3LihVZHxDGIKMRfYzLo1ZBeDNwlJFGBIw4zLKPfu3RujCQg2ZCR74403NNMaPFMweK0wPmRB Q0pnBOwj9ufPf/5zICPbnDlzApnRkPUN2dBQDnPs3LlzoNyMGTNUBOIYF+aBrGhuDTwfffRR zThnjYUBq/fff18zt+EYHoQmsq9BBMHrg3n269cvqBuUa968ua4Rst8hU9uwYcOCyoE7hBES MCCrHeyOO+6QokWLytChQ3V9sUZIVoAsdzjaiDgjjAdxO3EZMsThLibUR5Y1v4a+H3roIa2O Ns+fP69r7NQmBY9fyqxHAiRAAiRAAiRAAuEjEHbBgw1ubIb37BeLIrkBxI4xCAn7HTa4lBJH yayGlNdeA98hZJBUwGoI+neK0UG6ZWRksxuEHMSXMXubEBUQGBAlEGPmThyIHqSTNoYkBwia x9ztbbp5fCCUihQpElTUOh+Mw9xxhII45maSGVgr2stBdFjvGrKWhehBqme7YT7mfh3My9xv hHJO6+5mjn7KeOnblHV65vz0zTokQAIkQAIkQAIkQAKJTyDsgsdkaUv8qf6nB2z+X3jhhTi7 3LdvX6xpsZNyrOyLBEiABEiABEiABEiABEjAP4EUKXjMBaVxYcMFm7gQlEYCJEACJEACJEAC JEACJBC9BFKk4Ine5eLISYAESIAESIAESIAESIAEvBCg4PFCi2VJgARIgARIgARIgARIgASi igAFT1QtFwdLAiRAAiRAAiRAAiRAAiTghUBUCh5kEkMWM2TLwk9yNqRxRvpo/IYhk5tTlrjk zCAx54bU1khHbTV7qmukJ8dFuE6Ge6OQipxGAiRAAiRAAiRAAiQQmQSiUvDgbpyHH35Y79+Z N29eZJIN0agg7MaMGaN33kD04ILWcGS2C9F0IqoZpAjHRaP4EEC4wMDYfvHoqFGjNEU47iYy 5ZD2HPVRFndD0UiABEiABEiABEiABCKTAAVPZK5L0KhwESc8WxQ8oVuwgQMHSvny5WXq1Kmy ZMkSbbhcuXIyaNAgvQuoXbt2+poRPBMmTJDVq1fra/jg4NJcCp7QrQdbIgESIAESIAESIIHE IBCVggeXdKZPn143pSnleBcFT8zHv0qVKnqX0uHDh2XYsGG+PhtuBc+dd94padKkkYsXL8q1 a9coeHzRZiUSIAESIAESIAESCA+BsAueli1bxjrzvXv3Cjb6VsPxoXvuuUdfWr58uf7YbfDg wYK7dqy2Zs0aWbhwoSfKiN3o0aOH1unbt6+88sorgtec+samuE+fPkHto0/0bczapnlt2rRp smPHjqC61jYRx5M2bVrfHh54Ljp06BDUB/iCM6x+/fr6g79j3GbueA/H6o4dOxaj3A8//KBz sx7pGjp0qJw7dy7QT40aNaRp06ZB/VrLtWrVSh566CFta8+ePYFxXr16VVDOiAxrI7Vq1ZJu 3brJ/v37pVevXp7W1RR2K3icGqeHxxdyViIBEiABEiABEiCBJCcQdsGDY0Gwjz/+WL+tr1On jm5+v//+e5kzZ47s3LkzBpTSpUvrN/ulSpUKiuGB5wcxGZUqVZKZM2fqcSMY2ixcuLB8/fXX smDBAteQET/zyCOP6IZ+8+bNgr4hBO677z6BGMGfV65cqW23b99e3588ebLGesCaNWumnqhP P/1U1q1bp6+hTRyjMoZ658+fl1mzZgkEhDF7mxAr2bNn9yV4KleuLM8884zGnMyePTvQB1hB xMyYMUN2794tBQsWlAYNGghEyqFDh6REiRIyfvx4ZYq1+eijjwLlIGIefPBBOXHihIpAiDaU w3pNnz49sJaNGzeWCxcuyBdffKH9gsdrr70m27Ztk3fffVfXCPExTz31lPaHshgnjph17txZ tm/fLlOmTAmspRk8kg0UL15cvXxOYtHNImO9nn32WcFzg3nA8OcyZcrEONJmbwvr16ZNG10P zAFjpJEACZAACZAACZAACUQmgbALHggAGDbAECpNmjSRM2fOyPz584PEjkEYW9KC3Llzq+CA 9ezZUw4cOKB/hljAxnvjxo0ycuRITythbRMC7KuvvpK2bdtK7dq1ZfHixbrRN3EfN2/elA0b NgQC27ExRn1rcgVs1LHJNgYxkjVrVrHGh0AAYEMNT9YHH3ygbeJ9vzE8jRo1ko4dO6rnBZyN 4VgYPGHWuCDjOTl16pQKnLVr16qXzd63aRMZyiCivvvuO2WfOXNm6d+/v4oQw33VqlUyceJE 7RbrDTFqXyN4+uDp2bdvn4q/o0ePOq6lp8VzURiiJ1++fIGSEH1PP/10rIIHH5gnn3xShRvW ddOmTS56YRESIAESIAESIAESIIFwEQi74DEZx7DRhihBmmkICevG3A4nXILHiChAK1asmOza tUvHaQQP0hlj7BA+VsPmHz/YTEMoVK9eXcvBcIQM3qL4AuITEsNjxAm8KRAfdoP3CQID5nRU DPUhZKzlTJvwSg0YMECP22H98Bt9QDD5ETxGlEIYoT0Yji0mVfpxp6QFhhfW3bCAp9B47cL1 4WW/JEACJEACJEACJEAC8ROICMGDI1T4dv/kyZN6/OvHH3+Mc+ThFjz2wVk3yTjWFVsiBae4 D7cZwEIheIw4iQuu29gYu+BxajMhgie+RxcxTRUqVNAjcNYYqfjqxfd+XIKna9eu6tmzeqzi a4/vkwAJkAAJkAAJkAAJhJdA2AUPpo84lrNnz2rMDjblefPmlaJFi+pm1h7Dg/LRInhKliyp 3ht4T/ATaYIHggFHs+CpMh6UaBE8bsfp5eOF44Y1a9bUJAuI2UL8ktUoeLzQZFkSIAESIAES IAESiAwCYRc8JmkB7kIxMTdVq1aVhg0bqvjBcSmr4ShZp06dNLAc37TjaJE5jpUjRw7p3r27 vodgchOIjraQ5ADlrUH78S0BgucRV2SylVxR0rQAACAASURBVL3zzjuyfv36IA8OxvTSSy9p 8oKxY8cGsoq1bt1aMKZPPvlE729BvAi8HrhEFOVgONJ2//33a0IFHN3CUTCUwxxR15SDRwUx QUiUgHlAILo1xOrAg3br1i2NOTIGVhA6SAoAYYl4I4wHMSzHjx/XuBsnwYlyEAXgiixpYI2k B3Z7/PHH9Vga1sEkiwDTt956S0UWBAXew1E/JHiA9+Snn37S8ZhnIbY5PvDAA1oH9e2Z/Nxy QTn0Dc4wtImkDVhjpzYpeLyQZVkSIAESIAESIAESiAwCYRc8TqmSDRpsis2G37pJh3gxhs3p hx9+GIPm6NGjNTjeasimhkQIXgzHpuypppGe2WlznzNnTk2hbDf0ib6N2dtEHYgCeFsQ12Mu wIR3yJoWGuMw2ensbbqZE9rHcTu7WecDUWXiZlAOR/MQt2Q3ezkkmUDabidDhrwWLVoEvYX5 GNGGCz4hcuNadzdz9FPGS9+mrNMz56dv1iEBEiABEiABEiABEkh8AmEXPCZpQeJP9T89pEqV KuieHnv/8IaY9NJJOTb2RQIkQAIkQAIkQAIkQAIkEDoCKVLwIFYDno24zCmGI3TY2RIJkAAJ kAAJkAAJkAAJkEBSEEiRgueOO+7QOJq4DN4dJE2gkQAJkAAJkAAJkAAJkAAJRC+BFCl4one5 OHISIAESIAESIAESIAESIAEvBCh4vNBiWRIgARIgARIgARIgARIggagiQMETVcvFwZIACZAA CZAACZAACZAACXghEJWCp3Llyno5KdJWO6WI9gIg0sumSZNGkNo5bdq0OtRNmzbJyZMnI33Y UTM+pOtGqnCrIXZrzZo1gZdq1Kgh2bJlc5zT1atXY6Qdj5qJc6AkQAIkQAIkQAIkkEIIRKXg ef311+Xhhx+WuXPnyrx585L1UqVLl07v36lZs6am0h4xYoSEI5V3coSMi0abN28uEJVHjhzR KeISUgigjz76SNauXauvjRo1Su6++269FNVcZotMf/fdd5/88ssv0qVLl+SIh3MiARIgARIg ARIggWRBICoFT+vWraV06dKyatUqWb16dbJYiPgmMWnSJMmTJw8Fz79BQZgULFhQrl27Jnv3 7o0Pn+P7AwcOlPLly8vUqVMDF76WK1dOBg0aJJcvXxZcNAqDoMmXL58sWLBAtm3bpq/hg9O7 d28KHl/kWYkESIAESIAESIAEko5A2AUPviGPzbCZNd+omzLYeGbIkEH/+uuvv+qP3YoUKSJI PW01HFM6e/asJ7LwrhQoUEDrHDp0SDe9eM2pb3gJ7EejUA59WtNbW9s0gwGDK1euBI3N2maf Pn0kZ86cvgVPpkyZVDDZDXzBGQYRgR/8HeM2c8d7x44dkxs3bsQohzFjbuBiDJ6S3377LfB3 HAXDuO1mLQdvSZYsWbQt9G3Gefv2bfW84LfdatWqJd26dZP9+/dLr169PK2rKexW8Dg1TsHj CzkrkQAJkAAJkAAJkECSEwi74MG35DDEQmBjC0GAeJWbN2/K9u3bZfjw4TGgvPnmm4KjSBAD 9iNtqVKl0mNfkydPVsFjNspoc+XKlTJjxgzB/TpuDcJp6NChArHw0ksvyVtvvaWbcfS9aNEi mT9/vooA9FW4cGEZPXp0DOGSPn16mTNnjixevFjnA0ObQ4YMCQwB4m3ChAmyfv36GELB3ibm hdf8HGnDeKtWraoCwYgbDABt/vWvf1Wvxa1bt6RZs2bSokUL2bdvn8yaNUsGDx6s80G5/v37 a8yUtdwPP/wgy5YtkzfeeEPXD5x69uwphw8fDqxlo0aNpFWrVgGxhH4zZ84sPXr0CJTr3Lmz xinBY4djYxgn1un333/XchBfdtFTvXp1efHFF+XgwYPSr18/t0sa9CwhhgfPEeYBK1OmjK6z 1cNjb9zKE3PFnGkkQAIkQAIkQAIkQAKRSSBiBA821Dt27JAOHTpI48aNdfM7ceJER2qxxfDk zp1bxQ4Mm9ADBw7on02bGzdulJEjR3paCWubqIhx1q5dW38gZKZNmybWY1Avv/xyQPS4iTUy 8SEQPdbjefY2Iab8HmmD6OjYsaNAoAwYMCAwf6djcsZzgkJm0+9UzrSJcvBQgTfYQ8zEtZYQ RTNnzgxao5YtW6owgmGcWHuntfS0eC4Kd+3aVdfSbnEJnlB4l1wMjUVIgARIgARIgARIgARC QCDsggdHkmA4mobYnHr16qm3A5viixcvOk4xXIIH3p7vv/9evT1OggdeiDNnzqhnApY9e3aB l8fqicKxNxxPM3bnnXeqR8sqeOB1gJcD7cHbgDbfeeedBAseeKOsRwBz5colqVOnjuE1Mpt5 eC7giTp9+rTEJXjg9Xn77bfVcxQKwQNvE1iASVIInqxZswaOSGJNSpUqpV6l2AQPhB4SHcAL BlF27ty5EHwM2QQJkAAJkAAJkAAJkEBiEQi74DEZxxAYjsxrK1as0ADyuOJtwiV4jNfIGnOC cRpvDI51QRTht9VMrBHKQSzhiBjKwbC5RvC9VfA4xYckJGmB8cbs2bNHxYvdrDFETt4LiDQc 47KWs3uNcNwO5fDbxAU5eevi8/AYL5w1fskaP5RYHwTTrlPSAvMePFAQ5OCIRAdxxZ8l9jjZ PgmQAAmQAAmQAAmQgDsCESF42rdvr2mXcfcJxE5898yEW/DY0cZ2pM1ezknIOB1pSyzBYz/S 5vSIuD2uFdsxOWubCRE88T2+yK72xBNPqOiYPn16fMVdvx+X4DHH3+I6bum6IxYkARIgARIg ARIgARJIEgJhFzwYAC4S/eqrr9S7A+8AjnThssejR49qKmC7RYvgwYa8ePHiem8OfiJN8CDt MrKoQWSao4XRInjcjtPLpwipznFczX4Pj2mDgscLTZYlARIgARIgARIggcggEHbBY7K04Vtz c0QIcRQVK1YMCrIHMmx0kU0Mm1J4LLBZN8ficFwKCQ/wPtoz8SpoC4YkA+vWrXNNHima0Rba hCGTFwTYqVOnYrSBxAYoU79+/RgZ2apVq6ZlUQcJGXB0DZ4RZBjDWIyhHMQd5mLKoV8sjrUc 4oYQM4PXdu/e7XoeJUuW1PGBK7gYw2tgh/Ghf3g3MD4cLURsCsbjJDhRDuMDV6wZxoOydkM2 PfQBjmaNEJvz9NNPax20jTXCPNEvvDZIQ43X47tfqVixYloP9ZcvX+6ahb0g2kBbMPzGBaPo 36lNCh7fmFmRBEiABEiABEiABMJGIOyCB5vn2Oz48ePy5Zdfxnj78ccfl/z58wdew8Z/7dq1 Mcq0adMmcF+OeQNCwmy63dLG/TFNmzaNUXzp0qVBdwOhAO6RQUpnuyEm5ccffwy8bG9z4cKF mma7aNGisnXr1sDFlrjbpmHDhoF6SIENoYS529t0Mx+kw37ssceCilrng3EYcYiCSHKA9NR2 s5e7dOmSpuh2srJly6qAshvKox4M84IoM+a07m7m6KeMl75NWadnzk/frEMCJEACJEACJEAC JJD4BMIueLyKkFAgwb082LTHZfBwePGihGJcbIMESIAESIAESIAESIAESCC0BFKk4MERq+7d u8dJcufOnTJ79uzQ0mZrJEACJEACJEACJEACJEACSUogRQqeJCXMzkiABEiABEiABEiABEiA BMJGgIInbOjZMQmQAAmQAAmQAAmQAAmQQGIToOBJbMJsnwRIgARIgARIgARIgARIIGwEKHjC hp4dkwAJkAAJkAAJkAAJkAAJJDaBqBQ8rVu3FlwSiTtl4ruvJbEBJnb7GTJk0AQL+A1DIgUk VKCFhgDuE7Jn7MPlt5MmTQp00KVLF0GacCfDPUBjx44NzWDYCgmQAAmQAAmQAAmQQMgJRKXg ef311/Vul7lz58q8efNCDiWSGkydOrVUqFBBcOll9uzZZcSIEZ7vE4qk+UTSWCCca9asKd99 951s2rRJh1a4cGG9e2nz5s0yfvx4fW3UqFF6ISkuV8VltzDcG4QLVHHxKgQRjQRIgARIgARI gARIIDIJRKXgqVy5suTNm1d27dqVYu7KgcchT548FDz//hyVKFFCatSoIWfPnhVc3urHBg4c KOXLl5epU6eqmIHhItxBgwbJ5cuXpV27dvoa+smWLZts375djhw5oq/hg9O7d28KHj/gWYcE SIAESIAESIAEkpBA2AVPsWLFYp0uvj23H1mrVauWbvxhO3bs0B+74ZhS2rRpY7wMcbRt2zZP aHFfT/369bXOggULpHbt2oLXnPrOlCmTNG7cOKj9rVu3xhBl1jZN4XXr1snRo0eD6lrbRNuZ M2f2LXgKFiwo1apVC+oDxwJPnTqlr2Ozjx9wByszd7y3fPlywfEtazmMGVzBxdjixYvlypUr gb/DE1KxYsWgfq3l8BDiOUBbGIsZ582bNwXl8NtueA66desm+/fvl169enlaV1PYreBxapyC xxdyViIBEiABEiABEiCBJCcQdsGDb8lhEAbYUOObexwrOn78uKxYsUKFhtUgZho0aCC5c+cO OtKGOJcqVarIiy++qMeULl26pFXR5pkzZ7QtcyTJDem77rpL2rdvL1WrVpX33ntP0De+4Uc8 x6FDh+Szzz6TPXv2qAh69NFH5bnnnpMNGzbIb7/9ps3De4B4m88//1wOHDigr6HNZ599NtA9 vFXffPONfPHFF4LYEWP2NlEuY8aMvgRPoUKFVLw88sgjMUQfWC1dulSWLVsmp0+fVq/Fk08+ KVmzZpW1a9fKM888o79RDl4UiCNTDse5cNwOwqhhw4Z6JAzlPv74Y52PWUsINfA3cUdp0qRR j8mMGTNk5cqVukaPPfaYtnH+/HkVfhgnyj/44INaDoLQrKXhgxiuunXrqkDC0UY/hvVE31hD I4YhDDE3q4fH3jbW/4knntA1xxw+/PBDP92zDgmQAAmQAAmQAAmQQBIQCLvgwTf1MATjYzPc qlUrFTw4YgQR4GSxxfBABE2ePFmr9OzZMyAyOnTooN6XjRs3ysiRIz1htbYJsTRlyhSN8YBX A96HadOmBY5BXbt2Tfu/fv269oENdalSpWIIM3htIISMQVDheN6ECRMC3iyIHWzEITgwZrQ5 btw430faGjVqJB07dlSRBs7GXn755aC4IOM5wYbfxLE4HaczbV64cEHHiE0/xgkvVP/+/dXz ZrhDKE2cOFG7xfxnzpwZtEYtW7bUtT937pwK3a+//tpxLT0tnovCEC7W9cDRtTJlysQqeCCI ILghyiAGp0+f7qIXFiEBEiABEiABEiABEggXgbALnn/+8586d3xrjs1/8eLFVezEFZcRLsFj RBQ25g899JCsWbNGx2niPm7duqUeoNu3b8dYTxwHww82+8gI9uc//zkQC1KgQAFJnz59DMHj dFwqITE8RpxcvXo1hhfJDBKizRwNdDoq9tZbb0nOnDlV3Jlypk2IwAEDBmgWuT59+qgXCmPd u3evL8FjROmdd96p7cHGjBkjx44dS5LPiFMMj+kY3jl4fyB2cNSSYidJloSdkAAJkAAJkAAJ kECCCESE4MFmuW/fvip2sImEOIjLwi147GOzbpLhNbHGsFjLOgkZkwHM6uFJLMFjxElcbN3G xtgFj1Obfjw8br1w8AamS5dOxSU8a6GyuAQPMuXBs2f1WIWqX7ZDAiRAAiRAAiRAAiSQOAQi QvA4bfopeGJmAAuFhyc5CR63wszrx4aCxysxlicBEiABEiABEiCByCYQdsEDLwCOL8HDgZgR fFtfp04dadGihWbtcrrUMVo8PPD24A4dxPrgmF6keXiGDBkiuXLl0lgZpFyGuRUS4fbwuB2n l48fki506tRJEySADRI0WI0eHi80WZYESIAESIAESIAEIoNA2AWPydKGrGzmaBICx7ERd/JI 4JJHZE1DcDwC3L/66qtAli4cc0JGMmxWcT/LjRs3lDLiT7ChR8A+Ui67NcTXQFwhiQIMGcRw GSXiU6yGI3lly5aVN954I0YMD9JnY3yLFi3SrGVOMTxz5syRJk2aaOICZH0zsT6YY+fOnQOx PshW1rZtW82ghnkgfsitgScyiiE7nDUTHFi9//77sn79ej2Gh0xuiFFBogYkXsA8+/XrF9QN yjVv3lzXCHFBP/74owwbNiyoHLhDGCEBgxEPd9xxhxQtWlSGDh2q64s1QkxUvXr1VPgiWQLG A49WXJYlSxbNeIf6CYnvMfFY6AttIlMc1tipTQoet08cy5EACZAACZAACZBA5BAIu+CJCwUy gJl0xqYc0hFjA28MaYlxF4vVkM4Y4sdq2OgjS5kXs2dUQ92ffvpJLl68GNQM4kmQkMBuBw8e lJMnTwZetreJTT8yf2GzD0Fl7uOBsEG2MGNIm4wYJ8zd3qabOSHzGzLG2c06H4wDP8aQXnvL li1BdezlII6Mh8heGEIOAsdumI8RpHfffbeKLGNO6+5mjn7KeOnblHV65vz0zTokQAIkQAIk QAIkQAKJTyDsgsdkaUv8qf6nB4iJF154Ic4u9+3bF2ta7KQcK/siARIgARIgARIgARIgARLw TyBFCh54WXAvT1wGTwsuvKSRAAmQAAmQAAmQAAmQAAlEL4EUKXiid7k4chIgARIgARIgARIg ARIgAS8EKHi80GJZEiABEiABEiABEiABEiCBqCJAwRNVy8XBkgAJkAAJkAAJkAAJkAAJeCEQ lYIHmcrSp0+vKYyRTjk5W6pUqTT9M37DkDbZZDdLzvNOqrkhgQXSilsN2emQ8twYMujZs/6Z 927duqUp0GkkQAIkQAIkQAIkQAKRSSAqBU9sF49GJuKEjQoJFsaMGaOiB3fYjBgxQsKR2S5h s4jM2hA6uBwWHwKIHBgY466mvn37BsT0qFGjBCmpkX7blEudOrUKJZTF3VA0EiABEiABEiAB EiCByCRAwROZ6xJjVEb04K4aCp7QLdibb74pFSpU0Itrly1bpg3j7iNchguvDcQQzAie9957 L3Dha6VKleS1116j4AndcrAlEiABEiABEiABEkgUAlEpeFLSkTaz6pMmTZI8efJQ8PwbSJUq VfQupcOHD8uwYcN8fTgGDhwo5cuXl6lTp8qSJUu0jXLlysmgQYP0uGS7du30NXOkDRfOXrt2 TV/DBwfCiB4eX+hZiQRIgARIgARIgASSjEDYBU+jRo1ineyBAwdk2rRpMd7v0KGDFCtWTF9b tWqVrF69Oqg+vrm3x2WsX79evvzyS09g8+XLFziuNHz4cEHfeM2p7xw5ckj37t2D2l+6dKls 2LAh8Lq1TfPi7NmzZefOnUF1rW2WKlVK0qVL51vwlC5dWlq3bh3UB/iCM6xWrVpSu3Zt/TvG bT2qBcF14sSJGOUwZnAFF2Njx46VX3/9NfB3CJOGDRsG9Wst16xZM3nggQe0LfRtxglxgXJG ZFgbwVi7desm+/fvl169enlaV1PYreBxapyCxxdyViIBEiABEiABEiCBJCcQdsGDb8lhH3/8 sX5bX6dOHXnooYfk+++/lzlz5gQJAWzc8c0+BACOIs2bNy8ADZ4fHEPCcaOZM2fqt+8wtFm4 cGH5+uuvZcGCBa4h4yjZI488ohv/zZs3C/peuHCh3HffffqtP/68cuVKbbt9+/b6/uTJkzXW A4aNPJIrfPrpp4FLTNEmvArGUA+JCGbNmiU//PBD4HV7mxAV2bNn9yV4KleuLM8884yKQIgr Y2B17NgxmTFjhuzevVsKFiwoDRo0kBo1asihQ4ekRIkSMn78eGWKtfnoo48C5Zo2bSoPPvig iqACBQqoMEU5iKDp06cH1hIXvF64cEG++OIL7RY8cBRs27Zt8u677+oaIT7mqaee0v5QFuOE x6Vz586yfft2mTJlSmAtzdjvuusuKV68uHpiduzY4XpNrQWxXs8++6zguTFiDn/GsTarh8fe ONavTZs2uh6YA8ZIIwESIAESIAESIAESiEwCYRc8iEuB4dv9smXLCjbSV69eVZEQ20YytqQF aAuCA9azZ8+A5wJiARvvjRs3ysiRIz2thLXNzz//XDfizz33nHpCFi9erBt9cwzq5s2bKoDw GwahAY+OVZjlzJlT52gM4gIb5wkTJgS8VUWKFJGWLVuqMIIQRJt43++RNnjROnbsKGfOnFHO xiAEIcCscUHGc4Kyn3zyiSxfvlycjtOZNo8fPy6fffaZerHAPnPmzNK/f38VIYY7PHETJ07U btEfxKh9jTDfVq1aycGDB1XE7t2713EtPS2ei8KI4SlUqFCgZP78+dUjFZvggSeqSZMmKngh ntesWeOiFxYhARIgARIgARIgARIIF4GwCx6TcQwbbYgSHIeCkIAHIDYLl+AxIgrQcKxu165d Ok4jeJAuGmM3gseMH5t//MCDAqFQvXp1LQerX7++bp6tgsfpuFRCYniMOIE3BeLDbuvWrZOj R4/qy05HxVAfQsZazrQJr9SAAQMkbdq0un74jT5OnTrlS/AYUQphhPZgEF3WY3KJ+WFxiuEx /WFdDAuIHfCgkQAJkAAJkAAJkAAJRDaBiBA88IQ8//zzgqDw+fPnx3tEKNyCx76k1k0yjnXF djeQk5AxGcCSQvAYcRLXI+k2NsYueJza9OPhceuFg+cMR9IuXbokmzZtCtmnLC7B07VrV/Xs WT1WIeuYDZEACZAACZAACZAACSQKgbALHswKcSxIA4yYHWzK8+bNK0WLFtV4Dqdg/mgRPCVL llTvDbwn+Ik0wYPjXIipgafKeFCiRfC4HaeXTw3igmrWrKlHDhGzhfglq1HweKHJsiRAAiRA AiRAAiQQGQTCLnhM0oJ33nlH4zZgiGtBELuTR8JkOUN8C+5OQfzI6dOntR7ERZ8+fQQxMOPG jdOAfBg2sNjcf/PNNxpQ79aQFQ39oE3Y6NGjZcuWLUFZw+655x7NGIYN89ChQzUGCQYPB2JC TCwMvAcvvfSSZMyYUcvBEDSP2KVFixbJV199pcID5ZAoAWLElEOiBggoiELMA2LQrYEnMp/B g4ajccYwLyRYwGs4coescPXq1dMxQaDB+4TkBXZDOcSxYI327Nmjx/GOHDkSVA7c4Qnat2+f jhuGuQ8ZMkSTGiCeCmsEbk8//bQmTMCaWzPCxTZHeAUxTtTHxax+DX1nyZJFqyNZBsaMNXZq k4LHL2XWIwESIAESIAESIIHwEQi74LGmNLZjgOcBaYmthtTPyNBmDEH4H374YYwyECaIAbEa Av9xXM6LIZjdiB1TDxthZDSzG5IRGHFifQ99om9j9jZRB7EqEGSI6zH3wUDc9OjRI1AP4zDZ 6extupkT2jcXaVrLW+cDcWLiZlAGR/MQt2Q3ezkkOOjbt6/jMJAYoUWLFkHvYT7w6sFw303V qlUDZZzW3c0c/ZTx0rcp6/TM+embdUiABEiABEiABEiABBKfQNgFj0lakPhTZQ8kQAIkQAIk QAIkQAIkQAIpjUCKFDw4xhTfMSinGI6U9nBwviRAAiRAAiRAAiRAAiQQ7QRSpOBJkyZNjLtX nBYRx7nMxaXRvsgcPwmQAAmQAAmQAAmQAAmkVAIpUvCk1MXmvEmABEiABEiABEiABEggpRGg 4ElpK875kgAJkAAJkAAJkAAJkEAKIkDBk4IWm1MlARIgARIgARIgARIggZRGICoFD+5gweWk SF/slCI6OS0i4o2Q2jlt2rQ6rU2bNsnJkyeT0xTDOhek60aqcKvhjqM1a9YEXsI9RtmyZXMc J+5csqYdD+tk2DkJkAAJkAAJkAAJkEAQgagUPK+//ro8/PDDMnfuXJk3b16yXlZcPor7czBf /HnEiBHCVN6hWfLSpUvr5aUQMydOnNBG8WfcqTRlyhS9gBSGC1jvvvtuvUD11KlT+houucV9 UEhsgUtiaSRAAiRAAiRAAiRAApFJICoFT+vWrQWb1VWrVsnq1asjk2yIRzVp0iTJkycPBc+/ uebIkUMKFiwo165dk7179/qiPXDgQClfvrxMnTo1cOFruXLlZNCgQXL58mW9EBUGQZMvXz5Z sGCBbNu2TV/DB6d3794UPL7IsxIJkAAJkAAJkAAJJB2BsAue/fv3xzrbmzdvyq+//hrjfWx0 zfEubEqRPtpuuGcnVapUMV7G0aNLly55IovjZPgmH3b69GlB33gNZu/7jjvukFy5cgW1jz7R tzFrm+a18+fPy40bN4LqWtscOnSotu/Xw5MuXTrJnj17UB/gC86wTJkySebMmfXvGLeZO947 d+6c/PbbbzHKXb9+XecGLsbOnDkjt2/fDvw9Y8aMkiVLlqB+reWyZs0qGTJk0LbAwYzz999/ F5TDb7vVqlVLunXrJnh+evXq5WldTWG3gsepcQoeX8hZiQRIgARIgARIgASSnEDYBQ++JYdh s4uNMjbmEDTYdG/fvl2GDx8eA8qbb74pDzzwgAoP+5E2iBxssCdPniwQC2bjjTYRZzFjxgzB Jt2tFSlSRCA0IAReeukleeutt9TLgr4XLVok8+fP1w06+ipcuLCMHj06hgDDEbQ5c+bI4sWL A6ICbQ4ZMiQwBGz0J0yYIOvXrw8ICrxpbxPzwmt+BA/GW7VqVRUI8IgYQ5t//etf1Wtx69Yt adasmbRo0UKPbs2aNUsGDx6s80G5/v37a8yUtdwPP/wgy5YtkzfeeEPXD5x69uwphw8fDqxl o0aNpFWrVjEEHURVjx49AuU6d+6scUrw2P300086TqwThA7KnT17NoaIwvirV68uL774ohw8 eFD69evndkmDniXE8OA5wjxgZcqU0XW2enjsjVt5Yq6YM40ESIAESIAESIAESCAyCUSM4Bk2 bJhudtu2bSsNGjTQoHEIF+sGHQghELAJrlSpUpDggWdnzJgxuvHGJhibYRjaxIYaomL8+PGu V8KIDrSJDTD6huBAEDtiaiBkIAxwvK5Pnz6BDbrxOr322mt6ZArCCMehjJBBO8YgfpCAAUfW 1q5dG3jd3ibK5c6d25fgqV+/vrzwUFzXfgAAIABJREFUwgvqDQFnY5gXvC/4jXgVCE1w+tOf /qQCBYIR8UNO5Ro3bqzxL8Yb1LdvXy0H0QmRuHPnTmnTpo1A8CDm6L333tNusTbvvvuuCikw O3TokIpcCK0mTZqooMI433///YCARNsoZzWIDtTDGO3PiNsFxjpgfvgQGO8V1hwCLy7BA7GF Y25IHoE5WD14bvtmORIgARIgARIgARIggaQhEHbBY4604WgVYnPq1aunwmTmzJly8eJFRwqx JS2AIIBIguFb9wMHDuifO3ToINigb9y4UUaOHOmJrLVNbOS///579fbUrl1bBc+0adPExH1g 8209goWjWfDyWD1RyAiGTbIxHBuD0ICXx8QjwesALwfag7cBbb7zzju+Y3ggOjp27KgixnpE EEfkUqdOHUNEmaNi8FxAZOEon1P8kGkTXp+3335bRQfYw3sDb9COHTsC3OG5mThxYkDwYG3t a9SyZUv1BMHbBBZg4rSWnhbPRWFznM4URSICCOrYBA/m3bx5c/WCYU446kcjARIgARIgARIg ARKIXAJhFzwm4xhESbVq1WTDhg0qJEzWLCd04RI8RkQhWB5xKxAiGKcRPPimf+zYsUEeB2Ty QnYveG0wTwgNlIPBU5A/f/4YgscpPiQhSQuMOIG4hECzG7wnRlw6xcaULFlSvSnWcqZNHGsb MGCAHreDWICAQj/w4Bih6UXwGFEKwYP2YEhK4NeL4/Wj55S0wLSBI3/wlh09elSPR0IU0kiA BEiABEiABEiABCKbQEQInvbt20vNmjX1GNuSJUvivWcm3ILHvqTWTTKOSDklUkAdJyFjUh5b PTyJJXiMOInrkXSbDMAueJzaTIjgie9jg6OCTzzxhGZJmz59enzFXb8fl+Dp2rWrevasAs51 wyxIAiRAAiRAAiRAAiQQFgJhFzzYYCIm5ttvv5Uvv/xSjhw5ImXLltUYmePHj+trdosWwYN4 mKJFi8rWrVv1qFakCR7EzSCGZ8WKFYEYmWgRPG7H6eVTVaJECXnqqafUs/TJJ5/I8uXLY1Sn 4PFCk2VJgARIgARIgARIIDIIhF3wmCxt+NYc39bDsOGsWLGiOHkksNHF0SLEwuB9eITMsTgE xCNWB++jPROvgrZgOCq3bt061+RxbA1toU0YMnkh+YC5fNI0hDgflMFxJ2tGNhzRQ1nUQUwL jsLBM4Kgd5QzhnI4JoW5mHLoF4tjLQfvAmJm8Nru3btdzwNH0jA+cAUXY3gN7DA+9A/xifFB bCI2BeMxyRasnaEcxgeuWDOMB2Xthmx66AMczRrhqNrTTz+tddA21gjzRL/w2kDw4vX47lcq VqyY1kN9uzBxDeaPgmgDbcHwGxeMon+nNil4vJBlWRIgARIgARIgARKIDAJhFzxmAE44sAm3 b7ix0YZwMIbMbvBQWA1pjpEswGrwsFizoLnBj6xvyERmNSMO7PUR/I5MaHbDMT2k1zZmbxNp q8GgePHiKgqMMMAcMVdjiBmpW7euzt3eppu5YCMPUWE363wwDut6IDU0sqXZzV7uwoUL8uGH HzoOAwkY4MGzG+Zj4oYee+wxTQdtzGnd3czRTxkvfZuyTs+cn75ZhwRIgARIgARIgARIIPEJ hF3wmA1+4k/1Pz0gAB/eh7gMHg4vXpSkHD/7IgESIAESIAESIAESIAEScEcgRQoepIK2poZ2 QoXjcqEMhne3HCxFAiRAAiRAAiRAAiRAAiQQSgIJEjybNm363e9gXnnlFa0aDg+P3zGzHgmQ AAmQAAmQAAmQAAmQQHQRMIIH91p6tVQUPF6RsTwJkAAJkAAJkAAJkAAJkEBSEkiQ4Pn9D/M7 WGQCo4fHLz3WIwESIAESIAESIAESIAEScEMgQUfaKHjcIGYZEiABEiABEiABEiABEiCBcBGI SsHTunVrKV26tN4pE999LeECG6p+M2TIIN27dxf8hs2ePVt27twZquZTfDtI/W3P2HfixAmZ NGlSgE2XLl0kX758jqxwD9DYsWNTPEcCIAESIAESIAESIIFIJRCVguf111/XyzHnzp0r8+bN i1S2IRlXmjRppEqVKvKnP/1JsmXLJiNGjGCih5CQFb3nCHfr7NmzR3BPEwz3HNWrV08vqDV3 EI0aNUovJP36668Fd/DAcG8S7jXCxasQRDQSIAESIAESIAESIIHIJBCVgqdy5cqSN29e2bVr V4q5Kwcehzx58lDw/PtzVKJECb3Q9OzZs7Jw4UJfn66BAwdK+fLlZerUqbJkyRJto1y5cjJo 0CC5fPmytGvXTl9DPxCbuED2yJEj+ho+OL1796bg8UWelUiABEiABEiABEgg6QiEXfDkzp07 1tmeOXNGNmzYEON9eDty5cqlr8UmeOrXry9p06aNUW///v3y448/eiKLTS42u7Bly5ZJ1apV dePr1HfGjBmlTp06Qe2jT/RtzNqmee2PbHdy8uTJoLrWNlu0aCFZs2b1LXggECEU7bZ+/XoV DbCSJUtKqVKlBNwxbjN3vLdmzRq5cOFCjHIY8759+5SLsZUrV8rVq1cDf4dnpGzZskH9WstV qFBBChUqpJzQtxnnzZs3BeV+++23oPq1atWSbt26aZ1evXp5WldT2K3gcWqcgscXclYiARIg ARIgARIggSQnEHbBg2/JYTgqhA110aJFNV7i1KlT8o9//ENjVqyG+B0cQ8LlofYjbenSpdN4 jFdffVWPKeFbehjaPHz4sHz66aeePELwqLz00kva5rhx4wR9Qxzcdddd8vPPP2t7hw4dUiGC I3adO3dWL4DZoEM8bNmyRT0QR48e1bGgzfbt2wemBA8DxBR+Tp8+HXjd3ibKpU+f3pfggdip W7eu/pgjWegI88IcVqxYIYhFqVatmjz11FOCY3R47fnnn5fNmzdruY8//ljWrl0bKPfMM8/I 9evXBWINf8ZFrRAuOAa2ceNGuXjxohQpUkQaN24s999/vwojGNquVKmSxsh8++23cuXKFXni iSekQYMGcvz4cV0njBPlEac1efJkHQPKWQ08UA9HyvxeEIv1rFmzpnz33Xc6D1jhwoXlueee i+HhsX8qsf4YL34wB4yRRgIkQAIkQAIkQAIkEJkEwi54EAcBmzZtmuAbfWxCIRSWLl0qCxYs cKQWWwwPvEVm89mzZ085cOCA1u/QoYNuvLERHzlypKeVsLYJEYWNOtqqXbu2LF68WMdtjkHB s4EA9mvXrmkfmEuZMmViCDMkH7jnnnsCY0D8R/78+WXChAmBBAwQO48++qi0bdtWN+NoEz9+ j7SBcceOHdUbgvEaQzIECEdrXJDxnGAuO3bskOHDh+uc7X2bNiEqt27dKu+++66yz5w5s/Tv 31/rGu5ILjFx4kTtNlOmTDJz5kz9s3WNWrZsKa1atVLR+8033yhbp7X0tHguCtuTFmD88EpZ j7RZm8HzAA8iRBkuzbUmN3DRHYuQAAmQAAmQAAmQAAkkMYGwCx5sGmE5cuSQTp06aUwF4inm z58fK4pwCR6zQUdsB45x4bgVxmkEz+3bt/VIlv16ImzeMSd4oDC/N954Q8vBIDhw/M4qeJyO SyUkhseIkxs3bqiHxm4QFvBMwZyOig0ZMkSPEVrLmTbh2RkwYIDg+B3KQdCMGTNGPWl+BI8R pTlz5pShQ4fqmPDbxM4k9ufDKYbH9Akh2rx5c/UwwttFz05irwbbJwESIAESIAESIIGEE4gI wQOvR9++fTXzFY4nLV++PM6ZhVvw2Adn3SS//PLLQcevTHknIWMygCWF4DHiJC64bmNj7ILH qc2ECJ74Hm0cjYOAhMg0HrX46rh5Py7B07VrV/XsWT1WbtpkGRIgARIgARIgARIggfARiAjB M3jwYLn33nvlgw8+0NgRpyB1KyIKnn95xdyaG3Fi2ooWwVO9enV58cUX5eDBg9KvXz+3KOIt R8ETLyIWIAESIAESIAESIIGoIhB2wQMvAI51wcOB4HR8W49sZ8hKhixsTpc6RovggbcHgfzm SFukeXicjqpFi+BxO04vn0ZkAMSxykuXLunxPGsSCbRDD48XmixLAiRAAiRAAiRAApFBIOyC x2RpQ0C9yaqGeBEE8jsdwYJAQkA/0jsjQxeOv5nkBoiFQcKDN998U7OimaNOaAviCVndkAXM rSFbHDK+oU2YSVpgkiGYdhC3UrFiRS2Lfm7duqVvIUsZLrBEljZknUMMCIBjU41yMIy/YcOG +h7msXr1av2zSVpgyiEGCIH9qVOn1nnY03XHNSfEw+AoVtOmTWOkyMa8PvroI00SgKxqEBEI 4keKaGvSAnvbKIdYFnA1SQuchCn4IcEDhITJUofxI5ED4nyMwEWfSASAxAgmaYE1uYLT3BDz hUtCscZ79+51u6RB5axJC9AmEmcgXsqpTQoe35hZkQRIgARIgARIgATCRiDsgieumWPzu3Pn zhhFkKrY3IWDNyAkrPfc4LUHH3xQ0x9b7cSJE5pC2otByCDJgNWQ1hniwG4mJbb9dRy5st6x Y28Tog4bd3i5IAqMMIDogTAwtm3bNo1xwtztbbqZEzbzRrjFNh+MAz/GcLQQabXtZi+H9NQm 6YG9LFJiIy243TAfJFGAISua9T4mp3V3M0c/Zbz0bco6PXN++mYdEiABEiABEiABEiCBxCcQ dsFjsrQl/lT/00OWLFn0yFxcBlGBLGw0EiABEiABEiABEiABEiCB6CWQIgUPvCw4ahWXwdOC 42g0EiABEiABEiABEiABEiCB6CWQIgVP9C4XR04CJEACJEACJEACJEACJOCFAAWPF1osSwIk QAIkQAIkQAIkQAIkEFUEKHiiark4WBIgARIgARIgARIgARIgAS8EolLwIFNZ+vTpNSXylStX vMw36sqmSpVKkKYbv2Hnz58PZDeLuslE4ICRDS9DhgwxRobsdOfOnQu8hgx69qx/5k2kID97 9mwEzoxDIgESIAESIAESIAESAIGoFDyxXTyaHJcUCRYmT54smTNn1umNGDFCwpHZLjmyxZzM 3TrW+SHNea9evQIvjRo1SlNnOxnugurSpUtyxcN5kQAJkAAJkAAJkEDUE6DgiYIlhOjBRZ24 q4aCJ3QLhgtqK1SooBe5Llu2TBvG3Ue4DBdem5dffllfM4LnvffekzVr1uhrlSpVktdee00v v6XgCd2asCUSIAESIAESIAESCDWBqBQ8efLkEYiAX3/9VX9Sgk2aNEkwbwqef6125cqV5dln n5Vjx46pGPRjAwcO1Itlp06dKkuWLNEmypUrJ4MGDdLjku3atdPXChQoILhY9vTp03Lp0iV9 DR8cCCMKHj/kWYcESIAESIAESIAEko5A2AVPo0aNYp3tgQMHZNq0aTHe79ChgxQrVkxfW7Vq laxevTqoPr65t8dlrF+/Xr788ktPZPPlyxf49n748OGCvvGaU985cuSQ7t27B7W/dOlS2bBh Q+B1a5vmxdmzZ8vOnTuD6lrbLFWqlG66/Qqe0qVLS+vWrYP6AF9whtWqVUtq166tf8e4rZ4L CK4TJ07EKIcxgyu4GBs7dmwMEVqlShVp2LBhUL/Wcs2aNZMHHnhA20LfZpzXrl0TlMNvu2Gs 3bp1E/vxMy8L7FbwOLVJweOFNMuSAAmQAAmQAAmQQPgIhF3w4Fty2GeffSa47LNGjRq6+f3p p5/kk08+kW3btsWgg/fatGkjxYsX16NI8+bNC7yPAPQXXnhBqlevLp9++qmcOnVK30ObCPxf vny5fPHFF65pZ8mSRerUqaNt4igT+v7qq6/02BME1eeffy5r166VggUL6ib9wQcflBkzZsj1 69e1D4g5BLVjbibuBm3CO2EMXgoIiTlz5sQQPfY2UQ7JGvwIHhzbgqhA8P2CBQsCfWNee/fu lVmzZqlwgJCEOMFxrT179sj9998vOMaFcj///LPyNuWeeuopgYg6cuSI3HPPPTp+lNuyZYtA wGEtsQ644BVJAL7++mvtF8kmXnzxRRU306dPV68J2nnyySfVkwKPHca5YsUKee6551QsfvTR R1rOahCOqAePy6ZNm1yvqbUg1rN58+aakADzgEFkVqxYMYaHx944+sV6YAyYg1XQ+hoIK5EA CZAACZAACZAACSQagbALHsSlwLABLlu2rDRt2lSuXr2qgmX79u2OE48taQHaQoA/rGfPngHP BTwQ2Hhv3LhRRo4c6QmmtU0IHBx9wkYcnpDFixerB8ocg7p586asXLlS8BsGYYNNsVWY5cyZ U+doDGIse/bsMmHChIC3qkiRItKyZUs9bvXxxx9rm3jf75E2CK+OHTvKmTNnlLMxiDkcDbSK KOM5QVkITohEp+N0ps3jx4+roMOm3yRX6N+/v+zYsUM9P+AOT9zEiRO1W/Q3c+bMoDXCfFu1 aiUHDx5UEQsh5rSWnhbPRWGIwUKFCgVK5s+fX0Wf9UibtRmIpCZNmgTEo4npcdEVi5AACZAA CZAACZAACYSBQNgFj/F84OgTvAY3btxQIRFXJrJwCR4jouC5KFmypG7qMc7YBI9Zz61bt6qn Km/evFK/fn39gYiBOQkep+NSCYnhiU3wmPHBm3Lo0CH9q9NRsRYtWgg8U9Zyps0ffvhBBgwY oMftUA6/cRwOXis/gseIUvSH9mALFy5MstTPTjE8hhPEEcTOXXfdJX//+98DaxiGzy27JAES IAESIAESIAEScEkgIgQPPCHPP/+8XLx4UebPnx+rZ8fMKdyCx87WuklGZq/Y7gZyEjImA5jV w5NYgseIk7ieDbexMXbB49RmQgRPfM9vKI60OfURl+AxKaytHqv4xsn3SYAESIAESIAESIAE wksg7IIHR4cQHI/AdMRqwBOCY184WoT3TEC9FVO0CJ7ChQtr3A0yeSGeKNIED7xU8MjAuwOx CYsWweN2nF4+XojfqVatmsZjwXuHRBVWo+DxQpNlSYAESIAESIAESCAyCIRd8JikBUgtvGvX LqWC2BLEdDh5JLApRXYuxFLg6BviTMxmHUJp6NCheuQIm9XDhw9rezgaVbVqVVm3bl0gLsQN fgSzlyhRQtuE4ff3338fiNExbUA4/OUvf5GMGTNK3759Ax4eeHsQ0A+vFWJ/cCQKm+bff/9d +vTpo9VfeeUVuffeezXoH4H98A6hHOZ4+/btQLkePXpoUoEPPvhA54E4J7cGnm3btpWTJ0/G SOGM+dxxxx0aH4R4KcTX1K1bV5MPgN2QIUOCkgWgT5TD0S6sEdbs7bffdjxyBu7wBGEdkczB 1MVaI0YI6Z+RLADJJpA8APE+ELwYT3zpxnEE0oxz2LBhblEElUPfJqMfnhGIHayxU5sUPL4x syIJkAAJkAAJkAAJhI1A2AUPNpGxGTK12b9lR8ppZEkzhqDx999/P0YTCHbHptxquFgS2ci8 GJIHYNNvNWyEnVJIQ2Q53QcDrxUC/43Z24RAQgY1ZEZDBjWTRQ2ZwN56661APQiezp0769zt bbqZEzLI4aJMu1nng3HgxxjEl7l801rPXg7eK8Q3ORnilSC27Ib5mMxrmBdimYw5rbubOfop 46VvU9bpmfPTN+uQAAmQAAmQAAmQAAkkPoGwCx58+x+bwcNhv4MF38bDK2EMKY+R6MBqdrGD 95zKxYcX/djv88F4MC67pUqVSj08dsPY0Lcxe5toL23atJI6dWr1HJkMb/Zy8OggpTNet7cZ 3zzwPtpHfbtZ54Nx4MdqTvFI9nLwWMXmcYKXDMfm7IbyqAfD+yhnzGnd3czRTxkvfZuyfp4l P2NjHRIgARIgARIgARIggYQTSJDg+eP+k3/tWH0YjnLB4srG5qNZV1XM0be4CuOIl0mL7KpR FiIBEiABEiABEiABEiABEog4AkbwvPPOO57HlipaBQ88FKVKlYpzwhcuXAjEAHkmwwokQAIk QAIkQAIkQAIkQAIRQSBBguePI0m+PTwPP/ywAgiHhyciyHMQJEACJEACJEACJEACJEACiU4g QUfaKHgSfX3YAQmQAAmQAAmQAAmQAAmQQAIIUPAkAB6rkgAJkAAJkAAJkAAJkAAJRDaBqBQ8 5cuX17t2cCmp08WkkY3c2+iQvQx3zpgsZshqZ9I5e2uJpZ0IIP13vnz5Yrx16dIl+SM+LfBa 5cqVJUuWLI4AkeVuw4YNhEsCJEACJEACJEACJBChBKJS8Lz++uuCGKC5c+fKvHnzIhRtaIaF VNK4CwfzxZ9HjBjBuKfQoBWInWeffVayZcsmJ06c0FbxZ2TxmzJlimzZskVfGzVqlNx9992y b98+wZ1DsDvvvFMTX/zyyy/SpUuXEI2IzZAACZAACZAACZAACYSaQFQKnvbt2wu8PLjQ03qp Z6jhRFJ7kyZNkjx58lDw/HtR4HGBlw93Eh07dszXUg0cOFCfo6lTp8qSJUu0jXLlysmgQYPk 8uXL0q5dO30Nl6QWKFBA5syZE/D84IPTu3dvCh5f5FmJBEiABEiABEiABJKOQNgFz/79+2Od LS7h/PXXX2O8nyNHjsDlmNiUOl2MiY0wLgK1Gi66xFElL4ZjZPgmH4ZjZOjbHC2z940LQXPl yhXUPPq0XsppbdMUPn/+fNDlqXjP2ubQoUO1fb8eHlyamT179qDxga+57BQXtmbOnFn/jnGb uaPSuXPnAheomnLXr1/XuYGLsTNnzsS4mBWXsTodB7OWy5o1q17wirYgYMw4kQQQ5ZySAdaq VUu6desmeH569erlZVkDZd0KHqfGKXh8IWclEiABEiABEiABEkhyAmEXPPiWPDZDvMqAAQNi vG02qXgxtiNtH374oW7crbZ48WKZNm2aJ8DFihWT0aNHa53nn39ev/nH0SanvnPnzu14UanV e4B61jbNYGITMU5t+hU8ZoNuB9C/f3/ZsWOHvtyyZUtp1aqVgDtYmbnjvZ49ewbipUy5jRs3 qmcEXIzh+J059oXXGjVqJB07dgzibi3XtWtXqV27tmCNMBbzTEBUopyTqKXg8fQoszAJkAAJ kAAJkAAJpFgCESN4hg0bJj/99JO0bdtWGjRoIGvWrFEBgaBwq8ETgCNGlSpVChI88OyMGTNG 4IHo16+fHDx4UKuizTp16sj69etl/PjxrhcbHpbChQtrm9h8o28Ijho1amhMDTbos2bN0liQ Pn36qCcCYzMb9Ndee02PTM2fP18WLFig/aJNtGNsyJAhkjdvXsGRtbVr1wZet7eJchBAfgRP /fr15YUXXlBvCDgbw7zgfcFvxKvgQlZw+tOf/qSeltu3b6vgcCrXuHFjjX8x3qC+fftqOXjW 4I3auXOntGnTRgUP7lp67733tFuszbvvvquMwOzQoUMC71OLFi2kSZMmcuvWLR3n+++/r4IL 5dA2ylkNnjLUwxjtz4jbBcY6YH74EPz222+B9YFXynqkzd5e9erVNW7n5MmTOgerB89t3yxH AiRAAiRAAiRAAiSQNATCLngQ9A1D0HjTpk1V7Gzfvl2FRGzZyGJLWmD1iFg9Eh06dBBs0OGR GDlypCey1jaxAYcw6NSpU8AjAU+IifvAZv3IkSOBI12IuYGnyeqJQiwIRJEx/B3JCCZMmCCr V6/Wl9EeNtR4ffDgwdrm3/72N98xPMbLgo25Cc5HP4UKFVKRYxVRxnNy9OhRDdaH0HCKHzJt 7tmzR8d+9uxZFaiYr/EaGe6rVq2SiRMnBgTPzJkz9c9OXiN4l9AfWKI9ezlPi+eiMESy9cjd PffcI6+88kqsggfi8emnn1axA+HmN37IxdBYhARIgARIgARIgARIIAQEwi548O0/DJvjatWq aYpfeE6sG3P7PMMleMwGvWDBghq3gvgSjNMIHgiKsWPHBnkcIOpwzAteG8wTsTgoB4OwyZ8/ fwzB4xQfkpCkBUacwHPidKwPoubixYs6HqejYiVLllRvirWcadMcO4TnClnLUqdOrR4aeGb8 CB4jSiHE0B5s7969vr04Xj8jTkkLTBvNmjUTCB6IwRkzZsjhw4e9Ns/yJEACJEACJEACJEAC SUwgIgQP4kbq1asnmzdvlkWLFqlHIy4Lt+Cxj826SY4t5gR1nISMSXls9fAkluBxiomyz8Vt bIxd8DitV0IET3yfA4jHunXrqpCEBy1UFpfgMbFGVo9VqPplOyRAAiRAAiRAAiRAAolDIOyC BxtMxMR8++238uWXX6rYKVu2rMbIHD9+XF+zW7QIHsTDFC1aVLZu3Srbtm2LOMGDuBkc51qx YkUgRiZaBI/bcXr52JQoUUKeeuop9Sx98sknQSnPKXi80GRZEiABEiABEiABEogMAmEXPCYj 19KlS1XgwCCCIHicPBJVqlTRbGJGSMAjhJgfGDbv2MQjDgjZwxBXAkNbCERHHytXrnRNHpdQ NmzYUPuDff755zHaNQ3ly5dP4zoQzI4EBQj4hz322GOa3vmzzz5TwVOkSBHBsaiKFStqORgu ucScdu/erW3jN8qhT5PwAOVwDA7tox3MI6503vYJQkA++eSTGrODusbACoxxeSuOq+HoGjw3 EKA4rue06UddlMM8jCjF/Jy44uFC7BSOwyEJBQx/RhIJiCzca4M1qlChgiYsABckmsB4cLQx LoM4wThRf+HCha7X1F4QfYOLmRdYYR2c2qTg8Y2ZFUmABEiABEiABEggbATCLnjMAJwIIFbC ZDcz72OjjRgaY8jshs2z1Tp37qwB/1aDULBmQXNDHAHtyERmNYwH47Ib7pJBJjS7YaNvBBne s7eJTT8YFC9eXLOZmZgmzBFzNYaYERzhwuv2Nt3MBem0IWbsZp0PxmFdD9yzg2xpdrOXu3Dh giAVuJNBUECY2A3zMXFDEIZlypQJFHFadzdz9FPGS9+mrNMz56dv1iEBEiABEiABEiABEkh8 AmEXPGaDn/hT/U8P1oD42PrFJp5B6Um5KuyLBEiABEiABEiABEiABEJPIEUKnjvvvFPvT4nL cNRr+vTpoSfOFkmABEiABEjsubhMAAAgAElEQVSABEiABEiABJKMQIoUPElGlx2RAAmQAAmQ AAmQAAmQAAmElQAFT1jxs3MSIAESIAESIAESIAESIIHEJEDBk5h02TYJkAAJkAAJkAAJkAAJ kEBYCVDwhBU/OycBEiABEiABEiABEiABEkhMAlEpeJCuGXfBrFu3Tn+SsyG99ssvvxxIs400 0rirhxYaAk888YTed2S1X375JUbCivbt20uePHkcO0Q2v8mTJ4dmMGyFBEiABEiABEiABEgg 5ASiUvC8/vrreunl3Llz9ZLK5Gxp0qSROnXqyHPPPSe462fEiBGBu3qS87yTYm6PP/644OfY sWOyY8cO7TJ//vzyyCOP6N1Os2bN0tdGjRoluMcI9x8ZsYmLb3EvD8RRly5dkmK47IMESIAE SIAESIAESMAHgagUPNWqVdMLOLFJNRtVH3OPqiqTJk1SLwMFz7+WrVixYnpJ6q+//irLly/3 tZYDBw5U787UqVNlyZIl2ka5cuVk0KBBcvnyZWnXrp2+Vr9+fcmRI4cKzQMHDuhr6Lt3794U PL7IsxIJkAAJkAAJkAAJJB2BsAueTJkyxTpbbGa3bdsW4/0HHnhAN58wbD7NBtRaqHr16gLP iNWOHDkie/bs8UQ2S5YsUrlyZa2zdu1aQd94zanvDBkySJUqVYLaR5/o25i1TfMa7vw5ffp0 UF1rmy+88IJky5bNt+C56667go5uoUPwBWcYRAR+8HeM28wd723atEkuXboUoxzGjLmBi7EN GzbItWvXAn8vVKiQlChRImhu1nKlS5eWfPnyaVvo2xwx++233wTl8NtutWrVkm7dusn+/ful V69entbVFHYreJwap+DxhZyVSIAESIAESIAESCDJCYRd8OBbcthPP/0kiIfAUSFsfk+dOiX/ +Mc/ZPbs2TGgtG7dWo8S4fJQ+5G2dOnS6eb71Vdf1Q07vqWHoc3Dhw/Lp59+6in+BR6Vl156 SdscN26coO+zZ88KxMPPP/+s7R06dEiPmuGIXefOnWX79u2BDXqpUqVky5YtsnDhQjl69KiO BW0iJsQYNvfLli3TH6vosbeJcojn8ePhyZs3r9StW1d/wNkY5oU54PgWhAY8Z0899ZSKRbz2 /PPPy+bNm3X+H3/8sYo+U+6ZZ56R69evqxDCnyHaKlSoIO+//75s3LhRLl68KEWKFJHGjRvL /fffL/v27dNu0XalSpUEHqtvv/1Wrly5IoijadCggRw/flzXCeNEeQghxMdgDChnNfBAPXu8 jZdPENazZs2a8t133+k8YIULF9bjg1YPj71NrD/Gix/MgTE8XqizLAmQAAmQAAmQAAkkLYGw C56WLVvqjLEBPn/+vLRp00Y3zhAAEDROFlsMT+7cuQObz549ewa8Px06dNCNNzbiI0eO9ETY 2iZEy/jx46Vhw4ZSu3ZtWbx4sUybNi1wDOrq1asydOhQwW8Y+sXG3CrMIMoKFCgQGEOPHj30 eN6ECRNk9erV+jq8XlWrVlUBhZgRtDl27FjfR9oaNWokHTt2VBEIzsb69OkjOXPmjCGijOcE Ymbv3r3Sr18/rWM/TmfaxFx//PFHFYTY+GfOnFn69++vRw0N91WrVsnEiRMDc5s5c6b+2bpG eA5atWqlQmP9+vXyySefOK6lp8VzURh9PvTQQ4GS8Kohjic2wQPvYr169aRJkybqHRszZoyL XliEBEiABEiABEiABEggXATCLngQFwHDRrJTp04qEBBPMX/+/FiZhEvwmA06YjsgSFauXKnj NHEft2/fljNnzsjvv/8eY+wQRpgTxA7m98Ybb2g5GDxVadOmjSF4nI5LJSSGx4iTGzduBI6v WQcIoQLPFMzpqNiQIUMkV65cKkBMOdMmPDsDBgyQjBkzCspBrEEEQKj5ETxGlEKIQejB8Nt6 LDAxPyxOMTymP3jdmjdvrh5GeLvo2UnMlWDbJEACJEACJEACJBAaAhEjeJziKWKbYrgFj31c 1k0yUkjbj1+Z8k5CxmQAs3p4EkvwGHES16PjNjbGLnic2kyI4AnN4+29lbgET9euXdWzZ/VY ee+BNUiABEiABEiABEiABJKSQEQInsGDB8u9994rH3zwgcaOOAWpW6FQ8PzLK+bW3IgT01a0 CB4kpnjxxRfl4MGDeuwuVEbBEyqSbIcESIAESIAESIAEIoNA2AUPYjcQ0wKxg+NMyARWo0YN adq0qcaQWGNODLJoETxIToAjbEibjJ9I8/C89dZbGsODOCST3jtaBI/bcXr5mCErHdYMRxPh eUNCCqvRw+OFJsuSAAmQAAmQAAmQQGQQSJDg+SOzVcxgFQ9zeuWVV7S0ydKG9MImqxriRRA4 7nQEC8ekHn30UU3RjAxdEBILFizQthALg8xob775pmZFM+mR0dauXbs0eQCygLk1ZItDxje0 CTNB//ZU2IhbqVixopZFP7du3dLyyFK2bt06zdKGrHOIAQFwxCqhHAzjRxIEvId5IHEB/ow5 tm3bNlAOMUAQh6lTp9Z5IF2zW4OowVEsiEhwNoZ5ffTRR/LNN99oVjWIiGbNmglSSSMZAUTQ 8OHDg7pBOcSymOD+rVu3alIFu4EfkkUgXbfJUofxlylTRuN8kH0Na4Q+cdcNEiMgUx/GAxEW lyHmC8keUB/C2K+hb5NWG23evHlTRbZTmxQ8fimzHgmQAAmQAAmQAAmEj4ARPO+8847nQaT6 Izjft+BBGmdYQu7hQf0TJ07Izp07Yww+Me7hMR1Y762xdur3Hh6kQ8bdN0h1bL1XCJtv+/02 SNOM1+13+7hZOS/38Jj2cLQQwfl2M/f1mNchOmITYF7u4THtOd2/5GaOfsqYO4Dc9G3KOj1z fvpmHRIgARIgARIgARIggcQnkCAPTygEj8nSlvhT/U8PuPyzRYsWcXaJ2BBkYaORAAmQAAmQ AAmQAAmQAAlELwEKnljWjoIneh9qjpwESIAESIAESIAESIAEDIEUKXi4/CRAAiRAAiRAAiRA AiRAAimDAAVPylhnzpIESIAESIAESIAESIAEUiQBCp4UueycNAmQAAmQAAmQAAmQAAmkDAJR KXjSp0+v6ZmRQhg/yd2smeyuX78eSHud3OedFPNLly6dpEmTJkZXuIfHpDTHG8jAd8cddzgO B4kKkcKbRgIkQAIkQAIkQAIkEJkEolLwxHbxaGQiTtioIHYmT54smTNn1oZGjBgh4chsl7BZ RG5tc7eOdYS4q6hXr16Bl3AJ6d133+04CdwF1aVLl8idIEdGAiRAAiRAAiRAAimcAAVPhD8A qVKlElzEOmzYMP1NwRO6BevevbtUqlRJFi1aFEhBjstYu3Xrphel9uzZUzszgmfGjBmyfv16 fa1ChQoqdCh4QrcebIkESIAESIAESIAEEoNAVAqePHny6IWluKASPynBJk2aJJg3Bc+/Vrty 5cry7LPPyrFjx2TMmDG+HoGBAwdK+fLlZerUqbJkyRJto1y5cjJo0CC5fPn/2TsTsB3L9P+f 2psiS5ayJCQ0k5SOKMpSZAtlSRnFTEUHR1mGKeJIaBiUYSY1JkpGlorJEi1MEX4pmSHGUtoV UdFCqf//c/1+1zP3e7/3877P87zL8y7f8zjeA/dz3dfyue77dX2f8zrP6xvr1auXu3b22Wcb W9/2799vhw8fdtd4cYYNGybBkxJ53SQCIiACIiACIiAC+Ucg7YKnWbNmcUf74Ycf2ty5czN8 3qNHD6tataq7tnbtWvcTtrvuusuI8wnaxo0bkz5IFIFx6623umqmTJlitM21qLZLlSplffv2 zdQXDi+lbW/BOv215557znbu3Jnp3mCdF110kRtTqoLnvPPOs86dO2dqA75wxq644gr3w79f fvnl2Nj5bNasWW5xHyxHnxkbXLyx/e7rr7+O/Rth0qJFi0ztBsu1bdvWCQ/qom3fT+KVKMef YeO5wRMT3n6WqWAWFxIVPFFVSPAkQ1plRUAEREAEREAERCB9BNIuePiWHHv22WfdNqKmTZsa i/tt27bZwoUL7e23385Ah89uvvlmq1Gjhs2bN8/mz58f+7xkyZJ2yy23WJMmTeyZZ56xffv2 uc+ok+1gK1eutGXLliVM+/TTT3eLdep87bXXXL9efPFFq1u3rgtkX7Roka1Zs8YqV67sFv0X X3yxse3JL9DbtWvnEgwwNh93Q52IAG94Kfbu3WtPP/20bd++PXY9XCflEECpCB62XyEiypQp Y4grb4xr9+7dNmfOHCccqlevbm3atHHbvHbt2mUXXnihPfbYY278//nPfxxvX65Tp05Wp04d ++ijj6xmzZqu/5R76623nEhlLpmH9u3b248//mgvvfSSaxbRdvvtt7utYYgovCbUc9111zlP Ch47+onguummm2z9+vX21FNPuXJBq1SpkrsPj0tQUCY8uf+/IPPZpUsXl7SAcWClS5e2Bg0a ZPDwhOukXeaDPjAG+igTAREQAREQAREQAREomATSLnhYZGOrVq1ygeH+230W5vGC8+MlLShf vrzzCGDEX+zZs8f9vXfv3m7hvWHDBpswYUJSMxGsc8WKFU4wdO/e3Zo3b25LliyxmTNnxrZB HT161F3zmePwllSpUiWDMGNB3apVq1gf+DsL/KlTp9rq1avddcQOHJgc2qPOP/3pTylvaUN4 9enTx3lo4OwNJiRDCIoo7zk5ePCg2+ZF+1Hb6YJ10j/q9ckVRo4caVu3bo1x57Np06a5ZtmK OHv27Exz1K1bN8cV4UGb3B81l0lNXgKFYeyfQYrjgWNug1vagtWw5Y2xM0fwQUTLREAEREAE REAEREAECi6BtAseL2qC37azgMZzEs/SJXi8iGrZsqXz8uB9op8+7gOhw7f9eDSCxhj5OfPM M91iumPHjjGvAN4ePFNBwRO1XSonMTxenCBiwh4z+snCHc8NFrVVjFgWvEvBcr7OLVu22KhR o1yMCx4ePDgIFjw8XmgmI3i8KPXeOvqE9yjs4cmrVyoqhse35T1R1apVc57CZLyFedVf1SsC IiACIiACIiACIpA1gQIheFhk/va3v3VCgW1T2W1RSrfgCSMNLpKJ4/n2228jqUcJGZ8BLD8E jxcnWT0SicbGhAVPVJ05ETzZvbiIR7Y14onBG5RblpXg8SmsgwIut9pVPSIgAiIgAiIgAiIg AnlDIO2Ch21WgwYNcgc7Eg+B2MGbULZsWXf4I/EtYSssgiecTa6gCR622xG/whx4kVZYBE+i /UzmtSG+6rLLLrPf/OY3Lrbpvvvuy3C7BE8yNFVWBERABERABERABAoGgbQLHp+0gNTCO3bs cFRIFEBMR5RHghgYsnOxBY6tbyQ2OHTokLsPkTR27Fi3dezBBx+MZR/r2rWrNW7c2GV083Eh ieBHDNSqVcvVifHnv//971iMjq+DDGi/+93v7NRTT7URI0bExAPeHgL6FyxY4LaDkTyARfPP P/9sw4cPd7ffeeeddv7557ttWwT2Izwoxxh/+umnWDlEIbEmf/vb39w4vvvuu0SGEOPZs2dP ++yzzzKkcGY8CE28S5s3b3bxNVdffbXbmka2tDFjxkRuJaNchw4d3BwxZ3/84x/twIEDmfoD dzxBzCPJHDDuZa6/+OILl/6ZmB22r5E8gJgittzRn+zSjTdq1CjWT84oStVomwQUGM8IySeY 46g6JXhSpaz7REAEREAEREAERCB9BAqM4IlCECV4fCphXz5qe9GTTz7pgvGD5hMMJIMagTFp 0qQMt/iA/HA9weQGwc+CZ7xwPVwncUEIBzwLwaxzfmuVrwvxxII7fG5MouPx3qVw+eB4fOIA XyZe4H64XFaHb/qtb+F2GY/PoueFhC+TyNa7RMedXblk2pbgyY6mPhcBERABERABERCBgkcg 7YKHxW08w8PBtrag8W08XglvxP2QHS1oeBHCFlUuu+mgHf/tvy9Lf+hX2EqUKOE8PGGjb8Ek BuE6qe/EE0+0448/3nmOfIa3cDk8OiQE4Hq4zuzGwefUHz6biOvB8dAPfoIWFY8ULofHKp7H CS8ZCQ3CRnnuw/icct6i5j2RMaZSJpm2fdlUnqVU+qZ7REAEREAEREAEREAEck4g7YInXurp nA8tfg2kgfZbyuKVQogRUyQTAREQAREQAREQAREQAREovASKpeDBQ1G7du0sZ+3rr7+OxQAV 3ulVz0VABERABERABERABESgeBMoloKneE+5Ri8CIiACIiACIiACIiACxYeABE/xmWuNVARE QAREQAREQAREQASKHQEJnmI35RqwCIiACIiACIiACIiACBQfAoVS8JCambN29uzZ436KspG9 jDNnfBYzkins37+/KA85X8dWp04dq1SpUoY2Dx8+7A7A9dawYUPjUNIoI8vd+vXr87XPakwE REAEREAEREAERCBxAoVS8AwdOjTTuTWJD7lwlSQt9sCBA+3CCy906ZvHjx9v6chsV7ioJdZb zkTiQFYEDwehYpzfBPNp06bZ9u3b3bWJEyfaueee6w5J9QeilipVyqpVq2ZZnUGUWC9USgRE QAREQAREQAREIC8JFErBc+utt7oDOFeuXOl+ioM98sgjVqFCBQme/5tsPC54+TiT6JNPPknp EfCH2AYPh/UHvgYPXR00aJCdffbZ9vTTT8c8P/4gVwmelNDrJhEQAREQAREQARHINwJpFzw5 OXg0eFBnkFheHDzKAZzBQ0/Dbad68Cj9PnLkiB07dizTpAfrnDx5spUvXz5lwZPMwaMc/ImQ CB66GnVAKX2GQ7Bc8EBRBpTMwaMc6EmdwQNSow4+pd5mzZrZgAED7L333rMhQ4ak9MIkKnii KpfgSQm5bhIBERABERABERCBfCeQdsEzbNiwuINGDI0aNSrD536RysV58+bZ/PnzM93/5JNP uq1JQVuyZInNnDkzKcBseZo0aZK759e//rWNHj3abW2KahsxMn369Ez1B70HfBis0xeOt00t qs5Ut7T5BXq4gyNHjrStW7e6y926dbPu3bsb3GHlx85ngwcPjsVL+XIbNmywpUuXOi7e+vbt a/v27Yv9u127dtanT59MXILl+vfvb82bNzfmiL74ZwIvC+WiRI8ET1KPsgqLgAiIgAiIgAiI QLElUGAEDx6MHTt2WNeuXa1ly5a2bt06mzFjRixmws9Q6dKl3Tf7F110USbBU7ZsWRs7dqzb 6vTggw/GDg6lzsaNG9vatWsjRUm82cc7UatWLVcni3janjp1qquLmJrnn3/eFixYYOedd579 7ne/s1NPPdVGjBgRW6CzWK9Zs6YrgzDAqLNMmTKxJocPH27Egzz22GMZgt/DdVKuXLlyKXl4 WrRo4WJVPvvsM4OzN8Z13HHHuTFt3rzZ8IxdffXV1qNHDyNwH88N27koh7eJuBZfrkOHDtax Y0c3VjxClBkzZozh4fnjH/9oO3fudHOJ4EFAPfHEE65Z2qAPxMwglIiLKVmypHXp0sXoJx4j +kn5Bx54wJWjXsoFjb5xH16hgwcPpvQCM5+//e1v3fZI+o1xKC3zE9zSFq6cJBK33367cTgt Yzhw4EBK7esmERABERABERABERCBvCeQdsFDDAS2d+9et4Bu3bq1W1TPmTMnbjayeEkLgh6R oEeid+/e1r59e8MjMWHChKSoBuvE4/HWW2+5RbL3SOAJ8XEfbMdiYY4AwIi5wdMU9EQRC4KI 8Ma/2cKF6Fi9erW7TH39+vVz11n0U+ef//znlGN4vJeFRT2cvVWpUsUt8INeI+85+fjjj12w /gcffGBR8UO+zl27drm+s+jHw8V4vdfIc1+1apUTSxiCZ/bs2e7vUV4jxBHtwdJ7zILlkpq8 BAojjoMZ2BCod955Z1zB06pVK7v++uudKHv00UdTjh9KoGsqIgIiIAIiIAIiIAIikAsE0i54 fMYxvApXXXWV/etf/3Jbm1hox7N0CR6/8GZbG0II8UA/veAhzoVFOjE5QUM88IPXBk9L1apV Y4t5EjBUrFgxg+CJig/JSdICL07o69y5czNhxbPms49FbRWrX7++E1/Bcr5Ov+2QGCHK4cHa tm2bHTp0yFIRPF6UkpEOLx5GG/FieXLhHchQRVTSAl+gbdu2TpDjUUKQ48WSiYAIiIAIiIAI iIAIFGwCBULwEDdyzTXX2Jtvvum2iYW3L4URplvwhPsTXCTHiznhnigh41MeBz08eSV4omKi wmNJNDYmLHiiHvOcCJ7sXhvOz2H7HVsN8aDllmUleHysUdBjlVvtqh4REAEREAEREAEREIG8 IZB2wUMQP9uE3n77befZ4SBRPCENGjRwZ5z4bV7B4RcWwXPFFVdY5cqVXSA+PwVN8CBa2IJG bBMeKKywCJ5E+5nMa8OzyNZHPEvEXD333HMZbpfgSYamyoqACIiACIiACIhAwSCQdsHjM3It X77cPv30U0eFb9kvu+wyt5UpnKWNgHGyhJ1zzjm2adMm5xEi5gcjFoNAebYdsWD1weTURUIB 2njllVcSJk8ygTZt2rj2sEWLFmWo11fEwZXEdTRp0sQlKCClM0byBYL/n332WSfoOKiyc+fO TsxRDiPRAmNiexR95k/K0SbB9L4cCQuon3oYB+mYE7V69erZddddZ8TscK83WMGYTHdsd0No IoKaNm3qkgUsXLgw8pwjyjEOuDJnjC+KKw8XAoLtaa+99pprlr+zre/ll19259owR2yFIwkC XN5//33Xn/Xr12c5PJJJ0E/uX7x4caIoMpWjbbhgjAtWzENUnRI8KWPWjSIgAiIgAiIgAiKQ NgJpFzx8Ux/PPvzww0wxJ8T6EAPjjQX7smXLMlRx1113ZTjLhQ83btyYlNjhHpIOEGMTNGJg 6FfYEEdsZwsbQoC2vYXrnDVrluEJYrGNp4UfjDEyVm/EBiFGuB6uM5Gnx4uUcNngeOgHP96I RZoyZUqm6sPlyFYWlZKbGxs2bOiyr4WN8tyHERuDuPMWNe+JjDGVMsm07ctGPXOptK17REAE REAEREAEREAE8p5A2gWPT1qQ90P9bwtkJqtdu3aWTbIYjxI2+dlPtSUCIiACIiACIiACIiAC IpAzAsVS8PjzerJCxza5eF6LnCHX3SIgAiIgAiIgAiIgAiIgAvlFoFgKnvyCq3ZEQAREQARE QAREQAREQATSS0CCJ7381boIiIAIiIAIiIAIiIAIiEAeEpDgyUO4qloEREAEREAEREAEREAE RCC9BCR40stfrYuACIiACIiACIiACIiACOQhgUIpeEgPXKNGDSPDWzqyvOXhfGSqmnNrbrnl lliabc6ISeYMnvzsa2Fsi7OS6tatm6Hr+/bts3nz5sWude/e3cqXLx85PLL5Pfnkk4Vx6Oqz CIiACIiACIiACBQLAoVS8AwdOtQdesmilEMqi7KdcMIJ7hybm266yUqWLGnjx48v8iIvv+bz 2muvNX4++eQT27p1q2v2rLPOsssvv9wdjDpnzhx3beLEiXbuuee6w1M5GBbj4FvE0ueff279 +vXLry6rHREQAREQAREQAREQgSQJFErBgwBgwblp0yZ7++23kxxy4Sz+yCOPuINQJXj+d/6q VKli9evXd4eXIkRSsfvvv98dePr4448bnjPsggsusNGjR9s333xjvXr1ctc6duxopDKnnV27 drlrvDjDhg2T4EkFvO4RAREQAREQAREQgXwkkHbB84tf/CLucL/88stMguaiiy6y0qVLu3v2 7NnjfsLWpEkTwzMStI8++ii2WE2U7+mnn24NGzZ0xdesWWO0zbWotk855RRr1KhRpqpZINO2 t2Cd/tqWLVts//79me4N1sm2tlKlSqUseM4880y3uA8bghHOWPXq1d0P/6bffux8tnHjRjt8 +HCGcvSZscHF2/r16+3777+P/RthUqtWrUztBsvVqVPHKlWq5Oqibd/PH3/80SjHn2Fr1qyZ DRgwwG3vGzJkSKJTmqFcooInqnIJnpSQ6yYREAEREAEREAERyHcCaRc8fEuOsXDlW3W2FJUr V84OHjxoa9eutZkzZ2aA0rt3b7vyyivd4j+8pe3EE0+02rVr2z333GMff/xxbOFNnTt27HDl P/zww4Qhswi/6667XJ3jxo0z2mYxj+BCKCxcuND27t1riLYGDRq4srRz7Ngx10a1atXcGBYv XmzEhWDUGdwCVbNmTXvuuefcFiovPCgXrpNyxPOk4uHBO9G8eXPnqQjG/zCup556yl599VU7 dOiQISI6d+5sP/zwgy1fvtzuuOMO27Ztmxv/jBkz3FY6X65Lly6uv+vWrbOePXva7t27Xbkp U6Y4z9u3337rxtq+fXsnBJkP7Pjjj3cxM5MnT7Y333zT8aTNVq1auTroH/2kfNWqVe2hhx5y 282CIop6EFncB3+8X6kY83nFFVc4UcU4MARfnz59Mnh4wnUz/2xno33GQB9lIiACIiACIiAC IiACBZNA2gVPt27dHBkWrV999ZXdfPPNbqvSihUrMgSOB/HFi+EhsHz69Omu6ODBg2PeHxa2 LLw3bNhgEyZMSGomgnWyCGdB36ZNGycglixZ4gSZ3wb13Xff2dixY40/MdrFWxEUZoiWs88+ O9aHQYMGWeXKlW3q1Km2evVqdx2x07hxY7vttttczAh1sqhOdUtbu3bt3CIer01QHAwfPtxt 1QqKKO85OXLkiBMg9913n7sn3Lavk7G+88479vDDDzv2p512mo0cOdKJFM991apVNm3atNjY Zs+enWmOeA5IDoDoRXwgJqPmMqnJS6AwbV566aWxknjVEMjBLW3BahA711xzjXXo0MGJXoSb TAREQAREQAREQAREoOASSLvg8VnWWGj27dvXxUYQT+EDxqPQpUvweBGFEGnatKkTZfTTC56f f/7ZeTbChgeHH7wbeEGIEfGiiHFzPSh4orZL5SSGx4sTPE9hTwl9Ray89dZbrttRW8UmTZrk spQFy/k62Y43atQoJ/j7sz0AACAASURBVNJY/PMn3rDt27enJHi8KGULnhcTI0aMsA8++CBf 3qKoGB7fMGK1a9euTuwgyhC/MhEQAREQAREQAREQgYJNoMAInqh4injo0i14wv0KLpIRbVGi h3uihIzPAJYfgseLk6weyURjY8KCJ6rOVDw8qXjhcvMVy0rw9O/f33n2gh6r3GxbdYmACIiA CIiACIiACOQ+gQIheO6991771a9+ZXPnzrUXX3wx5v2Q4PlvyuPc8PAUJcFDXBCJHIjJwqOU WybBk1skVY8IiIAIiIAIiIAIFAwCaRc8xG4Q0/K3v/3NxdiQCYztYgSuE0MSFZBeWDw8t956 q4vhWblypfspaB4ehCYxPMQh+XNoCouHJ9F+JvOakZWOOfvpp5/c2TvhbXTy8CRDU2VFQARE QAREQAREoGAQSLvg8VnayAbGmSoY2b04ZyfKI9GjRw+XIatMmTIujTFxNMuWLXP3EWNB9i6y pRGgT+A5Rl14Ap555pnYwZGJ4CdQn0xlPu0y/SFbWTjTGweCchAqsT2bN2+OpVEmXofYGLK0 kfCAgHdSZnOIqD8/iHTPBMGTRnvRokUuq5vPAnbDDTfEypFJjKxgxOAwDu5L1CpWrGhXX321 +4GzN8ZFXT5DHBnLOnXqZDVq1HDsyEAWFadCOfoGV+YMoeoTDAT7RJY6kkVceOGF9u6777qP GOcll1zihOzrr7/utv+1bdvWWrdu7c7WITsf/cHbl5UR4+P76cVaojyC5Wjbp8EmTon+McdR dUrwpEJY94iACIiACIiACIhAegmkXfDk5Bwe0JGWmAD5oOXFOTy+/uC5NcE2Uz2HB+FCKmQW 8MFzhRA94fNtOK+G6+GzfRJ5hJI5h8fXx/k3nD8UNn9ej7+OCEOQRVky5/D4+6POX0pkjKmU 8WcAJdK2Lxv1zKXStu4RAREQAREQAREQARHIewJpFzw+S1veD/W/LSCy8DxkZXhk8LbIREAE REAEREAEREAEREAECi+BYil4Tj/9dJdeOCt7//337ZVXXim8M6uei4AIiIAIiIAIiIAIiIAI uDh6jDCMZK3E/z935udkb/LliXnB0uHhSbXPuk8EREAEREAEREAEREAERKBwEZDgKVzzpd6K gAiIgAiIgAiIgAiIgAgkQUCCJwlYKioCIiACIiACIiACIiACIlC4CBRKwXPyySfb8ccfbz/8 8IP7KeoWzGR35MgRO3bsWFEfcr6Nj1TmpKIOGufwkHnOGxn4jjvuuMg+savzu+++y7f+qiER EAEREAEREAEREIHkCBRKwcM5O5zl8txzz7mfomyIncmTJ5sXPQ8//LA720eWOwQ4O4mDboNG wor77rsvdumBBx5wZw5F2b59+2zw4MG50xnVIgIiIAIiIAIiIAIikOsECqXgGTp0qDvoc968 eTZ//vxch1KQKsSzwFk2LMDLli1r48ePV6KHXJqgfv36ueeIg05fe+01V2vNmjXtN7/5je3e vTsmeiZOnGjnnnuuPf300/bGG2+4chxW2rt3b/v888+NemQiIAIiIAIiIAIiIAIFk0ChFDxV q1a1UqVKucUm37AXB3vkkUesQoUKEjz/N9kcytq5c2d38CxsUrH777/fCZfHH3/cli5d6qq4 4IILbPTo0fbNN99Yr169YiKIbW2czcShqBgvzrBhwyR4UgGve0RABERABERABEQgHwmkXfD4 DkSNmQVmeMsai9zKlSu74qS0jkprzTYl4nyC9vbbb9uaNWuSQnvmmWfajTfe6O557LHH3AK7 fPnykW2XLFnSbrnllkz14znYvHlz7HqwTn+RxfZ7772X6d5gnY0aNbJTTz01ZcGDh6Jdu3aZ 2oAvnP0invng3/Tbj53P8G7s378/Q7l3333XjQ0u3p544gk7dOhQ7N/169fPtGWMD4PlWrZs aXXr1jXmiLZ9P4lXotzRo0cz9btZs2Y2YMAAx23IkCFJzasvnKjgiapcgicl5LpJBERABERA BERABPKdQNoFD9+SY8uXL7dPP/3UbTHiW/adO3faokWLbP369RmgsPDv1q2bi6kIb2nzB4q2 bt3afWN/4MABdy91IhZoI5nDRPEitWnTxrW3YsUKo+3XX3/datWqZQSrIxYQXJUqVbLrr7/e mjRpYgsWLIgt0FnIHz582J599lm3mMeoMxgz0rFjR0M4LFy40Hbt2hUba7hOyiGAUtnSVq9e Pbvuuuvc1jgYeOPw1S1btrhtgR988IGdd955TmxQfuvWrY7bnDlz3CGtmzZtcuP15RA5zAGC Ay/J4sWLXTlEJePF88LD1b59eyMxgN8yxt979uzptpEhopgjRFGHDh3sjDPOsC+++ML1k/K0 wXzBxs+l7ztluO/rr7+O1Z3s28N8durUyc2XF5zlypWzxo0bZ/DwhOtl/rt06WI1atRwY0jm mUq2jyovAiIgAiIgAiIgAiKQMwJpFzyIGy94KlasaDfccIMTJyyg43lk4sXw4H2ZPn26q49A 8j179ri/E2vBwpvTVSdMmJAUsWCdr776qhNZLHabN29uS5YssZkzZ8a2QeGRCAuesDCLEjws sqdOnWqrV692fYMDAuCqq66yF154wdU5ZcqUlLe0IWL69OnjBGVY8IRFlPecfPXVV06UIHii ttP5OhEoL774ohOYsD/ttNNs5MiRTjB57qtWrbJp06a5sZF8Yfbs2ZnmCFHZvXt3J5Sef/55 e/PNNyPnMqnJS6AwIhWh5y07weNFIX+uXLnSPacyERABERABERABERCBgksg7YLHb0kjJgMh QYpghERW28/SJXi8iApuwaKfPu6DFNl4pH788ccMM+633rGdDaGEt8Z7rho2bOg8N0HBE7Vd KicxPF6cHDx4MOZpCnYwuKUuaqsYsSwItWA5XyceolGjRjkvDlv62Erot8mlIni8KA1u5wtu p8vrVykqhse3WadOHecpq1atmi1btsz9yERABERABERABERABAo2gQIheMiMRaarE0880ebO nZtpG1sYYboFT7g/wUVy37597dtvv42c9Sgh4zOA5Yfg8eIkq0cy0diYsOCJqjMngie716Z0 6dIulovzcsiolluWleDp37+/E6xBj1Vutat6REAEREAEREAEREAE8oZA2gUPmdYGDRrkDnac NWuWbdy40XkTSMHMYpYtToVV8JBVjS1cZPbip6AJHuJg8KgxB16kFRbBk2g/k3ltiAEjbimc ltrXIcGTDE2VFQEREAEREAEREIGCQSDtgscnLRg3bpxt27bNUSHpAIHtUR4J0gMjkDh4lOD4 YMwMW8b8IZ2cW8MBkhh1tWjRwtatW+diYRI1RBgpsKkTGzFihP3nP/+xn376KUMVbHUaPny4 S2RA37x4uPvuu11AP31km9fFF1/sPieRAX9i3EcQPKmRCX5nW1xUubFjxzqPBp4gxhHeNpfV mFq1auW2mxGYD2dvjItFPn9ymCkeNjjdfvvtjh3jjfJWUY6YKLgyZ/Ttu+++y9SFm2++2SVB YEsfWe4wBOCjjz7q6mXsJEFgOxwJD0j8QOwO/UHsZmXE3vh+Bg8JTXRufTnaRvRhJJNA7DDH UXVK8CRLV+VFQAREQAREQAREIP0ECozgiUIRJXh8KmFfPmp70ZNPPumC54PmEwwkg7x69eo2 adKkDLf4gPxwPcHkBsHPgme8cD1cJ3FBBOyHD1L1W6t8XWyVY8EdPjcm0fF471K4fHA8PnGA LxM8iyZ4X7hcVodv+q1v4XYZjz9DyQsJXyaRrXeJjju7csm0LcGTHU19LgIiIAIiIAIiIAIF j0DaBU/U+TMeE94Of9Cjv0bsBh4Gb3gCgue+cB1PT4kSJTLQxgOBZyUZ45v/MmXKZLiF/tCv sOENIsNX2Ggz6P0I10kiAbweBPsjMLxHhTEyVm9kQ2OrH9fDdSYyJjwZpH0OW3A89CMoFPFY +bN3gveFyx07dixT2mhfnox7eJHCxni8p4wEBXjuspr3RMaYSplk2vZlo565VNrWPSIgAiIg AiIgAiIgAnlPIO2CJ+rg0LweNiKG7VRZGV4GYopkIiACIiACIiACIiACIiAChZdAsRQ8eDtI g52V4Xnh8FOZCIiACIiACIiACIiACIhA4SVQLAVP4Z0u9VwEREAEREAEREAEREAERCAZAhI8 ydBSWREQAREQAREQAREQAREQgUJFQIKnUE2XOisCIiACIiACIiACIiACIpAMgUIpeM477zyX Pe3jjz92P0XZjj/+eKtfv37srJgdO3ZkylxXlMef12M799xzjZTiQSNb3tatW2OXSBEeTnPu Pzxy5Iht3rw5r7up+kVABERABERABERABFIkUCgFz9ChQzOdW5Pi+Av8baRrHjhwoF144YXu gM7x48e7gzxlOSfAmUgcnlqpUiUjTTaGsIH5tGnTbPv27e7axIkTDWH00UcfxcQmKcKrVatm WZ1BlPMeqgYREAEREAEREAEREIGcEiiUgodDK/F6cJjo0qVLc8qgUNz/yCOPWIUKFSR4/m+2 ECWci/Pjjz8aGfVSMX+IbfBwWH/ga/DQ1XvvvdeqVq1qTzzxhK1fv9415Q9yleBJhbzuEQER EAEREAEREIH8I5B2wcN5N/GMgyk55DFoLHQ55BPjANCoQ0A5GDNsLIyPHj2aFFna8QdiciBo Vm1z0CmHbIaNNmnbW7BOf41tURzeGbZgnZMnT3Zbr1L18LA1jsNNwwZffwAoh5ryw7/pd/Aw 0Khy9Bn+wXIcssqBpd44aBXPVNiC5ficcnCizmA//UGs4fubNWtmAwYMMA6uHTJkSFLz6gsn KniiKpfgSQm5bhIBERABERABERCBfCeQdsHTv3//uIPetm2bPfjggxk+v+eee6xu3bru2nPP Ped+wjZ9+nQLi54VK1bYnDlzkgLMlqUxY8a4e/Aq0fY555wT2faZZ55piJKwPfXUU7Zy5crY 5WCd/uLDDz9sb731VqZ7g3UiphBLqQqeiy++2O6+++5MbYwbNy62datz587GD9xh5cfOTSNG jLAPPvjA3e/LvfnmmwZXPCDeBg0aZPv374/9u1WrVm7bWNiC5W677TZr2rSpq4u2fT8RO5SL Ej0SPEk9yiosAiIgAiIgAiIgAsWWQNoFz7Bhwxx8xAIB+V27drWWLVvaunXrbMaMGZkC9EuX Lu2+2efg0Hnz5tn8+fNjk1e2bFkbO3asIRQQSh9++KH7jDobN25sa9euNcRQoobXoVatWq7O ffv2GW1PnTrV1UVMzfPPP28LFiwwkij87ne/cx4ehIFfoCOSatas6cr4rXfUScIFb8OHDzfi QR577LHYdik+C9dJuXLlyqUkeFq0aOFEx2effZZBlDEuRBRjIvAekXj11Vdbjx497PDhw85z g+CgHN4m4lp8uQ4dOljHjh3dWPEIUQaBhOfmj3/8ozu0Fe7t2rUzvHhsB8Nog7kmZmb06NEu LoataV26dDH6iceIflL+gQcecOWol3JBy40tbcznb3/7W/vlL3/p+o3h4WJ+glvaws9Lo0aN 7Pbbb7evv/7ajeHAgQOJPlIqJwIiIAIiIAIiIAIikM8E0i54WFhibE1q3bq1tWnTxgmfuXPn xs3AFi9pAVu+vKAZPHiw7dmzx9Xdu3dva9++vW3YsMEmTJiQFOJgnX/5y1+cEOvTp481b97c xRDNnDnTfNwH27Hou9+ehjcHMRMUZgTI9+vXL9YHBBFCCdGxevVqd71OnTpuIc6CnIB56vzz n/+ccgwPooM+wxrO3mrXrp0pEYL3nHz66aexwP2o+CFfJ/U9+uijbq5gT9D/yJEjXZYzz33V qlWuLgzBM3v2bPf34Bx169bNunfv7jw8CF36GjWXSU1eAoUrV67sOHsjkYFn1atXr0w1wAcP 16FDh9zc7969O4FWVEQEREAEREAEREAERCBdBNIueHzGMbwKV111lf3rX/9yQsJvn4oCky7B 4xfoPpXx3r17XT+94CHOhUU6MTlB8+mz8drgaSEA3i/mb731VqtYsWIGwRMVH5KTpAVenNBX hGTYgqmuo7aKkSCCuJpgOV8n3ptRo0ZZMH02ogVBkIrg8aKUuB68eBhtxIvlye0XJyppgW+j bdu2TpSTJIEtf3ixZCIgAiIgAiIgAiIgAgWbQIEQPGyNYgH9zjvv2OLFizN4IQqi4An3KbhI ZhtbvMV5lJDxKY+DHp68EjxenGT1SCYaGxMWPFF15kTwZPfasNWQuB+2k/HM5JZlJXiIN8Oz F/RY5Va7qkcEREAEREAEREAERCBvCKRd8LBlDMGD92DRokW2a9cud+ZJvXr1XPyGTwMcHH66 PTyJCp6GDRs67w1jwxtQ0AQPMTNsp9u4caOLm8EKi+BJtJ/JvDZVqlSxa6+91i6//HJ7+eWX MyW5kOBJhqbKioAIiIAIiIAIiEDBIJB2weOTFjz77LOxmB22MvHtfZRHgs9uvvlmq1GjhovJ +cc//hHLMkbw+y233GJNmjSxZ555xiUawKiLgH+ypS1btixh8qeffroLpKdO7Omnn7YXX3wx UyIF4kDYkkcmNILt/ZY2vCDE8zA2tu4h5IhTOf/882NB/HgqEEYkA1i+fLmLO6IcYyS+xwf7 E2/DZL3++utuHOEg/qwGxZY04k4Ixg9mtWNcxKCwPYtYHOJXiKEicQHsyDC3Zs2aTFVTrlOn To4r/WCbXJQwZR6InSLd9EsvveTqYWscAf/EQs2aNctldCNm6brrrnOHyb777ruuP2+//XaW 88Q9vp/ESKVq1ENcFUb2v0suucTNcVSdEjypUtZ9IiACIiACIiACIpA+AmkXPIiCeMbin8Dw oLFNigW3NxbG4dTUpI8Ong1DWRbYL7zwQlKkwwkGuJn++GQIwcoIfB84cGCm+hExQTEQrpPY HLZJsfBmq5RPXMAYGau3hx56yIkWrofrTGRQ1I8oC1twPHhN6Is3YpLCacH5LFzuyy+/NPoX ZWQ0Q0SFjfLchzEuH6/Dv6PmPZExplImmbZ92ahnLpW2dY8IiIAIiIAIiIAIiEDeE0i74PFJ C/J+qP9tgdTQbF/KyojD+fzzz/OzW2pLBERABERABERABERABEQglwkUS8ET75DQIFsO1Zwy ZUou41Z1IiACIiACIiACIiACIiAC+UmgWAqe/ASstkRABERABERABERABERABNJHQIInfezV sgiIgAiIgAiIgAiIgAiIQB4TkODJY8CqXgREQAREQAREQAREQAREIH0EJHjSx14ti4AIiIAI iIAIiIAIiIAI5DGBQil42rZt687hIcNbOrK85fGcZKj+pJNOcucAcX4NtnTpUndmjix3CLRs 2dKdvxM0ziAKnsPD2UkckBtlX3/9tT355JO50xnVIgIiIAIiIAIiIAIikOsECqXgGTp0qDuk kkXp/Pnzcx1KQarwxBNPdId3cgbMaaedZuPHjy/yIi+/+HOeEGw5D2jHjh2u2QoVKrgzgRCW /nyniRMnusNgOejWn8HEYbMcrErq8n79+uVXl9WOCIiACIiACIiACIhAkgQKpeBp0aKFnXPO ObZp0ybjEMjiYBxQymJcgud/Z5tzlOrXr294WF577bWUHoH777/ffvnLX9rjjz/uBA52wQUX 2OjRo+2bb76xXr16uWsdO3a0smXLunZ27drlrvHiDBs2TIInJfK6SQREQAREQAREQATyj0Da BU9WQ2Uxu3379gxF6tSpY6VKlXLXPv74Y/cTtosvvtg4XDRoe/futQ8++CApsr/4xS/cghjj XB7axssS1TZbz/AMhO3999+3zz77LHY5WKe/iHcBL0PYgnX27dvXzjjjjJQFT+nSpa127dqZ 2ti2bZsdOnTIXcdrwQ/cYeXHzmdbtmwxDmMNljt48KDBNbglDAF69OjRWDsVK1Z04jRswXJ4 T9gyRl207fv5448/2ubNm+3YsWOZ7sc7M2DAALe9b8iQIUnNqy+cqOCJqlyCJyXkukkEREAE REAEREAE8p1A2gUP35JjLFz5Vv2ss86ycuXKGYvptWvX2syZMzNA6d27t1155ZVO9IS3tLH9 i8XyPffc44TQ999/7+6lTkQF5T/88MOEIVeqVMnuuusuV+e4ceOMtqkT8cCCfeHChW6Rjohp 0KCBK0s7foFerVo1N4bFixcbcSEYdQa3QNWsWdNtnXr55ZcziJ5wnZRDAKXi4cE70bx5c+ep CMb/MK6nnnrKXn31VSd6EBFsnfvhhx9s+fLldscddxiCiHIzZsxwW+l8uS5durj+rlu3znr2 7Gm7d+925TisFc8b4oixsmWsUaNGMWF6/PHHO4E0efJkJyLhSZutWrVyddA/+sn8Va1a1R56 6CHbunVrbC795CEuuQ/+eL9SMebziiuusPXr17txYNWrV7c+ffpk8PCE62b+if2hfcZAH2Ui IAIiIAIiIAIiIAIFk0DaBQ+LTowFMIvXX//619a4cWN78cUX4waDx4vhwUswffp0V9/gwYNj 8Ra0wcKbGIwJEyYkNRPBOg8cOODub926tRMQS5YscYLMb4NikT9ixIiYJwSvDAvzoDDD81Sm TJlYH4YPH+4W9lOnTrXVq1e76wibSy+91AkoBBp1wifVLW3t2rVzi3jEGPV4Gzt2rBOXQRHl PSeIHkQHHKO20/k68eYgVBCEsMcDNnLkSCdSPPdVq1bZtGnTXLMIudmzZ2eao27duhnJAY4c OWJvvPGGE2JRc5nU5CVQmG1rPG/eEM3MT3BLW7Aa+n/11VfbjTfe6LxejFsmAiIgAiIgAiIg AiJQcAmkXfD4LGunnHKKIRDoEPEUc+bMiUstXYLHi6jbbrvNmjZtaitWrHD99ILn559/jomd YOfx4PCDdwMvCDEi3333nSvCuLkeFDxR26VyEsPjxQmeJ+/1Cvbv4YcftrfeestditoqNmnS JLflLFjO18mif9SoUU7IIKb4ExHAVsRUBI8XpWeeeWZMnCH4kt2OmOorFxXD4+tCiHbt2tU6 dOjgPEJ4s2QiIAIiIAIiIAIiIAIFm0CBETxsQyMIHW8IgicYBxJGmG7Bw8IXTw0xJvQzuEge NGhQJtGDt4QfYov4/PDhw+5PbMyYMS7GJT8ED9vTojwSeFX8NrwowXPqqadaiRIlnPfFlwsL HsaC2MEQVT/99FOOBA/t0W6wvvx4lbISPAhdEmYgyhCg8JCJgAiIgAiIgAiIgAgUbAIFQvDc e++99qtf/crmzp3rtrJ570c8dOkWPOF+BRfJeKl8cH+4XJTnxqc8zg/B470xWT2SiSYDiBI8 4Xpz4uHJ7rUhLojzidjyl5vbyrISPP3793dbGYNb9LLrpz4XAREQAREQAREQARFIL4G0Cx4W zgTkI3YI8CcQnsVsmzZtXAxOOGkBuAqL4OnRo4fL7MYCmficgiZ4Bg4c6BIwwN5nwyssgifR fibzehFvRQIGthkScxTOECjBkwxNlRUBERABERABERCBgkEg7YLHZ2ljuxUpiTGye7HNK8oj gYggQxaB5R999JGLo1m2bJm7z6dxJtif81IIPMeoC0/AM888Yzt37kyYPEkCyFTm003TH7KV hTO9lSxZ0h2EypYn0iiz1Q0jXofYGLK0kQAAccFhlTfddFPs/KCNGzfaNddc47bILVq0yIk+ nwXshhtuiJUjkxhZwdguxji4L1EjNTSB9vzA2Rvjoi6fIY6MZZ06dbIaNWo4dmQgi4pToRx9 gytzxhYvn2Ag2Cey1JEs4sILL7R3333XfcQ4L7nkErcl7PXXX3fesLZt27pEEJytQ3Y++oMI y8qI8fH9JEFCqkbbPv02cUr0jzmOqlOCJ1XKuk8EREAEREAEREAE0kcg7YKHRWY8++KLL1zK 4KDh/SGzmDdEDyIjaKQ4JttW0Eh3/M477yRFmtTXJCcIGsHqZGsLG/EmxHeEjTaDqaDDdXKY JcIIUUIWNS/ISCUdzB72yiuvuBgnxh6uM5FBUX/Dhg0zFQ2O57zzzstwVg9xRytXrsx0T7gc WxDpX5Rxxk69evUyfUR5v3WRcSF2vEXNeyJjTKVMMm37slHPXCpt6x4REAEREAEREAEREIG8 J5B2weOztOX9UP/bAsH1eB6yMjwyeFtkIiACIiACIiACIiACIiAChZdAsRQ8bEEj4D0rYwuW 3ypXeKdXPRcBERABERABERABERCB4k2gWAqe4j3lGr0IiIAIiIAIiIAIiIAIFB8CEjzFZ641 UhEQAREQAREQAREQAREodgQkeIrdlGvAIiACIiACIiACIiACIlB8CEjwFJ+51khFQAREQARE QAREQAREoNgRKJSCp2/fvi5F85IlS2zp0qVFetJIdz1mzBgjsxzGeTfhNNxFGkAeD65Xr14Z 0n/THOcsjRs3Ltbyvffea1WrVo3sCSm0R4wYkce9VPUiIAIiIAIiIAIiIAKpEiiUgmfo0KHu oM958+bZ/PnzUx17objvuOOOc2fU3HfffcbZPOPHj7d0pPIuFLCS7GS/fv3cc8RBp5yHhNWs WdN+85vf2O7dux1zbOLEicZ5Qk8//bS98cYb7hqHlfbu3ds+//xzox6ZCIiACIiACIiACIhA wSRQKAUPB1+WKVPGOCuHn+JgjzzyiFWoUEGC5/8mG8HRtm1bJzhmzZqV0iNw//33O+Hy+OOP xzyFF1xwgY0ePdq++eYbw/uDce20004zUpXv37/fXePFGTZsmARPSuR1kwiIgAiIgAiIgAjk H4G0Cx7fgaghI2aee+65DB917tzZKleu7K7h6Yjydtx222128sknZ7jv7bfftjVr1iRF9swz z7Qbb7zR3fPYY48ZbZcvXz6y7Xhn++A5CG5BC9bpO8O2vPfeey9T34J1NmrUyNjelqqHBw9F u3btMrUBXy8amQt++Df99mPnJrwbwcU+5RAAjA0u3p544gk7dOhQ7N9sPWzatGmmdoPlWrZs aXXr1jXmiLZ9ztHw/wAAIABJREFUP48cOWKUO3r0aKb7mzVrZgMGDHDchgwZktS8+sKJCp6o yiV4UkKum0RABERABERABEQg3wmkXfDwLTm2atUq9215gwYNrHbt2m4hS4zO6tWrM0BhocsC m21e4S1txLm0b9/efU59X375pbuXOjHqW7t2bcKQS5cu7eqizmeffdaaN2/uFuXVq1d3HgDE Av9GBFGmVatWro0ffvjBtXHFFVfYvn37XLmtW7e6a9RJOW/8nc8os2fPntj1cJ2tW7d2XoZU BA8eMfoHV7h44xqC0YsePBmIDcTRpk2b3Hj5jHKIRYQZgoRyXvzt3LnTiaQVK1a4citXrnQM GPdFF13krjFmL0xPPPFEu/76610Z6maOuJ92TzrpJPcM0E/Ke5606+fS95054D6u02YqxrNE /6hjx44drgq8aIw76OEJ103bjB8OjKGox5Glwlb3iIAIiIAIiIAIiEBBIZB2wcOiEVu+fLlV rFjRbrjhBufJWLx4cVyPTLwYHkQCQf3Y4MGDYwKCWAsWths2bLAJEyYkxT5Y56uvvupEVpcu XdyimEX7zJkz3cKXbVB4JBYsWBDzSOC5OOecczIIs1KlSmXweHTs2NHKlStnU6dOjYk7OHTo 0MGuuuoqe+GFF1ydU6ZMSXlLG2KiT58+9umnnzrO3rp27Wp4kYIiyntOvvrqKxfbMmfOHIva TufrJGj/xRdfdIt+2CPKRo4c6USc547ImjZtmmsWUTp79uxMc9StWzfr3r277d27155//nl7 8803I+cyqclLoHCTJk0MQeiNuWjcuHFcwUNZxs6fCC2eU5kIiIAIiIAIiIAIiEDBJZB2weO/ +a9Tp47bQoUgQEi88sorcamlS/B4EUXsCLEfGzdudP30gufHH390W7z4M2h4lfjB08EC+6ab bnKeIYx6EAlBwRO1XSonMTxenHz99de2bdu2TFzxUuCpwaK2ipEVj3kJlvN1btmyxUaNGuW2 EFKOP+fOnesynaUieLwopT3qw4jRwfOTHxYVw+PbxfPVqVMnO//8851HK7zdMj/6pzZEQARE QAREQAREQASSI1AgBA+Zsch0xXYnFsvr16/PchTpFjzhzgUXySzSv/3228j+RwkZnwEsPwSP FydZwU00NiYseKLqzIngye4xRjwSy/X999+7jGq5ZVkJnv79+zvPXtBjlVvtqh4REAEREAER EAEREIG8IZB2wUOszvDhw+3000+3GTNmOLHDljb+TSxMOHYDDIVF8OClwONBPAgiqKAJHtJc H3/88cb2NZ8YoLAInkT7mcxrc8opp9gll1zikiEQq4RHL2gSPMnQVFkREAEREAEREAERKBgE 0i54fNICDnr0260I0O/Zs6dFeSRYlA4aNMgtTEkkEIyZIQPa5MmTXZwIZ6i8//77jjJ1tWjR wtatW+diYRI1zsDhwEnqxDhg8j//+Y/99NNPGapgOx6i7eeff3Z98x6eu+++221Zo49sf7r4 4ovd54cPH3Z/YtxXq1YtlxqZ7XGIvKhyY8eOdR4NPEGMI7xtLqsxEfx/yy23uEQQwQM1GRfC kj/feust52GD0+233+7YMd4obxXliImCK3NG37777rtMXbj55ptdvAvbFslyhzE3jz76qKuX sX/wwQcuWQHxRCQzIHaH/uC5ycrYGuj76c/LSXReg+Vo+4QTTnCXyCbHGTzMcVSdEjypENY9 IiACIiACIiACIpBeAgVG8LBg9kKCBSiekSjBc88997jsX5TBK4FI+Otf/+oolihRwnmHCJ5H rPj6WNRSjhTHJBZI1KpVq+YW8yzSMfo4ZswY2759e4YqvDCaNGlSBoHAGEjn7DO34U0hAxkJ DrxAoH4SNQSFEeUY4+9///tYOcTBHXfc4TKoMY5kMpPBikB8PBdBIQGrP/zhDy6e6NixYy7z GMKDfvPvAwcOxOJoggMOlyNeJ+wNoTzcETwkIwimliZmCcHHfcwRacQRWpRHyNGfBx98MMtp YkyU5/7sxFFWFdG2T5tNnaTaZo6j6pTgSfTNUTkREAEREAEREAERKDgE0i54os6f8XiitrQR u4GHwRsL0+C5L1zH04P4CRoCA89KMsYCmANOg8YWO592Ongd0UOGr7DRZtD7Ea7z4MGDTlAF t75RB2NkrN7IhsYWOa6H60xkTIiDM844I1PR4HjoB2LEGx4rf/ZO8MZwOS+OovrhtyeGP2M8 XpCSKQ7PXVbznsgYUymTTNu+bNQzl0rbukcEREAEREAEREAERCDvCaRd8EQdHJrXw0ZIDBw4 MMtm8OKQQEEmAiIgAiIgAiIgAiIgAiJQeAkUS8GDt4MtY1kZnhefqrnwTq96LgIiIAIiIAIi IAIiIALFm0CxFDzFe8o1ehEQAREQAREQAREQAREoPgQkeIrPXGukIiACIiACIiACIiACIlDs CEjwFLsp14BFQAREQAREQAREQAREoPgQKJSC57zzznPZ0zgckp+ibKSorl+/fuysmB07dkQe xlqUGeTl2EjzXb58+QxNcFDs1q1bY9cuuOCCDNnrgoVJc7558+a87KLqFgEREAEREAEREAER yAGBQil4hg4dapdddpnNmzfP5s+fn4PhF/xbSdfMGTyIPFJSjx8/3h3kKcs5gUqVKtmtt95q NWrUsK+//tpVCG/SZU+cONEdiorxd4TRvn37YqnNSc1dsWJF+/zzz61fv34574xqEAEREAER EAEREAERyBMChVLw9O3b13k9ONBz6dKleQKmoFX6yCOPWIUKFSR4/m9iECaci8NBpWTUS8Xu v/9+d+Dr448/HnuO8OZwMCxenl69erlq7733Xqtatao78HX9+vXuGi/OsGHDJHhSAa97REAE REAEREAERCAfCRRKwZOPfApMUxI8GaeiWbNmNmDAAOPg2iFDhqQ0T4kKnqjKJXhSQq6bREAE REAEREAERCDfCaRd8PTv3z/uoLdt22YPPvhghs/vueceq1u3rrv23HPPuZ+wTZ8+3dhyFLQV K1bYnDlzkgJcrVo1GzNmjLsHrxJtn3POOZFtn3nmmTZ58uRM9T/11FO2cuXK2PVgnf7iww8/ bG+99Vame4N1nnrqqXbcccel7OG5+OKL7e67787Uxrhx44xDVrHOnTu7H7jDyo+dz0aMGBHb 4uXLvfnmmwZXPCDeBg0aZPv374/9u1WrVtazZ89M7QbL3Xbbbda0aVNXF237fn777bdGOf4M mwRPUo+yCouACIiACIiACIhAsSWQdsHDtiDsL3/5i+3evds6duxoV155pb3xxhs2a9Ys27t3 b4bJIe6CmAm2IoVjeEhkQLwLogIR8cknn7h7qZMtcK+++qqrM1HjgFLaoc7333/faPtvf/ub XXrppVarVi17/vnnbfHixVazZk3nbUCgjB071r777jvXRO/eve2ss86yhQsXxkQPdZ599tkZ BMIJJ5zgtlVt3Lgxdj1cJwv/smXLpiR4EBM9evSwQ4cOGZ4ib4yLoHuuEaRfunRpu+aaaxyv AwcOuPYQOpRjTI8++misXIcOHVxZYl9OPvlkJ/Yoh9iZOnVqbC7btWtn7777rj399NOuWYQb QurDDz+0CRMmuDmC2/XXX2+NGjWy77//3vWTuf39739vH330kYuh8XPp+3766ae7+44ePZrp s0TnN14MD3MW3NIWrq9hw4bWp08ft52OMdBHmQiIgAiIgAiIgAiIQMEkkHbB47HwzT4LcxbI LIZZ8LJdKcriJS0g2xbeHWzw4MG2Z8+emPBo3769bdiwwS1Qk7FgnTNnzrR//vOfdsstt1jz 5s1dDBHXfNwHC2AydvEnVrt2bZdNLijMiMMhUN4bguq0005zImH16tXuMgkKaANhNG3aNFcn f6YawwNTFuiIEzh7u+iii5xYCSZC8J6Tzz77zGbMmOE8T1Hb6XydBPYjInfu3OnYM5aRI0c6 YYTgg/uqVatc/zE8b7Nnz840R926dbPu3bsbWeiIlfniiy8i5zKZuUukbDhLG7E6N910U1zB c8UVV1inTp3cHOO9C2ZzS6Q9lREBERABERABERABEchfAmkXPD7jGNukWrZsabt27XJCgj/j WboEjxdRderUcd4evtmnn17w4C1hsc6fQUN48cPimkX9+eef78phN954o0uLHBQ8UfEhOYnh 8eKE/kZtAdyyZUtsG1rUVjE8LyQJCJbzdXJt1KhRLm025fjz7bffdqmzUxE8XpTSHvVheL4O Hz6cL29GVNIC3zDPZ5s2bZwXCo8VY5eJgAiIgAiIgAiIgAgUbAIFQvAQ54HgwaPDghxvQVaW bsET7ltwkUysT1TMCfdECRmf8jg/BI8XJ1mxTTQ2Jix4ourMieDJ7rWpXr2644mwCsZIZXdf dp9nJXiIN8OzF/RYZVefPhcBERABERABERABEUgvgbQLHrwbxIywlWnRokXOY4InpF69em5b k08DHMRUWAQPsR6c1cLYEHEFTfC0aNHCxdTgQWELG1ZYBE+i/Uzm9apSpYpde+21dvnll9vL L7+cKcmFBE8yNFVWBERABERABERABAoGgbQLHp+04O9//7uL3cEQCmwfivJIsJ2M+BbiY9as WeNEko/1KVWqlMumdskll7g4EQ6FxFjYE5vx0ksvRW7pijcVxJuw+PUHS/oYHoLqg0bdxOXQ N+JY/JY2vFbEyDzzzDO2du1aF5tDxjLK+1gjxkoGtddff91lKfv4448zxPD4cmzvatCggRsD P16gJPIY0cYNN9zgtqXNnTs3dgusSAbA9joEWeXKla1169YujioYwxNug3KIVObIx/AQZxQ2 uBPDQ+zQsmXL3MfwIAsb295IgsAcIXCJi2nSpEkshsdnjos3PmKf2rZt6+5PJhFFuL5gDA91 EkdGnFZUnRI8iTxtKiMCIiACIiACIiACBYtA2gUPi+t4RtwLIiNobJNiO5M3Fs7huBTSR7O4 D9q6devshRdeSIq+zwgXvIn++GQIwetkOBs4cGCm+pcvX57BSxWuk9gctkkhltgq5RMXMEbG 6u2hhx5y2/64Hq4zkUFRP5nawhYcD14T+uKNWJVwWnA+C5djWxn9izKEGnEvYaM892GMiwQK 3qLmPZExplImmbZ92ahnLpW2dY8IiIAIiIAIiIAIiEDeE0i74PFJC/J+qP9tgfNsypUrl2WT eGnwTMhEQAREQAREQAREQAREQAQKL4FiKXjiHRIanEYO1ZwyZUrhnVn1XAREQAREQAREQARE QAREwMXRY2QDTtZK/Pz/LdmbfPnLLrvM/TUdHp4SJUq4YP2s7NixY5nSS6c6Vt0nAiIgAiIg AiIgAiIgAiKQHgLFUvCkB7VaFQEREAEREAEREAEREAERyG8CEjz5TVztiYAIiIAIiIAIiIAI iIAI5BsBCZ58Q62GREAEREAEREAEREAEREAE8ptAoRQ8nO9yzjnn2KZNm9x5LkXZTjrpJOva tavxJ8aBmJx9I8sdApz9w/lIQTtw4IAtXrw4dokzh8qWLRvZ4OHDh23BggW50xnVIgIiIAIi IAIiIAIikOsECqXgGTp0qJH0YN68eTZ//vxch1KQKjzxxBPd4Z2cAXPaaafZ+PHj05LooSAx ya2+cJ4QbDkPaMeOHa7aChUquDOBli5dGjvfaeLEie5wVDJ7+DOYOHwVscTBp/5g2tzql+oR AREQAREQAREQARHIPQKFUvC0bdvWatSo4Rb+6cjylnv4E6+JA0pZjEvw/C8zDnDlMFU8LBs3 bkwcZKDk/fffb7/85S/t8ccfdwIHu+CCC2z06NH2zTffWK9evdy17t27W/ny5e2ll16y7du3 u2u8OMOGDZPgSYm8bhIBERABERABERCB/COQdsGT1VA5+NMvMH05FrmlSpVy//z444/dT9gu vvhiO+GEEzJc3rt3b9JbwX7xi1+4BTHGuTy0jZclqm22nOEZCNv7779vn332WexysE5/Ee8C XoawBevs27evnXHGGSkLntKlS1vt2rUztbFt2zY7dOiQu47Xgh+4s23Oj53PtmzZYt9++22G cgcPHjS41q1bN1YvWwyPHj0a+3fFihXd9sOwBcvhPUFQUBdt+37++OOPtnnzZiNFeNjwzgwY MMDee+89GzJkSFaPUdzPEhU8URVI8KSEXDeJgAiIgAiIgAiIQL4TSLvg4Vty7NNPP7Xvv//e xUqwsGcRzhYiPBtBY/tQ48aNnfAIb2lD5FSpUsXGjBljxGH4hTd1snCeO3eu+0Y+UTv77LON 7XNVq1a1ESNGuK1Lxx13nJ1++un2+uuv28KFC107p5xyitWrV89+//vf20cffWQ//fSTawKP zIsvvmjPP/98TNBQ56BBg2Jd4N9///vfbfXq1c5b4S1cJ+XY3paKhweBeOWVV9qNN97oRIU3 WP31r3+1devWOTHTqlUru/766+2rr75yMSx33323Ez6U+9Of/uTipXy5Ll26uDl79dVX7bbb brNPPvnElfvDH/5g77zzTmwu27VrZy1btrT9+/e7ZuGHABo7dqwTUcwRHpRrrrnG/v3vf9vu 3btdPynPAbGU41pQRFFPw4YNXTnanTx5cqJTmulZYmskcVGvvfaa+6xmzZp25513ZvDwhCtn /hFcN910kxvDuHHjUmpfN4mACIiACIiACIiACOQ9gbQLnt69e7tRsmhlMf7rX//aCRqEwpNP PhlJIF4MD16C6dOnu3sGDx4ci7egDWI1EFATJkxIimqwTsQN97du3dqaN29uS5YssZkzZ8a2 QSEGEEbeE4JXBq9PUJghysqUKRPrw/Dhw52gmjp1qhM9GJ6dSy+91O666y778MMPXZ3wSXVL G6KjT58+Lk4lKA4QE+XKlcsgorzn5IcffnDeMzhGbafzdSJEECQs+mGPEB05cqRt3brVPPdV q1bZtGnT3NjwcM2ePTvTHHXr1s0JnyNHjtgbb7xhTz31VORcJjV5CRRm2xrPmzdEJfMT3NIW rIb+X3311U5sSewkAFhFREAEREAEREAERCDNBNIueIIxOP37988gJOKxSZfg8SIq3E8f9xGv v0HBU716dZs0aVKmokHBE7VdKicxPF6cxOtf0GsUtVUsK8HDon/UqFFOyOSG4PGiNJ54zev3 JSqGJ9imF2apiOe87rvqFwEREAEREAEREAERyEygwAiee+65x+rXr++8IQSQh7cwBbuebsGD BwZPDTEm9DO4SGa7mvfw+D7jLeGH2CI+Z+ua39bG9ju2eOWH4CFeJ2r7FV4VHycTJXhOPfVU K1GihPO++HJeRHnBw1gRPRhbE9nWl4qHxwsJ2qPdYH358QJnJXjYukdKdL/VEh4yERABERAB ERABERCBgk2gQAgeFv+IAeJGVqxY4QLXs7J0C55w34KLZLaxhQWPLx/lufEpj/ND8ATFSTy+ iSYDiBI84TpzIniye21yI4Ynqo2sBI/37AW36GXXT30uAiIgAiIgAiIgAiKQXgJpFzwsnAkU J6HA2rVrXXB/o0aNrE2bNi4GhxiZsBUWwdOjRw+X2Y0FMvE5BU3wDBw40MjeBnufDa+wCJ5E +5nM60W8Vc+ePV0SCmKOwhkCJXiSoamyIiACIiACIiACIlAwCKRd8PgsbZs2bYplMiPb13nn neeCwokPCRoHcJI0gBgPUhIvX77cZdnCWKgilm6//Xb717/+Fct6VqtWLfviiy/cQZLUmaiR JezWW2+NBbUTTE/AfTgVNqKBLGhk7Vq/fr3b6oaR1plF86JFi5x4oz6SHXTs2NGVw3bt2uWy mLE96h//+Ic7V4hyjBHR58uRcABxSCpoxkHWuUQNnmRgu/zyy12mNW+wgh9eNbKi8TBcd911 Ls00WfIQoGRxCxvlyObGHNEfMrVFJZiAO8ki+NOLB7YCNm3a1J544gl75ZVX3BwxfsZKeup9 +/a5/jDGrCw3zuGhftr2abWps2TJkm6Oo872keBJ9IlTOREQAREQAREQAREoOATSLngI4o9n pJD2mct8Gb7ZJ1uZN4RE+PBRRBHZtoKGYAgu9hOZAoQMQiFoeGtYlIeN+BUW92FDyO3cuTN2 OVznypUrXQwQ59+Q2YwfDEGHOPJGRjgmi7GH60xkLNR/xRVXZCoaHA/94McbcUdRwiNcjoxm /uDOcAOIogYNGmRql/H4rX+MK/gcRM17ImNMpUwybfuyUc9cKm3rHhEQAREQAREQAREQgbwn kHbBExYreT9kc8HwBJ9nZRwWGvUtf370T22IgAiIgAiIgAiIgAiIgAjkDoFiKXg4iJPkAlkZ XpnstlXlzhSoFhEQAREQAREQAREQAREQgbwiUCwFT17BVL0iIAIiIAIiIAIiIAIiIAIFi4AE T8GaD/VGBERABERABERABERABEQgFwlI8OQiTFUlAiIgAiIgAiIgAiIgAiJQsAhI8BSs+VBv REAEREAEREAEREAEREAEcpFAoRQ8JByoX7++kdo4XjrkXGSU1qrIKDdmzBgj7TU2ffr0pM7g SWvnC0HjvXr1ip2z5Lv74Ycf2rhx42K9v/fee61q1aqRo+F8pxEjRhSCkaqLIiACIiACIiAC IlA8CRRKwTN06FC77LLLbN68eTZ//vwiPXPHHXec1a5d24YMGWJlypSx8ePHZzp3qEgDyMPB 9e7d251NxOGu69atcy1xHlCPHj3ceUgPPviguzZx4kR3KOqzzz4bO8upTp067qBZzgzq169f HvZSVYuACIiACIiACIiACOSEQKEUPBxmyeL/448/dj/FwR555BF36KgEz//O9i9/+Utr27at ExyzZs1K6RG4//77XT2PP/54zFPIoaqjR482DlPF+4Nx7bTTTrN3333X9u/f767x4gwbNkyC JyXyukkEREAEREAEREAE8o9A2gUPi8l49umnn9oLL7yQ4eNrr73WzjrrLHdt06ZNsW/cg4Vu vvlmO+mkkzLcxzf2yR5yWrZsWevYsaOrZ86cOdamTRvjWlTbp59+unXt2jXTUDZs2GDvvPNO 7HqwTn/x5Zdftg8++CDTvcE6OSiVbW2pCp5q1apZy5YtM7WxfPly27t3r7t+0UUXWYMGDQzu sPJj57PFixfbgQMHMpR7//333djg4m3BggV2+PDh2L/r1avnvHFhC5Zr0qSJIWKZI/ri+3n0 6FGjHH+GrVmzZjZgwAB77733nPcrFUtU8ETVLcGTCnHdIwIiIAIiIAIiIAL5TyDtgodvybFV q1a5b8tZcLOFi4UsMTqrV6/OQIWFbufOna1KlSqZtrQhCNq3b+8+p74vv/zS3UudGPWtXbs2 YcqlS5d2dVEn25maN2/uBBbbnvAAcDAp/y5fvrwr06pVK9fGDz/84Npgu9S+fftcORbzGHVS zht/5zPK7NmzJ3Y9XGfr1q2dlyEVwYOYoH9whYs3riFsaBtPGeKzXbt2bvsWYpLx8hnl1qxZ 47wgvhxc6CMHtPIQrVixwpVbuXKlY8C4EVBcY8xebJ544ol2/fXXuzLUzRxxP+0iUnkG6Cfl PU/a9XPp+84ccB/XaTMV41mif9SxY8cOVwVeNMYd9PCE66Ztxg8vxlDU48hSYat7REAEREAE REAERKCgEEi74PEdYOFYsmRJ5yUpV66cPf/884bnI8rixfCwACeoHxs8eHBMQBCrwcIWb8uE CROSYh+s84033rDZs2e7xS6LYhbtM2fOdAtftkEdOXLEnnjiCfcnxiK+Ro0aGYQZXpuGDRvG +nDjjTc64TB16tSYuDvzzDMNgYPn5J///Kerc8qUKSlvaaMfffr0sY8++sgt0L3dcsstVqpU qQwiyntODh065MThX//6V4vaTufrPHjwoL366qu2cOFCxx5RNnLkSCfiPHdE1rRp01yziFIY hueoW7du1r17dyeUEE8IrKi5TGryEiiMN6lu3bqxkogzBHI8wYPYYV5ImsG4iCOTiYAIiIAI iIAIiIAIFFwCaRc8/pt/gsBZ/LMAR0i88sorcamlS/B4EUXsCLEfGzdudP30gufHH390GdT4 M2gIB35YTLN9i2B3PEMY9SASgoInartUTmJ4vDj5+uuvbdu2bZm4IoLw1GBRW8XIise8BMv5 Ords2WKjRo2yk08+2SjHn3PnzjUynaUieLwopT3qw4jRwfOTHxYVw+PbxfPVqVMnO//8850o C4rH/Oib2hABERABERABERABEUieQIEQPGeffbbddddddsYZZ7hYmddeey3LkaRb8IQ7F1wk s0j/9ttvI/sfJWR8BrD8EDxenGQFN9HYmLDgiaozJ4Inu0cZTxmeMOJ7Pvnkk+yKJ/x5VoKn f//+zrMX9FglXLEKioAIiIAIiIAIiIAIpIVA2gUPsTrDhw83FrAzZsxwKYI5e4Z/EwsTjt2A UmERPHgp8HiwPQoRVNAEDwkUjj/+ePvqq69iiQEKi+BJtJ/JvFWnnHKKXXLJJS4ZArFKePSC JsGTDE2VFQEREAEREAEREIGCQSDtgscnLfBxH2DJzntQWARPuJ8FTfBEbZNLVEhkN0fMY156 eBLtZzKvWXZ1SvAkQ1NlRUAEREAEREAERKBgECgwgue7776zn376yVE54YQTnGckagvWPffc 47J/UYbtTMTQEFiPlShRwnmHCHbnwE5fH9m/KBdMKJAIflI5jx071gXaY/RxzJgxtn379gy3 01bVqlVt0qRJGbazMYann346lrkNbwoZyEhwQF0Y9d9www0ulocUzMSFUI4x/v73v4+Vwwt2 xx13uAxqjCOZzGSwaty4sfNcfP/997G+w+oPf/iDiyc6duyYS8ZA0gj6zb9JQ+3jaIIDDpcj XifsDaE83BFGJCMIppYmZmnQoEEuzoc5uu2224y025Qn/on++EM/480TY6I89wfHlMi8BsvQ dtOmTWPPHWftMMdRdUrwJEtX5UVABERABERABEQg/QTSLniyCkZn0enPiPGoKlWqZGw98saZ L/4wSH/Fr1lcAAAgAElEQVQNoYIICRoB+/4cmUSxs6Amviho9CdqMcwCnFTZYaNN2vYWrpP4 E5IZIKrYvue38DFGxuqNDGvErHA9XGci46F+Ui6HLTge+sGPN8RE1PlA4XKIFPoXZWzr82cX BT+nvE/uwLjYwugtat4TGWMqZZJp25eNeuZSaVv3iIAIiIAIiIAIiIAI5D2BtAueZA8DzQ0k LNgHDhyYZVV4ccg2JhMBERABERABERABERABESi8BIql4MFL0qhRoyxnDa8RW+pkIiACIiAC IiACIiACIiAChZdAsRQ8hXe61HMREAEREAEREAEREAEREIFkCEjwJENLZUVABERABERABERA BERABAoVAQmeQjVd6qwIiIAIiIAIiIAIiIAIiEAyBNIueDiUMysjYxeHk5LOmXTNUUYWNFIc e6tTp06msl988UWmjG/JgEqm7HnnnedSJpPh7NChQ8ncqrJFgEDlypVj2e7IuschplFGKnOy 2GFZlcsKCdkIg+9GIs9czZo1Y5kOP/3006SzFyYzRWQHJJW6tx07drgDhQuzEQMIQ6wojKeg zgVZKsuVK5flu1G9enUjzT2W6u/4E0880b1D3vj/hoOiszL/O54yef0OFdT5Ub9EQAREoDAR SLvg8QePHjx4MMNCiEUFi0H+87nvvvvc2SgsEBE9X331lR05csT9R8fPhg0bbMKECS4VNf9B Tp482aWO9mmPSXm8bt06e+qppzKkiM6riYo60DOv2lK9BY9Ar1697JprrnGpxletWmXTpk2L 7CRnHF1xxRXZlstqhJylFHw3xo8fb9llPrz33nvtV7/6lRPljz/+uC1dujTPILIw/N3vfufe S4wx79u3L8/ay4+KWWRz5lZRGU9+MEuljaiDi8P1kG3zkksuceevLVmyxGbOnJl0U6TN5zw0 0s7zf0jwEOx4lfHOIXrz4x1KekC6QQREQAREIBOBAiF4wgd6cqZNy5Yt7Te/+Y395z//cYIH CwsJfwAmB1UieMqXL+8OHcU4CHPPnj3u7/4/Ti+MwhQQV/xHx+GYXiTl5FlhMURfHn74YXvr rbcSqor/OH/++edC/+13QoMtBoUSWawFn82shFEiuJIV2ffff7877DavBQ99D76XRUHwcM4X C16MA3TD54AlMl8qkz2Bm2++2Vq3bm2vvfZa7HDpqLv8gcCpCh5f55NPPum+QEtE8HBPfr5D 2dNSCREQAREQgawIFAjBM2LECCdsOOgSa9Wqld16660WPvU+vKhjK0KLFi2sfv36ORI899xz j9WtW9d5gFauXJnjJ4ZvG0uUKOG8UMeOHUuovttuu80tnJ577rmEyqtQwSYgwfPf+Slqgocv R/zhx3xZwxcVstwnwJdAfPnFl1B8GRXPJHhyn71qFAEREIGiRiDtgocta2xn856Vrl27Wrt2 7dwZODNmzHD7t70FBc8555zj9lm//PLLblsBcTzhLW14fXbu3GlsaUOEIEAoF7bc+qbOby9i KxOGt2nz5s3ZPjN8692kSRP7xz/+YfPnz3fl2QrEt8dhS7TO8H2IQtoJG9v/YITBvX379i4u YcGCBTZ8+PBYcbZ8fPTRRxnKMTb4B/vJPQcOHIjdhyBlTsMWLMcWsMaNG9srr7zi2vb9ZH4R wywq0230CYbeGLv3Jkb1LV2Cx2/35NvurLaqZfXMh59jP75wnX4rUHj84XJRgsfzzK6fUWwT fTfiPfPBd8g/nzx3TzzxhNva5C34bvhr4bbDzzvlEnnmkymXyLMffId4d30/eYfwdnsLcue9 8u8m8S+8a0HzdfprMHrooYcylGF7JFuNYbd+/frYZ1WqVIn9/uD3A22x/SwYK8M2Y7wqURZ8 37Iqx73ZCR68cX5LJeXjPXPew+O3V8OR30nxLKt3KNF3I5G5VRkREAEREIGcE0i74AnGG7BF rU2bNm7RO3fu3EzB3l7wEJjN1oOXXnopJhCCKEhawH+CxPGQFGH58uUZ/jMOY/OBrzkNPvUB 5EOGDLEyZcpYIvEU/fr1MyaBseBdIr6B/v/2t791ge/BBQaLaGKY5s2bl+V4wuPjkNXu3bs7 b1NwjzsLEAQlwnL79u1u6xHeNbaRwILg+wcffNAtVFgQca8v17FjRxd/wnX6ydxQjuQRjz76 qNtOeO211zoBtXfv3pjnim/GWSQxx1OmTHGf0Q5zf+GFF7r5op94uu666y5XjhgYyqXTggkG LrroIrv66qtdrAzjjrJ0CZ6///3vLkkA8QU8T/E8hvEWa8wlzy8LU+bHf+HAexmsk4By5ody 48aNc+8axjwyn4sXL7YXXnjBXQsLHp6JK6+80tauXevKJRPTk+i7wRzdcssthhc4OEe8byRN YIHOVlgWps2bNzeeZ75k8SIx/G74OebLDMT5nXfe6S6Ft+g1a9bMunTp4rjxOwzjmU/13Uj0 mQ8v+i+44AIbPXq0e58QLt54juHCHK1Zs8YxYC75fcO7xvvu5zKYfAOe/F5AfAR5Tpw40T1v U6dOtdWrV8faCcY5/frXv3ZfTgUTDMCQ30s8A1FxN/ST31mUy267Z3aCJ5hgIPwcB/l6wcM2 zwYNGjguiCP/HIfnIt47lMy7kej8qpwIiIAIiEDOCBQYwdOjRw+76qqr7F//+pf7TwZREzYv eJ599ln3rSJb3rxHJFyW//ARRW3btnXJD6gzq2/rcoYx492JxlOwWLr88sttxYoV7sfHAjAp JHP4/PPPjQWat1Q9UXhu+vTp47xb27Zti9XHIubkk0/OIMxYsA0YMMA+++wzJ4SIQYoaj6+T eZo1a5bzEvHNeXAPfNSinwXj7NmzXR+CcVbdunVzCxz/TTtCKioeK5F5YtHNIieesZDH25eM BetkAV+jRg2XUANxEGXpEjyIbMThDTfcYOeff757rqJET7xnKd72s/B4oha0cGDxSx30wb/D wTpZYMMOgc8Pz1kyFu/dQAjxnr///vuuTv8ch+coaoEeVWdW73BWSQv8c4yXgGcZY1sW3ib+ 9PEhxAEh/BD5//znP5044ssMAvAxxFd2mcKC3BIVPNwTLhtvLvndSZwXFu+ZT0bw8Due39sY ogAvPeMcNWpUjt6h7AQPv2d9NkTapO0oERWM4YE9v4/oL89pMu9QkOebb74Z273Acw/HnMYa JfO+qKwIiIAIiMD/EigQgodvV1lAv/POO+4bXxYpURZchBw+fNh9U+u3Y8WbUBYaLP7YpoOn Jz9ET3aChy12bCVh6wvfwvMTXPjlleDBawODsG3cuDHWftRCkX7CL1jOCx6/YGExRzm+Uedb YLa1pSJ4fGIJ2qM+jKDlqK2I8ea8YcOGVrFixbjvOCIgmeQUPJ94vnjW+EFMNW3atMAKHjxP fuEdL1FHXgmeKOhBweM/T8T7GVVXvHcjXDbdggfhxXbPsPl3g+uIQ56tevXquXeGOJU5c+ak 9H9TbgsevLP8fPLJJ7Z169a4z3yigoeshf53PO8QX0hddtlleSp42OrM71nGgajk9x9t0nZ2 gocxZ5fsJt47FBQ8xIWG44/4/43/62QiIAIiIAL5RyDtgof/HFhM8s0v33z5zGogYKHE1gKf SCA7IYH3gG9NMe7x23Gy+4+LxVGFChVs06ZN2QqoRKYmq36yZQhvAf1kvHxzGIxTov68EjxZ fZvqxxVvoRged1jwRHHJieBJhHN+lQkv6hJhlE4PT0EWPDzzPN94P/h7dl9YhOe4sAieeEIz PB5+/zEmfi+wtY7fB3BJxrtDnbkteMKL+XjPPL+7+V3AWVNsB0QosBWOa8Ql+t9xbJULbn1L 9fdH1Dsfz8PD/weJeJ19neEsbdn9v5GI4PHb+fLrd5XaEQEREAERiCaQdsHjz+EJpwJl2wGp qRE8fttQdoIn1bTUqW4Vi/dQxesn5zz4eAECfIkjiDqYNL8ED3voiS9ACPntdIks5hl3qguW 7La0JbpQzM8XWoLnv6nd/Tfj8bZBsbWMd5cEF7t27XLTFN4mx0KYeBDiwRYtWpThS47s5jXe u8H2TEQDbdJ2uj08wecY7yfvGn/yxQ5fcNSqVcsI7GfrHxz43dCzZ0/nOeT3Ap5ovNiJWroE D/1j6xs/bGFEbLN1ixgtxuCTEoTfoVR/fxRmwRP1biQ6vyonAiIgAiKQMwIFRvAQbE3Auzf2 jvOfIu5/RBFb0/hP/YwzzjBieKL2/7NPm/3a7IMnToQYGIytUVntxfZ7y/kPmm1bqRp78LPq J7AZw+uvv55lhi+2TBFYfPbZZ2coRz8JKH7mmWeS6idbvNjWh7jxgdSMEVZsWWGBxTftfDPL QhTuwRieMA/KsRUHQepjeKKy0cEdTxbb0ZYtW+aqIWbo7rvvdgs/khswR3zz26lTJ/eNsI/h YRFYUIwU6fSNeUMcsqAnmJpnkTGEx8542P9/6aWX2r///W97+umn3aI2bMwz8+LLsZ0pWY+H rzMY30YdJJSIF8PDlh6C1IkjYdtVMGaOd4hnlOf4r3/9a2wrIXN51llnuZgg5hKP6B133GEI Dc6b8jFRLHxJ2MHWVN6nkiVLum1EPhbNB/kPHTrUXScBR7w4vKj5T/Td4PcH57gwR8SYeWMu yWQHa+YS8yKK6z5uLPxu+PsZD7GGfPuPwZ3nwntk4M6cwsPHffDMUx/PAH3h91yi70ai7wDc eW+pG+6IP/qCsCJmjffNb61KJIYnGFPJ70SeeTiR5MHH9gX7Rvv87kDEEb9EQoQwd7ixPRXu lOMdQgRSH56hoCX6biAibrzxRneQ7htvvOGeJ78l2nPnOeN3Jmzgwb/pY/h98x4e/39RVv9v 8H7wLPl3iOcdLxeW6LuR6NyqnAiIgAiIQM4JpF3wEGuQlbEg/8tf/uJSnBLX4Y3/YPjPM8oe eOCBDGUpQ1nuyUtDUGTVTxaaLApId5udkRErmLDAlyejUXhxkF1dfE7bfpEWLM+Cbffu3e4S 21P48UYqWX/oa/CecDnidcjUFWV8Y404Chvpf1l0YF4c+DL0J172s0TGmhdlWNz4AG4WViza 4Bk19kTHE6yTPlNncJGYzDjIfMdiNGh+ARiuhzTBiGlv4Xcj6jmmrI838/chbIKpy/31YLnw c+zn3Y89XGciY0703Yj3zIffIS94iAn0qdfpR/Dd8P2Kapv3md9T3hJ55imbaLlEmFCG94w6 Md4hft/5lPFR75ufd54FX47U1D5LW/A55llC+PA7KbvfC/GeY+6FH0bbCATECuzCvxMTfTeC dVJv1DMffDdgwv8j/A4L9zOZ/zfC71sq70ai86pyIiACIiACOSeQdsETTEud8+GoBhEQARFI jkCicUHJ1arSIiACIiACIiACBYWABE9BmQn1QwREIC0EJHjSgl2NioAIiIAIiEC+EZDgyTfU akgERKCgEWBrE/FybOP76aef3EG6bO9KNktaQRuX+iMCIiACIiACIvBfAhI8ehpEQASKLQGS NARjnxA9xPHwp0wEREAEREAERKBoEJDgKRrzqFGIgAiIgAiIgAiIgAiIgAhEEJDg0WMhAiIg AiIgAiIgAiIgAiJQZAlI8BTZqdXAREAEREAEREAEREAEREAEJHj0DIiACIiACIiACIiACIiA CBRZAhI8RXZqNTAREAEREAEREAEREAEREAEJHj0DIiACIiACIiACIiACIiACRZaABE+RnVoN TAREQAREQAREQAREQAREQIJHz4AIiIAIiIAIiIAIiIAIiECRJSDBU2SnVgMTAREQAREQAREQ AREQARGQ4NEzIAIiIAIiIAIiIAIiIAIiUGQJSPAU2anVwERABERABERABERABERABCR49AyI gAiIgAiIgAiIgAiIgAgUWQISPEV2ajUwERABERABERABERABERABCR49AyIgAiIgAiIgAiIg AiIgAkWWgARPkZ1aDUwEREAEREAEREAEREAERECCR8+ACIiACIiACIiACIiACIhAkSUgwVNk p1YDEwEREAEREAEREAEREAERkODRMyACIiACIiACIiACIiACIlBkCUjwFNmp1cBEQAREQARE QAREQAREQAQkePQMiIAIiIAIiIAIiIAIiIAIFFkCaRc83bp1iwt39+7d9sgjj6QN/tlnn22D Bg2KbH/lypXGj7cyZcrY8OHDM5VdvHixvfbaa+76BRdcYL17985UZubMmbZ169Y8HWe8tuEL 56DVrFnT+vXrF7s0duxYO3jwYNL969ixozVt2tTdl665pH3GM2vWrKT7rxtEQAREQAREQARE QAQKP4G0C55vvvnGLa7POusse/bZZ+3tt9+2xo0bW5s2bWzLli02atSotFE+5ZRT7JJLLomJ nr/85S+2d+9e69y5s1WuXNkQMy+88IJVr17d7rjjDqtatao99NBD9v3337s+9+jRw0qXLm0L Fy601atXW8mSJQ3gd955p/t88uTJrswPP/xgTzzxhBt7XlijRo2se/fuduzYMUNceRs4cKB9 +eWXNmPGDNu+fbu7fNFFF1nPnj2NsXuxuWPHDtfHZK1SpUrWvn37tM1ls2bNrEuXLvbBBx/Y hAkTku2+youACIiACIiACIiACBQBAmkXPP/zP/9jEydOtHPPPdemTp3qhEGVKlWsQ4cOxoI5 nYKH+S1fvrxNnz7dTfXgwYNtz5491r9/f2vevLktWbLECQi8J6NHjzbEW9++fe3bb7915YcO HWqXXXaZzZs3z+bPn++uIY4mTZrk/k7Zc845x4mRI0eO2D/+8Q+DR1bWtm1b+/jjj23z5s0J P37t2rWzPn36ZBKQCJoKFSrY+PHjXbs8DNddd50TZrNnz7aNGzcm3Ea8gvHaznHFCVSA9xC2 GzZskOBJgJeKiIAIiIAIiIAIiEBRJFDgBI8XC5988okTPuvXr7eTTjrJunbt6v5cvny51atX zwkFbOfOnbZmzZoMc3PzzTe7skFjy1hQTATrDJbbtGlTBk9LIoKnbNmyds011zjPzyuvvGJ/ //vf7fDhw9awYUOrWLGi4SGhn1GCZ9++fZHCKOphu/baa50QXLZsmS1dutRq1arltowdOHDA eZuC1qJFC8eI8eCNSkTweIGQm541L3i++OILW7dunR09etTmzJmTaXh4lho0aJDhOmUXLFjg 7vHGA4vADFq4Tj/22rVrGz945RBvzAn1yURABERABERABERABIoPgQIleIh1QTy89957GbZe eXHCgv+f//x/7Z0JtBTFuceLTUQQBFxAlIgvbIIILkEREDeCEUVRFkHFYMSDifEhcYOIC7Kp YDwSF4wLioAboIAGDYIbIugTEIUAURNAQDBsvgCyPX7lq3vq9u2emZ6Zy8y9/Osdji93qqur f1XVVf+u7/vqXSt4WLxWqFDBlClTxpqMsaCtVKmSYbGL4OGr/pYtW2xLkn/btm12B8XloyxE FGKJ31y+zZs3m6lTpxbsoPiCZ8qUKVZcIDL27t1rJk+eXCCiqlSpYnr06GHvz9+pH/dat25d od4U3OFJVfBQbufOnc2qVavsc3z55ZdW8GCydfzxx1sGzqeI+iG+8LvhWRAE7NwgIBGMLvH8 iBt2nzD7coJnzZo1hfKRn7ZxPOMMD1/wIDrZ8ULwIAwd95NOOskKuWrVqtnnItGWrVu3tgJl 5syZ9t7ku+yyy+xvLl/VqlWLlCnBE6eFlFcEREAEREAEREAESjeBvBI8S5YsMQgHzLV8XxPX BM4E6/PPP7eiomHDhoVMlnxxMnHiRIOYICEA2EFwpk1+Pnxn3ELe5Zs1a5YZPXq0vdbPO3/+ fCtkGjVqZAUCPkcrVqwo6CEIs169epmKFSva+82ZM8eKEESKS3EFT/ny5Q0+ONdee611/Ecs IAhdwhQQs61mzZqZMWPG2D93797d7mrAAN8chE779u1Nq1atCu1eUS4CaMaMGWbDhg0Fggeh 5PsTkY8dJLiQL07yTdowWcQ/CM5wR/TAM2giGOQeZUpIvjCern4yaYvTUsorAiIgAiIgAiIg AqWTQF4JHhbEOMuTCAYQTEGfE5zS8aVhUT9hwoRC4gQh4oIHuHLC8mFu5ptMkZfFPoIqzsI7 WFeisbVt29Z8+OGHViw48RVH8LCDhZAhuMDKlSvNE088YX2IgglfJ0RD48aN7U88O4LRBSJI 1YcnyqQtyD3OUAje+5BDDrH+QaREQiYVU0LKkOCJ0xrKKwIiIAIiIAIiIAIHHoG8EzwELYhK yRbeYYvksLL8fAQOcGIkWd6oBToiDdGxZ88eu5vDf0mpBC2IMmmjTEzxbr/9dlvm4MGDI0ND s7NE6OX77rvP3pegCIg25w8lwaOgBQfeq01PLAIiIAIiIAIiIAI/ETggBA+CANMwwjITDS1K 8Lh8u3btKtj1SWWnIZMobVu3brVhr5s2bWr9VdhZKleunDWJQ+zg7M/vTrwEOy55ccxHELk8 iCV2ywgSwLNI8HxsIwG63cMolnopiIAIiIAIiIAIiIAIlD4CB4TgwbyM82DCfHj8HR6XL8qH pzjCUt92222FQnI7Fcrfv/vuu0IHgIZ1PxqQvITEvvrqq22WYJhvCZ6PbWAGFw78qquuihSQ pW+I64lEQAREQAREQARE4MAmkHPBg8ioXr26jbhG8AD8O3Bm9xNRuTDX4mBPdjSIpDZu3Lgi +cqWLWtq1qxpD/TEf4fdDRKBENjt4BruQT7KokwihbHz4/JxbyKesfOCs/+gQYNsmSQitFEm 59QQOYwdGRctDpMydlnYkSGCG4moY/jvECmNXQWijOFrQyQ6EnmJMsbBn0SLcz5HNApR1h54 4AF7z6hEMIE+ffrYZ+JZXEABeHIfF72NZzrzzDNt4AMOGnWJ53r44YcNwRjwY8K/5rzzzrOH oQbzDR8+3EZ0C/o7JRs+TmxxHWUSVY9ds4EDB1pfI8eTaHNEV4MniXam3f/4xz/ac4dcPsQK B9O6fOzcsXPDLhg8nTkhZfA8RH/r1KmTFYS0C/eFk2ujZPXX7yIgAiIgAiIgAiIgAiWbQM4F D7sYfmKBHwx/jEBBfPBfl8Lyud/q1q1bKC9/p0xfPISVST4W5W6xj4nb0UcfHdrCfj4ysPCm jsHk15MFOAd9BhMMfDMr8iGEiLSWKCHkDj/8cCtCOLfIT9yHclw9o+7NPfzgDq7M4H0pP67Y oQyewwk8v0z8kpwg5e+HHXaY/eenoE8Uv1EWZQbzETUvLPn3535+xLyEcPWjCIiACIiACIiA CIhAqSCQc8HjHwZaKojqIURABERABERABERABERABPKGgARP3jSFKiICIiACIiACIiACIiAC IpBtAhI82Saq8kRABERABERABERABERABPKGgARP3jSFKiICIiACIiACIiACIiACIpBtAhI8 2Saq8kRABERABERABERABERABPKGQM4FTzBKG2SCEdXSoUV0NaKskRJFdEun7KhrgpHfgtHX gtcR1Y086UQ/y2a9g2UR5rlWrVoFfw5GVCvOe+d72USSIyKfCwGerfomiriXrXv45dC+tHOi sUH/5Fn35xhK9qxR0Qa5LizaYapREcPy+REMo6IN+vWlT7hw6cmew/89m+PNr2dY9MY49YqT l2iR9GESESfD3uuuPBe1MVHI/Tj3ztb7OBv3DCuDuYhn9aNhxrlXsM+X9Pex/zxhkThTZROn z6VaZi7z+c/DeyTbc0wun033FoF8IJBzwRM8h4cFFmfmcB4PZ+Gkk3hxcH4LEzCLCc7BmT59 elqLkTj3D54XNGLECBMWhc6dFzRkyBAzdOhQ880338S5TbHmhdcpp5xibrzxRhvSOnhmTrHe PM8L5/wlzguqXLmyGT16dFZr265dO8v866+/Nn/4wx+yWnZYYffcc49p2rSpefrpp+3YCEuc 7cT5Unw4SJSv2Cvr3YCzrODEWVMslty5VwjRp556ynz44Yf2bC36cevWrc1vfvMbs3HjxoIS uM4/94oxm8oZVf55UixGgmdpcY7YI488YmbPnh0bR/369c2tt95aUKZ/GHKcwnjfUU/OnmJx TT3987nilBU3L4cec4YXY8Md8BxWBmOIs7Roo2eeeSbubWLlT/V9HKvQmJndXPTkk0+aL774 IubVP2UPnt+Wbv9I6+bFcJE/hjkfjefxj2VI9Zap9rlUy8t1Pp7n/PPPt8dJ+Ief57peur8I lBYCORc8CIIHH3zQ1KtXzy4Y+G/Hjh0zGvDPPfecnXg5NPTss8+2/6ZNm1bsE6zrFI899pg9 bydK8CAiHn/8cZu9f//+eSV4/IU3/BCe+VjPXAxADnOlLxXHZJSPggfGqQij/d0WTZo0Mffe e689TNYtloL1jOLpv2sQJ07IcKjuXXfdVfAowTHs52OhPnLkSJuX+992220F7690BA/lHHfc cYXKXL9+fWysfDxy7076qGPEQmp/pK5du5pu3bolFDxuDOXT+7g42fhzUbqCJ1v9ozifM27Z YWM4bhnkT6XPpVNurq7xx3C2P6rl6pl0XxHIFwJ5J3jmzJljFyFMnAsXLjTDhg2LzcqfZJYv X26uueYas3PnzhIpePjaM2rUKPvVh92gpUuXxuYR54LgQtHdf/jw4RkJs0aNGpkBAwbYL3ks EktiKk7Bw84mOynsWqRr+hKHKTsg7DRi9uQfABssIx8Ez3XXXWfNOyZPnmyrlyvBw04MHyow B/QFDzvRN998s+HdlUjwcA1f+sPGcLYFz6OPPmoaNmxo7rjjDlNSBU/Pnj3NL3/5S/P+++9b bqkkdvXatGlTaN5I9gEqlXLTzZOu4OHZeVe6Pp+N/pHuMxTHdekKHsbQww8/bNxB0xI8xdE6 KlMESieBvBM8ib66smB2piSuOebPn29efPHFQq0TnGTCbMZZ8A0cONBg9uDSa6+9ZidXl7C9 ZiFDwkSOhWjfvn2tmc9bb71l/4WlqAmWlzxfcFjcHnvssfbS1atX20XnxIkTzSeffFKkOAQH i4tyIwAAACAASURBVCy3Y5XOV0IWAJ06dYrswXyxduWGfRkP8zWKKhMzPd+EyN3Un+CCCzDE 7WmnnRZZPwTft99+a0Uw+WgjuHXv3t1eg3nMnXfeWej6sDKxo0c0+iksH/fini7RB+gLmKdg ksMClwV4MF+6r4j27dsb/pH8MgcPHmz7J/3pH//4h21DuPt93u/H5ON3TNVIYWODv7vn4f8P 9vngMyQSPJiHMYaCyR8bjBXGDG1E3+Debjwmuzfl8rGCPvnGG2+Yl156yd4qF4IH3xgEKe0e tvhkR5cFapgPj2sjBBNt6o/hU0891fZjyq5Tp459vqDJkt8/HGvH0xfHwa/DlIk4c4tDd22w z4f1Y/eec23k6pmozydafAbH0ObNm61fC/2afhuW4n7tpu8jFNatWxe6W8ffaaOod7cbb35d eNfAwKWweYPf/DL9eaNu3bqmXLlyZs2aNXb+SDRvuHvQ59u2bWv++te/FvT5sD5HPsZ62HgL 8vTf8X5bIowxe3TJz+fe8bQR85M/1t07yV3nygze1727g3+PK3jgTj2Zi26//faCj2/BPue/ k/x7u3enX4/gvOHz5Dc3ZwbnDX9sUJ7LFzY2XJn+fRONobh9PnTg6I8iIAKhBEqE4OFl169f P9OsWTMzbty4gpcd5kXNmzc3M2fONBMmTDDY8ZOvcePGdpLBH4L8CxYsKPLwfN1u0KCBzUe6 4oor7PWvvPJKwVdaf5LB7pzJ0i0AEVluARYsPErwsFhmAuQ+Tkgx4eAczQIen5lg8uvJ86Rj 6+zMcbieCc3xZDGNb8Z7771nF/EsLC+99FI7qfDCZ2EWtsNGPnxZqC/cSa7MlStXmieeeKLI bhDCDXPF3bt3F/nC7XZO8N1688037YKyd+/etg4PPfSQrQeLBRaEtBPtxm/s2pH/+uuvN0uW LLF5qRN5zj33XNvumPaQWPjhz7Fs2TL7TJTH5IL/xty5c63fGIl7c73/7CzaeT7YtGjRwnz2 2Wf2yytlsBjINGHiyKK2c+fOhXx4gsI9bDJ0/QO/H56dxQ99KTg2/Do6EUJ7JPPNiRI88Lzp pptsWyAi3cIbRrQTi0QWbLQ7zMgLe+7NmDzjjDOKjLcgRxYWvKD+9re/2edyZl5usURfokz+ y7NwT9qbBUq2Tdr8usX52s5Yp23gxJdp+o4bw6effrrta64f33DDDfY2vuCBJ32DfkZfJ1Gm 44nZC+8P8l1wwQWmZs2a9oMDvkxRPjK0D2WQ2Hnl2k8//dSOH5dSNRH0uSQSPMEx5MY6ZolR Poz0MZ6Hfk2fTpQ6dOhgzflg4c8RXOPex+PHj7f9xH2wcrsn/rzBu4sySPCk3ehTbn7x29K9 r8nnl8m7gv9NYofNvWd5ToI5JDJXZIwjdmg/+rPLG+xzvH+DY4O25B3H8/htSZnMc8xZvOv4 nfcj7U6dmC8RB64vjh071r47+TDBe4QFPSafztePOZZnxxeO3Uo3bwStKMiHjx39MLirGUfw 0A+YI1w96avufeP3OeZj5gI+JvrzhhsbvCvcGKLM4LzBdb169bLvL94pPCNtH5w3aIsrr7zS zin0Y1iFzRv++8utQaLGm+vbEjyZzqa6XgSiCZQIwePvcrBgcBMNLxkmMOcky0TDIqJPnz6m YsWKZtKkSVYMuQnMx8DXT15u5CPxpYyFpy9ksi143P33tw8PAubnP/+55cbC6dprr7WcWAAg dnyeTN44HzPRsnD44IMPivQeuFxyySV2sTRjxgy7+GfXijL5Ly/3MPEW1Q0ph8mD6ENMNHyl ZcGAEzoTtG9y5SYEBA7ilPv45kXUGwfwli1bptyW/qI/0U5UcZq0hS3QUxE8jmlQZCcz9UjV VC0qnz82+Aru2oi2rF27diGfOb+/s5iizzFGg23k9w92Ac855xybl90dfwy7NtqxY4ehPHZI 2IHxfebyQfA4gX7yySfber777rsFCzVMr1igwy2qH8PD9Tk+JKxYscIi4j2HYCQ5H0C4d+nS xX4AcmMj7EMP17DYZfFIYtfyxBNPtAtxFmguZVvwuHKLw4eH5yFQA4vrl19+ucji2h8biGE+ LPDhiX7Fv6j3sXvXuPnFz+eL0kSL1DgmbfR5xA6mkQh83ocu+eONRTbzVXBsMJnjT8bHIN6b LtEn2Pnw33MuL2NozJgxNj87KM6X1plmunx+/4h61yC0/T7HfIDYC/NlTVXwMIb42MjHTldP f1fTved478MrbN4IG0ME+HBWBX5burw8B/MaO7ZufnEfPf1x6XzRwuYN5y/IeHTvr6jx5tpK gid6sapfRCBTAiVO8PCFBvMAP2Gq4JuDJZtkeNn16NHDLqjcS41J82c/+1nKi+R0dnhcnfe3 4HH3RVQw2bPYYmHAF3gmRz+l6jzPxIg4YjJlAsYsjzIzCbF9wgknmIsvvtjuMCFW33nnnSL9 OzghsNDF9IJEfp5HgmdeUmfebAoehHGw3dlN/PLLL227hC0UMYE56qij7A4NfnYuMTZZuDM2 nakO49tPwcUSCyv6NQue119/3d4314KHBTWLMRamfFigb4YJdxcAI2rXyC3A2HFk4R1MiE3C +JNSWSzBlTGGaR4fj3jn8e4rqYKHnR3+YSbE4tP1OZ9Tso8BuRY8fHyjz/MciGKiigb7vN8/ 3LMFhYQTJ+zW8y4OJtgwLkkuLztszsSY9yjvU3xnndiKI3iYl90Oin9v5uZkYzjMcoGPdHxY Y5eNjwJhJuRO8Lj7Bfsxf082hty84ed1QsafX/i458ZwULgnEjyMUf8dx32Yp1KZ34o0ov4g AiKQNoESJ3iIHJbMjyWZ4AlbgMVdJO8vwcOOCYsUwt4iLNI9u4LFJV9BzzrrLCt0osRJqoKH HseijsUSX/ESiSjyYh7BV2nMHsImLvwbMD1gAcaETx3DUiqLurhtqR2e8LDU8E9lh8f/8hnW ZlFfxoN5WVwgolnEsDOL30BYf8+FD49f12Qmbf7HgLfffjt08Rnsx8kETypRzdIZG2EL2rB2 T+W9kGxXMWxBmWjm4gMILFl8swgPJhbo+COxmH711VdDxQ7X5LPg4d2J0EHwsJvOh54wiwS/ fzA2+GCAkEDgJxInUXzDBE9Y3jiCJxjpMFHbJtvhod0xpaMPYErn+1H55bo+BzPEXNgHhji7 iqnmjSN44oSrT2UMp73a04UicIATyDvBw8sbUw++7vBiZwcmynGfSYB/fK3kZetSSRM87tBJ 7KmD9uzZCFrAjgl+AK1atbJmEPAh8WUc8xjYuUPOUlnYBLnjmxRlJufaJJGpGOY4fHXG2Rcx hJmJM0/keiZ25wyeyoSwPwQPi3EmV8wrfPORdN8nJdmkzRc8vnmiM8FKRfBg6uH8BeCJCVjU OVz5LHjCzD1TEe5xBE82x0YuBQ+7AfQXxnZYwJZEY50PLPhRMF/w9T9R9Mp8ETyY6zrTXcYG vjSYsGFtQJ/HhDeqzwf7Bx/BGC8IQTgyb0S1Jbvw3It7BsWRv8OTbcETNr+EzQfBc3iY+4Nr gKj3qi+yX3jhBeuH5ExI8YOib4WJGOZcRCMJ9s5MrrgFD++5RPNGKvNbunOMrhOBA51AzgUP L1xsx7H75+sW/2ULm5e4cypNNWgBuyBc6zuK8tIL+pMEHYn5Hed1XoCLFi2y98VJNswx2zmD Y+PLROt/jfMdyLGZxpTFOVH7Hc05yVJXHD8pE9HAfYNhbd2z81+cP9M5pDQYtMDVBadS6ulM I3znecwTcIgOW0ikE7SACZuXORNLMBBCMGgB9fMDOzg/BecTwU4R5jhB52T3XNkOWuDKdQ7k 9A3sssOcvdN9oYQJHvoxi3scpml3Fi48ezLHbNos1aAFjDN2D8K+KrPrhmMvX1vJ5ztRxw1a 4IJ04BztO+47XryIfv/73xdxng/yZJywSCSoRaJzeGCFjx7vBD8KGO8adhmdYzaLMnYJWIz6 Tv5Bx2xXDz5A0AYuwADPE3SixgfOObpH9QffyZ5xT39ndyvomJ1q0IJ0xwbXsUtLcAAcvenX hEYPBvRg/NKneA+FvRcoh7qShzJgGRbQw3cg5x1D2Gl2rsMitcEI1s6fwmfJRxuu57pk70Q/ aEHY2Mh20AK/nv4YJniHH9CDsU30T+Yc2EeFo6fPMz6CQS2CH3biBi1AaGFaxfsY01LGRTCl ssMTN2iBP4ZdYBoYuPvT92h3fw0QNo78PhfmZ+XmjbhBC2gn+iRWHPjOhaVUdnjiBi1IdQyn O8foOhE40AnkXPDwhSaYgqFA3e/JwlKHhcmNCvccDC/KBM2XpWDY32CZTJ4IIxceOVnI0kSh d/3niapnNjpoqmGpg+Fvw8I9u/rEDUud6DnihqV2ZSUKaZvNsNR+3aNCSMdtJwQDfRCTLXww onbWgiGkuQ+mHsFnd4s6F3qXfKmEpSZfquMtGFI3Tlhqn08wpC2/sfhj8euHAw9j6kK785sf mjkYRtmVyeIpmPzQu4nyhdXTRbjzy/TD39I/MFOKMsHxr/PHED4ofojgYJkubLm7PhiWOtjf Ux0b7O7SrsHw+9zHL5O+xC6MCzGeLAx8otC7fojgRPVMNKYIIU37cJ9kKdm84a7PVljqYH38 MRwMIQ3jYKj84PV+n+c3F/o/07DU/n0SHSfAGPJDMzueYaGug3UPC0sdfB7/mdz7jf8mG0N+ /6QfP/vss/YDngufnW5YavcMrsyw/uUfkUA9/fD7/tiIE5Y6zhhO1uf1uwiIQFECORc88+bN U7uIQKkg4A7zTPQwzjk3nShYicrN5eGKpaLx9BAiIAIiIAIiIAKlloAET6ltWj3Y/ibgwpBG 3de3l5fg2d+to/uJgAiIgAiIgAgcqAQkeA7UltdzZ50A5hRE1YtKe/fuLQgOgd/AjTfeaE0h ME9id+irr76y/hGcZ5FqwnyK8zM4NI/DBTnBHt+msJCnqZapfCIgAiIgAiIgAiJQmghI8JSm 1tSzlCgCRx55pI1A6BLmbpwjEScRKIMofPzXJecXFKcc5RUBERABERABERCB0kpAgqe0tqye SwREQAREQAREQAREQAREwEa7JIUd4p0MT5l9Jjp7k2WK+r1ly5b2JwUtSJegrhMBERABERAB ERABERABEUhGIOeCh/MdXEL8JDtTIdkDpfM7IYGXL19uz95REgEREAEREAEREAEREAERKD0E ci54iMnPeRTVqlUzjzzySJGDN4sbNSdWd+7c2XCQnXabipu2yhcBERABERABERABERCB/Usg 54IHkeHC+eZC8MQ5vwRxVrlyZRtNa8OGDfu3pXQ3ERABERABERABERABERCB2ATySvBMmjTJ LFiwwHz//fdm7dq1RR6mfv365qCDDir0902bNhUxRWvUqJEN0esnv8wKFSqYBg0a2J/79etn T2ceP368Wbp0qY2StX79+lCQuRRmsVtWF4iACIiACIiACIiACIiACORH0AInJLZs2WLPMfno o4/M888/b7Zu3WqbqEyZMqZmzZpm6NChNvzuzp077d/ZbVm0aJEZM2aM4Vp+I9+oUaPM9u3b za5du2y+KlWq2DI5n4R8NWrUMEOGDLG/kd+dX7Jjxw4zbdo0M3369NCuMWDAAHveydixY83c uXPVfURABERABERABERABERABPKcQF7t8GDSVq9ePdOxY0cza9YsewgjibNKHn/8cStwBg0a ZL744gv7965du5pu3brZEHP333+/OeKII2w+Uv/+/QsCIPz617+2Zbp8fpvEMWnL87ZU9URA BERABERABERABERABAIE8k7wzJkzx1x44YVWyCxcuNAMGzZMgkfdVgREQAREQAREQAREQARE IC0CeSd4Zs+ebQVP7969zeLFi81dd90lwZNW0+oiERABERABERABERABERABCZ7HHjNHHnmk GTFiRNKw1H379jW1atUykydPtsEVlERABERABERABERABERABPKbgASPJ3iIANe8eXOzZMkS M3PmzCItpyht+d2ZVTsREAEREAEREAEREAERCBLIK8HDrsmqVats4ALEx5QpU2w0NCK3cUBo jx49rJkbIaZJhJYmgtsrr7xiPvnkE1OpUiWbr2fPnjZAARHZSCeccILZtm2bef31120+P7mD R7kvEds2b95spk6dav2HgokDUqtWrWp/I7+SCIiACIiACIiACIiACIhAfhPIC8HTqVMnGyra T8uXLzcffPBBob916dLFhphOlg/BEzyvh8huHHIaljp06GBq165tf/rss89krpbffVa1EwER EAEREAEREAEREIGUCeSF4Em5tsooAiIgAiIgAiIgAiIgAiIgAjEISPDEgKWsIiACIiACIiAC IiACIiACJYuABE/Jai/VVgREQAREQAREQAREQAREIAYBCZ4YsJRVBERABERABERABERABESg ZBHImeBp1apVySKl2oqACIiACIiACIiACIiACJRYAnPmzIld9zJ796XYV/3/BRI86ZLTdSIg AiIgAiIgAiIgAiIgAnEJ7HfBc8YZZ8Sto/KLgAiIgAiIgAiIgAiIgAiIQFoEPvroo9jXZbTD I8ETm7cuEAEREAEREAEREAEREAERSJOABE+a4HSZCIiACIiACIiACIhAySFw6KGHmtatW5uj jz7aVvrbb7+1h91v3bq15DxEGjXdXbG82XpaA/Of+nXMzlrVbQkV1m40hyxfbQ6dv8yU27Er 5VIPOugg07BhQ1OvXj1zxBFH2OvWr19vvv76a/P3v//d/PjjjymX5Wfs2LGj/Z/Tpk1L6/pk F0nwJCOk30VABERABERABERABLJOoEOHDoYFtJ927txp3nzzzazfiwKvuuoquzhftGiRLb9Z s2bm8MMPN+PGjSuW++VDoVtPPM5sPO8ks/fgiqHVKbN9h6n+t4Xm0M+/SVpdhOI555xjBSJi cfXq1faaOnXqWBGJoHznnXfsb6mmmjVrmu+//974gsf9LdUyUsknwZMKJeURAREQAREQAREQ ARHIGgF2Cdq0aWPeeOONQmX+6le/Mu+//77dLchmYkFO2c8991zBLgRi6+qrr7Z1iLNIz2a9 irMsxM6/O/4ipVvUmDYvoehx/ObNm1cgGIMFIyDZQZsyZUpSnpUqVTJ9b7jBVD+mtrlu3lTT /bimtriJ3yw2T/7iIrNx1Rrz2KOPmm3btqVU/2SZ9rvgOf3005PVSb+LgAiIgAiIgAiIgAiU MgKcieIC/TZq1MiKGhbQfiIPYmjp0qUFf54/f37GJCiXRTuLcT9dcskldnEerEfGN8xxAbsr VjDf/vbCyJ2dYPXY6Tn6z9P3mbftLFJzhGG3bt2s0Fm4cGHCJzvppJPsztmLL74Yad6G2Ln5 tlvMt1UrmAf/vcT8757dpme1erbcFzZ/bSqXLWf+UKOxOXrLTjNqxANZET1z586N3SIZBS2Q 4InNWxeIgAiIgAiIgAiIQIkn8Nvf/tZs2LDB7Nixwz4L/jOnnXaaqVq1qv3fW7ZsMYgbdglI FStWtCZnf/7znzN+9gNN8Gxu08RsbvPTrklUalL1cNOk2pHmpZVf2izV3l+8798XRbIjYvDZ CYrFqHIRkfj0RImja665xpRtUs/cvfGn+5J8weP+dnfVRmbP0n+aZ599NuP2L1GCp127dsad 41OuXDlTu3Ztc8stt5jjjjvOYAe6fft2g+3nM888Y//bsmVLO2j27Nlj3nvvPfPpp5/GBla2 bFlz0003GeJ3f/zxxwZV2rt3b1vOrl27zNixY+19jz32WNO1a1c7iLFpnDx5cux76QIREAER EAEREAERKK0EEDysj9hRceZkCCC3m8OuD34gbneAHZlLL700Y8GDaGLXASd7zOX8hFmd8+uh LqUlrendviBAQdgzIXZeObOLuWvxuwWCh0AGtZ9+q0j2uLtgUeKSgvHPGTp0qPndmnnmHz/+ UHCv86vUtv//2z+sKfjbfx1UxYyu/QszYMAA6+eTSSpRgsd/0Msuu8xs2rTJzJw509x3330W 3n/+8x9z8cUXmx9++MFgq4cYGjJkiEG03HrrrWbkyJFWnMRJnTt3Ng0aNDCzZs2ygodG/+67 76wAQkxVr17dTJ061d4LBcqgQRDx1WLZsmVxbqW8IiACIiACIiACIlBqCfiChx0DfGqefPLJ Qj411113nfWpYYcgW4KHtRuO9YkSH6tT3cEoCQ30rwHdCqpZtfxPgSG27PopglqY2HGZ6w59 scjj0SbTp09P6pfjLnT+Pn/5y1+KlMWauu9NvzeXrS4sPKOYvlqntXns4UcyXlPvd8HDrkum 6ZhjjrGRNoYPH25tQflK4MLgde/e3e6wIDwwn3PbYGyfIViWLFlib3/wwQebO+64w4wZM8aW QWOOGDGikCBim7VWrVpWMK1bt84AC2Hz9NNPW6WJSkXcjBo1ytx7771m4MCBtmzOGjrqqKNK 1cDJtM10vQiIgAiIgAiIwIFN4He/+52ZNGmSXTizC4AICVrEsKPDOg6fGhbOfHgePXp0RuD8 MsMKiqoLeVljXnnllda0jvUiH9tfeOEF+5GdNeIVV1xh8/AbH7oRTY0bN7bRzLJhipfug68c 2L3g0j+1aG9OqHqEufzDl82xh1QtsrPj3+PYIROL3LJPnz42XHSqgR1oN6KuscYOpubNm5u2 PS43t2xenNKjPVCtqXlv/CtmwYIFKeWPyoQGiJsy8uHJhuC5/vrr7Q7L559/XqjulE0He+CB B0zTpk0NW6MTJ/7UcHRIxI4PjK8LCKQyZcqY559/3qxcubKgPBrroosuso3FrpETPIMGDTIP Pvig7eiVK1c2/fv3t/djB+mee+6x15988smmfv36dktWSQREQAREQAREQAREwBhf8LBGw5yM HR4/sbjGDQEzt+ISPJjNkdz5O4kEz3nnnWeqVatmXn31VXsNu1Ks/15++WXDjtW7775rFi9e bD+O83z8bz7C51rwrL32lwUmbezwvHpmV7N33/8heHwzNp89Jm21nppRpKsmE4zBCxLxtDs8 /32TuTzVHZ5j2phHH3o44x2eEid4DjnkEIPoYHfGRfoA9AUXXGCaNGliHt0Xwg4xwkACOOEH Sb169bJmbkEzM/xzdu/eXeTrASZzNAq+QKh6Oi9x2jt16mTYotu4caOpUaOG3eF56KGHzN13 323uvPNOey92lrATxdRNSQREQAREQAREQAREoLDgQXTwMXrVqlV2N4ddEr7+Y8WDdQ7rruIS PKwPSS4yW6IFOnXCT/y1114zK1assH7hiBvWh0Quw7ebs2f4aF6+fHn7O+vHXAuezW2bmC1t Tizodk70PPnV/xT47AT7ZNX3PzfV3ss8aAEC6auvvooMWsBmwjWr55h1uxK7mRxV/mDzbJ1W BhGcaSpxgofdEzofZmUuXXjhhXZbkQGCeCHRAZ0PDzs4ODzdf//9hUzWTjnlFHPqqafajkun jwpqgMhxOzw04tq1a614OvPMM62wYfuSHR7qhMMbIojfnflcpo2k60VABERABERABESgpBPw d3h4FgTN+eefbwMVkNhxefvttwtMp/JB8FCvFi1a2I/Zxx9/vK0b1kNr1qyxAuess86y61IC aWF5hHUPFkS5FjyEpV5z40Vmb8XCB7tG9aEyO340tR+ZGhmWGnGKlVQqYanhMWHChMiw1Dfs 2wkrW/8Yc9t3ic3URhzZ3PywaLl59qmnMu76+13wYAe5fPnytCvOViKiZsaMn7bcCGWI7w0i hKhpJMzdCDJA58SfhohuROXwHxb/G3Z3EEEIHsTRn/70p9AoEL7gYRuT3SJEFP+e2tcIHIpE lLbLL7/c1o26vPTSS2k/oy4UAREQAREQAREQgdJGAMGDuVqq0dCwsGnbtm1OfXjYrfnXv/5l P5iz7sN94uyzzzbDhg0zJ554YoF7RYUKFUyXLl1sPj5451rw0Hd+aFbPbLwoNd/56lM/NlUW fR3Z5ZxfDv7snMcTlghfjZmi89OKKoxNiTsH32M+K7fNPPHvZfYcHj9xDs/1NRqYFrsrmcF3 3pXxOTy4mWClFTdl5MODcz+OT0oiIAIiIAIiIAIiIAIHDgECEKSTWEBnkrgvZ/xEWd4QZIAP 6GH34UM9rhLuNwQQUd/4YD548GC7o4MPDwnfbz6yc6Dqueeem7FQy+SZ3bX/e9LxZlP7FpE7 PezsHPbWZ6bywq+S3o4gE+zIbd682QaW4B+Jv/MPXyd26NzfExVYt25d0+s315qKNaubt7et NYu2b7LZmx18mDm/Ui2z4/uNZuxfnrJiM9NEAAXcYeKmjAQPYe2cc3/cGyu/CIiACIiACIiA CIiACMQhgOBJJSx1mODBd7xHjx7WTA2/Io4+GT9+vDVpY9ejZ8+eVixh4YM/EjsJ5O3bt689 xsQlLIK4Jhdpz8EHmR9aNjDb9pmR7axV3VaBAAWVlq8yVT5eZspu/ylcdSqJw2ARiJj34dZB IjIyPjsISneobCplkQcB1ey0U8zP6hxjL/nn6lVm0fxPrXDKViK4GKaHcVNGgoebuQOM4t5Y +UVABERABERABERABERABEQgFQKI0nTPV8pY8BCyD58ZJREQAREQAREQAREQAREQAREoDgLp 7u5Ql4wFD4VwWKc7I6c4HlBlioAIiIAIiIAIiIAIiIAIHJgEOGvz5ptvTvvhsyJ4uPvIkSMl etJuBl0oAiIgAiIgAiIgAiIgAiIQJIDY6d+/f0ZgsiZ4qMXs2bPtwZ3ENVcSAREQAREQAREQ AREQAREQgXQI4LPTr18/065du3QuL3RNVgWPKxnBw79NmzbZf0oiIAIiIAIiIAIiIAIiIAIi kIjAYYcdZviH2OFftlKxCJ5sVU7liIAIiIAIiIAIiIAIiIAIiEAmBCR4MqGna0VABERABERA BERABERABPKagARPXjePKicCIiACIiACIiACIiACIpAJAQmeTOjpWhEQAREQAREQAREQkZlu NAAAAsFJREFUAREQgbwmIMGT182jyomACIiACIiACIiACIiACGRCQIInE3q6VgREQAREQARE QAREQAREIK8JSPDkdfOociIgAiIgAiIgAiIgAiIgApkQkODJhJ6uFQEREAEREAEREAEREAER yGsCEjx53TyqnAiIgAiIgAiIgAiIgAiIQCYEJHgyoadrRUAEREAEREAEREAEREAE8pqABE9e N48qJwIiIAIiIAIiIAIiIAIikAkBCZ5M6OlaERABERABERABERABERCBvCYgwZPXzaPKiYAI iIAIiIAIiIAIiIAIZEJAgicTerpWBERABERABERABERABEQgrwlI8OR186hyIiACIiACIiAC IiACIiACmRCQ4MmEnq4VAREQAREQAREQAREQARHIawISPHndPKqcCIiACIiACIiACIiACIhA JgQkeDKhp2tFQAREQAREQAREQAREQATymoAET143jyonAiIgAiIgAiIgAiIgAiKQCQEJnkzo 6VoREAEREAEREAEREAEREIG8JiDBk9fNo8qJgAiIgAiIgAiIgAiIgAhkQkCCJxN6ulYEREAE REAEREAEREAERCCvCUjw5HXzqHIiIAIiIAIiIAIiIAIiIAKZEJDgyYSerhUBERABERABERAB ERABEchrAhI8ed08qpwIiIAIiIAIiIAIiIAIiEAmBCR4MqGna0VABERABERABERABERABPKa gARPXjePKicCIiACIiACIiACIiACIpAJAQmeTOjpWhEQAREQAREQAREQAREQgbwmIMGT182j yomACIiACIiACIiACIiACGRCQIInE3q6VgREQAREQAREQAREQAREIK8JSPDkdfOociIgAiIg AiIgAiIgAiIgApkQkODJhJ6uFQEREAEREAEREAEREAERyGsCEjx53TyqnAiIgAiIgAiIgAiI gAiIQCYE/g9slbL8P28gFwAAAABJRU5ErkJggg== --g54odslnzqtx3xjv-- --bg3pyh3y7e7u6wik Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmM9oCsACgkQCLYqJMpB Hmlg/BAAsYBR0Ga1chTPawtgvntUEWWOqnlp4p6/VcYABfpqSyqyTv/4XR6NRoUY Swfo76c4gCzJ4FP/TdfR6vPvwNU6S1fQnvuRGri4qTkie16Cw3SGfapcpQK+rJlz arCZKJ86xrddhbXnIdN6WMjDdzZwYMshPNfVKNJHaG8/A/Z7C/S4+uCR4wCoLoXM yMgn4kq7yYClRkSEXMPUNQYICoMOFOPBO8lEO19S5TkL/huL7IeuaLwlMOzFkRd2 aVIzYPI/Ww0ibfzPNqu7L1aSPoTTeboBgOpgIXL1awJoKX123C5+nZzoOtjXosso UnZvDauHyX0KzSuZ3w2XhYe3BQhA8PwdH7JQN1VCc+fq64JTGGYznugRT65rTQD4 o6OolnGkw5dMxVC5nQmBAWuMGtyX1NpGpQWrT+pYWl31U/oW02/3b4s39fyNnYeW BXZzfIGN4po/lS9zcgqLnDx7A8Cccv0G+xUEA3YH3KE+YKeDJGnUW4A2OlOdXtA5 A852opTbI3xB2rMGLC7Oy7Shu1bLuxqw7hZ5ah4tjGRAiTbhEwnq5yjIpl+hj4gL Oer0E61nqXBRs1rmC9eU0ArR+/lluZ2rL5CN61dS2MpviOT66gEu79qPedWXjIMf GB7t0UbSZLMiMp55b1Em8cU8x+fuutxnFLglykBihFai8MVYc64= =BhL+ -----END PGP SIGNATURE----- --bg3pyh3y7e7u6wik-- From nobody Wed Oct 5 15:25:30 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjJL94RKqz4V2T2 for ; Wed, 5 Oct 2022 15:25:37 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjJL872KSz3gCS for ; Wed, 5 Oct 2022 15:25:36 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 295FPTjB073539 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 5 Oct 2022 11:25:29 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.29] ([192.168.43.29]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 295FPTaj027419 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Wed, 5 Oct 2022 11:25:29 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Wed, 5 Oct 2022 11:25:30 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.3.1 Subject: Re: zio_read error: 97 Content-Language: en-US To: freebsd-fs@freebsd.org References: <20221005151806.k4b5yf2fpyy56xty@x1> From: mike tancsa In-Reply-To: <20221005151806.k4b5yf2fpyy56xty@x1> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 on 64.7.153.18 X-Rspamd-Queue-Id: 4MjJL872KSz3gCS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEFALL_USER(0.00)[mike]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[sentex.net]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Did the boot method change by chance ? e.g. it was booting legacy before and now UEFI first or vice versa ?     ---Mike On 10/5/2022 11:18 AM, Julien Cigar wrote: > Hello, > > I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) > and it doesn't boot anymore, I get tons of "zio_read error: 97 "with > ZFS: i/o error - all block copies unavailable" .. any idea what could be > wrong? It worked like a charm before reboot.. > > I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} but > it doesn't work > > any idea? > > (I've attached a screenshot of the iLO console) > > Thanks! > > Julien > > From nobody Wed Oct 5 15:32:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjJTw2xGxz4V3HX for ; Wed, 5 Oct 2022 15:32:20 +0000 (UTC) (envelope-from wfc@mintsol.com) Received: from scully.mintsol.com (scully.mintsol.com [199.182.77.206]) by mx1.freebsd.org (Postfix) with ESMTP id 4MjJTv5CvPz3h0s for ; Wed, 5 Oct 2022 15:32:19 +0000 (UTC) (envelope-from wfc@mintsol.com) Received: from mintsol.com (officecc.mintsol.com [96.85.114.33]) by scully.mintsol.com with esmtp; Wed, 05 Oct 2022 11:32:13 -0400 id 00C4948D.00000000633DA37D.00014C0E Received: from localhost (localhost [127.0.0.1]) (IDENT: uid 1002) by mintsol.com with esmtp; Wed, 05 Oct 2022 11:32:13 -0400 id 00004577.633DA37D.0000F81F Date: Wed, 5 Oct 2022 11:32:13 -0400 (EDT) From: Walter Cramer To: Julien Cigar cc: freebsd-fs@freebsd.org Subject: Re: zio_read error: 97 In-Reply-To: <20221005151806.k4b5yf2fpyy56xty@x1> Message-ID: <20221005112832.K61224@mulder.mintsol.com> References: <20221005151806.k4b5yf2fpyy56xty@x1> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4MjJTv5CvPz3h0s X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of wfc@mintsol.com designates 199.182.77.206 as permitted sender) smtp.mailfrom=wfc@mintsol.com X-Spamd-Result: default: False [-2.69 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:scully.mintsol.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[mintsol.com]; ASN(0.00)[asn:22768, ipnet:199.182.77.0/24, country:US] X-ThisMailContainsUnwantedMimeParts: N In addition to advice from folks who are far more expert with ZFS - I have often seen such errors from systems with iffy HD data connectors, or HD's that had "only malfunctions when cold" sorts of issues. -Walter On Wed, 5 Oct 2022, Julien Cigar wrote: > Hello, > > I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) > and it doesn't boot anymore, I get tons of "zio_read error: 97 "with > ZFS: i/o error - all block copies unavailable" .. any idea what could be > wrong? It worked like a charm before reboot.. > > I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} but > it doesn't work > > any idea? > > (I've attached a screenshot of the iLO console) > > Thanks! > > Julien > > > -- > Julien Cigar > PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 > > No trees were killed in the creation of this message. > However, many electrons were terribly inconvenienced. > From nobody Wed Oct 5 15:35:25 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjJYT36Gjz4V3Xb for ; Wed, 5 Oct 2022 15:35:25 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjJYS58pxz3hYc for ; Wed, 5 Oct 2022 15:35:24 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 295FZNZr084242 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 5 Oct 2022 11:35:24 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.29] ([192.168.43.29]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 295FZNZT030889 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Wed, 5 Oct 2022 11:35:23 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4fa5c349-4a7b-cb8d-10e7-ad1bf194251c@sentex.net> Date: Wed, 5 Oct 2022 11:35:25 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.3.1 Subject: Re: zio_read error: 97 Content-Language: en-US From: mike tancsa To: freebsd-fs@freebsd.org References: <20221005151806.k4b5yf2fpyy56xty@x1> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 on 64.7.153.18 X-Rspamd-Queue-Id: 4MjJYS58pxz3hYc X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEFALL_USER(0.00)[mike]; RCVD_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[sentex.net]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[] X-ThisMailContainsUnwantedMimeParts: N zfs_load="YES" is still in your loader.conf ? On 10/5/2022 11:25 AM, mike tancsa wrote: > Did the boot method change by chance ? e.g. it was booting legacy > before and now UEFI first or vice versa ? > >     ---Mike > > On 10/5/2022 11:18 AM, Julien Cigar wrote: >> Hello, >> >> I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) >> and it doesn't boot anymore, I get tons of "zio_read error: 97 "with >> ZFS: i/o error - all block copies unavailable" .. any idea what could be >> wrong? It worked like a charm before reboot.. >> >> I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} but >> it doesn't work >> >> any idea? >> >> (I've attached a screenshot of the iLO console) >> >> Thanks! >> >> Julien >> >> From nobody Wed Oct 5 17:25:46 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjM0x0g3Wz4dfkb for ; Wed, 5 Oct 2022 17:25:53 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4MjM0t6B46z3wrM for ; Wed, 5 Oct 2022 17:25:50 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from x1 (94.105.105.213.dyn.edpnet.net [94.105.105.213]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id E63DE28A49; Wed, 5 Oct 2022 19:25:47 +0200 (CEST) Date: Wed, 5 Oct 2022 19:25:46 +0200 From: Julien Cigar To: mike tancsa Cc: freebsd-fs@freebsd.org Subject: Re: zio_read error: 97 Message-ID: <20221005172546.ntxtorp7h4jc6meg@x1> Mail-Followup-To: mike tancsa , freebsd-fs@freebsd.org References: <20221005151806.k4b5yf2fpyy56xty@x1> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="4b5t6kaf7iwynkfx" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4MjM0t6B46z3wrM X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=PXPv=2G=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=PXPv=2G=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-4.50 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_NO_TLS_LAST(0.10)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[perdition.city]; TO_DN_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be] X-ThisMailContainsUnwantedMimeParts: N --4b5t6kaf7iwynkfx Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 05, 2022 at 11:25:30AM -0400, mike tancsa wrote: > Did the boot method change by chance ? e.g. it was booting legacy before = and > now UEFI first or vice versa ? Oddly enough the system boots when I'm switching from "AHCI" to "Legacy mode" in the BIOS, maybe just another issue with HPE bios .. Thanks >=20 > =C2=A0=C2=A0=C2=A0 ---Mike >=20 > On 10/5/2022 11:18 AM, Julien Cigar wrote: > > Hello, > >=20 > > I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) > > and it doesn't boot anymore, I get tons of "zio_read error: 97 "with > > ZFS: i/o error - all block copies unavailable" .. any idea what could be > > wrong? It worked like a charm before reboot.. > >=20 > > I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} but > > it doesn't work > >=20 > > any idea? > >=20 > > (I've attached a screenshot of the iLO console) > >=20 > > Thanks! > >=20 > > Julien > >=20 > >=20 >=20 --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --4b5t6kaf7iwynkfx Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmM9vhcACgkQCLYqJMpB HmkY/A//dOlbjzavLQhxwzf7TWMQ0h4j2R0e8pmIXUchc0mFm7q/JRaDYSJteM8P TWFBjdOmdDouktampJd4vTD9L4Rxd/UbpAUbXJ93mLZ0zgpNka1anCK+mcseIqnL HuUD+Ea8EoPbas4H9hc+6G7BHZNRppZdAtFkByD1CoMvm4a2afeuvYgQefIVOtov wiTW8JuXMcohJLkMvQnpylZt4FATIWI0v6ISmseXk3Y34oT93oGUiXLGA8UnDKud LPzdKqwoZ03VbuDboJTBvMfcK6/nilnc75Ue2RGOdaCzVobaM9utqpARIaFe7ovD C4PedWoD9u1bkY8g+wq3yi+drAWM4jV4YWL3Zx06h+uh4/SqoTw2X0UmtuBv/9PT 6AGQwWGks9gCAfR5UjxccwK5oJMnNtD9bTckD6eMMDsjkBqMv7czkuciv6DqzXLo FnK87mJ3S+6t92uQuwgi4CTuwDtTTLEfpw0HggMsSh+m02kf7pvFbsfaBgtESHsr 7rHMMnWr4sa4WmQ5FCH3PtHPVaoifuDnBA4/xkzjXAessFfQ0HfhGhWGvQEQzDe/ pDvdGSYmG8eA3XVLhuu8exlNmwbGOQtYnmOVesWlB1IFavPT3iC+77uEhcpue/b9 eBmqvjp1bjlCb70wb3efJWg78XDBKfs4ri+1A05g9RForZbirqs= =+4MQ -----END PGP SIGNATURE----- --4b5t6kaf7iwynkfx-- From nobody Wed Oct 5 17:27:13 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjM2X2xp2z4dfsG for ; Wed, 5 Oct 2022 17:27:16 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4MjM2W69GCz3wyD for ; Wed, 5 Oct 2022 17:27:15 +0000 (UTC) (envelope-from SRS0=PXPv=2G=perdition.city=julien@bebif.be) Received: from x1 (94.105.105.213.dyn.edpnet.net [94.105.105.213]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 7C21228B52; Wed, 5 Oct 2022 19:27:15 +0200 (CEST) Date: Wed, 5 Oct 2022 19:27:13 +0200 From: Julien Cigar To: mike tancsa Cc: freebsd-fs@freebsd.org Subject: Re: zio_read error: 97 Message-ID: <20221005172713.ssqj7idcgrkekfrp@x1> Mail-Followup-To: mike tancsa , freebsd-fs@freebsd.org References: <20221005151806.k4b5yf2fpyy56xty@x1> <4fa5c349-4a7b-cb8d-10e7-ad1bf194251c@sentex.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="5sfzo36ymvjolkjk" Content-Disposition: inline In-Reply-To: <4fa5c349-4a7b-cb8d-10e7-ad1bf194251c@sentex.net> X-Rspamd-Queue-Id: 4MjM2W69GCz3wyD X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=PXPv=2G=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=PXPv=2G=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-4.50 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+mx:c]; RCVD_NO_TLS_LAST(0.10)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=PXPv=2G=perdition.city=julien@bebif.be]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[perdition.city]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --5sfzo36ymvjolkjk Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 05, 2022 at 11:35:25AM -0400, mike tancsa wrote: >=20 > zfs_load=3D"YES" >=20 > is still in your loader.conf ? yes, https://gist.github.com/silenius/c26697fd25fd2ba845d551e71cfda46c >=20 >=20 > On 10/5/2022 11:25 AM, mike tancsa wrote: > > Did the boot method change by chance ? e.g. it was booting legacy before > > and now UEFI first or vice versa ? > >=20 > > =C2=A0=C2=A0=C2=A0 ---Mike > >=20 > > On 10/5/2022 11:18 AM, Julien Cigar wrote: > > > Hello, > > >=20 > > > I just rebooted a HPE microserver gen8 (running FreeBSD 13.1 with ZFS) > > > and it doesn't boot anymore, I get tons of "zio_read error: 97 "with > > > ZFS: i/o error - all block copies unavailable" .. any idea what could= be > > > wrong? It worked like a charm before reboot.. > > >=20 > > > I already tried to gpart bootcode -p /boot/gptzfsboot -i 1 ada{0..3} = but > > > it doesn't work > > >=20 > > > any idea? > > >=20 > > > (I've attached a screenshot of the iLO console) > > >=20 > > > Thanks! > > >=20 > > > Julien > > >=20 > > >=20 >=20 --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --5sfzo36ymvjolkjk Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmM9vnEACgkQCLYqJMpB HmnBBxAAqizwfngR8ZiljMFs9NYLswZBvSPydj4Pw5x7ztBUQ2a0n16s399xBQ9z 9frayzhAGA+Sn7kJabTBEbR3apw/8JEzqdF/W3d4L0FyUd2fOMTMe5g5vb1f4wUU 3xOusaP5B7pvnGr2S50nkBgEVKNW2pfnGGRm15drgDiahRYfnab8ZVfg55Ae31p/ +7amPsYZJMulhfhKQWR4rB2oNUffgcY1N2r5HEv5CutQ57EqwHKR6Dlg8GALULD9 sNVop5uzmZfcAQ3JGg7CK5Wh+gCLv/BJdgkxm4mxjUgpu0wLiNS8hcv1C9FM1bFe PvzihskiIGc7p7RtpD70StV+uMTqAave/SYBDi7ch4dw/9R815DvRklc7oV2RvPd 4EIFy6SDhWHqH/Z+m2I10ZY6GQTSw39MBQlbmHYK3E7m3T7YIbG82AlKASuVFvM9 HZ4LVIy5KfTAbBol5Ky6RyD/V2S2scwfrtoPIxP6Mi12fw3QWQs3iy0cqI1Ckz0i rzSESEydEJ7gYXcMexsneoBdaSJvXdzHe8Or0GBiPFGkPEZidDJfER9nTIMeY2tL pIJOUvO8C5WOlXH83hyhidCjey7mR0fDCDQ0inY5kjlY9lvzU8Ai7j8Him9qBT7+ MAzVEhiv7xn/vbtohtyAO9nyPqzM0LbC8WnjXWM28sYuSNzd6QI= =N+f3 -----END PGP SIGNATURE----- --5sfzo36ymvjolkjk-- From nobody Thu Oct 6 14:05:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjtVn08kYz4dgdQ for ; Thu, 6 Oct 2022 14:05:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjtVm57t0z3KVT for ; Thu, 6 Oct 2022 14:05:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MjtVm49sXzGdj for ; Thu, 6 Oct 2022 14:05:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296E54Q1046583 for ; Thu, 6 Oct 2022 14:05:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296E547i046582 for fs@FreeBSD.org; Thu, 6 Oct 2022 14:05:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 14:05:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nomad@neuronfarm.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665065104; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QGuDNBkU2ezmeutIDHQ+iQ3AngF4BAiMAGcDi6YdNI4=; b=W14roZwbHNT/01g8Te7jN7crSh4uSStIHxOpeAC5bKL7euJ7DJJt7NOpDjHNDhiqyrdhl4 pkUop1eI6MJh1Lrx9iiwo7D3c1nb+llnBBIFX8XprpnEmwY3Y5bKreCjxbCqkrRtZESjRH +KMD53/HGp5wvmMmA/Ut1s+tSlVQaQx2E0F033tDsQ8zshNr8G03W7kJDyaflBhLHGw94X 1PqTrpq4AgFS093jF+MdfMH4WW611AUnLDFtYYA5quWaWMg+rBYoLuDjmydBAHGKXebRay kYbDp0ev16HpuvTR0z7CTwNkyum1WQ+olsufjC0Zu/f7bW6cOE3YkyCc9WF+JQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665065104; a=rsa-sha256; cv=none; b=ejBmtyuYAEe3ZAKWSepmbj12ihL9QCywZ5z3KUYvI8vcU6nIUYeWI2juylCsz53/wap35d g3uxYUt6a7qhs5pn+xi/H4az4trn6TecDKwI24T93k1XXYOGwo5RZK+GXWPxuGpxr/Mkmm c5PB3czYlfP8abvfRN/8Mgg7SEZInSw0/lfKWgzXFe0YUzM5lIgAL/gKhG2geC/KCYUf+K CnldN+wLX07+ZYSJN/lo+T0SvVd4zTIMi7zd3uNj80eT4nK0fwuXn4b0UP4TDj2JfJpdu3 SWp3GIDSaeKj8VRPZz073sUw3650w54z67I+pfuTDCE6IHRSCAeNH7ZTPsV50w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #10 from Michel Le Cocq --- How can I help for this bug ? In fact I've two FreeBSD server with several disk bay. Server1 : 13.0-RELEASE-p7 Server2 : 13.1-RELEASE-p2 My disk bay are attach on booth. Then I can choose to import the pool on Server1 or Server2. The point is that on Server1 with 13.0-RELEASE-p7 no snapshot access trouble but really often NFS client hang like this : Oct 6 15:15:57 xxx kernel: [275827.527427] nfs: server Server1 not respond= ing, still trying ... Oct 6 15:18:58 xxx kernel: [276007.920813] nfs: server Server1 OK Since upgrade on 13.1-RELEASE-p2 on Server2, I have 'Stale NFS file handle'= on NFS client. root@poste:~# ls -l /mnt/.zfs/snapshot/1/ total 0 ls: /mnt/.zfs/snapshot/1/: Stale NFS file handle And worse on this release ... an action on zfs vol result in : 'process in Uninterruptible sleep', then I must reboot... --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 6 15:01:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjvmC2r3rz4dnDK for ; Thu, 6 Oct 2022 15:01:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjvmC1rP7z3N76 for ; Thu, 6 Oct 2022 15:01:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MjvmC0wnfzHdY for ; Thu, 6 Oct 2022 15:01:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296F1ljA016842 for ; Thu, 6 Oct 2022 15:01:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296F1lAS016841 for fs@FreeBSD.org; Thu, 6 Oct 2022 15:01:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 15:01:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nomad@neuronfarm.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665068507; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=q0wROdtajrdPIptFTpVkS/CYv0msq5cmyDI8qy6MuHc=; b=PTbtFhtlXQ/yqs7hsTk18dJMVcDf/OYUbTTSsVqn6w2e3akPBQzqHgXQqPhBhH7+hjl0c0 xzCmJ4uYYq0zaYovnvtb2T+RLRfBJ6wLXninBljY39eGwU+tQw+mmi40oVnL82q+oeZXo/ ww1zWm2sPDroOR4Hu9RS/NvaUsi2YP5n6SL2oxSDcXQslWGN7tUeIV2H05D8Yy+wNuXWBb wWo/S9UWmNTVpOVavXPYTX29nDMBCvXYFFv5aCDbEBypbP5N/LFHUly2jIwMWchBWc20VF parrS1awoUgF2WTZNG3oG1ZqTJUGNMpXk8GN069OnNMbUiqrsU9tjYSkslCmHQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665068507; a=rsa-sha256; cv=none; b=izS2yeceuLpzPFQ5tCMt4chi5lmNqgGp7NtAXRikDu/Z+NJGEsfMqhO1QHFFbp3UH+8lHL CcaR6x0tUQtS2TrVBkKmAcjw5VLgJfvy3YY+injvithAvRbHLGSegLLtWy8HpMHueQK+6n VU5IGhaE2w1k7Aq4cyAdUKO994BVl5ArRDai8UACe41WeIEiop3CB/4MPqGhzUwf+xJd2A wqTY5U2J/dvr9CRKN8YfmOvt7srvoSOnEDvXlvbO4ATUj46hy7Vx6OsepAQ16UQe4V3ftX lBpeV1YzeOICyC54VjipSpH/FbEB8Yi4sG9R4+JOnc18Az1REtceTb2DvJG8SA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #11 from Michel Le Cocq --- With 13.1-RELEASE-p2 no more "nfs: server Server1 not responding" at all . --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 6 15:57:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mjx0C01WYz4dtYx for ; Thu, 6 Oct 2022 15:57:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mjx0B63gtz3R6P for ; Thu, 6 Oct 2022 15:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mjx0B56PFzJB6 for ; Thu, 6 Oct 2022 15:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296FvEXX076398 for ; Thu, 6 Oct 2022 15:57:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296FvENk076397 for fs@FreeBSD.org; Thu, 6 Oct 2022 15:57:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 15:57:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665071834; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IN+kNYjn5OWn434Ck5UVmqvOx+pSkTXPpuOqWpUkTt8=; b=gKMDZpHXqgRCp+EEvByeyK5JakHOiAN7ZV2Td/z77ZxyP+URfVe4rM5AMQUONBl7nIbqHg 9YQLNel1eZGbN3zmbUMpQtkrBQMKyZyAzEPGnftbOIxuzvUVOus5iKuLotq8yMDf+6MgCS 72+X3Ap4DTK3dITJp33oXe285KyBSvfTI1q5+bupPprzLV5p+/zDbBkuR8bSxKuaVfiNvs CfNXviCEpwj8jK7I0ugc1H4MCH89Hs+J2kpkc7tO16nU4qu+O+aCPuCqYpGoXtGSG/t2k+ sApvTWUuh1GLjZFTQ3BYSoRMvbsBLcu9bC6OpXe6jMAuZGe5IYJ6YhfyOl1qsg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665071834; a=rsa-sha256; cv=none; b=viHe0jFuP/k8gnr09heEEP7QUbPsNv3mcHB1r/0fm01DiIzi8cjU7fYoLjMsWNyDdr7qGZ Z/75MQB+CGH41MZhuxGvpto9JeGnpIqwfI1hmi2WqogY25BhLQ9o4fUC280pn2054hHog+ aY+bcBApNihl5BmQ6C1v/MqP5uopyq8LJVpacxEyNoY+wRxsxM32kZ5JRhFMybTGX/R42x GEx1PvEfP/XdWgopYnTszV3GuesRd1j7rNLDm8qaIZ+a3tUN9yarTWf4EFmgyxRdqZrjST iSCelpYzbspIKyRwCtzbzXqZLTwXViujBpsRB8YoWoEbLnCwAt30B7wtQ3nmeQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #12 from Mark Johnston --- I can reproduce this with a loopback NFSv3 mount of a dataset containing a snapshot. Some dtracing shows the ESTALE comes from nfs_access(), the RPC = is returning the error because it can't translate the file handle to a vnode. = In particular, I can see zfs_fhtovp() is returning EINVAL when dealing with a "long" FID, used for files under .zfs/snapshot. 1 70351 zfs_fhtovp:entry fid_t { u_short fid_len =3D 0x12 <-- LONG_FID_LEN u_short fid_data0 =3D 0x22 char [16] fid_data =3D [ "" ] } 1 70352 zfs_fhtovp:return nfsd 22 kernel`nfsvno_fhtovp+0x3d kernel`nfsrvd_dorpc+0x120 kernel`nfssvc_program+0x68c kernel`svc_run_internal+0xb4f kernel`svc_thread_start+0xb kernel`fork_exit+0x7e kernel`0xffffffff8107803e With DTrace I can see that vfs_hash_get() and VOP_LOOKUP are not getting ca= lled from zfs_fhtovp(), which means the error is probably coming from a recently added check: 1821 if (fidp->fid_len =3D=3D LONG_FID_LEN && (fid_gen > 1 || setge= n !=3D 0)) { 1822 dprintf("snapdir fid: fid_gen (%llu) and setgen (%llu)= \n", 1823 (u_longlong_t)fid_gen, (u_longlong_t)setgen); 1824 return (SET_ERROR(EINVAL)); 1825 } That came in with https://github.com/openzfs/zfs/pull/12905 but let me see first if that really is the source of the error. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 6 16:54:22 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjyG722fdz4f0nd for ; Thu, 6 Oct 2022 16:54:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjyG710nxz3X2s for ; Thu, 6 Oct 2022 16:54:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MjyG66mdmzK93 for ; Thu, 6 Oct 2022 16:54:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296GsMvR056983 for ; Thu, 6 Oct 2022 16:54:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296GsMaQ056982 for fs@FreeBSD.org; Thu, 6 Oct 2022 16:54:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 16:54:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665075263; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lvgcv8jEUC5cnyG6x8sIILYcoabUYC+68JSj5/Rvbp0=; b=x3x3NfnGNSFZuZG2Qf+yRXzGvcW02/k4MVmG1HITwFDyUALDAvaXfsn2UCttAwcP/V7mhd OkBZjsdIHVZpFx1zLhsTNJvhiIj5rbS7dVwLV4zWKBh8Q8P/qoIsArPmV6AreSKipuKJBu Sn441x9QSRfHWp3s21DwGwl8d6wVK6DNne7nPlnxP7pXBMU85pNzpPVxqoXO6Rbeq6NxdM GqPpLkp6wyR6FcT8tnddDBsUQ4zl1LMf2hsfN2en49nszbREfhmDhv1sFGA8kNSVxGuE/5 /4HDISFpZeJ+1DzgOZHEeF3qsNC+NJ9+7/kdNMUHwUCoQ8C9yvfyS7OVVpiI1Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665075263; a=rsa-sha256; cv=none; b=NDEVjEwBLL1hAnXXvoSL2BVe5vh9VsEQUXwSs1re7rO8BrDy4yVGoEPvBXBRhX4ID/p7kd lY92MOq34TAVyrS4KUTnmvLvDEK1OvUenrI44oUjHL+NqFzTWPpV1bCJANXFYWQDCh0KUW aP7ltNjdqUrd297nJgqrkbZnOfUN76VaiIZBqxu+VG96PEOLo+vgwH0DrgPi3iWGsu9ogh zBAlhCOpmOxCrPIa2x7X4txw/wguE96DmSpQIImvcIvh4B5Fi/QGJfkOuBSF3emOrstW/W 2iIiPpnJJU2SxOgJljNtboHbq1KtWBRzZ9emG1r7OrAgPXwgqX7dMlYjBaLRYw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |freqlabs@FreeBSD.org, | |markj@FreeBSD.org, | |mav@FreeBSD.org --- Comment #13 from Mark Johnston --- Reverting https://github.com/openzfs/zfs/pull/12905 does fix the problem for me. There is an additional bug there in that there is a missing zfs_exit() call before the return, which causes a lock leak. In my case, we end up with fid_gen =3D=3D 4 and setgen =3D=3D 0. I don't u= nderstand where that generation number comes from. zfs_fid() sets it from a ZPL attribute, and "stat -f '%v'" on the snapshot dir prints 0.=20=20 To repro, I just enabled an NFSv3 server in a VM: mountd_enable=3D"YES"=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 mountd_flags=3D"-n"=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 nfs_server_enable=3D"YES"=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 rpc_locked_enable=3D"YES"=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 rpc_statd_enable=3D"YES"=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 rpcbind_enable=3D"YES" zfs_enable=3D"YES" Create a dataset with a snapshot and export it: # zfs snapshot test@1 # zfs set sharenfs=3Don test Mount it locally and check .zfs/snapshot: # mount localhost:/test /mnt # ls /mnt/.zfs/snapshot 1 # ls /mnt/.zfs/snapshot/1 snapdir fid: fid_gen (4) and setgen (0) snapdir fid: fid_gen (4) and setgen (0) snapdir fid: fid_gen (4) and setgen (0) ls: /mnt/.zfs/snapshot/1: Stale NFS file handle --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 6 16:59:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjyMq5htpz4f1Hq for ; Thu, 6 Oct 2022 16:59:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjyMq4X27z3XJy for ; Thu, 6 Oct 2022 16:59:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MjyMq3cHdzK4S for ; Thu, 6 Oct 2022 16:59:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296GxJpF058613 for ; Thu, 6 Oct 2022 16:59:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296GxJx0058612 for fs@FreeBSD.org; Thu, 6 Oct 2022 16:59:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 16:59:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665075559; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NqaEof7Vy8PCzWvnUeN3t/SKeyLOI8/58sDhLHAyni4=; b=Hl/6x741Cf+GGh4JGU0WrM6KMeMcatgeYFhhmh9KVrKSgGbS29pl8ECs4/4iLlWREDruce +4/u1bWxg/4Iv9ee05ni9dhekW+9eUKoc0Kyw9smRKqzqm3/KQT8fxuIIBFdNkglC+/7Fm Zu5Z4CWKe14o3t98/ljmmQslts2fM9ACLKKA5wMp2zhVNY6ohwxbxGc4gvbuBkcsNukMwe sF5LP3pf2RlcnHuqLUvLU/l3drk0wr3qoCI2DkbaI9OGYAciDHaVtXUYSSH7xX8JNE1Ovo mYqwoiwzTyND4lhZjPqXCAbFxI9MbUy/qKwJ4VAChRJw18qX7FFoXYlHgbzmoQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665075559; a=rsa-sha256; cv=none; b=fKVh+V1FpIHgBxbEO24f+sfBAB4jzd4SAmAlODdnRIFP6iqGmCmzZR5a0CIdtZUguW/QjY cnGp0ieqdOWc2SDDR1xKW+wWpQJr1bCR3bxxomGN9woBeeOwOt2cEXywnx8B4hYgieSwP2 brryWHyxExBrDZit6jh+py+ftrVneaURZa6d2aBRegxmF0tCDbA0SUn4R3hCXfhHJLqbuT BZiv5+STyDlgf0pxVUe0k8w5svo7SBJuZvN4CkvFvPyKAht1jOjt975ZGl0Te5GO6Zbf9B 6afMRemOcgrtoFfUxRidRk1pO2KO0id6iZTMsh53SOxRvaSpJS2IyeaELzcEAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #14 from eborisch+FreeBSD@gmail.com --- (In reply to Mark Johnston from comment #13) Thank you for looking into this! To clarify: 1) With your reproduced error state, is deleting the snapshot still possib= le, or does that hang as expected? 2) Does reverting https://github.com/openzfs/zfs/pull/12905 fix that (hang after failed-access/destroy), as well? Your comments may already answer (2), and I've just failed to parse it sufficiently. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 6 17:07:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MjyXx45P6z4f1wL for ; Thu, 6 Oct 2022 17:07:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MjyXx33Wbz3YQH for ; Thu, 6 Oct 2022 17:07:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MjyXx26WhzKB7 for ; Thu, 6 Oct 2022 17:07:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 296H7DCY068120 for ; Thu, 6 Oct 2022 17:07:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 296H7DTE068119 for fs@FreeBSD.org; Thu, 6 Oct 2022 17:07:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Thu, 06 Oct 2022 17:07:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665076033; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sSYjg/gdSU1H37f75ghKJI/WPhZT0GVI2RSphojaZWY=; b=szeb6UmsQ6GRwn845uMO5F1KbZmGU2VK2910x+uwhOb60VIFfoAb5e8WMt01ay07M6/Tpm wU/UtLrK8OVSA1XxYPC1/bvhijyelVTgmUIqm5nJ7mi+7gefx52hTAL4sahNvQizXyctOA CUwi/0twLNaTCSyh5nGO+rtE1p2CrvV1QdILFBPzPYw7oBFCyiT9rrM/suQnEJsDvK4Zpr 09ihia4rVfhbpaSbMw3A63vhKNvIe+CMv/W16H0W2FxGYWorug+bd1HgRH2Ws2DUaQoT72 hESGo2TgQvTtu9ydHWApZeXyAyltVH6ND4F03wN2de/3Y4qvCKTU6vxhO0zTUA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665076033; a=rsa-sha256; cv=none; b=SIiSnDntEd95q2cA9dt4K4hKI8m7HdEEH5sIWCKgUYMh6nefc7FMP9rwvUaICY8q13fyq9 5sY9UproxmyNqOVOlCHsBrtTsiF1CRJN+Fl2MMxOgp8IAN+abwtFbmQNkm2eLbZFwJk8vF nF6A7hM8mdMqsI4yiwQC/hXFf9sxbKztGk5Rk5skTRvvsOjxi5sNXhG8/Lolswljl85PJD 9Dn45o8sJmcVu1y7yYJpCkM2/fEJT/kJNpxBvFOS99QY/KRky+ejlSsUunTjYuZwa8COqg 1bVtr+pYpdwzcxVdTc90UkESFTN5cLw6ED6puPR1Eq2SCy6c4/vTztne5LLCaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #15 from Mark Johnston --- Created attachment 237124 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D237124&action= =3Dedit fix lock leak (In reply to eborisch+FreeBSD from comment #14) The hang you are seeing is due to the aforementioned lock leak. That at le= ast has a straightforward fix, patch attached. But that doesn't fix the "stale= NFS handle" errors; I'm not sure exactly what's going on there. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 08:34:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkM6P2b94z471wL for ; Fri, 7 Oct 2022 08:34:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkM6P1ZgMz3R21 for ; Fri, 7 Oct 2022 08:34:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkM6P0g2CzXlB for ; Fri, 7 Oct 2022 08:34:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2978Y5DW092454 for ; Fri, 7 Oct 2022 08:34:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2978Y55f092453 for fs@FreeBSD.org; Fri, 7 Oct 2022 08:34:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 08:34:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bane.ivosev@pmf.uns.ac.rs X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665131645; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ulqkOf1tDNgkAKxWMgLesEH6ZM+25Bcd2LPCF4qheKs=; b=p3gme5nbP0sMOzYnVGj0a5LvyjYVsQgUwb9rdE2iAZDoDa9Rp91s6rJxwdaXQY0bEcFsSF BHGa5CJzjmi0m1sfkM5/Fw3J9Uk1WSNPOVRXzpMr9GjRXwOg6NRZindBt5iF0HN4qSdIzh 4N50ofpuj3XxiZiTpOPIrZywXbxB2D1qkd3JqurSZECHP/93oo1Jg53i4CUkZJSSjDbI/2 mZoHwpIJHuY0i+EQz/tS0yLNi/mbmYgc2RUhvjVkBYYVMRekqUzkZ3E773HpnWjvorv4Mf SJUFyj0tqL73ejrEYVEVvYkNNUunL+1IgG0kS1qyBscfdoKGm7SWhn0sTkFTLA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665131645; a=rsa-sha256; cv=none; b=sk4oLQ8dNnRE4nndiGVMUXiymaDGyyeRXI5YAaGkS5Gb6qMLCt/Gb247Cl49K8JgTYhuuB YXqPczrTQUKuKnB/gwmBrsuW4NbpvPt7JFy+QjK44skAu1B/4gQ/ZJFrC3fjOnTJ/+oDx9 JCY5in8mkBQvNZMj/37Y/BYaj7V/iESTvwaSIGTJBlFhQWGD/Fn8gOTThjdO8GZTJfFY0b AI3O+DZLsLzdiMCSs0zhWWR0yZWHwrh2Zuh47aa+Kn5VAGP4zpC7QSQ1soMVUiBMlj5hcc 83J5VYHMDCybRPXqvzXWIMV/ShHlzJa0QSGsRaxzW5zNtDO8LoB5rusnR04jOQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Bane Ivosev changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bane.ivosev@pmf.uns.ac.rs --- Comment #16 from Bane Ivosev --- Hi, we have the same problem after upgrade to 13.1, easily reproducible eve= ry time. First, we experienced freezing of our production nfs/zfs Supermicro storage after we tried to access snapshot on the nfs client (at one moment server freeze at regular snapshot management procedure, not immediately), t= hen tested this bug on our backup storage. Same result. Now we try the same with 12.3 in KVM VM.=20 server: zfs create tank0/test zfs snap tank0/test@1 client: mount -o vers=3D3,tcp server:/tank0/test /mnt ls -al /mnt/.zfs/snapshot/1 Results: 12.3 server zfs -> 12/13 nfs client, everything is ok, as expected 12.3 server openzfs 2022Q1 -> 12/13 nfs client, everything is ok 12.3 server openzfs 2022Q2 -> 12/13 nfs client stale file handle, server ha= ng on any zfs command or can't finish reboot/halt, need power cycle Same results with openzfs 2022Q3 and 2022Q4. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 13:27:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkTcQ4rhbz4dlM6 for ; Fri, 7 Oct 2022 13:27:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkTcQ2KjMz3pJS for ; Fri, 7 Oct 2022 13:27:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkTcQ1PSmzcMk for ; Fri, 7 Oct 2022 13:27:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297DR2T2065209 for ; Fri, 7 Oct 2022 13:27:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297DR2bq065208 for fs@FreeBSD.org; Fri, 7 Oct 2022 13:27:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 13:27:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: florian.millet@laposte.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665149222; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BVmkDcDAdDixXuL7rRLKXaUfGC9xAi7UhzraQkCpt0o=; b=uvPbD+OI7OC6uVjL+D6o8sC3VEGpbLgt6TPzWmngaOeX4hg6z5F3QsKYpYvcT/qXn8f/oY QfyXYfZV0Ud5AuWpKGiZg7XQ5UA1NzW0B4E7lfSX1LEHzls9MeALjECwXFU86fOa3aaaGq 924oqYZulEwYK5JPq18h+K3c2Iv2R7jDQIRGkWROqnW30wEHjZumMIqaur04A3DVn/ATr4 +nz4tkAq9uoJEOtmJNYOK2ndZ0HVlpxfLj2EDB59GkoCLGEqhhuAUvsAi3Ta03J48iAQiD 9X0EWNhFROTmZpDrxQLUqp6hNrc0qMCfu2tPKVSCt1aHRZ/bmyXpbC2zpxuUbg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665149222; a=rsa-sha256; cv=none; b=GT+N5RjbStV/ZjoFpNE3nWyVx772tOFQ5QYHJQiRCO53/36qfhGYdgeH4Pw+7+C92uNKpP SzDU5VJup9on7xUxOVsMeFgEs14QfLB/N0sTd8V46+MzT8UqYRP8sZjhsKKe6y3bXFU9sN YA5LhrtkBV9EUe3Q8nXqOgI/yZXFoDjuhINCSinnKG+2YuqrXSWs4kOr/5pyW6kkm2Aq+s 5zvQyIb/IMPzyIxs11jrgi9lAJiy54uWvH3bg+dF/SoENxMkv5PGaDOSoAlub5mYskvcEh zX0Hs8R7MtgsGStZmGDP2HftsGUlWNk43Akwd2QrKxRLS1mYv9WoJ8c5Cskh8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #17 from florian.millet@laposte.net --- (In reply to Mark Johnston from comment #15) I tested a modified version of your patch (it didn't compile so I replaced = your line by a ZFS_EXIT(zfsvfs);) and I can confirm that the deadlock no longer happens. I can also confirm as you specified that we indeed still have the NFS Stale Handle error while listing the directories under .zfs/snapshot/ Thank you for the patch! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 13:43:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkTzW1bn7z4dnH0 for ; Fri, 7 Oct 2022 13:43:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkTzW0ZMZz3qJH for ; Fri, 7 Oct 2022 13:43:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkTzV6m7TzcZl for ; Fri, 7 Oct 2022 13:43:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297DhYdc088728 for ; Fri, 7 Oct 2022 13:43:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297DhYlm088727 for fs@FreeBSD.org; Fri, 7 Oct 2022 13:43:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 13:43:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665150215; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3MFyDtCnn4LEDQAmdkl3endagkBwl6hMNuCRPEZ2xKU=; b=Ns9g5Cx0xvoyqLlFbURVCrB0rSnZ+n1wygDsDFil0eJjVrfshZqIxQUZLe/HjI9ZDU/frx 0yfPE+IiedokirYq4Nt05zS52AcJ+XmLNVzG6coWW06fRxwmGz+Q7DAvKvsuzD0WJvTalr yLtcFSH9cjpSSrYvWeg1xyyM2mx2Qb4Y8ArQ01SIyOnjI3KfJb1afhmiccqRct3vplGFnE jVJjPFfiX+rLSIMbIGILbQ3jJ/301CcAm7T8xAdeDj3BUdxYWoLHxb7Z7yYzBI6s13j0UT 2Tar1FtNzwxo/kA55+INq8Tzc+JqC8CgQ/lUnqLLSS7YuuyaejQLtu/ZwiI24A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665150215; a=rsa-sha256; cv=none; b=SswKM2BNBmDBmuYZH7ka0xWXr42GT/jPS8sz1Tdh2lalfjPlVRdteS7xeq40622u1FZHcv plTJ8/FjKbzY0WIuB4npQoWkNrWDLQmNl8mGPSZB018epTdd/KjU8Afgl584eMIJq4jpB8 bk9kq5Bek6f46Gxo2BWBLw4YfN5pR+usvQr2fbdQfOOegqat+XaLDxDi/ic1KTsBSw7sae 3RHjGoENYGqDJw6AhHQyFLGfhiW3oDenxt86KMWDgh0EjP497J9tVos4BotW/LLPx97owM nfGiEUAlk3YAouG+nCyud4C24AyQruADwT5gtCmbxm4fJ0B9trZXTNp1eY2RNQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #237124|0 |1 is obsolete| | --- Comment #18 from Mark Johnston --- Created attachment 237140 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D237140&action= =3Dedit proposed patch It looks like the fid_gen > 1 check is related to the implementation of zfsctl_snapdir_fid(), which is Linux-specific and sets the generation numbe= r to `!!d_mountpoint(dentry)`. There is a comment explaining this: "we encode whether snapdir is already mounted in gen field". As far as I can see we do not do anything similar when constructing FIDs on FreeBSD, so the check is wrong there and we should simply drop it. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 14:06:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkVVL0R6jz4dqQF for ; Fri, 7 Oct 2022 14:06:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkVVK6XqQz3tL2 for ; Fri, 7 Oct 2022 14:06:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkVVK5cXCzchK for ; Fri, 7 Oct 2022 14:06:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297E6nSE013978 for ; Fri, 7 Oct 2022 14:06:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297E6nhJ013977 for fs@FreeBSD.org; Fri, 7 Oct 2022 14:06:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 14:06:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665151609; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XKIxDcSiZtMHIglDu/HXngtMZCQi3swXPvitjnpkwfc=; b=Xmofkywo5lKxjeEZrVoPBdUDqZO1j5M78UhF/pZ9e9UZTwWg5zbcZebtaZqmi9xsifDDST mCQJTnjRAlw/R7Mcsy2Oq/9lcgVabmNGoIIknc12G7gZykd0+p6Bg1ikBEyJ4leCA8s3SR 1Xn0f697EkJGZLRJmAxQVjuaX+l7iCIrn224kdgm9n74dDQI/sYKQBESs16M7uJEzpEPII b96BPiVbRbm3UbX9NlOj0wrtfplemK11Lz9Zw+pvGR4HKhXHkzo1r20rYcYUySUJ8FAJfY YSfLLbBqkWhgt6ypwR9IWJMxaWXLUFLxOSslO+3bUQzcGKbhyo4ciP2R6EjYwQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665151609; a=rsa-sha256; cv=none; b=KsAZj2X98ln3NkqxVtmJu1MUVg7pgASWi/+GO3YY86LfBbkl5w4ixxUNorDHqWsENrtapi xuOZtFlGgEaT4SEqzmjgfzlRSjiTz4Z9mBAHCQ/9Dulghr+0Zi+/r0ZNM6SIQN39A5x7im PPrGsqpsXxBLwYqvq8Ne1e0G+3Ik8duWJ1TaJdhetX2vwiwAUv7djYfvFFTE75bYYCdIeK 1aQLTrVewx0oblHP4UVjeFtYa94k+xvJW14t8VB1YTWx4Fi+MsbT0t68wqj948E5Pz1EB6 8m85ApTLNRaCn+3fOf2MVOgVZjfhEEcoFxdElWXnqrrlq4b38eH6F7pEhLdBcg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #19 from Mark Johnston --- (In reply to florian.millet from comment #17) Thanks for testing. Please give the patch from comment 18 a try. You'll n= eed to change the zfs_exit() line again: the interface is different on FreeBSD = 13 vs. the development branch, and I'm testing on the latter. See also https://github.com/openzfs/zfs/pull/14001 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 16:25:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkYZl6L3mz4f4hq for ; Fri, 7 Oct 2022 16:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkYZl5L9Qz3CHd for ; Fri, 7 Oct 2022 16:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkYZl4Ms8zfbL for ; Fri, 7 Oct 2022 16:25:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297GPpiR096852 for ; Fri, 7 Oct 2022 16:25:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297GPpuT096851 for fs@FreeBSD.org; Fri, 7 Oct 2022 16:25:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 16:25:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: florian.millet@laposte.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665159951; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HrviUF4aQ8y+UBhtBjPIu+EssNgMJl/VhGv5ExUPz8E=; b=Ox1tEAJbDYGcOOSc391enkvkOK+UJDLeUUUZjec7UNs9L/I/mUnBcbd89iGVuB6hqVxmKS 9DXc1XPRgJp+n1Wix1KivQSW0W7hUKlMo2vRsiaL6O1pGMNm+AmtkSDWnkYKTLo2BYlPMI 9It4Y85+O5fN3XybLWSXWdyqomXP4T9au7Wa7+HkkGrEXNWKfKS0sEPzwSaP/5vVpREUeo Fb/jYvuZcbiyzonk6Ylhba9ytXyurqQZ64XJ0J72G1Qm+b6V3CSSDLirpjSAQmosfeOcp6 2jtWXablt5XtLmdHuxVemoz8ZSI5SaKQC0YhI14px1GmaKsqUw3LIL/2YEVuJg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665159951; a=rsa-sha256; cv=none; b=CtLRhfAfl0ISmtugQ1k85EZvkmPFWET+atWF/sDafIARGpexiwD5fh7Our9bBHkL/FukqX A9rIXGR/thpyxLzSDCJftTWm+AjTqU6TA4g6aLJKyVn4GsBPxZzMCr1TNsuUiqDNzGQNnQ KOARVWqQSWU9Rk9zk1H5EOF/wwfbPYohUJtME1Vek+1PGMWc/LPtxrrbixkaQ3asP795Sd djUMlawKN+FsR3CVxrJY756YMjk6bblJGEXlizyzBPzl2TPH2MlKvWCHtRVVMSUNffToIi lAY8QekptwJa1MVhBmTUdkEEdS+YAeOr+t3HJNVa7whdxB8IBEeR2z+Ysg/vOQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #20 from florian.millet@laposte.net --- (In reply to Mark Johnston from comment #19) I tested the new patch and I have weird problems, NFS no longer works on my= ZFS shares : - A Linux Client with NFSv3 gives a Connection Timeout - A FreeBSD client with NFSv3 gives a NFS Stale Handle when trying to mount - A FreeBSD client with NFSv4 mounts the share but I see nothing, no files,= if I try a touch I get a Input/Output Error I'm quite surprised by this behavior. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 17:10:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkZZW65w6z4V1h9 for ; Fri, 7 Oct 2022 17:10:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkZZW56wCz3HB7 for ; Fri, 7 Oct 2022 17:10:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkZZW4BJ8zfvC for ; Fri, 7 Oct 2022 17:10:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297HAhU7049625 for ; Fri, 7 Oct 2022 17:10:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297HAhW2049624 for fs@FreeBSD.org; Fri, 7 Oct 2022 17:10:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 17:10:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665162643; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ag8lepVZLPe4lZw/SKc33du25q8NFeOeD1GNi4ABxPg=; b=xAtBQA9xPWjnkhG5m9rdGLshaUwVuYYp2jOD2phSauALJa+uxUD5+gIFOX2phkeMzV07+l TQv72Xl0+ncxREeIDYBdYsMjM+JMMoyUKYoSIHlz1Aaq1mw2wiGkLWUn8jlT3n8sSkUFsJ +sDi6TIyOkAEYT6rGRcoWlPvnQ8tIhCWGnIajsgfrM1HuiHv6ZrN82RLr/3BmkNHpIjNyl +j08ifQ5ZRaRC3PRooJXn6s2+bN3B3+rXnXUUNO4NXL5PsC/TX5SzB/2XwRWrubWvBNo20 tmxpSXJz9YTKgievlW/5n38jE30bkzYBm/SVsXh3KP3ckLFMsFzMtRFLS3MoNA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665162643; a=rsa-sha256; cv=none; b=eLjFIdq3vN9kl9JOKhUUJ07dUsfWRXorwGdvkRruRjjISB93/wA5U3tWS0Rl3zIX8r0HM/ eJ3T8zDnqM60g/lmBFYHSMWA0twExDp0npFvU0bAOUG16sOdQM8CCL4SghNsK7YYSBXqaG FmivahjFPdh7A0nuYfj/8HZTeru3c6uaGXoeEtuEDb2J2+v1lTgqywAAHpNgIMSxJyYThy iJT0B5KHtvNtYQsPZ6W8u60kw6a+MCBPexSJXkwoSokFjRFaz9D27FAntcZ9O5UwbaVnuD KGVtQC4C5IhcgbrHCA7W0eGHJXIS/mbXjxhHoQCLcvpDKpiIRpT1WYNMwkUZWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #21 from Mark Johnston --- (In reply to florian.millet from comment #20) That is indeed surprising. I can't reproduce any such problems locally. J= ust to double check, can you show the patch that you've applied to 13? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 17:15:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkZgf4hRzz4V1gr for ; Fri, 7 Oct 2022 17:15:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkZgf3hghz3Hvr for ; Fri, 7 Oct 2022 17:15:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkZgf2m7Bzg1j for ; Fri, 7 Oct 2022 17:15:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297HFAUi057369 for ; Fri, 7 Oct 2022 17:15:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297HFAJX057368 for fs@FreeBSD.org; Fri, 7 Oct 2022 17:15:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 17:15:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: florian.millet@laposte.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665162910; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NJeCzuEvMwMWpy3COJjHjCGsf4VfzR5AcSTLPXGCUgc=; b=Rl00y2J6Ovby2sUmP1cAuOzLXYvv4mYjbNM7ZeLelQeRyo3gMbPKr+wCTD+cNbOhhtrGPC SbVjU2Th8Rv+V5FaBHOfN5FFBr1iTogvfb+bXNJx67l0o8LhfmAJl5DZXdXIp5xxp0o8+X +dWBkAM0OgW8/vMh9UFzUdSqJ1KzZhFOJmrg1wAU4uEhQAp8wUJTS6SY9LfhKRqjPwSt6V /PCbwd/ULeEZAH34HD5LW0lOMyLMDSLRIPAPjM+Iwmmkxa+lMLo0mxDyqNWyUtYNMvX7BX GHQn7I3qoKHiGuy78EWWvoUqHRU5e7HrKY20glRTpgFRMp+w3+IAOu7DX0Ry6A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665162910; a=rsa-sha256; cv=none; b=pngV0Y9PsCxFT8Z6TJjSVk9rAePcrKA/O6WCGLmXeXiPXmnFjYhQGhkPcUQnwK9fUOfRTB XSwSpEWJO365uD+qnNEBT/3gn7T7jDRFkq8awc1MyPctCP36p4kJHHXy3UPKwKMOhZNh8I 1SF3AkkZ8Fln6ynARt95Pu79bYejI8gAfot/j6+7KUEgPjJh4r1PWxn/+v7kYFh5VwBR+O IgMu+lEr9J4PSlO3lWcE4+EXkueSsHfQXrlLHLn3I5GJbYGfTAhPEXm0vh9SGMvAIxJebS mKuEoCkyw9o9PN3Ap/Aoi57yvNWR4pZXqxWp5IAMcL9iR1KiWXt96X8hV8SXPw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #22 from florian.millet@laposte.net --- (In reply to Mark Johnston from comment #21) I tried this : diff --git a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c index cdd762dcbcbf..05d41d4e3b2a 100644 --- a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c +++ b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c @@ -1845,7 +1845,8 @@ zfs_fhtovp(vfs_t *vfsp, fid_t *fidp, int flags, vnode= _t **vpp) return (SET_ERROR(EINVAL)); } - if (fidp->fid_len =3D=3D LONG_FID_LEN && (fid_gen > 1 || setgen != =3D 0)) { + if (fidp->fid_len =3D=3D LONG_FID_LEN && setgen !=3D 0) { + ZFS_EXIT(zfsvfs); dprintf("snapdir fid: fid_gen (%llu) and setgen (%llu)\n", (u_longlong_t)fid_gen, (u_longlong_t)setgen); return (SET_ERROR(EINVAL)); --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 18:46:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkcjJ15p2z4VCCn for ; Fri, 7 Oct 2022 18:46:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkcjJ056Kz3Qx9 for ; Fri, 7 Oct 2022 18:46:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkcjH6GZkzhRs for ; Fri, 7 Oct 2022 18:46:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297Ikh2e072909 for ; Fri, 7 Oct 2022 18:46:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297Ikhgm072908 for fs@FreeBSD.org; Fri, 7 Oct 2022 18:46:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 18:46:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bane.ivosev@pmf.uns.ac.rs X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665168404; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/zVBfQK7cp3XeUtCuSt6eWDN9Qbxt6BWKo+VkcS5L1I=; b=w2Zg9ZLyRW2kya/iUcY61tZCFrg6LCa/SrB1Fg212d3EycPaseZ/wa+XfLwTPNkk2WJpSC QhTcasxPZEJghHQWM5IfQuqAoInNtoCYwm6HlNC9jP7KZBUQ/RV9f/7tyWbuZ2Y3rXqgtT dEavoEL/jXLwsJajhl1WRpqpHBCSN7ANxR6hdR/ZmurGeizRfrQshSMn+aum/kW5Mw62VS gKciZjG9awIGfZdjWCsHL0HeiRfC3yp9TctUJDvnU3r1Pkj4cBIwq4ROlSYWFEhEu7OGnZ twM76RBxSH1KqaATIdgERxniVieHrAoVRPeSOi11N75jpAO6GA/ySojhU4KjjA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665168404; a=rsa-sha256; cv=none; b=YBSbopUoaxZ267yRbqo0YeOrcnWGPtUOtEudTuijOpmdtsXozEzZYdgQ5MjgxkyGEPpOEo IcKdLBcCdCQjxabUfe0Cfbt9tcc4xiEc82CwcSVQ2RcM3+XuWefbAqwfD3RqtaePgtkB/F WLk+4N0nK81qFYnt1nuwEhUOENa5lheoEz8qFzviafJ6iwANyHJ+l8BoXf+JQR1CnoC08E Gooa/d6ogCRffOamKIAySGCYcMrmHs3bOLE2fo/Vnaeq20c0Qzo3dLg+JxIGNMuF9nucxQ IwMk++DOFolqbRM6/0fAklLb7BMoYhoCiD6XenQTS1rMbaO3AdUUiJ5VcfnrRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #23 from Bane Ivosev --- Mark, i just tried your patch and i don't have stale file handle anymore. Great. I'll do more testing. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 18:59:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mkczg1JdXz4ddK9 for ; Fri, 7 Oct 2022 18:59:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mkczg0JkDz3RvL for ; Fri, 7 Oct 2022 18:59:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mkczf6P0FzhbM for ; Fri, 7 Oct 2022 18:59:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297IxApT083385 for ; Fri, 7 Oct 2022 18:59:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297IxAgA083384 for fs@FreeBSD.org; Fri, 7 Oct 2022 18:59:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 18:59:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bane.ivosev@pmf.uns.ac.rs X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665169151; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jgH2pwK0FJtRZtx/H1PBPbkdNjmp7o+Q61xaejLuh8Q=; b=OavIdHrXm+ap4d3sI7wyPVmJd48tpodqI8Nd0uZm0j/3u/w+7uPSTQTaOFjWmyN06G9qef ERb3ru+rtxoZgvO+PTzQNYBwTOK/VZEZZE2YhVezPXn0BXJ5zn/YMup3fq+vBQg6ewbx8e t/5CzQcxNozP2fNH6HClCr5iX00m8J0QL4oOSbtiwJzAVyiFVs7/IEuN3qzHcaYai27eXX Kd0CGUhfCJE2/MsOyKAyay37MVrIPVfwq9p2oV7a0Iz2gBIYeQmqk4ZvFK/bk3byAhw8kK LDbulAYy280aACiJ8ZDQlBx1YE8iDXARB8uL7sIvqVcqzMQI3yNJRw5vqmqKkg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665169151; a=rsa-sha256; cv=none; b=lWw+aIJKTTWqulcvDl9CMaCN1dw7kYfMSMGY5FskBQO4THOQxP4phn7CHqb2MVuLdZSRfK tiu6OSFL1sQa5RY8LBTd7Wd7XMvkwdllDf2GJjSv5V5omyx254l/AMxFvk0dPYhu5VX3TU dY5pWU8/Lfm8yaKcgyxr8iAFtFjfocGvVBYNMNb+ytsl/oWWHcbHp8T6volIvkShpSM7GP O2IOON904NmO65o+BVIOFutIUmLMKh0Jt2WBLgSVWkaLYoLzRYg/XqdhYC/6BAF0BhiCKe Zap1WUQc2WIW8TkS8pbMcFPpBZ3GBH/YuRjJYyGaCVX+b08Aigf5aRvrDwPp4A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #24 from Bane Ivosev --- I run tests in VMs, 13.1-RELEASE-p2 source, applied patch - if (fidp->fid_len =3D=3D LONG_FID_LEN && (fid_gen > 1 || setgen != =3D 0)) { + if (fidp->fid_len =3D=3D LONG_FID_LEN && setgen !=3D 0) { + ZFS_EXIT(zfsvfs); make kernel, and then nfs mount from 12/13 client and ls .zfs/snapshot/snap= 1. Everything is working normal, no more stale file handle and freeze at the server side. Thanks Mark! --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Oct 7 19:43:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MkdyM5TGzz4dk0l for ; Fri, 7 Oct 2022 19:43:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MkdyM3JzLz3WLq for ; Fri, 7 Oct 2022 19:43:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MkdyM2NflzjD5 for ; Fri, 7 Oct 2022 19:43:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 297Jh7P2041711 for ; Fri, 7 Oct 2022 19:43:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 297Jh7wf041710 for fs@FreeBSD.org; Fri, 7 Oct 2022 19:43:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Fri, 07 Oct 2022 19:43:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665171787; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ChkYmbBCJrnWv/cVKqTvegaL4W/JC68Xi7GIMQdVKDU=; b=QhZZaq/Jfn4keADVvmGAp05EF+TLPDoy7QtUxcjj73UgPagzt2MCuuOdW2e9/Ze+dXouHk dkaKs7HgXdAXGonwLBW4XoM7cO8uWP+P8Lb9Cp3t58X919jykarpUTA1GGcXmm7Ylzh1yk sQPbE5+HZq9kXCk6UtbwLrLMXhP4gbZ+UeY5e7QudZ1FipgY0QBTnHucaeNnjGD21KP7tY Uco2sBo7dTwVDzjk1TdtPKEM2XSqnX8iV9OxzWOFHD0sZgmjbHw5undXx5C+YRwffZGHWn rddmRqz+boiC8KM4uaUpXDVByuE7DGxsv3jNpkGAbZfOuS1sQgb2VkvPjxkmSQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665171787; a=rsa-sha256; cv=none; b=XjhAaHe/eXaAMSvoCBKDNjd3fFEto7F4aJ/ejpDPgzLAxoxW0ZZWUPEwv3jtAupLIC456x /j59WH4Ts/Of+ZE7inTCGFy+nPdGJZKMeF6WZDTj6529JdB+rel16z0pKyUL/qaarGly3g f/cH0qT3cInBtJmYu67NfnXxe/WdkeuXxftGYd+/efLcpgdu8sRxKiLEw6upgcWW0TdnYl tGnYbJtgneK1dEuQpfgRBmwUD5om5a7XUz+Co9nJaq2UoWJ1ZDwTzn83ZPEBL6tSO9o+KH +vhmJwMb12eUuq5usx5yzyBIGFRoD5T2M6LxqbI0h/64QcyVITS2J/8XmXiZrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #25 from eborisch+FreeBSD@gmail.com --- (In reply to florian.millet from comment #22) I have the _exact_ same changes (git blob hashes from 'git diff' match), an= d it is working for me. (Access to snapshots over NFS succeeds; zfs doesn't hang; can destroy entered-via-nfs snapshots.) What's your 'uname -a' look like? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 8 16:37:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ml9nj0jfyz4V4Vg for ; Sat, 8 Oct 2022 16:37:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ml9nh6pfcz42Bf for ; Sat, 8 Oct 2022 16:37:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ml9nh5KHxz10sB for ; Sat, 8 Oct 2022 16:37:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 298GbSgx063480 for ; Sat, 8 Oct 2022 16:37:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 298GbSig063479 for fs@FreeBSD.org; Sat, 8 Oct 2022 16:37:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Sat, 08 Oct 2022 16:37:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: florian.millet@laposte.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665247049; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e582UZBkB/1cXKWk9Pc/BzNsWeyLwIkE3NIGNwyqqJw=; b=nZJ8HunRw+2T/YtYAdL2yvStT6Gf6suYfJBXECMY03Q9WY41TSnd64aSRue02dgy4JCGXn 4cvvTVE23GqBnRzhpf4nn6VIQVzqkq/IBkvVUb61HcQ8Gf3+5NzGU7eHCgUeRdtHXPEizd U8WCS95qubAMsScpd3IxXODzefw6bJ5iwFyQevrvMtItaXgJzBeNlUyG8PYMN/Lh3DExl9 G3GiTJBwPD/pzHjwXxzLnuDLYngVvE76i8Xv1ObhX58ZuMX0ndRPm2cesahZ9vIEiMYLuB wgo3rw07dSFMSe7h+2YpICtAeln2tgncIu6EnUhD6NxP52t5fF9jeRCcU73GDQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665247049; a=rsa-sha256; cv=none; b=Y7N8GojnXdX5mkj2k2h66N6B923a3x2B85FOYP26VBP9hut3SD+Xw8NwlwS6tdEnVE1YRV T7sDVuLZgZWI6VQWC/ekiV6uFFvgu1eKb5dgGezxfXKvnWC0VT0vV7Yc1xwWvO+3DupQq2 0Wg/TzW3Ahf7dLycpm7hUTLHDDWqSU9o+WBzQ095QtlhLnFg6g7OgSjtFhZ62SncOM9sKf u6rrVHiZJ3NkTuTCdHE2z1Zcy2891xUXhxcl+tt40mti9Cju4+++zTCvcJGmZ/r9QgQbYL clgPyjdBeKQyuKXh97OjJ3+JqONhYopKm8SHOvz7gku1epBc4wiEBlYeDOW3mA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #26 from florian.millet@laposte.net --- (In reply to eborisch+FreeBSD from comment #25) My test environment is far from being standard so I must have made a mistak= e, let me retry monday from scratch to see if I can reproduce my NFS problems. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 9 08:27:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MlZsg6qyjz4f6hs for ; Sun, 9 Oct 2022 08:27:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MlZsg5f9Jz4LSd for ; Sun, 9 Oct 2022 08:27:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MlZsg4jjnz1CtW for ; Sun, 9 Oct 2022 08:27:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2998RJ4w043484 for ; Sun, 9 Oct 2022 08:27:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2998RJhP043483 for fs@FreeBSD.org; Sun, 9 Oct 2022 08:27:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Sun, 09 Oct 2022 08:27:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nomad@neuronfarm.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665304039; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RXYoFombCgFoxuA0RKLAmYnZ2UEJ5eoM4Lkj3uaBKqw=; b=HNpZjdMpLSqhz5O7oT8cytUNiIURyqhZAyqxgBPGF+esjkfA0h1EPUo8ZANZ7gBH9/eGxX feylVAJZ6e0ap6IOWtTpmOWMeuh9PDhHbryWSMBvZKuyz90DRlIfwIK1IwFtoEpVAe6SZ6 zNNAuB/c2wUbPHPyw0CNF1ATGBNEILS//BHH9qFI0xnYB5X1o9H45uJkMt3D1oyAN6dPpz EJF1xWV08F33xXtsgFtv9qmZYaoxG7eNNIDdQgzEDD687rDGFhSRQeoVTCRfGpfeoc0gwM Bb1aF36ny6rfv6OPno8k/t0pxzBKPjaEg5kUCJQGAryll947ijt5Z9i/l40jWw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665304039; a=rsa-sha256; cv=none; b=UByeN2XRyzgpEEpTD5YzdRS5fK5eLGbOQmzUFrWJ8ej5T2nNNuhUsboppj8G40Kd0ClOJU AkFLW57DCc6WdgCbxfFQx73LdulXaHjfRLM0j1QFi6AhxPejpdl6zRiYex0yaaAj8oxLE3 Bn14uzJDmNdR3Az1R55wGxA8UWjBKEvqzvnbG3B1JoCvKmdXDncl9ogcvgdWb50PZM/3MF vLSaUu83H0sFVqJ9ollJOQW/wNKZmSOShiSEL7qLDLwiuPHrBODePHBw+MheZK/J14t2sB 33ptX3iPMRhgD7u1jJv52ainvuctTottm0vwXizxFzPjl9ElGBm9LeCUpxFqBQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #27 from Michel Le Cocq --- Thanks to all of you for all this work. I'd like also to test. Can you give me a process to do that !? Thanks --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 9 21:00:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MlvZR4bJCz4fWhT for ; Sun, 9 Oct 2022 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MlvZR1nGgz3jCK for ; Sun, 9 Oct 2022 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MlvZQ6R3MzPgY for ; Sun, 9 Oct 2022 21:00:14 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 299L0EZk093763 for ; Sun, 9 Oct 2022 21:00:14 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 299L0Eou093762 for fs@FreeBSD.org; Sun, 9 Oct 2022 21:00:14 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202210092100.299L0Eou093762@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 9 Oct 2022 21:00:14 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16653492145.a29C.92041" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665349215; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=FCKnu9/M11r7bhF1c0IqdwVdZA5lNYmNPV5IPmQzIpE=; b=nH9uqvEjbSvY/DrLfF7QRHiEzjEFSBuPuFtWXCTPmen9ARf8RKBu0AG8Lt6GWDumGYsxz1 UQyekf3JTtt220TIQBybHEgjsjWCbanWwRhU3YXm1J/UIRRVWAOEisaYdgTqyy4hnvn24j sas+Xn1I8lzLjqNpgHu1AGpHrmExb9Iy0m+zRI3psOpZWTjHfxQRD3+bI9sJDzR60TaJd/ 0e935K0dQ0dcjWnCVwbrsYRxP0SypigqBwnnChiBvYjMmPf0F/zAkbqWiVzUaS3RGUUzFF N79Az5pCcJmQSu2b3CGpfG+5oisolp45Wdax7l4/JagnUDzAm49dDJRlA0Qu+g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665349215; a=rsa-sha256; cv=none; b=F5aF0dVTZ+aRGCsZKuXu94t+G/VabuFsh4UzOm4xEprDmxMdo0/IqlZYVu3c/uAgYq0l/a fv5PmvHD9hjYfc64OuAxcgIMoBrxs259RLeFZc6baYzgsxDOJA2q13Ysk9puwBw8YVk1J5 O7xqy5k1U5avzTz3UL/KfI5PQIwWKCinR9DlhySnvdTgIWGRfnPnj3TrIkefmrvQFPuQyz B8FRbfeRSArnjpuAKvan71vFXtHvrWRFnB7eZyDDR6dGYJDm3q/3qR5tTDaPxpvhQA7wJf wqYEYGLrkmlXB+j5djA+YOnggHtTuQo1VooDvfyALnWeQ0+qgQp/6neKaAeAcg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16653492145.a29C.92041 Date: Sun, 9 Oct 2022 21:00:14 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 8 problems total for which you should take action. --16653492145.a29C.92041 Date: Sun, 9 Oct 2022 21:00:14 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

8 problems total for which you should take action.
--16653492145.a29C.92041-- From nobody Mon Oct 10 10:40:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmFmW3pCHz4f6wc for ; Mon, 10 Oct 2022 10:40:11 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: from mail-yw1-x112c.google.com (mail-yw1-x112c.google.com [IPv6:2607:f8b0:4864:20::112c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmFmV6PHbz3lkc for ; Mon, 10 Oct 2022 10:40:10 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: by mail-yw1-x112c.google.com with SMTP id 00721157ae682-35711e5a5ceso96458617b3.13 for ; Mon, 10 Oct 2022 03:40:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=c8RXLSageFj3bVdb0lYQSRlTW9bRzmFILR5YC0EXVPc=; b=erPlXSTjD/2lGwJoV+a9L65cIGsxTfoZdvCnaOeG7YugYKu8aGtiHYcGHWURlTGRw0 X2XP+MJwHI5FfTCwL7hwsZZ4bGPUTysUivgBwj0w4GzUZE0xrT+xeRnQTXmCOkM21Yzu yb0gpW4+214gDUY49xMvXSwzwnSyYNzoXwsbbmiThSjk1U1stR6TdM5buhXP3YUcnjrf q3d34FLEaoy2koy+VBaBknmrVFCxJTnxniQmEV1zmm3Y3SlAm3LzOUTExVDHr/JgBTea eVUFVPCZElyr1nVWXsRYcSFJqi2cBDeJOSlPgcWnunZ+b3vhqJCZdxlDKkWleQoGM8xS 2Ftg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=c8RXLSageFj3bVdb0lYQSRlTW9bRzmFILR5YC0EXVPc=; b=JsGXxnb4A7PeRZ+sb+eVijzd0ZzAPoTw+gEPwuBBN+M1ItBezsVj3IjRVu5TC7/Uim 7CDc2x3yCFEDwGN/JVszn52BlxVDL/wkacbyI1V6cdN9CW0B2dxmpxLfbhwEltc7S4Zq qj4TsCpC9u2qonNbEXnY27U09wb8hX2IW2Tlp5rLhHLaNiTcoZiPP+FKlFcO/AK3h0h7 Dke2aSXZLrTG9vTfR0VxiNCNgf0vzL8VOu1Fd/20weW+IYKpoykMuywMX/yFRBDhLrAi 3LA0IM19XbbKHR7bucIZItAoTz1yLMu5i4OFnzTSr0pJ+F+V90S/mzV9jial2xx3UI5H DltA== X-Gm-Message-State: ACrzQf0+NeYMo4x5Bond52eQDHmh5FU14Kym6yH2+aqDxG6lyDnDBZXX T3sh5eiATj82cAPkKEg4Vup+hJDLEaLO/TP9cuWiukmYAK4= X-Google-Smtp-Source: AMsMyM4zbpWQIiIpesqA9byStaeEmqquIhQPpGav+f/9hlk7CzKXMhaahCil9L++h04juqps7mu0NChhx1bX3T/8XzU= X-Received: by 2002:a81:698a:0:b0:356:4bc:9ebf with SMTP id e132-20020a81698a000000b0035604bc9ebfmr16918377ywc.53.1665398410057; Mon, 10 Oct 2022 03:40:10 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Archimedes Gaviola Date: Mon, 10 Oct 2022 18:40:00 +0800 Message-ID: Subject: UFS in a USB flash drive (ufs:/dev/da0s1a) To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="000000000000a41d3e05eaabc84b" X-Rspamd-Queue-Id: 4MmFmV6PHbz3lkc X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=erPlXSTj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of archimedes.gaviola@gmail.com designates 2607:f8b0:4864:20::112c as permitted sender) smtp.mailfrom=archimedes.gaviola@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112c:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000a41d3e05eaabc84b Content-Type: text/plain; charset="UTF-8" Hi, I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process? ... Trying to mount root from cd9660:/dev/map/rootfs.uzip []... mountroot: waiting for device /dev/map/rootfs.uzip... Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. Loader variables: Manual root filesystem specification: : [options] Mount using filesystem and with the specified (optional) option list. eg. ufs:/dev/da0s1a zfs:tank cd9660:/dev/cd0 ro (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) ? List valid disk boot devices . Yield 1 second (for background tasks) Abort manual input mountroot> ... Thanks and best regards, Archimedes --000000000000a41d3e05eaabc84b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,

I have a scenario (see= =20 below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from=20 scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step=20 reference(s) that can help and guide me in the building process?
=
...
Trying to mount root from cd9660:/dev/map/rootfs.uzip= []...
mountroot: waiting for device /dev/map/rootfs.uzip...
Mounting= from cd9660:/dev/map/rootfs.uzip failed with error 19.

Loader varia= bles:

Manual root filesystem specification:
=C2=A0 <fstype>= :<device> [options]
=C2=A0 =C2=A0 =C2=A0 Mount <device> usin= g filesystem <fstype>
=C2=A0 =C2=A0 =C2=A0 and with the specified = (optional) option list.

=C2=A0 =C2=A0 eg. ufs:/dev/da0s1a
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 zfs:tank
=C2=A0 =C2=A0 =C2=A0 =C2=A0 cd9660:/dev/cd= 0 ro
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (which is equivalent to: mount -= t cd9660 -o ro /dev/cd0 /)

=C2=A0 ? =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 List valid disk boot devices
=C2=A0 . =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Yield 1 second (for background tasks)=C2=A0 <empty line> =C2=A0 =C2=A0Abort manual input

mountroot= >
...

Thanks and best = regards,
Archimedes
--000000000000a41d3e05eaabc84b-- From nobody Mon Oct 10 11:11:10 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmGSR12Pqz4f9yS for ; Mon, 10 Oct 2022 11:11:19 +0000 (UTC) (envelope-from SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmGSQ172bz3n6j for ; Mon, 10 Oct 2022 11:11:18 +0000 (UTC) (envelope-from SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl) Date: Mon, 10 Oct 2022 13:11:10 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1665400270; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=uGZprFz/Shf5XwltsTYDyWH1DaVd9iqq36ddktXIJJw=; b=IA2LiVuEMFnf/Mzq4cbLSFsRZrnq3UX/ils9QWj+dWMN8qlclB2LwvJ6QjExWY3piXvhTh OnajceXUWdKtQiAeclZPAmy1jUj7VVVToiV7zOLX5mbQAeLHnITNArPtyx53RN24cEYmqf slfjySHsX+5kslhrt8KG6sC5CYSE6v3EBQKR6mzXHhM+Zjo655QDqYA1MvR2Uxwtes0Yk/ +1zLjjc3sfPcMSNQZ0WM+NTmTbaqFTNQJSHqTmQwtXKiYlELXWVCogdn8VBTuLpAktuLrT v5Q0+6WSpdnshX9GyNiciTAWW9JPuPSQ07DpnJWBm3kz63smAnV8RRFNhHdQMQ== From: Ronald Klop To: Archimedes Gaviola Cc: freebsd-fs@freebsd.org Message-ID: <1630032913.129053.1665400270350@localhost> In-Reply-To: References: Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_129052_1213203895.1665400270294" X-Mailer: Realworks (627.29) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 4MmGSQ172bz3n6j X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=IA2LiVuE; dmarc=pass (policy=quarantine) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of "SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl" designates 194.109.157.24 as permitted sender) smtp.mailfrom="SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl" X-Spamd-Result: default: False [-3.16 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; NEURAL_HAM_SHORT(-0.97)[-0.971]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[ronald-lists@klop.ws,SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_X_PRIO_THREE(0.00)[3]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[ronald-lists@klop.ws,SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl] X-ThisMailContainsUnwantedMimeParts: N ------=_Part_129052_1213203895.1665400270294 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: Archimedes Gaviola Datum: maandag, 10 oktober 2022 12:40 Aan: freebsd-fs@freebsd.org Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a) > > Hi, > > I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process? > > ... > > > Trying to mount root from cd9660:/dev/map/rootfs.uzip []... > mountroot: waiting for device /dev/map/rootfs.uzip... > Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. > > Loader variables: > > Manual root filesystem specification: > : [options] > Mount using filesystem > and with the specified (optional) option list. > > eg. ufs:/dev/da0s1a > zfs:tank > cd9660:/dev/cd0 ro > (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) > > ? List valid disk boot devices > . Yield 1 second (for background tasks) > Abort manual input > > mountroot> > > ... > > Thanks and best regards, > Archimedes Hi, >From your mail I don't really understand what your level of skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is not your biggest concern. You just want to install on a USB flash drive. Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ? Regards, Ronald. ------=_Part_129052_1213203895.1665400270294 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit  

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 12:40
Aan: freebsd-fs@freebsd.org
Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a)

Hi,
 
I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process?
 
...
 
 
Trying to mount root from cd9660:/dev/map/rootfs.uzip []...
mountroot: waiting for device /dev/map/rootfs.uzip...
Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19.

Loader variables:

Manual root filesystem specification:
  <fstype>:<device> [options]
      Mount <device> using filesystem <fstype>
      and with the specified (optional) option list.

    eg. ufs:/dev/da0s1a
        zfs:tank
        cd9660:/dev/cd0 ro
          (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /)

  ?               List valid disk boot devices
  .               Yield 1 second (for background tasks)
  <empty line>    Abort manual input

mountroot>
 
...
 
Thanks and best regards,
Archimedes


Hi,

>From your mail I don't really understand what your level of skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is not your biggest concern. You just want to install on a USB flash drive.

Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ?

Regards,
Ronald.
  ------=_Part_129052_1213203895.1665400270294-- From nobody Mon Oct 10 12:09:02 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmHlG6D8sz4fHcb for ; Mon, 10 Oct 2022 12:09:14 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: from mail-yw1-x112c.google.com (mail-yw1-x112c.google.com [IPv6:2607:f8b0:4864:20::112c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmHlG07B7z3rvb for ; Mon, 10 Oct 2022 12:09:14 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: by mail-yw1-x112c.google.com with SMTP id 00721157ae682-35711e5a5ceso98270767b3.13 for ; Mon, 10 Oct 2022 05:09:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Y83avL+/UpLDj7hVJlVlYOselKm+vRehxcpNBQzQ7AM=; b=oKm22m3DLu+O+HvSERotu+iOHhFO1WsRX+mXu2ZkRLT5mkQCcLg0I67x5/byLXj7sl odL9ecT/6EvgwRIU4zs9+LBCw8Jjoq8DYGOpcgBVosyxxK9/xMBJdnQWQUcjt8VDnWVc k6DGV5GpXTPUFDkR89qHFbeI1yIOKV8WkahKYZlAQK+3Id6Xf6Yfgst6sUx0WVFkgZlb EbWMhtvPbDenUwnfDLaKtThhtyf4Q2/eNTqC0CV0FyxlnJYj+LR2OYBgWEj9Ctunmgv0 /OCtp0gSFbwbTZixaehbZbJiJWSA5NhwXs5NI+tXYKwoo3vM1082v06S6JOVFpnszXlm 9i3w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Y83avL+/UpLDj7hVJlVlYOselKm+vRehxcpNBQzQ7AM=; b=o1TlVtRH8ae2TBCcYTl9R3gQnKY7mTsD8NcnJnIuwC0lpz+Doftx+l3ZLQZuCyS2br KTcOjkYGRTdAoLZDVIgYsBQv7YGVPToRHGanoOEpoSOFU52BU8nZA4VSi0Lg3DNzJRnn SnJ3Pj05AbEa6j6MpsTTYNoW1+4P+ghbiJKX2gFsZbZDOKZioMkZ5siD+NfE2VkpcRUD YEZYC7KFKVxXTWQqwQ3yp/6nQZEQcZkhMO8SdBpq8eB5prYtzZMLpa106Ern0A3h7uhJ N7dkumjBUEdl3Mn1N1bLJN2OPt97hlFzHoBbI1RoRrrSLVbUQX+mZWzOGDwgneGApY0g 1PWQ== X-Gm-Message-State: ACrzQf2HbTbggcHXpx6yl85SZYGBBcj0sLT1HU/7bv6NzM3j6KjePTQ7 W47rp4xmufYLrA4X9fap5s74CmeZK/wQKKyyvtvSnpxY+p4= X-Google-Smtp-Source: AMsMyM5qjxcNgYH+hYcaOzyACe1Gt+XpNtvbmRnUwyb7iY/p4PWp/ACG/jqCeR2NfmpfQ6357nj4WAJfrPU2DIRD1J8= X-Received: by 2002:a81:1b41:0:b0:360:84ff:4409 with SMTP id b62-20020a811b41000000b0036084ff4409mr9201105ywb.233.1665403752062; Mon, 10 Oct 2022 05:09:12 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1630032913.129053.1665400270350@localhost> In-Reply-To: <1630032913.129053.1665400270350@localhost> From: Archimedes Gaviola Date: Mon, 10 Oct 2022 20:09:02 +0800 Message-ID: Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) To: Ronald Klop Cc: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="0000000000000ca4a705eaad07a4" X-Rspamd-Queue-Id: 4MmHlG07B7z3rvb X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=oKm22m3D; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of archimedes.gaviola@gmail.com designates 2607:f8b0:4864:20::112c as permitted sender) smtp.mailfrom=archimedes.gaviola@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112c:from]; ARC_NA(0.00)[]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --0000000000000ca4a705eaad07a4 Content-Type: text/plain; charset="UTF-8" On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop wrote: > > > *Van:* Archimedes Gaviola > *Datum:* maandag, 10 oktober 2022 12:40 > *Aan:* freebsd-fs@freebsd.org > *Onderwerp:* UFS in a USB flash drive (ufs:/dev/da0s1a) > > Hi, > > I have a scenario (see below) after which the FreeBSD kernel boots-up in > my embedded system, it is looking for the root filesystem. Now, I want to > build one from scratch based on the examples below using a UFS filesystem > in a USB flash drive -> ufs:/dev/da0s1a. Are there any available > step-by-step reference(s) that can help and guide me in the building > process? > > ... > > > Trying to mount root from cd9660:/dev/map/rootfs.uzip []... > mountroot: waiting for device /dev/map/rootfs.uzip... > Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. > > Loader variables: > > Manual root filesystem specification: > : [options] > Mount using filesystem > and with the specified (optional) option list. > > eg. ufs:/dev/da0s1a > zfs:tank > cd9660:/dev/cd0 ro > (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) > > ? List valid disk boot devices > . Yield 1 second (for background tasks) > Abort manual input > > mountroot> > > ... > > Thanks and best regards, > Archimedes > > > > Hi, > > From your mail I don't really understand what your level of skills with > FreeBSD is. I assume the scenario with cd9660 and error 19 is not your > biggest concern. You just want to install on a USB flash drive. > > Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ? > > Regards, > Ronald. > > Hi Ronald, No, it's not about installing FreeBSD from scratch using a USB flash drive as I already flashed and installed the FreeBSD kernel in the SPI flash RAM using trivial FTP in the U-boot loader. What I want is mounting the root filesystem that's been created in the USB flash drive (this hardware has USB port) using the ufs:/dev/da0s1a method but before that happens, I need to create that root filesystem (/) from scratch in the USB flash drive so that it can be mounted right after the kernel is loaded. Not sure what level I am as a FreeBSD user but I can install and setup FreeBSD system, networking, install packages and re-build or compile a kernel. Thanks and best regards, Archimedes --0000000000000ca4a705eaad07a4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Oct 10, 2022 at 7:11 PM Ronal= d Klop <ronald-lists@klop.ws= > wrote:
=C2=A0

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 12:40
Aan: fre= ebsd-fs@freebsd.org
Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a)

Hi,
=C2=A0
I have a scenario (see below) after which the FreeBSD kernel boots-up = in my embedded system, it is looking for the root filesystem. Now, I want t= o build one from scratch based on the examples below using a UFS filesystem= in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-b= y-step reference(s) that can help and guide me in the building process?
=C2=A0
...
=C2=A0
=C2=A0
Trying to mount root from cd9660:/dev/map/rootfs.uzip []...
mountroot: waiting for device /dev/map/rootfs.uzip...
Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19.

Loader variables:

Manual root filesystem specification:
=C2=A0 <fstype>:<device> [options]
=C2=A0 =C2=A0 =C2=A0 Mount <device> using filesystem <fstype> =C2=A0 =C2=A0 =C2=A0 and with the specified (optional) option list.

=C2=A0 =C2=A0 eg. ufs:/dev/da0s1a
=C2=A0 =C2=A0 =C2=A0 =C2=A0 zfs:tank
=C2=A0 =C2=A0 =C2=A0 =C2=A0 cd9660:/dev/cd0 ro
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (which is equivalent to: mount -t cd9660= -o ro /dev/cd0 /)

=C2=A0 ? =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 List valid disk b= oot devices
=C2=A0 . =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Yield 1 second (f= or background tasks)
=C2=A0 <empty line> =C2=A0 =C2=A0Abort manual input

mountroot>
=C2=A0
...
=C2=A0
Thanks and best regards,
Archimedes


Hi,

>From your mail I don't really understand what your level of skills with= FreeBSD is. I assume the scenario with cd9660 and error 19 is not your big= gest concern. You just want to install on a USB flash drive.

Does this help: https://docs.freebsd.org/en/books/handbook/bsdins= tall/ ?

Regards,
Ronald.
=C2=A0

Hi Ronald,

No, it's not about installing FreeBSD from scratch usi= ng a USB flash drive as I already flashed and installed the FreeBSD kernel = in the SPI flash RAM using trivial FTP in the U-boot loader. What I want is= mounting the root filesystem that's been created in the USB flash driv= e (this hardware has USB port) using the ufs:/dev/da0s1a method but before that happens, I need to create that root = filesystem (/) from scratch in the USB flash drive so that it can be mounte= d right after the kernel is loaded.

Not sure w= hat level I am as a FreeBSD user but I can install and setup FreeBSD system= , networking, install packages and re-build or compile a kernel.
=
Thanks and best regards,
Archimedes

<= /div>
--0000000000000ca4a705eaad07a4-- From nobody Mon Oct 10 13:39:32 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmKlX37Xhz4fS03 for ; Mon, 10 Oct 2022 13:39:36 +0000 (UTC) (envelope-from SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmKlV3JZDz3xl6 for ; Mon, 10 Oct 2022 13:39:34 +0000 (UTC) (envelope-from SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl) Date: Mon, 10 Oct 2022 15:39:32 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1665409172; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ElWEMos4ud9l6DrnYc32nBR+PslRZ2OlDyVD1EKHt3c=; b=up610SQKtIhaG3P4XJQ7IszNEFmtUYykli1/BLu17/oLIJDpaVZOZc6XCUB/otg09RibwE Mkt0p2RYiKe++OBQYUsPfLUMQZdTFQPifgBQjPaR7bBElpnLA32Qi5VQpF5KMjLrqE0qbz 3W5NOgJGqcv/YYaP+KOIvwl+HeEJTyx/UH5G7qBAEZuU0/i1sL+459lHtzOI3pr6njF7fx LYHUGZpAp1iY01SwO9b60phCKUen9K0MoBYb+v65ksYAtoM3Euayre+m5Lz7fSwLZKwE2R StO7Jsti7fL8PS4wxmMGexmwOAWjUpZoAxy7x3Q9OKbbRQfSOxsv/8mA1ZaaIg== From: Ronald Klop To: Archimedes Gaviola Cc: freebsd-fs@freebsd.org Message-ID: <896114746.217581.1665409172569@localhost> In-Reply-To: References: <1630032913.129053.1665400270350@localhost> Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_217580_2099596757.1665409172565" X-Mailer: Realworks (627.29) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 4MmKlV3JZDz3xl6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=up610SQK; dmarc=pass (policy=quarantine) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of "SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl" designates 194.109.157.24 as permitted sender) smtp.mailfrom="SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl" X-Spamd-Result: default: False [-3.13 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; NEURAL_HAM_LONG(-0.94)[-0.943]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[ronald-lists@klop.ws,SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_X_PRIO_THREE(0.00)[3]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[ronald-lists@klop.ws,SRS0=7aXz=2L=klop.ws=ronald-lists@realworks.nl] X-ThisMailContainsUnwantedMimeParts: N ------=_Part_217580_2099596757.1665409172565 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: Archimedes Gaviola Datum: maandag, 10 oktober 2022 14:09 Aan: Ronald Klop CC: freebsd-fs@freebsd.org Onderwerp: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) > > > > On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop wrote: >> >> >> Van: Archimedes Gaviola >> Datum: maandag, 10 oktober 2022 12:40 >> Aan: freebsd-fs@freebsd.org >> Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a) >>> >>> Hi, >>> >>> I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process? >>> >>> ... >>> >>> >>> Trying to mount root from cd9660:/dev/map/rootfs.uzip []... >>> mountroot: waiting for device /dev/map/rootfs.uzip... >>> Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. >>> >>> Loader variables: >>> >>> Manual root filesystem specification: >>> : [options] >>> Mount using filesystem >>> and with the specified (optional) option list. >>> >>> eg. ufs:/dev/da0s1a >>> zfs:tank >>> cd9660:/dev/cd0 ro >>> (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) >>> >>> ? List valid disk boot devices >>> . Yield 1 second (for background tasks) >>> Abort manual input >>> >>> mountroot> >>> >>> ... >>> >>> Thanks and best regards, >>> Archimedes >> >> >> Hi, >> >> From your mail I don't really understand what your level of skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is not your biggest concern. You just want to install on a USB flash drive. >> >> Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ? >> >> Regards, >> Ronald. >> > > > Hi Ronald, > > > No, it's not about installing FreeBSD from scratch using a USB flash drive as I already flashed and installed the FreeBSD kernel in the SPI flash RAM using trivial FTP in the U-boot loader. What I want is mounting the root filesystem that's been created in the USB flash drive (this hardware has USB port) using the ufs:/dev/da0s1a method but before that happens, I need to create that root filesystem (/) from scratch in the USB flash drive so that it can be mounted right after the kernel is loaded. > > Not sure what level I am as a FreeBSD user but I can install and setup FreeBSD system, networking, install packages and re-build or compile a kernel. > > Thanks and best regards, > Archimedes Hi, To create the root filesystem on USB you can use several methods. 2 of them are like this: * the "bsdinstall" tool * or - fetch https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz (change the URL if you need a different architecture or FreeBSD version) - newfs /dev/da0s1a (NB: this device name might be different depending on the devices already available in your system) - mount /dev/da0s1a /mnt - tar xf -C /mnt /base.txz - umount /mnt This is from the top of my head, so I might have forgotten something. Than plugin the USB on your embedded system and at the prompt type: mountroot> ufs:/dev/da0s1a If it does not work type a "?" question mark to see what filesystems are available. If you want to persist the FS used as root filesystem it depends on the system you are running. You can hardcode the root FS in the kernel you saved in the SPI RAM. But depending on the system it is also possible to pass the rootfs in a variable in loader.conf or some other place from which the kernel can read variables. What kind of system are you running? Hope this helps. Regards, Ronald. ------=_Part_217580_2099596757.1665409172565 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit  

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 14:09
Aan: Ronald Klop <ronald-lists@klop.ws>
CC: freebsd-fs@freebsd.org
Onderwerp: Re: UFS in a USB flash drive (ufs:/dev/da0s1a)

 
 
On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop <ronald-lists@klop.ws> wrote:
 

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 12:40
Aan: freebsd-fs@freebsd.org
Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a)

Hi,
 
I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process?
 
...
 
 
Trying to mount root from cd9660:/dev/map/rootfs.uzip []...
mountroot: waiting for device /dev/map/rootfs.uzip...
Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19.

Loader variables:

Manual root filesystem specification:
  <fstype>:<device> [options]
      Mount <device> using filesystem <fstype>
      and with the specified (optional) option list.

    eg. ufs:/dev/da0s1a
        zfs:tank
        cd9660:/dev/cd0 ro
          (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /)

  ?               List valid disk boot devices
  .               Yield 1 second (for background tasks)
  <empty line>    Abort manual input

mountroot>
 
...
 
Thanks and best regards,
Archimedes


Hi,

>From your mail I don't really understand what your level of skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is not your biggest concern. You just want to install on a USB flash drive.

Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ?

Regards,
Ronald.
 
 
Hi Ronald,
 
 
No, it's not about installing FreeBSD from scratch using a USB flash drive as I already flashed and installed the FreeBSD kernel in the SPI flash RAM using trivial FTP in the U-boot loader. What I want is mounting the root filesystem that's been created in the USB flash drive (this hardware has USB port) using the ufs:/dev/da0s1a method but before that happens, I need to create that root filesystem (/) from scratch in the USB flash drive so that it can be mounted right after the kernel is loaded.
 
Not sure what level I am as a FreeBSD user but I can install and setup FreeBSD system, networking, install packages and re-build or compile a kernel.
 
Thanks and best regards,
Archimedes


Hi,

To create the root filesystem on USB you can use several methods. 2 of them are like this:
* the "bsdinstall" tool
* or
    - fetch https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz (change the URL if you need a different architecture or FreeBSD version)
    - newfs /dev/da0s1a    (NB: this device name might be different depending on the devices already available in your system)
    - mount /dev/da0s1a /mnt
    - tar xf -C /mnt <path-to>/base.txz
    - umount /mnt

This is from the top of my head, so I might have forgotten something.

Than plugin the USB on your embedded system and at the prompt type:
mountroot> ufs:/dev/da0s1a

If it does not work type a "?" question mark to see what filesystems are available.

If you want to persist the FS used as root filesystem it depends on the system you are running.
You can hardcode the root FS in the kernel you saved in the SPI RAM. But depending on the system it is also possible to pass the rootfs in a variable in loader.conf or some other place from which the kernel can read variables.

What kind of system are you running?

Hope this helps.

Regards,
Ronald.

  ------=_Part_217580_2099596757.1665409172565-- From nobody Mon Oct 10 16:15:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmPCJ6rLqz4fjW2 for ; Mon, 10 Oct 2022 16:15:24 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: from mail-yb1-xb36.google.com (mail-yb1-xb36.google.com [IPv6:2607:f8b0:4864:20::b36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmPCJ1LFxz4DsF for ; Mon, 10 Oct 2022 16:15:24 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: by mail-yb1-xb36.google.com with SMTP id 81so13530930ybf.7 for ; Mon, 10 Oct 2022 09:15:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=bq6ad8gI6nDldeHm57ua2h1eLfTEgv2Wfs1OqzoaeiQ=; b=YKd7tqcEgvQ0UebVPGcty9vRQQHtjC+jfKJ9Z2cGykjtWYkq1b6rCjnAjUAOhB66o+ JiFaRm+wbwrExqO6KLa9eAFoN3Z9RzvJW1kVpKCrcerI42hcSmJKB8VWntfUtpG5KMFq b2t0+fTXE/rmf4HaGV8inyre22z96b2QBIgh1t2C92fzWs+u4r6tfpYWPACzO6FOv1// EdBUWDJsqPXIus3thM6+YLd3aekkZhtOLpuxn75KFodWMV6Or6nke2AIbBoPTFk65+Ta jTUJqIKUQaKz9zR90Q+D3Qzl1S/AvOC8YvfOIWhafToRjLjv5sNISE+Nfq67whCGfJ4T SGNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=bq6ad8gI6nDldeHm57ua2h1eLfTEgv2Wfs1OqzoaeiQ=; b=EGkhv85+5GJEyEybkFOwc3DGYFjf6KFGOpkVqOHibPkyfnrHoSwQBzf6tINF0/sSE9 46W/nrHRpqxlQFbLI1Azv228kiPya0jCLpXXmEzG00sqNW+0E4dlv3ejfxfoiYdOGDXe iG3nqaPkch1/PxGc3jr2eFpO4TLKY3jJ5W4TRKfJZ2dDQvisFCAr2y9edGcU86MI9qvt zi9nAnRNb8+ZH2qr+v3uvQQnFtkk8ewGBy7EFn+z9vZQtgegzl204+LXLvulpdw/oZQ7 8X8drbGJx0Tu/navYM9JgQxOfB+N/UD7siuyDAcUtquaf7NZbFEBr8P+GskERWkwyMZF Dz2g== X-Gm-Message-State: ACrzQf23q3PFn2WaaY+Cx0IujW6/4gWBvRtqKBax1qif6i+zUezTgnXP WrylKOcRKM1mmB5AIzDIZXv7elvaHxoFvdwdIRXn4GQheFY= X-Google-Smtp-Source: AMsMyM60qYQss3zzdsNZK47A+A6vNzvbJ2MZ65fTRijwpJmte6tSMjWZm+prwQ9MJ1C9uNYNhTSKPUnM05Zc92hxnAE= X-Received: by 2002:a25:2d4a:0:b0:6be:bf20:27cb with SMTP id s10-20020a252d4a000000b006bebf2027cbmr19615878ybe.331.1665418522776; Mon, 10 Oct 2022 09:15:22 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1630032913.129053.1665400270350@localhost> <896114746.217581.1665409172569@localhost> In-Reply-To: <896114746.217581.1665409172569@localhost> From: Archimedes Gaviola Date: Tue, 11 Oct 2022 00:15:12 +0800 Message-ID: Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) To: Ronald Klop Cc: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="00000000000073d5ea05eab0778f" X-Rspamd-Queue-Id: 4MmPCJ1LFxz4DsF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=YKd7tqcE; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of archimedes.gaviola@gmail.com designates 2607:f8b0:4864:20::b36 as permitted sender) smtp.mailfrom=archimedes.gaviola@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b36:from]; ARC_NA(0.00)[]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --00000000000073d5ea05eab0778f Content-Type: text/plain; charset="UTF-8" On Mon, Oct 10, 2022 at 9:39 PM Ronald Klop wrote: > > > *Van:* Archimedes Gaviola > *Datum:* maandag, 10 oktober 2022 14:09 > *Aan:* Ronald Klop > *CC:* freebsd-fs@freebsd.org > *Onderwerp:* Re: UFS in a USB flash drive (ufs:/dev/da0s1a) > > > > On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop wrote: > >> >> >> *Van:* Archimedes Gaviola >> *Datum:* maandag, 10 oktober 2022 12:40 >> *Aan:* freebsd-fs@freebsd.org >> *Onderwerp:* UFS in a USB flash drive (ufs:/dev/da0s1a) >> >> Hi, >> >> I have a scenario (see below) after which the FreeBSD kernel boots-up in >> my embedded system, it is looking for the root filesystem. Now, I want to >> build one from scratch based on the examples below using a UFS filesystem >> in a USB flash drive -> ufs:/dev/da0s1a. Are there any available >> step-by-step reference(s) that can help and guide me in the building >> process? >> >> ... >> >> >> Trying to mount root from cd9660:/dev/map/rootfs.uzip []... >> mountroot: waiting for device /dev/map/rootfs.uzip... >> Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. >> >> Loader variables: >> >> Manual root filesystem specification: >> : [options] >> Mount using filesystem >> and with the specified (optional) option list. >> >> eg. ufs:/dev/da0s1a >> zfs:tank >> cd9660:/dev/cd0 ro >> (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) >> >> ? List valid disk boot devices >> . Yield 1 second (for background tasks) >> Abort manual input >> >> mountroot> >> >> ... >> >> Thanks and best regards, >> Archimedes >> >> >> >> Hi, >> >> From your mail I don't really understand what your level of skills with >> FreeBSD is. I assume the scenario with cd9660 and error 19 is not your >> biggest concern. You just want to install on a USB flash drive. >> >> Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ? >> >> Regards, >> Ronald. >> >> > > Hi Ronald, > > > No, it's not about installing FreeBSD from scratch using a USB flash drive > as I already flashed and installed the FreeBSD kernel in the SPI flash RAM > using trivial FTP in the U-boot loader. What I want is mounting the root > filesystem that's been created in the USB flash drive (this hardware has > USB port) using the ufs:/dev/da0s1a method but before that happens, I need > to create that root filesystem (/) from scratch in the USB flash drive so > that it can be mounted right after the kernel is loaded. > > Not sure what level I am as a FreeBSD user but I can install and setup > FreeBSD system, networking, install packages and re-build or compile a > kernel. > > Thanks and best regards, > Archimedes > > > > Hi, > > To create the root filesystem on USB you can use several methods. 2 of > them are like this: > * the "bsdinstall" tool > * or > - fetch > https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz > (change the URL if you need a different architecture or FreeBSD version) > - newfs /dev/da0s1a (NB: this device name might be different > depending on the devices already available in your system) > - mount /dev/da0s1a /mnt > - tar xf -C /mnt /base.txz > - umount /mnt > > This is from the top of my head, so I might have forgotten something. > > Than plugin the USB on your embedded system and at the prompt type: > mountroot> ufs:/dev/da0s1a > > If it does not work type a "?" question mark to see what filesystems are > available. > > If you want to persist the FS used as root filesystem it depends on the > system you are running. > You can hardcode the root FS in the kernel you saved in the SPI RAM. But > depending on the system it is also possible to pass the rootfs in a > variable in loader.conf or some other place from which the kernel can read > variables. > > What kind of system are you running? > > Hope this helps. > > Regards, > Ronald. > Hi Ronald, Thanks for sharing the information, really appreciate it! I will try the newfs (newfs /dev/da0s1a) with my USB drive and then afterwards mount it to the host system. I can't fetch the base system since I'm cross-compiling a 32-bit MIPS (mipsel) system in an older FreeBSD 11.4 x86_64 release. I just downloaded the kernel source (/usrc/src). What I have at the moment is a successful cross-build of a system using the build command below; cd /usr/src; make KERNCONF=RT305X TARGET=mips TARGET_ARCH=mipsel kernel-toolchain buildkernel buildworld installkernel installworld distribution DESTDIR=/tmp/rt3050 that instead of using the DESTDIR= /tmp/rt3050, I will try replacing it with a mounted /dev/da0s1a. And then let me also try building without the kernel. > Than plugin the USB on your embedded system and at the prompt type: > mountroot> ufs:/dev/da0s1a > > If it does not work type a "?" question mark to see what filesystems are available. Noted on this. > If you want to persist the FS used as root filesystem it depends on the system you are running. > You can hardcode the root FS in the kernel you saved in the SPI RAM. This is quite interesting but does it matter with the size of the SPI RAM as this system is only having 4MB? > But depending on the system it is also possible to pass the rootfs in a variable in loader.conf or some other > place from which the kernel can read variables. > > What kind of system are you running? > > Hope this helps. Again, this is a 32-bit MIPS system based on Ralink SoC. Apologize for this one because I know the FreeBSD project already phased-out this architecture platform in the -CURRENT builds and for support and it happens that I came late on this architecture and eager to learn and explore. Yes, the one you've shared means a lot to me. Let me try and get back on the progress. Thanks and best regards, Archimedes --00000000000073d5ea05eab0778f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Oct 10, 2022 at 9:39 PM Ronal= d Klop <ronald-lists@klop.ws= > wrote:
=C2=A0

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 14:09
Aan: Ronald Klop <ronald-lists@klop.ws>
CC: free= bsd-fs@freebsd.org
Onderwerp: Re: UFS in a USB flash drive (ufs:/dev/da0s1a)

=C2=A0
=C2=A0
On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop <<= a href=3D"mailto:ronald-lists@klop.ws" target=3D"_blank">ronald-lists@klop.= ws> wrote:
=C2=A0

Van: Archimedes Gaviola <archimedes.gaviola@gmail.com>
Datum: maandag, 10 oktober 2022 12:40
Aan: fre= ebsd-fs@freebsd.org
Onderwerp: UFS in a USB flash drive (ufs:/dev/da0s1a)

Hi,
=C2=A0
I have a scenario (see below) after which the FreeBSD kernel boots-up = in my embedded system, it is looking for the root filesystem. Now, I want t= o build one from scratch based on the examples below using a UFS filesystem= in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-b= y-step reference(s) that can help and guide me in the building process?
=C2=A0
...
=C2=A0
=C2=A0
Trying to mount root from cd9660:/dev/map/rootfs.uzip []...
mountroot: waiting for device /dev/map/rootfs.uzip...
Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19.

Loader variables:

Manual root filesystem specification:
=C2=A0 <fstype>:<device> [options]
=C2=A0 =C2=A0 =C2=A0 Mount <device> using filesystem <fstype> =C2=A0 =C2=A0 =C2=A0 and with the specified (optional) option list.

=C2=A0 =C2=A0 eg. ufs:/dev/da0s1a
=C2=A0 =C2=A0 =C2=A0 =C2=A0 zfs:tank
=C2=A0 =C2=A0 =C2=A0 =C2=A0 cd9660:/dev/cd0 ro
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (which is equivalent to: mount -t cd9660= -o ro /dev/cd0 /)

=C2=A0 ? =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 List valid disk b= oot devices
=C2=A0 . =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Yield 1 second (f= or background tasks)
=C2=A0 <empty line> =C2=A0 =C2=A0Abort manual input

mountroot>
=C2=A0
...
=C2=A0
Thanks and best regards,
Archimedes


Hi,

>From your mail I don't really understand what your level of skills with= FreeBSD is. I assume the scenario with cd9660 and error 19 is not your big= gest concern. You just want to install on a USB flash drive.

Does this help: https://docs.freebsd.org/en/books/handbook/bsdins= tall/ ?

Regards,
Ronald.
=C2=A0
=C2=A0
Hi Ronald,
=C2=A0
=C2=A0
No, it's not about installing FreeBSD from scratch using a USB fla= sh drive as I already flashed and installed the FreeBSD kernel in the SPI f= lash RAM using trivial FTP in the U-boot loader. What I want is mounting th= e root filesystem that's been created in the USB flash drive (this hard= ware has USB port) using the ufs:/dev/da0s1a method but before that happens= , I need to create that root filesystem (/) from scratch in the USB flash d= rive so that it can be mounted right after the kernel is loaded.
=C2=A0
Not sure what level I am as a FreeBSD user but I can install and setup= FreeBSD system, networking, install packages and re-build or compile a ker= nel.
=C2=A0
Thanks and best regards,
Archimedes


Hi,

To create the root filesystem on USB you can use several methods. 2 of them= are like this:
* the "bsdinstall" tool
* or
=C2=A0=C2=A0=C2=A0 - fetch https://download.freebs= d.org/ftp/snapshots/arm64/13.1-STABLE/base.txz (change the URL if you n= eed a different architecture or FreeBSD version)
=C2=A0=C2=A0=C2=A0 - newfs /dev/da0s1a=C2=A0=C2=A0=C2=A0 (NB: this device n= ame might be different depending on the devices already available in your s= ystem)
=C2=A0=C2=A0=C2=A0 - mount /dev/da0s1a /mnt
=C2=A0=C2=A0=C2=A0 - tar xf -C /mnt <path-to>/base.txz
=C2=A0=C2=A0=C2=A0 - umount /mnt

This is from the top of my head, so I might have forgotten something.

Than plugin the USB on your embedded system and at the prompt type:
mountroot> ufs:/dev/da0s1a

If it does not work type a "?" question mark to see what filesyst= ems are available.

If you want to persist the FS used as root filesystem it depends on the sys= tem you are running.
You can hardcode the root FS in the kernel you saved in the SPI RAM. But de= pending on the system it is also possible to pass the rootfs in a variable = in loader.conf or some other place from which the kernel can read variables= .

What kind of system are you running?

Hope this helps.

Regards,
Ronald.

Hi Ronald,

Thanks for sharing the information, really appreciate it! I will tr= y the newfs (newfs /dev/da0s1a) with my USB drive and then afterwards mount= it to the host system. I can't fetch the base system since I'm cro= ss-compiling a 32-bit MIPS (mipsel) system in an older FreeBSD 11.4 x86_64 = release. I just downloaded the kernel source (/usrc/src). What I have at th= e moment is a successful cross-build of a system using the build command be= low;

cd /usr/src; make KERNCONF=3DRT305X TARGET=3Dmips TARGET_ARCH=3Dmipsel = kernel-toolchain buildkernel buildworld installkernel installworld distribu= tion DESTDIR=3D/tmp/rt3050

that instead of using the DESTDIR=3D /tmp/rt3050, I will try replacing it with a mounted=20 /dev/da0s1a. And then let me also try building without the kernel.

> Than plugin the USB on your embedded system and at the prompt type:
> mountroot> ufs:/dev/da0s1a
>
> If it does = not work type a "?" question mark to see what filesystems are ava= ilable.

Noted on this.

> If you want to persist the FS used as root filesystem it depends on th= e system you are running.
> You can hard= code the root FS in the kernel you saved in the SPI RAM.

This is quite interestin= g but does it matter with the size of the SPI RAM as this system is only ha= ving 4MB?

> But depending on the system it is also possible to pass the rootfs in a=20 variable in loader.conf or some other
= > place from which the kernel can=20 read variables.
>
> What kind of system are you running?
>
> Hope this helps.=20

Again= , this is a 32-bit MIPS system based on Ralink SoC. Apologize for this one = because I know the FreeBSD project already phased-out this architecture pla= tform in the -CURRENT builds and for support and it happens that I came lat= e on this architecture and eager to learn and explore. Yes, the one you'= ;ve shared means a lot to me. Let me try and get back on the progress.

Thanks and= best regards,
Archimedes

--00000000000073d5ea05eab0778f-- From nobody Mon Oct 10 17:13:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmQV141Lvz4fpcW for ; Mon, 10 Oct 2022 17:13:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmQV12wp1z4KrL for ; Mon, 10 Oct 2022 17:13:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MmQV120n2zhBN for ; Mon, 10 Oct 2022 17:13:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29AHDDsa076482 for ; Mon, 10 Oct 2022 17:13:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29AHDDZP076480 for fs@FreeBSD.org; Mon, 10 Oct 2022 17:13:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Mon, 10 Oct 2022 17:13:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nomad@neuronfarm.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665421993; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uIpqy0fk1bvjbjVbPKdD3o4PM2zD1UbZbDqSxO8WSjY=; b=DBOgRu6pf8lRv616tS6ltER50oU/Y/prY4na2ioDRopbhgE479AbuynW2n8271MFzAG3lm vTBZyB5JHGyPM84IFBQlROMqrCnh92f2cYJPRpWyUOwAfG/HzAcwj9obkd01jg6U6qaK80 bJcQDZcuiQAsIJI49EfUnfOv2a07SrMAdr4BHoAatL6UWvUmEqXC1UZOM7fOf+UOXAQ5zC Ri8l+ieWQkmdYa0wrdMPVl4tcCnGXoJhWvxNezwcMKJJLk9bYoQ007F4wS7BU7TscUL9F7 xktDulVsZTkJbQS6hUvr8dGTVvT5yLYtOVK9kjD3/wYftW8FXrHBpJIo7t1pIA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665421993; a=rsa-sha256; cv=none; b=NirDFWgUqdvLPjNH57gdWjHVqbA09BBY9Gg9XEjC9Kb/K0OPDsefD7AdjnsIreiJdwXdCW Og1rBDY0YjawKMxNjNa6HfyGHI3Ca64JiKwRPl2KlokF2f4xjz0b8MC+AHmN1HswQOcPVW CI0rlhf4u+StqmmJHnl7Q7XC/bwFhA5sxZyvd6wcss600CDIQKIE7J7+cPEeYKoNiCaLn/ lM0+x1fM4c0n/0PKNyIm+z2yWID1/AtKde5VBi/ZngfyglKdDGslxe79JK9WE/EF0FoZvJ lLtF9Q2V2ZQk6kjI5TbOL4XL7NAbTIUCFwl/IgHfFLseb6Jf+VtiogcdpukZOw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 --- Comment #28 from Michel Le Cocq --- I made the _exact_ same changes : in : sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c - if (fidp->fid_len =3D=3D LONG_FID_LEN && (fid_gen > 1 || setgen != =3D 0)) { + if (fidp->fid_len =3D=3D LONG_FID_LEN && setgen !=3D 0) { + ZFS_EXIT(zfsvfs); On a small test server all seems to work has normal now for me. - Access to snapshots over NFS succeeds - zfs doesn't hang - can destroy entered-via-nfs snapshots I just did a git pull of src then remove the line and add the two others th= en create a new zfs boot env and : make -j 8 buildkernel make -j 8 installkernel root@smallfish:~ # uname -a FreeBSD smallfish 13.1-RELEASE-p2 FreeBSD 13.1-RELEASE-p2 #0 releng/13.1-752f813d6-dirty: Mon Oct 10 11:46:40 CEST 2022=20=20=20=20 root@smallfish:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 root@smallfish:~ #=20 Cool :-) Now waiting for the implementation in freebsd-update for my production environnement. Thanks to all of you. Do you have an idee of when it be avaible in freebsd-update ? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 10 19:00:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MmSsb3BHyz4dmt7 for ; Mon, 10 Oct 2022 19:00:19 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtpq4.tb.mail.iss.as9143.net (smtpq4.tb.mail.iss.as9143.net [212.54.42.167]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MmSsY580Jz3H8x for ; Mon, 10 Oct 2022 19:00:17 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from [212.54.42.107] (helo=smtp3.tb.mail.iss.as9143.net) by smtpq4.tb.mail.iss.as9143.net with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ohy0d-00051L-3I for freebsd-fs@freebsd.org; Mon, 10 Oct 2022 21:00:15 +0200 Received: from [192.168.1.109] ([85.147.65.221]) by smtp3.tb.mail.iss.as9143.net with ESMTPA id hy0co1KrqrgF4hy0coqLbv; Mon, 10 Oct 2022 21:00:14 +0200 X-Env-Mailfrom: ronald-lists@klop.ws X-Env-Rcptto: freebsd-fs@freebsd.org X-SourceIP: 85.147.65.221 X-CNFS-Analysis: v=2.4 cv=GKEbr8BK c=1 sm=1 tr=0 ts=63446bbf cx=a_exe a=1n1117WVeNyb02ulsRzAPA==:117 a=1n1117WVeNyb02ulsRzAPA==:17 a=IkcTkHD0fZMA:10 a=MKtGQD3n3ToA:10 a=1oJP67jkp3AA:10 a=0EyHQldr3sIA:10 a=T8hboYP3AAAA:8 a=pGLkceISAAAA:8 a=6I5d2MoRAAAA:8 a=3F9wsYHBOmTlwiy__LwA:9 a=QEXdDO2ut3YA:10 a=3Xhr1e3L9Km7VwPPQCJS:22 a=IjZwj45LgO3ly-622nXo:22 X-Authenticated-Sender: emnvandam@casema.nl Message-ID: Date: Mon, 10 Oct 2022 21:00:15 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.3.1 Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) Content-Language: en-US To: Archimedes Gaviola Cc: freebsd-fs@freebsd.org References: <1630032913.129053.1665400270350@localhost> <896114746.217581.1665409172569@localhost> From: Ronald Klop In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-CMAE-Envelope: MS4xfN6J/TEzyhwhGBcCBlRjBDAZfNxGvroKex58176w+RzCzwmoVbRS8WrXt3e27Ks5ORN1+roC84aGZCr3+yJFxkUsopckBmqRyGwlgEPWYbdC4fj+5G1I HBlP3OcfFncP6V6Iz4djO6R8PcokilIvFEyfxyfmvDzfR0vmvpRuvASDbC5punEDpDN7yRvYl0cePU13IhBtLFsq8mcYXLVYjkb5zox3QghQZ5JNwAT5qV0h Mso6oneF4jj5tyuCwJ+6jw== X-Rspamd-Queue-Id: 4MmSsY580Jz3H8x X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=quarantine) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 212.54.42.167 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-3.89 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:212.54.32.0/19]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[212.54.42.167:from]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[212.54.42.107:received]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; HAS_X_AS(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:33915, ipnet:212.54.32.0/20, country:NL]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.54.42.167:from] X-ThisMailContainsUnwantedMimeParts: N On 10/10/22 18:15, Archimedes Gaviola wrote: > > > On Mon, Oct 10, 2022 at 9:39 PM Ronald Klop > wrote: > > *Van:* Archimedes Gaviola > > *Datum:* maandag, 10 oktober 2022 14:09 > *Aan:* Ronald Klop > > *CC:* freebsd-fs@freebsd.org > *Onderwerp:* Re: UFS in a USB flash drive (ufs:/dev/da0s1a) > > On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop > wrote: > > *Van:* Archimedes Gaviola > > *Datum:* maandag, 10 oktober 2022 12:40 > *Aan:* freebsd-fs@freebsd.org > *Onderwerp:* UFS in a USB flash drive (ufs:/dev/da0s1a) > > Hi, > I have a scenario (see below) after which the FreeBSD kernel boots-up in my embedded system, it is looking for the root filesystem. Now, I want to build one from scratch based on the examples below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are there any available step-by-step reference(s) that can help and guide me in the building process? > ... > Trying to mount root from cd9660:/dev/map/rootfs.uzip []... > mountroot: waiting for device /dev/map/rootfs.uzip... > Mounting from cd9660:/dev/map/rootfs.uzip failed with error 19. > > Loader variables: > > Manual root filesystem specification: >   : [options] >       Mount using filesystem >       and with the specified (optional) option list. > >     eg. ufs:/dev/da0s1a >         zfs:tank >         cd9660:/dev/cd0 ro >           (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) > >   ?               List valid disk boot devices >   .               Yield 1 second (for background tasks) >      Abort manual input > > mountroot> > ... > Thanks and best regards, > Archimedes > > > > Hi, > > From your mail I don't really understand what your level of skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is not your biggest concern. You just want to install on a USB flash drive. > > Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall/ ? > > Regards, > Ronald. > > Hi Ronald, > No, it's not about installing FreeBSD from scratch using a USB flash drive as I already flashed and installed the FreeBSD kernel in the SPI flash RAM using trivial FTP in the U-boot loader. What I want is mounting the root filesystem that's been created in the USB flash drive (this hardware has USB port) using the ufs:/dev/da0s1a method but before that happens, I need to create that root filesystem (/) from scratch in the USB flash drive so that it can be mounted right after the kernel is loaded. > Not sure what level I am as a FreeBSD user but I can install and setup FreeBSD system, networking, install packages and re-build or compile a kernel. > Thanks and best regards, > Archimedes > > > > Hi, > > To create the root filesystem on USB you can use several methods. 2 of them are like this: > * the "bsdinstall" tool > * or >     - fetch https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz (change the URL if you need a different architecture or FreeBSD version) >     - newfs /dev/da0s1a    (NB: this device name might be different depending on the devices already available in your system) >     - mount /dev/da0s1a /mnt >     - tar xf -C /mnt /base.txz >     - umount /mnt > > This is from the top of my head, so I might have forgotten something. > > Than plugin the USB on your embedded system and at the prompt type: > mountroot> ufs:/dev/da0s1a > > If it does not work type a "?" question mark to see what filesystems are available. > > If you want to persist the FS used as root filesystem it depends on the system you are running. > You can hardcode the root FS in the kernel you saved in the SPI RAM. But depending on the system it is also possible to pass the rootfs in a variable in loader.conf or some other place from which the kernel can read variables. > > What kind of system are you running? > > Hope this helps. > > Regards, > Ronald. > > > Hi Ronald, > > Thanks for sharing the information, really appreciate it! I will try the newfs (newfs /dev/da0s1a) with my USB drive and then afterwards mount it to the host system. I can't fetch the base system since I'm cross-compiling a 32-bit MIPS (mipsel) system in an older FreeBSD 11.4 x86_64 release. I just downloaded the kernel source (/usrc/src). What I have at the moment is a successful cross-build of a system using the build command below; > > cd /usr/src; make KERNCONF=RT305X TARGET=mips TARGET_ARCH=mipsel kernel-toolchain buildkernel buildworld installkernel installworld distribution DESTDIR=/tmp/rt3050 > > that instead of using the DESTDIR= /tmp/rt3050, I will try replacing it with a mounted /dev/da0s1a. And then let me also try building without the kernel. Ah, yes, with DESTDIR you will have same effect. Before you can newfs the USB drive you need to partition it using gpart. Some example usages can be found here: https://www.freebsd.org/cgi/man.cgi?gpart(8)#EXAMPLES For flash drives it is often a good idea to align on 1M by adding '-a 1M' to gpart. And GPT is often more simple to use than MBR. As you use the kernel to load the USB drive I'm pretty sure GPT is supported. > > > Than plugin the USB on your embedded system and at the prompt type: > > mountroot> ufs:/dev/da0s1a > > > > If it does not work type a "?" question mark to see what filesystems are available. > > Noted on this. > > > If you want to persist the FS used as root filesystem it depends on the system you are running. > > You can hardcode the root FS in the kernel you saved in the SPI RAM. > > This is quite interesting but does it matter with the size of the SPI RAM as this system is only having 4MB? I had a system on 11.2 which used this option in the kernel config file. options ROOTDEVNAME=\"ufs:/dev/da0s1a\" > > > But depending on the system it is also possible to pass the rootfs in a variable in loader.conf or some other > > place from which the kernel can read variables. > > > > What kind of system are you running? > > > > Hope this helps. > > Again, this is a 32-bit MIPS system based on Ralink SoC. Apologize for this one because I know the FreeBSD project already phased-out this architecture platform in the -CURRENT builds and for support and it happens that I came late on this architecture and eager to learn and explore. Yes, the one you've shared means a lot to me. Let me try and get back on the progress. > > Thanks and best regards, > Archimedes > Happy hacking. Let us know if it all works out. Regards, Ronald. From nobody Tue Oct 11 13:47:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mmxtl3scFz4fltn for ; Tue, 11 Oct 2022 13:47:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mmxtl2rJDz3l66 for ; Tue, 11 Oct 2022 13:47:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mmxtl1vm1zylH for ; Tue, 11 Oct 2022 13:47:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29BDlxfL058805 for ; Tue, 11 Oct 2022 13:47:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29BDlxpA058804 for fs@FreeBSD.org; Tue, 11 Oct 2022 13:47:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266236] ZFS NFS : .zfs/snapshot : Stale file handle Date: Tue, 11 Oct 2022 13:47:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: markj@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665496079; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZLAJ0Xq9KmgD0Hu++EXZSCbFM1VYx7O1aqlZv7XJYTM=; b=liSmqw9caTQRSsT3zpx55C4iGcN2vR1VyU63emdeR/ZRYRb6yvSAPy44+MsH7A/n7dhuRW M7hEVeIxjZXOWwGBHmOkz4YQDf8PrWD6I5KrF87likOXbCcXyZ1cOafa6u7oMZZ7EF82Td N3rb7Nl2O0NZ7+U91Xynd6BuFLLLTdncpqeNHqRDvbZtDiUQHqlpXEezD9xdJU+yY3DSuO mj9KliSH7mAR3zUUGqGlu/Rwzlb6FwSBfXXsOV2qJSXYZLc5UoxAOKed/WU1qHQfTe22p2 Q4SlALjbL2JrhXMklShBT7VbdMBt8a/WmM7s0dsQJ1U8ounvkl9K+aj3Zve0eA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665496079; a=rsa-sha256; cv=none; b=TBbRlJ7cTLW5KYoPs9tJ7phW0WAwdRCdb9HuZbgIIqm/y29fUFbGOYLb8pcBennRIoLMF6 YVyZU1mZm8ZmMrBZghOr7qpXvGbC0ucfcfqe2LT5gsod5xm4bPCx4d5ZkcDEDw+CAZu25G Zuvsb25EbHUvVyN0iuQPwnJPH1jXhYWlWuUG8nPBV/2lBcdh/H+2b04n4PG3JduNtZneXm uVog4QufZK+JJ0UJ0/Pqbl/AhzHW4sqIbYbrsyEbkpkuhjCbELFbMYyHSG0EvvQvFcJUlR IvfnLqweztvH1HeCa/PklAwTqDpVGHVCWXz61FyqWFimoh69XXdicjj/iPIROA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266236 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |markj@FreeBSD.org --- Comment #29 from Mark Johnston --- (In reply to florian.millet from comment #26) Have you been able to reproduce the same NFS problems as before? (In reply to Michel Le Cocq from comment #28) I will aim to get it into the next patch release, but I'm not sure exactly = when that will be. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 11 17:31:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mn2rq4hSQz4f2L4 for ; Tue, 11 Oct 2022 17:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mn2rq3jCsz3Bv9 for ; Tue, 11 Oct 2022 17:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mn2rq2mH8z12dR for ; Tue, 11 Oct 2022 17:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29BHVdiu036394 for ; Tue, 11 Oct 2022 17:31:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29BHVd3I036393 for fs@FreeBSD.org; Tue, 11 Oct 2022 17:31:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245683] panic: solaris assert: HDR_EMPTY(hdr), file: /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c, line: 6271 Date: Tue, 11 Oct 2022 17:31:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665509499; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hCqBPqCZJUvq5aSnVmT8WO0zn57h+oCbRkluwwDJv1k=; b=Kzqah9/xORpMQQ7InVoMXPO0ajj8xqmyVUQseInDL5cvZ/V4/oHaoY+hE9qeugp1QXJGVp KKn3/KQ9s+BYgpCOBTAmhWgNPhHKZ6xnrwhFsUaHfJ+skiOQZpDrr76Rs3S8oJmiBMVWVF ns9oE0w65arc4CuKnux9TrHuSrBxZEF2+wjXWFuX+UnAcYl9tJTUlJzUYD/ekoUbRra7GK kCSOV6BYwMEDNWdvYnl4ZPyWacIuddiXbSwo65S5MG25SicCvKv5buV2yeXoM92Tb4Fogk ttJbL5Za+bMO199Hz1KaU5iYaHGZmDfjo8ZOvvn5UfdD+meJ3t1hf08NMIp5TA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665509499; a=rsa-sha256; cv=none; b=WfATvcpFF2Wij4xDfqHveN/0dBHBXFIQ15C2hQEaNZJ/q0MztW6kwxIVMx1DKHx4bXAVQi u5CEY27SsmFt0LrN3dR8/DjPPHJYIfV/ST+pl+etmNHcb5jFv4gNW6KfR0rWMqJpx8Eo/l wWmvRhQ2CsmArL18RFhnb8X1dE8b9wbxsOL8T36+Fv94KSp2XJqhGOZ4zEsAqaXFJNsU06 8YyLkh7XftJotmkVXKffc5V5GVs6Yet3hI6A78Skt2GP2QSuQmO6UxyumfxWJFbWQAcMgQ SWU8i1k0eFPpnMae0X9fzK/lkDVeHTC10ilA24BXCWm7kkuGxh6flE7vE+dpLg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245683 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED Assignee|fs@FreeBSD.org |mm@FreeBSD.org --- Comment #1 from Xin LI --- Closing this bug. This was fixed in 2faf504d1ab821fe2b9df9d2afb49bb35e1334f4 in HEAD, f941f0a062982f77faaf326752c80ed69201cff4 in stable/13 via 7676ffc51f5e4963c7e7f9971561f483dcd65976 and 7d70f1e09971d2ffac9c4557bdd59ce8e8bc5035 . --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:48:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYD60Glz4drGq for ; Wed, 12 Oct 2022 00:48:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYD4ZmKz3kDK for ; Wed, 12 Oct 2022 00:48:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYD3fHVz17jw for ; Wed, 12 Oct 2022 00:48:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0mmGw067156 for ; Wed, 12 Oct 2022 00:48:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0mmRw067155 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:48:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245649] [zfs] [panic] panic booting after removing zil Date: Wed, 12 Oct 2022 00:48:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535728; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=D9yYPM9liNV3OyfLdKlw6c9mwvCIBsfJ8MIElSVRQNI=; b=K3OUKliKLXF8mhR5LhigiUHDIyQoWQBogr0KrqCVGhgccf0n9GyQyrvjrq2PV8TZgWUmGA FrnFdIdTtmemdh+kB2tMU4LIneLLRZK7R81/Q9oCenRWUdqjAvzT3TieJfZi3Jd6q7WRP/ vwsWPahxLJNNu/TRmnT9Yqqi5eOKaptAZvCLN59nwsCqbn9G45DXLKI3moAr2y9FUiJm4O plDG34dP6pQYE/dYk03jXrFWMs4PO2mjaQc3wz/zrxQPl091dGCDC2Muk6q5jMrLEWVCa2 2TbxpVKbBLCRYhXaauNN9DucAzehRVgt8ZQQVNV/q6hW+TnAM6qxRYzL1AKqwA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535728; a=rsa-sha256; cv=none; b=dg807MoC2Xg0Z2oFJgIZfcre2nSxzYVevvB+Ym20JvyrtYTYv3JbCF6LLIICAnO5YMxz4g oks9ZKq8TCNdWEH5IRwI4qQ0/On+B3/PIOGIAQ9GrvR/iCsy0KEbpmmC6C8q51B07ew9OU IBp98F1vtagzxsaW2nytfrUX/qN9HQkTYUtk07/PegWWbBi9sx13x3ynxvewoK1c8JQ8p0 KPnb+8OpHUcODpLMn/fvl3OCNV9E9CvpUWfgPcwkLuBiRnGb+FLtNl6ed1uVtQsXTj92M9 tsyv0EL9HzUiZN+2nDfyFHQ6ghhffus4MP0omhwi+oEkEReewno0HH2t1AXL1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245649 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:48:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYR57Vsz4drXm for ; Wed, 12 Oct 2022 00:48:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYR3hH8z3kks for ; Wed, 12 Oct 2022 00:48:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYR2kZhz17vC for ; Wed, 12 Oct 2022 00:48:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0mxp0067645 for ; Wed, 12 Oct 2022 00:48:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0mxsg067644 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:48:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265695] Kernel panic on ZFS service Date: Wed, 12 Oct 2022 00:48:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535739; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/S08rmHFx8TZimyD/nVr7BqjmAkL3VtpUm+Bo1mxQA8=; b=g131qHAYtgPNFQ65zG1iGVibdLQAx63S3at0s36D1cb5e6PkVYRcY5HSDiGKLZCI2phrI6 Nf+F15c88ooQ9h50rb6l4n95yPJ8wKTrDktiv1ffs/jgQqqRBu5Dnc9nshNBzy2cjYwvSz 9rEXeUcA5efeqCk19wAT0+0R7Szg/nMI5ED8M1P5L86Fq0iLQZ2G7RqJIp9DfiTAYlLuDE wEvumeBCmZ0ZC7x31c5z1TZAWbp//+sXFCs4//9FmyLl/umDKi5cgjCeQUjBc/YJUFUns4 Wjck0v1P0BFHBzjTRN3mN1cOsO/HnQJaqVJnZDJsRtyZD2j5ATH0oIIaG9GZOw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535739; a=rsa-sha256; cv=none; b=FF44Ha8kDAWNwf0UPLTdhPxneQ01hoqkF7dUCuyoXmxwlQTrOLDzBO9viOP1NsmhmzUm7i K0Zvlt309qG1c+jU4Hb3jd+Xb9nGLrZPpLMU7nN3S6nas09deJ+Ox9PpOFxmpQ3JO1dWte Fd34t7gk6RjAWhXT9Gry9gy15FkLYjJj60KHwU+myj9bDIAfIIJ4ybplCvU9oAvNxTytch 6wUvwiIvrZr8yJxLPrDjLFbeELINrz1//GEuqwUQXpF97o7bR6Z/777rf+aHBbVrPkeknD Yxgo+BwwJ/J3VA0W674BNumrJG9Snf8EU8RjWQeE7xXgoVDKN7SYnHTIOqZqTw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265695 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYS5l1Rz4drMV for ; Wed, 12 Oct 2022 00:49:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYS3bf5z3l4P for ; Wed, 12 Oct 2022 00:49:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYS2fdKz17pZ for ; Wed, 12 Oct 2022 00:49:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n0aQ067789 for ; Wed, 12 Oct 2022 00:49:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n0VU067788 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245567] zfs: Null pointer dereference in dsl_prop_register Date: Wed, 12 Oct 2022 00:49:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535740; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3vHuXXq9LKB2v3Jd3n9Cy7rgcD0rAYRozw2lIvYzvrc=; b=mfh2Q66JSTh57LGAX2zYZweikWeJ8whoG5djX0YC0C+eUknor8L2zzjsh71M8aopiH2WDe uxKdFwAjPUvm91X+YVHFs6cfxsNJt8dCVZ/JqgCpnwIHBrEYTxDoB+R3JEp9bjPExLvWkG rdj1P6ggj2sdAbx5ZJND3owRBy/s4XUIGK7I6S/3lew/X1xYxNazXHWqmNOzT4BgSDboLB 3w/L/w2fRXYwMmh+A4xUqPrSQxojW1hNA0IH6DqxHF6w7KmuTfw5bUFQANWyi2NbxGjb5P qTV8Y/SfzlWEU8otcSN6t5SzskVm+VSfvOGmXYwdoVFHqDjvIXzrbAVjMKGJ0g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535740; a=rsa-sha256; cv=none; b=cRYAJPO52hCWKqzI2JOLEk66PM8NB/yBiGrRuSBPDZYHsUDHaix++YrngwfAs0ZTmOdIDN Z7qg1jNZXGERz0sit6+ERq1BZMO7dxiVklMcBG8HBClTWu0oYITh5T1zc7cKItWN/Rvtik U10fclHWtDoQo9SSViKksViaoDM5XBW41ijAaGPcrk+KI+HGtVxGnXEowRRVdidoD0u2fy u1vl8ucvk2ahdVY1ccqy8UX2B8P6n9ichsGT13PlcI8N59tAZMCXSSAJVc+WdZberpyBaa +kttIJaV0+Yo7rVNhCLw4UdvkYRFXZf/yk7J/eH2dOLFfSPzeh+2LWaddwpDuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245567 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYV38wYz4drWB for ; Wed, 12 Oct 2022 00:49:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYT6dszz3kxF for ; Wed, 12 Oct 2022 00:49:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYT54Z4z17rr for ; Wed, 12 Oct 2022 00:49:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n1T9067864 for ; Wed, 12 Oct 2022 00:49:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n1fe067863 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250784] integer divide fault in zfs_rmnode Date: Wed, 12 Oct 2022 00:49:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535741; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cO8twtbYFVPn7OySQaFaigb/PlLXXEoFHftgDvBa7nw=; b=xPy6BSGXhA0THqL6KbPt1NmzgQYYtAp1XH7xRHvAm9UllTBICEYanEypoD02XOX23bwMc8 Xx5jkTvmGS0pFE7X/FAxxsdxPsMfS5KE053UafD0Z+qjLYfj2+P39M1Y4SAHX2ZnHUS/M5 LdogKvM9qgP1Kv6tVrgKX/z3RfR8L5Mnkf38xeH7C56V6JDDRBwzcG4bRouiQRDJuo9gLl sM5dST5gHCzMKSV/Z0nMIgU+NGMW6XakU832pQmCULKna0X2VEyEof/1vfRw5BM9KKVM4E 7HhremdpMVQi4+59gttQU5tlTmIa7eVnfgj8j6o413FhnuGpFec8sWP1TBDvQA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535741; a=rsa-sha256; cv=none; b=vz1xwQDhbeT9NMp6uCL/Zd0ADld8/OCckv8lyU/5/rXU/wnoNSjjnuXhMv9/fncbE/nig7 h0nKcNaDe1Ad//QbNJs6eUPLLcJ447eSPs/qdxedaIPFj+B8wi/7UMm6+6PGmgE1LMTOr3 j/6imRgyxOJ1Sa7+rH7iDVlk+uOKjDYg9f2/2e8RC6HZIYmnFH0wrkbvQflanXQSqdmIEB /MJ8UnmtsK0eMf5S8uBsDWyLcONFT48kUiSO4lQ7zcuKKpUlh6uvBi5I5ErfiF+W9xpCyb lDbxPFt2qXJPrdne43Uq21vQ234SFYEFFW1kdutwPeM1PWwlxW7C31FwI90iVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250784 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYV5hkGz4drbl for ; Wed, 12 Oct 2022 00:49:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYV4FZnz3krM for ; Wed, 12 Oct 2022 00:49:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYV3LfXz17x9 for ; Wed, 12 Oct 2022 00:49:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n2wm067908 for ; Wed, 12 Oct 2022 00:49:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n2gZ067907 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 228750] panic on zfs mirror removal Date: Wed, 12 Oct 2022 00:49:02 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mav@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535742; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bZVUDlvxlBwY4BtYDErQp8D9Pw0Qac2/NPkVeNM9Pck=; b=PABWqOTcBqtERP+VxSPfdlHGfGm/doMkeXp5RyF8EmY/5DZFijX+z/AfHSYNj7+s9H0lfD +Z+mFaOrk3OwiHglxLFUz8+ZyLmJnEvCq7HHf73hzywG4lgHG/Cw/ZbQV/rEItm3ZZtWYz RGGI49nxtiv6wTQtop7QaBzLvdUvDiaS8PFgMHGMWjfrHHk77c3pv1eXyBYrMEhPpVKUU0 3lc1QlwFklxwOe5ttvz0VIjSLGv1NlQkIUF8P0am5X5PQ8EzqexIEBpI2AMa/Nn57qIz9m obkJzojzVSQ2Lp1uAo9kwI7qMLTieTNlOBaICWbk5RwFFm3njYJ082uqmQea2w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535742; a=rsa-sha256; cv=none; b=LrFcScSxOf8eeAc5Cf0+5CLrkvtD64E+cm1FZS7bl2U0U++l72Lh/nhk/PDgyDm/lyBuve lsDrRGHpAGaUtWK9GYEQpQa7bSrxcNqvnmJyLoNUFruencogYbF/QBsZcBJuxyADeCP36o rVcGMNOJ1t7eGLN423AI2yxEHV3JDVXatM1lWftrwdVqMnVu46KfOW8yiFJtwFdc5AX/5e tqqtKBWul9F3AHFYOZ5Vn+HwK0WqgCqqLn49VubVose4/hmPRKBKtEn3fwz4StY2GNo7Rt 7uivNb1R8ghUsww2nlrRB8w84sjOUJ1G+wdnzIpqvzkbueUaYFi4oo8iC9y97Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D228750 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed Oct 12 00:49:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYb34zWz4drWM for ; Wed, 12 Oct 2022 00:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYb22zjz3lWM for ; Wed, 12 Oct 2022 00:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYb193Xz17xL for ; Wed, 12 Oct 2022 00:49:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n70C068106 for ; Wed, 12 Oct 2022 00:49:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n7Cq068105 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Wed, 12 Oct 2022 00:49:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535747; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bp9l8Ik/7+4dtjWnBrSfcnmfWt9oxUYY/+ldQ5mra0U=; b=enFDsCga/S/2owHaJ3NzaCLLdIwDwu6LBGTlL8GPRPP1xT8VyYPTgnUE+W/OklVxvn+aA+ IUMk09m0EgBnImLXlqOzVKbYqlWJzcsHX5yv3ztsyQjciIHOwM1fvPjPFiydC0DyKV1LqT idU5i8RgAknRD1huvmXp33qK2G2qa3yfWi4n4WsqJHTcezJLyVtTMLPAfQLTShotahuDVJ sINzSqvoGN+VdE3xwJ9zKIKdOZsQauueDqTBU5wUP1L5LVGdK01k07dMGN+qDXxuU6AmnA A8IsTilbi+s/86z9RiPRPe0b8PtqviD/dMGcSLy/SJhFfOB7vDiKbsbJdUW3bg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535747; a=rsa-sha256; cv=none; b=tvkCCxNz6Nf6lt/4rTVVuBxLO0HnrKCH1G87BUeQnCgYPsFIxfhGaLXA+ORLV/OSygFOxB 0+WPr3Mbj0gkClTrWWesZ7cU7NqnAQdfT6RcuDQUtn3nL22qhs516qdZ94CKjvisCwgbyq NgTsM0w0vH+qkZaRI896agLALjUXYR0cq7f7NySLs3HnXVE90RmDKjbetAvFHzdPJp1zxI 0btHLq+35hYpgOQxjHqY5zd7mh9AXuHWi8rIRX5mlUSWdpq6Mb0ZX2gEM2O2Dhb59/zTyJ 84YmpK8zHfjTqRpKyAefF//VyWWfZKysyEc1N2LvKPwxlS1vrjBpqWoNIBb3iw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYd0Mckz4drWV for ; Wed, 12 Oct 2022 00:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYc4qYLz3lJG for ; Wed, 12 Oct 2022 00:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYc3mvDz17kR for ; Wed, 12 Oct 2022 00:49:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n84k068175 for ; Wed, 12 Oct 2022 00:49:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n8M5068174 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 184711] [vfs]: panic in mnt_vnode_next_active, vfs_subr.c, line 4849 Date: Wed, 12 Oct 2022 00:49:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not Enough Information X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535748; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BMObGjWTcFnGNxlghGjdlmYdAQArSDr1SVahbMVwRbg=; b=TMhS7DOEIuBklsAYiFhvachwlJc1/+0gvsSW3tMc0Es9UB15TUQkjIQp8EnX+TWAhE5Awf 2ZfPTBAPP1hqCYCOM8ihPhjMRt0nefHplHzAPTn6cYAczKAY1pTeLmycqfAIJNGbtA1BJa QiinWc5QTaCveavhMDWPbUg9brintRL9vOSVYXX9+j+uTsVL6q4kpw+2QULXIeAOB23HF+ FNqS3CCHh2D7jxIIUlEvlThVRK1yIwAg+Zb3l1QyEeuHvBIJEhLFjS4i6bb7OThxgc/DyR FZbXfq0+q+U/rzvdWdJarTOkRKez+o7oCPkWQx3Ognnivc/DKmj2OkC4NtkP7g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535748; a=rsa-sha256; cv=none; b=PC4T0OO4pdZwVKupuLmyevQEu/cB4MJHxeWlqfZ+MaQcn6V4QA3BdE89eIWKgEsUGYa4qO ZUhODDaAkXs8LnLHJ3BSYPTOQQCu9cqgpCgVRy10TGfn9CaKvzFKXdYLBwuePBRlZz1dSO I9dr1V3FJURMtz1P022Bv4mXciZtull2PI5uOkUGtBYIAzwpAkU7bPlUUNEZAZNvtAoCyi hDyLXadVpo2Uw0svIceWlOm2ld3eNkI27BwTWM/mK3uSZO4O+q25Kx3w20wjpR1EacdT3N XhVQ7cpmxLYXqcf6btbtx3vKWTD8/8VGOyQklZpXt1txMULKfuClfLKzyVcLHw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D184711 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYd73d5z4drc1 for ; Wed, 12 Oct 2022 00:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYd5Knpz3lrC for ; Wed, 12 Oct 2022 00:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYd4RWzz17s3 for ; Wed, 12 Oct 2022 00:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0n9TB068212 for ; Wed, 12 Oct 2022 00:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0n9wV068210 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 236357] [zfs] kernel panic on 12-STABLE Date: Wed, 12 Oct 2022 00:49:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535749; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CmhKazJui5SddlTm3jfPa6fpGzpxIp4Rt8ZsVrTXpAo=; b=eoI9pdqqUT/mfpnhfTmaSpApwVL3gd5IITuThaM6fn0DSuP0PXHdL30Uw5vDIagOLanyjw CYpfR9Z4VEKIt0kv/OCQXVFWMcqXO9s+tyZ+eZrOIP9a9yY0qOWqjeqs6pC49mq59vYZyq VSvF3Vlp5aEJn4wSuUGG9zMuVmVOf9Up82QWFMqbuh0YAod+aPRJHgfR0EGhmkmNX5Ikt7 pMkewbH6uAa9mPoJMHbz+QO4wStzIsOfyX0MLR0ngCyUABGvxaFtnb5Z9JdydS4ZgqsN9M hNjoJWRags2fk5iZEhfvgW3SUn4LMx2ACZwWYWKAZoA634eKfKXt0nLgnY8ZYA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535749; a=rsa-sha256; cv=none; b=MPlF+w5leycLeufTWiHFF4CCRpy+D+YgiEw8eDnBIT4hRKqgRCpAaogm+nzWZiJRCuVWls GHcvDnBhcid5Szg4frOeaeJfc0Ld51ZFcXHuJY9LoNlAIs9153dRfkWlyyfl2uTDl+y0PR 119nPh2mEEUvf0iZLH/oLWIOjmKs9HFPH8oCcFT7DdPhYukuTEJUp4O+H+OKLmOYocvkAG QZoVkJo0OUt87hEHykADI2cPVaN/8XHucTq73llWa9l5Me9e+2q7vncii5J72cFbG7T8wk msPgg4qPl3fCQGOMHe/K9WjcHskDAhBwMlBgSA3K6nUi7TZwhmEyc2SBXebN6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236357 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYg6pK5z4drdl for ; Wed, 12 Oct 2022 00:49:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYg4vbVz3lsM for ; Wed, 12 Oct 2022 00:49:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYg3yJtz17mg for ; Wed, 12 Oct 2022 00:49:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nB9d068303 for ; Wed, 12 Oct 2022 00:49:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nBMk068302 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 239566] [zfs] panic: solaris assert: avl_find(&scn->scn_queue, sds, &where) .... dsl_scan.c line 1029 Date: Wed, 12 Oct 2022 00:49:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535751; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=quPS0gIKqcPcR71x+nknFDymRBZjfEsxIJ4EF4eopqI=; b=SlGExp+iWzcnIG1ZiqNqinzJuUKnWyqdNFZ3V24YIhbfbRj3BXQPT1UohozH6MPZ8AJzU4 LIyHc7IeEBLvyH+eEtwbw+Cz7FAy9eHFDqa2HT8l2nyvciuet7oJdX0n9rVv1eFbRiGAsq fZxMQAT5oHsit7NUadpm7N+95Nr/9PDbFzguEsczfrfX97cLQNvBEDTpFNEGV2leNUpfi6 taAhEaDmp7fY1DoSP73r22KsJ7+ivH+Qpu7HuEMBvP/tqWqULKjs8D9zJYSiSCuYN0FL/v sBsZrZ6MaKiL60/nfuiuVwbtk/FC6WzO6lLLnp1Dpunpor27nNzwNBvwmQL0wg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535751; a=rsa-sha256; cv=none; b=aZ1EruB/C2U8vJkpRXHKixnwtUxeyg8GNtvzCe8Q4At0fYnElVEucI5jedt5qFOjlqCMzm rZmz9P8jNxmD0roIhg+mjn0Uum218Oz5HEjOKll9tAwfWHNI40ula636JE+L4GD1HFXpDj uL1rUs3n4QarGM6zbhjxENvbq8ArGY/MEhWjsDdDfWMsKbQnumbotQHZ4WFh4r/0PEGZW1 DyncP4j7NSNP9DIuQL3/NfqnUbdgVmXv5xVqnnpua/4NkgVIXIeayG8aSGiXMTHx3sSRpk 1NtSWCj9lHqeZ0bWizYCCydIuofKFoGGR20HY7Bmtpp8lYSftpPXGNJ8LLvdkA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D239566 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYm045Wz4drQD for ; Wed, 12 Oct 2022 00:49:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYl4DGqz3m1q for ; Wed, 12 Oct 2022 00:49:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYl3J6jz17s9 for ; Wed, 12 Oct 2022 00:49:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nFZw068434 for ; Wed, 12 Oct 2022 00:49:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nF7a068433 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264617] Panic: Invalid dnode block MAC in ZFS Date: Wed, 12 Oct 2022 00:49:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535755; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ocp5lSBQ4Hsd5BYBmGBws1MVWP5L9yjHa8WbYxOAKwM=; b=RCXIwbLObnO1V4IdoFwYDXigVbcGGaZMBZfvz/QV8gM2i4ltx92fzrL36gAZSbv4QuVxbN 5Odw10oq1MPX4M04zwg023LhN25TVWpzd2GOcumw288Jrl00KO6RFLC30X9LTX+Fle5K7R 64Jn6cN/bn7kxQccf1ZFi62lJ23qpSSJL6qXII68DdiCDX/Gh18poaABR4W8RJ+DGRx08v SBGvqsl3iHwZ7Qj1OHELl/x8LqNJTEOKKDHhCMcXV25bHVs5jVPccoCr9VDFQXCZIH8Bw1 CyZn55iPlTiTxiWOY2N8P3UGd0cdCOLG7v58m2T1mlNhDOvVH2RIurwaeAlRJg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535755; a=rsa-sha256; cv=none; b=tK0qABBkPWNyLewkS9qMapWdrrwV0cr/rvT12s9co1u/As8xrlE19/yWi7jcEUO3xPG3oA vhYguAR1c9GBfAWXL5A+Ly7AhBZmX2N2M7AZmyrcwmfLwEikzFhjWhV5temN0LzueNvHaB Om2bzzkJdy5refJYjup6JbKxjMwvHTased69XnFhaOgmTMOB6s9bM+GoJbU4u2nC8Drr4r jtoeEKosbPyQRr697yPkngG5WGrQ0Rw4MnVwDZ7otVPLQ+0lz66hFX4Gfj9LnFD+aAKHtD 6ZyB17oqjJJpxT75kcOt6nsQggK0OhF5E9Ntgk954IeBsgAVUc1n2GlbnMy0Nw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264617 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYs3M3Tz4drQL for ; Wed, 12 Oct 2022 00:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYs1p19z3mbn for ; Wed, 12 Oct 2022 00:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYs0nxHz182p for ; Wed, 12 Oct 2022 00:49:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nLa4068683 for ; Wed, 12 Oct 2022 00:49:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nLGs068682 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233997] Reading ZFS filesystem via NFS causes panic Date: Wed, 12 Oct 2022 00:49:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535761; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xU4QynEwYMn9tLoYxqqWTd8bBrhJKWHg2DnAA06BeCY=; b=OW/O9a/O0gH+7aDywh9/Lydd94d1hY4yzE2tkrcTNRrF0UnufRed/10Lt2yzMrq8VzuxP+ Mv1yxpS0Ww/g5KK2smRvllTFQx11aRifYBAfwXUmxPdlseUcNNHAX+79FuDxryV0XOMEC6 JyG7rWXetPjAmRMbJinAGLnWQPvX0/kxFOv8XroyxWBW7Mgu46LfXaFBrgMEAqjTEYXAC/ /sjBNfFahmfuAKS6GN2ekXbcXZDxrVV6jL0XO//TeWfTsG1D0XkqrX95fFJTCMuNjCqJFB 7Un3wruQ36vysvsgUgj5XP0wcgsR+qhSLIYoJVuHoOTtI/z0v00WGgbBHB40hA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535761; a=rsa-sha256; cv=none; b=cx+/rZz0Ffa9U7p3A97CsW0ftBPHAQPdS6bT/tnoGoKMviydURuFvyO9T7C1ImsxuJGdnN lGRVdbXo5D718B3l+rWNpEmUryr4Q/pA/OelTw0CHIxMlKwR5hb0ltradCVPbOkaAL4DVV vmEC430BI3/9nQcjEg4XuvOV4YbWYDfWPtRs2nrUGphVofzpKE/erVAQ7Nf6iJ/eRoG6G0 n9v+hnruvdwd5H3ppq1eRPon7Qw66FyO7mh0uuMmiEYEeioptNJs3Z4k5E+/PvJOL8rZI1 sUuF6VzstAFMg6vOnAkZHx+oZDPsrTjHhpojo5A6ILNxgPy83kNoRJr5+EppSQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233997 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDYv46pQz4drNd for ; Wed, 12 Oct 2022 00:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDYv2K2Hz3mgQ for ; Wed, 12 Oct 2022 00:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDYv1Jrsz17sN for ; Wed, 12 Oct 2022 00:49:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nNpl068754 for ; Wed, 12 Oct 2022 00:49:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nN0C068753 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235783] Repeated ZFS-related kernel panic Date: Wed, 12 Oct 2022 00:49:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535763; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gzz3rVvmv7CHJVzNEfaFqPq7flY28WANmiBNWiyTHd0=; b=qK8EqAsUCEUKPqF7BSQ73snjHXbNVz17InjdXQKaJxngHwBAFBWErk2teTBqJB5jWYi8sN EJ9hlvs1cS1WPI/qykRpE8IBewZQw4hAOtSMdsQz5iHPEWVbL1BTyXUx8ZIgk5OBttApg1 13dotAh9bF/ApDHxkJjAcuBCmq359DiqA/s0XA+vpj8mAXp0iLidBuMGW+QkQ6va/fnvYz Wt9YD85ZZTRssINsOeSX0aIwEryJvfYvSMik7hBS+5vBjEs+Ab3csZNMbpejFpccA+MX+k EmYx8b/ree5PAIPSx0biCAeBFSUprSKgogYIfVPah0NnAeXFW6I2vsECxWPMjA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535763; a=rsa-sha256; cv=none; b=yS96bNdu8Xr4LPwiPvBM8Xpou2iqxMAs7ECGmwWOW78PJRq+Smlzh2CwBfjn3TAb7/8Om6 AxmU0YDSD/x4tOz1pPtDOG95gnTfUMo/gtZRExML4w4HzPg6sjiPCOp1wTpl2/TzWCZlts Dj0/k6Da4jhEcXtB4U0UqIZY8dd8uKmspaxxFU4FlzYoJRBmrRWkDS3+utmlk2LzmVPsKM TB+fo/ZfKx0XpHjYdNaocKUV6Q/LScR3Y5qOfyevf3u5I7A5McyDxZjHKnP/1K+Q2csCBT A4FshN3/9NWCORuWRemLL373W3aGMnUqhMwD4qBKGHQvg1lCloCEZYW4nWTzrQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235783 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZ33MMgz4drfN for ; Wed, 12 Oct 2022 00:49:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZ30wVdz3nHF for ; Wed, 12 Oct 2022 00:49:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZ302Gvz187m for ; Wed, 12 Oct 2022 00:49:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nU6E069108 for ; Wed, 12 Oct 2022 00:49:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nU4Y069107 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 236452] [ext2fs] panic: mutex EXT2FS not owned at ../../../kern/kern_mutex.c:281, vmcore.23 Date: Wed, 12 Oct 2022 00:49:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic, stress2 X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535771; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aqPDBmYlCbg14itGHN7xdpvRIpYqKUXiKijoVYgP3V8=; b=REc+uWLKo5jhLdk4qUv7+YOZdREg5LXLH7kvGKLudjc4F8Ej5+PtkkiNY3MRVu+SzIIJnz PxpYUlFa/FECjnhOARBAiqxVfpD7bBaguav8FkRV96e711O92LJFCXul1nzJUCfWsizS7F R1MlDJF31y8bnEObS/71o62BSNaUg4a+Ru1YM8XbV+nll1WNIH/eqjbodwx+l2CaLkL0iv QZuWnuNt0IEkPtr8MvEsx9kDjk1mY0v4fh3Bco8WOl7FdA/9iEGwJcyOMIV0xNNxesonIq 3neDH+MBkbf+SqEu4N0AfEudzwgslClEcuabr7/jpywws1uVB7uoikKEMR+FCg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535771; a=rsa-sha256; cv=none; b=Fi0xno1pKrXXC6I++qnK9QIzP5nHX2el35/1qG3WqxdVblSIYRd2qcy9MFskQJym7ujOT/ aFCr32lpoelbJkVTiiDQuwzKvShN4CPoeqfY3H7Gp7Vpw6uISk14pxDgD36Gx3jW5en5C0 Ku0B+DwNVZuOJdhDqQdt0UjV1UTcU4wZ1j2vPmfojfI7Ia+dncoB0GmJ89KIs3pZUHfrBV Zz71Umy3Lt7/ZE7XWP1XZubHU6zXoaFBxxU/ilwuYQvseY8OpIOSomm/7GfiFyXA60/dkD e8oNhFE1eIpsMCAzHqE6mSW+6XQbMkbW/+Ys0NzqFz4+/hFRL20yPiIdha1hhA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236452 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZF0hxtz4drTd for ; Wed, 12 Oct 2022 00:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZD6WdFz3p0L for ; Wed, 12 Oct 2022 00:49:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZD5cYKz185j for ; Wed, 12 Oct 2022 00:49:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0neb6069425 for ; Wed, 12 Oct 2022 00:49:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nepq069424 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262760] Trying to import certain zpool leads to kernel panic on amd64 Date: Wed, 12 Oct 2022 00:49:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xtCZp1m8FXcLXhP/uKk+S224y7Voagn6NvvaWkT5d0s=; b=XYEpB4x9kOXCaUqAAj3I/u09QsO5QrDkgb1QYtUqO4lqR5mst1f116M98gXSsf3feIRvb1 ZupT5dNlzchotzYqJbZd4Ap2HgbnkdY8s/bkSZY4YnNvUMk+zF+BYhbpieJuBEQN0Ku53C 1G5BGZzh6u+tb5xcafSL0maXLjGSquvaWPVZ2wO9IraA+G3uUikSAd265+hRH7tkChnt6I Oj2kwZAUAOHn3JM1xZsaGbfRP/5DYupdKPya/P1blR3FhtwsVu7YPhGFVPDQAdhEUZAwDN 3o5orRAxQEvs4ihmSBb0hHN8fMnJkoZld7FmPH5jdB4R37VdtoNvlUBeA3oMvw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535780; a=rsa-sha256; cv=none; b=ACKBI2v1iVuAD7BV7jRS7Kp4sTzfVhGlCS+h/tp23DWEe5g+MEvIHhyV2tCOpKaG9V8yc4 5aSlM6eoevZnH5+gJ1g956n2Xka2+tIDoFsKe6sjSdQIEAk8HARHQaYVMxlznz3dIpJiul 2qvokDw2lqOvpr9JLPcVvgGW419e5ZrIJBWGSa9zfeJbDY59EbaHc7kEpOHv3Mm/+rgcbj zobqnjpTqsbC5X7gj2uGiQCCMbavTJEMS9C+MjORzAgewJLzSm6pfvtYkqEPqLjpZeMnd3 TmZ9ZiEwg6yy0H6nbKPQBtXmq1UDmrcOIoLZ6GUARSz0VPFFrgxH3ZDoHbF2fA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262760 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZG0RzJz4drlc for ; Wed, 12 Oct 2022 00:49:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZF5Nflz3p2r for ; Wed, 12 Oct 2022 00:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZF4Tgvz17qB for ; Wed, 12 Oct 2022 00:49:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nf6T069464 for ; Wed, 12 Oct 2022 00:49:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nf5Y069463 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 242319] dmu_object_claim_dnsize in zfs_znode.c results in a kernel panic upon FS mount Date: Wed, 12 Oct 2022 00:49:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535781; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tPQ6Q1opiV0zKJI/eLlAwmjFmxaRTS+r5O163N7ryyY=; b=mDGhiSrv6gJK8Gg0xPpdUkf25cNyTVrt2pGb88yi8m0F5s+BpQ1lPoz5eej2li4vik33eG oK9/gXVGJwq+bOKOpAIT4UrRazlBD6IzJpoedObxuTLVfgHwAXIUmSMSB+Fn8fAjRGquvv y76dt4p/qlSHRrNSg2whhiCfSRr4H6ULX8w0BEHMkIdEl4pYZkhQaT9POns8yKE+0+ynOp kTdutrv2Y6/KR9tvjy1CnaNPUApjJLLImdBLD7uTT/wzXOISWHakIv0byF0SxGi5kZbW1t TAvG2vWBB+XynaymIuLkPrehE0+oPbnqk2j7Kmw8omskfB6cESli6Q8v1tMi/w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535781; a=rsa-sha256; cv=none; b=V71YkkxViHIce7ZKvoyo56MuQi6Pk4HNvlemX49aGaJEl24MBOs/QV/piJ1zVnD325XfJr uMFz3Cx9LUNEJ9+Bu+5J6CQOF8JsVCiKTwSK7SCfnH7veWwYWpsYg69kBlyjk2XQkrmSoB 2qyEJ7flBCoDdq6s+044/fpV+Y67YJ2j4z+FjTTlTcVTRG4uXg2ewtkbjo5UKxofzMAeKm kSxLfalir4i2Gc/KMJ+rKLt+13bGUYOBObFviqRO/EmlhKLptiGeWr7kxRxQOZ0ag+Y7gz uo3DSYDngNj92Xf1Z+H54numwSw/+j4acx4mhxaG2zA6zpJrba+t6+vV06gGTQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D242319 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZH0rySz4drjt for ; Wed, 12 Oct 2022 00:49:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZG3Mm5z3nv3 for ; Wed, 12 Oct 2022 00:49:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZG2Tmjz1881 for ; Wed, 12 Oct 2022 00:49:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0ngq2069501 for ; Wed, 12 Oct 2022 00:49:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0ng6P069500 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 180001] [zfs] [panic] Solaris(panic): zfs: allocating allocated segment Date: Wed, 12 Oct 2022 00:49:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535782; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eHdHy9xgGXsgYLr4Y9F2XqLFNO2L20dhy25d2s4UJZo=; b=eMZgqj6eSuiPlgdwoN8KM86LggrCk4MSjTtQ6cw0kVKJDIpeeMw5BDwGvRYGETJgKhp32M ne3yRgu9hDnGU4FMbtJa4+FEDoahEhRx32UrhbPOuAa0ABBoGB1NrztRAS8zPZV7uPtyJT T/FdQjRMTkz83snW6IbmnvvHr8OoDB6OaLmvqzPEBQkkOJeXLVyHfFsYLMrzoR+Wqs4FX6 Y8BNrHWSQ8EMcHiSAW3W9eTXu8Wb5vByz71GdhUHoQy4iN8i81idz6VesCfVy2GVnF6y5S sToKFktFBPVW86xl/p1cICwjwkU7thYaUytBH0hxTikMsmW8+tsEaB4G1nI72w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535782; a=rsa-sha256; cv=none; b=dxgDZ65TXNlWyESqs+oYZp0+kdegTzAOhPrbecnTMXuC7wBHiulK5Gvdw1eVY6h7AZN5pW JAErwy/9v9autt5rF1DXwfgPC/cI8foGBeLUwTraEp6iStdmhKpKaaJnkqXv22KigSoHjw PjAuCcP1/oR97Jp2rNt0zyPjidH2IfHPq4FbRjgr4DhOmpzyNCc66lvzqAPmrdwL3QOdcT w2yWn/fNlonOdmYEh6ursd9Rpgj8iksCKnUqT304i9dPrrMyl+K+1TrQIXyIr8yIRSI/JW rdYkxIB5/XmzYO8KUBEPMJdHbKWxJLieqeNMeceKVL1pmyIw0NDnvV6kM9vnog== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D180001 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZT55QJz4drq1 for ; Wed, 12 Oct 2022 00:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZT1dWdz3ph5 for ; Wed, 12 Oct 2022 00:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZT0lhTz18BK for ; Wed, 12 Oct 2022 00:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nrd9070024 for ; Wed, 12 Oct 2022 00:49:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nrt2070023 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 249147] [ZFS][Panic]Fatal trap 18 on boot after OpenZFS import Date: Wed, 12 Oct 2022 00:49:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535793; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3aw0mqXXyo2pYIwriZyYf1vAmMv2Hg4WTrkmVQqwtGc=; b=ypoCu2NVq5VnDCU99xojOwxqDamiY/9VWF9oyQFFFbdw6+4paYXxHQW0+Nk2VQY7XvS7uV KT+F7XJVPuRdJNE9mGToswiBwL17jfX2yY6MhsxZpf9SZJ1K10VkTh/SfVHJdd4behnMuF kLVgQbSKXzvZdh+jh5+Z/VZ5dTwQxmdyzE4fp/6cS57U7e3wN/Hdr4GFgQpQWFqfRy1mz4 fgD6H0vHPiJwr/80Ky+TZ00RHALvew0Vhfe1+9mGHMEkphvLZ6T3BQB3mC3B1Pstdu3OKR 5jRGc+Q2oIFYtM0vzztWAdybFrRP7qZHBD+mR9GjphsiqE/d0nLWHJfHLr3irA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535793; a=rsa-sha256; cv=none; b=kX1VbJfuynt8TUSCxeZK2QIwa5ub8I7mEEmiBJg4YsQoUylzIF4l3d1bqqBBQ0BewXZL+5 juiZiTywYuLlAFOktjJddMJkKr1oqsES5j+mY15spfil5c/oqnwQuBkOAnn47FjYhJZzhL DLzKdx1Sz2KVZSzyF9AZTUg6vwKBW2AndemWPnjTQPfhyjM7jK2BXIlF4h/kOPrJY9rxjh Qx9aDyTh9KKnmWG4a4pvjtPCUMh4NJ4RGOe5ycj+EAh5uhRlE9I2gZwUWoSCkBfHgyjzD3 bhozpwnYI0XSPvO6YBLHajDH8iTs+9fO2w54JskI4uPk7FWAgCAravlIyv4lAQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249147 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZZ0Z0Nz4ds4P for ; Wed, 12 Oct 2022 00:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZY69Wmz3pwf for ; Wed, 12 Oct 2022 00:49:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZY5C1dz188N for ; Wed, 12 Oct 2022 00:49:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nvPj070204 for ; Wed, 12 Oct 2022 00:49:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nvZW070203 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 242184] r354398 causes panic in nfs_unmount during shutdown Date: Wed, 12 Oct 2022 00:49:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535797; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qm/czF6w/3pKx1xtE0XQAwfvgdHd6/NqMPQvgj1Vyfg=; b=fju7Xtz9QbYIuIhDVBGksXtnXljTFIDYQg8us+isHs3XpvKK9j4iMueBZvW/xiAfTx5/rr CwFiNgwr6LMGUxssb/A62owumbHw91K1KvuTBM8G4GfUyvSAT6gKTJwJ8gij1FPVdgwRyT ifBw63yDflHAohmBu+eEULrJxPXKKI7ugYm+7znfaG3nYWJDRorOpJWF9k/pUA+9fiv8Ok iF+tUpgWAfYUiI6oTK2sgnisgnyrXFAtBiyLPE8H1n13iiJ+/xg9U1txyCfveIxfew/2Er 2toQX98GqiwA3yryUgsAMNRXODSXIYZ4NO3jswx/xLXSDjG15yWXSDKVNIv+Zg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535797; a=rsa-sha256; cv=none; b=P9QRifPmXWaS6dOE4jOsU0um/IUPkJ+ucLc0NWoUYFhJufoFmVFkLYhRyOpV35OziPEt0H Fy8DO1MiT8kJ2gjA4zqODyvE85W+1y35JqEVTExSOcHJbcNF27YK/t/x1BHaT2uZFZ1a00 YGKA3bTUBTUzevwU3YJRCZA+gCIxYvgjaeYFpBO4J2kFB+ngNk0NdzWCnCA2j86itLnOya aqxFzdDqE4RHxjVnYkH4G5ektAOHo74fgn9erWNDECaeGxf21R8D2HnwiimpcjYpsqYQpu mEBNnIIpKPmYcGA4hWS6Bp5VMkuWn4kQGyHS2aXVtrIUYGdV2IVNA3X8hoU63Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D242184 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZZ6RW2z4drsh for ; Wed, 12 Oct 2022 00:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZZ2BmBz3q9F for ; Wed, 12 Oct 2022 00:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZZ1K3Rz183y for ; Wed, 12 Oct 2022 00:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nwha070229 for ; Wed, 12 Oct 2022 00:49:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nwuU070228 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTY3MTJdIFVGUzoga2VybmVsIHBhbmljOiBmZnNfYmxr?= =?UTF-8?B?ZnJlZV9jZzogZnJlZWluZyBmcmVlIGZyYWcg4oCTIGluIHJlc3BvbnNlIHRv?= =?UTF-8?B?IHBrZy1kZWxldGUoOCkgc29vbiBhZnRlciBsb2dpbg==?= Date: Wed, 12 Oct 2022 00:49:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Unable to Reproduce X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535798; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/AzVaE2/3kn7+Vaj5/txQs88YOPHMyy3+JDGMbIw7bg=; b=s8tWDV90UakVE2qiRkt922NYFlTTsKZ5J893TPoABgovkvuLPbdAD7pauKzMrpPftu6SQd E/C8DUOkf3e/VNV8yr3xhWQN1hPnzW8+3+wSgTmTt85e6lFpCeX1cHaoCTpgcORzJOdMAB 4rrvD2q3Bq/MUoKDvfWyBcQqALP2kti9iFlUIbMf53+SuckCihFnrydsIXBTY6kPiu1hUM JTY4JMfDbOPdmaONXudB9mBNBfZNBCR3uwMcsMZUlez8Z4ge7ztVZ+bPepyc/CaCT0Sl4T NmmWtv6w1GFz+iQbXjHBr6fTiRzhKvIFJBkWK79KfgIZ947bDJD10dCHCRpqag== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535798; a=rsa-sha256; cv=none; b=jDhBzulbN2pVcrkARcjZUOrR2KZERvoxY+qSq0pSha89ZKqsa3ppgTYfSI9BKuQtIEp7Bs paNGCGgzelu+Q/6PXyLn68t/mKDwggT5dXgHeoywH8aI7KJFf6cERYbdDhQGeEJjaSUUGT dxOmhTBr1Fh8goOdnLHqxyfiAqw3LjX0vfPq/xnsO6aAB8tsPS9D2iFITDXrOyv/pgO4VE UnwUBlzpBOWMRX4xqkFiS8WAYsVglCczNJmQiUAFg05bhIiLLLMGwh7hYGzvt29aMGmd/v c8rzevASyncQ9uqR4Bd+3YFBop8meywB7oV4VqCXByOloHdcfTEiqnxDM53JLw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256712 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:49:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZb6XVNz4drrt for ; Wed, 12 Oct 2022 00:49:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZb1RZBz3qFN for ; Wed, 12 Oct 2022 00:49:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZb0Z1Dz17qT for ; Wed, 12 Oct 2022 00:49:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0nxbd070255 for ; Wed, 12 Oct 2022 00:49:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0nxVE070254 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:49:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 242369] tmpfs + union_fs panic: lockmgr_xlock_hard: recursing on non recursive lockmgr Date: Wed, 12 Oct 2022 00:49:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535799; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Kb/qDV0Puk26RvSvwesjHAPnZyLCelZK2Ax64Anp65M=; b=B111VAr6VUb5/HkiPQYakUys8P7gFCTeFSGqT5drmuTl/0N8gVZh2eysw68q9G2oZXpAZk OeJaUalFXD0/EnTFOyVmG0HoQwy0qGKWgwi2uQicyqoeR/i3PLADwQLGj/fZZSYMf8ZqTs y+hcO/QXdWJYxp8x3kskFF8GsvrRC7F5VtiMvBZ8hPHmHx4PM4dKGcyS0M7m/NLKiyjwgN Y+D60DSI9R7r2SMvnRxKkB08AS3883AcJ/Yw9G2tlpvbjI8PHEe7MGZI+ZEZzGiZljmqB+ fx54rUPBUnZae+TcwQSAJfEYWzYkD2S3D0em+dzw1ChdpqB31a+6CDx+zzXK2g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535799; a=rsa-sha256; cv=none; b=GKu3Fqwo0bdpbbyYuUSVKr6hwYhWoWRKDtQZ7NxOMdv4YHZWF9vXsLg78Mph3N+/v7Nb9Q btmyw0v6Bm/6NbtB+fIWlXSXrDpWn5UYJYjIiAK/blti7fkpQJEydgriZpMrkWWHsoMP74 S70TnqPaapi64Pr3NYuOOuSfD4py4y4JLbjNGCRXjDhy01BwK/Gmt7NDnbF7AKh2rQNmrU PCLNDLHYWGdp30aqFUhrTAwd1MOwC4DTvW93AvDsC6IKjYV7bXzmhHAAlxHIlmJQyCxJqe xtYaz/UNXJ3NIPG9CL4Yc2v++tH9pBGd177xmGbc56pa02mDzvYdwOfsY5kJTg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D242369 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZd2b95z4ds8H for ; Wed, 12 Oct 2022 00:50:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZd1H0Cz3qJl for ; Wed, 12 Oct 2022 00:50:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZd0Lh5z1844 for ; Wed, 12 Oct 2022 00:50:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0o0tA070598 for ; Wed, 12 Oct 2022 00:50:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0o0FK070597 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253158] Panic: snapacct_ufs2: bad block - Non-suJ mksnap_ffs(8) crash Date: Wed, 12 Oct 2022 00:50:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535801; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CKXxTG7h+lR6yldhR90hXemJnATc+PK3eiIibH9Kyuk=; b=xCww4BzPXGETXV568v9nvDgkW/ctH+7t7RGzHUBRn+To8kTtCjYT1M8NWwcReI9Xrq5ZS9 g3htCWvhaGLLbh7EnflbTRpzb733YOq8kTUoqX5yKcIK9aiGKnUO96PCwVVgeaQ/bEIP7S z8OUUJ2rh7eNDrx4B8TcONJIJO5tJ38fkPVpADbE4lKoAqfQS+gUYzBXLxigWP5nPqDkM0 nONUpuCdrS8coZP98k63frXSN+KXq+3rMYvVJRJGmDJ1D0U9R2ceJKlH666zbXRA3jiX5D PbbJ9XeAX9iswYRTVEr4A0sWAe+93MdG78E7hlEDxx8hTb/ce2nqe+0eceVVXA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535801; a=rsa-sha256; cv=none; b=n2beI/phk6VgY8CYREU45jBw3YJ27kkJ/VMkIOTc/djPvOGo+oECasXP267Qh0EGS7jDG8 3lrwcrNTbO+D9qvCNnhChjOqoNP85hzD4MzPtTL/4R2kDvrOgT+M6Tbtve0mOaX2/KGVS/ d3Hxqii3noSixcuBXlPnoo8S4ONhoiGgmxnf/6NbNrpHypYpWqAMZkrVNO8XIxZ9VHClg9 MRF5xjDbO9qUYgYU0I48zBZD2fwyKtgRNDygm/AraNzrJUVkYGGF+huROO/lsuawgjY3e8 xd/EdE7mw9DDT8CR1ywCl9bhg9TFbOYypw5NRY0tZV88ELjzZvrrxcFqrtBLIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253158 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZh1jQNz4ds6B for ; Wed, 12 Oct 2022 00:50:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZg6lS2z3qHG for ; Wed, 12 Oct 2022 00:50:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZg5s5fz181S for ; Wed, 12 Oct 2022 00:50:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0o3U9070706 for ; Wed, 12 Oct 2022 00:50:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0o3Tv070705 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 243620] UFS softdep Panic while rebooting Date: Wed, 12 Oct 2022 00:50:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535803; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qw8XjQDQ14QUt+e4iO0/wL42GTh5NEVfLDe9zIp86/w=; b=C3LJxFPyCLo0HT9PD+nFsy+aX4Be9+QVtf2UXzQnuU4gM12qXBjYENCm5Bv9zESkEUU7+y 82WN5eRKejnpPZtAW2qzPHbFc950zJ6xE8Iei54h8f1Xk5Z4Y+a74zp3PiB0NSm6ZC9CoT WCdFSnvb99Mpxtowv9ZelEsyGGlIfxwIgj9JVOQuT5KigIJPogXT5p56ducpmdlFW+elbt 8ZJ8pei+ibp/O/nE12FT9rGIw+UlehZovfJ7oQPuETQhoXcYfmv3ocKzBxs2J9nJSr33J4 N+Q2FwB+JcaX51zhCfrWlEHtMabBdEwckAvizmk8qvJlW0ySO1bsvLgsdhHV8g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535803; a=rsa-sha256; cv=none; b=C+lHkPq84vcbTvEoG/nHS7opaR+2h/Yb2d+uEt9SmMyjMgxlhTysYkvMLvZq/ZjO64jNSi m4/FIexysGPRUIddjV0kkypjvJ3t13r+Z7VU5vfg+gIJtlTUEZ40tRIKYgE+LpdRM+DthS xtRCbc8YVseCGZZiWINaojQjcvK5TIPJW6pHmVJ9/1nVFw8N4XztMjhXDd6muJU6A0J9dX jiPTuc1grBHGQ00NUdq2JiXTVnbuEKj5mc6FQ32VAfWZZydSbvM7DtroH+g0+lZm6w79B8 jm+2BdmOd7qPOq9N+m/TJLejCCV6Efl8ghFF/9gLXEysZOu68ctcJqhwx1Y7+A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D243620 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZk1TPlz4ds1v for ; Wed, 12 Oct 2022 00:50:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZj6rQ3z3qks for ; Wed, 12 Oct 2022 00:50:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZj5rBzz181W for ; Wed, 12 Oct 2022 00:50:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0o5UH070793 for ; Wed, 12 Oct 2022 00:50:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0o5kS070792 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 230962] Kernel panic when writing extended attributes with soft updates enabled Date: Wed, 12 Oct 2022 00:50:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535806; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QTLtAiqVskiNX2ih+RkcL9ysFY+6BiaMHTnmXr7QI+c=; b=g2lFGuzTiVXK4XCL5qL/4OOZLMVw83+Hsj3GnYDrXFSZuia8LYiZKTAo/ZwTBfWNclbaXf 508/UrWh6Ju1cAf8FSmMw8Lgv3APwaPUyShXk74rSCGj/Ol+6/GtHPvatBL+oiMAJW7cX2 rDsydDn90Ib6kZP4dCoU8ZicqeUTmxF3gmRR22E5nOnDXuzQ7PtYBiwPSDa8Yl9ivFHILl UKLMATLwjQhU+eTnjW1qYKSMcpz7VV7tKNUK0+tOgsWth+R4+CKf/uCfBIUjJRv9DQQzIH 74bk+HGRXSAkeAV0EePS5BJ2P/kXJdQEBNQAAnQlTsEs8q9SbJ88XpeUeng76g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535806; a=rsa-sha256; cv=none; b=OZOST4CMfmz0ZsJl2RbK7yG4WDcGNb8XJZtrQyzrKgC5xE0A9f+XxjjZMnKvchSlsGSYVH lkonAZGg3oVmZNejYky0u+Y+BUnm7bLtDyNChzvMsvcgrIiCb1bMau+okHaaF9VIg2lK86 dmyqyArtb3D1KUgaflDJkEUM7s7vOT7KEPMH5cbFnfJ4zmhE9frrCN1d52z50AEMQBt1nl ZmqmKF0WplrAxLjBmTx/wTg/frhKHWWcXzyz3RR1yYFIx42TGbnzRpIzKMFCgV+BUj9Cwr oCrHwAlboandkySFRDVe5hdsa56X06f8roCLmFe8nSt2TtyR79tGdeBP0/ct/A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230962 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZm2r9zz4ds24 for ; Wed, 12 Oct 2022 00:50:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZm1G9gz3qm3 for ; Wed, 12 Oct 2022 00:50:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZm0Mplz17qY for ; Wed, 12 Oct 2022 00:50:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0o8Ro070890 for ; Wed, 12 Oct 2022 00:50:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0o7vL070889 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252981] panic with ZFS encryption and QAT: VERIFY3(0 == spa_do_crypt_bad(... Date: Wed, 12 Oct 2022 00:50:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535808; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nxBIqvTF2bZMw+cvcZHTaMqIebIa4yJ9CAyRoZclkLg=; b=BwmAGt+V5JUQXUj5V1Y/l83VtBEui/l58ipHSBGWfHewZh+2QoYBeIeVydxqk+FhYQudZ7 ITywjc9xHKCZAdH5WX4rXGmpeNTxgXQAI7qXwXW1OwWbRb5dSF9YkkGT2omr2rVo2FpSLu hJGErfGtqG88CLDwW7P6faPlMI29cyfYBIv3v5QM5pbe9PkonIiIibeFAXDXFOm6g1GF3D GfwFf9C5T4X10IberguAl5elZExT9t61VJgbAqTpmVy8A0w6IzU5UbR9T+AbpyuMBdTcmo 9Jj1uD1/p/eUV8b5D+6LEnjLVNmMVqROyfTKCciqKC4wZU2BHYWGwfPlXHsCfw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535808; a=rsa-sha256; cv=none; b=IVXkRrI9f2xpelyf+xmzJwmObf65aeCW0IwK9YRNt9FQWn9UyfNKgMLlGhMywLKEaj6jHr DO7rDpG7KH2ernvb1Vph24TValo0GOBYLIAj8WgdJS49DT2IMvVQpDK9POm3k47mbpVAf1 3GUNIcEfYik76lBzoHz2mDzjFN2jeOkAK9SIJxSd0kkafE9/+GbDjGmPNh3Wh7hyH3Wmeu WbXFH1Haf0SnaLrQXJlOZ9jkQ44p7+G5uaf6nheoYSlUwgcF+Rvk+QNCDU0NeEeAmPhMs7 eKkRIdyVpsw8T/ReXeTMerhB1JMIsE0ei1YCfl75dmXcYsUHsL1mF7Q/wXN9EA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252981 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZp3gMzz4dsN7 for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZp1WD3z3qs4 for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZp0dhBz17wJ for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oAd1070995 for ; Wed, 12 Oct 2022 00:50:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oA44070994 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252396] [zfs] [panic] Panic on 'bectl list' after slog removal Date: Wed, 12 Oct 2022 00:50:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535810; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jci4IvfOC97Xw6l7GxOnmXqwU/BjHqTcCWGsvYMH8rs=; b=ZhptEEG3oHonr6NrGS5MNx6q49XAky0Q5rscp/dEb67A19TlIVBM6l07AVeAG0gQVkSW8v CFYOLUvzPfepq9Aiqj9BHDRZ2+8Vy85HJErGwEstDN9QbN1Z2O9AB52N3xig7lWdloKnaR 3B3g4TbtLGAFecGjlfQLFoDgU2fbYaDewKzBdYqdGpFre/nqrL3G00sdF47bUJ8q3mZ0rh WlLGdVq1csxiYnisFMzIENduk3DJsxfB3t0N6UabI1sit+SJ5mbnIQ8eXZC5ph3YvNzRkS 49uvLqZUjKy8evytRXtLSA2THif0e1/ZGEdk2mHN0me7p1f8HOpTQg9CNHpD+g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535810; a=rsa-sha256; cv=none; b=lEjrgAaW4F0Lapu3vfBH3dieGbtprHSAWA8DoE57PCJw6rAlFzBdHk8TZ00V9c7SoB7zI7 h0RYhfkHlFSCayMxef6V3V+86gymRPaJG4xClv368KFD9teyCV5D4dQoP3Goi5aQdvXqLD bwzymqtTiQd7hVyrt6nvcOmgTe443i38A8YaQ8cw04y0ZbnjFfnuqYVx0GaxZnGvwl6PXt Vzo9IF1a4AXeSN2ooFNV+9gvz8Qd5IdyvST4Dqaf7Q2C0AmHzQR5an97R+ZXaJJFseKAbP 11t7LkD1HCqpiNtULDRnQJrrQZ/DKvVMnsy551XW1s4TCqW3VNHgSUxypnkROg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252396 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZp55mVz4ds8v for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZp3kh3z3r3B for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZp2phZz186q for ; Wed, 12 Oct 2022 00:50:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oAeg071012 for ; Wed, 12 Oct 2022 00:50:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oAsS071011 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 237637] ZFS kernel panic after removing a vdev Date: Wed, 12 Oct 2022 00:50:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535810; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Fy9JsN3xMQUbM/QDUYRwQYeJULaCKDQt2blGvOugRPo=; b=iKZNVlTvqf/y7Z7l+xbGC3QSFGYIeg1pDLsxpjSGRn7bfhxKq4M4PP+1cNiyPprEsp3lE1 hIvXvqva+GdtlQ9hMrm3f+jTJlt7GCaxv07zPztmPzcDfkfsd02JpMu0aRXlnSCOxF5KSF RPwCmuhB2Z7omAVLtNjn/Sck8FYo/6mPnYqpgec6xT6vH5OvYwe4ZH7+GJGHNCC04+yYht DK4JizoWZdIDW4I9c1bvg1ZszsiBYdsbFA4wqpxl5NuJtNaaC9R5SAmaCiBfIMvZZd0JSC MsGy4O9m8Xbog53B1tUeWcesk9auxWBu88hG/0aGhU38++NYz8YeSblIHQISTw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535810; a=rsa-sha256; cv=none; b=V98IvybYEP0B0dJ7ge7hGKza0aulLfxI4TjxCJHbQReD2JJBj/joom7RZCezEKwdwwLTpu SJFIe91J9zbpGzbJ43XDTcfm/orLICEp7bJPPTHUqrPTK+Ggha1r4zOSF6qmePy85n8ldF Nj3VxxdGc88JhtOPnAK5XVZf12+ETyHVlvFiYzwpVO/HCEcK6T6SnTKNC63kLnhLWvglS3 2vP1g2m46AfR2EcbevvHkDg/IpmgNL3gHFMGqOgUiQ63vBFEz4tomSb9eIJZC5Htd0cW4D qWGs8FOvlNNzCpLMuIkVxxXpVYZy/h0uw0hKoe/YZ669rdYNCmNIU2peX/PlLA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237637 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZq73Ysz4dsBX for ; Wed, 12 Oct 2022 00:50:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZq5z8pz3r2C for ; Wed, 12 Oct 2022 00:50:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZq53HSz186t for ; Wed, 12 Oct 2022 00:50:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oBc4071066 for ; Wed, 12 Oct 2022 00:50:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oB1C071065 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 242839] zfs spa_condense_indirect_start_sync panic Date: Wed, 12 Oct 2022 00:50:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GixpOYwibi+wt7Lu4K4zpLMdTs9DAdpNiZSEFPKL/q8=; b=YsGI4VCVHqftLqw8Vwwty7QvQNBmkd2CoD0A9qGuoFmiL7PgEjR1yAGQFz1YXfu0e9cA/1 GoELrDCi11Wj9N00XdosgVSXBBoH0FTMZDX1sIpbrzKLR9J1Zlu6NZg/YemzEAy/EmR4FY aSizuQKgDDHEKR+Gd9q0t8LvPtu6tgxjLV/CzUFo55mHedKim4HzrFUmPYB2w0cIe2aucI WtoJcF9ntC5A/jvJ7UC3tgihkMH8vt1YT0NYjO9Qxt8BVSbuehhbKpgzOWN0nTAR1zXmBa A5AQe2aE0jGWJliZIG9PnhZNWlMslnlEGZUr+fZDxyZMpYEA57sC3Yls8Ef9RQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535811; a=rsa-sha256; cv=none; b=q4JUb5Jzq4T82WBm4cQv5le3K4C/DsI7fe8pUQTQRs4t/dE+9th7E/RVobZqGrgfhXyl0x TKQkBOV3l4FiF+vEBssEMm5v8fIMZ9vjJ9Q0mxw57wE1h+xK9ms8ndIQ7S0f+k00DVawyy WG8InxhD8nTQGxYp75VrO+PBjj92rWR138nqCIySRtTwou/oEcygx8/p+8Hvt3CuyMdP3D 2CMs3SfJWz9pbLoMjsusT1qaI5IxhHCuWEbuyv9c0zFfbeZOeefF5mAFYg6AOXxtIkEMzE rlFRRpq7841gKu1NjFPcLeCkFPKtdTAQcKca/lczfPdEh9gJCXHaVkilk7F60A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D242839 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZs0gnPz4ds6s for ; Wed, 12 Oct 2022 00:50:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZr63Xlz3r4S for ; Wed, 12 Oct 2022 00:50:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZr59bFz181g for ; Wed, 12 Oct 2022 00:50:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oCMN071123 for ; Wed, 12 Oct 2022 00:50:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oCNf071122 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 243638] [ufs SU] panic: worklist_remove: mkdir(0x29) not on list Date: Wed, 12 Oct 2022 00:50:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535812; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=X3enJNEACouXclK8VRq7IO5LJNf48nIFIjXNt+kHOvk=; b=aQXw50DDIFsxFmzzC7aQnA6mBylrJ+cLF+dZlQX4qpPi7oR1xqx452PZAx5+zSMP7bXyWZ j3fbQtri5kkzAUBbTnoZf1peiRz/mg+WTni6TNj1f+x5kzE9jkNuuwU9QdecT1BUNA4Lho 8D0aLmvAeanRO1HlEzYP5ZEqZB3EaRkEYxiHoUtaOMD/I56epbj7tVWgXywRd1HM3qTTKo Xz7VJgMmXHoOqTCGSuz7TNavmc/U4WG/+CI/HkMCtMfR/PF9R3T5kOOZP0uTX/2Ihgel5I xDVwJm2IWQ34YlJWc5dmXSZQos/iYOxPtvqr0OAEnw729rtZEiqrbRPeETrTrQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535812; a=rsa-sha256; cv=none; b=pIp5rs1yworjHtIRMXpujb0EuXgkiERDdGnzvl8FEr+BbHLnNeiyRg4PV71IzVxu7plIvQ GBBRcw4jLHUcD8+G3mZ8K5CI0CE8z3wWZwCdAMyjyZUb+z7mRk/dVoPeNedy9/3RY2vhT3 ahgscKx8yReS8oMuYc9uhHRUK3NpxUZtqLLBvg9/i9JdVcZLQzbw9uGtM+XXUl1o8j8+bo cQc1gSMMQkKibpqrsYlD8JwJrjlfmgT4FYSRJ5PGd0pT6IlCzyrluOllqxJvY+rxeKNhsI jW9jGsQCBJ8GGd4uMClVOZGMU/gjF2W5SyrHKbiVqr1NJYS5/4G28MV7Tty4+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D243638 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDZs5qdlz4ds6w for ; Wed, 12 Oct 2022 00:50:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDZs1TMXz3r8k for ; Wed, 12 Oct 2022 00:50:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDZr6sjbz181j for ; Wed, 12 Oct 2022 00:50:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oClG071135 for ; Wed, 12 Oct 2022 00:50:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oC1X071134 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 237067] ZFS: Crash in vdev_dtl_reassess when using GELI with autodetach Date: Wed, 12 Oct 2022 00:50:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qkZ2csae4Cl4In2JEihOL/rTdgFIiTSQOHYngTNAAhA=; b=u1aUj48197/wb91qXD2sPtLfAM99MH9Udy2ehkzRGc+GNoIrlEIQFboQI73sqkF9pBzH0s Ldp7Oq6RhF78uArJ6Zt3ffIW4yfa5W12rQSlsyLu/d5LOSLxPrpPwi4Be7rh7F69dZG3iO 4nC9yd4/Ec2gVBzh7Ou33Mfn76kcdQ/dVBVh2lB8BHBAzFuGqKab6ZF/BsCGUJS40Havsa i+m3x/9j0C02XOMpIqkqB0bYQxe+5foOwUeDgbyNRSI0h5BvSIMswvAT3sQcP6drGnuEy8 cjzbbqR+EAjz8amgcStpAcMj9hL1LO25jCTMmQ9aOUywj83Eq5CFPFH21d+6yw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535813; a=rsa-sha256; cv=none; b=kwK1bgLFz4VAXzkUh64sCY0A6EfJM2kccm34zJ7rlnjzv32zXsjwdEIwgrriOqeOL15dB5 ArJcwDASTahWylqqLso5GdV9j0SH2QrKU7C+IEieLugGPOCFzOSdUdOg4EIt2ZNwWuxLdT b0bWe22oKgZVNvh+lFTRY/CNBHQ8Q4Cf3/t4QoDnmjBMh1z+AwaofFV90OCFHuhQFEs7Pu 9i/KZ0zrbyUFVs9d5c1x8agtEwz6rQlTlfelO+qk52PJkKXs3oIQHxl1F0Ay+3bxFLvgm/ 6nSNGOMc6J8QdYJgIjMqnth5H5f269ntxNd7zdQ99Ugqunrln9yQ6kySIo+eQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237067 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDb83tPTz4dsFt for ; Wed, 12 Oct 2022 00:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDb82msnz3sJ3 for ; Wed, 12 Oct 2022 00:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDb81hYcz18HN for ; Wed, 12 Oct 2022 00:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oSL6071825 for ; Wed, 12 Oct 2022 00:50:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oSNg071824 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235683] [zfs] Panic during data access or scrub on 12.0-STABLE r343904 (blkptr at DVA 0 has invalid OFFSET) Date: Wed, 12 Oct 2022 00:50:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535828; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ou8U+Xth5PKROepTm9nFXiJxF+3Ym+rTdmR27xQK/RU=; b=RIKsPpd4zuEuzg1Qxa/jVOkuDFi6I03J8Autx+yxlbsLjR+Y2i+9YtXlsSls3zZWmPXjhK MXaQwhGjs1G60pDIqEzVXWSDadPeuDCDNwo4eAPyA0gJGMnF+0XEs3wkqu6tOBSDnOtRr5 xa1F6C63WQ3ieyfC6lRbxaMxzWLvTnxPmxrrvmBKf8j0skQMumO9SWF4kM5ZPf+8q6hY7T euQuN0v9KuE1d1b1kCVYt9/BRzT6vY+ZIS3kqh7ttR1JAU7dFPcI1rc5mguh0+RmwGIbBa ghBdCF6+Ngf9HPHi+/e8v/a1jS8NPv/sxGXV5HRlIU5m3ponfC/47ZH3QbkNWg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535828; a=rsa-sha256; cv=none; b=NUGaGzzgdErPUkz88QEhf7NDNkI3ThbVWoelo8kHSfGvkD8/F1g2YTbWYCJVzIulXZXqqs vVlVSY4JQqFyT7Nrk/n8VTc7Ri25yRxHaQmdSFjJHF99sH26dIJWrWOVlTXX5iWBd/O9u2 q1mISz8WI8g91hN7XdImXv32esAfvwbLbOFlExKNa7472147qS+QtT1nG+noyEdrK/LA12 5QaTNs/SYlIM7qThBiuJtl8CdxZworMpJ/e1lSVCRAkGDWIGaJybliP57hUZNTTFNm8zh4 0mnUaB/KqQWbyj4TR4DJUVM62XPKFZ7kdRE9of92TF6YdZPDbj8LrdCRQOhxGw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235683 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbB3Vvkz4ds9d for ; Wed, 12 Oct 2022 00:50:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbB0nDrz3sc4 for ; Wed, 12 Oct 2022 00:50:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDb96vJCz17yt for ; Wed, 12 Oct 2022 00:50:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oTWs071923 for ; Wed, 12 Oct 2022 00:50:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oTJ7071922 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263765] panic: ffs_sync: modification on read-only filesystem Date: Wed, 12 Oct 2022 00:50:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535830; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1tsoCAbyT93Lz7stRzHqwNx+5oKAMxNOkMdpKJJZHVQ=; b=HGTrnGo5oxxNpu560AdYZamTBUYScdJ8NoRtxaIGEFGpvPgWUSaoTMzNkk5C0xZuBd8syl jJLEPElOZprZ2LRbyupNPd6HOohgu/rKWVn15MuNFeC/CI3Lzq+LyNX34fKU4ZRJj5Fgi/ IxwWiHp1N9UM+YIBKLgYJl7Jn5llAcp9pRreX2KfMAISQK+TCX9DHq0SyBUsTRPH8bWLjX S1lDkXcTYDNbwer/ArfBcm4NJPIsuWUXrwOl1llaFwNl9J08ESQg4u/LZ8VAcMEyyF8KNr R0YCpg67jWAx//Hj5WMtWovNdeWWtaHa5bpVTfAFz5Pgr9GevrxvoppXqDQ6+g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535830; a=rsa-sha256; cv=none; b=HytHOjEsMoeIsWlWb/RrCmHRymeKldWXFynJ9LkP/SHA3/bjW8AZaqsmo5g/5u9hkXslE+ q1po+vOeZxyeiZoWmvF9mKtTKpnmIjPhfAeXks+3qroff6HQ3tC5eOwmDfAUcgq+TcZ0C1 rbYIzV2Du3fYGp9imc19XEZcfbJIdA32Gd+3dyH4H1KjfNsCj5xkdwrU1Ud0swZ9oMnCPX NtBy7bxhJcYHIsdhUyArLRQ3AGRtKBKOwRa+RqrM7Vi73YZ60eC76KZj5KnmfOe0tZM8rJ Uvdh9wiuU2bPYHQ9BHvOzmI/t3g+ZwtGLo2+k5nWT1fpbOCd5MlFhg2Cwz/2GA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263765 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbC1c4Zz4dsJH for ; Wed, 12 Oct 2022 00:50:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbB64PLz3sfk for ; Wed, 12 Oct 2022 00:50:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbB58j0z18HQ for ; Wed, 12 Oct 2022 00:50:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oU0i071965 for ; Wed, 12 Oct 2022 00:50:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oU0u071964 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256816] 13.0-RELEASE-p2 ufs2+sujournal. Fatal trap 12: page fault while in kernel mode Date: Wed, 12 Oct 2022 00:50:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535830; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1zKwVfP17/QsH2wubwJqnGRLzFEVZt+HD8uSfSPz/ZU=; b=gjb9N0hpGsW2Netmy3mhI+BUv2n2rCkqysrbn/lxCN7CYEbRmDsrO7KNw48doJXOdGD3D3 gv7DQ5hDDYEkk1IpZy9hmQnoLR64wt25amJ5aQl24LHMkFfG6iE3xojUi/ImGo7p7Q5Om5 qmInUkerkRIA18WMHxJOAqhc/kyo+X7G5gmIYTsBaRuaC/6eOFqBBOyNFqqlawM2sCsxtn /anTRUr0ngrxtqXcF1LCjPzVI8H0sLSiwGmqVtgxuxM67YE0dEETD4/g8lmJ2vM5p6kD9b qA6NFeBnZRsjr9f39kLDHTTeCTxvDAXHrY24NiFSfsmjm1mGUoWBQxJPq4XgPQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535830; a=rsa-sha256; cv=none; b=k/r5r1zcqjBVA+JGhyNq53LtDn1xD3J1tKKmRo2ZucUhDe0skRey3x74vnqF4Wp3xgSu6g UbBOj0WlLxYM9EP6S7vmcx9SLYoU023gJIfc3tM5PtudTRPH930B2yG3z4lqcDCIU5XpWZ RQTa/xzAmTO/LM3P1HN8YOp3hWNJhxPOsRFIR8Ibm5DKnnhRvPbGyCPeezYQXbb+0zdvGX uNlATS3zOypw+DlpJLn7EOI7wPgCwWk4kvUIm+KzIj5zaAfy5Zdie8tIgkX8w+qdapptDC u1IvdjbeKZDwMxaJ/rWiBYEyb9IVrXQ8iZPHxu96/UKSSUsDpzecKFNwM4jI/A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256816 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbD5zRNz4dsGD for ; Wed, 12 Oct 2022 00:50:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbD2ZN8z3srP for ; Wed, 12 Oct 2022 00:50:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbD1fFmz189F for ; Wed, 12 Oct 2022 00:50:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oW7Y072028 for ; Wed, 12 Oct 2022 00:50:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oWhQ072027 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235852] [FFS SU + snapshot] panic: handle_written_filepage: not started Date: Wed, 12 Oct 2022 00:50:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic, stress2 X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535832; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=puQlkAHGWJs+8hs8buVm5Ne2jLvnCcnsVAhQivWGVt0=; b=lS1w2zck8yfctQc0HR/9vVXOnrWbrG8UBIegWumVpvibQFze3RWe2bUie7NeNmxAU741/6 YfWfX7jqlrIu2avPcAOftlw1L9hNBOgiS065n+3s37E/yv1tBfSmeYX5aMXjQFgUqnl3bl ku/MTh9XBr1iDdGC/InW4rWCEBpqlh5AKHdazNzINYo1O8lmWZmix0sAf+R6ToB9c1vMW+ 6ZvIGOWDQobwlDh4wd9uGUcnnWIm0FXZqVEVpmOrT1s4EhK2pzyobhIk+xY7d0deVZ89Gz WfK3up3gFpCYSoKOkiTdlNECHj4/lrK4DlTbFNPdZ83DhRcc+vcEYowRkIP+hw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535832; a=rsa-sha256; cv=none; b=hSPwk9ZGeZ5Xf6tq7MONAr3JEsvw3K7SzEsiQgZ0Uva0AuG+SzzBAWRAN6c+TkPYXJVlam wNsOgdNn9LXZaEgblF/54ajv8HgRHMaMSkIfk4hHgSlYZQzsnTADJ/b+w9/d4qW6zggoG2 iXVcgqnggH06HIJT3SH4mSx34iC/PgkCy5J1/RZ/PKgAik4CWUj+CKaAAk1RK1GoazI8hD XxM3CHrroOqEO2ZILC0RvHrB+LB4zY/yDe5fw+RGCGUcQ6OBp2GYIN/Oi15WyovB0T1dNo +IULUZxabqL9bL6v72uCCwgxEAjN5qkrK+WMjOhTAXvbqYwcTugaUaoCgOdE9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235852 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbH0Tkcz4dsGK for ; Wed, 12 Oct 2022 00:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbG6V50z3ssl for ; Wed, 12 Oct 2022 00:50:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbG5Jd2z18FK for ; Wed, 12 Oct 2022 00:50:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oYPd072125 for ; Wed, 12 Oct 2022 00:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oYCX072124 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 252821] UFS filesystem panics after deadlock during mksnap_ffs Date: Wed, 12 Oct 2022 00:50:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535834; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ROd8jl1yPQXZy07j3vUYaE9z6OQXKJmKnNBOU5MlYGA=; b=wdXkyAM4ww43Gf52pEGORlid6grNUOuzSvBDeoXj2byVoqV5b9Sst+ouDHk9LeHz7KFIEE dqTqvZZDXCf7AKoXIDkYyJKPOGwERGKn2JsnvoNmnW/dUiWjJGEo6BOClsTJuN5rumQEYC HGff0/BR57o0hNnoKTufAVt1uXA7PFqVq/IeG+QQjCK/Eg1XXkg3DcAjiow9ubq+Oj/8p7 HWJwcSOXfeQCQ/ACIlXbDVBqmStYX9whonI9SKHjJ/8cZHn8zKN/pupofamTPy3n9wqbZi Gay8ZZsZqQJCDTLqGFT7VSI2hQ3o9irWUu9LA6sLXUclT1CpEyIrh4X46Cs39A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535834; a=rsa-sha256; cv=none; b=O76GCqFFRfhJIxk8X8lQpPhW4wAFZY60BRlbVrjMqBJ1YLxNHmwda1b+pgu+0L3K8o719B HL4fYrqRY0M+oaMkglXijDUbPumxbjBQwPqACEemwU1NebCXcBfIbyV/uJOSIruNgoKDN8 eDrB+/fEafy4SJgMgP3kv61D6GfzURLACGLAsuA5bO5gTqms1j9MO4dbI6nMmJka0K3Si+ lfNP9nHDK/N7u9Ur6sfFHYk/zWwv8iuwrovzn1vPBsRB/1DM4ZvQBu6qRK/5iZ4YluRbv+ rpm3dwjRrzZdPHdwNEeFUnMGjtpi+qSrG2H5+dg+Q3+O7QBCvzt/dPyiM1G3CQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D252821 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbJ3GZwz4dsRM for ; Wed, 12 Oct 2022 00:50:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbJ0cJ4z3t0M for ; Wed, 12 Oct 2022 00:50:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbH6kssz18CJ for ; Wed, 12 Oct 2022 00:50:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oZVX072175 for ; Wed, 12 Oct 2022 00:50:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oZC7072174 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 211959] Kernel panic in devfs_fsync() -> ... -> g_vfs_strategy() in sys/geom/geom_vfs.c:173 on 11.0-RC1 Date: Wed, 12 Oct 2022 00:50:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RC1 X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535836; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SiBKDyPgUZw3Q3ZHbSempxoFXOzH+czFGMBU56M8n40=; b=m466glgJHaReGkGyl4BFxslMLc3cB/LXRhe8PN7kKkpnqWWCC0hCS1w5tUkvS9z7WlfBhh NxusOcohj65MUzu9RPfBj0RwAlD4gnYwYY/Nv0fKlK613IWMAJFZQoJACnkDI8x5LWz2y6 YAsMWZG1DFPMiOJbK6FWFQVnsc4WdWBGYSIW6X/oWrUaX3qAwxAsi6IKmGZyg586bZHh2K NCM24nTyGgFAeJDTaXuvFq2jRKVJWSPQ7zVNYhkqHUzh4zvLDZIzCw59qIE1YhSTwo4eIY /woxxiHK8lOOo9fFtgWLnuxU0Z22dLyT6aoxTSjEnerjIKVC/2ro/A7vWzBiSQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535836; a=rsa-sha256; cv=none; b=Oan3n0M7DtKNVnNw7EJtNNClSxT8PEcbmC+Fh7AH3noO+KyU8BW9IVmd1fkhfYLpfrOkK/ 2QiirrhR/Uvvg6MdkX+vaN+vnf+d/Z53iP6CHusIqxdZxYiUMcRLRRjkG/MMOSmPRzRfdB ZfB8vy86jKlULSeu4dZu4Cfd4+5Ooikj/T/T/Uzn1STTu3IZoN+BTSPB8FBCIfzgDNPSAg lawEPrlPF2iU0eWmOF/yKeEnjczjmUWhLXvNqu8w+RaAWSRkYvbKAmv1f0RgJ+Jlxx5Aic ZMqGxxQQpeGXKDmJ+be+raI47nPa0iIvQ+9eQ1iaXLHyLHPmv53Guop25vozrg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D211959 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbK0J7Mz4ds9s for ; Wed, 12 Oct 2022 00:50:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbJ5Hycz3t0c for ; Wed, 12 Oct 2022 00:50:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbJ4Q4Jz189M for ; Wed, 12 Oct 2022 00:50:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oaxG072212 for ; Wed, 12 Oct 2022 00:50:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oaB6072211 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 241604] NFS kernel panic after running iozone on share while idle Date: Wed, 12 Oct 2022 00:50:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535836; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aD6w3i1ZxcaxusxezLwSJkt25POTMsZ9FE2aTFJfAN4=; b=FLZA5nOcslvVduLFlhKbwNOT2PavqM52nqoINFt+rLdASUQjkOQ8x+6XaAa55smXwJLVr7 8PfX/0Zc1gcJl5t6DNyNQXJoc4qh8D1JtY6DRbrJ4rtRvyVymxdcQ1b5O8cuzHOO25xamO Bt4L7dbKF053zI6zQaLl8Jp8L9Q3pL0nYPuxQeQLOhZFKAaQndlDDDAZsw1STO6UlZ3ugG i9q+jCymHECosrW4bENoMysqiOQbPUmyyRDdO8att/VvJVwMUiDytqtiCmHcYOKoZIU0Af 6dwNquhm2qfsvDnAAITKyGo3oDcxxYuQWb3qTlvTaFiuyGOEFbOF7S/URj052w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535836; a=rsa-sha256; cv=none; b=S50Ex3Hiy/B4p2pvw6JLCXYlXQaKtPHBlNuAmPtUXg8/MyB1rXokM/btEPIAIS6iiRFrcq u1SR2FjIJ4mEDFmu4xtL+uDcsdsHeTTqnxABH+uA1MgQ9tDFgRmB48ouC+gTbvDJ8rvrGW LpeShxsh/2nNEnXzYT2efzUe9+KVbrEj5Kig1QFJPhZSLdv1DK0kAiaihJI5XXBkd4eL1y fp5KLeNWbc7mMVEDYFYqzYuMNr+eC0aioI2OlWAjlWjEWV9Yf6khKgGgHNTl2sq0OalQqe UN7QqLzgzLRsnNMVjFIuuI7guaOp0o8HPmSv5NJFybrNrHRnLMoGVGtHMZOuig== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241604 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbK5k2nz4dsWX for ; Wed, 12 Oct 2022 00:50:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbK44V6z3tC7 for ; Wed, 12 Oct 2022 00:50:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbK34Mrz18CL for ; Wed, 12 Oct 2022 00:50:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0ob0Z072254 for ; Wed, 12 Oct 2022 00:50:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0ob83072253 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251342] fs/unionfs: VOP_UNSET_TEXT without VOP_SET_TEXT leads to panic Date: Wed, 12 Oct 2022 00:50:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535837; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=d2O0qu67lnrrWYVHgQfH75bQWq4rYFlPY0Yka3oC9bw=; b=kvoZ618pCjhTYHpt9+vDEOulraL+Tm1byOSE4pCrOQBjRJpoz4pRF1KnrSUmwn/IFMQsa+ FWiR0HstkOGfv67TrYQtNlXXFq45YSuuwNYowCLT9uuUROiVE9YnTTktSkUjkfkBWmVfXI gjZFEKasLu/RyPM0NBusC8fp0OCCovkBWjj6PzbTHomrv36Uxa14u9X28axsHzGFknzMGq sVr6KrYfK5LQ1NFBoGlGH6sgIfwYGZIT7RnTs+H8OCM9S+bAN2okLFiXESEZyq3RYwVlVm d/ntDrDCyhxf6ORx9TQZ1Rl2ZK/t9Njwk6SCpEiJLslYJe/GNoRNajw5tUuAEw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535837; a=rsa-sha256; cv=none; b=Bbk4QI6UxoK8SmU67OT/cPUv28/ySVWIka1V+09wLkQf/2RgH/FxpXWs3RHpx/vgdt0lHJ WpG7a1UxYj0VEe5MoVkWjR5xmejzeYXKkwWOMOKLPGC7SxPop5kCQB1+4xONGzY549cLhA X4qgslZgzQBpVm25tPV2rewvoP3Dnk4Zh5ZFUDP6OaX414oOSCUPZ32FDXhOo1NX3BG4nm DfznnQz/OfyMCN8+qMaKVek0rM9C/vh5R88x4JftYZEkyDU5hLGPp/PXZwpueIATU0TPfD XnMIWFB1CUKWkdUWwHQf2lX94SqnEVjaGUFpi5JCg+lGhFq56ooGDL4of5YqBQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251342 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbM40vlz4dsV4 for ; Wed, 12 Oct 2022 00:50:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbM2fqjz3tNp for ; Wed, 12 Oct 2022 00:50:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbM1jfhz1809 for ; Wed, 12 Oct 2022 00:50:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0odXU072323 for ; Wed, 12 Oct 2022 00:50:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0odEW072322 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253890] [zfs] panic: Assertion lock == sq->sq_lock when sending ZFS snapshot Date: Wed, 12 Oct 2022 00:50:39 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535839; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TenE9ouaGjLV8bE50LEecaw+qa64mzDX0CsWXrFyuG4=; b=j9TH5AP+TptqklgY7CfcItGZLPaWibmcPj1BLd4O8GGqg3r4K82vG7LoTqFxNglzKHqwNA 0kGjSFaIyPXK6qjZVLjMg0m9Sra++TADjZc412KLLV+z+wNGvPwYD+YA/xip6Y0q7/NbPX A63Ouu3njeV5tW+y3x7W1pUBVTaHvA6qO3vO4X9+FIf3A+K0FL7G7hqMNbZa3nqWg8C6Fs I7bX/3XOeA9WxMKEtQWcg+/e8Jnx4BcGjBBRx/azPfcagbJMz70mc36SJo3Azs7CY8340y DpFqs2PcDYyhwjGRUJZaU6Fw9tuDdXCs9Yhx1EcErBczgTaZcxD27EATHJ48JA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535839; a=rsa-sha256; cv=none; b=CokV9dnWTyE1sFVmLRloSj40M2MSdRMihT5YXBGDgLQ9f6RIlGrxX8CQiFmQjpuUFHkllM j468AiUUR5DkwoZF3aCuRTz2ovDaDm3HB3M6i0HfSnJtDzUdxt7ktvcqQVoRmUc1ZBXJtX wi2wWC1o84iY/xhK7qq0eMJfFglCwEeASqZHPePHfhVIpNFOsDW0JGCAdr6xrF/Ul0tUlL Q7H7jSd+1e0ANkzLlYHOJezyK7XLOTyY4j7DBC2Mne4rJ/HelL1gdOTj07fhEO3ajUvNPN tn9cpSJVBK/+2dG5fD2DaPymd3W5WUZ/yBPFzN9rS+dhBsN7N6UzpnmtN1WM4w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253890 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Wed Oct 12 00:50:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbP0YlQz4dsCm for ; Wed, 12 Oct 2022 00:50:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbN69Qmz3tDN for ; Wed, 12 Oct 2022 00:50:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbN5GKkz18Fc for ; Wed, 12 Oct 2022 00:50:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oeHJ072415 for ; Wed, 12 Oct 2022 00:50:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oepa072414 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259093] [zfs] [panic] NULL pointer dereference on "zfs send --raw" of encrypted filesystem. Date: Wed, 12 Oct 2022 00:50:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535840; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Hh+YwMPulloBWULGCyvDPbCGRvIWyDW6flXsAD8CJBE=; b=aKEbK9ItzHPXlNUMygMfMMpmF8LJe3QGGCjKP/oWbj/+kG7O00+icUa0QJHU33zQP4lCsw j8jS36Vem2qYQBVeHQ6AvbX2H5+Uy450qcbCgSd6lngLjGtxPuGYZnE3AuOMUo0I+35Eps tL9/ah2U9B+53O4k12GMHJpPIhHM1Dhn1ZO8s3QL565HGoAGFJP89BIUelz6t3RKQNspNd Ry0ZXgLNe9c8glx8cgjteCRx3u6AvgrNO4KE+v1Vi5AhOEOwJnzNG5b78LIhn/uzdia/ra NWAwi8MPhLgWOohWaj1Pp25vVMRXv4B4NRTMQIQOlmPbiiaDrHK/s4ZwJqx10g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535840; a=rsa-sha256; cv=none; b=ikwIFtTZmu/FJurAynA6wWR9bOQ/tMf8stwJLHQ33I0ok26mIi2inVE5hlnRWbDDqs50q5 sUwi8UH+QQJZxgBukYdcFFqYqgpIXa9g+t/EOkiiIEn2f5gKSHSIFKdmSZinDY0o5AsQ0z ieebUPPZroOPy8r6GAf8Y0z1B8hr4IUVnLpVAXr3umlgPBsY/2BYVsC5GxlerA4wZlacrL fx0mfbIUJE9vlW2P6K9jpepqs30LDJDdiLxbphHZP7JF4UCvBpi+yRzRwXofLmYd8hqjRY BC+wEePVom/67UiGMw6h//VZpGq7K7v1H+V44FOwwvwtmqEYXIWOQS2K55caaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259093 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbT0MJCz4dsD1 for ; Wed, 12 Oct 2022 00:50:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbS4cRgz3thW for ; Wed, 12 Oct 2022 00:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbS3l4Dz18NS for ; Wed, 12 Oct 2022 00:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oihU072618 for ; Wed, 12 Oct 2022 00:50:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0oii6072617 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 232175] [panic][zfs] solaris assert: HDR_EMPTY(hdr), file: /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c, line: 6213 Date: Wed, 12 Oct 2022 00:50:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Unable to Reproduce X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535844; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2npFd0LHkRMm2WgDNYuP1trxl25eNLErHRr33O+AVHk=; b=mwvicIqfCkVWkXhCywDbIje9iDY/D5SVgGGKvBVD2fM9MKQjFRgqAifJ38En3AAfZq+2NB sgrQ9I4NlRdazv2y9gsx2Ikcl5SALfYtkkWK0qF89J49ySLFCt/zhDLECKxwrdhZSDpZ+4 aow8lDDvp7mqO10l/6BxNAv5udxUKInmOkz+aQ6e7OljE59AU4HWshpOehHWMCtOIUzOpW kXro4TSbE7hOS5Ioqe5blQrR+fWekhwo1kjOFpOowlGempCe2qn22Vu4JXHaKYt+7MOSJ4 GlfcOS9mMXmtXRsbAO6T2b0ABSwzlwMuaWf9vRjvqskNSwkAThyKUIAsP7UZ1Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535844; a=rsa-sha256; cv=none; b=q0ALIHG/9fF7v6sC0sKehicVA6r9Q7Q9Ch90jfozYbpSDvM6J+l4w1v88KWInolasA0IIm mj2gVkZYOfX7QOZ10V394VIcX474HQ8ZrckDS+8mJUWuRGgsqJ8SP82Kgg9GVaDNg6Bj4B xb5NsQNKpMMHZ7W+xyIJDDeriv83giPX31mev+zASX3jPHjFwZyM1tHbVrsPmzMILzPrDs he05HW+4zh8OKpBMvlsR6Y35bk7r/cnWVVCqZS/xJkvieuuzTEK/RKJ0nWvvD0eW9Rm04I O/QJeSK7ZMonvbISs5JNdR8lAycva0gsWnOpDvC9tqOTtKFjlGQdvcYX2b8mtw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232175 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbX2dJlz4dsZ4 for ; Wed, 12 Oct 2022 00:50:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbW73qnz3tk6 for ; Wed, 12 Oct 2022 00:50:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbW683Rz18R6 for ; Wed, 12 Oct 2022 00:50:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0ol7L072777 for ; Wed, 12 Oct 2022 00:50:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0olYP072776 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 245414] panic: softdep_setup_blkfree: not free Date: Wed, 12 Oct 2022 00:50:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535848; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bYvXjgAwQXKTolGrJ94r4d+QOV33W5oa4QqUWrBvcNs=; b=g5How82xfxFg7ex9evt4OvcSmvL0qUJqhbVy1kGVwTCuKfo6uxV3MNNZ83i32GgTPvn4R4 9cCWNFJIhV2isGjqKIwV7kmqgtXJ9XOeHKS+6/rKc4LVy/oQNesOXHaKG6mIr09rzMsfb7 kmZdlYfDIrTJP5zHi7ufb7QB5Du5wJ40JaZEMUSIrUpuUWr5Jip98ffsFqHyYaFESQJ0f3 NdlDdeTPvg/eaw+veZQ1UXg1159YB8PK1qIcwtQyAM8xFtAXxZBDi1BTe0vdaQ6reIKsZd 4E7JA4dMrzjrDzDvirVaW4sWDeXqXFZIFhRP3r+g+YOcLPembd8HmzQ8EIDGPA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535848; a=rsa-sha256; cv=none; b=qYvipvPHmc2+TpCZSqQoKumMpCfCuqVGoeWpei6e/ETDH6+xLlf7wSOduIwUwSbFC5roMR q1IgZw9iJcTGEBgNRhP9Xp8chb0EOWQ1VmJZGZSoVjGhviLnKGNMPHlyxi+JEovJPIKFs1 ZDHs0ogNATUFy/MoVxgVo+lGyjjoUpIsjfXg62O2zfCx168YBW9VO9r3YIOM+uDynWFutW cee3NuCYszjckdmxG+xACcge48m3LE9BqtL4jeRPws6WOMsYs0LAPgKK8ApGgC2SUAzsc3 PDmSqx5ayACmDDwjPNJ9JLp0DeYA4XBmJKPZGAc2hz4BxyT4pHjpkCVGJsfJTA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245414 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 00:50:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnDbh56FKz4dsQH for ; Wed, 12 Oct 2022 00:50:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnDbh2hF0z3vLt for ; Wed, 12 Oct 2022 00:50:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnDbh1h5zz18J7 for ; Wed, 12 Oct 2022 00:50:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C0oux2073075 for ; Wed, 12 Oct 2022 00:50:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C0ouBR073074 for fs@FreeBSD.org; Wed, 12 Oct 2022 00:50:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 230752] panic: excl->share in newnfs_request Date: Wed, 12 Oct 2022 00:50:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665535856; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5+KC69o6V5g9Zpxf1MJn6WEUqg0KBw2UhKHfCp7a1aw=; b=jtg+pPnvY/ZHNNsJaR5CHQ2ymEqKlpqXRF3B4anu8QQ5G+j5L15ubxs4d3CIdQrjrAF994 uuTPIXORaTFFg9iFD5pgSeBLEGPR3RnnJ9XMhb+BfMMDQ8X9AOrpUDukzq5EOTL/Gfrc5O 3YHXX4Ds9sgmNh44FImNrL4JK72qNS75C0pz1gkfujeGK1D826DQnwgFAhUYhGkasIeq06 Af09h37ixwMtsEGGhpBrBuM5/PnwxXmKIGMecHb7QlCzd1JNoNEAFvBcb6fdTdM4/CNklH WWfc8Z76kiQ/1RTTMF0Ambo6lsq0UYhnIaj7RG2r24aCqWJ2gQ3DuQY6J0arpQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665535856; a=rsa-sha256; cv=none; b=LpR7znhCg4Pf5qOYMs8gbwzzhkj47r57s4LSSSuLPEz1+gkzzOAwQEiIv5dEzhxds/HjXk FdTPHk7WPJB+XTzsC672fiM/y8Ep1PVQzwta+0iwkx1m+msJFmXOsTa7877br3844Q2TEP auy8r7b9MAAxDkbuejPJw1SLvIj5gZ/MIQ7/zJfvV4dvaZ7BmeX7WLh8HavzmWOVtkIm3F mXsZmSNkrdDwT6ogGp8zY4xJnFxBWLey/8kTNmxNBGxHn1+UG1Qe7mYeCmeT+6EkJto/9h Yv34ZKmFsqbU5xWo/iy7ZEtxMptM9eHB8LXt+WHdg6bdCfF13LjOFJcJm9v+hQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230752 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 12 03:55:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MnJhx3R1Wz4fG96 for ; Wed, 12 Oct 2022 03:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MnJhx2SJYz4Mql for ; Wed, 12 Oct 2022 03:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MnJhx1QY4z1BYS for ; Wed, 12 Oct 2022 03:55:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29C3tjj7000919 for ; Wed, 12 Oct 2022 03:55:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29C3tjup000918 for fs@FreeBSD.org; Wed, 12 Oct 2022 03:55:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 230752] panic: excl->share in newnfs_request Date: Wed, 12 Oct 2022 03:55:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rmacklem@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665546945; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eD4Nkq0cvFt8y/o+jhkW1FCkUcacHoUSL9aPH9zRXMo=; b=dxYvP2ZKCjfpoCtYL68ZSwn0TZIrNFeIHrCKZNs6NSzTAJZOM1j1cutlKFFNtP+RG9U9qV obggTFgEi9A1LhPgXuWFrFuW2oPLrHXjAD7dtnImmfIeVn5+gwtA4zLmyKLiXXcS5rF6mI tLH01y4X6xFQAv/PTTRLIvELETanPpWCju4/To3DHBvlPeiIU/oNxx0SG0b4UHhYRYnekK 5SyNhb291QYzU9G8yX6kncj7U9YmOe4RLNJKCqyiNXWrDP1hOUeqBUMJXaWL0gn8+B96D9 Cw4YBOeYzXCOVjg+hkdUq9/xtYYO6uQcwY3nmLYdz+/a7KwHyf0yuWIRJ83g1g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665546945; a=rsa-sha256; cv=none; b=KQkdIE5/M3q+ocOls9felwi3TE5KbGFYmTEvztsvIHlnC/Sc/FEeKoaTn9g3GPzM/xMbMl u0+ZqTwNMg5ehB8fkJ9ket2YAh2CfkJoqTH0mv+z1qg6fCtCzR3UVfTY8KdXvssxlgTlXB AmTe0AkiJ53FEvLXIoVYSanAyVsvDTNKUyd62DklwWaJ1l3Uk5P0v3yRSvizoiLgnN/Ed3 62mKP66hBcS7gdQHr9jBuahEyXDDC2uZUtVR4cVqrpZkE7cFI5FnOj0LwsZbnhAWoWog4T SJQh3bbCgwj60tP1WL7CHJVtgRh4CRX08DfO5eeeS5LEg7JImpTTzxqLc5sWDg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230752 Rick Macklem changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED Assignee|fs@FreeBSD.org |rmacklem@FreeBSD.org --- Comment #13 from Rick Macklem --- Fixed by reverting the change that made nfsuserd use an AF_LOCAL socket instead of a UDP one. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 15 05:27:33 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MqBbd17BXz4gCQN for ; Sat, 15 Oct 2022 05:27:41 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: from mail-yb1-xb2c.google.com (mail-yb1-xb2c.google.com [IPv6:2607:f8b0:4864:20::b2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MqBbc0288z43JH for ; Sat, 15 Oct 2022 05:27:40 +0000 (UTC) (envelope-from archimedes.gaviola@gmail.com) Received: by mail-yb1-xb2c.google.com with SMTP id e62so7825017yba.6 for ; Fri, 14 Oct 2022 22:27:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=wcZtnhojg3fFmRzOb9NEy48l0L2dRY/p669CeyI6weo=; b=XAgYzLkxFnGRXnFJaJw7/ua+ppLNTBG88ZmFsQReU4Yz80cm4Z7y2y4QhDOpGtOUE5 9QtIDYXeIaJLDpsPFle9u86GB6c6Js7M55LcAoEvTr7Sdm7sS2YRwVDFcYAIjweL++WP lSywfITZ2QWCE6Pkk//c6QWAMB2fBZqNeC0faDxCWI7kZF9OnpYpkqDozR984Rnlt/oQ ry2AclzynjrGY5XpH9rroLf9+bPcF8b8N2LMZw5TcXflp6WbjaneIc7FKqKtL7Y6FZkf LQxshCfMynZ2S2sdcyIIz7+fgHDauNbDPgA++D1r86wxgaAl3lt54vxHDbKrRYuM254h SCgw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=wcZtnhojg3fFmRzOb9NEy48l0L2dRY/p669CeyI6weo=; b=VqyJkE/n8syuvsT0WbCfNJrtdcYU1lsbmUnGb454WQ+oPvAEzlf5ubBvN3qqQTcEcl MZ/2hE47DifomASpjLwftMt795QZkk32zcrXYaAJ0I1eS3Ta8LbzgWVMYQXsVz1/YYAX O6XP8Hh9xJdnpvdI/eh6VhWMzp/0ND4S/xi9aTYefH+JfWJHuFRrGC+skNnwHn3Ao7Ot SRyiL+T+vOwfSdDaflz6MlqdtvhQ2QJKv/ffBKKdYRgfZs0RHp+S3GTyp9QjT/5+TMSj 8rk8yJQ7/3OBoBZ+Nk35rfaGX0CN3+QFO2OFQ92KBkR3rpVlHuah+ad2p+2BFODdBHVp uTvQ== X-Gm-Message-State: ACrzQf1TBZPpFX6WhnukKjVF4dWSiAUaR8da6cyPwaYewaDJchPWtZYN MFqxfVowyGqiSK/Ig58ojqSXEhpsIg0AnKWRT5ga8tbWmdM= X-Google-Smtp-Source: AMsMyM6TklcEthjBaVymSvON0lDQSmu+RZrmHKS0mBMrOV/XRBNSNRnWTAfCtifF7VRjjXpbRK9qRamGbGSMV9ZKbDc= X-Received: by 2002:a5b:1c3:0:b0:6ac:c87f:3dc8 with SMTP id f3-20020a5b01c3000000b006acc87f3dc8mr912739ybp.547.1665811659017; Fri, 14 Oct 2022 22:27:39 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1630032913.129053.1665400270350@localhost> <896114746.217581.1665409172569@localhost> In-Reply-To: From: Archimedes Gaviola Date: Sat, 15 Oct 2022 13:27:33 +0800 Message-ID: Subject: Re: UFS in a USB flash drive (ufs:/dev/da0s1a) To: Ronald Klop Cc: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="00000000000032d0fe05eb0c00cd" X-Rspamd-Queue-Id: 4MqBbc0288z43JH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=XAgYzLkx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of archimedes.gaviola@gmail.com designates 2607:f8b0:4864:20::b2c as permitted sender) smtp.mailfrom=archimedes.gaviola@gmail.com X-Spamd-Result: default: False [-2.92 / 15.00]; HTTP_TO_IP(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.989]; NEURAL_HAM_MEDIUM(-0.93)[-0.927]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b2c:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TAGGED_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --00000000000032d0fe05eb0c00cd Content-Type: text/plain; charset="UTF-8" On Tue, Oct 11, 2022 at 3:00 AM Ronald Klop wrote: > On 10/10/22 18:15, Archimedes Gaviola wrote: > > > > > > On Mon, Oct 10, 2022 at 9:39 PM Ronald Klop > wrote: > > > > *Van:* Archimedes Gaviola archimedes.gaviola@gmail.com>> > > *Datum:* maandag, 10 oktober 2022 14:09 > > *Aan:* Ronald Klop ronald-lists@klop.ws>> > > *CC:* freebsd-fs@freebsd.org > > *Onderwerp:* Re: UFS in a USB flash drive (ufs:/dev/da0s1a) > > > > On Mon, Oct 10, 2022 at 7:11 PM Ronald Klop < > ronald-lists@klop.ws > wrote: > > > > *Van:* Archimedes Gaviola > > > *Datum:* maandag, 10 oktober 2022 12:40 > > *Aan:* freebsd-fs@freebsd.org > > > *Onderwerp:* UFS in a USB flash drive (ufs:/dev/da0s1a) > > > > Hi, > > I have a scenario (see below) after which the FreeBSD > kernel boots-up in my embedded system, it is looking for the root > filesystem. Now, I want to build one from scratch based on the examples > below using a UFS filesystem in a USB flash drive -> ufs:/dev/da0s1a. Are > there any available step-by-step reference(s) that can help and guide me in > the building process? > > ... > > Trying to mount root from cd9660:/dev/map/rootfs.uzip > []... > > mountroot: waiting for device /dev/map/rootfs.uzip... > > Mounting from cd9660:/dev/map/rootfs.uzip failed with > error 19. > > > > Loader variables: > > > > Manual root filesystem specification: > > : [options] > > Mount using filesystem > > and with the specified (optional) option list. > > > > eg. ufs:/dev/da0s1a > > zfs:tank > > cd9660:/dev/cd0 ro > > (which is equivalent to: mount -t cd9660 -o > ro /dev/cd0 /) > > > > ? List valid disk boot devices > > . Yield 1 second (for background tasks) > > Abort manual input > > > > mountroot> > > ... > > Thanks and best regards, > > Archimedes > > > > > > > > Hi, > > > > From your mail I don't really understand what your level of > skills with FreeBSD is. I assume the scenario with cd9660 and error 19 is > not your biggest concern. You just want to install on a USB flash drive. > > > > Does this help: > https://docs.freebsd.org/en/books/handbook/bsdinstall/ < > https://docs.freebsd.org/en/books/handbook/bsdinstall/> ? > > > > Regards, > > Ronald. > > > > Hi Ronald, > > No, it's not about installing FreeBSD from scratch using a USB > flash drive as I already flashed and installed the FreeBSD kernel in the > SPI flash RAM using trivial FTP in the U-boot loader. What I want is > mounting the root filesystem that's been created in the USB flash drive > (this hardware has USB port) using the ufs:/dev/da0s1a method but before > that happens, I need to create that root filesystem (/) from scratch in the > USB flash drive so that it can be mounted right after the kernel is loaded. > > Not sure what level I am as a FreeBSD user but I can install and > setup FreeBSD system, networking, install packages and re-build or compile > a kernel. > > Thanks and best regards, > > Archimedes > > > > > > > > Hi, > > > > To create the root filesystem on USB you can use several methods. 2 > of them are like this: > > * the "bsdinstall" tool > > * or > > - fetch > https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz < > https://download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz> > (change the URL if you need a different architecture or FreeBSD version) > > - newfs /dev/da0s1a (NB: this device name might be different > depending on the devices already available in your system) > > - mount /dev/da0s1a /mnt > > - tar xf -C /mnt /base.txz > > - umount /mnt > > > > This is from the top of my head, so I might have forgotten something. > > > > Than plugin the USB on your embedded system and at the prompt type: > > mountroot> ufs:/dev/da0s1a > > > > If it does not work type a "?" question mark to see what filesystems > are available. > > > > If you want to persist the FS used as root filesystem it depends on > the system you are running. > > You can hardcode the root FS in the kernel you saved in the SPI RAM. > But depending on the system it is also possible to pass the rootfs in a > variable in loader.conf or some other place from which the kernel can read > variables. > > > > What kind of system are you running? > > > > Hope this helps. > > > > Regards, > > Ronald. > > > > > > Hi Ronald, > > > > Thanks for sharing the information, really appreciate it! I will try the > newfs (newfs /dev/da0s1a) with my USB drive and then afterwards mount it to > the host system. I can't fetch the base system since I'm cross-compiling a > 32-bit MIPS (mipsel) system in an older FreeBSD 11.4 x86_64 release. I just > downloaded the kernel source (/usrc/src). What I have at the moment is a > successful cross-build of a system using the build command below; > > > > cd /usr/src; make KERNCONF=RT305X TARGET=mips TARGET_ARCH=mipsel > kernel-toolchain buildkernel buildworld installkernel installworld > distribution DESTDIR=/tmp/rt3050 > > > > that instead of using the DESTDIR= /tmp/rt3050, I will try replacing it > with a mounted /dev/da0s1a. And then let me also try building without the > kernel. > Hi Ronald, Ah, yes, with DESTDIR you will have same effect. > Before you can newfs the USB drive you need to partition it using gpart. > Some example usages can be found here: > https://www.freebsd.org/cgi/man.cgi?gpart(8)#EXAMPLES > For flash drives it is often a good idea to align on 1M by adding '-a 1M' > to gpart. > And GPT is often more simple to use than MBR. As you use the kernel to > load the USB drive I'm pretty sure GPT is supported. > Thanks for providing further valuable information! These are the missing pieces of the root filesystem that I want. Maybe I missed something on GPT with gpart as it doesn't work but with MBR it did. With GPT, root@:~ # /sbin/gpart destroy -F da0 da0 destroyed root@:~ # gpart create -s GPT da0 da0 created root@:~ # /sbin/gpart add -t freebsd-ufs -a 1M -s 8G da0 da0p1 added root@:~ # /sbin/newfs /dev/da0p1 /dev/da0p1: 7168.0MB (14680064 sectors) block size 32768, fragment size 4096 using 12 cylinder groups of 626.09MB, 20035 blks, 80256 inodes. super-block backups (for fsck_ffs -b #) at: 192, 1282432, 2564672, 3846912, 5129152, 6411392, 7693632, 8975872, 10258112, 11540352, 12822592, 14104832 root@:~ # gpart show ... => 40 15523760 da0 GPT (7.4G) 40 2008 - free - (1.0M) 2048 14680064 1 freebsd-ufs (7.0G) 14682112 841688 - free - (411M) Upon kernel boot-up, only da0 is present in the list. ... mountroot> ? List of GEOM managed disk devices: da0 flash/spi0 mountroot> ufs:/dev/da0p1 Trying to mount root from ufs:/dev/da0p1 []... mountroot: waiting for device /dev/da0p1... Mounting from ufs:/dev/da0p1 failed with error 19. ... With MBR, root@:~ # /sbin/gpart create -s MBR da0 da0 created root@:~ # /sbin/gpart add -t freebsd -s 14G da0 da0s1 added root@:~ # /sbin/gpart set -a active -i 1 da0 active set on da0s1 root@:~ # /sbin/gpart bootcode -b /boot/boot0 da0 bootcode written to da0 root@:~ # /sbin/gpart create -s BSD -n 20 da0s1 da0s1 created root@:~ # /sbin/gpart add -t freebsd-ufs -s 8G da0s1 da0s1a added root@:~ # /sbin/gpart bootcode -b /boot/boot da0s1 bootcode written to da0s1 root@:~ # root@:~ # gpart show ... => 63 30031809 da0 MBR (14G) 63 29360128 1 freebsd [active] (14G) 29360191 671681 - free - (328M) => 0 29360128 da0s1 BSD (14G) 0 16777216 1 freebsd-ufs (8.0G) 16777216 12582912 - free - (6.0G) root@:~ # /sbin/newfs /dev/da0s1a /dev/da0s1a: 8192.0MB (16777216 sectors) block size 32768, fragment size 4096 using 14 cylinder groups of 626.09MB, 20035 blks, 80256 inodes. super-block backups (for fsck_ffs -b #) at: 192, 1282432, 2564672, 3846912, 5129152, 6411392, 7693632, 8975872, 10258112, 11540352, 12822592, 14104832, 15387072, 16669312 and upon kernel boot-up, da0s1a slice is detected, that's why it's mountable. ... mountroot> ? List of GEOM managed disk devices: da0s1a da0s1 da0 flash/spi0 mountroot> ufs:/dev/da0s1a Trying to mount root from ufs:/dev/da0s1a []... mountroot: unable to remount devfs under /dev (error 2) mountroot: unable to unlink /dev/dev (error 2) Warning: no time-of-day clock registered, system time will not be set accurately start_init: trying /sbin/init ... > > I had a system on 11.2 which used this option in the kernel config file. > > options ROOTDEVNAME=\"ufs:/dev/da0s1a\" > > Thanks to this kernel config option I added it as it's very useful, once called during kernel boot-up it automatically mounts the root filesystem in the USB flash drive. It's like a binder between the kernel and the root filesystem. > > > Happy hacking. > Let us know if it all works out. > Yes, thanks a lot! I've made it. Here's the flow of the booting process from U-Boot loader up to login. I never touch anything yet on adding the /etc/fstab. U-Boot 1.1.3 Rev 0.3 by WErt(WErt) 4PDA (May 19 2016 - 14:41:04) Board: Ralink APSoC DRAM: 32 MB ****************************** Software System Reset Occurred ****************************** Ralink SPI flash driver, SPI clock: 15MHz spi device id: c2 20 16 c2 20 (2016c220) find flash: MX25L3205D .. ============================================ Ralink U-Boot Version: 5.0.0.5 -------------------------------------------- ASIC 5350_MP (Port5<->None) DRAM_CONF_FROM: Boot-Strapping DRAM_TYPE: SDRAM DRAM_SIZE: 256 Mbits DRAM_WIDTH: 16 bits DRAM_TOTAL_WIDTH: 16 bits TOTAL_MEMORY_SIZE: 32 MBytes Flash component: SPI Flash Date:May 19 2016 Time:14:41:04 ============================================ icache: sets:256, ways:4, linesz:32, total:32768 dcache: sets:128, ways:4, linesz:32, total:16384 #### The CPU freq = 360 MHZ #### estimate memory size = 32 Mbytes Please choose the operation: 0: Load system code then write to Flash via Serial. 1: Load system code to SDRAM via TFTP. 2: Load system code then write to Flash via TFTP. 3: Boot system code via Flash (default). 4: Enter boot command line interface. 5: Load system code then write to Flash via USB Storage. 6: Load U-Boot code then write to Flash via USB Storage. 7: Load U-Boot code then write to Flash via Serial. 8: Load U-Boot code to SDRAM via TFTP. 9: Load U-Boot code then write to Flash via TFTP. 0 . 3: System Boot system code via Flash. ## Checking image at bc050000 ... . Image Name: FreeBSD Kernel UC Image8 Image Type: MIPS Linux Kernel Image (uncompressed) Data Size: 3675932 Bytes = 3.5 MB Load Address: 80001100 Entry Point: 80001100 ......................................................... Verifying Checksum ... OK OK No initrd ## Transferring control to Linux (at address 80001100) ... ## Giving linux memsize in MB, 32 Starting kernel ... U-Boot args (from 0 args): None Environment: memsize=32 initrd_start=0x00000000 initrd_size=0x0 flash_start=0x00000000 flash_size=0x400000 entry: mips_init() Cache info: picache_stride = 4096 picache_loopcount = 8 pdcache_stride = 4096 pdcache_loopcount = 4 cpu0: MIPS Technologies processor v76.150 MMU: Standard TLB, 32 entries (4K 16K 64K 256K 1M 16M 64M 256M pg sizes) L1 i-cache: 4 ways of 256 sets, 32 bytes per line L1 d-cache: 4 ways of 128 sets, 32 bytes per line L2 cache: disabled Config1=0xbea3319e Config2=0x80000000 Config3=0x420 Physical memory chunk(s): 0x3b3000 - 0x1ffffff, 29675520 bytes (7245 pages) Maxmem is 0x2000000 Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.4-RELEASE #20: Fri Oct 14 15:25:17 UTC 2022 root@:/usr/obj/mips.mipsel/usr/src/sys/RT5350_USB mips gcc version 4.2.1 20070831 patched [FreeBSD] Preloaded elf kernel "kernel" at 0x803acf50. real memory = 33554432 (32768K bytes) Physical memory chunk(s): 0x0043f000 - 0x01f44fff, 28336128 bytes (6918 pages) avail memory = 27901952 (26MB) ULE: setup cpu 0 random: entropy device external interface null: mem: nexus0: random: harvesting attach, 8 bytes (4 bits) from nexus0 clock0: on nexus0 Timecounter "MIPS32" frequency 180000000 Hz quality 800 Event timer "MIPS32" frequency 180000000 Hz quality 800 random: harvesting attach, 8 bytes (4 bits) from clock0 obio0 at mem 0x10000000-0x1fffffff on nexus0 rt305x_sysctl0: at mem 0x10000000-0x100000ff irq 0 on obio0 Chip ID: "RT5350 " SYSCTL_SYSCFG=0x103000 random: harvesting attach, 8 bytes (4 bits) from rt305x_sysctl0 rt305x_ic0: at mem 0x10000200-0x100002ff on obio0 random: harvesting attach, 8 bytes (4 bits) from rt305x_ic0 uart0: at mem 0x10000500-0x100005ff irq 5 on obio0 uart0: fast interrupt uart0: PPS capture mode: DCDinvalid random: harvesting attach, 8 bytes (4 bits) from uart0 spi0: at mem 0x10000b00-0x10000bff on obio0 spibus0: on spi0 mx25l0: at cs 0 mode 0 on spibus0 mx25l0: device type mx25ll32, size 4096K in 64 sectors of 64K, erase size 64K random: harvesting attach, 8 bytes (4 bits) from mx25l0 random: harvesting attach, 8 bytes (4 bits) from spibus0 random: harvesting attach, 8 bytes (4 bits) from spi0 uart1: at mem 0x10000c00-0x10000cff irq 12 on obio0 uart1: console (115200,n,8,1) uart1: fast interrupt uart1: PPS capture mode: DCDinvalid random: harvesting attach, 8 bytes (4 bits) from uart1 ehci0: at mem 0x101c0000-0x101c0fff irq 18 on obio0 usbus0: EHCI version 1.0 usbus0 on ehci0 ehci0: usbpf: Attached random: harvesting attach, 8 bytes (4 bits) from usbus0 random: harvesting attach, 8 bytes (4 bits) from ehci0 random: harvesting attach, 8 bytes (4 bits) from obio0 rt0: at mem 0x10100000-0x1010ffff irq 3 on nexus0 rt0: RT5350 Ethernet MAC (rev 0x00000000) rt0: use hardcoded 00:18:e7:d5:83:90 macaddr rt0: Ethernet address: 00:18:e7:d5:83:90 random: harvesting attach, 8 bytes (4 bits) from rt0 Device configuration finished. Timecounters tick every 10.000 msec tcp_init: net.inet.tcp.tcbhashsize auto tuned to 512 GEOM: new disk flash/spi0 usbus0: 480Mbps High Speed USB v2.0 Trying to mount root from ufs:/dev/da0s1a []... Root mount waiting for: usbus0 ugen0.1: at usbus0 uhub0: on usbus0 uhub0: 1 port with 1 removable, self powered random: harvesting attach, 8 bytes (4 bits) from uhub0 Root mount waiting for: usbus0 Root mount waiting for: usbus0 ugen0.2: at usbus0 umass0 on uhub0 umass0: on usbus0 umass0:0:0: Attached to scbus0 random: harvesting attach, 8 bytes (4 bits) from umass0 mountroot: waiting for device /dev/da0s1a... pass0 at umass-sim0 bus 0 scbus0 target 0 lun 0 pass0: Removable Direct Access SPC-4 SCSI device pass0: Serial Number 4C530000070424102200 pass0: 40.000MB/s transfers GEOM: new disk da0 da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 da0: Removable Direct Access SPC-4 SCSI device da0: Serial Number 4C530000070424102200 da0: 40.000MB/s transfers da0: 14664MB (30031872 512 byte sectors) da0: quirks=0x2 da0: Delete methods: Warning: no time-of-day clock registered, system time will not be set accurately start_init: trying /sbin/init Setting hostuuid: 4e22d8d6-4bce-11ed-b0aa-0018e7d58390. Setting hostid: 0x351daf11. eval: cannot open /etc/fstab: No such file or directory fstab: /etc/fstab:0: No such file or directory Warning! No /etc/fstab: skipping disk checks. fstab: /etc/fstab:0: No such file or directory Mounting local filesystems:fstab: /etc/fstab:0: No such file or directory . ELF ldconfig path: /lib /usr/lib /usr/lib/compat random: unblocking device. /etc/rc: WARNING: $hostname is not set -- see rc.conf(5). Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Starting Network: lo0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet 127.0.0.1 netmask 0xff000000 groups: lo Starting devd. add host 127.0.0.1: gateway lo0 fib 0: route already in table fstab: /etc/fstab:0: No such file or directory fstab: /etc/fstab:0: No such file or directory Creating and/or trimming log files. Starting syslogd. Clearing /tmp (X related). Updating motd:. Mounting late filesystems:fstab: /etc/fstab:0: No such file or directory . fstab: /etc/fstab:0: No such file or directory Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. eval: cannot open /etc/fstab: No such file or directory Starting background file system checks in 60 seconds. Fri Oct 14 20:17 FreeBSD/mips (Amnesiac) (ttyu1) login: root Last login: Fri Oct 14 16:15:17 on ttyu1 Oct 14 20:49:08 login: ROOT LOGIN (root) ON ttyu1 FreeBSD 11.4-RELEASE (RT5350_USB) #20: Fri Oct 14 15:25:17 UTC 2022 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. root@:~ # root@:~ # uname -a FreeBSD 11.4-RELEASE FreeBSD 11.4-RELEASE #20: Fri Oct 14 15:25:17 UTC 2022 root@:/usr/obj/mips.mipsel/usr/src/sys/RT5350_USB mips I tried adding an IP address to the rt0 network interface including default and it works as well. root@:~ # ifconfig rt0: flags=8802 metric 0 mtu 1500 options=b ether 00:18:e7:d5:83:90 hwaddr 00:18:e7:d5:83:90 media: Ethernet 100baseTX status: active lo0: flags=8049 metric 0 mtu 16384 options=680003 inet 127.0.0.1 netmask 0xff000000 groups: lo root@:~ # root@:~ # ifconfig rt0 inet 192.168.1.215 netmask 255.255.255.0 root@:~ # ifconfig rt0 rt0: flags=8843 metric 0 mtu 1500 options=b ether 00:18:e7:d5:83:90 hwaddr 00:18:e7:d5:83:90 inet 192.168.1.215 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet 100baseTX status: active root@:~ # root@:~ # route add -inet default 192.168.1.1 add net default: gateway 192.168.1.1 root@:~ # netstat -rn Routing tables Internet: Destination Gateway Flags Netif Expire default 192.168.1.1 UGS rt0 127.0.0.1 link#2 UH lo0 192.168.1.0/24 link#1 U rt0 192.168.1.215 link#1 UHS lo0 root@:~ # root@:~ # traceroute 216.58.200.238 <--------- google.com IP traceroute to 216.58.200.238 (216.58.200.238), 64 hops max, 40 byte packets 1 smartbrosettings.net (192.168.1.1) 1.727 ms 0.888 ms 0.786 ms 2 * * * 3 * * * 4 * * * 5 * * * 6 27.110.255.33 (27.110.255.33) 35.536 ms 26.458 ms 15.635 ms 7 210.213.130.15.static.pldt.net (210.213.130.15) 17.515 ms 210.213.130.13.static.pldt.net (210.213.130.13) 18.300 ms 210.213.130.15.static.pldt.net (210.213.130.15) 18.509 ms 8 210.213.130.7.static.pldt.net (210.213.130.7) 57.830 ms 60.194 ms 210.213.130.97.static.pldt.net (210.213.130.97) 51.395 ms 9 74.125.118.24 (74.125.118.24) 71.609 ms 72.14.195.168 (72.14.195.168) 60.027 ms 44.248 ms 10 * * * 11 66.249.94.222 (66.249.94.222) 61.563 ms 142.251.245.20 (142.251.245.20) 61.087 ms 65.270 ms 12 108.170.241.112 (108.170.241.112) 58.601 ms 42.972 ms 108.170.241.80 (108.170.241.80) 77.755 ms 13 209.85.250.133 (209.85.250.133) 63.080 ms hkg07s47-in-f14.1e100.net (216.58.200.238) 73.084 ms 86.918 ms root@:~ # root@:~ # ping -c 5 216.58.200.238 PING 216.58.200.238 (216.58.200.238): 56 data bytes 64 bytes from 216.58.200.238: icmp_seq=0 ttl=55 time=60.700 ms 64 bytes from 216.58.200.238: icmp_seq=1 ttl=55 time=62.175 ms 64 bytes from 216.58.200.238: icmp_seq=2 ttl=55 time=58.768 ms 64 bytes from 216.58.200.238: icmp_seq=3 ttl=55 time=57.592 ms 64 bytes from 216.58.200.238: icmp_seq=4 ttl=55 time=61.002 ms --- 216.58.200.238 ping statistics --- 5 packets transmitted, 5 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 57.592/60.047/62.175/1.645 ms root@:~ # Checking the default running processes. root@:~ # top -S last pid: 641; load averages: 0.31, 0.33, 0.37 up 0+00:39:46 20:55:54 27 processes: 2 running, 24 sleeping, 1 waiting CPU: 0.4% user, 0.0% nice, 0.9% system, 0.0% interrupt, 98.7% idle Mem: 10M Active, 7120K Inact, 8948K Wired, 3100K Buf, 1088K Free Swap: PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 10 root 1 155 ki31 0K 8K RUN 38:00 98.89% idle 641 root 1 20 0 7912K 2624K RUN 0:00 0.82% top 11 root 9 -52 - 0K 72K WAIT 0:03 0.22% intr 4 root 1 -16 - 0K 8K - 0:01 0.03% rand_harvestq 0 root 7 -16 - 0K 56K swapin 0:00 0.03% kernel 9 root 3 -16 - 0K 24K psleep 0:00 0.00% pagedaemon 18 root 1 16 - 0K 8K syncer 0:00 0.00% syncer 15 root 1 -16 - 0K 8K - 0:00 0.00% bufspacedaemon 16 root 1 -16 - 0K 8K psleep 0:00 0.00% bufdaemon 17 root 1 -16 - 0K 8K vlruwt 0:00 0.00% vnlru 13 root 5 -68 - 0K 40K - 0:01 0.00% usb 615 root 1 20 0 7288K 2624K pause 0:01 0.00% csh 535 root 1 20 0 9756K 3020K select 0:00 0.00% sendmail 12 root 3 -8 - 0K 24K - 0:00 0.00% geom 2 root 2 -16 - 0K 16K - 0:00 0.00% cam 585 root 1 21 0 6896K 1676K wait 0:00 0.00% login 336 root 1 20 0 6268K 1220K select 0:00 0.00% syslogd 542 root 1 37 0 6304K 1152K nanslp 0:00 0.00% cron 1 root 1 22 0 5504K 492K wait 0:00 0.00% init 538 smmsp 1 20 0 9756K 1668K pause 0:00 0.00% sendmail 278 root 1 20 0 7084K 460K select 0:00 0.00% devd 5 root 1 -16 - 0K 8K - 0:00 0.00% soaiod1 8 root 1 -16 - 0K 8K - 0:00 0.00% soaiod4 6 root 1 -16 - 0K 8K - 0:00 0.00% soaiod2 7 root 1 -16 - 0K 8K - 0:00 0.00% soaiod3 14 root 1 155 ki31 0K 8K pgzero 0:00 0.00% pagezero 3 root 1 -16 - 0K 8K mx25jq 0:00 0.00% task: mx25l flash This device is the M1 router (a.k.a. 11V-5A or A5-V11) with Ralink RT5350F SoC 360Mhz CPU with built-in USB port, Wi-Fi and an Ethernet LAN card. It has a default Linux 2.6 OS with busybox accessible via telnet. It has been described here from OpenWRT https://openwrt.org/toh/unbranded/a5-v11. It's as little as a cigarette lighter having 6cm. x 2cm. board dimension. Again, thanks a lot Ronald! Best regards, Archimedes --00000000000032d0fe05eb0c00cd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Tue, Oct 11, 2022 at 3:00 AM Ronal= d Klop <ronald-lists@klop.ws= > wrote:
On 1= 0/10/22 18:15, Archimedes Gaviola wrote:
>
>
> On Mon, Oct 10, 2022 at 9:39 PM Ronald Klop <ronald-lists@klop.ws <mailto:ronald-lists@klop.ws= >> wrote:
>
>=C2=A0 =C2=A0 =C2=A0*Van:* Archimedes Gaviola <archimedes.gaviola@gmail.com <mailto:archimedes.gaviola@gmail.com>>
>=C2=A0 =C2=A0 =C2=A0*Datum:* maandag, 10 oktober 2022 14:09
>=C2=A0 =C2=A0 =C2=A0*Aan:* Ronald Klop <ronald-lists@klop.ws <mailto:ronald-lists@klop.ws= >>
>=C2=A0 =C2=A0 =C2=A0*CC:* freebsd-fs@freebsd.org <mailto:freebsd-fs@freebsd.org>
>=C2=A0 =C2=A0 =C2=A0*Onderwerp:* Re: UFS in a USB flash drive (ufs:/dev= /da0s1a)
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0On Mon, Oct 10, 2022 at 7:11 PM Ronal= d Klop <ronald= -lists@klop.ws <mailto:ronald-lists@klop.ws>> wrote:
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0*Van:* Archimedes Gavio= la <ar= chimedes.gaviola@gmail.com <mailto:archimedes.gaviola@gmail.com>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0*Datum:* maandag, 10 ok= tober 2022 12:40
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0*Aan:* freebsd-fs@freebsd.org <= mailto:freebsd-= fs@freebsd.org>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0*Onderwerp:* UFS in a U= SB flash drive (ufs:/dev/da0s1a)
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Hi,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0I have a = scenario (see below) after which the FreeBSD kernel boots-up in my embedded= system, it is looking for the root filesystem. Now, I want to build one fr= om scratch based on the examples below using a UFS filesystem in a USB flas= h drive -> ufs:/dev/da0s1a. Are there any available step-by-step referen= ce(s) that can help and guide me in the building process?
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0...
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Trying to= mount root from cd9660:/dev/map/rootfs.uzip []...
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0mountroot= : waiting for device /dev/map/rootfs.uzip...
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Mounting = from cd9660:/dev/map/rootfs.uzip failed with error 19.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Loader va= riables:
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Manual ro= ot filesystem specification:
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 &= lt;fstype>:<device> [options]
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 Mount <device> using filesystem <fstype>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 and with the specified (optional) option list.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 eg. ufs:/dev/da0s1a
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 zfs:tank
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 cd9660:/dev/cd0 ro
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 (which is equivalent to: mount -t cd9660 -o ro = /dev/cd0 /)
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ?= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 List valid disk boot devi= ces
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 .= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Yield 1 second (for backg= round tasks)
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 &= lt;empty line> =C2=A0 =C2=A0Abort manual input
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0mountroot= >
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0...
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Thanks an= d best regards,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Archimede= s
>
>
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Hi,
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 From your mail I don&#= 39;t really understand what your level of skills with FreeBSD is. I assume = the scenario with cd9660 and error 19 is not your biggest concern. You just= want to install on a USB flash drive.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Does this help: https://docs.freebsd.org/en/books/handbook/bsdinstall= / <https://docs.freebsd.org/en/books/ha= ndbook/bsdinstall/> ?
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Regards,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Ronald.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Hi Ronald,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0No, it's not about installing Fre= eBSD from scratch using a USB flash drive as I already flashed and installe= d the FreeBSD kernel in the SPI flash RAM using trivial FTP in the U-boot l= oader. What I want is mounting the root filesystem that's been created = in the USB flash drive (this hardware has USB port) using the ufs:/dev/da0s= 1a method but before that happens, I need to create that root filesystem (/= ) from scratch in the USB flash drive so that it can be mounted right after= the kernel is loaded.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Not sure what level I am as a FreeBSD= user but I can install and setup FreeBSD system, networking, install packa= ges and re-build or compile a kernel.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Thanks and best regards,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Archimedes
>
>
>
>=C2=A0 =C2=A0 =C2=A0Hi,
>
>=C2=A0 =C2=A0 =C2=A0To create the root filesystem on USB you can use se= veral methods. 2 of them are like this:
>=C2=A0 =C2=A0 =C2=A0* the "bsdinstall" tool
>=C2=A0 =C2=A0 =C2=A0* or
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 - fetch https://download.freebsd.org/ftp/snapshots/arm64/13.1-= STABLE/base.txz <https:/= /download.freebsd.org/ftp/snapshots/arm64/13.1-STABLE/base.txz> (cha= nge the URL if you need a different architecture or FreeBSD version)
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 - newfs /dev/da0s1a=C2=A0=C2=A0= =C2=A0 (NB: this device name might be different depending on the devices al= ready available in your system)
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 - mount /dev/da0s1a /mnt
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 - tar xf -C /mnt <path-to>= ;/base.txz
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 - umount /mnt
>
>=C2=A0 =C2=A0 =C2=A0This is from the top of my head, so I might have fo= rgotten something.
>
>=C2=A0 =C2=A0 =C2=A0Than plugin the USB on your embedded system and at = the prompt type:
>=C2=A0 =C2=A0 =C2=A0mountroot> ufs:/dev/da0s1a
>
>=C2=A0 =C2=A0 =C2=A0If it does not work type a "?" question m= ark to see what filesystems are available.
>
>=C2=A0 =C2=A0 =C2=A0If you want to persist the FS used as root filesyst= em it depends on the system you are running.
>=C2=A0 =C2=A0 =C2=A0You can hardcode the root FS in the kernel you save= d in the SPI RAM. But depending on the system it is also possible to pass t= he rootfs in a variable in loader.conf or some other place from which the k= ernel can read variables.
>
>=C2=A0 =C2=A0 =C2=A0What kind of system are you running?
>
>=C2=A0 =C2=A0 =C2=A0Hope this helps.
>
>=C2=A0 =C2=A0 =C2=A0Regards,
>=C2=A0 =C2=A0 =C2=A0Ronald.
>
>
> Hi Ronald,
>
> Thanks for sharing the information, really appreciate it! I will try t= he newfs (newfs /dev/da0s1a) with my USB drive and then afterwards mount it= to the host system. I can't fetch the base system since I'm cross-= compiling a 32-bit MIPS (mipsel) system in an older FreeBSD 11.4 x86_64 rel= ease. I just downloaded the kernel source (/usrc/src). What I have at the m= oment is a successful cross-build of a system using the build command below= ;
>
> cd /usr/src; make KERNCONF=3DRT305X TARGET=3Dmips TARGET_ARCH=3Dmipsel= kernel-toolchain buildkernel buildworld installkernel installworld distrib= ution DESTDIR=3D/tmp/rt3050
>
> that instead of using the DESTDIR=3D /tmp/rt3050, I will try replacing= it with a mounted /dev/da0s1a. And then let me also try building without t= he kernel.

Hi Ronald,

Ah, yes, with DESTDIR you will have same effect.
Before you can newfs the USB drive you need to partition it using gpart. Some example usages can be found here: https://= www.freebsd.org/cgi/man.cgi?gpart(8)#EXAMPLES
For flash drives it is often a good idea to align on 1M by adding '-a 1= M' to gpart.
And GPT is often more simple to use than MBR. As you use the kernel to load= the USB drive I'm pretty sure GPT is supported.
<= br>
Thanks for providing further valuable information! These are = the missing pieces of the root filesystem that I want. Maybe I missed somet= hing on GPT with gpart as it doesn't work but with MBR it did.

With GPT,

root@:~ # /sbin/gpart destroy -F da0
d= a0 destroyed
root@:~ # gpart create -s GPT da0
da0 created
root@:~= # /sbin/gpart add -t freebsd-ufs -a 1M -s 8G da0
da0p1 added
root@:~= # /sbin/newfs /dev/da0p1
/dev/da0p1: 7168.0MB (14680064 sectors) block = size 32768, fragment size 4096
=C2=A0 =C2=A0 =C2=A0 =C2=A0 using 12 cyli= nder groups of 626.09MB, 20035 blks, 80256 inodes.
super-block backups (= for fsck_ffs -b #) at:
=C2=A0192, 1282432, 2564672, 3846912, 5129152, 64= 11392, 7693632, 8975872, 10258112, 11540352, 12822592, 14104832

root= @:~ # gpart show
...
=3D> =C2=A0 =C2=A0 =C2=A040 =C2=A015523760 = =C2=A0da0 =C2=A0GPT =C2=A0(7.4G)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 40 =C2=A0 = =C2=A0 =C2=A02008 =C2=A0 =C2=A0 =C2=A0 - free - =C2=A0(1.0M)
=C2=A0 =C2= =A0 =C2=A0 2048 =C2=A014680064 =C2=A0 =C2=A01 =C2=A0freebsd-ufs =C2=A0(7.0G= )
=C2=A0 14682112 =C2=A0 =C2=A0841688 =C2=A0 =C2=A0 =C2=A0 - free - =C2= =A0(411M)

Upon kernel boot-up, only da0 is present in the list.
...
mountroot> ?

List of GEOM managed disk device= s:
=C2=A0 da0 flash/spi0

mountroot> ufs:/dev/da0p1
Trying t= o mount root from ufs:/dev/da0p1 []...
mountroot: waiting for device /de= v/da0p1...
Mounting from ufs:/dev/da0p1 failed with error 19.
= ...

With MBR,

root@:~ # /sbin/gpart create = -s MBR da0
da0 created
root@:~ # /sbin/gpart add -t freebsd -s 14G da= 0
da0s1 added
root@:~ # /sbin/gpart set -a active -i 1 da0
active = set on da0s1
root@:~ # /sbin/gpart bootcode -b /boot/boot0 da0
bootco= de written to da0
root@:~ # /sbin/gpart create -s BSD -n 20 da0s1
da0= s1 created
root@:~ # /sbin/gpart add -t freebsd-ufs -s 8G da0s1
da0s1= a added
root@:~ # /sbin/gpart bootcode -b /boot/boot da0s1
bootcode w= ritten to da0s1
root@:~ #
root@:~ # gpart show
...
=3D> =C2= =A0 =C2=A0 =C2=A063 =C2=A030031809 =C2=A0da0 =C2=A0MBR =C2=A0(14G)
=C2= =A0 =C2=A0 =C2=A0 =C2=A0 63 =C2=A029360128 =C2=A0 =C2=A01 =C2=A0freebsd =C2= =A0[active] =C2=A0(14G)
=C2=A0 29360191 =C2=A0 =C2=A0671681 =C2=A0 =C2= =A0 =C2=A0 - free - =C2=A0(328M)

=3D> =C2=A0 =C2=A0 =C2=A0 0 =C2= =A029360128 =C2=A0da0s1 =C2=A0BSD =C2=A0(14G)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A00 =C2=A016777216 =C2=A0 =C2=A0 =C2=A01 =C2=A0freebsd-ufs =C2=A0(8= .0G)
=C2=A0 16777216 =C2=A012582912 =C2=A0 =C2=A0 =C2=A0 =C2=A0 - free -= =C2=A0(6.0G)

root@:~ # /sbin/newfs /dev/da0s1a
/dev/da0s1a: 8192= .0MB (16777216 sectors) block size 32768, fragment size 4096
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 using 14 cylinder groups of 626.09MB, 20035 blks, 80256 i= nodes.
super-block backups (for fsck_ffs -b #) at:
=C2=A0192, 1282432= , 2564672, 3846912, 5129152, 6411392, 7693632, 8975872, 10258112, 11540352,= 12822592, 14104832, 15387072, 16669312

and up= on kernel boot-up,=20 da0s1a slice is detected, that's why it's mountable.
...<= br>
mountroot> ?

List of GEOM managed disk devices:
=C2= =A0 da0s1a da0s1 da0 flash/spi0

mountroot> ufs:/dev/da0s1a
Try= ing to mount root from ufs:/dev/da0s1a []...
mountroot: unable to remoun= t devfs under /dev (error 2)
mountroot: unable to unlink /dev/dev (error= 2)
Warning: no time-of-day clock registered, system time will not be se= t accurately
start_init: trying /sbin/init
...

I had a system on 11.2 which used this option in the kernel config file.
options=C2=A0 =C2=A0 =C2=A0 =C2=A0 ROOTDEVNAME=3D\"ufs:/dev/da0s1a\&qu= ot;


Thanks to this kernel config option I = added it as it's very useful, once called during kernel boot-up it auto= matically mounts the root filesystem in the USB flash drive. It's like = a binder between the kernel and the root filesystem.
=C2=A0
Happy hacking.
Let us know if it all works out.

Yes, thanks= a lot! I've made it. Here's the flow of the booting process from U= -Boot loader up to login. I never touch anything yet on adding the /etc/fst= ab.

U-Boot 1.1.3 Rev 0.3 by WErt(WErt) 4PDA (May 19 2016 - 14:41:04)

B= oard: Ralink APSoC DRAM: 32 MB
******************************
Softwar= e System Reset Occurred
******************************
Ralink SPI fla= sh driver, SPI clock: 15MHz
spi device id: c2 20 16 c2 20 (2016c220)
= find flash: MX25L3205D
..
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D
Ralink U-Boot Version: 5.0.0.5
----------------------= ----------------------
ASIC 5350_MP (Port5<->None)
DRAM_CONF_FR= OM: Boot-Strapping
DRAM_TYPE: SDRAM
DRAM_SIZE: 256 Mbits
DRAM_WIDT= H: 16 bits
DRAM_TOTAL_WIDTH: 16 bits
TOTAL_MEMORY_SIZE: 32 MBytes
= Flash component: SPI Flash
Date:May 19 2016 =C2=A0Time:14:41:04
=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
icache: sets:256,= ways:4, linesz:32, total:32768
dcache: sets:128, ways:4, linesz:32, tot= al:16384

=C2=A0#### The CPU freq =3D 360 MHZ ####
=C2=A0estimate = memory size =3D 32 Mbytes

Please choose the operation:
=C2=A0 =C2= =A00: Load system code then write to Flash via Serial.
=C2=A0 =C2=A01: L= oad system code to SDRAM via TFTP.
=C2=A0 =C2=A02: Load system code then= write to Flash via TFTP.
=C2=A0 =C2=A03: Boot system code via Flash (de= fault).
=C2=A0 =C2=A04: Enter boot command line interface.
=C2=A0 =C2= =A05: Load system code then write to Flash via USB Storage.
=C2=A0 =C2= =A06: Load U-Boot code then write to Flash via USB Storage.
=C2=A0 =C2= =A07: Load U-Boot code then write to Flash via Serial.
=C2=A0 =C2=A08: L= oad U-Boot code to SDRAM via TFTP.
=C2=A0 =C2=A09: Load U-Boot code then= write to Flash via TFTP. =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 0 .


3: System Boot system code via Flash.
## Check= ing image at bc050000 ...
. =C2=A0 Image Name: =C2=A0 FreeBSD Kernel UC = Image8
=C2=A0 =C2=A0Image Type: =C2=A0 MIPS Linux Kernel Image (uncompre= ssed)
=C2=A0 =C2=A0Data Size: =C2=A0 =C2=A03675932 Bytes =3D =C2=A03.5 M= B
=C2=A0 =C2=A0Load Address: 80001100
=C2=A0 =C2=A0Entry Point: =C2= =A080001100
......................................................... = =C2=A0 Verifying Checksum ... OK
OK
No initrd
## Transferring cont= rol to Linux (at address 80001100) ...
## Giving linux memsize in MB, 32=

Starting kernel ...

U-Boot args (from 0 args):
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 None
Environment:
=C2=A0 =C2=A0 =C2=A0 =C2=A0 memsi= ze=3D32
=C2=A0 =C2=A0 =C2=A0 =C2=A0 initrd_start=3D0x00000000
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 initrd_size=3D0x0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 flash= _start=3D0x00000000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 flash_size=3D0x400000entry: mips_init()
Cache info:
=C2=A0 picache_stride =C2=A0 =C2=A0= =3D 4096
=C2=A0 picache_loopcount =3D 8
=C2=A0 pdcache_stride =C2=A0 = =C2=A0=3D 4096
=C2=A0 pdcache_loopcount =3D 4
cpu0: MIPS Technologies= processor v76.150
=C2=A0 MMU: Standard TLB, 32 entries (4K 16K 64K 256K= 1M 16M 64M 256M pg sizes)
=C2=A0 L1 i-cache: 4 ways of 256 sets, 32 byt= es per line
=C2=A0 L1 d-cache: 4 ways of 128 sets, 32 bytes per line
= =C2=A0 L2 cache: disabled
=C2=A0 Config1=3D0xbea3319e<PerfCount,Watch= Regs,MIPS16,EJTAG>
=C2=A0 Config2=3D0x80000000
=C2=A0 Config3=3D0x= 420
Physical memory chunk(s):
0x3b3000 - 0x1ffffff, 29675520 bytes (7= 245 pages)
Maxmem is 0x2000000
Copyright (c) 1992-2020 The FreeBSD Pr= oject.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 199= 3, 1994
=C2=A0 =C2=A0 =C2=A0 =C2=A0 The Regents of the University of Cal= ifornia. All rights reserved.
FreeBSD is a registered trademark of The F= reeBSD Foundation.
FreeBSD 11.4-RELEASE #20: Fri Oct 14 15:25:17 UTC 202= 2
=C2=A0 =C2=A0 root@:/usr/obj/mips.mipsel/usr/src/sys/RT5350_USB mipsgcc version 4.2.1 20070831 patched [FreeBSD]
Preloaded elf kernel &quo= t;kernel" at 0x803acf50.
real memory =C2=A0=3D 33554432 (32768K byt= es)
Physical memory chunk(s):
0x0043f000 - 0x01f44fff, 28336128 bytes= (6918 pages)
avail memory =3D 27901952 (26MB)
ULE: setup cpu 0
ra= ndom: entropy device external interface
null: <full device, null devi= ce, zero device>
mem: <memory>
nexus0: <MIPS32 root nexus= >
random: harvesting attach, 8 bytes (4 bits) from nexus0
clock0: = <Generic MIPS32 ticker> on nexus0
Timecounter "MIPS32" f= requency 180000000 Hz quality 800
Event timer "MIPS32" frequen= cy 180000000 Hz quality 800
random: harvesting attach, 8 bytes (4 bits) = from clock0
obio0 at mem 0x10000000-0x1fffffff on nexus0
rt305x_sysct= l0: <RT305X System Control driver> at mem 0x10000000-0x100000ff irq 0= on obio0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 Chip ID: "RT5350 =C2=A0"=
=C2=A0 =C2=A0 SYSCTL_SYSCFG=3D0x103000
random: harvesting attach, 8 = bytes (4 bits) from rt305x_sysctl0
rt305x_ic0: <RT305X Interrupt Cont= roller driver> at mem 0x10000200-0x100002ff on obio0
random: harvesti= ng attach, 8 bytes (4 bits) from rt305x_ic0
uart0: <rt305x_uart> a= t mem 0x10000500-0x100005ff irq 5 on obio0
uart0: fast interrupt
uart= 0: PPS capture mode: DCDinvalid
random: harvesting attach, 8 bytes (4 bi= ts) from uart0
spi0: <RT305X SPI> at mem 0x10000b00-0x10000bff on = obio0
spibus0: <SPI bus> on spi0
mx25l0: <M25Pxx Flash Famil= y> at cs 0 mode 0 on spibus0
mx25l0: device type mx25ll32, size 4096K= in 64 sectors of 64K, erase size 64K
random: harvesting attach, 8 bytes= (4 bits) from mx25l0
random: harvesting attach, 8 bytes (4 bits) from s= pibus0
random: harvesting attach, 8 bytes (4 bits) from spi0
uart1: &= lt;rt305x_uart> at mem 0x10000c00-0x10000cff irq 12 on obio0
uart1: c= onsole (115200,n,8,1)
uart1: fast interrupt
uart1: PPS capture mode: = DCDinvalid
random: harvesting attach, 8 bytes (4 bits) from uart1
ehc= i0: <Ralink integrated USB 2.0 controller> at mem 0x101c0000-0x101c0f= ff irq 18 on obio0
usbus0: EHCI version 1.0
usbus0 on ehci0
ehci0:= usbpf: Attached
random: harvesting attach, 8 bytes (4 bits) from usbus0=
random: harvesting attach, 8 bytes (4 bits) from ehci0
random: harve= sting attach, 8 bytes (4 bits) from obio0
rt0: <Ralink RT5350 onChip = Ethernet driver> at mem 0x10100000-0x1010ffff irq 3 on nexus0
rt0: RT= 5350 Ethernet MAC (rev 0x00000000)
rt0: use hardcoded 00:18:e7:d5:83:90 = macaddr
rt0: Ethernet address: 00:18:e7:d5:83:90
random: harvesting a= ttach, 8 bytes (4 bits) from rt0
Device configuration finished.
Timec= ounters tick every 10.000 msec
tcp_init: net.inet.tcp.tcbhashsize auto t= uned to 512
GEOM: new disk flash/spi0
usbus0: 480Mbps High Speed USB = v2.0
Trying to mount root from ufs:/dev/da0s1a []...
Root mount waiti= ng for: usbus0
ugen0.1: <Ralink EHCI root HUB> at usbus0
uhub0:= <Ralink EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0uhub0: 1 port with 1 removable, self powered
random: harvesting attach= , 8 bytes (4 bits) from uhub0
Root mount waiting for: usbus0
Root mou= nt waiting for: usbus0
ugen0.2: <SanDisk Ultra Fit> at usbus0
u= mass0 on uhub0
umass0: <SanDisk Ultra Fit, class 0/0, rev 2.10/1.00, = addr 2> on usbus0
umass0:0:0: Attached to scbus0
random: harvestin= g attach, 8 bytes (4 bits) from umass0
mountroot: waiting for device /de= v/da0s1a...
pass0 at umass-sim0 bus 0 scbus0 target 0 lun 0
pass0: &l= t;SanDisk Ultra Fit 1.00> Removable Direct Access SPC-4 SCSI device
p= ass0: Serial Number 4C530000070424102200
pass0: 40.000MB/s transfers
= GEOM: new disk da0
da0 at umass-sim0 bus 0 scbus0 target 0 lun 0
da0:= <SanDisk Ultra Fit 1.00> Removable Direct Access SPC-4 SCSI deviceda0: Serial Number 4C530000070424102200
da0: 40.000MB/s transfers
d= a0: 14664MB (30031872 512 byte sectors)
da0: quirks=3D0x2<NO_6_BYTE&g= t;
da0: Delete methods: <NONE(*),ZERO>
Warning: no time-of-day = clock registered, system time will not be set accurately
start_init: try= ing /sbin/init
Setting hostuuid: 4e22d8d6-4bce-11ed-b0aa-0018e7d58390.Setting hostid: 0x351daf11.
eval: cannot open /etc/fstab: No such file= or directory
fstab: /etc/fstab:0: No such file or directory
Warning!= No /etc/fstab: skipping disk checks.
fstab: /etc/fstab:0: No such file = or directory
Mounting local filesystems:fstab: /etc/fstab:0: No such fil= e or directory
.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat
= random: unblocking device.
/etc/rc: WARNING: $hostname is not set -- see= rc.conf(5).
Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_N= G,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: .
l= o0: link state changed to UP
Starting Network: lo0.
lo0: flags=3D8049= <UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 options=3D680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSU= M_IPV6>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet 127.0.0.1 netmask 0xff000000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: lo
Starting devd.
add host 127.0.0.1: gateway lo0 fib 0: route already = in table
fstab: /etc/fstab:0: No such file or directory
fstab: /etc/f= stab:0: No such file or directory
Creating and/or trimming log files.Starting syslogd.
Clearing /tmp (X related).
Updating motd:.
Moun= ting late filesystems:fstab: /etc/fstab:0: No such file or directory
.fstab: /etc/fstab:0: No such file or directory
Starting sendmail_submi= t.
Starting sendmail_msp_queue.
Starting cron.
eval: cannot open /= etc/fstab: No such file or directory
Starting background file system che= cks in 60 seconds.

Fri Oct 14 20:17
FreeBSD/mips (Amnesiac) (ttyu= 1)

login: root
Last login: Fri Oct 14 16:15:17 on ttyu1
Oct 14= 20:49:08 =C2=A0login: ROOT LOGIN (root) ON ttyu1
FreeBSD 11.4-RELEASE (= RT5350_USB) #20: Fri Oct 14 15:25:17 UTC 2022

Welcome to FreeBSD!
Release Notes, Errata: h= ttps://www.FreeBSD.org/releases/
Security Advisories: =C2=A0 https://www.FreeBSD.org/security/
FreeBSD Handbook: =C2=A0 =C2=A0 =C2=A0https://www.FreeBSD.org/handbook/
FreeBSD FAQ: =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 https:= //www.FreeBSD.org/faq/
Questions List: https://lists.FreeBSD.org/mail= man/listinfo/freebsd-questions/
FreeBSD Forums: =C2=A0 =C2=A0 =C2=A0= =C2=A0https://forums.FreeBSD.org/<= /a>

Documents installed with the system are in the /usr/local/share/= doc/freebsd/
directory, or can be installed later with: =C2=A0pkg instal= l en-freebsd-doc
For other languages, replace "en" with a lang= uage code like de or fr.

Show the version of FreeBSD installed: =C2= =A0freebsd-version ; uname -a
Please include that output and any error m= essages when posting questions.
Introduction to manual pages: =C2=A0man = man
FreeBSD directory layout: =C2=A0 =C2=A0 =C2=A0man hier

Edit /= etc/motd to change this login announcement.
root@:~ #
root@:~ # uname= -a
FreeBSD =C2=A011.4-RELEASE FreeBSD 11.4-RELEASE #20: Fri Oct 14 15:2= 5:17 UTC 2022 =C2=A0 =C2=A0 root@:/usr/obj/mips.mipsel/usr/src/sys/RT5350_U= SB =C2=A0mips

I tried adding an IP address to the rt0 network interface including= default and it works as well.

root@:~ # ifconfig
rt0: flags=3D8802<BROADCA= ST,SIMPLEX,MULTICAST> metric 0 mtu 1500
=C2=A0 =C2=A0 =C2=A0 =C2=A0 o= ptions=3Db<RXCSUM,TXCSUM,VLAN_MTU>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 eth= er 00:18:e7:d5:83:90
=C2=A0 =C2=A0 =C2=A0 =C2=A0 hwaddr 00:18:e7:d5:83:9= 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 media: Ethernet 100baseTX <full-duplex&= gt;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 status: active
lo0: flags=3D8049<U= P,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
=C2=A0 =C2=A0 =C2=A0= =C2=A0 options=3D680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6= >
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet 127.0.0.1 netmask 0xff000000
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: lo
root@:~ #
root@:~ # ifconfig r= t0 inet 192.168.1.215 netmask 255.255.255.0
root@:~ # ifconfig rt0
rt= 0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu = 1500
=C2=A0 =C2=A0 =C2=A0 =C2=A0 options=3Db<RXCSUM,TXCSUM,VLAN_MTU&g= t;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 00:18:e7:d5:83:90
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 hwaddr 00:18:e7:d5:83:90
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet = 192.168.1.215 netmask 0xffffff00 broadcast 192.168.1.255
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 media: Ethernet 100baseTX <full-duplex>
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 status: active
root@:~ #
root@:~ # route add -inet = default 192.168.1.1
add net default: gateway 192.168.1.1
root@:~ # ne= tstat -rn
Routing tables

Internet:
Destination =C2=A0 =C2=A0 = =C2=A0 =C2=A0Gateway =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Flags =C2=A0 = =C2=A0 Netif Expire
default =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0192= .168.1.1 =C2=A0 =C2=A0 =C2=A0 =C2=A0UGS =C2=A0 =C2=A0 =C2=A0 =C2=A0 rt0
= 127.0.0.1 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0link#2 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 UH =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0lo0
192.168.1.0/24 =C2=A0 =C2=A0 link#1 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 U =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 rt0
192= .168.1.215 =C2=A0 =C2=A0 =C2=A0link#1 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 UHS =C2=A0 =C2=A0 =C2=A0 =C2=A0 lo0
root@:~ #
root@:~ # tracer= oute 216.58.200.238 <--------- google.com<= /a> IP
traceroute to 216.58.200.238 (216.58.200.238), 64 hops max, 40 by= te packets
=C2=A01 =C2=A0smartbr= osettings.net (192.168.1.1) =C2=A01.727 ms =C2=A00.888 ms =C2=A00.786 m= s
=C2=A02 =C2=A0* * *
=C2=A03 =C2=A0* * *
=C2=A04 =C2=A0* * *
= =C2=A05 =C2=A0* * *
=C2=A06 =C2=A027.110.255.33 (27.110.255.33) =C2=A035= .536 ms =C2=A026.458 ms =C2=A015.635 ms
=C2=A07 =C2=A0210.213.130.15.static.pldt.net (210.213= .130.15) =C2=A017.515 ms
=C2=A0 =C2=A0 210.213.130.13.static.pldt.net (210.213.130.13) =C2=A0= 18.300 ms
=C2=A0 =C2=A0 210.213.130.15.static.pldt.net (210.213.130.15) =C2=A018.509 ms
= =C2=A08 =C2=A0210.213.130.= 7.static.pldt.net (210.213.130.7) =C2=A057.830 ms =C2=A060.194 ms
= =C2=A0 =C2=A0 210.213.130= .97.static.pldt.net (210.213.130.97) =C2=A051.395 ms
=C2=A09 =C2=A07= 4.125.118.24 (74.125.118.24) =C2=A071.609 ms
=C2=A0 =C2=A0 72.14.195.168= (72.14.195.168) =C2=A060.027 ms =C2=A044.248 ms
10 =C2=A0* * *
11 = =C2=A066.249.94.222 (66.249.94.222) =C2=A061.563 ms
=C2=A0 =C2=A0 142.25= 1.245.20 (142.251.245.20) =C2=A061.087 ms =C2=A065.270 ms
12 =C2=A0108.1= 70.241.112 (108.170.241.112) =C2=A058.601 ms =C2=A042.972 ms
=C2=A0 =C2= =A0 108.170.241.80 (108.170.241.80) =C2=A077.755 ms
13 =C2=A0209.85.250.= 133 (209.85.250.133) =C2=A063.080 ms
=C2=A0 =C2=A0 hkg07s47-in-f14.1e100.net (216.58.200.238) =C2= =A073.084 ms =C2=A086.918 ms
root@:~ #
root@:~ # ping -c 5 216.58.200= .238
PING 216.58.200.238 (216.58.200.238): 56 data bytes
64 bytes fro= m 216.58.200.238: icmp_seq=3D0 ttl=3D= 55 time=3D60.700 ms
64 bytes from 216.= 58.200.238: icmp_seq=3D1 ttl=3D55 time=3D62.175 ms
64 bytes from 216.58.200.238: icmp_seq=3D2 ttl=3D55 ti= me=3D58.768 ms
64 bytes from 216.58.20= 0.238: icmp_seq=3D3 ttl=3D55 time=3D57.592 ms
64 bytes from 216.58.200.238: icmp_seq=3D4 ttl=3D55 time= =3D61.002 ms

--- 216.58.200.238 ping statistics ---
5 packets tra= nsmitted, 5 packets received, 0.0% packet loss
round-trip min/avg/max/st= ddev =3D 57.592/60.047/62.175/1.645 ms
root@:~ #

Checking the default running = processes.

root@:~ # top -S
last pid: =C2=A0 641; =C2=A0load averages: =C2= =A00.31, =C2=A00.33, =C2=A00.37 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 up 0+00:39:46 =C2=A020:55:54
27 processes: =C2=A02 running= , 24 sleeping, 1 waiting
CPU: =C2=A00.4% user, =C2=A00.0% nice, =C2=A00.= 9% system, =C2=A00.0% interrupt, 98.7% idle
Mem: 10M Active, 7120K Inact= , 8948K Wired, 3100K Buf, 1088K Free
Swap:

=C2=A0 PID USERNAME = =C2=A0 =C2=A0THR PRI NICE =C2=A0 SIZE =C2=A0 =C2=A0RES STATE =C2=A0 =C2=A0T= IME =C2=A0 =C2=A0WCPU COMMAND
=C2=A0 =C2=A010 root =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A01 155 ki31 =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K RUN =C2=A0 =C2=A0= 38:00 =C2=A098.89% idle
=C2=A0 641 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A01 =C2=A020 =C2=A0 =C2=A00 =C2=A07912K =C2=A02624K RUN =C2=A0 =C2=A0 =C2= =A00:00 =C2=A0 0.82% top
=C2=A0 =C2=A011 root =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A09 -52 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A072K WAIT =C2= =A0 =C2=A0 0:03 =C2=A0 0.22% intr
=C2=A0 =C2=A0 4 root =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K - = =C2=A0 =C2=A0 =C2=A0 =C2=A00:01 =C2=A0 0.03% rand_harvestq
=C2=A0 =C2=A0= 0 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A07 -16 =C2=A0 =C2=A0- =C2=A0 =C2= =A0 0K =C2=A0 =C2=A056K swapin =C2=A0 0:00 =C2=A0 0.03% kernel
=C2=A0 = =C2=A0 9 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A03 -16 =C2=A0 =C2=A0- =C2=A0= =C2=A0 0K =C2=A0 =C2=A024K psleep =C2=A0 0:00 =C2=A0 0.00% pagedaemon
= =C2=A0 =C2=A018 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A016 =C2=A0 = =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K syncer =C2=A0 0:00 =C2=A0 0.00% s= yncer
=C2=A0 =C2=A015 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 -16 =C2= =A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K - =C2=A0 =C2=A0 =C2=A0 =C2=A0= 0:00 =C2=A0 0.00% bufspacedaemon
=C2=A0 =C2=A016 root =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K psl= eep =C2=A0 0:00 =C2=A0 0.00% bufdaemon
=C2=A0 =C2=A017 root =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0= 8K vlruwt =C2=A0 0:00 =C2=A0 0.00% vnlru
=C2=A0 =C2=A013 root =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A05 -68 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2= =A040K - =C2=A0 =C2=A0 =C2=A0 =C2=A00:01 =C2=A0 0.00% usb
=C2=A0 615 roo= t =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A020 =C2=A0 =C2=A00 =C2=A07288K = =C2=A02624K pause =C2=A0 =C2=A00:01 =C2=A0 0.00% csh
=C2=A0 535 root =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A020 =C2=A0 =C2=A00 =C2=A09756K =C2=A0= 3020K select =C2=A0 0:00 =C2=A0 0.00% sendmail
=C2=A0 =C2=A012 root =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A03 =C2=A0-8 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K = =C2=A0 =C2=A024K - =C2=A0 =C2=A0 =C2=A0 =C2=A00:00 =C2=A0 0.00% geom
=C2= =A0 =C2=A0 2 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A02 -16 =C2=A0 =C2=A0- = =C2=A0 =C2=A0 0K =C2=A0 =C2=A016K - =C2=A0 =C2=A0 =C2=A0 =C2=A00:00 =C2=A0 = 0.00% cam
=C2=A0 585 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A021 = =C2=A0 =C2=A00 =C2=A06896K =C2=A01676K wait =C2=A0 =C2=A0 0:00 =C2=A0 0.00%= login
=C2=A0 336 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A020 =C2= =A0 =C2=A00 =C2=A06268K =C2=A01220K select =C2=A0 0:00 =C2=A0 0.00% syslogd=
=C2=A0 542 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A037 =C2=A0 =C2= =A00 =C2=A06304K =C2=A01152K nanslp =C2=A0 0:00 =C2=A0 0.00% cron
=C2=A0= =C2=A0 1 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A022 =C2=A0 =C2=A00 = =C2=A05504K =C2=A0 492K wait =C2=A0 =C2=A0 0:00 =C2=A0 0.00% init
=C2=A0= 538 smmsp =C2=A0 =C2=A0 =C2=A0 =C2=A0 1 =C2=A020 =C2=A0 =C2=A00 =C2=A09756= K =C2=A01668K pause =C2=A0 =C2=A00:00 =C2=A0 0.00% sendmail
=C2=A0 278 r= oot =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 =C2=A020 =C2=A0 =C2=A00 =C2=A07084K= =C2=A0 460K select =C2=A0 0:00 =C2=A0 0.00% devd
=C2=A0 =C2=A0 5 root = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2= =A0 =C2=A0 8K - =C2=A0 =C2=A0 =C2=A0 =C2=A00:00 =C2=A0 0.00% soaiod1
=C2= =A0 =C2=A0 8 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- = =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K - =C2=A0 =C2=A0 =C2=A0 =C2=A00:00 =C2=A0 = 0.00% soaiod4
=C2=A0 =C2=A0 6 root =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 -= 16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K - =C2=A0 =C2=A0 =C2=A0 = =C2=A00:00 =C2=A0 0.00% soaiod2
=C2=A0 =C2=A0 7 root =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0 =C2=A0 8K - = =C2=A0 =C2=A0 =C2=A0 =C2=A00:00 =C2=A0 0.00% soaiod3
=C2=A0 =C2=A014 roo= t =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 155 ki31 =C2=A0 =C2=A0 0K =C2=A0 =C2= =A0 8K pgzero =C2=A0 0:00 =C2=A0 0.00% pagezero
=C2=A0 =C2=A0 3 root =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A01 -16 =C2=A0 =C2=A0- =C2=A0 =C2=A0 0K =C2=A0= =C2=A0 8K mx25jq =C2=A0 0:00 =C2=A0 0.00% task: mx25l flash

This device is the M= 1 router (a.k.a. 11V-5A or A5-V11) with Ralink RT5350F SoC 360Mhz CPU with = built-in USB port, Wi-Fi and an Ethernet LAN card. It has a default Linux 2= .6 OS with busybox accessible via telnet. It has been described here from O= penWRT https://openwrt= .org/toh/unbranded/a5-v11. It's as little as a cigarette lighter ha= ving 6cm. x 2cm. board dimension.

Again, thanks a lot Ronald!

Best regards,
Archimedes




--00000000000032d0fe05eb0c00cd-- From nobody Sat Oct 15 07:34:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MqFPV13fnz4V2wV for ; Sat, 15 Oct 2022 07:34:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MqFPT5mCPz3D2k for ; Sat, 15 Oct 2022 07:34:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MqFPT4qGBz13Wd for ; Sat, 15 Oct 2022 07:34:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29F7Y5xl050438 for ; Sat, 15 Oct 2022 07:34:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29F7Y5xE050437 for fs@FreeBSD.org; Sat, 15 Oct 2022 07:34:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256746] fsck_ffs completely broken for background fsck Date: Sat, 15 Oct 2022 07:34:05 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rew@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ X-Bugzilla-Changed-Fields: bug_file_loc see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665819245; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=i/89ez/f1PokrJUlX4fmcjZnqqKd36gN8pzKGKFltZg=; b=LfWhYWL7c1/Djyme80lLAGvhmi/Spi2nQEw7Qxuai9fPJzlhOxwqCqSig11B6ApU4L6Szf 4N4LDGLkN8NelD+5Ym377lCwqjD2Ff7vK9lTmpOr9wb58wX3Ux+UjgOys74Aem4W8TD97v Y+CFmy39hwbcu+PjOEKMb3riwReCCyZQZX3tsd7kzie2XN/EagviObZJN5nq/Iq9s9Ajrx 94WDycwMeRsth06ZqHfeNNwXrY6dz9qIfFr/JpXIO6uvq9fgvqmY8Ml5TwqMapI58eX2m7 0SyWygY/QVIFAh1ODS67qZKm2LIKEhldAxTLnUOG4K0Yw55nPtHL4OpzC7qs9w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665819245; a=rsa-sha256; cv=none; b=ygB7kzI4Dm9fR2IlCJTA/MI1+M+8lFCTARseY85siDwXiiS9zMJ+4CWgMcl15srm2sg2aM fQsFbnIeoVFiaoFxZellKmiWyRwojxJ5bGs4ambG5ZQLPgGE7VXeTunH6jDHET+L35q1+6 BTqsgPMcYLoL9uw4+sf2lKSagB6KrzTlRLfXaawhvY3po5y+QPN/DWGdvT3ki5huSTb9zs nsmaKMX4qsK9B9l2eoyFqPM5TVLAHmeczGWDgWyc359cGGTiM48pib0fU5klEdumW9LArT N/DC8/aWU+ebalAwLp0NjNoxzXyNaZNDixxn6ZMYUgUlxEwcYOqEeJHPkCvApA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256746 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |https://www.freebsd.org/rel | |eases/13.1R/relnotes/#stora | |ge-ufs See Also| |https://reviews.freebsd.org | |/D35212 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Oct 16 13:57:04 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr1sn4g7Nz4fHTm for ; Sun, 16 Oct 2022 13:57:49 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr1sl5vZbz3PNs for ; Sun, 16 Oct 2022 13:57:47 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 4EC7132007BE for ; Sun, 16 Oct 2022 09:57:45 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 09:57:45 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to; s=fm3; t= 1665928664; x=1666015064; bh=SsVzU2rz9lAh1Cm0Tdf07ZyPKQalpappM2q J+QOxaIo=; b=BHrYAKg4xQ2DkMosebaP/OK0ptlTJBFpFNgwo2X5RdWoon+7cnm DxVNrc3FpyBX3KGNREyMDMS0dTExxXL48IuXyelAelBH8gTgGsqTBawDAA2QMWdL BcNDgnJo7/FO78X6rsgJnLBttmnqU9uAkSOZrob0h8vgB1M0VhEsMqoy/9NcHp3N No+cjuRjyazcQvwptPgrBfDhKmZUVg3kRxx621y7LG593fZl2QDYFEecAtroZk2v ZJmLuobTtrMcFgTqiYHwWp10VwCeLGuQ8yDWhfkXogzvexyLHRNr5lFZxL9N8PN8 nbQPJFvKfn26DLZTI+7W+cu92oCUSPbf3jg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1665928664; x= 1666015064; bh=SsVzU2rz9lAh1Cm0Tdf07ZyPKQalpappM2qJ+QOxaIo=; b=I kYg7yVSGMsqkrVrud4FirrimykhFSRg89SsCjPfQ2aQ7qyIj9eU01EcJE0dwJ8/2 Iht1laDzxZo8PdxuXp+hdwJ14jv9meF5mV3E4vfEOOCtymEo/dSV2ZfIKEpP4338 NJ7VBhV3LHRLhmQdyJyM2fvH6hNcNLoz185k2bPhXl3qgLxIQzGwBcJUZ+iHuntS ESHCU+h5qoeBBszo+HtTgIPxevtOZU4dBfj5tsR+Z2XmqtlhB25Adly4WefK0ApM RIzXr0o905Lxc7rQ3Zgja1s6CJ5YVoDrVh5gSrJHPXvQGpHOU79nXkBWh0WJXktZ zZwSbex9eO0ZgvfOC9afg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekjedgjeduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfffhffvufgtsehttdertd erredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeeftdfhhefgjeeiteevfeeghedvkeefgeetudffffehfffgjeehtedukefhje dtveenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 8D9C42A20079; Sun, 16 Oct 2022 09:57:44 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: Date: Sun, 16 Oct 2022 13:57:04 +0000 From: void To: freebsd-fs@freebsd.org Subject: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4Mr1sl5vZbz3PNs X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=BHrYAKg4; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="I kYg7yV"; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.21 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.59 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.21:from]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N Has anything recently changed in -current that would make file operations on zfs such as rm -rf *.* very slow? What would I look for and how would I test it? system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on arm64.aarch64 using GENERIC-NODEBUG kernel. the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be plenty of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and it's taken over 10 mins. It was never this slow. No errors in /var/log/messages and none yet in smartd. zpool scrub last ran successfully 3 days ago. last pid: 4324; load averages: 0.17, 0.10, 0.12 up 0+02:10:34 14:40:55 77 processes: 1 running, 76 sleeping CPU: 1.6% user, 0.0% nice, 1.9% system, 0.2% interrupt, 96.4% idle Mem: 550M Active, 803M Inact, 2224M Wired, 40K Buf, 4239M Free ARC: 1293M Total, 381M MFU, 725M MRU, 1124K Anon, 30M Header, 156M Other 938M Compressed, 1906M Uncompressed, 2.03:1 Ratio Swap: 16G Total, 16G Free Process id to show (+ for all): PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 3871 root 1 20 0 12M 3648K zio->i 2 0:10 0.39% rm 353 _pflogd 1 20 0 13M 2108K bpf 1 0:00 0.00% pflogd 1441 mailnull 1 28 0 25M 9508K select 3 0:01 0.00% exim TIA, From nobody Sun Oct 16 14:15:51 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr2Gr6Kl2z4fK15 for ; Sun, 16 Oct 2022 14:16:04 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f53.google.com (mail-vs1-f53.google.com [209.85.217.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr2Gq66l6z3QVj for ; Sun, 16 Oct 2022 14:16:03 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-vs1-f53.google.com with SMTP id 3so9228694vsh.5 for ; Sun, 16 Oct 2022 07:16:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=YTxtxCB7Sb7tHfxXF6I2GbQKRViHVLdOLAJUuG/d5xU=; b=RDJD08Rkx90KJkKotTZ63K9J4lgjyIdg67gEkOWkQ04tNwpCLe+CBs8cwxF+Md7GWY jm62ahSepCTYjU1EKdDd+kn11Yw7fcyQdUxy4dHJ+RzJpL0I0Y8JG/4ajjvEZMW19jxk AXYXarzXdONqd7W/VKncZOOjA6dpZqKnLUlPa0eRyexL/uJxeYUQmrohoXgD2FarRV/P CzVYYqKgWVlRZAw9UtxVrfz8MoJ4oP8ES0O0JUBSP8p6e9SXgvpIUcOtskhHu8wxDF1O csrEi1CicLsRQzHPSvdMFm9M/0Wt2MsgPWq5C5IgVk7l6tBJSsFGnSQc9h6xteZ+0dgT BJtA== X-Gm-Message-State: ACrzQf0EwjRZvz+pVdtXxmI2rojTmiubUGpOVWq/8IuXDtMlkxJJRUA5 QxsqlIfFYV058LLwWAghYzerQYxvr98tR1XUcpaTHnc3 X-Google-Smtp-Source: AMsMyM6fHlJKRsfN2xK1+oRXAb/TXM/KFf605UZULMrueqrS+qcDrtCwxR5QesGy2s9GZUwKtC6dgKMKGa1NAvUpwAE= X-Received: by 2002:a67:b303:0:b0:3a9:61e4:2769 with SMTP id a3-20020a67b303000000b003a961e42769mr1750076vsm.0.1665929763098; Sun, 16 Oct 2022 07:16:03 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 16 Oct 2022 08:15:51 -0600 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Mr2Gq66l6z3QVj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.53 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_TO(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.53:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.53:from]; TO_DN_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N The usual reason why rm gets slow is because your pool is nearly full and there's a snapshot. A snapshot means that rm doesn't actually free space; it just rewrites metadata, which requires even more space. And when a zpool is nearly full, writes always slow way down. But if that's not it, then you should also check gstat to see if the disk itself is slow. On Sun, Oct 16, 2022 at 7:57 AM void wrote: > > Has anything recently changed in -current that would make file operations > on zfs such as rm -rf *.* very slow? > > What would I look for and how would I test it? > > system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on arm64.aarch64 > using GENERIC-NODEBUG kernel. > > the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be plenty > of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. > > Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and it's taken > over 10 mins. It was never this slow. No errors in /var/log/messages and none > yet in smartd. zpool scrub last ran successfully 3 days ago. > > last pid: 4324; load averages: 0.17, 0.10, 0.12 up 0+02:10:34 14:40:55 > 77 processes: 1 running, 76 sleeping > CPU: 1.6% user, 0.0% nice, 1.9% system, 0.2% interrupt, 96.4% idle > Mem: 550M Active, 803M Inact, 2224M Wired, 40K Buf, 4239M Free > ARC: 1293M Total, 381M MFU, 725M MRU, 1124K Anon, 30M Header, 156M Other > 938M Compressed, 1906M Uncompressed, 2.03:1 Ratio > Swap: 16G Total, 16G Free > Process id to show (+ for all): > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 3871 root 1 20 0 12M 3648K zio->i 2 0:10 0.39% rm > 353 _pflogd 1 20 0 13M 2108K bpf 1 0:00 0.00% pflogd > 1441 mailnull 1 28 0 25M 9508K select 3 0:01 0.00% exim > > TIA, > From nobody Sun Oct 16 15:12:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr3Xb0WY6z4fQfS for ; Sun, 16 Oct 2022 15:13:03 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr3XZ1JXwz3WRl for ; Sun, 16 Oct 2022 15:13:02 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 0487E3200319 for ; Sun, 16 Oct 2022 11:13:00 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 11:13:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665933180; x=1666019580; bh=BiIcRGi19T rEwgunu3kD7koVZ3TWWKJyzfSByQNokhw=; b=XpJJyLfj7o9HaSxJERmjcZsF9h rOY0LUvX2Fr2vFs+a9spEURNt6XXQk6+S1d87Yz3oko4UXM9uSU2A0Bj8WFHB2KZ cXoZ63ofDyjXacfvXejSV6oWKZca2SJGqYXpy1D9Uk4+OEKCCrZaY9bVkCzmLemO bKRrXys4xBd+nnlaJkHPCX8Dl8OlYuuKsLv5kcwul+3OBuYQ8M+obmaj7CYMAWsv /TCq0D9GefrT08ofjBlRRwa9/c+0mqQXn+8FaRinyjxIaJy3CE3XhdcnvAv2Qznz kG04t4aZwNoYyk/OhAKlPrT1KhG1oh+PvRSlZgSukfnHn+VhZHqLxgTcJhPw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665933180; x=1666019580; bh=BiIcRGi19TrEwgunu3kD7koVZ3TW WKJyzfSByQNokhw=; b=B6kPz/dbinEbomSFXgG+8oSR75bEJjNjtpe1O/mh7sit NQlSPvPvlKmKW+jfxIunNb3YDjKLLKKHLNj4XCB6UgskdQB3niR9RMigYhAKD0sf mOX1sHH2fQPwEhsRzAkYb0sl0ceLkOHW6cx3y11P/QBbsVkwfzvwrGZiNQeJg//T NbIUAOsMq9yato1+xVXEuOns5gzZlkaghsEVooukgHXCuYbYwNVS84uQPI4oChWH 43YBH9zof8A2Hv+GUH/krEQ1Fx1SJWL7ICOkiOGGk2e/o4YKfWBR3SCemKrKCZMA 9qYFc9X0Or23RnOwuWsUXrGPAkANT2GJpSeTD3HFpg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekjedgkeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeefgfeufefhgfdvfeegffetvdejudevgeegteeitdehhffftdejjeegud ffgeekueenucffohhmrghinhepshhkihhnfhhlihhnthdrtghordhukhenucevlhhushht vghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhiugesfhdqmhdrfh hm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 6C1912A20079; Sun, 16 Oct 2022 11:13:00 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> In-Reply-To: References: Date: Sun, 16 Oct 2022 15:12:15 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4Mr3XZ1JXwz3WRl X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=XpJJyLfj; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="B6kPz/db"; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.21 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.59 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.21:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 14:15, Alan Somers wrote: > The usual reason why rm gets slow is because your pool is nearly full > and there's a snapshot. A snapshot means that rm doesn't actually > free space; it just rewrites metadata, which requires even more space. > And when a zpool is nearly full, writes always slow way down. > But if that's not it, then you should also check gstat to see if the > disk itself is slow. Hi, The disk in question is one of these: https://skinflint.co.uk/toshiba-mobile-hdd-mq01-series-1tb-mq01abd100m-a1820027.html It's a CMR disk. Power-on hrs = 39253 da0: 400.000MB/s transfers da0: 953869MB (1953525168 512 byte sectors) da0: quirks=0x2 Filesystem Size Used Avail Capacity Mounted on zroot/ROOT/default 863G 146G 717G 17% / there are no snapshots in "zfs list -t snapshot" rm -rf /var/cache/ccache/* has been running for 53 mins so far (it's still running) # gstat -dopC timestamp,name,q-depth,total_ops/s,read/s,read-KiB/s,ms/read,write/s,write-KiB/s,ms/write,delete/s,delete-KiB/s,ms/delete,other/s,ms/other,%busy 2022-10-16 16:01:24.761122175,da0,5,0,0,0,0.0,0,0,0.0,0,0,0.0,0,0.0,0.0 2022-10-16 16:01:25.762821956,da0,4,40,34,136,107.8,4,16,57.1,0,0,0.0,2,293.9,111.1 2022-10-16 16:01:26.763826447,da0,3,52,50,200,37.6,1,60,34.1,0,0,0.0,1,152.0,95.0 2022-10-16 16:01:27.767079004,da0,3,108,40,159,33.6,67,2173,10.3,0,0,0.0,1,12.2,85.1 2022-10-16 16:01:28.813081219,da0,1,57,17,69,62.8,38,467,31.0,0,0,0.0,2,156.9,108.7 2022-10-16 16:01:29.818093791,da0,1,56,56,223,17.2,0,0,0.0,0,0,0.0,0,0.0,95.9 2022-10-16 16:01:30.825841923,da0,1,57,57,230,16.9,0,0,0.0,0,0,0.0,0,0.0,95.3 2022-10-16 16:01:31.828940957,da0,1,58,58,231,16.7,0,0,0.0,0,0,0.0,0,0.0,96.7 2022-10-16 16:01:32.830822873,da0,3,150,29,116,33.9,120,8460,9.4,0,0,0.0,1,125.4,99.7 2022-10-16 16:01:33.877434519,da0,3,115,6,23,128.4,109,8607,17.1,0,0,0.0,0,0.0,93.4 ^C I'm not sure what, of the data above, what would be considered "slow", or why it should be like this now. There's lots of things in sysctl -a concerning zfs. Can you suggest anything to look out for? thanks, From nobody Sun Oct 16 15:42:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr4B92NxRz4fTP0 for ; Sun, 16 Oct 2022 15:42:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-19.consmr.mail.gq1.yahoo.com (sonic313-19.consmr.mail.gq1.yahoo.com [98.137.65.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr4B83cM2z3byf for ; Sun, 16 Oct 2022 15:42:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665934926; bh=qhfps6j0ExpOd3xi13PGqfi7ImJ+ZZfwVPK50k8I0jQ=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=e4KJoZzN54T///glVvO9/NOBwaY55edWS/r3ITU1XvrbaAIAUZGv4lQUQ+/zKxss2jPGDsBdKKhZiC5/4aZdO7NJbE0b3w2mY3iUREwZ0CBx0bDrt1ZphivZ88kZOYC9D0ob5IwQ1KwPZlYpgUc0VjGiq5e3vFCuZhItedIuQKFIZCBu/JFp+OnfMPdcD3VHB68s1EEKJQrC7ogLerZdtJ3+Kb0PsKZ66Go2ok/vHFB67hiSnS0Z3ad8sRwzr/iUpSuTv1m92+YTtbHIyqEWw+Cz63In+NkUXXQm6wGwm3IAakFQwlU9j4jokl4BxgO2RYJ4VUNvc1AhnKzF9425Xg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665934926; bh=Cme1lBSSlrfDg5zgG4cpZS+D6iJ9UQuUuKcVv5V/vel=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=i21AVBo7IANsA9458RfIR28p68Hwbj41VoG/XunRMSmnLGaQT6Wne6LqGCh0BNQKFAwXNl+KvLTmjjNlOa3cnaiserwgxoatj+H++QkQlcXQvJ34QY/0NW1LIxj4K1BM/dXOUDzy15dW3XZ3z2fup4JEy4tm3lNXFcNvZgf4tUGxteghWaiGmDto4+ZoaRyCYyJtx2s+pq3DPkLEsyDcfGRIY6mK+Rkb98zabD0wILNBaw2eAXlzfJGaUntFiCEVp6E5x2Bp+AYQyRFvOKXxxGFmWPjS6JTI7QhKecAkZmo1mEnsrIZadERFiu6jmscem+WDNrD1lWHLpyjXqlOSaQ== X-YMail-OSG: VDjQH3cVM1nb0I3anso5ke2i6x9MEgpRusZU_W3nMmLOmzSat0OIvenZwX3kDNt vkH08DO_Cg7pp6cWqjwa7ixN9K0jjgRbYP6gNanYcQBlwvRQeSjA2vI1qGWGavfq1sin7atS6uuE sVsVk4d2.5o3zilgkcr6TztajQVMr2B54rOjL_6uAiE69Co38ajhI24qfvTS9fCpWE_pjvSUAPqx iFufyWfSfwqW_IDZhHfKbSNcPMj5po6kmcRvUxgcLYSlk8Hzhayf_tD_Ybym8uQ_zPGqeLyNAghu MHgCsPY0R6WNRJH_Px5Zsr6Ww0a3o0QUXuLDltQEPkU7jI9EljP_rrxARccrmv7R.0zbOUoCWMJO TFyFLbYiw4QsGXUvJG.8UXDVkEH4sF_KszoBlJMIAVh0wGEYsW2vOWZXKvyLF6JKB_RJYay_dF4X H5YUptHpsoVyTXjR1c9Ckf4Z4vI5mETZZ6EN9HRh08pO4IQ1NLLq0ULzHtHM_YHs9qdpFrzRJuNv sPpL1QFiahDvsqQ.nStqxz9ENT3anas5nSoMct3bJxANQZFR0wIC1CTc6ZiwGj70R0AL.KESBYNj y1SFo3aO2C_6fzaJANPW52UiQWQcT558qBCr26OsZ9kdDOYQTfa1omBUFq0HtR5v7Z4d9v0ah5A2 _8CtdUatf4NOTYkYzXAd1dvUhdDNP80j6XpfFuLaQLL6xzIn45luG.IyvJzTitUOKNz9KLOIgi2G N8T6hXxYQuoT1g8wrz2MjWwsXD4dT_Y04NatB4UHE2hnU4A1SxApl5pnvy2mJ_DES4Pyv7xULKZ0 Jo.mcNYU9YUXuaz6tWatxqgXqHIX.YuPPDS9zG_0AW1aVAWCKFadcshyxu84T1NA4_mn4_fhYI0t T9So5kwuFIl_WbHiy3VliFM7_9n5iYUsuPPeargoKkdHpPrCBXNfsC7hsiQH3LbPA1bN4XYg6fBn OQJORZhtV2Gd6qPtNzjcWZmuj9he6CA57xAjXXyOkyXenGkcK7r8TWeqD84QSxE18TqalHVeDTdM XwPhVPFWOWd9eodPE.AZr3IYv5u9Th25gxGPwUHJ6exAnJY9XyaK7ERC4R7UTKLy1UjPYZ0rHOTh .jcaWeCjIDy8OtADB16qBNEa66iQJoKMq9D5XmX_I0V1e0j5rKE8kc2Tutc2mLhBIdZGZETaK6F3 _M1rgq2T5CZUKc4GMthksv.YJRz.eb_6fdx7athc7JSsunpkOUZYGCGECvJHmj.ce3EGLNiPfQWR lSpqtsHGx2BB6ism7fdWugQHShc81cADntuN..k_CZs_.dEoiOyY6A1JW4.ZYQLI6dXaQ33ebRl_ 0JsM.X2FKnQRxfRbCa9KQtFTqsdLSh0eoa1X4qzhh_6toDrKr5oYgDREE3TDLDerneAKqbjMwHu1 YzDIQRwVBpzVTdonL2gNDQCQZ8okN4lIObMhHSYrlSrAMQcbCTNHeajSi9JCdyFpajHTPhtOhHg. iB1ite_JZuTU8CplNxv4iiv_OIUjtgflXKTNrDsKITP4mMl03Sa6EjhFW_0HdmcUx7oVPq9akGHy N8yVbggWg3o1RFcmVIwJ._rrVrKIqag9jNQu_7zT1R8z5G0LUF4k0YcVgm94B9bRNoaeq.Tb9Xnh PcWg4KH53T4LE9yV72bHV9uPRPSU0k0zYpR23IhIOSngSmfRFAa5hJua0te4NaDkJNP1sQ6GLhR2 RVhc1WYz_zMy7lTvH20YJAryoBiPMa5DhvFNzrtyKhDJVVpBPDw8Hm_gDau7K4QGXiYXoowY5hvO MGV7z4YpgGKgueZqE6poKTTsExvUd.4pT.BgfouzMUnxrilepY1PwvKQwyA7Gg5bN8mk6lShIRVQ mqvhdI39XH_2UeMGeJ8KHw92MY7BEoIBm5HsvAZ87ZBWWyj2_AlSsfHC97FJA21Ejcmm1.7DV4w3 Rdx1W_6JUxCDcbjDrIBpyVcJVjS_K1TJWv2DOFdLd06qXVbsvdBCanp0ncJIkeXgCfYx0y2eBaBC gdfCn5M5rOYWar1ClkvgmjZmx6FJPyvVQjLik0DpNk3oBEIhYV0.DG27ennKg6Xz5cGNM2WCRwN7 rWwWAy_pycl8FULXoLaNp6Tl6Vi3kQqtMFl7bYqQbrEqe9jqToC7_OJeI_GKftwZey4STNUIKhOv 4HcsyJ9NVeUTLHhb.UQwpeB8xDFBkpl2B3G7I4FAOkfm5R3Ia_N9upuL1bys5JEnErjd0AmuAI_q oIJq65f7Tg1r1sLg6.xVpA3GAqbHSC.v_zsVNuaaQz9._9SHg48hbbZpdL5QhExSsccg- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 16 Oct 2022 15:42:06 +0000 Received: by hermes--production-bf1-585bd66ffc-gfghw (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3bd51f861688a041c9e15a52c054df13; Sun, 16 Oct 2022 15:42:02 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Subject: RE: zfs with operations like rm -rf takes a very long time recently Message-Id: Date: Sun, 16 Oct 2022 08:42:00 -0700 To: void , freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3696.120.41.1.1) References: X-Rspamd-Queue-Id: 4Mr4B83cM2z3byf X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=e4KJoZzN; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.82:from]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_TO(0.00)[f-m.fm,freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N void wrote on Date: Sun, 16 Oct 2022 13:57:04 UTC : > Has anything recently changed in -current that would make file = operations=20 > on zfs such as rm -rf *.* very slow? >=20 > What would I look for and how would I test it? >=20 > system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on = arm64.aarch64 > using GENERIC-NODEBUG kernel. >=20 > the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be = plenty=20 > of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. >=20 > Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and = it's taken=20 > over 10 mins. It was never this slow. No errors in /var/log/messages = and none=20 > yet in smartd. zpool scrub last ran successfully 3 days ago. >=20 > last pid: 4324; load averages: 0.17, 0.10, 0.12 = up 0+02:10:34 14:40:55 > 77 processes: 1 running, 76 sleeping > CPU: 1.6% user, 0.0% nice, 1.9% system, 0.2% interrupt, 96.4% idle > Mem: 550M Active, 803M Inact, 2224M Wired, 40K Buf, 4239M Free > ARC: 1293M Total, 381M MFU, 725M MRU, 1124K Anon, 30M Header, 156M = Other > 938M Compressed, 1906M Uncompressed, 2.03:1 Ratio > Swap: 16G Total, 16G Free > Process id to show (+ for all):=20 > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU = COMMAND > 3871 root 1 20 0 12M 3648K zio->i 2 0:10 0.39% = rm > 353 _pflogd 1 20 0 13M 2108K bpf 1 0:00 0.00% = pflogd > 1441 mailnull 1 28 0 25M 9508K select 3 0:01 0.00% = exim "The Design and Implementation of the FreeBSD Operating System" 2nd Ed. says about ZFS (page 548): "Like all non-overwriting filesystems, ZFS operates best when at least a quarter of its disk pool is free. Write throughout becomes poor when the pool gets too full. By contrast, UFS can run well to 95 percent full and acceptably to 99 percent full." And page 549 says: "ZFS was designed to manage and operate enormous filesystems easily, which it does well. Its design assumed that it would have many fast 64-bit CPUs with large amounts of memory to support these enormous filesystems. When these resources are available, it works really well. However, it is not designed for or well suited to run on resource-constrained system using 32-bit CPUs with less than 8 Gbyte of memory and one small, nearly-full disk, which is typical of many embedded systems." (Note the full-disk part and 8 GiByte being at the low end of the RAM size range.) Page 523 says: "ZFS takes advantage of the abundant processor power available with current multi-core CPUs. Because they are much faster than storage, ZFS can afford to checksum everything." The book is not explicit about RAM subsystem performance tradeoffs for ZFS. One property of the RPi4B's is that they have very small RAM caches and one core can saturate the memory subsystem if the RAM caches are being fairly ineffective overall. In such contexts, multi-core need not cut the time things take. (But I've no clue how likely such conditions would be for your context.) A cache-busting access pattern over much more than 1 MiByte memory range drops the RPi4B performance greatly compared to such an access pattern fitting in a 1 MiByte or smaller range --no matter if it is 1 core or more cores that is/are trying to be active. Independent of all that, something like: # gstat -spod would likely be interesting to monitor at during a time-taking "rm -fr" . I do not know if the "rm -fr" is deleting a lot of files that also have unchanged content in a snapshot. Such files are not actually deleted. The information about where the file should be visible is adjusted instead, leaving the snapshot copy(s) available for access. Such adds to the disk space usage by writing more metadata without deleting the snapshot related data. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Oct 16 16:07:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr4m25p57z4fWyf for ; Sun, 16 Oct 2022 16:08:02 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f49.google.com (mail-vs1-f49.google.com [209.85.217.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr4m200LRz3g64 for ; Sun, 16 Oct 2022 16:08:01 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-vs1-f49.google.com with SMTP id d187so9369461vsd.6 for ; Sun, 16 Oct 2022 09:08:01 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=mHH3NcZsw5Bsbv1bWM2pUwacaXrtHErfZN70atnR2H8=; b=NZCH3pLmE9A57U5LtPX/zHa+35048cV3W1W51rnBwMZ7gEGd7fM8PPc8NQ8LN/BQzb 4WlrepRHVqEJqhxJRYmg5LMixIxCyjhgE9aAigFXQ0Ae7M+tW0v/7Wd2Y2W86TubDZY+ 4SM1wsWAdgkBo2OWlMjCeCTo0ce3rNIEZcMKfrVr3thWEsGvVNDWiRJ9xGQpcizjoaJw 7tNl9zDVU14KHvS1/ShF6fpwiPQqyQ0+/dWF9+8b4avIW6Cqq6Zo2AQorlu3ZZ8iMivq z3T0eSMBseu5FGQfNH6MRgacG9tbQ3cccXzGSoIMOcD/jsoBfsKop0F6N0zSMIWXZt8i LNdQ== X-Gm-Message-State: ACrzQf19zlqIhVoLUJNZ2KEZcebVFYQbl/eQyfBaiHClHj+E+i/Slv3t 6+P2r8bNBTNCgwIJbAXqNSQqoifaSTXHInmYXH5v3xle9CE= X-Google-Smtp-Source: AMsMyM4bf0ipFNQM5CTOT2xYh4AzKgR6X7lzewgnlxsBWPm7FtvHM7+qqrNFiJh3cfyczT3IT/KaykxxPVcHyhvUjMs= X-Received: by 2002:a67:f699:0:b0:3a7:c31b:c8e2 with SMTP id n25-20020a67f699000000b003a7c31bc8e2mr2511094vso.11.1665936480574; Sun, 16 Oct 2022 09:08:00 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> In-Reply-To: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> From: Alan Somers Date: Sun, 16 Oct 2022 10:07:48 -0600 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Mr4m200LRz3g64 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.49 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[f-m.fm]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.49:from]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.49:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sun, Oct 16, 2022 at 9:13 AM void wrote: > > On Sun, 16 Oct 2022, at 14:15, Alan Somers wrote: > > The usual reason why rm gets slow is because your pool is nearly full > > and there's a snapshot. A snapshot means that rm doesn't actually > > free space; it just rewrites metadata, which requires even more space. > > And when a zpool is nearly full, writes always slow way down. > > But if that's not it, then you should also check gstat to see if the > > disk itself is slow. > > Hi, > > The disk in question is one of these: > https://skinflint.co.uk/toshiba-mobile-hdd-mq01-series-1tb-mq01abd100m-a1820027.html > > It's a CMR disk. Power-on hrs = 39253 > > da0: 400.000MB/s transfers > da0: 953869MB (1953525168 512 byte sectors) > da0: quirks=0x2 > > Filesystem Size Used Avail Capacity Mounted on > zroot/ROOT/default 863G 146G 717G 17% / > > there are no snapshots in "zfs list -t snapshot" > > rm -rf /var/cache/ccache/* has been running for 53 mins so far (it's still running) > > # gstat -dopC > timestamp,name,q-depth,total_ops/s,read/s,read-KiB/s,ms/read,write/s,write-KiB/s,ms/write,delete/s,delete-KiB/s,ms/delete,other/s,ms/other,%busy > 2022-10-16 16:01:24.761122175,da0,5,0,0,0,0.0,0,0,0.0,0,0,0.0,0,0.0,0.0 > 2022-10-16 16:01:25.762821956,da0,4,40,34,136,107.8,4,16,57.1,0,0,0.0,2,293.9,111.1 > 2022-10-16 16:01:26.763826447,da0,3,52,50,200,37.6,1,60,34.1,0,0,0.0,1,152.0,95.0 > 2022-10-16 16:01:27.767079004,da0,3,108,40,159,33.6,67,2173,10.3,0,0,0.0,1,12.2,85.1 > 2022-10-16 16:01:28.813081219,da0,1,57,17,69,62.8,38,467,31.0,0,0,0.0,2,156.9,108.7 > 2022-10-16 16:01:29.818093791,da0,1,56,56,223,17.2,0,0,0.0,0,0,0.0,0,0.0,95.9 > 2022-10-16 16:01:30.825841923,da0,1,57,57,230,16.9,0,0,0.0,0,0,0.0,0,0.0,95.3 > 2022-10-16 16:01:31.828940957,da0,1,58,58,231,16.7,0,0,0.0,0,0,0.0,0,0.0,96.7 > 2022-10-16 16:01:32.830822873,da0,3,150,29,116,33.9,120,8460,9.4,0,0,0.0,1,125.4,99.7 > 2022-10-16 16:01:33.877434519,da0,3,115,6,23,128.4,109,8607,17.1,0,0,0.0,0,0.0,93.4 > ^C > > I'm not sure what, of the data above, what would be considered "slow", or why it should be like this now. > > There's lots of things in sysctl -a concerning zfs. Can you suggest anything to > look out for? > > thanks, Gstat is showing that your disk is fully busy. It's also showing read latency as high as 128 ms, which is extremely slow. I suspect a problem with your disk. FYI, ZFS naturally has a 5-second rhythm (unless you changed vfs.zfs.txg.timeout), so gstat's output is sometimes more consistent if you use "-I 5s". You can also omit "-d" for magnetic HDDs, since they don't have anything like TRIM. I suggest checking dmesg to see if there are any messages about errors from da0. It would also be worth running "smartctl -a /dev/da0", from sysutils/smartmontools. -Alan From nobody Sun Oct 16 16:27:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr5C95s9Dz4fZ2X for ; Sun, 16 Oct 2022 16:28:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr5C83Wvtz3jXV for ; Sun, 16 Oct 2022 16:28:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665937682; bh=qhbhy5trzWeMzekha4+e/oTSEMluIZo5AERVx41zaOA=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=ksmRjP0TimPYsIQEf7NFUvNxY7s7NKOy8W9lFY7GbUdlR+imomkEckr9iUJxpu8iX1BmJAs6LywNj/6z7xOlUcdgnUSvqTl1LjCUn3FGN46hmaGkHxcr7ardbEMUYl9b5tqzXAyx0cAA/fWHQSjWgKqVOzC5Z3osTFsPnxL8DJGu0uCW4n88HwmuwjrGe7jxGojGD/XGjwofF7+S6sY6EvWYWn6xOS8x57BFjfdcm6mMwLPvm2THu9hmZhfx4TQ/qmi/QVif3SZ2RCCxFrvJAl3tqyohAg1Usq64BApALaxpcSuNPluMYiix8/2U5iUc0IKSzNoZAcGy8WKgeb9/VQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665937682; bh=6Ez14GRGNefKWhYB4U7bJONLRBcAwzlVxMf9erOvxUg=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=e2LRr/kjnBlzA0t3/+piHLCod4ycViB/NQ+B7h17IEYpHuRTx98uIQmmxZho2ulxktBrYLoknhzshcvl0utPD9ZK2fW62zvB2eLNizsekx60nqb47D4utDhSGrzffwzhiC05DbTD6yPTxhfvkVNWaayyrXPeZ970XVBs2uA9T5IY5Sw6/SJsyJCn8yAMiS9oi2fr8T4YmW2F1RG1ZHhqPy3q4SL8KuI1o2nlRr+G2gtOIp8Mq+bqnoe6VPQ20/8y0gWorRSdxcuHxoIzjuIJeqSR9I042d+p4rS9POZmM3JKgRi09QDRW9YJpqg2YTBQ9zM4mZFBSSu9veEBAgBT6A== X-YMail-OSG: Ww8jbrkVM1ldi9dF_WW_ljSfm46ASCILJk_xH5LH__c_QPJjgGyWQn73Dcx1bbo VQWKEfHxlJ55K.4ySBWHJiaG8xyn9zq0WhywSiaK5piKWsAvyxmb6ItPbLXpXCSdrpq3PJQvbcRY mQ3oGUcY.nIdDQiXeCX1vGKbXj8W4XY31_t59fS553Bw7V3NCyiScH656W4DxDC4HA698rekueQQ 8fgoYyuZB97elPZD7zWNVbFLJbvVHoGD_X00UzO_jiOeNZjdvaZTJJ9J1Arv2Gy2_PsjsM3vyaOW ZNnB8Wfl1.o5tP0U5ouCoA6JZaOs68CItaQl2.w3Ijrsx0HwL8QddSHf8jH43Ff4FdgxA2gYnptG ep42ZrjLCVisgjRB2DgI1I1zzJLW5hRPBw8i63as7jF.Ho15tNvjekpUQHCu.e9uhHiyGzrquvd. 1zbwddapNQYBCpSO8TY0kF2PkNMcXNVLuAieGzVlAZGus_wfGalWzul2FhfbzNAGCe1BtFJ25_ZG OpZ5nejsf1HgNKihUBOs2wjnSJFaCn_6iu4cHu9WO3YRohQGBxjIMknw9XB17IAjeOqA0BJdIVMI cIZBn8v3H3QLo9EDqnh83wsgV8BLW1_.gU2SSM8hY7QmQITVKlq09yY4RUkq6R8v7wQESCcTWN7q K.hnoQzGHf4qp5LL9KAihkDLyqMpvycgc1W.4Qr1x44nzXaxe8UzXz.lbIp_fA6b9WWx.JsGEv_Y RRhvStKrYBSXtQR_beBk_XfvQSVXDOT49mormthd6Jno2lsoKhsmgLbzIvI4P98NSjzlrq16YUT6 sTRHN5_GLfSuVtGGUXGy8mz3EPKvXhNha3sKWduN8XNIEEE8YP_IH2l33WxmGIwtSehyVtkHJ.5f 8KjgMcrD44MFAiQh0HEU67xMUn.nJpBy.a9uH7uAAFU1fRpgqFpoKH9xP8WkNnQ40ZTjnBL1KtEt v0uNsdwH0uvXZVUr51b0NWUWqqh4vCP.5l_raRSlUySu7pPklTcVc6htsrZ2KFwg2k5B25K8BKwm l0qmt_o7v7tNKsIdmxm2q_syoGrzVp5EPOoFqeotBWD32eMCtNIuIh11WiapH4UL_6pzhLS0Y7Mw V4uUs30hv2c74sAVKNm4Q6mUFEy2_eEMvsdE6AGcoKFGXz1gfhQdwwmd7K9y.Cu6Y..Mbn64UTjC HXTCmcdFlC6uZZ7HCNm.MQ3.pjHh6p16HW32a7_Jd59RzaJ0vg5D929nqo6y90p.XPzh_J_sPG1z 5tJi2A.wwfG596VGdIcHu4c5zaZFcVQ9BuLqNLaYFl1nasuianuXPXfa_l4m6AjTT1yoQ6VCQ8HB UEp7SJn_flt.VUyI9Oo3fWS5uae9erR68jn5Ms9q29AJrajg5TdSWeg32YJET1b.Sgyma8LImMfO jJXzkrEUlcl17C_OHytutasDMAfxytC73OaHAmKbI8w.H.tEGbDha6xkcFKVcrT0JIarLlOOX4Ry O29CP_yAM9NAVKS_X08xktPglUdddGOCJWZ_46wF2Ev_BS.AgveUS2bhR6bxSHKQFJRWUsEacZ1L xQwPJnniNaV6UdyJnjqMTB5N4PIprda5zRjwC9Pear6LHpCFspaOzm9e550Z3QngTSBpqAM.WKK7 iVpZqzQSyhiLJXDpdNhQVT0yXZeLAmIgykJRaVG8Ftn6UuUD0Ii.ggygFnfWMu3w3cTScnRCcUbq _gSa4nstpVP1PgEb1irfbVlq5ZOBdoFg5X09wzRbdzRmY6SrE0Y8S2xpLSn09q5B2IZLlxLffRGn 7WYFS_Fo8DzaRfrQjhR.6jQa4nPgtHZwIVYSsDpP.5OFEeWMYbA7y6ZV3LoNLLbYyqaBLMfkTtlZ Hm1T3uDyHpD8F1V_PcjZtw6hQAnPfO5XG0N3LT482scmWAj503cDsplFC5Ns1wC_sxIaoDN5KDzl lPjy4y8jemlG1.9mvGSVB8RJTj7WTAXsVITI7DVTUl.8Xh5sxS1.2kzTDKn5RiHGaJl0BvOa7M9t VglX8Mr.aAtifGGLhSdYt5XpO7B1ficd0FvPP1EU0HKU4Bprv3Y.4Z53XU_zOxlpW_of0PRZ8o8U GZQouPSW.uaBxmrY9OQWbn274qKa9PhWTQ1vsfkYf_WJ.ezQbERYrMqZOfEcW7oIte.qCEYDoI.t TNekg1TRMGtHMAORJkSTZl6GKrxrncBlSSs5r3EutmG3S6Eea23vwo4mdY9eKq78y.QTz.bqpj7f OA9cP3vohAdKvJb32uUrpZw9nJxeqXUuskLyUidvD2JRADi.ujkLVwgGDqlWBlTWnVrkc X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Sun, 16 Oct 2022 16:28:02 +0000 Received: by hermes--production-gq1-75cfcccdb-vtzqm (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 0d703516a62274c3c9b20d7483eeebdb; Sun, 16 Oct 2022 16:27:58 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Subject: Re: zfs with operations like rm -rf takes a very long time recently Date: Sun, 16 Oct 2022 09:27:58 -0700 References: To: void , freebsd-fs@freebsd.org In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3696.120.41.1.1) X-Rspamd-Queue-Id: 4Mr5C83Wvtz3jXV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ksmRjP0T; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_TO(0.00)[f-m.fm,freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On 2022-Oct-16, at 08:42, Mark Millard wrote: > void wrote on > Date: Sun, 16 Oct 2022 13:57:04 UTC : >=20 >> Has anything recently changed in -current that would make file = operations=20 >> on zfs such as rm -rf *.* very slow? >>=20 >> What would I look for and how would I test it? >>=20 >> system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on = arm64.aarch64 >> using GENERIC-NODEBUG kernel. >>=20 >> the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be = plenty=20 >> of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. >>=20 >> Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and = it's taken=20 >> over 10 mins. It was never this slow. No errors in /var/log/messages = and none=20 >> yet in smartd. zpool scrub last ran successfully 3 days ago. >>=20 >> last pid: 4324; load averages: 0.17, 0.10, 0.12 = up 0+02:10:34 14:40:55 >> 77 processes: 1 running, 76 sleeping >> CPU: 1.6% user, 0.0% nice, 1.9% system, 0.2% interrupt, 96.4% = idle >> Mem: 550M Active, 803M Inact, 2224M Wired, 40K Buf, 4239M Free >> ARC: 1293M Total, 381M MFU, 725M MRU, 1124K Anon, 30M Header, 156M = Other >> 938M Compressed, 1906M Uncompressed, 2.03:1 Ratio >> Swap: 16G Total, 16G Free >> Process id to show (+ for all):=20 >> PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU = COMMAND >> 3871 root 1 20 0 12M 3648K zio->i 2 0:10 0.39% = rm >> 353 _pflogd 1 20 0 13M 2108K bpf 1 0:00 0.00% = pflogd >> 1441 mailnull 1 28 0 25M 9508K select 3 0:01 0.00% = exim >=20 >=20 > "The Design and Implementation of the FreeBSD Operating System" > 2nd Ed. says about ZFS (page 548): >=20 > "Like all non-overwriting filesystems, ZFS operates best > when at least a quarter of its disk pool is free. Write > throughout becomes poor when the pool gets too full. By > contrast, UFS can run well to 95 percent full and acceptably > to 99 percent full." >=20 > And page 549 says: >=20 > "ZFS was designed to manage and operate enormous filesystems > easily, which it does well. Its design assumed that it would > have many fast 64-bit CPUs with large amounts of memory to > support these enormous filesystems. When these resources are > available, it works really well. However, it is not designed > for or well suited to run on resource-constrained system using > 32-bit CPUs with less than 8 Gbyte of memory and one small, > nearly-full disk, which is typical of many embedded systems." >=20 > (Note the full-disk part and 8 GiByte being at the low end of > the RAM size range.) >=20 > Page 523 says: >=20 > "ZFS takes advantage of the abundant processor power available > with current multi-core CPUs. Because they are much faster than > storage, ZFS can afford to checksum everything." >=20 > The book is not explicit about RAM subsystem performance > tradeoffs for ZFS. One property of the RPi4B's is that they > have very small RAM caches and one core can saturate the > memory subsystem if the RAM caches are being fairly > ineffective overall. In such contexts, multi-core need not > cut the time things take. (But I've no clue how likely such > conditions would be for your context.) A cache-busting > access pattern over much more than 1 MiByte memory range > drops the RPi4B performance greatly compared to such an > access pattern fitting in a 1 MiByte or smaller range --no > matter if it is 1 core or more cores that is/are trying to > be active. >=20 >=20 > Independent of all that, something like: >=20 > # gstat -spod >=20 > would likely be interesting to monitor at during a time-taking > "rm -fr" . >=20 > I do not know if the "rm -fr" is deleting a lot of files that > also have unchanged content in a snapshot. Such files are not > actually deleted. The information about where the file should > be visible is adjusted instead, leaving the snapshot copy(s) > available for access. Such adds to the disk space usage by > writing more metadata without deleting the snapshot related > data. >=20 Your: Filesystem Size Used Avail Capacity = Mounted on zroot/ROOT/default 863G 146G 717G 17% / indicates that it should not be too full. You published some "gstat -dopC" data.It looks like generally under, say, 65 reads/sec with generally under, day, 300 KiBytes/sec resulting is enough to keep the %busy suggestive figure at over 90, no writes at the time. It looks like where there is notably less read activity, there is write activity and/or "other" activity keeping the %busy figure generally 90+. Sure looks I/O bound. Page 547, mid first paragraph: "The result of the sequential writing is that a file can end up requiring many random access when it is later read. ZFS mitigates the reading cost by dedicating enough memory to the ARC to be able to keep all actively accessed files resident. ZFS also attempts to prefetch data when files are being read." It looks like you are suffering the random accesses from an ineffective mitigation and have storage media for which the, say, seek times (and more), is leading to generally under, say, 65 reads/sec (absent writes/other). (It is harder to say as much about the writes&others activities based on the limited data and the mixing of read/write/other.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Oct 16 16:40:35 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr5VN3Pmvz4fb6k for ; Sun, 16 Oct 2022 16:41:16 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr5VM4zKJz3kn4 for ; Sun, 16 Oct 2022 16:41:15 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 6F0413200583 for ; Sun, 16 Oct 2022 12:41:13 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 12:41:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665938473; x=1666024873; bh=nWTWir13Wy kWqHpbg9ZB4PwE+/Kmr+PC0KSfEFza4Ts=; b=Iy5BtkJE8StrfAZl111KS2p5G3 nlP8XoQCrJmbgNoe0SOlf4Tmo1Ouss8IEgLWEgce91VnPzLRQcpx3kfVgu5dWKuu qWP2qBW8uuB/IXxxKaa/I/EccJ+spQ/OfQamIER1l3C+l3MgnzG+3JHG9/YMmpoS G8Fu+WO5H0pemnnH0z+OKG2zJAJYD6v7zErguxB/oMlw3+rH8F/JxBrbTcfQUE9h UbBPIy3GzdrLoxuP9u+Y54GJIKzL84oJa1FQuFz8A3dO6PTdCy6RAIT+kFCYdKwY BSMa34ZHLVFBDCxH34WRQ9uPCVjDb0HO/T23GCwL9aSaLK2x5AzeZ5DaHNtw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665938473; x=1666024873; bh=nWTWir13WykWqHpbg9ZB4PwE+/Km r+PC0KSfEFza4Ts=; b=exwUA3odqxJ9QtsitIpQ0eUsxNhAa2giRLpkNI5KIA7O qRttKgOP72QzOrlmFOuRS4xunBcLB3N8YM+vhJwxyDErZju7wamc5xZwdqGlDGZZ U6HuaXTrnKLa+WsHR/7C0sxH/JICrxmzm/zNbQa28oaX/6Ei08R0HZi1CKSOle9L K+0FzfEy6YGl2ceZs4OVTOlxgfsp/xociQzYftJ1p7kasLBnPWEgTNZbkKqAEZFh gPzAfDF9vG1BgdaZhO12sPe5maRDqq9KrMyo7Roo2CMgFyEnPLntO0iTcrfcgXAA tlu5ACULPCwyoXfHx/k2HqGv4rJZL1VqsuQNejL71A== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekjedguddthecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepofgfggfkjghffffhvffutgesth dtredtreertdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggft rfgrthhtvghrnhepieetvdeuhedthedtvdfhuefhveehvdeiledvieffheevleehgeefud eljedukedvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepvhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id CE2F12A20079; Sun, 16 Oct 2022 12:41:12 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> In-Reply-To: References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> Date: Sun, 16 Oct 2022 16:40:35 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4Mr5VM4zKJz3kn4 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=Iy5BtkJE; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=exwUA3od; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.25 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.56 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.967]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RWL_MAILSPIKE_POSSIBLE(0.00)[64.147.123.25:from] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 16:07, Alan Somers wrote: > Gstat is showing that your disk is fully busy. It's also showing read > latency as high as 128 ms, which is extremely slow. I ran another gstat with -I 5s and have omitted -d as per your last email. How did you calculate latency? There's zfs-stats installed too. Would pasting some output here be useful? # gstat -opC -I 5s timestamp,name,q-depth,total_ops/s,read/s,read-KiB/s,ms/read,write/s,write-KiB/s,ms/write,other/s,ms/other,%busy 2022-10-16 17:23:47.080118413,da0,3,0,0,0,0.0,0,0,0.0,0,0.0,0.0 2022-10-16 17:23:52.088745392,da0,4,93,45,246,26.4,49,3974,12.7,0,154.4,97.8 2022-10-16 17:23:57.167503039,da0,3,82,41,164,25.5,40,3193,17.3,1,153.2,99.2 2022-10-16 17:24:02.176759152,da0,3,81,43,176,22.8,38,2704,13.3,0,252.6,98.6 2022-10-16 17:24:07.189364538,da0,2,90,35,140,27.9,55,3371,15.9,1,146.9,99.4 2022-10-16 17:24:12.190874083,da0,3,95,42,170,23.3,52,3486,13.2,0,167.0,96.6 2022-10-16 17:24:17.212769876,da0,4,85,33,134,30.6,52,3508,22.3,1,164.9,100.7 2022-10-16 17:24:22.286986167,da0,3,89,42,168,23.2,46,3149,12.7,1,127.3,97.2 2022-10-16 17:24:27.295992137,da0,3,88,40,160,25.4,48,3978,15.6,0,147.4,101.3 2022-10-16 17:24:32.406662934,da0,2,90,46,254,27.1,44,3554,12.9,0,159.3,97.9 2022-10-16 17:24:37.426033077,da0,3,87,42,177,23.3,45,2835,15.4,1,112.8,98.0 2022-10-16 17:24:42.455203661,da0,3,95,43,170,23.1,52,3770,11.9,0,153.5,98.8 2022-10-16 17:24:47.468741642,da0,3,71,36,144,27.9,35,2510,19.7,1,243.7,99.3 2022-10-16 17:24:52.471973107,da0,3,80,34,138,29.1,46,3630,17.6,0,266.6,99.2 2022-10-16 17:24:57.490425268,da0,3,79,35,141,28.1,43,3372,18.6,1,297.8,98.3 2022-10-16 17:25:02.589730547,da0,4,68,30,123,32.7,36,2318,22.4,3,105.2,97.9 ^C > I suspect a > problem with your disk. FYI, ZFS naturally has a 5-second rhythm > (unless you changed vfs.zfs.txg.timeout), # sysctl vfs.zfs.txg.timeout vfs.zfs.txg.timeout: 5 > so gstat's output is > sometimes more consistent if you use "-I 5s". You can also omit "-d" > for magnetic HDDs, since they don't have anything like TRIM. > I suggest checking dmesg to see if there are any messages about errors > from da0. It would also be worth running "smartctl -a /dev/da0", from > sysutils/smartmontools. Unfortunately, no errors seen in either dmesg or smartctl. there's been a long smartctl test relatively recently, also came back clean. SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 39253 - # 2 Extended offline Completed without error 00% 39176 - # 3 Short offline Completed without error 00% 39172 - ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0 2 Throughput_Performance 0x0005 100 100 050 Pre-fail Offline - 0 3 Spin_Up_Time 0x0027 100 100 001 Pre-fail Always - 2595 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 1487 5 Reallocated_Sector_Ct 0x0033 100 100 050 Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0 8 Seek_Time_Performance 0x0005 100 100 050 Pre-fail Offline - 0 9 Power_On_Hours 0x0032 002 002 000 Old_age Always - 39254 10 Spin_Retry_Count 0x0033 128 100 030 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 1263 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 4 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 426 193 Load_Cycle_Count 0x0032 029 029 000 Old_age Always - 710616 194 Temperature_Celsius 0x0022 100 100 000 Old_age Always - 54 (Min/Max 16/65) 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 220 Disk_Shift 0x0002 100 100 000 Old_age Always - 0 222 Loaded_Hours 0x0032 075 075 000 Old_age Always - 10367 223 Load_Retry_Count 0x0032 100 100 000 Old_age Always - 0 224 Load_Friction 0x0022 100 100 000 Old_age Always - 0 226 Load-in_Time 0x0026 100 100 000 Old_age Always - 260 240 Head_Flying_Hours 0x0001 100 100 001 Pre-fail Offline - 0 SMART Error Log Version: 1 No Errors Logged From nobody Sun Oct 16 16:48:39 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr5gL539dz4fbm0 for ; Sun, 16 Oct 2022 16:49:02 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr5gK4YKwz3lsF for ; Sun, 16 Oct 2022 16:49:01 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 5F454320051E for ; Sun, 16 Oct 2022 12:49:00 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 12:49:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665938939; x=1666025339; bh=fkN7O7Y3TS zFLLlmFGbwQkbhvA5J6y3HXW04Z1SDGsQ=; b=tQAb67sI987Jhvjq83fabkNrcl pUnJ36ouKH1HuRsOqt3uq/s1kxRggpkz+TeOvVSzDQy3JzJPoVzuuQoXaUITpO/F zgFpePIm1x4IEHDxq7I29x4ZxQhpJRpzyG8vRU7I433xThdh/27+CjeHlPyq7409 a8CP2x5ENPAy6zJrJpVe7gPXRwtE3yx/ijCXKO+iftUCWtoda9cen14Iv7VdGifO /T6AAWNTSTq/WNQkw0rCfdzGuA+1b03ZtYoKeELHgz3GOk5x/oXQKwGjkM178o7q juyI96r8bqDcVeF48DxegTgFZN19EBYfHQTeWIg22eTPIKIWNPvYUCMifnFg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665938939; x=1666025339; bh=fkN7O7Y3TSzFLLlmFGbwQkbhvA5J 6y3HXW04Z1SDGsQ=; b=ni81sWo2b5to8bYapM2ebtmaLpBudNSHm4msPraFTthX t5PwdWJCjDyKKWUQlBoqlY89V23xT0/Dt8OJod+fwfdwoHvrPan7Kf3ysYadu1WH vRH0OiSE29IL1/O8t2t0n6VQy1nn9rF3iQI6ViX0JtqF3zsbpXsdHmDqsfFSRsSU A8dVKFP6i0ldHy0SCiyv2tRVDvf3z2LgH/PHx2IuFbcSE6XvmqrQQvPdP0+QPgdW 5udt+VyorWWztx8jhJmk6RXc6tbbsb6zkHbJE8q08h1eyowpGUh2KEdH/oIO57/s hKXGdVtWifWiPOlsr4mtmPUrRvwvu3YoWTPhHORhTA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekjedguddtiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepofgfggfkjghffffhvffutgesth dtredtreertdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggft rfgrthhtvghrnhepieetvdeuhedthedtvdfhuefhveehvdeiledvieffheevleehgeefud eljedukedvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepvhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id C5A4A2A20079; Sun, 16 Oct 2022 12:48:59 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: In-Reply-To: References: Date: Sun, 16 Oct 2022 16:48:39 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4Mr5gK4YKwz3lsF X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=tQAb67sI; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=ni81sWo2; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.25 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.55 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.964]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25:c]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RWL_MAILSPIKE_POSSIBLE(0.00)[64.147.123.25:from] X-ThisMailContainsUnwantedMimeParts: N Hi, On Sun, 16 Oct 2022, at 15:42, Mark Millard wrote: > The book is not explicit about RAM subsystem performance > tradeoffs for ZFS. One property of the RPi4B's is that they > have very small RAM caches and one core can saturate the > memory subsystem if the RAM caches are being fairly > ineffective overall. In such contexts, multi-core need not > cut the time things take. (But I've no clue how likely such > conditions would be for your context.) A cache-busting > access pattern over much more than 1 MiByte memory range > drops the RPi4B performance greatly compared to such an > access pattern fitting in a 1 MiByte or smaller range --no > matter if it is 1 core or more cores that is/are trying to > be active. That's interesting; i cant understand the system has been in use for 9 months or so without this performance penalty. The OS has been updated on the following timeline main-n258595-226e41467ee1 on 2022-10-13 main-n258157-f50274674eb on 2022-09-23 main-n257818-6f7bc8e7a3d on 2022-09-05 main-n257229-e9a2e4d1d28 on 2022-08-10 main-n255150-70910e4b55c on 2022-05-04 cleaning out /usr/obj and /var/cache/ccache/* is something i'll do periodically if what is required is a completely clean from-scratch build. On at least two of those occasions I'd be doing what I'm trying now. but only now this issue has arisen. Of course, it may very well be the hardware. But all the things i'd use to monitor it say it's all fine. would output of zfs-stats -a be of use? thanks, From nobody Sun Oct 16 16:51:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr5jv1ljVz4fbxw for ; Sun, 16 Oct 2022 16:51:15 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr5jt0tjPz3mlc for ; Sun, 16 Oct 2022 16:51:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ed1-x529.google.com with SMTP id r14so13018248edc.7 for ; Sun, 16 Oct 2022 09:51:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=9WEplfKO6IAzUgGYX9/0MjDaBzD3LzYoDLxWzqrHjc4=; b=xmDZfWaIqbklUq3EcVEr4j/X565WgTAFe+yXm0K/x3VEQHPMZdX7CmhnSViymA3n3n vi7EaZrPwj7rHA9B5Cwkcwc5+FtVo4feekqzxYPnCgbFjmS1dzRKtt9rFR0uTdd0++Fp gkghslo6cHUw9aHfQrRZTHH3Njf5N8nWjc9rZqN+mmZgBNwr3tM0sQBL/B5bDi/YNcAB D9hns63bivlhygmuK17r3/vkrUlTEyxFhBtNpI3YY4yDo0Z2fuy8fm7sYQQsdTMyBJCG tD9yu9t8I1Gaswuw1qosVCC1m+EhDBmGfxFwa2B1Ts0av+MWR5flX4oYdpmMbG97ckjz eZIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=9WEplfKO6IAzUgGYX9/0MjDaBzD3LzYoDLxWzqrHjc4=; b=pRoPtuqXC4Ux7SgJNTClhVGkB4GuBadONaWt7zaY+zvTctpSY2JhaHJSBlxeY410Br 4hxw1qO2EOQLNpG+BuoTgFFLRVdrfJ9Ys0pDKBuYdzalVpspxrRWe9YwUa00+wXJq+H0 KKh8SqcUuRhjiFGaD2PEDjeY8QS1ruJ20jY+81AATYfcikwrjJD8bPAVlZqgj1nilaCq CZFW03b+M+c8BkR0KqUpyGITbP+95MuI+1kiDkUz7XUaH3qrBSBbdJtkNA7vouY9r0he JgejMNwboHjL18FYKxNlbllBj3pY53Fowf3+r6g9KaYaQFqcg7tfwmPTu78HvAV0MA4M geJw== X-Gm-Message-State: ACrzQf3rcze9CiLnvsyLkGkLLvx3gaXc2f5fYIN3CT1ZHbGJ2P37Chak /4sp+qlihyJB6be2pGDoUEKjPb0drZUgrcqwky0syA== X-Google-Smtp-Source: AMsMyM6RzE+Yacnl8wdUtYejeLd5p0kQgpqPCF2eo0Ju7hBZ7mydZWDzhRuptGKWJeJnGOHFGj/AZ1aY2DVvvtiNZaA= X-Received: by 2002:a05:6402:2687:b0:45d:3a94:348f with SMTP id w7-20020a056402268700b0045d3a94348fmr6795028edd.48.1665939072062; Sun, 16 Oct 2022 09:51:12 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> In-Reply-To: <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> From: Warner Losh Date: Sun, 16 Oct 2022 10:51:00 -0600 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs Content-Type: multipart/alternative; boundary="0000000000009baec005eb29aabc" X-Rspamd-Queue-Id: 4Mr5jt0tjPz3mlc X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=xmDZfWaI; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::529) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.997]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEMAIL_TO(0.00)[f-m.fm]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::529:from]; DMARC_NA(0.00)[bsdimp.com]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --0000000000009baec005eb29aabc Content-Type: text/plain; charset="UTF-8" On Sun, Oct 16, 2022 at 10:41 AM void wrote: > On Sun, 16 Oct 2022, at 16:07, Alan Somers wrote: > > Gstat is showing that your disk is fully busy. It's also showing read > > latency as high as 128 ms, which is extremely slow. > > I ran another gstat with -I 5s and have omitted -d as > per your last email. How did you calculate latency? > > There's zfs-stats installed too. Would pasting some output here be useful? > > # gstat -opC -I 5s > > timestamp,name,q-depth,total_ops/s,read/s,read-KiB/s,ms/read,write/s,write-KiB/s,ms/write,other/s,ms/other,%busy > 2022-10-16 17:23:47.080118413,da0,3,0,0,0,0.0,0,0,0.0,0,0.0,0.0 > 2022-10-16 > 17:23:52.088745392,da0,4,93,45,246,26.4,49,3974,12.7,0,154.4,97.8 > 2022-10-16 > 17:23:57.167503039,da0,3,82,41,164,25.5,40,3193,17.3,1,153.2,99.2 > 2022-10-16 > 17:24:02.176759152,da0,3,81,43,176,22.8,38,2704,13.3,0,252.6,98.6 > 2022-10-16 > 17:24:07.189364538,da0,2,90,35,140,27.9,55,3371,15.9,1,146.9,99.4 > 2022-10-16 > 17:24:12.190874083,da0,3,95,42,170,23.3,52,3486,13.2,0,167.0,96.6 > 2022-10-16 > 17:24:17.212769876,da0,4,85,33,134,30.6,52,3508,22.3,1,164.9,100.7 > 2022-10-16 > 17:24:22.286986167,da0,3,89,42,168,23.2,46,3149,12.7,1,127.3,97.2 > 2022-10-16 > 17:24:27.295992137,da0,3,88,40,160,25.4,48,3978,15.6,0,147.4,101.3 > 2022-10-16 > 17:24:32.406662934,da0,2,90,46,254,27.1,44,3554,12.9,0,159.3,97.9 > 2022-10-16 > 17:24:37.426033077,da0,3,87,42,177,23.3,45,2835,15.4,1,112.8,98.0 > 2022-10-16 > 17:24:42.455203661,da0,3,95,43,170,23.1,52,3770,11.9,0,153.5,98.8 > 2022-10-16 > 17:24:47.468741642,da0,3,71,36,144,27.9,35,2510,19.7,1,243.7,99.3 > 2022-10-16 > 17:24:52.471973107,da0,3,80,34,138,29.1,46,3630,17.6,0,266.6,99.2 > 2022-10-16 > 17:24:57.490425268,da0,3,79,35,141,28.1,43,3372,18.6,1,297.8,98.3 > 2022-10-16 > 17:25:02.589730547,da0,4,68,30,123,32.7,36,2318,22.4,3,105.2,97.9 > ^C > Your disk is doing ~90 IOPs. ~60 read ~30 write with an average queue depth of 4, and a 95+% busy factor (which is kinda misleading, but in this case not so much). So a crapton of traffic to the disk is making the disk slow. Why that's happening, I'm unsure, but your disk is slow because it's fairly loaded. I'm not sure what the 'other operations' are that aren't read, write or trim. At a guess, I'd say that's BIO_FLUSH slowing things down a bit (but not a huge amount). > > I suspect a > > problem with your disk. FYI, ZFS naturally has a 5-second rhythm > > (unless you changed vfs.zfs.txg.timeout), > > # sysctl vfs.zfs.txg.timeout > vfs.zfs.txg.timeout: 5 > > > so gstat's output is > > sometimes more consistent if you use "-I 5s". You can also omit "-d" > > for magnetic HDDs, since they don't have anything like TRIM. > > > I suggest checking dmesg to see if there are any messages about errors > > from da0. It would also be worth running "smartctl -a /dev/da0", from > > sysutils/smartmontools. > > Unfortunately, no errors seen in either dmesg or smartctl. there's been a > long smartctl test relatively recently, also came back clean. > > SMART Self-test log structure revision number 1 > Num Test_Description Status Remaining > LifeTime(hours) LBA_of_first_error > # 1 Short offline Completed without error 00% 39253 > - > # 2 Extended offline Completed without error 00% 39176 > - > # 3 Short offline Completed without error 00% 39172 > - > > ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED > WHEN_FAILED RAW_VALUE > 1 Raw_Read_Error_Rate 0x000b 100 100 050 Pre-fail Always > - 0 > 2 Throughput_Performance 0x0005 100 100 050 Pre-fail Offline > - 0 > 3 Spin_Up_Time 0x0027 100 100 001 Pre-fail Always > - 2595 > 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always > - 1487 > 5 Reallocated_Sector_Ct 0x0033 100 100 050 Pre-fail Always > - 0 > 7 Seek_Error_Rate 0x000b 100 100 050 Pre-fail Always > - 0 > 8 Seek_Time_Performance 0x0005 100 100 050 Pre-fail Offline > - 0 > 9 Power_On_Hours 0x0032 002 002 000 Old_age Always > - 39254 > 10 Spin_Retry_Count 0x0033 128 100 030 Pre-fail Always > - 0 > 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always > - 1263 > 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always > - 4 > 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always > - 426 > 193 Load_Cycle_Count 0x0032 029 029 000 Old_age Always > - 710616 > 194 Temperature_Celsius 0x0022 100 100 000 Old_age Always > - 54 (Min/Max 16/65) > 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always > - 0 > 197 Current_Pending_Sector 0x0032 100 100 000 Old_age Always > - 0 > 198 Offline_Uncorrectable 0x0030 100 100 000 Old_age Offline > - 0 > 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always > - 0 > 220 Disk_Shift 0x0002 100 100 000 Old_age Always > - 0 > 222 Loaded_Hours 0x0032 075 075 000 Old_age Always > - 10367 > 223 Load_Retry_Count 0x0032 100 100 000 Old_age Always > - 0 > 224 Load_Friction 0x0022 100 100 000 Old_age Always > - 0 > 226 Load-in_Time 0x0026 100 100 000 Old_age Always > - 260 > 240 Head_Flying_Hours 0x0001 100 100 001 Pre-fail Offline > - 0 > > SMART Error Log Version: 1 > No Errors Logged > The only thing that looks high here is the load cycle count and maybe the power off retract count. With 40k power on hours, that's a power off every 90 hours? That seems a little weird. And the load cycle is almost 20 times the power on hours, suggesting it's going on every few minutes. That's higher than I'd expect as well. The power cycle count is also high for the number of hours. Your disk is pushing 4 years old too, which may mean its past expected life. So this profile suggests possible signs of fatigue. Warner --0000000000009baec005eb29aabc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Oct 16, 2022 at 10:41 AM void= <void@f-m.fm> wrote:
On Sun, 16 Oct 2022, at 16:0= 7, Alan Somers wrote:
> Gstat is showing that your disk is fully busy.=C2=A0 It's also sho= wing read
> latency as high as 128 ms, which is extremely slow.=C2=A0

I ran another gstat with -I 5s and have omitted -d as
per your last email. How did you calculate latency?

There's zfs-stats installed too. Would pasting some output here be usef= ul?

# gstat -opC -I 5s
timestamp,name,q-depth,total_ops/s,read/s,read-KiB/s,ms/read,write/s,write-= KiB/s,ms/write,other/s,ms/other,%busy
2022-10-16 17:23:47.080118413,da0,3,0,0,0,0.0,0,0,0.0,0,0.0,0.0
2022-10-16 17:23:52.088745392,da0,4,93,45,246,26.4,49,3974,12.7,0,154.4,97.= 8
2022-10-16 17:23:57.167503039,da0,3,82,41,164,25.5,40,3193,17.3,1,153.2,99.= 2
2022-10-16 17:24:02.176759152,da0,3,81,43,176,22.8,38,2704,13.3,0,252.6,98.= 6
2022-10-16 17:24:07.189364538,da0,2,90,35,140,27.9,55,3371,15.9,1,146.9,99.= 4
2022-10-16 17:24:12.190874083,da0,3,95,42,170,23.3,52,3486,13.2,0,167.0,96.= 6
2022-10-16 17:24:17.212769876,da0,4,85,33,134,30.6,52,3508,22.3,1,164.9,100= .7
2022-10-16 17:24:22.286986167,da0,3,89,42,168,23.2,46,3149,12.7,1,127.3,97.= 2
2022-10-16 17:24:27.295992137,da0,3,88,40,160,25.4,48,3978,15.6,0,147.4,101= .3
2022-10-16 17:24:32.406662934,da0,2,90,46,254,27.1,44,3554,12.9,0,159.3,97.= 9
2022-10-16 17:24:37.426033077,da0,3,87,42,177,23.3,45,2835,15.4,1,112.8,98.= 0
2022-10-16 17:24:42.455203661,da0,3,95,43,170,23.1,52,3770,11.9,0,153.5,98.= 8
2022-10-16 17:24:47.468741642,da0,3,71,36,144,27.9,35,2510,19.7,1,243.7,99.= 3
2022-10-16 17:24:52.471973107,da0,3,80,34,138,29.1,46,3630,17.6,0,266.6,99.= 2
2022-10-16 17:24:57.490425268,da0,3,79,35,141,28.1,43,3372,18.6,1,297.8,98.= 3
2022-10-16 17:25:02.589730547,da0,4,68,30,123,32.7,36,2318,22.4,3,105.2,97.= 9
^C

Your disk is doing ~90 IOPs. ~60 rea= d ~30 write with an average queue depth of
4, and a 95+% busy fac= tor (which is kinda misleading, but in this case not so much).
So a crapton of traffic to the disk is making the disk slow.= =C2=A0 Why that's happening, I'm unsure,
but your disk is= slow because it's fairly loaded. I'm not sure what the 'other = operations'
are that aren't read, write or trim. At a gue= ss, I'd say that's BIO_FLUSH slowing things
down a bit (b= ut not a huge amount).
=C2=A0
> I suspect a
> problem with your disk.=C2=A0 FYI, ZFS naturally has a 5-second rhythm=
> (unless you changed vfs.zfs.txg.timeout),

# sysctl vfs.zfs.txg.timeout
vfs.zfs.txg.timeout: 5

> so gstat's output is
> sometimes more consistent if you use "-I 5s".=C2=A0 You can = also omit "-d"
> for magnetic HDDs, since they don't have anything like TRIM.

> I suggest checking dmesg to see if there are any messages about errors=
> from da0.=C2=A0 It would also be worth running "smartctl -a /dev/= da0", from
> sysutils/smartmontools.

Unfortunately, no errors seen in either dmesg or smartctl. there's been= a long smartctl test relatively recently, also came back clean.

SMART Self-test log structure revision number 1
Num=C2=A0 Test_Description=C2=A0 =C2=A0 Status=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Remaining=C2=A0 LifeTime(hours)=C2=A0 LB= A_of_first_error
# 1=C2=A0 Short offline=C2=A0 =C2=A0 =C2=A0 =C2=A0Completed without error= =C2=A0 =C2=A0 =C2=A0 =C2=A000%=C2=A0 =C2=A0 =C2=A039253=C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0-
# 2=C2=A0 Extended offline=C2=A0 =C2=A0 Completed without error=C2=A0 =C2= =A0 =C2=A0 =C2=A000%=C2=A0 =C2=A0 =C2=A039176=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0-
# 3=C2=A0 Short offline=C2=A0 =C2=A0 =C2=A0 =C2=A0Completed without error= =C2=A0 =C2=A0 =C2=A0 =C2=A000%=C2=A0 =C2=A0 =C2=A039172=C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0-

ID# ATTRIBUTE_NAME=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 FLAG=C2=A0 =C2=A0 =C2= =A0VALUE WORST THRESH TYPE=C2=A0 =C2=A0 =C2=A0 UPDATED=C2=A0 WHEN_FAILED RA= W_VALUE
=C2=A0 1 Raw_Read_Error_Rate=C2=A0 =C2=A0 =C2=A00x000b=C2=A0 =C2=A0100=C2= =A0 =C2=A0100=C2=A0 =C2=A0050=C2=A0 =C2=A0 Pre-fail=C2=A0 Always=C2=A0 =C2= =A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 2 Throughput_Performance=C2=A0 0x0005=C2=A0 =C2=A0100=C2=A0 =C2=A010= 0=C2=A0 =C2=A0050=C2=A0 =C2=A0 Pre-fail=C2=A0 Offline=C2=A0 =C2=A0 =C2=A0 -= =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 3 Spin_Up_Time=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0027=C2=A0= =C2=A0100=C2=A0 =C2=A0100=C2=A0 =C2=A0001=C2=A0 =C2=A0 Pre-fail=C2=A0 Alwa= ys=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A02595
=C2=A0 4 Start_Stop_Count=C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2=A0100= =C2=A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2= =A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A01487
=C2=A0 5 Reallocated_Sector_Ct=C2=A0 =C2=A00x0033=C2=A0 =C2=A0100=C2=A0 =C2= =A0100=C2=A0 =C2=A0050=C2=A0 =C2=A0 Pre-fail=C2=A0 Always=C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 7 Seek_Error_Rate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00x000b=C2=A0 =C2= =A0100=C2=A0 =C2=A0100=C2=A0 =C2=A0050=C2=A0 =C2=A0 Pre-fail=C2=A0 Always= =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 8 Seek_Time_Performance=C2=A0 =C2=A00x0005=C2=A0 =C2=A0100=C2=A0 =C2= =A0100=C2=A0 =C2=A0050=C2=A0 =C2=A0 Pre-fail=C2=A0 Offline=C2=A0 =C2=A0 =C2= =A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 9 Power_On_Hours=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2= =A0002=C2=A0 =C2=A0002=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Alw= ays=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A039254
=C2=A010 Spin_Retry_Count=C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0033=C2=A0 =C2=A0128= =C2=A0 =C2=A0100=C2=A0 =C2=A0030=C2=A0 =C2=A0 Pre-fail=C2=A0 Always=C2=A0 = =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A012 Power_Cycle_Count=C2=A0 =C2=A0 =C2=A0 =C2=A00x0032=C2=A0 =C2=A0100= =C2=A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2= =A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A01263
191 G-Sense_Error_Rate=C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2=A0100=C2=A0 =C2= =A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0= =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A04
192 Power-Off_Retract_Count 0x0032=C2=A0 =C2=A0100=C2=A0 =C2=A0100=C2=A0 = =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0 =C2=A0 =C2= =A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0426
193 Load_Cycle_Count=C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2=A0029=C2= =A0 =C2=A0029=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0= =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0710616
194 Temperature_Celsius=C2=A0 =C2=A0 =C2=A00x0022=C2=A0 =C2=A0100=C2=A0 =C2= =A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0= =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A054 (Min/Max 16/65)
196 Reallocated_Event_Count 0x0032=C2=A0 =C2=A0100=C2=A0 =C2=A0100=C2=A0 = =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0 =C2=A0 =C2= =A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
197 Current_Pending_Sector=C2=A0 0x0032=C2=A0 =C2=A0100=C2=A0 =C2=A0100=C2= =A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0 =C2=A0 = =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
198 Offline_Uncorrectable=C2=A0 =C2=A00x0030=C2=A0 =C2=A0100=C2=A0 =C2=A010= 0=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Offline=C2=A0 =C2=A0 =C2= =A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A00
199 UDMA_CRC_Error_Count=C2=A0 =C2=A0 0x0032=C2=A0 =C2=A0200=C2=A0 =C2=A020= 0=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0 =C2=A0 =C2= =A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
220 Disk_Shift=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0002=C2=A0= =C2=A0100=C2=A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2= =A0Always=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
222 Loaded_Hours=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2= =A0075=C2=A0 =C2=A0075=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Alw= ays=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A010367
223 Load_Retry_Count=C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0032=C2=A0 =C2=A0100=C2= =A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Always=C2=A0= =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
224 Load_Friction=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00x0022=C2=A0 =C2= =A0100=C2=A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Alw= ays=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A00
226 Load-in_Time=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0x0026=C2=A0 =C2= =A0100=C2=A0 =C2=A0100=C2=A0 =C2=A0000=C2=A0 =C2=A0 Old_age=C2=A0 =C2=A0Alw= ays=C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0260
240 Head_Flying_Hours=C2=A0 =C2=A0 =C2=A0 =C2=A00x0001=C2=A0 =C2=A0100=C2= =A0 =C2=A0100=C2=A0 =C2=A0001=C2=A0 =C2=A0 Pre-fail=C2=A0 Offline=C2=A0 =C2= =A0 =C2=A0 -=C2=A0 =C2=A0 =C2=A0 =C2=A00

SMART Error Log Version: 1
No Errors Logged

The only thing that lo= oks high here is the load cycle count and maybe the power off retract count= . With
40k power on hours, that's a power off every 90 hours?= That seems a little weird. And the load cycle
is almost 20 times= the power on hours, suggesting it's going on every few minutes. That&#= 39;s higher than
I'd expect as well. The power cycle count is= also high for the number of hours. Your disk is pushing 4 years
= old too, which may mean its past expected life. So this profile suggests po= ssible signs of fatigue.

Warner
--0000000000009baec005eb29aabc-- From nobody Sun Oct 16 18:24:05 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr7n965lmz4fmv0 for ; Sun, 16 Oct 2022 18:24:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr7n84VVTz41Pj for ; Sun, 16 Oct 2022 18:24:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665944650; bh=31zG/RLKBCHB2GktVmBzzRsQrBkLCNUXVUB/9WRoIwg=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=itUMEUNwr3L3iJG7ik3hT9jTiy0GRFYYrZRN+TR9xD1VrCATWJPvMwP5N/o8DcClSB2Y0Wmlwpuo2qZ2KL3G03fRKRLRElZpMv+ch4Qh6Rm2Z6zRvW0PoCnKqkcuonoOF57UTBPhQM58qle7GuzQT8Z/bkd6d89ia+PjcOQvR1wV4Ymuu87HeUGI9qfUCozzogYrg1lQClihsWgfcnfLy7u+2WGc1fPW3XNkGbE6uErXKqyJWwDFcxUVGysy+XMSTC8J/5648sIKhsMZITpiA9VKvUucUZPfaCoF2sQDzdrTgwfhrxrpUF9cafqr3eByXC1/MvfCns+m9ERABNuacA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1665944650; bh=QqwyPobxrnsdzJhwn/VnrJ2i0XDqnhlH5BlPXlNRoZM=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=pVkrnmliQFw0MiFyOfeq+H2BmNXrtVwrbLetdG61xxRv633l2xM8p/h33mKqXK8/LTV4FysoVYDYJoFRTnluK/BQugSBeTgbAA7wm573/HIVI7NWk5RtDUUnYMQrIcISbYblsaiE54vQl2wdQNntFuwsBaCC0SxvkPrNNy0bm2WcQ00TpxALAhXd/ZbnUZDSnbAmd6NMWt/jeE0pF+p/TYyF2eFzf9n7IQLPfNpylc7fGnVMDV3ffTKIhk4+k0na04gWR9v6aR4XI9m6DIUV80hn4pLmyIqAdOBnwCY6Kn5Zxl05C3DeU4Z2JWND0xWWAoZWeNQBJKE1Hl7DPa+Kjw== X-YMail-OSG: c7wvOIEVM1l3oSfYkZqSUmJEUKwO0fbY4SVQ.OtPSkngvI5lUgg2pctIE.fco1H pOe1DXIv6gC5ZIT0BW7HrSKoywyhp_mMkXzSKpdKFELpQ3lG8F43uw6kxn5ykUtkWmBQLoYDXXqz mKwfQ9vETNGI3oGyiNfPIUf1VsZ1HTtTnrpC0BE5saHXlU7Et7rpd9QkSnRRkiAna1IQwDUy9G8e 97jMa0cgwS6ZKpIfP4a18.Dm5zGmLGdATFvDbj9w0gdYt7tP7bNj0e7C.Vpnfoo1EVttBO49mlau LxWMt7chuDFTd2BTe2t8Oy7OKRWCWhLQC_pA2PkkTgSWN62uQVMzYeFRTk3Znt0qMVke6yR1iqk6 OdJaKgbOLSWjU.n2AYe5kcPQuLkd36rKAw70BNNRy3D3NbYCxjBe3bhsvacz8FOj9Df4kEpPk9y0 t9daQpnLS8_TaiSEGdxJvJntzMLDddu.mo6fuVUfnX6mmBZNL.cWA9Z_Qezb6ymlixR2Ple7BmIs h0YiW5bs9qNGPMn9vOIJOygklMX.LRJnuaCIbd4h0jexOvweHbciooA2gMBn0UaeVUFg4xtlIPM5 tLAVsLWVx0XK4W8GRxhOWSmpnYPk02yMhdMaPXj5QFUDMOtMJBdIEVCALvfzSnZjnQXQmG53M45z eop8zJHykrOVpLK58hRu_AQiy7CIIN49S7JSNL1n9MlZ_dTzRIjC72bu61tsbUZL8uteMlLxc7Yx nL7zvpp7pOxctjSNM_GkYJX2.3Tlj4ykQXUpbjgXQ0s1tcaW8d0sxePOLtDSQXJEIMUgsUWTPv7R qcLIKhNzWkS3Ok5rIyZduNDxdUO3jekYXiSYzNX8dfL8B_CXSQ.eW3cULIAp9ul4_uVAi6z5V.YS IDHU.ZzgIJmmeb8SoZ8yG17sZINoZEgFrjX7zf76HrQTc6l4naWMufaWBSrLFOOc7hbOadQlttKp QYFRvwcCCoZajXp.vyDg_WsFVJntF1DmrlYayGpj8uPou3FhqKdIa7YgkYGewS4URl_NwGM4edUh LqykohcfzaZnmy25J.zNvNfAX4i75RnO2mFplM9MXREPsShIw8Wh7z2qGJHY3sWpyUqfG0nW3WXD wuUuncAcoAJ7Rf4xJmcetcId5GAaOasM6O1QJwOiSoT_ZPzzWcPOyjE7nyDivytm1WTuCx90HkBD Bt_B944EunvGIiW.oqaPlILeoBXL2plxrS7H8BGqmIlzSV1n6eAUO122wMbtoYC9TYOYPi9qTLoK DCdrSUQakFMc2GxY2YczzTk0x9nf71cNLBLQ8ujorR69KbJCvJ8PQXgL__aRQfrH4c031QFRgB2c 5X10fMAeAFhqZiTip5VYO0H1j5_bTF_L_FlJtWbMLtgcDcazDa6kIcuB7NsvxOoUHnEeH_JvxtdH bt8S_csdJOClrFWMBknCduuR.JP0X3jYf7bkwU8GOC.4RipUgb4mRYouwU3RJAXBAewv3Z6oF3Ag GyM81tCfH.MZISNIad23yN4.A5ymHKsQz8u140l2JmQ7AP71LyfNzyCgoQpts8i7QpAD4cQujJkj yxL4a054klkDlqZA41lsXQEc.PEKmHRvS16KkDesTK4smnWrbI3iQrJEIG0phCUDlxx5ThKFoUEl 7TEvqVPADX.fuMw.5Uzee_HLbHHepv3_2cYse0CqRcPXCeBW9HGv.XfOs92wCHw3qP.ltfgeRR4F .f.Ng1hxIil52SkaL.Opq_n3uGtcDA1uDyInS5SuDK_Yx1l9FI_M6lhAdZ7.qPO3I.FQe4xDPHOB 7.J8wkPml_Z8nUC6rSnlBYGwpL96m5aWgREvkDz3VjppRh6Np.8nYuRK61DXe8Ga2p3IR.oKRc0u gVN1FLit7WNrqckjw2yRYV_sJr8VZn5kH.MOb4W4sPnvxYvd0m1w2Bq5HuRVazkdvSANrOgiGhQQ GHGIivnpxPYFVxEDg5QvB6ghKGHrKBtVOEueoyAIpRcAkY0PO70EyMuvCNHISv_9ghnUo8Lx48Ta mNr2548OR7FMZfvuB5LaooXH9UqrqHP5tw7YHZ4xhzyc0g1Q0aW_VivHTlW5rvSZ7CSZ_twEMlyw fO94ecYbjhqueglktaz5WelHsKJXjVPdtk1gIVsfydU7lTh9g_NmjbfygSoFP7eq5f4mAZ1eHZzd B0r1uLqppmWhQkzhDe7CeEXU7yPxPaspdSEKuxVAexzKBo28f0zKIAgX8haVF6E6LBZ20Uc27Xdl dQKvurjJ7T_1OBrmXWsylg3X6HH_.re67o4PThMKePNTXG59M7JCrHK.su7BnEmgd2s0tJQg- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sun, 16 Oct 2022 18:24:10 +0000 Received: by hermes--production-ne1-5db649d989-tfbvd (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 94c3801d89b9741313b68e3da2c86841; Sun, 16 Oct 2022 18:24:07 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Subject: Re: zfs with operations like rm -rf takes a very long time recently Message-Id: <738D20C3-2F31-4869-B318-F1B30CDE3764@yahoo.com> Date: Sun, 16 Oct 2022 11:24:05 -0700 To: void , freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3696.120.41.1.1) References: <738D20C3-2F31-4869-B318-F1B30CDE3764.ref@yahoo.com> X-Rspamd-Queue-Id: 4Mr7n84VVTz41Pj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=itUMEUNw; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_TO(0.00)[f-m.fm,freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N void wrote on Date: Sun, 16 Oct 2022 16:48:39 UTC : > On Sun, 16 Oct 2022, at 15:42, Mark Millard wrote: > > The book is not explicit about RAM subsystem performance > > tradeoffs for ZFS. One property of the RPi4B's is that they > > have very small RAM caches and one core can saturate the > > memory subsystem if the RAM caches are being fairly > > ineffective overall. In such contexts, multi-core need not > > cut the time things take. (But I've no clue how likely such > > conditions would be for your context.) A cache-busting > > access pattern over much more than 1 MiByte memory range > > drops the RPi4B performance greatly compared to such an > > access pattern fitting in a 1 MiByte or smaller range --no > > matter if it is 1 core or more cores that is/are trying to > > be active. > > That's interesting; i cant understand the system has been in > use for 9 months or so without this performance penalty. > The OS has been updated on the following timeline > > main-n258595-226e41467ee1 on 2022-10-13 > main-n258157-f50274674eb on 2022-09-23 > main-n257818-6f7bc8e7a3d on 2022-09-05 > main-n257229-e9a2e4d1d28 on 2022-08-10 > main-n255150-70910e4b55c on 2022-05-04 > > cleaning out /usr/obj and /var/cache/ccache/* is something i'll do > periodically if what is required is a completely clean from-scratch > build. On at least two of those occasions I'd be doing what I'm trying now. > but only now this issue has arisen. Of course, it may very well be > the hardware. But all the things i'd use to monitor it say it's all fine. One thing we do not have is a set of before-the-problem data to compare against. It is hard to tell specifically what time frames have changed. > would output of zfs-stats -a be of use? Earlier you wrote: "Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max". For this context, the number of files/directories is likely more relevant than the total space the files/directories take. My experience with spinning rust tradeoff management goes back 15 or more years at this point, beyond certain backup storage use. Even backup usage of spinning rust is not in the recent past at this point. So my help is minimal for such. I'd guess that each/any of the following could produce interesting background information during the problem: # zpool iostat -w # zpool iostat -l # zpool iostat -r # zpool iostat -q ( See: man zpool-iostat ) === Mark Millard marklmi at yahoo.com From nobody Sun Oct 16 18:37:43 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr8506Rytz4fp5h for ; Sun, 16 Oct 2022 18:37:56 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f48.google.com (mail-vs1-f48.google.com [209.85.217.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr84z4xQxz42Fy for ; Sun, 16 Oct 2022 18:37:55 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-vs1-f48.google.com with SMTP id k6so9587710vsc.8 for ; Sun, 16 Oct 2022 11:37:55 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=qlPG0hIikdsTtosgPST7nOKf44WcXdZB/kYdKyoRN9U=; b=3avEqOnE8vqp3xHpp7SjKb71q2yr4p+ik136jdabevoVW/8oEOvlMiSTJCkS7LLiev xq4VlC2B/qkRPWstnKwfrCWUA8ySjbvxFm4NxlVfQPbvTQ4YBSUzUmYa8SrsxYQXhsH7 rDL7B19Xs0tx63Tpp+LrL2X0eLOyQY2KdVYTd/uJLc6GdN7RkG7qfvOseNLo82ePk031 1mQYJQeuzHtqgoSPonvUYZKHdAwA/3hsqHWngUaCYtfS/8A9Ge33W0AW/ahH4kSeNVg3 0lsBt6vcruthltdjeIQWKExVCCFouDUmLQyGcGZFafg04H/GhRkr3tA4uY9bpT17Cx1Q Dulg== X-Gm-Message-State: ACrzQf2jGr+7w08TCfnuWhQMIlEFohc/ua/cO0x+o3+h1Rjpmm+o5cNm zwdm2Uqmcsw4/UADOH4KWxRrSV+rVAwAwKvJlFRLy2rYsIg= X-Google-Smtp-Source: AMsMyM5oCVNwM90O4SVOv+Z3/ZafBWezDBG2iXb9VRftX5Y53vko1iOf4MYxB9F/lz3CJep28tmCVSWdJtEguz1F8bk= X-Received: by 2002:a05:6102:2908:b0:3a9:43be:5e44 with SMTP id cz8-20020a056102290800b003a943be5e44mr2764297vsb.74.1665945474991; Sun, 16 Oct 2022 11:37:54 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 16 Oct 2022 12:37:43 -0600 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Mr84z4xQxz42Fy X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.48 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_TO(0.00)[f-m.fm]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.48:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.48:from]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sun, Oct 16, 2022 at 7:57 AM void wrote: > > Has anything recently changed in -current that would make file operations > on zfs such as rm -rf *.* very slow? > > What would I look for and how would I test it? > > system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on arm64.aarch64 > using GENERIC-NODEBUG kernel. > > the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be plenty > of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. > > Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and it's taken > over 10 mins. It was never this slow. No errors in /var/log/messages and none > yet in smartd. zpool scrub last ran successfully 3 days ago. Do you mean that the space used by that directory is 5 GB max? Or do you mean that you have a /var/cache dataset with a 5GB quota? In the latter case, if the usage is close to quota, then ZFS can slow down just as if the pool itself were nearly full. -Alan From nobody Sun Oct 16 19:55:21 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mr9pN3W8dz4fxg1 for ; Sun, 16 Oct 2022 19:55:24 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oa1-x33.google.com (mail-oa1-x33.google.com [IPv6:2001:4860:4864:20::33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mr9pM49vpz47lW for ; Sun, 16 Oct 2022 19:55:23 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-oa1-x33.google.com with SMTP id 586e51a60fabf-1321a1e94b3so11410799fac.1 for ; Sun, 16 Oct 2022 12:55:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=HwzsCQr91gQYkeUNrzxCra7gg1FZzmXEPqjZ9lJIcOc=; b=E7N+HPuI5S80TGA5/FWluRw4f2EzKMYhHssUS9+fpbplzDYv0sZ9ClNx1BHU8cZCkh T8QmxKZXsSoF25MKJNjzfVHyeqILOjj4vBqe2812FrqjHxNlH5pxiLm7RAdW2aPGFkOI hkynoCUezRsYO0uSMJvcWBnmZ77nuRxv0kXTjkOQbLbZMvcAQpoVBN2uMj4N9d/HE93Y a8jQyJSfvdrsqXc85A3iEvj5211sLwxxQO2lWJ74Llqxgz98DCSADSjujYFhVC1FiZzN J612nwOFy0TN+U1vjd0oM7WM1xYlMA/UnbYqrJsmyW4RR9BkthbycF+YSNcDsP5LWXl0 ZGug== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HwzsCQr91gQYkeUNrzxCra7gg1FZzmXEPqjZ9lJIcOc=; b=AWEhH6qHfP0KLJMiYGona5P1vGaDKeaSQslN0FvhOrb1p+K+TrA8MQR46g/qLlUiqR Gi1VpI5zwK+Ax6iIM5fm1EL8FUAl4qy+l1ls11oGArXs0l4I6P/loO6d4/8OXEMCoMsD 5mLiOQCpeyVIxWL9SfQtFTVIjjZxTQbP7BYFKbek1NLt01t8AIrDuohcr7YkdZRMK//r vfaMrZPxV3P4LGH+dZjq1xSOBjKX6DTvJkfVamZHRZHzXyMHHtF8Yt3cClsSummJdSwA sseqFWMYZIzLXY7nT9+LOYITmnwbzSox9nwuwbALKtDB35JloW9dbrzH08RmZhzLBWBE e87A== X-Gm-Message-State: ACrzQf1sCwUw8gmzKWqXKZe0OJ8NRWFNx7MRo6JeF77DnwFGINdcRaIo 1pA6ebS7EJjr8pfzmpDUtz5t59rj+27lawpcFsk= X-Google-Smtp-Source: AMsMyM6he4+GGWP9n3Lv9Q/gQbUSpO1NChIQNunixcnytiWUjzMvrtC0jW+Wzciq7zkui+SH5QYnrMj44a0QNBOjPXI= X-Received: by 2002:a05:6870:a7a4:b0:136:7c39:979e with SMTP id x36-20020a056870a7a400b001367c39979emr4174106oao.96.1665950121894; Sun, 16 Oct 2022 12:55:21 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:351:0:b0:478:5e54:a9c8 with HTTP; Sun, 16 Oct 2022 12:55:21 -0700 (PDT) In-Reply-To: References: From: Mateusz Guzik Date: Sun, 16 Oct 2022 21:55:21 +0200 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Mr9pM49vpz47lW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=E7N+HPuI; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2001:4860:4864:20::33 as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2001:4860:4000::/36]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2001:4860:4864:20::33:from]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_TO(0.00)[f-m.fm]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On 10/16/22, void wrote: > Has anything recently changed in -current that would make file operations > on zfs such as rm -rf *.* very slow? > > What would I look for and how would I test it? > > system is FreeBSD 14.0-CURRENT #5 main-n258595-226e41467ee1 on > arm64.aarch64 > using GENERIC-NODEBUG kernel. > > the zfs is zroot on usb3 on a raspberry pi4 8GB. there appears to be plenty > > of resources. cpu speed is 2.1GHz. zroot is external usb3 hd. > > Right now it's rm -rf-ing /var/cache/ccache/* which is 5GB max and it's > taken > over 10 mins. It was never this slow. No errors in /var/log/messages and > none > yet in smartd. zpool scrub last ran successfully 3 days ago. > > last pid: 4324; load averages: 0.17, 0.10, 0.12 > up 0+02:10:34 14:40:55 > 77 processes: 1 running, 76 sleeping > CPU: 1.6% user, 0.0% nice, 1.9% system, 0.2% interrupt, 96.4% idle > Mem: 550M Active, 803M Inact, 2224M Wired, 40K Buf, 4239M Free > ARC: 1293M Total, 381M MFU, 725M MRU, 1124K Anon, 30M Header, 156M Other > 938M Compressed, 1906M Uncompressed, 2.03:1 Ratio > Swap: 16G Total, 16G Free > Process id to show (+ for all): > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU > COMMAND > 3871 root 1 20 0 12M 3648K zio->i 2 0:10 0.39% rm > 353 _pflogd 1 20 0 13M 2108K bpf 1 0:00 0.00% > pflogd > 1441 mailnull 1 28 0 25M 9508K select 3 0:01 0.00% exim > Just in case, can you test with this: sysctl vfs.zfs.per_txg_dirty_frees_percent=5 As in, can you repeat the test multiple times, flipping vfs.zfs.per_txg_dirty_frees_percent between 5 and 30. -- Mateusz Guzik From nobody Sun Oct 16 20:12:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrB9h3FpNz4fyxd for ; Sun, 16 Oct 2022 20:12:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrB9h2DLvz3FBR for ; Sun, 16 Oct 2022 20:12:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrB9h1HYWzZZ5 for ; Sun, 16 Oct 2022 20:12:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29GKC8u1022456 for ; Sun, 16 Oct 2022 20:12:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29GKC81M022455 for fs@FreeBSD.org; Sun, 16 Oct 2022 20:12:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sun, 16 Oct 2022 20:12:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: arielmt@thornton2.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665951128; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dDrUugjt+dnKQx+MAhPV7cM8o4jDgEtFkFVYiLVDU+A=; b=fkxC6qqPal31RYtc6GpEw6YfLIjq9F7r988v67QfRrZVBClpquTTcSQZtV5n4a1qGKBjWG CkiYPpZTOJpRb02UOe6l5M5lLbuS8YRVgblAhnyVo5u0aBQmLV+SzUqMAhF7jmVTdrmE6k csYhqM3eyOEPq9zppXYFxkRFKFg0MakR6jPG9426UfEWPuDGjcr9YdsHsJaH9YGkoVxQrG HKHwMY0Eu4q1/QtKHJzfQVsDi9KoAtqaIbd9j5+SdC+Pos99DFmVc7pyATTRUNXNniok1f jz/xGgttMwpU5rEG0hRMTb06QV44cvkXlHCaU8QqJgMSExhTErgxl4qYr2boWg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665951128; a=rsa-sha256; cv=none; b=F5SAKx99nVgMFpJP6l3u2vuM9Zql40+s45YOV4HgNcL9wgx8dLDgbyDuRgXPPOFRNosJXU 8Osq4f00+ZRJ0iuIMcVHrWRlnxiEYVs9P+EvQtx1diTWW3f2sqt9vjoZYz8/6mlRHvm+35 +41Ecbcxni+O5CFwLsGcGG1/h7R3ID1xddvIBZjH7Iu22rIdzN+lklOOSIwqvuBKw6hr4E 5ycXvFFdfIQ+S/rxm/JeK4FtOdFtX8plt0aMyWOOY97Pfloc7PnegNxpEJBguqIgr/257+ oc1F5ZTdacg7HdBXqcG2eXg3coj1wX4m2V8UUe1aAdoRrj06rzvUXOnG7txWIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 --- Comment #6 from Ariel Millennium Thornton --- This may have been a corruption in my pool instead of a bug in zfs. I found that the only snapshot in my zroot/var/mail dataset that didn't cau= se a kernel panic when destroyed was the most recently created. Destroying every snapshot in reverse order, from newest to oldest, was successful. After th= at, creating snapshots then destroying the oldest snapshot worked as expected. I reenabled my zfs-auto-snap cron jobs, and their `zfs destroy -d` actions = have so far all been quietly successful. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 16 20:20:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrBMY1bvvz4g0kj for ; Sun, 16 Oct 2022 20:20:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrBMY0MZvz3G2Z for ; Sun, 16 Oct 2022 20:20:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrBMX6XrlzZL3 for ; Sun, 16 Oct 2022 20:20:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29GKKecC027554 for ; Sun, 16 Oct 2022 20:20:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29GKKeq2027553 for fs@FreeBSD.org; Sun, 16 Oct 2022 20:20:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 216586] zfs panic: sa.sa_magic == 0x2F505A in zfs_space_delta_cb() Date: Sun, 16 Oct 2022 20:20:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665951641; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=occVZmCucNGAKpTIwAA5ydpJWI7a7Dve+iv7ZRmopH0=; b=k1tC/VTOJ4g99Ah2aMU4UWlAkG1FnEFfH/ADPiBxTyMi5ttWQhh0r8p4j+oKHh4JTfzYOI x7hIKk9YthxIwMaaWwSdAugGeyGeR6ZGw/F1au3b9KLmQGjP+5s72gzVTC69sGAh7bf8re K8xsio4jkqAbr+WTorAyWuFzZiYEUNmhA9OZRfqKMpu9Wlo/XS+5J3iUo0reojj1UDQlJm VBKlnzfEy7hwDeW+YPBQsTf13AcEUa/zgFN5hJf/UE9ZwkCg0LcrUPvUtTA/HB9LbFV/+y WXmnSDiOfjXg3vlDVYiD9mG0F5zCInDNTd8dHB2HkcBabN6Yi/qRtobk/k6lgA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665951641; a=rsa-sha256; cv=none; b=bLiS0VCEEe/lT3zcTrUQgNuTfVjw2RtNMXNJxze/VYa274MmDyZujp5CH6GgnWp+NOcS06 M+6iGaLYg4BPVIRUFchHGtSt0pJlDWXUrkEkmxacUHV9E0lQg3kKRNZxg0yefo8Aju+xSa eLrbhjO/bckswe8bIdsutFQrsBOxpms+wIzLySkPGVJVv3GTKU06ecdZatssp+p6kDyBzw u9meP/NWf8dEQ/KhcjkyzfAiV5ZWTwzI4KPeePQCI0Fcj9ckq7nHwSrTUHJrwL+KTcZRHU GgUxyRkght5udPV51dQeeVvkjKZyUJX/EqLbNrBSfgI6WbLtiICyvej6AooqtA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216586 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 16 20:28:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrBXh67xhz4g1Sv for ; Sun, 16 Oct 2022 20:28:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrBXh57vNz3HKx for ; Sun, 16 Oct 2022 20:28:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrBXh46jPzZtH for ; Sun, 16 Oct 2022 20:28:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29GKSaZi040906 for ; Sun, 16 Oct 2022 20:28:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29GKSa49040905 for fs@FreeBSD.org; Sun, 16 Oct 2022 20:28:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Sun, 16 Oct 2022 20:28:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665952116; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e6gifaDE4/4F+5MhmySVaVDFQQO0H3ACCu/UBlzzhBs=; b=T2df3FlFIPFjNDC9nX7xaNioaMNNQ6PaSNOzRXFTcxnxAck+ZksfU7ArQ78Jn022LXfirs mq7GPR/5DqzoYokFkqgvAEWTgxNm+PN21XDovRAESBT48sdt40KIyF/rjHKmYIlbuWFdqM SQspE2EvQ0COKq94915q11QHhRXf/JkCeqayMgfH6nC64IVvYJsqFDpxxRPJgjnDIm4p4u dOjgleJjbmjyGAe+KlQZ4jnslCebMhRSevjDuE9VM4ne0kjo6Gsu7vCMEiSYawK7nelXux Nk9k6ErcGYxJplH9pr15Rj1Z5+hXCPl0BVgz6OLT6h9E0tV2smLscElu/74VSw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665952116; a=rsa-sha256; cv=none; b=ruyvqMG8ZjGS2me61YkPrtS+42mVce1BODfh4BBkTEUjKCyxXGziyMNw2WmkaNjUQRU/pI +TMQGywKTuhcHIi8WCBbbrZwIQz8rRSzAeTEfK5bBF9rr6Vw161sIRCoLxesg64JOLHDMN zJlmcB6wNl2uQXWe4SKIkfVsrWfI4cR2GvjUxohwIrIE6UqyV0T2r0TMbKNmu3VUCam3pv RPmDmiCfSDLwNxE9RpmKhcC0l+JhP7bVZhBwOmrUXJuR+SG4w9xtqzwXBPxevRSgzyTPZ2 OW/aFwpoZTz7j7MWSs7LXye6KpVprBHphee+HH53dUeFv3x1OC8NS/gRViJudg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open --- Comment #7 from Graham Perrin --- (In reply to Ariel Millennium Thornton from comment #6) > =E2=80=A6 the only snapshot in my zroot/var/mail dataset that didn't caus= e a=20 > kernel panic when destroyed was the most recently created. =E2=80=A6 What was the date of creation of that most recent snapshot? Now, I'm reminded of a ZFS snapshot-related bug that (if I recall correctly) was fixed in recent months, however it was impossible for the fix to be retroactive =E2=80=A6 something like that.=20 Annoyingly, I can't recall enough details to identify the issue/bug, to tell whether it relates. Anyone? (Is my memory playing tricks on me?) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 16 21:00:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrCF36qlfz4g4QF for ; Sun, 16 Oct 2022 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrCF34r5Nz3Lfx for ; Sun, 16 Oct 2022 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrCF33xwfzbBX for ; Sun, 16 Oct 2022 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29GL075k074726 for ; Sun, 16 Oct 2022 21:00:07 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29GL07A8074725 for fs@FreeBSD.org; Sun, 16 Oct 2022 21:00:07 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202210162100.29GL07A8074725@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 16 Oct 2022 21:00:07 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16659540074.BF5FAB02.73213" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665954007; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=HvQwO0nOAMvYg/Z2rALWBJYA+si3kVUj1kQuabcX8hU=; b=t9L7C5ROtcRG/++lezXK4N46bP4+7UHQWDnHnNXevldp1JFeq7kwu0g6/BvqElkX4ZSfM9 6k5XB9UDKlb40TFSyGGNaemP//4VK/eKn8VIMUwMh9m8HFJRSmNUmoQsA0o6yDr/t5Geay yw3gGINEWZezcdVyIXFHxJO3nM+U0HM+z5APTKaBEhwDQZs1BLGeGjyhqwnjz1B1yXHCji nKGVPcGnOr+3/ChuRmKXSG59nNstq8ERtxZuTnRW2TRpOFEO+ibztJw2Aji8ejBHxFfMgE GnzxRy4+bQeGeuYHOkvaSac9PDZEEBZj1V8CRliECA1Nxecvu/h3MuR3XD62SA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665954007; a=rsa-sha256; cv=none; b=S1CSUrQ7Y1Dq/YwXB5lAWMgggwpASxG2jf2ks89MXv2hJyLV0YyVZ3FOM4uUPBFhT0p0XY M9D7E8/1YbDnIjxTga+WjoYJbpDL+xW67YmWti2lgpVeDxIQ+HG6QVJ1J/dGx/3fq4F2Zs eyREgcX2hIiwH+q4E3cajYIHi6MxHz1BjcXR/HB3t13lTCwNu95frH/zYZsvk8PDnC4cUA SMvqSQwBDV2bpAPNcKIDbxUcHZbIfat7eGDEwHKQlO+nC5QK7lg2Fn1oXhYf2o6b2AOh0O 7jaOkUMqIlPtpp47g92vX8m0WzjVWQhEgg/96Wnm/2xWkC0WcpiHiJ+KlIwbJQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16659540074.BF5FAB02.73213 Date: Sun, 16 Oct 2022 21:00:07 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16659540074.BF5FAB02.73213 Date: Sun, 16 Oct 2022 21:00:07 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    244899 | [PATCH] zfs: xattr on a symlink target > 136 caus
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16659540074.BF5FAB02.73213-- From nobody Sun Oct 16 21:53:31 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrDR744kNz4g9vg for ; Sun, 16 Oct 2022 21:53:55 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrDR63lSdz3VNv for ; Sun, 16 Oct 2022 21:53:54 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id B48833200583 for ; Sun, 16 Oct 2022 17:53:52 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 17:53:52 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665957232; x=1666043632; bh=B9+moIHvBB anYZznMjuq2flXDBg8GInI1N0dwql/0YA=; b=ipGUvFgYUmHB2h6iOS7IeZgKPP fMjIPZnpxmS0Zj06kNS+OF8WDIyWISZM5QoWKv/OBJyYZPg/OwQ8kiLmP3N+ruNZ wy0AJ3Tglqg078It7bIytbHMsl2cHaxULH9GeSQX/nkEmDWI3Bt1OELGkEV5VSAK nLP4IpyF1utnyXTyIwM2mUfpWZ/bhOyc+oYnwgRBJX8WydHI37WvoKctC6owarcY zOOodTR0I433GngTgUefZsfTGl8Vy06bsXLduxrwCffqDDr8fRQxNEDNAQMDzMsZ EK0DNNEn8HsMze4d50avE0gvP+hQaGuxIlrLuRl+jzqYsmHxdxKkBPehhq0A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665957232; x=1666043632; bh=B9+moIHvBBanYZznMjuq2flXDBg8 GInI1N0dwql/0YA=; b=EXmBzEeEKg6KOgSLASixqZsMKa72TsyCmx1t/Nx322KS MCt+Kd+rrvbhUKwXLeoe4gdDemFnnjIkOwH+3jAhm0oeO1vyIcaWGben5OKRroja zvKCrf54+HHTbs64MMxSmHJQ6XB9w2OS/f1vJDg9POkRWsy4xhlvllaTJSmK/V89 wYJrbv5ORy6HDKYaueJfZqoKjH/yYVxk5LiUxkRJ7JgVVc9oXnGwoleq809t9LOI PBgfE/BYoxVFssP6PnddCLhWwWHqJD6LZObP1o4yIAnWTQLaZJ6IfyMMlZHNwEob JnR+kbSscCZ8I5W9K2sX39UOWZGDh1pRN9iOEL9zow== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekkedgtdegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 21E912A20079; Sun, 16 Oct 2022 17:53:52 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <528a0bcc-6bcd-4d66-aeff-273542deb21d@app.fastmail.com> In-Reply-To: References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> Date: Sun, 16 Oct 2022 21:53:31 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4MrDR63lSdz3VNv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=ipGUvFgY; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=EXmBzEeE; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.19 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.50 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.905]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 16:51, Warner Losh wrote: > The only thing that looks high here is the load cycle count and maybe > the power off retract count. With > 40k power on hours, that's a power off every 90 hours? That seems a > little weird. And the load cycle > is almost 20 times the power on hours, suggesting it's going on every > few minutes. That's higher than > I'd expect as well. The power cycle count is also high for the number > of hours. Your disk is pushing 4 years > old too, which may mean its past expected life. So this profile > suggests possible signs of fatigue. Thanks for the explainer. The disk is a dedicated ruggedised external disk. Before it was used in a stationary context with the pi, it'd be lugged around with a netbook or laptop, hence the large number of powercycles. From nobody Sun Oct 16 22:02:39 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrDdd6HDlz4gBlN for ; Sun, 16 Oct 2022 22:03:01 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrDdd1rdVz3WST for ; Sun, 16 Oct 2022 22:03:01 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 20395320016F for ; Sun, 16 Oct 2022 18:03:00 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 18:03:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665957779; x=1666044179; bh=8A7FEgkc9e MYMXM8QsQYMBkSQARTeXDadhLIbbhY+iY=; b=ZMYWV7kDo8pL4G9pD4PuHb11tR pssc6joXzCleJWt+4PCcKb1gO/FwMpD5uclEfzQ52leL0UmHth/RrhU7Ngt8GdnS dPJFmxRWwljC9xj1hNaaDeTjR7qkEoQS+26uRbnMiOZpWiK52k3Elc42CTk+KyC2 ihev9UIPNHTsBuZ3AvU2rD3cq3MaXgMI03WGavROStaMP1LG+vna/4epxw/NyG6c s5L7FLZe3A1BnL8/nJ6IH0X0wi9k1yQa7QyMUPsq2mLZdJwlAnZc5m0sag8ZdhRB PfHUvsaLygZMfpz/mACGC1bgVxFGuMFoXmAoR1ad6UWO2iFeUZUyoahWI0mg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665957779; x=1666044179; bh=8A7FEgkc9eMYMXM8QsQYMBkSQART eXDadhLIbbhY+iY=; b=DEMTEHkeLQO6GMrWADn03SjarEumDWWF/LNAb7Nc2z8o skLZrlygeIhF7Vl4pVtptF3k/qjJJ2cXsf84S+stA5ZqXUATP2vbSlwDsN0m8Hcg x3b0J3/7jvHuSRW9vtaWHRCiJF9E+q+kW+utZFxlGIcHEOc3Q0B291UO9NogXZba ETVMRyuhBZlqt+650JAadKmwuDp0u5UvV7JkDYrsDCwgmfarpA4ekxScbm6/1dYA 1kP94Yw+eR+wq13ACWdU9Fc3kyCnvV1fJQ9AFhKQBJmteT+LqWNzpdSCXjX5a5VA 65NAcqgYRrbLg6RvdVYf9l4mJNhyIjQWsW2i7Z3lqA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekkedgtdeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 7E5A02A20079; Sun, 16 Oct 2022 18:02:59 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <76faacf1-6307-47af-adb6-200486d63137@app.fastmail.com> In-Reply-To: References: Date: Sun, 16 Oct 2022 22:02:39 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4MrDdd1rdVz3WST X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=ZMYWV7kD; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=DEMTEHke; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.19 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.50 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.908]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19:c]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 19:55, Mateusz Guzik wrote: > Just in case, can you test with this: sysctl > vfs.zfs.per_txg_dirty_frees_percent=5 > > As in, can you repeat the test multiple times, flipping > vfs.zfs.per_txg_dirty_frees_percent between 5 and 30. After setting this and starting the rm -rf, it completed!!! before I had time to set up the other tests :D Maybe this'll solve the problem? thanks, From nobody Sun Oct 16 22:07:00 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrDkG57qsz4gC2l for ; Sun, 16 Oct 2022 22:07:02 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oa1-x2f.google.com (mail-oa1-x2f.google.com [IPv6:2001:4860:4864:20::2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrDkG0g86z3WrK for ; Sun, 16 Oct 2022 22:07:02 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-oa1-x2f.google.com with SMTP id 586e51a60fabf-132af5e5543so11554666fac.8 for ; Sun, 16 Oct 2022 15:07:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=/7jVyhOoKphFDQ/YwB459pNuoaNCKM4mDjRmNIsov1s=; b=YZ76ueYO2mtBBhXjLUocG9FWYx90lQXqENxtrFOTjKTToL7D3rWcXtMJbJdd6TCipY zlPn1734fUE9WMFKauGJkEUFJpWJ5fclwmyS5VHyBl9lw/0cIY1nSt7MUPf+pfKcMv/p 7EYyPFuc6l+8kpkYsTYlH5YvTfIDjYLUzlQzLCAP9afO/t5VvZKnSRHHa4VE/gO2hIqm FQGwqYKV0qUnHNOz/n+YqkgVsgKsNZTT9UNcpd+E9IOqqdIjvnUcvQflrGAO0AzWRQF6 +0lIxT3ZoEHIVYJ+c5Su9TBpfEUH0o981KOD2qPi6MGYo3o8+PsTUNKoRKwEoXAb+pw1 Aedw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=/7jVyhOoKphFDQ/YwB459pNuoaNCKM4mDjRmNIsov1s=; b=5Dj7e8kS/x48TtmJc58bvgWIgpdrTuUeYB4sSRJ3WnaFHUM47u2EiDQ25Gm1z+MsFy i5ca+6LwB2bV6M3+9iyo+2QZaJayKXENXa+J4QGKgZWE0Oas4VSwFlsR3TllsJrIr3PU AOp0ESYEhkthEkfAFDllfsIYmVaGKDbkMMgUbed/ekAaI5n2RN5nhsHq3DSYsqCMYg21 x8+wGksZUwTCl4ETrm0uJ7Rs95MICAcxq+drJ9OxVqrmsdsT3YjEo0BLYsBVnljfpR6Q ToI0+8BAKl76sqQShlXbR+pGumDVu87E0raRvDZ4jnKPwtQT5aTlaqkf7qWayev3pP/6 UjEA== X-Gm-Message-State: ACrzQf3k2exzGbLsQZIyBdvg25gJ+P2dvOmf1su0YWlyUyadOPpb33GB PU68t7dtONEvN4PTgD6/4hJWXmocEhKDw4wWTISD4Jwu X-Google-Smtp-Source: AMsMyM6hjg/d71n+xG6eNhI/YGN+OBkDTqC/iDChnJ/Teg1qN98h+6EMJb7bOryx2BGyd5Osm8OrM33mtXLFAipzRlk= X-Received: by 2002:a05:6870:a7a4:b0:136:7c39:979e with SMTP id x36-20020a056870a7a400b001367c39979emr4323301oao.96.1665958021251; Sun, 16 Oct 2022 15:07:01 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:351:0:b0:478:5e54:a9c8 with HTTP; Sun, 16 Oct 2022 15:07:00 -0700 (PDT) In-Reply-To: <76faacf1-6307-47af-adb6-200486d63137@app.fastmail.com> References: <76faacf1-6307-47af-adb6-200486d63137@app.fastmail.com> From: Mateusz Guzik Date: Mon, 17 Oct 2022 00:07:00 +0200 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MrDkG0g86z3WrK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=YZ76ueYO; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2001:4860:4864:20::2f as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-3.69 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.69)[-0.691]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2001:4860:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2001:4860:4864:20::2f:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On 10/17/22, void wrote: > On Sun, 16 Oct 2022, at 19:55, Mateusz Guzik wrote: > >> Just in case, can you test with this: sysctl >> vfs.zfs.per_txg_dirty_frees_percent=5 >> >> As in, can you repeat the test multiple times, flipping >> vfs.zfs.per_txg_dirty_frees_percent between 5 and 30. > > After setting this and starting the rm -rf, it completed!!! before I had > time to set up the other tests :D > > Maybe this'll solve the problem? > No, it was flipped because the smaller value was causing a performance problem the other way elsewhere. This needs to be investigated. > > -- Mateusz Guzik From nobody Sun Oct 16 22:06:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrDkR1dj4z4gBy2 for ; Sun, 16 Oct 2022 22:07:11 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrDkQ2gKXz3XBl for ; Sun, 16 Oct 2022 22:07:10 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ed1-x534.google.com with SMTP id m16so13616612edc.4 for ; Sun, 16 Oct 2022 15:07:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Bjm++Kn1kbXsl0yMy/th97Xdh+Zr285bW2RAVuoqht8=; b=jbwDyjszjn1/GOxgqVFy3i+Mp++pGoD3m/JEPCR031FSe02B2mrY9RonkqxH3Moqij Z42c7C7NkjBoOwJ5Vnr4eGSZxoxITTaYvmGycswMgvhU0p8Wh9K7ZvBWUgIWfSZLyqA/ v7QR5X3BtHD4XJo3oEWvWYrisqqoVsZFL1EAPUlNKP3o3BVCGhQmQ1l2+bA+Pc6Ko6de T+RR2dvNoecGsjLjFgiUPTUvtMgX6IGzo1OZW6dMePzslnuYoGHBriSkDbaNRXQUk48S i+WvyYVUGG/2Gr8I3Gf/UnkPpnj+gFrIYOj1sr/ST+nESf+KBTHrD2F6fVMbZ+V5NJFn Z4tw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Bjm++Kn1kbXsl0yMy/th97Xdh+Zr285bW2RAVuoqht8=; b=ikhCoWcACxigARkv5xWMLgrXh+dvh4uU2BcthgWQ+ZEULjX3erdH2rlucSlgnbkSwv W0s+7YH03Ku3eSkxAWwKZQ3UjzCCZyNoWfvzMiv3o8r+mZNnYbOkVLX+Da0I5CoOeB6B Tf4rRfm5t0dhsK62vUjMXrm3ie9MVvJHAc0DdhSwgBpy6wdkOulrNodhbh90T4nCYEoV 80ZOhGb3Sa9ci2fVXPT1RbRM35z2dHqBpeEfmW9kC3W2vIiFUfwSEet7FFQ0ljZhSGeg vNsVJMfD4V8mgINN820pBzycrKAm80WOJrpGtr/2E2J0q/jKRcZfHz/dqNzMoD1GARSg YLeQ== X-Gm-Message-State: ACrzQf3y4vDL+sphnaZNV46v0VDzVs32fU2yaRyEhiPqqEB++D4S8d4I WnHAYFW3NTEPoclLyigDYDfIG8up3dBXU2UyArGElA== X-Google-Smtp-Source: AMsMyM5JdrP2IGQO9QTbhdkSgqnwWfDClB+kmWoDsk6pfZL10BgXgqzUPQUaomzY7JrgiECyk/WcKQpf4vIDDl/XZZM= X-Received: by 2002:a05:6402:4312:b0:45c:c1e9:9dc8 with SMTP id m18-20020a056402431200b0045cc1e99dc8mr7654602edc.154.1665958029077; Sun, 16 Oct 2022 15:07:09 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> <528a0bcc-6bcd-4d66-aeff-273542deb21d@app.fastmail.com> In-Reply-To: <528a0bcc-6bcd-4d66-aeff-273542deb21d@app.fastmail.com> From: Warner Losh Date: Sun, 16 Oct 2022 16:06:58 -0600 Message-ID: Subject: Re: zfs with operations like rm -rf takes a very long time recently To: void Cc: freebsd-fs Content-Type: multipart/alternative; boundary="00000000000088c32405eb2e1423" X-Rspamd-Queue-Id: 4MrDkQ2gKXz3XBl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=jbwDyjsz; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::534) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEMAIL_TO(0.00)[f-m.fm]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::534:from]; DMARC_NA(0.00)[bsdimp.com]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com] X-ThisMailContainsUnwantedMimeParts: N --00000000000088c32405eb2e1423 Content-Type: text/plain; charset="UTF-8" On Sun, Oct 16, 2022 at 3:53 PM void wrote: > On Sun, 16 Oct 2022, at 16:51, Warner Losh wrote: > > > The only thing that looks high here is the load cycle count and maybe > > the power off retract count. With > > 40k power on hours, that's a power off every 90 hours? That seems a > > little weird. And the load cycle > > is almost 20 times the power on hours, suggesting it's going on every > > few minutes. That's higher than > > I'd expect as well. The power cycle count is also high for the number > > of hours. Your disk is pushing 4 years > > old too, which may mean its past expected life. So this profile > > suggests possible signs of fatigue. > > Thanks for the explainer. The disk is a dedicated ruggedised external > disk. Before it was used in a stationary context with the pi, it'd be > lugged around with a netbook or > laptop, hence the large number of powercycles. > OK. That makes perfect sense then. For a server drive, that data is crazy and suggests a drive that's been abused by flakey hardware. For an external drive like that, it's not terribly out of the ordinary.... The disk is quite busy and performing decently well for the load... The quite busy part I see others are trying to explain and/or diagnose, so I'll leave them to it. Warner --00000000000088c32405eb2e1423 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Oct 16, 2022 at 3:53 PM void = <void@f-m.fm> wrote:
On Sun, 16 Oct 2022, at 16:51= , Warner Losh wrote:

> The only thing that looks high here is the load cycle count and maybe =
> the power off retract count. With
> 40k power on hours, that's a power off every 90 hours? That seems = a
> little weird. And the load cycle
> is almost 20 times the power on hours, suggesting it's going on ev= ery
> few minutes. That's higher than
> I'd expect as well. The power cycle count is also high for the num= ber
> of hours. Your disk is pushing 4 years
> old too, which may mean its past expected life. So this profile
> suggests possible signs of fatigue.

Thanks for the explainer. The disk is a dedicated ruggedised external disk.= Before it was used in a stationary context with the pi, it'd be lugged= around with a netbook or
laptop, hence the large number of powercycles.

OK. That makes perfect sense then. For a server drive, that data is= crazy and suggests
a drive=C2=A0that's been abused by flakey= hardware. For an external drive like that, it's not
terribly= out of the ordinary....

The disk is quite busy an= d performing decently well for the load...=C2=A0 The quite busy
p= art I see others are trying to explain and/or diagnose, so I'll leave= =C2=A0them to it.

Warner
--00000000000088c32405eb2e1423-- From nobody Sun Oct 16 22:20:41 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrF3R3DPTz4gDRw for ; Sun, 16 Oct 2022 22:21:55 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrF3Q6RlFz3Ych for ; Sun, 16 Oct 2022 22:21:54 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id C095832004F8 for ; Sun, 16 Oct 2022 18:21:53 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 18:21:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665958913; x=1666045313; bh=rEDhLvUrM8 wofSeTARl6W0jXDeHVDxLIUCYfuv2y/cQ=; b=jYTV6JuvTl8wHK4KkycU48oSsm wWH1+sOV9k15jNiGKkacVra9/sNJtgaypWOxQHz7BwNOTcGCNucH7oIS58n1IQDN OU2Y5YGQOKpsDatK73crydfxYNwL+Yq+jI2CmDfF7S3k8Z53MfKaY935rzYhm0aI scPlQuvze6o33eKhMjsfHVoCjJR2uTbpWH7WQjWB4bo1EUa2oaG+YZ1qhPut5EPk +9J7B8qU+8TDl/5plqS4iBwJbcU2ftGPnquqIhkkOGZLadoW1nNk3Bl2tD8azCMw Wr+/bbJBAjZUVIsmb+utOvvImfmzTD5JcwB6GcfoWU0k9hRMoirrQumLzoxg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665958913; x=1666045313; bh=rEDhLvUrM8wofSeTARl6W0jXDeHV DxLIUCYfuv2y/cQ=; b=H6M4JQ7lV/bmdpx7nQEZsPRyc6b3LYmUonEzBnfphcXm zVxL2RwRBNLWmjWLDNyPNQiN61UpXz0Q9ZIaiHPfBOSzqcdJ18QN0iXCQ8domLXI lKkIz6IsJBrLaNXTg8UIdlLGFCxbU8gXC00vsLuHahzkyJBcTTOJFpFQtw3+TpJx 3MyaXkXvrW/LVU64azQinAL9n2qzNZMDDsg3YRHeTTctq3QAeIxL6OSSunkzlEGB AP4njnsiGqSljWixPjuZ39EQqIi/26pdFWC9Xc8afBFxcweK1eU7jWZL2Trq8I5f Imsl8byYIU8Ts7ApO97MFqBUIYcZaAeiqnIH3ZjEFQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekkedguddtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 2D5612A20079; Sun, 16 Oct 2022 18:21:53 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <1ad018e7-a6c8-4306-b5b5-339631ad80ee@app.fastmail.com> In-Reply-To: <738D20C3-2F31-4869-B318-F1B30CDE3764@yahoo.com> References: <738D20C3-2F31-4869-B318-F1B30CDE3764.ref@yahoo.com> <738D20C3-2F31-4869-B318-F1B30CDE3764@yahoo.com> Date: Sun, 16 Oct 2022 22:20:41 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4MrF3Q6RlFz3Ych X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=jYTV6Juv; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=H6M4JQ7l; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.19 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.58 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19:c]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N A few hrs ago I rebooted and ran zpool scrub just-in-case, and it completed without issue: # zpool status -v pool: zroot state: ONLINE scan: scrub repaired 0B in 01:41:20 with 0 errors on Sun Oct 16 19:47:00 2022 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 da0p3 ONLINE 0 0 0 errors: No known data errors On Sun, 16 Oct 2022, at 18:24, Mark Millard wrote: > One thing we do not have is a set of before-the-problem data > to compare against. It is hard to tell specifically what time > frames have changed. > > I'd guess that each/any of the following could produce interesting > background information during the problem: > > # zpool iostat -w > # zpool iostat -l > # zpool iostat -r > # zpool iostat -q Ok here's output when it was trying to du -sh /usr/ports. This also has the following sysctl set : vfs.zfs.per_txg_dirty_frees_percent=5 (it took this long to complete: # date && du -sh /usr/ports && date Sun Oct 16 23:06:24 BST 2022 8.7G /usr/ports Sun Oct 16 23:14:25 BST 2022) # zpool iostat -w zroot total_wait disk_wait syncq_wait asyncq_wait latency read write read write read write read write scrub trim rebuild ---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- 1ns 0 0 0 0 0 0 0 0 0 0 0 3ns 0 0 0 0 0 0 0 0 0 0 0 7ns 0 0 0 0 0 0 0 0 0 0 0 15ns 0 0 0 0 0 0 0 0 0 0 0 31ns 0 0 0 0 0 0 0 0 0 0 0 63ns 0 0 0 0 0 0 0 0 0 0 0 127ns 0 0 0 0 0 0 0 0 0 0 0 255ns 0 0 0 0 0 0 0 0 0 0 0 511ns 0 0 0 0 3 2.53K 0 7 0 0 0 1us 0 0 0 0 19.0K 6.38K 760 702 72 0 0 2us 0 0 0 0 12.5K 1.95K 1014 4.24K 520 0 0 4us 0 0 0 0 6.17K 7.76K 394 8.10K 224 0 0 8us 0 0 0 0 4.37K 8.12K 141 11.2K 167 0 0 16us 0 0 0 0 1.28K 302 57 2.17K 12 0 0 32us 0 0 0 0 68 34 3 380 1 0 0 65us 0 0 0 0 3 2 5 584 0 0 0 131us 0 0 0 0 7 1 10 1.41K 5 0 0 262us 0 0 0 0 4 1 96 4.26K 8 0 0 524us 12.5K 18.5K 13.0K 18.7K 5 0 145 14.1K 648 0 0 1ms 1.46K 23.6K 2.36K 161K 2 0 116 18.3K 259 0 0 2ms 881 42.5K 9.83K 60.9K 5 0 30 29.8K 256 0 0 4ms 1.05K 50.4K 59.6K 9.75K 22 0 55 44.3K 235 0 0 8ms 3.67K 61.0K 154K 4.47K 79 0 149 47.5K 16.2K 0 0 16ms 11.4K 21.5K 290K 6.40K 234 0 303 14.2K 77.8K 0 0 33ms 19.6K 17.9K 328K 7.10K 455 0 221 13.7K 40.7K 0 0 67ms 147K 13.6K 72.7K 2.23K 899 0 218 11.4K 42.2K 0 0 134ms 65.3K 12.8K 7.88K 1.98K 1.72K 0 368 10.7K 44.7K 0 0 268ms 70.9K 10.3K 4.42K 1.36K 2.60K 0 304 8.41K 64.2K 0 0 536ms 105K 1.73K 171 105 1.86K 0 170 1.42K 101K 0 0 1s 163K 221 11 0 211 0 117 182 161K 0 0 2s 160K 0 1 0 0 0 47 0 158K 0 0 4s 109K 0 0 0 0 0 0 0 108K 0 0 8s 60.6K 0 0 0 0 0 0 0 60.1K 0 0 17s 8.35K 0 0 0 0 0 0 0 8.29K 0 0 34s 1.56K 0 0 0 0 0 0 0 1.56K 0 0 68s 0 0 0 0 0 0 0 0 0 0 0 137s 0 0 0 0 0 0 0 0 0 0 0 --------------------------------------------------------------------------------------- # zpool iostat -l capacity operations bandwidth total_wait disk_wait syncq_wait asyncq_wait scrub trim rebuild pool alloc free read write read write read write read write read write read write wait wait wait ---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- zroot 154G 758G 51 15 9.07M 448K 1s 22ms 19ms 4ms 32ms 3us 75ms 20ms 1s - - # zpool iostat -r zroot sync_read sync_write async_read async_write scrub trim rebuild req_size ind agg ind agg ind agg ind agg ind agg ind agg ind agg ---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- 512 20.4K 0 0 0 0 0 283 0 7.64K 0 0 0 0 0 1K 3.62K 0 0 0 0 0 1.23K 0 14.2K 0 0 0 0 0 2K 1.47K 0 0 0 0 0 5.10K 0 22.3K 0 0 0 0 0 4K 22.6K 0 11.9K 0 1.22K 0 79.1K 0 353K 0 0 0 0 0 8K 3.22K 14 13.3K 0 2.44K 107 37.3K 29.6K 19.1K 73.2K 0 0 0 0 16K 100 68 734 0 45 389 2.58K 28.3K 5.77K 87.1K 0 0 0 0 32K 274 48 623 0 29 248 18.9K 14.1K 4.25K 68.3K 0 0 0 0 64K 105 18 482 0 0 90 1.37K 15.6K 2.32K 37.7K 0 0 0 0 128K 0 5 60 0 0 37 0 9.20K 3.18K 23.1K 0 0 0 0 256K 0 1 0 0 0 18 0 3.47K 0 17.5K 0 0 0 0 512K 0 1 0 0 0 6 0 953 0 23.1K 0 0 0 0 1M 0 0 0 0 0 0 0 10 0 125K 0 0 0 0 2M 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4M 0 0 0 0 0 0 0 0 0 0 0 0 0 0 8M 0 0 0 0 0 0 0 0 0 0 0 0 0 0 16M 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ------------------------------------------------------------------------------------------------------------ # zpool iostat -q capacity operations bandwidth syncq_read syncq_write asyncq_read asyncq_write scrubq_read trimq_write rebuildq_write pool alloc free read write read write pend activ pend activ pend activ pend activ pend activ pend activ pend activ ---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- zroot 154G 758G 51 15 9.06M 448K 0 1 0 0 0 0 0 0 0 0 0 0 0 0 From nobody Sun Oct 16 22:27:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrFB61dXZz4gDtt for ; Sun, 16 Oct 2022 22:27:42 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrFB52Qbxz3Z2Y for ; Sun, 16 Oct 2022 22:27:41 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 215DC32005D8 for ; Sun, 16 Oct 2022 18:27:40 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 18:27:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665959259; x=1666045659; bh=eCR5fwu7gJ 0rfk3I/bVUCJr/euEyQKDSOuvSbr8mxaw=; b=oDgAXEEvQlvrwS6Uy1eKeZMhxY rTLPg79IXE9H0WK7xSXfRz3GS3ijwUFLTzZKqhrplsWqu5RS0bNhZnlYkW0aa7U4 thtdU0vdFneUZ3rvqKA02vOcPJPJ6WJMg6CIBYIiSEiGRdT63YuoTXmWFcUpJ5Z8 0GTKJ4eZcWwjb0LAvZ++KP4Hpv5YcPkh33udecpgRvWgFOgIr+gYvbeCHsL/D28v N583Y/Xy7xr9aZvPcKAVSzVbCv8kJ0+C+3Vfbbfq18aqPAO6KwAGOqfPSkTRUh3F yrsflE+mtQAbIBRjc1DlnA3rtCioST4bND5NWm2Vm9lvS5Reft4VCvDCgdew== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665959259; x=1666045659; bh=eCR5fwu7gJ0rfk3I/bVUCJr/euEy QKDSOuvSbr8mxaw=; b=Kw73QtXywhHeAnBmj9L1DKnGWLz7rxOR532883JpnYtQ lqveBtmJ7Zm1FVjrEq6h4TmSnZiJNNf0joUfePMds3ChfpStrorO2nJcLFEpcXOo XdXOPYs5aIIIP9sAeSg+Kor5G2kVjjl9PEgIeZCK1/DnhPy2/KvsYZA4XXeRSZD0 UimbcH7yD12U3qjhPRYl8ubQgKcRd+KTF5QfLp0lMswp4R8y5Xj3CPHgWh3w4VZK osSEV7gxtIk7tWj1XEAjjqdt03Ev5iojyy/N0ZUN7u3n2O+5Fwi7yeskDtzpnQCJ 3tfewG9OnnjTnZWDbP7m2tCGvQH8aehdeK5gifPbuA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekkedgudduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 862FB2A20079; Sun, 16 Oct 2022 18:27:39 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: In-Reply-To: References: <76faacf1-6307-47af-adb6-200486d63137@app.fastmail.com> Date: Sun, 16 Oct 2022 22:27:15 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4MrFB52Qbxz3Z2Y X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=oDgAXEEv; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=Kw73QtXy; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.19 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.58 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19:c]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 22:07, Mateusz Guzik wrote: > No, it was flipped because the smaller value was causing a performance > problem the other way elsewhere. > > This needs to be investigated. Interesting! let me know what you'd like me to do with the disk, also what other info you might need. The disk can easily be plugged into other, faster hardware, such as 13-stable amd64, or even a linux box. From nobody Sun Oct 16 22:33:28 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrFKC2rYCz4gFj5 for ; Sun, 16 Oct 2022 22:33:51 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrFKB2tRNz3Zq6 for ; Sun, 16 Oct 2022 22:33:50 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 331CB3200708 for ; Sun, 16 Oct 2022 18:33:49 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute3.internal (MEProxy); Sun, 16 Oct 2022 18:33:49 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1665959628; x=1666046028; bh=08wsmMCsEk ZgfX1BRHVquc+dGhjWUMRs2AulpxxIyNA=; b=E2Ay+iZM1fFs6Avw1D40dytdsG hcloDczyV4FtvNNMsv6fX5/NF2X/0V4NrGQBm0ZHow76tGXraaaOvMJ0+aLAJ/0i wagqvpDtwdS3cu89Hosk0jhhko9yq/K0D6+uaqbbbYMu2hRIXK7uU42A2XE4QWl7 ZIrPCFKAFFCDt3WQr+K2/JRBUU6aaCQTKtb6gRkCeDy1UdkEmThDdOV1LkhORq+s EqiFCaFqb0Zv1hzAXWP4nXaWyeghfjjHTOZsRFlWyCmNvYf+aSOOI92NPEeXSRY7 LPQiWWrk4Yhg+6pXEyVnZJlrZiwvh4SshLhkXRrMR7uDgshYkho2xp4YbxnA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1665959628; x=1666046028; bh=08wsmMCsEkZgfX1BRHVquc+dGhjW UMRs2AulpxxIyNA=; b=b2D04GH9FBxvb0Gi8SFoVkNDUKmuVoHLW9buaq+c1ku9 /lZ5VYJwSlnJS6XqBdyC6xmyiIni9sBzf8l3tfi5Brb+nIETWIp4W6hJq8e5m4qS Hw3jGEirQptFqIh/k/RPgwz+AhpBlYpSZyTCFIhSGMlSkSL2pciEP8HuiMr47teW Dm1hGE+OoViu7xIbvHyaMqyuyc/1TqyYdzLxgfLSwDo4fSiATNHng1MWcIjqQxBZ s01nwRDCBNjskSwagu4+Pw1AP/ZXrHg9cP+uyDK21uPN5QXmSjyDnltVdtjdK+X/ UFXxDHgZJOU7d9x1xKAEBnhwK90GbaXR6YrAao5tGg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfeekkedguddvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 87A582A20079; Sun, 16 Oct 2022 18:33:48 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-1047-g9e4af4ada4-fm-20221005.001-g9e4af4ad List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 Message-Id: <6e408755-7d8b-496a-a34f-b30dd4ea9b53@app.fastmail.com> In-Reply-To: References: <1625dc7b-81c4-4350-8f86-1b65f5a860d9@app.fastmail.com> <64a0af42-630d-4f42-8b8c-921b68b03078@app.fastmail.com> <528a0bcc-6bcd-4d66-aeff-273542deb21d@app.fastmail.com> Date: Sun, 16 Oct 2022 22:33:28 +0000 From: void To: freebsd-fs Subject: Re: zfs with operations like rm -rf takes a very long time recently Content-Type: text/plain X-Rspamd-Queue-Id: 4MrFKB2tRNz3Zq6 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=E2Ay+iZM; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=b2D04GH9; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.19 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-4.59 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19:c]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Sun, 16 Oct 2022, at 22:06, Warner Losh wrote: > The disk is quite busy and performing decently well for the load... > The quite busy > part I see others are trying to explain and/or diagnose, so I'll leave > them to it. It runs ssl/nextcloud/postgresql13/nginx/memcached/exim but for only a few users. I'd not say it's particularly busy usually. last pid: 5664; load averages: 0.31, 0.24, 0.20 up 0+05:29:57 23:30:10 69 processes: 1 running, 68 sleeping CPU: 0.7% user, 0.0% nice, 1.9% system, 0.1% interrupt, 97.4% idle Mem: 391M Active, 237M Inact, 5304M Wired, 40K Buf, 1882M Free ARC: 2623M Total, 1857M MFU, 149M MRU, 143K Anon, 79M Header, 537M Other 1587M Compressed, 21G Uncompressed, 13.30:1 Ratio Swap: 16G Total, 16G Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 4369 www 1 23 0 480M 148M accept 0 0:45 2.20% php-fpm 1451 www 1 68 0 514M 151M accept 2 0:37 0.00% php-fpm 5016 www 1 34 0 478M 145M accept 1 0:20 0.00% php-fpm 1130 unbound 1 20 0 153M 119M kqread 0 0:10 0.00% unbound 1292 root 3 20 0 19M 3320K select 1 0:09 0.00% apcupsd 1345 postgres 1 23 0 2153M 74M select 3 0:05 0.00% postgres 1351 postgres 1 20 0 31M 10M kqread 3 0:03 0.00% postgres 1474 nobody 10 20 0 51M 7188K kqread 3 0:03 0.00% memcached From nobody Mon Oct 17 00:19:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrHfs2YHjz4fDfR for ; Mon, 17 Oct 2022 00:19:17 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2041.outbound.protection.outlook.com [40.107.115.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrHfq6sBFz3hdm for ; Mon, 17 Oct 2022 00:19:15 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eFX0LEFv22Cc2nOLMg9mwBgqp998yuXRWIfksWqeqKOFwQM/iudXJsB+wYT9g86ZNGKAmrAG6MFA8gJHQ8GNlGdLGG7ZFA0ng/ia6aaNEzUp02FvkYEFuU7F5BsMRZw0eUChZLFlRtRhcsEcMBRo2UcnHIwjsoZMa54K/yAV/DWQUhFyJXtXHebmy+6oZyFGPPKyG6R+q1Ys4bYdBkY4USVA6jwM2Dw2q1ybRNb4MEUEazu3d+XFyfj+lytjsYnYR43nuBYUej6F2njVReI26xiTeU2hYymGFHZBO2ce7y4P+pSlKiloRgcGerTf/Ogmep55cke7+Z91EOFy6oiImg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=dsAXk0fHyqoj/bxLv77xNtt8cv1AAAxrLhs5Boic7ck=; b=XccBRglyW7KgKKpZkubWmYMVS6EMgPFWAsndUL8Tf8nW8QWNYd7A1TOlIdiNldbzbYlznKRWsWxiHPWXYkCKaIsa1jTMkYEJWf+Ad7EVBAA9LRnW+/yNgixbkfOpovo8x3+QH5jf7eZxl4bR7h1H1pGCzXXGIRNTNPMZIAaD8eqtZByWO7rnjbQmpVPjl1P7v+3wzhSoEkqyBlmFokVAQ2/U8bN6Bg/kwDr7MuNx9OiC3oAUMWdHJwDx8f/TwsBR/b9kdXxXf88Hydi0umsWFYvOEtFvblV+rszMxK5b5B0Ib8BCv2TdjMsKp9OoVn3TrhYB0n0WPRfNRyJwqc1IKw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dsAXk0fHyqoj/bxLv77xNtt8cv1AAAxrLhs5Boic7ck=; b=aloxGpe5c+jzguLF0QmZrv6ouHIVPvseA/NzaaJs8KK4fIq80lJTta2b5VM3sZXVmEqokoE57ugw9Q01IyHGpj1yLysKrF7gaDaXl0u5WqeXBCOkDR7I3AOSRXrwg0e9atiBnmmlNbeGxC2VpDqdbzLzfJHjHOgsOJxveSGg98Y8OmH+tJh5v5Ft7Y5g0ze6qVK2R/HKnunuObhrmBpIcTO3xrH+Zxdoi9QXqPwYuKOYfIZITyY8bEWtTq0IX0e7ftcqpBhxnvv+5LG0gBkj2tAc/Y7TyZ2KdwIUcpp7EeyvvMkX1rfUaTsFKP/emy4zTrVgCy5RzwM7byBot/1ZPg== Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::7) by YT2PR01MB6045.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:59::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5723.30; Mon, 17 Oct 2022 00:19:14 +0000 Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::b4f6:11cc:78:9281]) by YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::b4f6:11cc:78:9281%5]) with mapi id 15.20.5723.032; Mon, 17 Oct 2022 00:19:14 +0000 From: Rick Macklem To: FreeBSD Filesystems Subject: RFC: ZFS does not update ctime/va_filerev upon Setextattr/rmextattr Thread-Topic: RFC: ZFS does not update ctime/va_filerev upon Setextattr/rmextattr Thread-Index: AQHY4b0rW65lBe3yfkigLX76pFTOpA== Date: Mon, 17 Oct 2022 00:19:14 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: YQXPR01MB4150:EE_|YT2PR01MB6045:EE_ x-ms-office365-filtering-correlation-id: ed0cddec-2ae3-48b7-ebe6-08daafd538e9 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: F03SrhgVtNptRXsc1cgNHS1K3seYlYB/WV81Zx9FSbh5A0+a+DJN3zID12W2uH1awex5WsRdUPl6014iuHSkQjBNy1KbaR2j8AGC69+V1FIhyAaFW8MDf3G/hJ3ohk/X7MHrWoP3Wqcw2BdPwDPDodcp51Anhc38qoAikaN16ETdEpvuMhJgLs36DC2LlbdPcTaixyqdzHheBpgFay04pqOdAcXUxuoXPvo7i8zlFaVmuvl05KG0wOlb+aYqFwIWncKwvLWWG0Y7HH1YO9/pMTID4V+4d/jNOWpIJeYULyrnaUW7U87XRMhNtl7i9OsEVph6LCspwS4FWvHmtUcfu5lYnkz8ELhn8msQkC7/KV2PkEsdDEQF5ufFcQMjR6YXWhIedXkpHSR3Vw9/zw+AWWhX2/ZaAVfQETpkBdPJGQrsE/4pRyGNNGXLNQr1QDLa+CILlaOAyneC7HzyYgYfGXXSSC/lbBhlCU3A1Ueooa5J9KQTEWqHLvfGFuBFtBrbnvw/jmT5eZFz1zn8Ylzm8FMyXz3w8lO+TCpWshP99x/9flrndmbmwuMpZllFkWtf87+qfD2lwEWKafGWsD0ky1KoDxWkc4zSOQfwhI96sLXGyP75whpUSbkRx8bQvorEykSzPRTipHuXKMvGylh/+n2W4eNKWbOEaexl9qoBe24PJDLa8GQXc0EDCr0PGYV8rp2Iyk33XicrdmzYvY0SuBTiSAcp54AlDi7SaNyPcLmCoWvAaU0GzwST23k4EzvgRH992gTt9qRjPWhcmvInWg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(346002)(136003)(376002)(396003)(366004)(39860400002)(451199015)(33656002)(86362001)(122000001)(5660300002)(4744005)(2906002)(38100700002)(186003)(6916009)(83380400001)(38070700005)(7696005)(6506007)(316002)(478600001)(786003)(9686003)(71200400001)(66946007)(66556008)(66476007)(66446008)(76116006)(91956017)(55016003)(41300700001)(15650500001)(52536014)(8936002)(64756008)(41320700001)(8676002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?TGTkkMpGfi7nC/uQhl/hQY4lk2+W9w4dZqNMr+V+dKrt8jW24/c+CBzz6/?= =?iso-8859-1?Q?AuKEjXQn1/Es6tuvcDG+doDk3h4xYMtz/p9X2F9rN3fxHzNhsgpoqQonOx?= =?iso-8859-1?Q?chgmMXjdpHG3ncftOv55jxm+2np4xU8154NJTyP2DvAb3RrIezwUo7RJ0i?= =?iso-8859-1?Q?f4VKNc6kYE2m6umuZpGmJGthwDRyLNiDh51NY4c6WXx/RAEOZO13+4yVh3?= =?iso-8859-1?Q?VUp7UD1ufb3+2tJLKbZlRjQlksctjht4KisLzqbpNR1Pr+QjcsrisYpr+Y?= =?iso-8859-1?Q?0lx1u1bMRalTCZXrrIrPXfj9Nt6lfj9uvbaDCZCmqXIGgOqf+V6s91JM3b?= =?iso-8859-1?Q?4gXFAas9CLaSbfyzTTCpPVRvaF1bcymsEh/Fe8FNMCEbMAu0++9WyYv19l?= =?iso-8859-1?Q?PqZlggY34AEqOYhOhtxFizJ+wlvtuDZ4W1JnCX4EJ96vgg70P++BBs7u8E?= =?iso-8859-1?Q?biLd/Vaw7xSuRh44SrtN8z6uUaasOF46C4buXY9it86nmGOAWJOwZTpxR/?= =?iso-8859-1?Q?gGIT6vgN43MXoPCNfg31bI4phFyg6ExrY4VzHCSY4klfzG24h7MmjCLltw?= =?iso-8859-1?Q?caqOccD9h3hrz2fNr3b77WtEnht5vpHt0njYtiN4xwRSBrGBwqBUQGtWac?= =?iso-8859-1?Q?sXXt3GNexOfnMiT4AqimKP/ePBapOru2fHIm98+qQ9kA5zNxTCtnPFT8JZ?= =?iso-8859-1?Q?cdxpsw2O5xScgusV18ABHFGz3E2twyqO1T2oE/Yz+yKUaTE8bx/6vOwmM7?= =?iso-8859-1?Q?S3poyNdfrLDkw4CMoS4/fFvRu2PkxGxjNZLyZTckq/Fwf/dkwQ4/SxJH8X?= =?iso-8859-1?Q?lfF2KpPTeyOUlkEaum2gRd0LOj3pSLE+LOLRCBXZeCxRulxFL+/rDHSg0N?= =?iso-8859-1?Q?2yV1V6Du9S74xc9DtnjyVvLE0Aa3VVG477Q+9vm6NVg6ePBcq1KWqN91nf?= =?iso-8859-1?Q?LNREaP2FgZcB1zuuoY+F8gRxqMfiDg1Fx2WPEeJWBXnrOEIfVPWAc8tf4P?= =?iso-8859-1?Q?w7d2V/sdQOoj3/58e4yjOdoPVreAo8GJ1fQBVKaid/AaRg/VkQWGwvhhfq?= =?iso-8859-1?Q?t49uJ8x/bNOEBSW2f9cmIHCCVzmHCheaBpblyPj+YfPReLrvNEqKkLadTM?= =?iso-8859-1?Q?t9QhXcgtBXqnjEIqkS79/p+0jPrjju2A7FBan4+aW3sG+QHm/Bmzs2UFyX?= =?iso-8859-1?Q?VHKY9XMUk76SPxI3KS+GNkEZMUl0GSHoF4f/+PXIK6B9PR4ofQpZa5dsdw?= =?iso-8859-1?Q?6eBcoPHMmSaEjdTbhp90wNx8ulYt5wTbkHJ6dQHsqbfhkmRDHZrPReiGg8?= =?iso-8859-1?Q?1BEsB8i0pfSYzchzRcQdPEWjZFdPFt10z7pxn1uL3mn3K0r6ZliJ/vIEYv?= =?iso-8859-1?Q?RTXDvpv66lpniMRUtuT6xgaw13fsuQbXhqhIRbtGPgdORUnZ+f5bDTHIkn?= =?iso-8859-1?Q?mhL1+w5q1HEucl+HtAT66srx0J6deolacraLcJqfdapBv80Q3DXVpQ+0k7?= =?iso-8859-1?Q?T8tjYmMwZjcb6cxB6tgqozjIj0LFvymasAcf1WXXu8Pgz+vv2ApV9Wl6Ak?= =?iso-8859-1?Q?3ZYvv+93NAmQno5Bgpp4ecZwLAIHMtmEHUHasSOmPXDzfAfeDEjXpL1+H8?= =?iso-8859-1?Q?KY6QxxG4Ay5Pae7ul0y6h3AZYIxqN5C06/c2g/Np4997xOY+xxQasGylYr?= =?iso-8859-1?Q?nb+DJXKj/I8zKuETK9LLAEs80k2H7Og2nmVoGYJY?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: ed0cddec-2ae3-48b7-ebe6-08daafd538e9 X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Oct 2022 00:19:14.3470 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: VlZEj8DN07/gj7/4NdxHXbFpjcjg4dMnokhdDfc9YsEHKJYTKANmDOhoRli61VEh4orlZ1OdqU994lV0EQA9hw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB6045 X-Rspamd-Queue-Id: 4MrHfq6sBFz3hdm X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=aloxGpe5; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.41 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.115.41:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEFALL_USER(0.00)[rmacklem]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.41:from] X-ThisMailContainsUnwantedMimeParts: N Hi,=0A= =0A= At a recent IETF NFSv4 testing event, it was noted that=0A= neither ctime nor va_filerev (called TimeMetadata in NFSv4)=0A= were being updated when a Setextattr or Removeextattr=0A= was being done on a file on ZFS. (Looking at the ZFS code,=0A= this is pretty obviously the case, since ZFS really uses subfiles=0A= and not extended attributes on the file.)=0A= =0A= A Linux wizard says that ctime should be updated, although=0A= there is no POSIX standard. I suspect that FreeBSD's extended=0A= attributes are meant to mimic the Linux ones?=0A= =0A= So, is this a bug that should be fixed in ZFS or something where=0A= the NFS server does a workaround to make the Setxattr/Rmxattr=0A= NFSv4.2 operations work per the RFC?=0A= =0A= rick=0A= ps: It looks like a zfs_tstamp_update_setup() needs to be added=0A= to the ZFS setextattr/removeextattr VOP calls for a ZFS fix,=0A= but I have no idea what the rest of the patch would need to=0A= look like?=0A= =0A= From nobody Mon Oct 17 01:01:26 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrJbm31h5z4fKS3 for ; Mon, 17 Oct 2022 01:01:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f41.google.com (mail-vs1-f41.google.com [209.85.217.41]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrJbl4CyPz3kwp for ; Mon, 17 Oct 2022 01:01:39 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-vs1-f41.google.com with SMTP id 1so5800719vsx.1 for ; Sun, 16 Oct 2022 18:01:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=R+H31Z1EwFpWC53exa7ujdwM8ATvKLrJeQnXZOxKkq4=; b=OpINQiLGY3rEgFaGBcTcScfyv5j9rV1X1ZHJwwm1nSY7+lDgkHd8xr1QvH7Ftr14av GluS6t/u9ypO582t0n5ovkmNOThgjgGqLxnBT9jdcR2zQKbLyhukmyWGptZDoh6N9J/M V39cWwpXVl5Wp9+T7q+u9Wlb1tMqYiJpPDbnWsN1P07bWb49bMc56C6Vf/8FyYNfqnEr J2Lw+PU2LfkA9BmuaF4cJ9H+AkvuTrQyABUcuJRAyHazqo/dzyDh8qm+RqMAaHeoJxgq ykGRLP2vaF/eFNYqcHDKCLkla505GX+DSCc7sKXJNKf4V2HSlYUdl4+dYEu+qHJ7fJSv /6gQ== X-Gm-Message-State: ACrzQf1rtIT4kJveIjMOEstkEXN3PiGM4qqOE7aDfm35oMQflzb2zKpB BkUO4aATbcLdXbdWzkC4Hq8OZKhEaD81fL7vTYw= X-Google-Smtp-Source: AMsMyM5Llcnp9ufxdUqaH3F2BH0S6YIuv/eMIkHIb8nz6UYzTF4RAdjHf5IXS3EF+hUcWKX3f051IDhCgI5GmdIOyOU= X-Received: by 2002:a05:6102:9d7:b0:3a6:fdeb:3bcc with SMTP id g23-20020a05610209d700b003a6fdeb3bccmr3148790vsi.53.1665968498283; Sun, 16 Oct 2022 18:01:38 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 16 Oct 2022 19:01:26 -0600 Message-ID: Subject: Re: RFC: ZFS does not update ctime/va_filerev upon Setextattr/rmextattr To: Rick Macklem Cc: FreeBSD Filesystems Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MrJbl4CyPz3kwp X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.41 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.41:from]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.41:from]; TO_DN_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sun, Oct 16, 2022 at 6:19 PM Rick Macklem wrote: > > Hi, > > At a recent IETF NFSv4 testing event, it was noted that > neither ctime nor va_filerev (called TimeMetadata in NFSv4) > were being updated when a Setextattr or Removeextattr > was being done on a file on ZFS. (Looking at the ZFS code, > this is pretty obviously the case, since ZFS really uses subfiles > and not extended attributes on the file.) > > A Linux wizard says that ctime should be updated, although > there is no POSIX standard. I suspect that FreeBSD's extended > attributes are meant to mimic the Linux ones? No, because ZFS was written for Solaris first. And Solaris's extended attributes are more similar to FreeBSD's than Linux's are. > > So, is this a bug that should be fixed in ZFS or something where > the NFS server does a workaround to make the Setxattr/Rmxattr > NFSv4.2 operations work per the RFC? ZFS, I think. > > rick > ps: It looks like a zfs_tstamp_update_setup() needs to be added > to the ZFS setextattr/removeextattr VOP calls for a ZFS fix, > but I have no idea what the rest of the patch would need to > look like? I think you should open an issue at https://github.com/openzfs/zfs to discuss it. -Alan From nobody Mon Oct 17 02:30:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrLZY4HTQz4fWxB for ; Mon, 17 Oct 2022 02:30:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrLZY1Ddlz3rk6 for ; Mon, 17 Oct 2022 02:30:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrLZY0Jj8zg7Z for ; Mon, 17 Oct 2022 02:30:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H2Ui4K075026 for ; Mon, 17 Oct 2022 02:30:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H2Uic9075025 for fs@FreeBSD.org; Mon, 17 Oct 2022 02:30:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264127] "zfs destroy" panic when destroying some snapshots but not all Date: Mon, 17 Oct 2022 02:30:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: arielmt@thornton2.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665973845; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PqcrtJ7ZlyxphTzQ6lqepP62keGnep42prZS7TJiBLA=; b=OESYyTvC7lULdxwmIBRe2LG4/9LDKTVbJSFnKgh3/Uf9p/BadixvEPznxlE6QcIRdLmR9g 08PC8Uk6BlSKQjvXH5yia6E/UBvsXR6ibVKKTEAMeIFHlz3jUmTjHJysqoWUfvWNclb1Kk 5q3RGfsmhOCor+miULsZcDl92dtVVRw2IuBYD5Uoz8lAGwZHRCv4ANcrhLiY3ZZ9hF/iHc JQ3a1A22z+V8OEejJ+anpgcC5IRNi+K5ijdMx/gMOCDqZK6gDLdIePEnFLwg3P5y7FamgZ vRoMedRImwcs0qFTmQA/53NQCgU1IM6YF9PEmSnLCIl+YSa+HA7od9vAVpAD5Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665973845; a=rsa-sha256; cv=none; b=e7IA6z+Q+3+RLNnawSO3eQMfk0en9Radd9iGNhT/4b2TrLYrETWHJxUlQlEgKfC976WO5Y adUGBTLgeZ2rHvoZAySlZCxndgIBN/9JhjHy1hMyvJJ4s9hDYIcP3MU53IFGytf+s5tQcX q9VDRzxi4OfkDkqt1ONuNULCbrEZD7s+C/JkHsVxTRWo4uGP0hSXIqpk9PCQyIGLSm0SFp wB/J78velt874Sxz5pGMXn54TaPjjCX3wYQ2QJ+PEgBqH/BOBx4aP+XLasY3TUi3Y9z/G5 OKFIcQOZ4rvzFPvvMZCEtyqlyM/yhLTs47uv2YibjwMUY6IP2BtNZEhX98kncA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264127 --- Comment #8 from Ariel Millennium Thornton --- (In reply to Graham Perrin from comment #7) I don't remember the exact date/time, but it was one or two snapshots after= the one I've been trying, created by a separate zfs-auto-snap hourly job instea= d. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 06:49:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSKY2bTLz4g2h6 for ; Mon, 17 Oct 2022 06:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSKY1cqWz4DKH for ; Mon, 17 Oct 2022 06:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSKY0Rrpzjpr for ; Mon, 17 Oct 2022 06:49:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H6nrVf094030 for ; Mon, 17 Oct 2022 06:49:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H6nqaG094029 for fs@FreeBSD.org; Mon, 17 Oct 2022 06:49:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 216586] zfs panic: sa.sa_magic == 0x2F505A in zfs_space_delta_cb() Date: Mon, 17 Oct 2022 06:49:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665989393; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uF5tZF44SaAX6r6hIL5PjmYR2GfspJ9w5wKISOGvdbw=; b=a54f2oGzqlHBUYet6SYdkZM1/r+wDiEpqUsNOvuFaH/t5COjBbgNWYI7TkCcxKMjLL5gvE IpMWs/3DfSwD40rshbZt6ksRcHWt27UFNXt8+CyR1j3716nuKp5MIU/NR2GgMs63KkJsOA bL/StT32fbYTjfVlyoIO3XGPFSlMe2xL2IsiESEtISOWY74cYuL0BYWui3ud8sq8qMfKCc +M21ZCDOCIzbHvlHn9MY+OtMH7sPGFjtNwX9BmgZF4PLtLg6AQh6nmm6eCRWxff/oDqw31 4aUPWe0wdxE2xpobpBZfEOlQmZ7RN2smFjGEtbX8YYRn3bl4dCX0inrF5+zBNw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665989393; a=rsa-sha256; cv=none; b=U89SjANL/BZy8Ax2IamDMjLE8Trxowg0ryK63+4TBHXSPK+Ut4ZH0aIBnWvUEzgYX42igy h9C31LliVPJnC6rvKhVvup/IQhCXIl7pVWehu2TVOzvmHZzdNgW4azsMdBxao9QB4bjSpo bliblkMJNczK0zvg1Y3liCNA4SuR7fxRMzCWYfPQzRIueRUlmREWkO/tCUHMrsT4KsEHie kYZnryDCWQ3gTrM0fU5aILgsQ+c/uPOOTMUuRrw+0DwndGr8XgvNAPmqWCD2tGPwenh0ab sRx4NvmEm5PMDACbgTQJx/hAVURwwm3jKAGAiHSJIRInVvXsGwM2ypNSOXz5bQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216586 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@freebsd.org See Also| |https://github.com/openzfs/ | |zfs/issues/2025, | |https://github.com/openzfs/ | |zfs/issues/6332, | |https://github.com/openzfso | |nosx/openzfs/issues/5 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 06:51:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSM721PLz4g2YB for ; Mon, 17 Oct 2022 06:51:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSM70JLZz4DPL for ; Mon, 17 Oct 2022 06:51:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSM66T29zk5y for ; Mon, 17 Oct 2022 06:51:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H6pEM4099517 for ; Mon, 17 Oct 2022 06:51:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H6pEmB099516 for fs@FreeBSD.org; Mon, 17 Oct 2022 06:51:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 220472] 11.1-RC1 kernel panic (zfs recv) Date: Mon, 17 Oct 2022 06:51:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: crash, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status resolution keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665989475; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=f6QbYlJtCAOiun4AEgHsPxdfjZX+zWCfZjR2yybuznE=; b=mc+EL4P3jEzZqidLObdjis93AK8/VD/jkO3ktLiFApc8vog0En/13rurUd2B/Zq3+KDhi+ g4szQXCXAfhmXvctx41yefVPEKvKgiBDymuqfvXLyzwAXK4He10BN3uhAOILTxLKh94l9F q2Wtf8NRgCCOhEk5utwHXoeSIOECjeB+TZyqauokwY24KeFN94IKXobL6gGFYAWPaYwxsM IMtf/UekUBzSBG+5G6ZjfEwwt9QtATfB2+lER2rdx92msibWNy55c/Su+G6N+ZhIu8mdNa 5T2nlBzipv/bPvJpFHqCPdILBosF95Is8D0PLJpkkeded1XzTq7qaPgYMbY2cQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665989475; a=rsa-sha256; cv=none; b=NBCU+Qhx3s9uiPdqwS6G5UkFlWviCqVCR7dfYPKwMI9o4mXyn7UIlJ2HIVvrb383dknwec M+IIgg9rYb5opObkU39dNY9jXFnWdDlPCIbuhAblnE/bQfB6hBtGGy6AWfRAfQgK9LK22t uHBvh0t7wqXieJZmnfgMppIWUKTiCOQPYJhcTfVw1EKLW92ymiGWz6L6hqigYK/tYQuxaJ NLHMcHTGYsyXsrkFpunqnjSeupGc9zpdj1nswQbuy9XTqt8V6fZSWGKs2rGnuA+ZXsxyhp AQMDvPZTfJu6LAaGnDIyG1M5KQsprcGx3950npiaeUifZ8NYPuNVEguFYmw0IQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D220472 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |grahamperrin@freebsd.org Status|New |Closed Resolution|--- |Overcome By Events Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:10:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSms69nkz4g4S0 for ; Mon, 17 Oct 2022 07:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSms3rwZz4Fc7 for ; Mon, 17 Oct 2022 07:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSms2n2jzjvs for ; Mon, 17 Oct 2022 07:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7A5ln020814 for ; Mon, 17 Oct 2022 07:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7A5Jc020813 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 155587] ZFS: offline/detach-related kernel panics Date: Mon, 17 Oct 2022 07:10:05 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: rep_platform bug_status keywords resolution cc assigned_to short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665990605; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3SeBjTzDO6nadz/C8SAh1CW2jvg+zQSpBu1jCEF9YPw=; b=Iaz550wXOCzDwMbaNTRLYdOxXX25ePZs/hta631lUnRTKonDGs4wwWXj7c8sdV+N9+iMeL ue0vexd+grbNszY9DqdCFC++usncMwR4TH3VPnGz9Cy+8BX5OrUjjoi/HaQVcId9du1H+G wRE1LrhUbAp1GicKw3gbXNFsT2BokDSictVdwNYg7Km0hgHBHIeqDDWv/AX/VkxUguKwg6 l82e/ARp+VyKXrGBC8oe6SewjBnTWERNw8sMun1FrZuYI4V51HOgkfUDE5khN2GJXxVJoy 75vkEowqi9S2qSR7LomFYr55sLykiUleke5mCHk5gLvGdsaESe7kKmk/caG18Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665990605; a=rsa-sha256; cv=none; b=nr1yma/mfsMX4rCGhSB0uu7gjkjsWHlXU9F1Ynn7rfDcapjYEsc9kAYljdU8OytNX7TH5X eUOAQrNuIkIDVtmC4E3D2s7jxCvTHQBWEGPyPKa5EQ/xA2Mgt8kMr4TdsKZlViQVaLWlsC Y2oopCeM1icwuWAkPXlEmXIsM/+2cIK3S4NWy380xJH9odhwMB6L+aEY2RZMiNubGySawW wYQ9rOWgoYIh1FHkHsVCHoajhJakLFqGoa178G2J8Np1gMbhFCtMi1aGXXAm7b3puyzjeH fvznKJSGLQUqiY5Gb/uOtqrFkwK2LT1FV8jieeqkFpdAlNmwAr79aADBVOqybw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D155587 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Hardware|Any |amd64 Status|Open |Closed Keywords| |crash Resolution|--- |Overcome By Events CC| |fs@FreeBSD.org Assignee|bugs@FreeBSD.org |grahamperrin@freebsd.org Summary|[zfs] [panic] kernel panic |ZFS: offline/detach-related |with zfs |kernel panics --- Comment #5 from Graham Perrin --- Thank you,=20 (In reply to jo from comment #3) (2011-10-21):=20 > zfs vdev_file_io_start: validate vdev before using vdev_tsd (2012-04-11):=20 > Illumos #1680:=20 > zfs vdev_file_io_start: validate vdev before using vdev_tsd With a decade passed since then, including the transition to OpenZFS: if not certainly fixed, we might reasonably assume that this bug was overcome by events. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Oct 17 07:15:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSvX2fdGz4g4qV for ; Mon, 17 Oct 2022 07:15:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSvX0ddMz4GVN for ; Mon, 17 Oct 2022 07:15:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSvW6mv1zkRZ for ; Mon, 17 Oct 2022 07:15:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7FpMN029728 for ; Mon, 17 Oct 2022 07:15:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7FpTG029727 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:15:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 161533] [zfs] [panic] zfs receive panic: system ioctl returning with 1 locks held Date: Mon, 17 Oct 2022 07:15:52 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-BETA3 X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords priority bug_status resolution assigned_to cc see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665990952; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Dw3C6kq/t9/twtoo6lAczP6f9pl1Xlm9uhdVI76J75M=; b=Xv3r/XMWMmk4LCoTU2KHNTlyEPHwRGkgZpFGhmaqCbgQoWlWNwpiCUcYmb114u/HJA50C3 +DJ76v5IygAcWydktoBkye+ZeTxN48TAXri6TAbNftXG7Yp8uiP770+DnwSdHgUv2BKm8F glB3K/iNlsq0q5Xu490GppiHP5RAikFjNucxpO5UEn+r1tFf1CZvWN1B8Vvi3eiXI8RmF3 ho5xvOEycqzk9N0EYdej+5L7XrY4RNj2UBG7VpNY+g8Imcr8mayT3RiteEpW1D7ydnCrl9 SrbdbAwYsNHNT9S+ZCM+k/mh4KuRhY1pW/ECBPbd0DGRXoB+VqVBqiFTdeD2jQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665990952; a=rsa-sha256; cv=none; b=QjDd0XCGMJe5E9Gp73SkoMFSdG04UFsABrcmZVAxbekoYk2JJmLas7vrB9MRhswPOKwiJG Ln44myZoDsy62dPz0ozqrLr1lxxMXPOFSQnlSLYQAISodUermG011TmqS6hgSsN7tS9QjB JIWSk8TV2/5MIripyDWrUqEM5P2z+Ou+nInVfJIirRuEiYlNdCt0Ec6O7Be7nRXnVHzzz5 4q1nBHQ5qaZt4o5Dr5XcgH/JDkPgjvqfrNlBuAiBH3cCakKLbZ+bDTCEvkLJIsmmcLnlB7 i90XKiYUlVJszqvHjkcjw9A0MLmfhc4ZWVTrLUG3D0GvODsKXBxq8JQesrvYzA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D161533 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash, needs-qa Priority|Normal |--- Status|Open |Closed Resolution|--- |Overcome By Events Assignee|bugs@FreeBSD.org |grahamperrin@freebsd.org CC| |fs@FreeBSD.org See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 204 | |72, | |https://github.com/openzfs/ | |zfs/issues/13598 --- Comment #3 from Graham Perrin --- (In reply to David Black from comment #0) > core.txt file attached. I don't see an attachment, sorry.=20 With eleven years since the report, the transition to OpenZFS, and so on, we might reasonably assume that this bug was overcome by events.=20 ---- Maybe of interest, the fairly recent linked issue in GitHub:=20 > Panic on zfs receive =C2=B7 Issue #13598 =C2=B7 openzfs/zfs --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Oct 17 07:18:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSyM6WkWz4g4wN for ; Mon, 17 Oct 2022 07:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSyM2xShz4HXv for ; Mon, 17 Oct 2022 07:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSyM22KbzkVB for ; Mon, 17 Oct 2022 07:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7IJUZ030707 for ; Mon, 17 Oct 2022 07:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7IJD2030706 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207619] ZFS range_tree_remove() assert causes kernel panic Date: Mon, 17 Oct 2022 07:18:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991099; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dUowII91h0NmKeMMY80+fRDWYncW6RRswunOeAD16HY=; b=QY4rg4h19TzSPaUL4FLGy3MHhEzPUWV66B1lTq8u+kNV3OLerkYuXm/HSeaMcMwgqTnHoa K4mf+Dta9XJbHiROHpf8BYuBJAOmejmea0zU3ZM2mYRyvNS3vtsCdkJCjQWCGGykMI48WW SsJhlnKjEjkTOe1xfFlDcvcg/Bah8ufNd2civodgMJWjf84TntoEPoFk35zrLcGNBuDjfA yGTJK3tyND2tbfRwoGYI2ARyPhXyp7T2a1mdYJHORX5MwCaoqSTXTc+aoC09VvurSQh1Es LL9HPWinnjVjIdtzAsCzRlrWfHoLtdZLp3Z0dK+MI/0GOkxvzCfoR6Jpj0a7+A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991099; a=rsa-sha256; cv=none; b=TbkEWF6mFbwm9RGkDJmk5eYKozLbcrikdubXi8R3n/EyNqZ9BLTQu2huFsfRzkB+Avfz4v Rx9d6V+7C7M2TTBoguinijTpQYPqdMg7CjFiEnzEsmI/Maa11qSKmF7Q7HV0RIWImQeDyX N0Z5ssOp08fzeHPDXzLTIqJo2ZUuBhw1X67h9GgYf3IwMuL/UGinvMPj5FbgcwiA+hxd8J i7Or0f2UmRx/fUGnu/eXDlTm7kdoVI//T0WLuvn0DGRSSSMtMHPwJ03n1xzJHjPQPw2xFw t57rVBLNKCSI6LwbHpEm7ognmccn9RSBdVVctlGPiE/WDHEkO7W+42GHTpmm9A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207619 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:18:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSyN1b9Hz4g5Hh for ; Mon, 17 Oct 2022 07:18:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSyM6HQXz4HVY for ; Mon, 17 Oct 2022 07:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSyM50ltzkNh for ; Mon, 17 Oct 2022 07:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7IJNV030725 for ; Mon, 17 Oct 2022 07:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7IJqR030724 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227465] [zfs][iscsi]repeatable panics on iSCSI target/zvol creation Date: Mon, 17 Oct 2022 07:18:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991099; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=W9wCutcgNhqYyBWi9WFdJYVf++UZN/8RbveUoj7BS10=; b=LptF3fRQCwoG4cMd7boYRxmuugsZttHxzCl0kLsxINNJ0Se/f4kT6RRFvqMpGfL7CSNRWD OusDxdaMLtQyKjrmnHxM6FymNNv0l8/gFVdlSfU2pem+qRkYO3WA/ZALSHnHzkGmYft6sQ vCvRvKdD6cfywgzbwGdIvXzNcajW6dwzqCiwDQc3SD7falS89w6BkREodEno4k/3IGxGA9 GQQxDglgODeVOZe3/jlZHDbpUBaiNbYDAFGEX9W83dlNUUZH1REt58VHu08ALwPbeomRzS gczrnEW0qAkGo1GMOicPyIAQXyvFoE3jCdFaM05nLUr2ZfwnbsF6G+okr1odMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991099; a=rsa-sha256; cv=none; b=ZpMwNrG7kmL7aT5v7hDaRnSlJYIzlq4tAeZcj4kV2YppmHGXLVKQF9Q6qt9NTwt+2Nmh7Q SUH26I6vwmQHcFnk1TgMw8UHBznthJfRCW5+P5a5G87CgCC2Ga658nYevXRgm/bgY+Nzp0 seV5v2UtPl4OL4a2m7mT35FEV1RZhHMe5NxGq4kioKFcZ0vkAg0IrNViTfyUV7mphrJ4Zo UD1HAqaa39pLdBF0kQdvKqTAPTRkeNG3AoDLAITSvKj9/7WbTlKeVzQ7TzPCYfwNH/NGoB dZkCdkJqkrdcPGaj9atI+UYvKS+us0L6HjeAiJMHydu0WfjkIDjDkfb2vfLDug== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227465 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:18:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSyP1rwsz4g5Fq for ; Mon, 17 Oct 2022 07:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSyP0XTLz4Hf3 for ; Mon, 17 Oct 2022 07:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSyN6mMRzkVC for ; Mon, 17 Oct 2022 07:18:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7IK27030764 for ; Mon, 17 Oct 2022 07:18:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7IKRM030763 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:18:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 210409] zfs: panic during boot, spa_refcount < spa_minref Date: Mon, 17 Oct 2022 07:18:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991101; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LZoVzDSXs2JqLQhTa+EYgg59zMVPhYK7vnFCuAhdS40=; b=TgUYorKNHBMWWFFD0FY1HVNhEU3gf2RPQ3tCA8tXpwfzE1qld9nvon9iP38UfVOn62uzmN 3brxyvMpsnPHTtY37F/siyXh7LDGcRhKz2HdPaRonN7gl562h3Nxo/IkNlJNc/LsRkl7fF v+RlsgYYItnAfTDq29P2TWewEonxXkO38ft7BKVp/h9stSfCMbRcbJEPDigmwDuZXWLBsy Z9fDmeCjgGsdfudprbd0u1tmupyCu/YbBc3KDXKTk6iMvpW6Yv1PxLNYDS9bN6zIFK4zlo l90Kd+hk4qRj0vYVH1+WcI16EUsbmlH00fq3FvfuZmsU03P+sneCR72Sas6gDg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991101; a=rsa-sha256; cv=none; b=Uj2Up9NQvN/3PQHHtezv5qLR4PbCBZxSge+L/5GYp8t7jASIaW9Vtrpofo3NZUWHUY9grE b/PjHG6y6wK/By2Ad6495NKDBqi6RukRVyHL6Ti2yGGuB9VMI4FLxK9pQizEpAOsD6DdsW 8DTNyh8wCPqvoZccO7/SFzld2n/H8TlibVwRjLMK84j8tVP8IC+GsaMezHCjMmXLB11UjS g4c8hkZx9tmWPDTLzm8du6Ppzsm/9s+Dg+LW4b6hx980KLfOdUbZJ73MrFqVn2UVfXwpFR SrITxj7jUNO73+0nQtzJ+UdwJf/f1ma2uYEBNv0RpKp2dSxWaVOou9mVeuHdCQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210409 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:18:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSyP6WN4z4g5L2 for ; Mon, 17 Oct 2022 07:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSyP3p7Hz4Hbm for ; Mon, 17 Oct 2022 07:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSyP2s25zkcK for ; Mon, 17 Oct 2022 07:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7ILYd030789 for ; Mon, 17 Oct 2022 07:18:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7ILr6030788 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:18:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 220203] [zfs] [panic] in dmu_objset_do_userquota_updates on mount Date: Mon, 17 Oct 2022 07:18:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991101; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PrLuPFIOkrMamaVAQmAK9aF6Gg5LRG68Vmn3kM7Da3k=; b=fQ2XDCY6AqAybp/afXgRGf+ssceyO75Vn+pxvWnQDdSuxdVZG8FbQ1IY6+NabUtlwWfFj9 78PS4Xz7C34adg/VYCK7hgGeq+4BUyMVSbTfS/qaW2MFx6/syNJvpr8JRz2zSfLocGzA/B gbzyQusKQzLPIXXuXQTKyraXDwtgqeqezpEJ6QqISCbBcxq4O5Yo+hF7LPSy70Isw2hm1K aObJrtA+uB5lNYdBiyes14d8R3BeeWNKQZB407JkmQLzgduft4y198VaY9PTMYd1biYBqW tVxWwwmKxDfccCYSho5p+h8CG5IcEd60SBQRPY1lvXdQth8HmZ+3rhZ7Csbeaw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991101; a=rsa-sha256; cv=none; b=OUU9YoMioLp5TWUokEPlMLoRib/MmVCvyGyVNrZ0LzyVyX5C7bQkmznky1VplbGvgiCluq +h257igK7GFNQ42bgee5SSLt3NkwJPWWddURPURpFiK+2EjmZFIq8cHwZXuJDoJ5J2v0F2 8YgAmgbYa9BY07zvwLgWvsaRLmoTDdH287hSqyCha4leYVZg+0rTlPGvbrA7GqCQYSXMUb FfKRVtQorQAiRv5xFn8OAQcFbd6lwRCu8V0w9cqtVEFbNJa91s9/dgqRi+yY+eHumbaWjz q+/NI1erfcYNPYefhfsGyl3Odw5Ocilmv9HAcEUXgTfLP6IiNVDSABqukAuV5Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D220203 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:18:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSyR2jDFz4g5Cd for ; Mon, 17 Oct 2022 07:18:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSyR0QBLz4Hwn for ; Mon, 17 Oct 2022 07:18:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSyQ6d88zkWw for ; Mon, 17 Oct 2022 07:18:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7IMAZ030848 for ; Mon, 17 Oct 2022 07:18:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7IMXi030847 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:18:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246216] ZFS sometimes causes a zio_execute()-related stack overflow panic not long after boot Date: Mon, 17 Oct 2022 07:18:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991103; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+z4Wp0AhRxSeefU4wyvkR87auWbvqzhoFs8TNxbAoyE=; b=VRbm8yoxjbdp3wqESoTHqsqa5G2bYMrinE8FmjKPHoM8Bf4oIQaPNxFkIyxGX8F/f/5Si8 F/6eF1D8IhshTNu69tk6uxE0K0XmeiQCYFrKfkKlMbVAouO33dL+48kmK7Ntq4kdvGPMR/ sRHO02n+1alCNe5VC1+lFn//b3m7TgyicRrvWzyahqVhzJUqqyoIYXdp3o7CFRiN32640s Hg7oejpKMf6mW0gRjjMFE15TS932XgQpQ3wdWZgfJ7Nb2CoRBR1oLaysheTkGpPZSd1A5Y N3jqTl/ANQhv3vwAL0ijXXpEnmmnuHaaAOvPOVFUE2BFhybMi1O3swjOj0HTMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991103; a=rsa-sha256; cv=none; b=rsX+J2aVewIlRfdneGLIqS7Cqq2QcQjf4jqA939DLGehMxKLwxzSZaaIs4LK4dQw1sTQIT k16+Qmf2DYm79tM0sCNN9OSJEOKL76ohxO+LOTQh/f1kDh8+9dztNuYzli8ZpECzmIpVFg HJeAU1MxAAvTEme5JYEWRw5E3VLwN11/Kd84OGz3MrOG00x4LeteeEEcDVA06vddM+0UF7 Yvglschjfll/Gce0UBv0PliI/6TcsxitRBUfdgBGMmcdGCuTDNOgLemG31T9+r/74N+1bo mg4F+lDOpK454ySCfdbhMxVdn9K654ecOBnzd1d1YedfArGoxXb1+LyIdjym7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246216 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:19:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzK5Y8Hz4g55C for ; Mon, 17 Oct 2022 07:19:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzK4WFqz4MHD for ; Mon, 17 Oct 2022 07:19:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzK3dbPzkZ6 for ; Mon, 17 Oct 2022 07:19:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7J9WP031214 for ; Mon, 17 Oct 2022 07:19:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7J9Fe031213 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 226130] [zfs] [panic] solaris assert: zrl->zr_refcount == 0 (0x1 == 0x0) Date: Mon, 17 Oct 2022 07:19:09 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991149; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e5A4Aw8vMd+jkplWbdvc6xjY7wNiGDa7b+QUVWBAQhE=; b=DWNEt3Fl84wXOTKbQW96xeDL0Ivf27/ojKbPrPWGau/WBR4AnGcPj1+tlym4lDUftp1AiC O+VUJMUi90Wbjdb77hy4mt6visr8g5APueh8APN1UhdNeK4VFI6nuUWw3HOTMhnSW1hjHC hnHRkp0kFmHla67YY8ust8K7C/Vh5VB9Pg0T4WS3FZ2OwrK8LK7H1c50PYAJTKYw5gHDVE G7MBtEhiwVgkm8o9BBDWKk1eaMOw63/WlwbMCUMzleVjpbx1c4uKbbqz6Q8AeC49KbyML2 MzP2CPvqru28qWnUm7i/GqPTWg9V4aNlFWb74trg4AZMilzBTB1W5M6CCUmRzA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991149; a=rsa-sha256; cv=none; b=NwDVGI2kdpHb3xOuGO2eWGYBaqbS0hjzFUBsd11lzg8WCLOHXTwBnv970s5F2BfJu5SXh/ gNeLl9Fh6ijL3l7KuXzKD3pswOdxreKZHcfm+KaXTxQE2Cszhg+X1hH6hurm+/XnJQjYO3 8Sjekfps18kaXADc7FKB2kjg1sKuS7wwqPDtqRRep1TgC9FFdKVLpx/ZQYZhvO3QDQIgng 7iAtCrsY1piORyT8kDN4Lgg/p1R07nA31UPMvOlqo8DJ6BJmMKwDJK72dP2xb/HCF1ZDlF ezELFg9kTCqertQpH5pAFwtnwFdki20wmKOmlKwCabDOEV16kA5OZ5dR5/hnsg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226130 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Oct 17 07:19:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzN4mYNz4g5R6 for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzN2YSvz4MR6 for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzN1dxxzkRm for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7JCqv031298 for ; Mon, 17 Oct 2022 07:19:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7JCiT031297 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 197789] (zfs+i386 No PAE) panic: kmem_malloc(36864): kmem_map too small: 431976448 total allocated Date: Mon, 17 Oct 2022 07:19:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.3-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991152; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=f2eLXlxLQIHNonML+Jh+TqViXHUmVOzb9pG+J16XIwo=; b=BHdexIw62NxgCLL26NL+ukxbuvOXNmK5cyPm5tlFRKGoqZMbtNEPinZQLArlsuwzsZvFjj e6ygRCf/NYayBOFg5AUBtTDsLnVPLLqulLvMg4PTHUI/N0QNNMRJc0oGUsbrp+XKcj6/yY 9hvocnp9tYpU0k4/TJcCOBfRaPmZ4j8KjZShY/z/chbm9nkm2EBBsf4MmMGzjp0FbbNTQj So7fhpeiLsPXMBlp0IFFX42oJATIjn2QjnvyyMcQtrLbWATfP6DozqTo3Ddc0l+/wCLFVb Newg+6hzAeLQCxLBt4mMQxMNSbHu5XeQlrZNFfYYWNqbhG9UvOpi1GB8z3a+5Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991152; a=rsa-sha256; cv=none; b=suohMmWFQXmoNIfX7/bl1Ai6TTOuWBMnupeMBskumAVP2izoyYgiH4DwNTNuSs3TlQtToU qIRzyIQbsTd94s7QY4k36OgMjDTSjBMOypLk9h8eJOUkgCOglNXiCKAtD96vXCULUjrfLQ UtyQHoVW27plhYC8J3doE1e8UlXqLcB4hGS9b9/HjKsjNmEdYQDUhimzSb/iK/Hr7VuQWq Y5+r62Pd/UuNNOMn9YdamSdWpj8maNpHmuctiJ8Q1piuY1ioaz0EsyugTB/SrESVg0hbvU 4qg1GFK4wnfNnmUJApuhXqSroSPOplbx5ZFFPELp7jDZmWiWTRoK5Wpf4wLndA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D197789 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:19:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzN6ZD8z4g5B4 for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzN3h2qz4MNv for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzN2nYjzkVJ for ; Mon, 17 Oct 2022 07:19:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7JCjJ031306 for ; Mon, 17 Oct 2022 07:19:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7JCws031305 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 208070] Kernel panic zfs_setextatt zpool version 28 Date: Mon, 17 Oct 2022 07:19:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.3-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991152; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ix4S5q/EZbniKjAoQYnkY3Ejj/yl6rXpSD1fssQKiW0=; b=ihZCc3rpQj3XESSkuAOxitd6dosbrOrcRKmvbXJD2faUHdyLjnQb0/8C9vPKZJNAwKJMOM wR659h42QkZM+inIrx6mOJ1O5ZxZyEniNlqfggLZRYvRvxz90sKOmmUx0cQPfL/YIBq424 /dELfdGu8n1lHSf2XhR5Gk10sO8LZeuyAeLnTEjpG5D8vyerBV1ZnIdmyJ3XFy5Sni6KgW ZXhNt8Zcj1Dwhnfcys0dHNX72TsHpfgCLAVYTtHIb4jNVHBOHSxFJUtYi/EJjServG9nBb qTIC6LgAgMZuylU1gj3c297hBQ6TxrtP4NVfGQ5vo9ToWBJrfty+TvUj/dGQyA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991152; a=rsa-sha256; cv=none; b=vXqSJto93SYj10869RyYpPRiQBQOVUxns8GifSzXFtSDOswx31hThMsd/wiawsV7lflJH0 OmP3x3nPUH60v9jMkRZbZQPEd3bhKZBULND7MWUKI/izjM/TNMxYR4f3U+tX6N1n/gHa05 +lSl1m8ufk8ZVUHbwoQjbeljrRQQyF45cNgCXCSFyac7b5YDtXXYACDT+azr7zC/ajqKBI bGHFbIyd95S+kcejEPjMIi0G/cCMgeq+HTTSFmiPLKqqa+8nHGomG1hHDFCsfRTWr0Tfsn UcryVPE3RVwAcaCmTgWdKFmzGNAFn8EBOaYiwEKPZV8Cq0e4Bq7kLv6DdkHYLw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D208070 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:19:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzP4R99z4g5JT for ; Mon, 17 Oct 2022 07:19:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzP2vZbz4MZf for ; Mon, 17 Oct 2022 07:19:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzP1z42zkNl for ; Mon, 17 Oct 2022 07:19:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7JDb6031332 for ; Mon, 17 Oct 2022 07:19:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7JDNj031331 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 172092] [zfs] [panic] zfs import panics kernel Date: Mon, 17 Oct 2022 07:19:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991153; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7rDdSUv7aEZOHMVPOucRMC8mpCCxYxglIPVpjgdyKKs=; b=nUx3NVYZrfVN9ix7FSbsVWjv3AgIj/DOjdb6vFAJvv0gAx+6zGHdE6igQK3D4ONlmRkiZH Kqjuee/0Fl/nxAgDbssq4tUtWmO2Z3SYPZr33MfmI8hvA0ZzovPWD4VbG+u3zMM4YGKN+z a2lxWdc1Iomxg8QvtDPe7KXC2EFH71KUGLV0QMBSBbPrp4Cd5BvUIdR/Fqq33NhQTscQJ5 NJX+OH+pD7zoULCLRL65UZK2fxnZiVxxFXLT7AG43rD+nOrvftX5zk8bbW1vO6JUybH14c m/K64QUzZVS7vXPGIvhkCnKaXkfDbJAR+0+wiGsvcv/LUIgssKV+6gnIH7Yj9A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991153; a=rsa-sha256; cv=none; b=iwgdsKHDLq6BYg4503IhsNfLbyer94jK4pQQcIGhtaZctkmy9xFDVrGJswzA8Stns8N9xC U5doiN0dHfWjxmCtCaCuNqNcBFoTjbVY0xgSRsy6mttjRF71zDmDsi6LZg9J/yivmLQP1t nOuNI3BYOd7902HxJRqv/1OPQ6zYzs87dVo0R64dwKYFMonCD3zdvgDadkz/qzmBNauXvA Mtcrp5jLL3XQpUpl6mtdqDQOfBfnMpIhrAfY3x8Yrn844ooov34TG7TG+RPBR0wkGqF8E6 U+7xjRC5oMfxuOUULsGCrgEvLRiGA+2aSCssB1A0vILw7lrdQQetTzMco4/38g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D172092 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:19:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzS4Xhtz4g5RK for ; Mon, 17 Oct 2022 07:19:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzS21KDz4MhN for ; Mon, 17 Oct 2022 07:19:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzS16j1zkX7 for ; Mon, 17 Oct 2022 07:19:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7JG06031432 for ; Mon, 17 Oct 2022 07:19:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7JGit031431 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 199405] Panic trying to mount ZFS pool after 10.1 update Date: Mon, 17 Oct 2022 07:19:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991156; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=J5GsyICpwRFJ+QOMCZcAleMFj/E+Ol3ed79vn1c/rds=; b=rHwHgqsfZA3sJ80g+d934UHTppgEEXdxGaUq3QyUZe8ekWjb+GIa2qFVCylasWlIJaw8KL HEBcSZ76JnkmhqTlI7vsLRkmTshbLDyb5iYJXdZKVGez80rrGp3/S60hefpcoA0lmn/Imc bQQhPQEy6R/ukjbNd89Daa+MwNs6nQrB4M8scVLwCfbG4K7nexlIEYuHFClA5vIDkuVN5G LJXErOr9ArtGCI/CDX8VHKBYiLu7DQ49m6TRVnTrH76gIvsBFr5fsto3E5/cmUW1RHqG6G nJcXNC3LG0p3UY6kAFbIcCher99m+rZ8Gym6fV5uPBXyWHo97P1VQ6ebzsUS0Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991156; a=rsa-sha256; cv=none; b=YNBuLRnXimc1XK/b1i2pxtuL5zGhiRD+ynSqrICVUPKBFgsuOmOPofNqP/6bk/0C3RuWnK pTmH4Qg58GtVA8PY1HlPp6cl+lWJm/cDwvNHKCrXnkPI2Br3RLfp32MUtyc5auIAwkDp+6 noc3vtAY+X/43EBtQw8oFOEYHUBi6w3hGg+8/Ol2YK6v9vlkRImgKI/Ur5/L0FWwmQlC64 gbjFJzkCC3HvDYnHtrUKd7H4L6cposTLYrb4mvZTCgoGefOUZh4UKmRUHBmcIdmMpRBHwI xV2TSBiK6Ihm1Oq1Uvv7SHnRvPFC2nAsMrGTwO63w2oRj3Um/UN0ux3jCNoYcg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199405 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:19:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrSzY0x97z4g5Xn for ; Mon, 17 Oct 2022 07:19:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrSzX4WC7z4N4S for ; Mon, 17 Oct 2022 07:19:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrSzX3bWYzkRy for ; Mon, 17 Oct 2022 07:19:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7JKBp031554 for ; Mon, 17 Oct 2022 07:19:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7JKdi031553 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:19:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225663] FreeBSD 11.1-STABLE on root zfs panics on boot Date: Mon, 17 Oct 2022 07:19:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991160; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qyy6us1LCHvSy4c77kg5meIT5IFh8BmhE6111uh8xR4=; b=YEr7IqgD/oG6Ti8bxXIyKUr3VUA3tusfDK+dxifF/bJOfgw4eOVOQzgQ9+K9qzNXYSm0WM OqTTT81TMAIlNZHcjIkWdv2LfVFWLkDeYh1GtzKIHC7/m+clhCrkawZtcz/86OeV1x40U4 RBkeNDtieQ1UNSImnW769047WIY6N55GKYrRSFxV4JYukexfbnsuP1LpKmsdHA+qYzQ295 2jIG9lLQyFpXT3bJEm7US+o2q+ClvVyQoByTWk8gE0G09oyNS4u87LNlsDRdAGZfd+98gP GVQm03x3jl3pkolG+Ar69XI/ER5W3boq/EsMN1/TvlkFo3qPjRck+aYmdNeS4w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991160; a=rsa-sha256; cv=none; b=Z4iCwZ2QeblOunmaB4w9f5vaQoC0DYkRestL+vCeKlPcQ8aPKtOOYbFeWq1O1hCHkzXBn2 Kl7aMdWkgT4qVgPv8lOv4z1+nHQ0K4nVOzpLw/TrnvOM3+xbKi5rdRfT2M6tGYfrqGPflP /qyyhzFthDXzAF6wd12cfjKEXiElK7bf0vhrwJPHAWeuhd7G7bNdu0DKP7PF1Q18FpXsEp BBLS9cLwbSGMJwZ4frx8mg0UZYVgb2I+GOmgY7d6MxN/B0mflhTD217HEDLkuWeJvKo6hU NJilJImMxoT7feeu03OXl96Q/o8x5/v2xHbYN+JEr4dwcHtMbnRlVi1BlcyVNg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225663 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0Q57Bsz4g5VX for ; Mon, 17 Oct 2022 07:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0Q40Twz3Chj for ; Mon, 17 Oct 2022 07:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0Q33lHzkNr for ; Mon, 17 Oct 2022 07:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K6bn032070 for ; Mon, 17 Oct 2022 07:20:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K6NI032069 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 205270] [zfs] Panic at shutdown in 11.0-CURRENT Date: Mon, 17 Oct 2022 07:20:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991206; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tvhl5q+aAdy6Ek1CnrSLTjbW7OJmY15S0bjG60yJ+Bk=; b=krs/FKiC1YzQvuXPZGFS7B3l8jSmJ0LumcJjObqcrzs7zEpCi00N4Ru1engslGS/RvsBGw QzJifiixEgI/EYFxwZOuZT0MClx8P4IX86lpadWh5oFoZK7RESEWqJmdllsOsdJSouEM0v CiFabDbxRCjZmz0XWoW+1JEpf30uNQcQjz7SibEJTMPkhN3kifsx8nVWtBlzZRkS0HQDUk 5BpS/MEVmBOEjVCsUp5yPnEqJnAWJLuzU+LvftsgmgElHYx/4+8jF8W9w1zOc0AcOI/qLJ RKoxqhwIYFkBM+4/HdD16CW63Z7va0HlqSDHsgwGAK/S63iCpHxGSLYIb4hHtA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991206; a=rsa-sha256; cv=none; b=frdegZrAZgekMYW/tnGrsGjz+SHgvbKMHz+wC1jl60tEqxPD0HBJ8DeZOtpLtGN/5OHNbN 84NQBAargpnz7uZja8gUqH5zSfdrnoE/m9XhVFMazotxe8tyYYr/lGVUB5p7fwMOPyp5U8 SFnoMoCoZHtePz+o1rkqumiBAiNO0fnZk0M1Y/S+e+2EymvC/jyplyNN8nkkzrJ1RLAGl5 YKZ+wWGXd+qYxVSTEbnVQhO0KwBYmSewRDIZ1vwM3q515iZiv9n/Z7ejaj8Rur9NS7KSNf dwcRj+tpAryJkqAPkii9/1sy5aavVAlLzQB9scW8BbTH8crX3EMuqQTV4b1fvQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D205270 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0R0tJLz4g5HG for ; Mon, 17 Oct 2022 07:20:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0Q5Y7xz3CTK for ; Mon, 17 Oct 2022 07:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0Q4bnKzkjl for ; Mon, 17 Oct 2022 07:20:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K6RL032082 for ; Mon, 17 Oct 2022 07:20:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K6hk032081 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 210731] kernel panic ZFS related Date: Mon, 17 Oct 2022 07:20:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991206; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vxsaanex6wH7CnB7Ci3QZDP0LEksQjKi6E8KQ7MLnws=; b=hBTHC1ZUJ1ZsxaIIVbm/9Yd3HOQ6yv2L09SJHV+m+hBThSizJHAjrDAdLPNDQoA1mjbqq3 EXVaZ6vMgrx6mKCZuP8BMRwFU/WJ2RyPCo5lF1yW2+NZiZDoVmoYDAmE5OhI6ArzBPxvVk Fo+YmEc16mi/SxEaYvs1CfvWgHqxP98sn6xHVA7C/0wCRofpXZ5YQA9RXtPpmz83QEybXk m+qGUcJBZWzI0YLHmyTXlI7osPhE1iYcZ+qM83BIuq0usIqN6GizUykJrkuHWLRB7yKVbt a7pAlGh7/fUn4AZfFk9ZW3H/XxUZneQLhmiJ2xCkSTnuTP68D5ycDs7O9Ov31A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991206; a=rsa-sha256; cv=none; b=R4JEtlV+E/ZPreY6lfoVKsrhtSl26ZWsEH9CqEmC5OmMEfSlZGufZt04aeJvSE1gl/AQPB T6G8+sh+mUqlb4LXDxhPuzYkeC2nFfvT2vhYR4US0a0WDeMQk6X36nYp533co4UnCGAmV2 1FNc5YcuFEHzt0UcfncHQZQJEav/UylukjlFcT4WxmUiihMY6i+s+VYnH0KGNH9i/Z5fBM G4ce2zhNO/4HHMG6j7lIYPjOnwyhI774FLuDZUaipoLSzgWeW3giwJ/I6M18zuMvm7BpHj X+dNUotZfk+ucBdQNPGa0HAHGxn1JCH/Qlj10CdUXwOc5FoAMhsqQSlsdkxt+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210731 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0S05KFz4g5Y1 for ; Mon, 17 Oct 2022 07:20:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0R5HT1z3CXW for ; Mon, 17 Oct 2022 07:20:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0R4MfCzkcW for ; Mon, 17 Oct 2022 07:20:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K7f4032129 for ; Mon, 17 Oct 2022 07:20:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K7gM032127 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 231794] Panic in ZFS due to arc related memory exhaustion Date: Mon, 17 Oct 2022 07:20:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991207; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6LxCPDJ9cd8PtPgF8uV0E9kQS1XfX6pE+pM6nKdHYMc=; b=LnB06CxEpRRYHXzcmnza51gO2r6tOZKanOhbDHKRJoy1QGq1C3cc2eQpfDnazk3Zzw0K36 aLUAYswXeheeuUp4Z9Fy2TGW41n24E/0xcZb+Qpm5g0v60s3JQP1mQ+B0464Nns8VyzaI3 PP8XTY7aaBbC40Uwvo5Iw34EJGofOL2Rddh0Qm/tO7HHvV4LPwhtv3pl5bJVqiEOQhPW37 RPhfNp+u24q/Iv5CAMyRYhLhYtn28VSRL4Db/2MebvkU0U53aEzZmrlyN7W+VjE3eHvJG7 TEIsoP4w1ejy+mSDEhF/jF29KovL9XNNK3CKeCWDV8D32k6mB4OR8Vo0ME4nQQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991207; a=rsa-sha256; cv=none; b=essMQyQCrgJ805DGBMouYxf5d3td+dUn/NTteMnImECr2+uxoj0UylzrkHex/ocS9IXBjM Juy1ghlAdTxigICODTtK1Spb0a/r2/aDiunRMHzM+j+nseVq+l7ye3CTvVosNcfQAdwsfu Soxm9ROZyRK9x3zsgOJz/O1l9/xw2iq63b77gGHfq52sQ9H5i8SlLa1o1p6PoR5FM4ZeV/ dEQ7Ke3977BrnEFRTH3ZZm1yCS64VxPV/s69M6xUsYVJKFdYpGY1EDtz9vMD9lEBTsFBLt oxJIhklx9X+81N5Ss41qH/8sHEGlPmUvr5QuvYqKFCB79I6yc+mh9MOK1+zxWw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231794 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0S5XrGz4g5Pk for ; Mon, 17 Oct 2022 07:20:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0S41fyz3CZs for ; Mon, 17 Oct 2022 07:20:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0S37MhzkXN for ; Mon, 17 Oct 2022 07:20:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K87O032162 for ; Mon, 17 Oct 2022 07:20:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K8aE032161 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: on long running find (zfs issue) Date: Mon, 17 Oct 2022 07:20:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991208; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=D+OQX+d2B5bIRwN2ZC9P20Nz3uNwE1B/sHgkirGEfLk=; b=elyn012NoVPs+2oqI3G1QQ4J7PjdRC2kiuNp9iwE7MUTmT9ZBa9BGZGGX4J7iAs79WD/Nw V6jd4NhkJfWZbT9+V6uARgGUyn84/9TkhOGaWVQ8AFBMMcKNVFLk+YSCDbwn5q2E8+gqgP zzQHQ7YMiOjVVtwM+8ckwujhDGubFUBVCRMK1ZfOEPIlmFEm/wD4fwF0t++Mb9txsThmem tJ/fdD38ExDnAuiFF+S55ycKEI8cC3B/rlx/mQCG6rFswcGvvM0ie4pH5fQ1X4KEzW1xJx UQ6nfr4mtKlpXtUCctMi3RT8O5nQMS20bUubbim0VzS2RDUydTykgFzX2S3t8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991208; a=rsa-sha256; cv=none; b=hD3sLJTCHQdyH2KnqEjyvlHMLdcVuYqfbMuYWczxQK86VG0CClvOu3OZEGREGPKKAl2aGx X0Tx0854b0olOP+lXZvA5+aRJH3cQ2CXbmhURa3anayZ5V1OPLyoI02IzeGKXzM/tTU4+T 9qvzI9xz/cK3FLSwH7Gl7JD6ouWkjML5nPUx8BbK3Tzjzb/sSoOb40CDBmv7IgyZQ8t2fc wpZJbPx1YUs65/tiJPTAcegKdPyBzrVbAo7GVswWqs0pMfTgAJjowBaQBGb20/xcxhgMhz uxHCA0aZQ9D2+T/LgBS+s1PngRFEA1a+wM/Scy5WpOyOO4S5lvuVdHbemcx9rw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0V0LR8z4g5SB for ; Mon, 17 Oct 2022 07:20:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0T3hhmz3Cb4 for ; Mon, 17 Oct 2022 07:20:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0T2jtwzkjp for ; Mon, 17 Oct 2022 07:20:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K96q032208 for ; Mon, 17 Oct 2022 07:20:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K9dM032207 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257012] panic in sys/contrib/openzfs/module/zfs/arc.c arc_release() due to faulty ASSERT Date: Mon, 17 Oct 2022 07:20:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991209; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vYQtxqGBnXQoUnggRZiho6ddkPPPoIqFoUe3HVSoDCg=; b=oxP7jrSTJ4LFyD+jXkS/rXIJ2fQJbB6ZXKzUgSW0N3k4uG3AgdO+vtnHPAeP7sV+A9fP4Y qtovjpFiLE/OoQWFYL3sIFZ6PZjhIqijU/0iY88HyfCnj0N0zHFNWJ7q4jSmN8X2CjPk3t kxyWtIjuRZcp/Y9zhHtELAi63niG5IXxdUbcWVzSWYM69aDiJrQMjHA0Mr32Lb4tjz0yDR w0rz3y9m5RZ4vnzCTU2Hec6VVL6c/fMhjE8cQyWAD1iUdMH7CEY4c01W+pe+lQDRkVYOvm 68i7cYPxb+XEpuq50SoXXVkXpdjFvDS2fngnoTSxMc5EamCDUU1U97lFx+soPA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991209; a=rsa-sha256; cv=none; b=SikLZ94l99YFe55mnMXYdoPwybhRLlxGpnkLL5BMcXUsqxGsajb1/Ug6pNaKkcEpbf20Zd 5AKRxGKKhe9Y8wEOiiGd6WKXbE1oF7UReGD6e/+vlTPMtnswYZfI3xqxS9eRlrC8DaYCIF 3r+q8WjfFLdWHHhzUJOJI8YqYe57o9u+/gn8DdlHQFYwf34Elj8HJUs4V1NpxPjflf1vHP hiXpgsqXYiKnRD1dzysj+vTarEyd00BFVZUb/5/7tN2bIF9oOE0GV9EbnAPlCaxM2jG6gY ny+v9qDkW/SrbVPRiyqAjGLL8OYPBbW2z1DoCKXBtsr0bE7V2Ba5dCxoBwIPEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257012 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0V33rQz4g5cy for ; Mon, 17 Oct 2022 07:20:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0V0ygKz3Cx5 for ; Mon, 17 Oct 2022 07:20:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0V04rzzkXP for ; Mon, 17 Oct 2022 07:20:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7K9hA032236 for ; Mon, 17 Oct 2022 07:20:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7K9JZ032235 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 204254] page fault kernel panic on ZFS operations Date: Mon, 17 Oct 2022 07:20:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991210; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AiISGBWGXj9Rew2NubojKhArnyaNT6TsJr7tIZjWGno=; b=pZ9NhrSVGv+s9Ug4mjfC1/tVOEP0Gh511+KSx+G/PnufF7Z5t7L20eTagqwnpJqFuV7Gh5 uFYasoz8/txh8MlEoPPyAxCWZa+Gk9ubzEvQMi6wnyyaGUSkhYuPQ5JIjqVBnNDj5Do7mi zfk7zkmWAQSSl3NMRtFqxpzUCcA+5a+sBt+Q30nP4aS/abUQnkpwWKsOD7OphWvM0O47PY jETK9iZ037zvzRVaakBrp8S44E7QPQB81QpcQ/ZhQ+1eTfddxQGTkJd3X2JKyKETK8AdFi f3xbaa+zEj3m8AekLzBiIMLvmUTfRZv6vY8o3gV6QN10scaLY97xSmKTbsYxvA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991210; a=rsa-sha256; cv=none; b=hjfV7/zB2dOHBsV4/c8MWZvfJ/JsIG+cS078pPjOXujbOtjREDVWHSp6ILlVN7+rSs4nGf 8sJ4wFKtgi4LJqsxvFVU7XDeD0N+lxQc2GrZqi0OGrkAm63mlcpuWpt0ow66wjn/TbZceL eQP7Q3YLuCH76drFg5VUdCil3Y3BsNZTFH3oEk3AiIJxzT22HYmKCgZFnT8+6ciL7vAPge arvevjsUZSyKtdDIRBivWZeZw9XnIdKAdlt7dkZPy3IS0YJIv31TPTrSMqEtZcbLy83Jga qXwY5P5FEkunAgSUYDPFHx2svfhq0QlRPDdSY1Arndg4eRHF/Qe7l2lLZXoGqw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D204254 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 07:20:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrT0W1Vw6z4g5Vg for ; Mon, 17 Oct 2022 07:20:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrT0W09Yxz3D0x for ; Mon, 17 Oct 2022 07:20:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrT0V6MQTzkXR for ; Mon, 17 Oct 2022 07:20:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H7KAcP032288 for ; Mon, 17 Oct 2022 07:20:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H7KAQE032287 for fs@FreeBSD.org; Mon, 17 Oct 2022 07:20:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 231251] [ZFS assfail] 12-ALPHA5 r338529 panic Date: Mon, 17 Oct 2022 07:20:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665991211; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bM9J2jHv6Hanfi22iCrIYk+7kiCN4BzB4xnk2A0hwgo=; b=mmimdABxhkYGlWQEAEtP2NyT01Ffn1LhxVm3EmJkEP2d0c7QIIKkvweEKkZPP82JNYLKH0 4sbu+BLcsfmlXtUKXpgFPgCH6At9UNRL7nfUYCdh77ZG6kpOkW364Yzj7LSWj90D21MiM5 ciUrOjMzgJ1orhzDqmlRRDxYmVJZSFwJRRhfwHoK/RkMEINpX76w4rI+KiMkxZdpRzBrfN R6ZRtnGS3/Wp021DHIRrCJXASlgUYlqSEfKLLADHk8wYMH60Tsn9RQyL+vsBnqtq6dcqGv id/MnypPFvfkrTyobjrM3eco7fm+AgznabM5pVOehqMHCY1HWHopFVdJXpazWA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665991211; a=rsa-sha256; cv=none; b=avwpm1C+eu/SsF4XfrVrEQ6vH9jq+VOd0vdFJqkFW2+ZeFyeC/pxx3pkaW1bth6o5NdRxO 5XOzAwYLZoJdLSwClNkhxiJUDWK2m7zNpIhJtDHN8cbNUw8exFChP4kuh209D3dO5Akn1i Dz0m/H2qlEsfnCmGrtviQ6VtrxXG/q7viikUYxw68+xzC5qSvIMhLATU1Y/hekH7u7wn// n13Un8dZq0gcph1g4v2T3qKpOiUU9pEoLQxvF5lAJe0gZ737HTAG5QWUIoEW93C5N6w2Lj PT+0kMkA2/crs2ALRMFFi5vY0U0doMn3GKb+7MkPqk8VbTiPV6dMRjuOp2AlBg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231251 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 08:58:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrW9y18Fdz4fK7l for ; Mon, 17 Oct 2022 08:58:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrW9x73rCz3QNg for ; Mon, 17 Oct 2022 08:58:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrW9x5xRCzlmF for ; Mon, 17 Oct 2022 08:58:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H8wTPl053178 for ; Mon, 17 Oct 2022 08:58:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H8wTTG053177 for fs@FreeBSD.org; Mon, 17 Oct 2022 08:58:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 231251] [ZFS assfail] 12-ALPHA5 r338529 panic Date: Mon, 17 Oct 2022 08:58:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665997110; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3JSyd2nsCfgulKHkkKKkYX8IL6XG3plj+CA2+eVz7ls=; b=Sm+lzF3Ski7GAQTOG8mF90evj4as0wnRPIdTnVmMgf06kEdvr17FiRuTBhr8+0BK2uLMFT MFHo7sOB0QCVWLRYlTRdPVMpS+XxlNTd35sZEYzhjAZJ9IGuTbYK7B8dtbsru1t/77wYi+ SSIZm5niGlszkEGcOhXSYyRAowzG2JKqt7lZJP0T5LIQMvMLaLys/5yGBxqRcfae2wdEy0 t1IEZNbTY1wjhER+3gaC2wRQ58gJbLnAROihl88laaqTBZJeQ7z9J3q2Vcq9h9dy2akeAd /G7a0QYvgbC0nzuFDXVBYlOyqj2b8G7POn6/UqWZZnM1/pi9k7CN0dpNW7zhpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665997110; a=rsa-sha256; cv=none; b=Qj7o6UqkqqRXOAMKjAAdZwCYIdBpN7TGKrY/cpKh1f6lqvzxhzPn7YST65/rlQXivF9uME IXQJur4TUnDTgWSet+YJmVe93ZvRIxf8rrkQM5kFcQwyzUnRnk2uOt+sbh0PKg0eC45thI 2l/+YCvxtnAVPlq39RxqdRB7IZwTj8GGeAcDNXHxSLUpgPTRLa/pi0r+B4wVYqOqh/MJla YBOW0VtcD8lh9MSFdEXlRSlVsgN1vCGv5LPJqv6UIviD8cTnhISZoSrb0u/yRcHu1SLja3 qsL4uRJ03LYxeHOopxN1fWyw4ZdtMearbn/cN0vusbPHz0bPwTPIL1ToNSCQaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231251 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |delphij@FreeBSD.org Status|New |Closed Resolution|--- |DUPLICATE --- Comment #19 from Xin LI --- *** This bug has been marked as a duplicate of bug 245683 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 09:02:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrWGv1ZMqz4fKny for ; Mon, 17 Oct 2022 09:02:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrWGv02Ymz3R2R for ; Mon, 17 Oct 2022 09:02:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrWGt6CDhzlnD for ; Mon, 17 Oct 2022 09:02:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29H92kUw064277 for ; Mon, 17 Oct 2022 09:02:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29H92kjU064275 for fs@FreeBSD.org; Mon, 17 Oct 2022 09:02:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251342] fs/unionfs: VOP_UNSET_TEXT without VOP_SET_TEXT leads to panic Date: Mon, 17 Oct 2022 09:02:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mizhka@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665997367; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jWJdBOS5nt3SC3wE5OUHcQxPza0n0UaivwAYYv+L5gw=; b=avOqAq6kpmLyofCWG+wY9Mjt33yzzOYhTmYpleb39g9daGyQpnGBCVhfsPUnh8TWaRYvSs mZtUQuMvQQM2lyhncsKkHq4ExnGAVPF5aGUbduwFD5uQNQU4oXV8O31f7I96RSRh56smcj IX4G/Yyt2PjxHTVmEK2Q3ao/Ah2TxG69ZZ41u5xxQQbc5g8vaS9Z93lB/a4VqBb921dhHd Qp6FzTuFtwWdyck/PoCW5fwx0LaKN4FAiZ+sD4gCn0W3GZgp5bTJ9DJ+MB0bWViY3zUjT0 OmrU0jlncWhj+quxcAsiDUE2H8Z53Td2IXPtn9SujWnwSuL+ecakTZfR97SeUA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665997367; a=rsa-sha256; cv=none; b=Ea9o1Ux2lojKjygxnQzYLHxWdk6TexXbHgrMHpvkpdAQPz0MvMY2HZR75sB0f9EcQy9noC GrjIziKyozZVX+xeJn7naZlFgGdgFHt1Z3V0RUbgYzamGmINvHy6Gk+mVQMTXqPmwA+SBY J0OPRlmd1Sm3NpFO4GWDC+UjPTTe1ZqC54Z/31pYnI56LB7w/a9woL6gyb+TaT+Zmf5fm0 RKEfHsXm22W9QOVpU49G1IdDm7SHTR8F/j6VVCrG456j0MvAQAFDZiMLvtL6zzAmkaqKsv xGLkzH74BjlT4J0TVL4LSVU6yRO22yj3el0Kyn/P9RI8WWW9Af3Lq/yMn7EL6Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251342 Michael Zhilin changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --- Comment #2 from Michael Zhilin --- As reporter, I confirms that fix works fine since 14.0, for validation i use only test case. Many thanks to jah@. Closed. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 11:45:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrZtz6s6rz4ffkx for ; Mon, 17 Oct 2022 11:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrZtz5dzwz3d8c for ; Mon, 17 Oct 2022 11:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrZtz4kC1znfD for ; Mon, 17 Oct 2022 11:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HBjlbR061620 for ; Mon, 17 Oct 2022 11:45:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HBjlvd061619 for fs@FreeBSD.org; Mon, 17 Oct 2022 11:45:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261059] Kernel panic XEN + ZFS volume. Date: Mon, 17 Oct 2022 11:45:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666007147; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iJ6xGKwW/SNm4VsjFXnJW0BB+Sa3LgpH+/3HIWP1IZs=; b=Kwfq4Q0JspHrYsiqTi8j0tmnlpB6jkaOX6eKVMLI6lQUuy0+EQzrcHJTP1y059/emiFncu s+v5X+qulJdHi8ZHnKpcxR4Hz8SeYLK9AqAkyeMEo/Pjcpg4uteNK6ZE93wF6GALU6krjU 9pwrkGwWNEvDk62vZPriCsdg2jF4t6rySCUnbWz1KIkLB3pQ6nky0c/cc/dNM2Jha8aXtD 2HgqRHOHFLyjbYHNOAdXrFDjFhKjNu5CV0vfMJp4uqZOEEoLbgvMIWyrKxSVFKWRgoBBKW EERVoeYADzch8+a0OXNaggWBIrZzgqyXA4SXoypUl+NZ81wpoUDF/QOM517wdg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666007147; a=rsa-sha256; cv=none; b=weNgOmySAj/aFAtjz5DUwnBfoExKQ9esI6LEodM5r4J3stst9TiPeuELfvMo3ApIV7SUL7 dlWudIjRzsC8Z4AKVbnP+F09Y+QKJDUwVTtTuKQM367fJmBWl9Df6z1m/3eYZG6vr4BUCu bEmleONolGjrwBxRuK81g2MA/k1V7sERkouKrZ/ENgfflslRuNFEq9zcyj5VqxFPAZLWM+ 4qoVwMzOorbxpR4psxl5rCXqj4mhvQzlAt1cgRaBpfqEBWbWqGue60kkjDt+YvOtPvwokh xN8rg8zO+/0O0jeUezTC42j1I2woqCd3zAgSNRVGn5wj5HNPupD/EutZYgXJiQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261059 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Status|New |Open --- Comment #6 from Graham Perrin --- If assignment is wrong, please reassign. Thank you. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:08:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrbPb21T3z4fjC9 for ; Mon, 17 Oct 2022 12:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrbPb0xvgz3ftc for ; Mon, 17 Oct 2022 12:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrbPZ71NPzp09 for ; Mon, 17 Oct 2022 12:08:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HC8oPF084944 for ; Mon, 17 Oct 2022 12:08:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HC8o4X084943 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:08:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261059] Kernel panic XEN + ZFS volume. Date: Mon, 17 Oct 2022 12:08:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666008531; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kDiAxKxYixz7MOcz1djtBqfnZuDNFwxQTMOclbXhvnw=; b=ZiEYI+MTzx+F/OAI9Vgi8mA5bjYv2riKfu8EsCQAWGyJ3s7t9Mhd/gBH6fN/PI4z0hFeop 2Qc6aPU/BNwcJdJs9eFXkR7BFf9hwLSXlOahvTxTLXTAqRjRbQVNDZ+L/ztqr8Jo92TIhF vYR4uTX74hRAFT9iMMO6T9M4h9t9t4SajCRC++wgDXzIaVUMlxAbmonBT1flyoU+C5hOio Q8z82MLVCscDwNJgF3UniA3gPVOS9ASy/pDrlFd1X7dD2fFbbC25n9p9U053lN/+D0MeoL yPSsGFvc7U2bk4skawSe1Tewup9z9JaRhEzcjIuZGjveBTWmib30Ofp1M7FqLg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666008531; a=rsa-sha256; cv=none; b=tOWPh4vhQDngoAfXr5U/4BXLpO7XotvdgNVuNsdgmPf1AeR8ZxrhnSNYj3BtCm1+MI8ecr 9aUGK5MBD5UkcMwJ7DZdbQfzlWyW5/hl+tmn6yk26x7pMriqXwGClH7Avgw1/v71e5yEas 1v3Yfs5XIGUNVOH2JCSOqw1DhwNKtr9oyjJHFO/GR96CfuzN0UFU6LEQ9lD6bKbmURWgXn H26PdVvVSTbJ/5TIzT8LdZzVSWZ2rd6Hyc4rHVXubM9x/WiWUeUVrTL6I7hub+0fQyqy+m tHSJqGUhB+5XNFEt3kTURyyVFSa0fOmKKL12bZBQF09cVLpReytH8pWDOHi7Bg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261059 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |xen@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:09:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrbQ826dVz4fj0Q for ; Mon, 17 Oct 2022 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrbQ80DS7z3gJc for ; Mon, 17 Oct 2022 12:09:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrbQ76R53zp2D for ; Mon, 17 Oct 2022 12:09:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HC9JAX085235 for ; Mon, 17 Oct 2022 12:09:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HC9JJn085234 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:09:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244899] zfs: xattr on a symlink target > 136 causes "bad file descriptor" (on 12.1) and panic on (13 CURRENT) in sa_build_index() Date: Mon, 17 Oct 2022 12:09:20 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc short_desc keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666008560; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QrGcxb0Uc8Jrz079gP+10M/iuxiPI+q2uYiFPp2/tKk=; b=dgpLZNM81QVnYoABNRW0RYht6RIQdyoiyv4A5euqurgwiJXpcDEsynv/ISlkphU4BnFHqM NnMceGTg8rC8PYVD7zfClt6RWMhzNytHK/POPJlRaQdURV6uzw6IbuuU5335j7LwNLMHH6 9Zp7aSFRjXyjQwJvHaL6z+qf3Stc1hEhPu9HaM9YxQFpMfSRIDkKHCLCUPdnetw2E0c05s 1PgDVK9bqbrzmg115Dnt4yYbOQdw15CePfZgPMQX/FVswLloOclBJqRyAqXvM3zcefRtdF gn+AAqgUWyQLRqgLIajdD34DC53c60vlS5dwVJS1AYgFgmwZPgq4AkXAF576/w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666008560; a=rsa-sha256; cv=none; b=tLpcox+JJ1SEGeDCnlL0crRLFqGpPs3/0l2+vcvtLVFsQVemkF/+7wvmQg+a697jaYaE4t N/8j7B+JCzFk9kDIvdIlWkRh9NdNaY/Da3xjax+fkzFfrfgzRWpT3/eB5pni8vHpeT6DUR KohdD5WMee2uvt0qBhJF3cg2DAO8vWqj2AiczXvQFo7+yD6z1tEt2jzIjnKhIf4K0mUQOs JspT6LYuo3UwH3iKVFQkiyvatBs9bQx2fSULJFsZN4sOAtYeX/cYMn0QBz8HrvHqWFSqbL 0jAGGiHRjmtC8I70UTtbg/QKkeJn1BM8Zf5qaQxyc9GtAoACW9iAv14gkSjicw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244899 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@freebsd.org Summary|[PATCH] zfs: xattr on a |zfs: xattr on a symlink |symlink target > 136 causes |target > 136 causes "bad |"bad file descriptor" (on |file descriptor" (on 12.1) |12.1) and panic on (13 |and panic on (13 CURRENT) |CURRENT) in |in sa_build_index() |sa_build_index() | Keywords| |patch --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Oct 17 12:17:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrbbL2KDlz4fkFt for ; Mon, 17 Oct 2022 12:17:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrbbK6fPmz3j7R for ; Mon, 17 Oct 2022 12:17:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrbbK5m9lzpMX for ; Mon, 17 Oct 2022 12:17:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCHHoY006367 for ; Mon, 17 Oct 2022 12:17:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCHHXh006366 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:17:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 193364] [panic] ffs_blkfree_cg: freeing free block Date: Mon, 17 Oct 2022 12:17:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666009037; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yoWuB2SQl4LZZRLEGfMJerxYv89k/n4Gu1AyEDUnq8Q=; b=DdZDvkmgsL8i9AHB/nq9zwCownnsdGU/9+aQg7LoEBo81PSfJ90qJXghbqyMuaTCuMhjOC FFLHN8yz7qnW/jy0cbuxRVS8DpigN7XDMMXYEqB/XW6aZjD4XoHHnHCx7Qj5+ER14NYXVQ qtA6gBP7JDfIeRugoxXs61OjDRPNKx2J2xG2UNO1UOw+HW7kfx06jzNO47y9fcl5A4u3fB O6W+FU5EJGvbKmr9FUJgLczuBQZ1TZzW/qqBo8nGCPv1uqlIydd/tFnGH0mPjfnc23tG42 uwC8O4RJwtJNaWpUGjyLbc+bIaErrq0Uql8vC5nxEc7MSib0oxXTOUc1ZBBs4g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666009037; a=rsa-sha256; cv=none; b=opvxm5/b2q+dAk2rH2mqSYCam2peyKsh10fOmYRtxye0PJdF8sD8cnmyP+eJ3XXj6uYqaC nsakZxrawIF/BhSuhtn6QVkb/zQwtyhVDd5GNuYHS0KpXn0CUSA6sk74zWnMYOTmMA9faq Ylao8FbRJ+oGoJtaHzUq2U9zERNBNNV7JlrOtug6id419J6jOfqQfUnr5EmhHzNCQXV4sO 40+zoaxSKZOa6p2wmfre3si/CdA9v0oFORmHiJc8DSQq+hJ92FAPqgbcg9iozmAOUA0jHY qm0xKVPJapSUA/GHDmHlFXeLVZI4SOp3+E1lJpRK5EeMpRuqoj4m4lZlzzSAXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D193364 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --- Comment #6 from Graham Perrin --- Keyword:=20 crash =E2=80=93 in lieu of summary line prefix:=20 [panic] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Oct 17 12:18:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrbcB6CMtz4fkX9 for ; Mon, 17 Oct 2022 12:18:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrbcB38qXz3mdp for ; Mon, 17 Oct 2022 12:18:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrbcB2HG2zp3p for ; Mon, 17 Oct 2022 12:18:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCI2wW007268 for ; Mon, 17 Oct 2022 12:18:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCI2Wh007267 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:18:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 211037] [panic] softdep_deallocate_dependencies: got error 6 while accessing filesystem Date: Mon, 17 Oct 2022 12:18:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666009082; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UgcWKGWrmaxgAMFgcb2myHKwVMk61HNsqK9sCIjfx7A=; b=Io6jgcm+ZcFTmuOlhh6gpZND0hrH+xg512Kyb3NdMs//zw1xsYAhgz7nKM9CK2uowCFSs1 LjpOgDggCqH5hwH5tXlit70W/5eSFMX8z0+0zm0Q7MebMJDtL/vXHeeNMqbqxn4naLchxN XRPAA2YXmlykaX0rg9Gg9ZPYWyXBJQ31RpS2+dt4N9jmH01fdkGp9hOaV6yhGbL5lbRPnK XfrkVers/gmH0qQYIlZPiR8XAu7V0v+bEbWzgcKCKydVT6sV5wkoN64KwciaDMRmlhwJ2e zcmgiYMbNRk/BwHw0BmkMQakDjU2gzU+rbmmMmKCho0XTTNKNUcOl4sYtY1R5w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666009082; a=rsa-sha256; cv=none; b=JFOhl9ao7RvvBUnNavv3nUHeJJMmK+KFXK6ezrnODTg9J62hLKZWWJidniqWdgB6GqZkE7 SNoYnzCKfF4M6zlNwKTo1WqF+I4mEaJpF3P6pAJ6IfSWwawu0f70VAL/+8BvhQADi4zB71 CiJSPwmBwvIMruGHRwl0tSSE5Piv5Fsx9AftBgdpPrK3NXj/jprgbcxw2kIG2+epIEILcz VMvCSzf6wQZdz/VqH6EOm7Gk5fBngSHG+PDnSxIAGETByW7CoQ0A+2l/OgdVYOqTnyZxTi SABpfgXIcGSgOXDd0YX1kFwOcvXPm/PlQ3pR+yqN5y6jTMPdJkL9IyieyL5rTw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D211037 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --- Comment #2 from Graham Perrin --- Keyword:=20 crash =E2=80=93 in lieu of summary line prefix:=20 [panic] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:18:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrbcY0Gjyz4fl41 for ; Mon, 17 Oct 2022 12:18:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrbcX5hPxz3nqj for ; Mon, 17 Oct 2022 12:18:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrbcX4mwGzpVx for ; Mon, 17 Oct 2022 12:18:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCIKpw007875 for ; Mon, 17 Oct 2022 12:18:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCIK4q007874 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:18:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255201] [panic] handle_written_inodeblock: Invalid link count -1 for inodedep Date: Mon, 17 Oct 2022 12:18:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666009100; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZEx3zXTibMCXCN+qn0MvvfKNg6Rx7Gd0D8pjNd85eNk=; b=acIu8Fv8604xFcp3X2xMFtX7hQfiXpTPHFbfE3Hjd/dslu1EDKCb9/FPSCpgfBvzYjkAm/ jojVKlFAY2Lhh//0tP+V5WUm/b0QT3hBlwZkMxGZgPdNfRlRO5YCB007tMI3ipL89SwnGO YQZhLGRHww9bPk2VtiM1F8KQRT8wVmFxSDVJC34BXRD5jzbS6KffSiMcmZBeY7Ef7zXPbf bnaw2o4X+Gz3nOdpS3lSyhfJCZUq9/pX5ncNd8mBkyLV3Azx1SeBBK/He+G0H7xGPilvZ5 HJafEFaz4NgF7cokcNFxH+AhzrjmRaKqt4/YdMvpoxHL0+//RXG6PHDUDP8fww== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666009100; a=rsa-sha256; cv=none; b=SW2mpUeaVedMFjyelb6qdgoVVkchuPA/0fzp80+TIuowcEF1mnA+zg+hGnS5Lhe1Fsu49z aBp10XINPcbh+XHW265SKjeFQtiwtvzE0nIjKo+xIcCimNhyhoZKperIqDHI7uBYtdeI48 X67jTHLM18TSl8AJDiXxKSsYlPrqs661Yj7BbINtNQbQZLvdrAF3fB0IAMwCVW7qPLj1Eg fFx1RSas1XnX8aEPHSAYx6lgbooyekFWuOmzLVRfdW1zdr8NGyUfqzyL/5vFRrfxCW5ylr w0OuWoZkeZvkiC58/5kIyaKEAX4pF68BEx/4jJCJMhsAeQ0H0wlIxcYBQ0wSJw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255201 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash --- Comment #1 from Graham Perrin --- Keyword:=20 crash =E2=80=93 in lieu of summary line prefix:=20 [panic] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:35:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mrc0s3svSz4fp8w for ; Mon, 17 Oct 2022 12:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mrc0s1BBvz3KkT for ; Mon, 17 Oct 2022 12:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mrc0s0JFRzpxs for ; Mon, 17 Oct 2022 12:35:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCZufv030705 for ; Mon, 17 Oct 2022 12:35:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCZujP030704 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:35:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 90815] [smbfs] [patch] SMBFS with character conversions sometimes hangs Date: Mon, 17 Oct 2022 12:35:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 6.0-STABLE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666010157; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QYD2smSAmfHnm5OJ3AKtZnlLNoCL9q/tDii9E4J4X9w=; b=mo/evtcBLDgrigWwWr0jLcgMy8UjwLAF5RnluhlAMmVIeWraliLQ5IaXWVWZLOEw4pr0gv BATAA2WiRyeDsPbyXuhAhKTOXKwk8pfKDic8EFmkRNilzj5BYZFWROT2RVknBdpUqnCoC6 rmPV2k1oaptVQNJVXUunh6TuozTgO5SZBYdg+no9Cvf/CFjKXxAjhRf0hnK70+bBhziQh0 9pY1qgk19wbeUBbFI3tl6Pu2SWHUNw68qPJaRq3DIVy+FaUb/RXx2zmymhKpD3JY00UFTC T2mmfd9J4UttagwWnUeVhW7rLzklQqdEU/gis/Bm9MvvfZe0Zdt2ckKr3JUAbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666010157; a=rsa-sha256; cv=none; b=vEIkvhqbSpY7MiMi30JPW5np6lX50Pk0KbV/fPwkEGpp2vRM7STS750mZmxyB4iwk8WPh0 8mK7S3WoBPhY7mpR4/xSjQ4SkCx517oTtUXig27lmegnqisHRD1ECInuNLtgOKFbuHQQ1G QCp6dtRApyASdeOQR5QxxM2nOCu6zbTS3ZLd+k9hbwUwqoGRELIQr2FBA5zj77skmXaDJJ c958zEfxvSXAOq71n1wBnZSbtd5tVS6cgn1HJx+rKyxIP0TVhgXDSzEu8vs71NkpR3VD9a iS4F8/Bv9oqycyj3e17F5hrJfuUAxJZ+ssB0ju1wduJtHR0bggjqSpknuLn31w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D90815 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --- Comment #11 from Graham Perrin --- Keyword:=20 patch or patch-ready =E2=80=93 in lieu of summary line prefix:=20 [patch] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:36:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mrc1043Slz4fpN0 for ; Mon, 17 Oct 2022 12:36:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mrc1022Q2z3LXT for ; Mon, 17 Oct 2022 12:36:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mrc1016dbzpkg for ; Mon, 17 Oct 2022 12:36:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCa4wM031110 for ; Mon, 17 Oct 2022 12:36:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCa4eP031109 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:36:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 147881] [zfs] [patch] ZFS "sharenfs" doesn't allow different "exports" options for different hosts Date: Mon, 17 Oct 2022 12:36:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666010164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JAmBrGxvYLrU2kvkY+e3X3SE874IW7T8SckrLGza31w=; b=WrQAiS60HdTcEv1iq7Caz81ghp46/IjRNYVyuCTpinCvBECs3bZmQAVy32HkezJy+vxAI6 XASp1S7t6oUBvk7CrhAcnrpkYCV2QZk+jVL8MQxeawslMCR44kgC9f2sNE5Lhw3B7Lq/Xe URgpNFBqGucRPBcJru8gL2Oq6p5rrzcBfpGYNmw3bPEQgCWsvNfe/36Rq80iWGxPuXdZxA A4zhw5PnBJ9Td9nZczUWKzeegmKH3hZJsx3szLBUWIJ+twNsUhCGmbxF+ShhOKTts4uYCI fIYqK9Fi7U+v9BtDFokV4vY1AUFpu90QPmkEvHdMT4CpSixwf2Ui0cqNFT9sbw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666010164; a=rsa-sha256; cv=none; b=V0csBr/QgU5AkyVRiMaeEsJYlFDZSXBmQHNLweSkD7fXRXbr+QoQ38YjFVikiB86OinE9S 6QQYHhkjNCQx7JY3niE6V5SeA2Sw/QKM8bYUViz9fLcmR8T5PyFEu6g7ivnVS0r4PuyEo9 uuWdioBMSIJn+km3DjgE+ZXkmDZQBjqz0JN4sKdcNZJJjAw+cMwVa7CwVRoOaEI39w/jlb lhs5dTB+howIu/kdN6lppKABCkslZ49O25x1k8oDcRhEDrxKL1YPWtUOm+x6qYIh6PV8eT LJ5JyJXZQh5WPhRAyG0uVy+zI7hKT80AjNA7ELUwMts3f8OSp/bI7wUggVeh5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D147881 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --- Comment #24 from Graham Perrin --- Keyword:=20 patch or patch-ready =E2=80=93 in lieu of summary line prefix:=20 [patch] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:36:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mrc1D0Cf6z4fpZ7 for ; Mon, 17 Oct 2022 12:36:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mrc1C5Kvtz3MF4 for ; Mon, 17 Oct 2022 12:36:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mrc1C4NWxzq3F for ; Mon, 17 Oct 2022 12:36:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCaFF4031526 for ; Mon, 17 Oct 2022 12:36:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCaFZN031525 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:36:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 112658] [smbfs] [patch] smbfs and caching problems (resolves bin/111004) Date: Mon, 17 Oct 2022 12:36:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 6.2-STABLE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666010175; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bAjGZ+72YKNYdJifuvXBVlbr4LEubGras4B89l0S/vQ=; b=BLiPYDhaNnHcV0QoqshY8tBoXZ3TDVLSMVENJpFn7xVZ/4pLln8xB/1B4RjVnL21CAAgjK iFHtX68NNM10yo4bsVHBJHb2zW7T7ylXxn3AVIYVUIKJxWzmqg8y5jKsTnwTwH6JSytmqw 5oh+KdipmmFRMvr3Jn8MYhlIfyPUsso9qFi7IaSOnPoJd2BEMUiCrJBqhuNlNL+f8JpJ67 oXns9aOkvf/bjQGobhhAAhi01hcACyfuoe5PslVkWmA78gM0lzzZNccT8IavgnK14C1VXW ply6n5nsu7eJsSkdJ+EWZF2sVyUK2H+DeisQyKyjsDZSG48xXCyagmyqXranuw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666010175; a=rsa-sha256; cv=none; b=MP5A0yzy2dVESG8RXpwwckf54xGlhSnrWjr20P7OiV0l0MkGIV5Lm+olWRShT833Tds+8j Q7PSoSd916oKkBTpZHmn1jtAzGNdZFIJJa81ZXEve7F0kNEEsdREar/RG1IQ+ZqpUoP740 077JmGHr7KPCQWXSmLVVSRiePdx0wBDCjB5gv+n/o6IY49GnYpOw3FCZ8QepyOBahi/mkU 0+BbRgP5wlJ/WNpi6s6iYBYfPSKMgv1u9KkDCVEu8P/pfLjMXobAtbk/zJ9/MCSYNgFcIW 27gDK2VIO7d60dvwwghfu1JlZQgM/IbS+p7ELy/WpnsMdKIQMesONXgAUPZ2AA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D112658 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --- Comment #5 from Graham Perrin --- Keyword:=20 patch or patch-ready =E2=80=93 in lieu of summary line prefix:=20 [patch] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:36:45 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mrc1n5HhBz4fpd1 for ; Mon, 17 Oct 2022 12:36:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mrc1n3yCmz3PR5 for ; Mon, 17 Oct 2022 12:36:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mrc1n34bQzq1Z for ; Mon, 17 Oct 2022 12:36:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCaj5D032162 for ; Mon, 17 Oct 2022 12:36:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCajXa032161 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:36:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 223015] [tmpfs] [patch] tmpfs does not support sparse files Date: Mon, 17 Oct 2022 12:36:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666010205; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9gbYBgf7mBMvZpWxd6XYAsJoYv2ndCayzlN5OHo++M0=; b=Ryn4lRP8S4cAvYIrEFVD5ma0pTKWQPJtObhub8APh0BTTgo9BvQ3lNf6aIspI+a/odQB/x abtboKox0QiONlVYjTJ+5uUpOUpaMxVV5IS1AWXPzJm2wKeyAB7PX3fxjqaEV7jwLLtZBp UipwZ/BSBuDJWm+VgoQ6Q2+Xmb1GcbELdHeZbwDM2O5aq2ltOQDXx4PU1Twv0327f7HJHv hX4SGa70ZtBWEeLfTFj67BvtZvJ9Oyx2WvqY1LrLwJhA+vk5T5N0Gorr+yi12bt5cjYlcV f4c7xI9kits05C8DpToZ9HAE/uaaMms8dLSwU+ehrmNXAV9Wi6pF2XDNbfK4Tw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666010205; a=rsa-sha256; cv=none; b=QrIqBURH5XX5c48BJdM1D+Yvl79XIsfImgSM/a2JOkAnMFk9qhG81NPrrK/oZzw8pPCtzY h9FfU0Slby1gVMemBhMd8nL72aLYpX3vo0Miv24E+xXt7/rGrAD4L8N69b6ePjftPmV8fv KRd/+QiXUTKY4oGA6n1+OA+K9Fo8DSRl0CxAe//QUz5PjuG44PG7p+hjIvmOTLHiKiU2ES /VA4lXENMNkM1Rxb4bAsB/294+2+phanolBT8s8pi8FiCq8r1DRuXK7Gw0MKX3V54qS1dd xR7QB3PZXTlkGLsOigbV6c4PzIlPtmL/vsiZzMyml1XEHBEWiNWzu/LIRHrF8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223015 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --- Comment #11 from Graham Perrin --- Keyword:=20 patch or patch-ready =E2=80=93 in lieu of summary line prefix:=20 [patch] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 12:40:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mrc6K2Mvjz4fs1k for ; Mon, 17 Oct 2022 12:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mrc6K0KFZz3kMk for ; Mon, 17 Oct 2022 12:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mrc6J6KGjzqXv for ; Mon, 17 Oct 2022 12:40:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HCeevh039489 for ; Mon, 17 Oct 2022 12:40:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HCeeAp039488 for fs@FreeBSD.org; Mon, 17 Oct 2022 12:40:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 149015] [zfs] [patch] misc fixes for ZFS code to build on Glibc Date: Mon, 17 Oct 2022 12:40:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666010441; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CKGisl8yszGyUgRMX7kPEpdawQhP7SfK0o2ozKp1sxk=; b=BjDckxvoNayLbUHmYbOPTwB9Mg9Mv/zaIzvx2NS0KY0/p3R0eMoyzPeqjL/2mu6BBvcI8R iA8KnYNnKtDW58FWuzJ7MaMJ7toL2ovAmdJYiekkodGQw9bpRdkaqThJ+/AD22DbEp0oJ1 fwbwxMdA66uHDCTURLEfM1znwOgtV3RHzdA3hkf3aru2tKaOwZKQfJyMnhg0claqLl9r6o JGDEeAQGt5/w63lMScD9eKZUuoWzLwB/UMBW8XiGVNsGA+beZVVwfL2afIh4fMbEaFQIs2 9XWbUSdN5b0XK3ersa+dyRQMcQ00t/0ALAfsQE67JUQeCs9d69qT96CLGU5qxQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666010441; a=rsa-sha256; cv=none; b=bvpLQiSKxMCxQ90YPJRESJRG42to6HrhGicxutoHkNLdDTslOMkTCYnXstpWSWDG4ll7my Ab7az7g7JG/4Is6ryBYBc4KfjgESOKUEmLLFqrhbhf9owaSufMLw0NqELgIJ0ZqRtfAaex wvOLmmSPjtZCr9GdAtPhlSe+4Xv217Ld9GjIlDGUhz1hJ1jIqkGri9j1FDgasMhK9HdsYj jeH+VMAAgguWwcIOJRu+atNZX2QQYMEvgiKFCVf4cpmYbZvdPRXpwr2OluEgFBJYaWLqC6 gam6dwQVGuadVk0bXByOraS0oe9CO68yMSelVQA88J6RP8AWmX2bAt/lKEDscQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D149015 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --- Comment #4 from Graham Perrin --- Keyword:=20 patch or patch-ready =E2=80=93 in lieu of summary line prefix:=20 [patch] * bulk change for the keyword * summary lines may be edited manually (not in bulk).=20 Keyword descriptions and search interface:=20 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 17 13:45:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MrdYf6zFMz4g0xR for ; Mon, 17 Oct 2022 13:45:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MrdYf4r8Qz46Ym for ; Mon, 17 Oct 2022 13:45:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MrdYf3tc7zrRL for ; Mon, 17 Oct 2022 13:45:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29HDjwHF017226 for ; Mon, 17 Oct 2022 13:45:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29HDjwUj017225 for fs@FreeBSD.org; Mon, 17 Oct 2022 13:45:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 211037] [panic] softdep_deallocate_dependencies: got error 6 while accessing filesystem Date: Mon, 17 Oct 2022 13:45:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not Enough Information X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666014358; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QdzVHfcOduKzQEJYah/p/CQ6ggHuPVP5HhXToSrToFA=; b=MQcqagwui+E9EbFmcbZs8lOTilVzamMjuiMOHQTHYzALcVUDcsewiiiYU6j9e5xdkY18Vg Qkm5d1Y87xEKEQsuHyosT718LnMzW0h7Pds/bDOhWWDKaQIFO4pMKyBXWD82cvxDoAVX1I 8cSyJiHVjhT4aNpHbdbM5s02GlUW4sNFrCVU/6gVSKvmz+3/GA4rfqrxbVsjvTTdUGwEad oBf18TDQx9s2a2QrdPZzCuVroA8PMCxZzLlR58UgroQu9KSKqD/srIHvOWrNQzSgyn6uXH Vt1ocLZj/AxbSNmyIFnx/sz7BdpfOY0bz9YMmK5sFCRofRdRI35Yzt4FVF/urA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666014358; a=rsa-sha256; cv=none; b=jd7bcwt26pPONqA+d2wOoX3QdaI9Fjoy/wf52+hITnTAIInCZ8xsFSn+/BbJGSbFgBXO1D IQP/rVuPOSebJsl/Y7b3aer5DLuvOivS22Ojd6NNX91YP5YWUPMHj5fpS+ugnGVhO2sYd+ knRtBWYSB7OK2w6gyvLPpPLSsfRD4ljAJHJEVBKn2sUAKSICG0KKx389lY2tIwSgK0QH67 031yqWtIS2Np8lKxrmjmoxIomjGOeOlr5L9timkWRlkzpRDp4J0smgoFgxZkkQYJQiff5Q jD5VXj5mBcsQLDuo0kRRmjr17eybQw5Ogj5nFRSASl+ASqUig6/fbDPpcl2o7Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D211037 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Not Enough Information CC| |mckusick@FreeBSD.org --- Comment #3 from Kirk McKusick --- Never able to reproduce and did not get any followup information. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 20 09:36:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MtMtM4yjmz4gLZt; Thu, 20 Oct 2022 09:36:27 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MtMtM4V0sz3KhR; Thu, 20 Oct 2022 09:36:27 +0000 (UTC) (envelope-from avg@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666258587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=aQzfZ3wdWfO+7mod652mAuWR8DKuyBIm3iGbts5Hnsg=; b=R+RaCoc+IZbanAThWhIjWNlJp2DvQlOyBA8wPhpO8M1Tir1JADVyRIyjpyJXlOnGjXpEn+ v61scxS7zCqvS0gTXDP9LvUfzSoynvBhnH/Bp3DzlzM8xMXBNJZ7Dupjn5Qm0E2PDn5eZZ UFsUJuUBCEdN3md+4RWHjKfgnYzN35HXJB4WfjER45BwNCyzpUSLwhSiFk/GV52s72+LQr WBtSi8yOiRw6CM2CbjFwKp/d3Ii1ofSZRC1pmD5rd7hkMIcFLVsrDswGAnlNcUJY49eSd4 OqQa0T6pFBHJ4KeARymm3+y21Iiq8lRb04HYJojDdwIo9alVDr/PRvOoS6I/tA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4MtMtM005bzThD; Thu, 20 Oct 2022 09:36:26 +0000 (UTC) (envelope-from avg@FreeBSD.org) Message-ID: <93085f3c-4592-8f46-fadb-ba0ee2d2ffa9@FreeBSD.org> Date: Thu, 20 Oct 2022 12:36:23 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Firefox/102.0 Thunderbird/102.4.0 Content-Language: en-US To: freebsd-stable List , freebsd-fs From: Andriy Gapon Subject: panic: condition seqc_in_modify not met, while replaying ZIL Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666258587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=aQzfZ3wdWfO+7mod652mAuWR8DKuyBIm3iGbts5Hnsg=; b=LVfRWehxSdKz5jEgKgmdU+CLCSKyka0k3GEX3Fl4lJEtG6/wDmSyo4c3RlEGrVxs+6zexB 99Re3pKKkop06DCAMaolOAhN1NoVJhNztQM4mmpuva/xjjh82rtWu51QrZ8QwVHJVRlYyw YUJcvo5gL+Uts3eF8iyNgF59xOeA0qOFXP0kHIRf4eUgmv0iFtnDRDYCoJ5fYBYHJCWPUT 4SPFjoaZLGv4mhBIP3uTGw8L2VK3nGPvdh3U+J2T8yDYA1Nz0mELMMpQ1TixV2ARHMNXXA TioqhfbHzXsxT5nbp+nE2RXZ7aLRDcEgCw7GUczpZ0Kh+ZWGgAjWKReAXpuMzQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666258587; a=rsa-sha256; cv=none; b=J48e1IcFsrv1EpksrgtEfp8iCTPcxcNDH39wfSavI1OkCC2hr6tf9yXbHC1fG0r3Y8E9Y+ kKNEHrU2fdwR70ks37S4Wo/iywLDXVsFiUByhp53k4VZ8YZYyvnmGxdhczdxXIuUrmLQBl gV56NpwzHlM3yjvszYsBpALsFQrkS8OZDdTfji74JY7NuhYG+u1LxZre9z4SvzAaiW9yP0 Ks1slqB4OsyDbCSmcbPj4jvOVqcCe2EHwDsIBNgb1tsYkYws3L+WSKGZLmxIaRsrMlGj9x 2ZxXZtzlnI1jfH616hh19YuI4p/h8k6cg5dHO55WJqZaJ+FtmWbziQ+PzET/5A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N This happens on stable/13, custom kernel compiled with DEBUG_VFS_LOCKS, from mid-September after an ungraceful reboot (unrelated crash). As far as I can see in kgdb, both dvp and vp have v_seqc == 0. VNASSERT failed: ({ seqc_t __seqc = (_vp->v_seqc); __builtin_expect((__seqc & 1), 0); }) not true at /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 (cache_vop_rmdir) 0xfffff8004bc0bd58: type VDIR usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 hold count flags () flags () lock type zfs: UNLOCKED panic: condition seqc_in_modify(_vp->v_seqc) not met at /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 (cache_vop_rmdir) cpuid = 5 time = 1666250711 KDB: stack backtrace: db_trace_self_wrapper() at 0xffffffff8061549b = db_trace_self_wrapper+0x2b/frame 0xfffffe01ce6c7090 kdb_backtrace() at 0xffffffff80942927 = kdb_backtrace+0x37/frame 0xfffffe01ce6c7140 vpanic() at 0xffffffff808f4fb4 = vpanic+0x184/frame 0xfffffe01ce6c71a0 panic() at 0xffffffff808f4d63 = panic+0x43/frame 0xfffffe01ce6c7200 cache_vop_rmdir() at 0xffffffff809b9b9f = cache_vop_rmdir+0xdf/frame 0xfffffe01ce6c7220 zfs_rmdir_() at 0xffffffff80391cff = zfs_rmdir_+0x1df/frame 0xfffffe01ce6c7290 zfs_rmdir() at 0xffffffff80391af8 = zfs_rmdir+0x48/frame 0xfffffe01ce6c7310 zfs_replay_remove() at 0xffffffff804fc53b = zfs_replay_remove+0x7b/frame 0xfffffe01ce6c7340 zil_replay_log_record() at 0xffffffff80508462 = zil_replay_log_record+0x212/frame 0xfffffe01ce6c7490 zil_parse() at 0xffffffff80502f4b = zil_parse+0x5cb/frame 0xfffffe01ce6c76a0 zil_replay() at 0xffffffff805081d8 = zil_replay+0xd8/frame 0xfffffe01ce6c7700 zfsvfs_setup() at 0xffffffff8038f09d = zfsvfs_setup+0x24d/frame 0xfffffe01ce6c7930 zfs_mount() at 0xffffffff8038c9b2 = zfs_mount+0x652/frame 0xfffffe01ce6c7ad0 vfs_domount_first() at 0xffffffff809d0d66 = vfs_domount_first+0x216/frame 0xfffffe01ce6c7c00 vfs_domount() at 0xffffffff809cdd43 = vfs_domount+0x2d3/frame 0xfffffe01ce6c7d30 vfs_donmount() at 0xffffffff809ccb6f = vfs_donmount+0x81f/frame 0xfffffe01ce6c7dc0 sys_nmount() at 0xffffffff809cc318 = sys_nmount+0x108/frame 0xfffffe01ce6c7df0 amd64_syscall() at 0xffffffff80c31d16 = amd64_syscall+0x186/frame 0xfffffe01ce6c7f30 fast_syscall_common() at 0xffffffff80c0889b = fast_syscall_common+0xf8/frame 0xfffffe01ce6c7f30 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0xb6aac9dd1a, rsp = 0xb6b538f468, rbp = 0xb6b538f4d0 --- Uptime: 37s Dumping 1426 out of 32644 MB: (CTRL-C to abort) ..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% -- Andriy Gapon From nobody Thu Oct 20 14:32:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MtVSV0Kk3z4fT1L; Thu, 20 Oct 2022 14:32:58 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc2f.google.com (mail-oo1-xc2f.google.com [IPv6:2607:f8b0:4864:20::c2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MtVST2nRNz3y1h; Thu, 20 Oct 2022 14:32:57 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-oo1-xc2f.google.com with SMTP id r11-20020a4aa2cb000000b004806f49e27eso4010019ool.7; Thu, 20 Oct 2022 07:32:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=/F8ysxKQPNWjg9y9yqeGD1E4zX5t7vzcXV5NeFpk/UY=; b=Q2cDrNpah/F6Gz0FQTecgVcd0N8kYxOSXozjLT8tKZ7Y2ntjCGv5cLSufMGbnW+tT5 gYwvJtDx9F4aYaGCPaqlHJabyRWYAIId9aNAo/ugTmcWbgZ7VHI4AbE4wU4FbBAdTj2m JyWJM4tzIsbeHrvaPn1jYNgSswYbw2mQ6HrinhnsYHGT4lQ9d1Cbr0ZzVsHPzk0bH4az LRQASTr36Ym7eAFBdW42hVibcbTyrKull0HLPS75v64Q/KZ/1M3n0YKr+8sMMyu3l3e1 e9eiW9gX84IkO56OqnEAjfK76/ZGFFM+G3gMLViuKo9HvlkQwcS9Eq7EnYokHKRsEyn0 8hNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=/F8ysxKQPNWjg9y9yqeGD1E4zX5t7vzcXV5NeFpk/UY=; b=PSmmIJudnfgF9XowZVRYx0a78u+D/F+U5pZkQogk6oqpUFZ+1nP4njNn0EC8lfpbRS FXVEMR4FnxrItdhEZfLeEBixJx8+z9vybXmrX88PTuOcQuDT68tdFVPCTxAMgnVOtE23 Ekn7N+tAZLpoi9HPmtfgi2nJ9pY6oF8l4eFYUDls+Fomy2iMf81a67dpP5+lZQ3FPLRw 65WvtSluGCRkxIZr0ngIRlheH+inM3Ks23+OO+EW4Bt7c6o6CfRKDaUvbIert3s4qiAR HmijlRpnA7bm0/NvUq3j+CF9LBMEIBDQ2NwbVWr/DKJnq0xmo1tvcWkarc6L6tt7scqW bERA== X-Gm-Message-State: ACrzQf2zq1fEonxbS9zjpZuuJx+heWKkpFeiO1QjUD1xIbCMzmzqXfLe MNiqF3itW6YPzOsv0swtS2cJVoBWAraop6qJ5kqj9A2w X-Google-Smtp-Source: AMsMyM6C4nm3b5xVGnIPKLuwISkVD5vqpp24aAPmRxrFBQ8HgYuX8OauKTqmu6ZyLF27xAiYpS69IjfjCN3wgKZYV9w= X-Received: by 2002:a4a:b447:0:b0:480:9c98:46a3 with SMTP id h7-20020a4ab447000000b004809c9846a3mr6449078ooo.14.1666276376322; Thu, 20 Oct 2022 07:32:56 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:351:0:b0:478:5e54:a9c8 with HTTP; Thu, 20 Oct 2022 07:32:55 -0700 (PDT) In-Reply-To: <93085f3c-4592-8f46-fadb-ba0ee2d2ffa9@FreeBSD.org> References: <93085f3c-4592-8f46-fadb-ba0ee2d2ffa9@FreeBSD.org> From: Mateusz Guzik Date: Thu, 20 Oct 2022 16:32:55 +0200 Message-ID: Subject: Re: panic: condition seqc_in_modify not met, while replaying ZIL To: Andriy Gapon Cc: freebsd-stable List , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MtVST2nRNz3y1h X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Q2cDrNpa; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2607:f8b0:4864:20::c2f as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[stable@freebsd.org,fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c2f:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N This is a false-positive -- the seqc stuff is not modified on replay and zfs internal asserts check for it. I think the easiest way forward for this one is to appease the assert by entering it seqc. That said, could it be it is an invariant there are no nc entries at this stage anyway and the call to cache_vop_rmdir can be avoided? I can add cache_assert_no_entries or similar routine to be called instead. On 10/20/22, Andriy Gapon wrote: > > This happens on stable/13, custom kernel compiled with DEBUG_VFS_LOCKS, from > > mid-September after an ungraceful reboot (unrelated crash). As far as I can > see > in kgdb, both dvp and vp have v_seqc == 0. > > VNASSERT failed: ({ seqc_t __seqc = (_vp->v_seqc); __builtin_expect((__seqc > & > 1), 0); }) not true at > /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 > > (cache_vop_rmdir) > 0xfffff8004bc0bd58: type VDIR > usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 > hold count flags () > flags () > lock type zfs: UNLOCKED > panic: condition seqc_in_modify(_vp->v_seqc) not met at > /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 > > (cache_vop_rmdir) > cpuid = 5 > time = 1666250711 > KDB: stack backtrace: > db_trace_self_wrapper() at 0xffffffff8061549b = > db_trace_self_wrapper+0x2b/frame > 0xfffffe01ce6c7090 > kdb_backtrace() at 0xffffffff80942927 = kdb_backtrace+0x37/frame > 0xfffffe01ce6c7140 > vpanic() at 0xffffffff808f4fb4 = vpanic+0x184/frame 0xfffffe01ce6c71a0 > panic() at 0xffffffff808f4d63 = panic+0x43/frame 0xfffffe01ce6c7200 > cache_vop_rmdir() at 0xffffffff809b9b9f = cache_vop_rmdir+0xdf/frame > 0xfffffe01ce6c7220 > zfs_rmdir_() at 0xffffffff80391cff = zfs_rmdir_+0x1df/frame > 0xfffffe01ce6c7290 > zfs_rmdir() at 0xffffffff80391af8 = zfs_rmdir+0x48/frame 0xfffffe01ce6c7310 > zfs_replay_remove() at 0xffffffff804fc53b = zfs_replay_remove+0x7b/frame > 0xfffffe01ce6c7340 > zil_replay_log_record() at 0xffffffff80508462 = > zil_replay_log_record+0x212/frame 0xfffffe01ce6c7490 > zil_parse() at 0xffffffff80502f4b = zil_parse+0x5cb/frame > 0xfffffe01ce6c76a0 > zil_replay() at 0xffffffff805081d8 = zil_replay+0xd8/frame > 0xfffffe01ce6c7700 > zfsvfs_setup() at 0xffffffff8038f09d = zfsvfs_setup+0x24d/frame > 0xfffffe01ce6c7930 > zfs_mount() at 0xffffffff8038c9b2 = zfs_mount+0x652/frame > 0xfffffe01ce6c7ad0 > vfs_domount_first() at 0xffffffff809d0d66 = vfs_domount_first+0x216/frame > 0xfffffe01ce6c7c00 > vfs_domount() at 0xffffffff809cdd43 = vfs_domount+0x2d3/frame > 0xfffffe01ce6c7d30 > vfs_donmount() at 0xffffffff809ccb6f = vfs_donmount+0x81f/frame > 0xfffffe01ce6c7dc0 > sys_nmount() at 0xffffffff809cc318 = sys_nmount+0x108/frame > 0xfffffe01ce6c7df0 > amd64_syscall() at 0xffffffff80c31d16 = amd64_syscall+0x186/frame > 0xfffffe01ce6c7f30 > fast_syscall_common() at 0xffffffff80c0889b = fast_syscall_common+0xf8/frame > > 0xfffffe01ce6c7f30 > --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0xb6aac9dd1a, rsp = > 0xb6b538f468, rbp = 0xb6b538f4d0 --- > Uptime: 37s > Dumping 1426 out of 32644 MB: (CTRL-C to abort) > ..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% > > -- > Andriy Gapon > -- Mateusz Guzik From nobody Fri Oct 21 05:04:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MtspM0zYPz4gc3x for ; Fri, 21 Oct 2022 05:04:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MtspL4Vvpz3rZb for ; Fri, 21 Oct 2022 05:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MtspL3XQDz168n for ; Fri, 21 Oct 2022 05:04:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29L54gj7041097 for ; Fri, 21 Oct 2022 05:04:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29L54gME041096 for fs@FreeBSD.org; Fri, 21 Oct 2022 05:04:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 199405] Panic trying to mount ZFS pool after 10.1 update Date: Fri, 21 Oct 2022 05:04:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666328682; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pBExdisQ29l1pRajm/etQNoGaj0q4NDa4YsA/UNf5Ws=; b=ghVN0u+4na8x0fzIjIUfmNMxg2bXqe43T2xdNNzYVih8mrHcXiOxi9Q74gsZd1fGpmAQow osFXJ2sk43QvKoFqxDYM4ry6PNJHLe+Fr0nyPXE1GfOwDtyl328hI3iMtVFqV/P3xfRE+o JzXG87KbmT+hvHQ/A91ITXaADrY/gMnZbtz8lE4SUrVZE/hCAriijZ5MjlZ4ZDea8if2+X 1F1+7A3LN4+M4JFA48n0l5WFhvuK/IlbGvBceEwuV/q4S1cHBKFtbKUFTjCgfXa+9NaH2h GRVUN5BEgHSTlslOWvWQe+pJodjwWDEd/0ph4eNgbSBtG8xpFiWAOzheOwEkUQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666328682; a=rsa-sha256; cv=none; b=RNmNQvAhzSjIcCxJUIxPHE1z17BcMDASaYHYccaqmK31guZ7gNa3eIbClyBtPge+AX76ZD BYGmpsCnqqIb1CDDd1FPdSP5SjVG2QWXbR6P0sk08iO//C0CKEjUdT1FajbOhG2VLAZVbs 9cnd+EptO70d6JM272P7TgI0lTZAjr/qVVwVuo9UtHdajcvwAtivBBDT03gtcLaLUGlTNH UZflFngTA48u1DWG2ZoJKwijPz6ujQqB76xPMeqh0nHn3KMNNrwYHs8llAH/XAKIVLuKXA TGssAeGDvDoDfDxHDY0rqpzZiWM/qX606+hPsyoi76Fgwjpj1DDdOjMmYdHfQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199405 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events Status|New |Closed --- Comment #10 from Xin LI --- This _might_ be fixed by https://github.com/openzfs/zfs/commit/c7a4255f128cc493df8383cb9f1ed650191b2= 081 but unfortunately we were unable to tell with the available information, so marking this as overcome by events. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 22 14:15:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mvjyx6H5Yz4g2FV for ; Sat, 22 Oct 2022 14:15:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mvjyx5Dvnz3jhn for ; Sat, 22 Oct 2022 14:15:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mvjyx49ZszZwg for ; Sat, 22 Oct 2022 14:15:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29MEF5Yl085934 for ; Sat, 22 Oct 2022 14:15:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29MEF5R2085933 for fs@FreeBSD.org; Sat, 22 Oct 2022 14:15:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244899] zfs: xattr on a symlink target > 136 causes "bad file descriptor" (on 12.1) and panic on (13 CURRENT) in sa_build_index() Date: Sat, 22 Oct 2022 14:15:04 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lab+bsd@thinkum.space X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666448105; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Z6hFDpCOYNqFjQsj7ZuyivH7pGCZ8ljGkusB4XnSyqI=; b=WAlTrqLvx4/qNukeurT8C9fr73rg1q/S0G7NBGw+VTHZYroNEpqfXD4DjuW2HkhuGEr2vD qhzk0cbzLAvbzJmxCwVP3EpMsErlhkdcxXEzIDwRsBK1MPbn7ppLkbgBLHSZbho4G67yxK fYlKueZBhuNum7NjzOxKljLXaRrOOCgeyXI5m1jShkWXQ5i4UpChqq+kunbZqAkEdZh2KV rVYshBCRX7RK+d7snP1+HAJI+wKbhT1rOM7THLXw7UCgnSgztTFayo8YbEeGjICGox99jc TLS1U4DYNSNnnQtwMlaWsgBBEokbf+zf/WDzIAVcfDsvePsD2qXCPM4DgH+ehQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666448105; a=rsa-sha256; cv=none; b=MxrCkUiZBHSu3ppWgzQFgy++qKZAu3QtN8f/0ywvm7ckT3b3m1tP4JjppYXbplt5t4dOKN +a0GnoUBTexw/Jf8B/XHwdnTH87wPahhA+9flRWz10DOv8AbsDPAVsS4Obt6k2BJrZ9/aN G0NvVN5c2PF4oHDpRx2wgK+UVaJ4KQMM4HC+DNOjmts4fyjCXEv2f79LN5y/ZkcWJ9mL8N Nx4IjS2GhDe/RtaJlPekn706ri+0jouR+rYBZeyLpffZdTc5sFtXcLDLoyXbBWKqhqJ6dh LLHFHiewXq9KLOtXRulyPR31pMgE4UhzbU56PYfsZv7RYBzE3q+sFioDcGAQjw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244899 --- Comment #8 from Sean Champ --- For what it's worth, I started seeing this error again, for a significant number of port builds, using zfs in poudriere. Example from an llvm13 build, during the build-depends stage: ~~~~ =3D=3D=3D> llvm13-13.0.1_3 depends on executable: ninja - not found =3D=3D=3D> Installing existing package /packages/All/ninja-1.11.1,2.pkg [xmin.bld.cloud.thinkum.space] Installing ninja-1.11.1,2... [xmin.bld.cloud.thinkum.space] `-- Installing python38-3.8.15... [xmin.bld.cloud.thinkum.space] | `-- Installing libffi-3.4.3... [xmin.bld.cloud.thinkum.space] | `-- Extracting libffi-3.4.3: .......... = done [xmin.bld.cloud.thinkum.space] | `-- Installing mpdecimal-2.5.1... [xmin.bld.cloud.thinkum.space] | `-- Extracting mpdecimal-2.5.1: ........= .. done [xmin.bld.cloud.thinkum.space] | `-- Installing readline-8.1.2... [xmin.bld.cloud.thinkum.space] | `-- Extracting readline-8.1.2: .......... done [xmin.bld.cloud.thinkum.space] `-- Extracting python38-3.8.15: ... pkg-static: Fail to chown /usr/local/lib/python3.8/idlelib/idle_test/.pkgtemp.test_squeezer.py.bFIrNz= t0LFou:Bad file descriptor ~~~~ uname in this instance: ~~~~ FreeBSD xmin.cloud.thinkum.space 13.1-STABLE FreeBSD 13.1-STABLE #0 build/stable/13-n252436-b63021e001d: Sun Oct 9 05:52:29 PDT 2022=20=20=20= =20 gimbal@xmin.cloud.thinkum.space:/usr/obj/xmin_FreeBSD-13.1-STABLE_amd64/usr= /src/amd64.amd64/sys/XMIN amd64 ~~~~ i.e kernel was built from changeset: b63021e001d in the stable/13 branch.=20 If it's not an absurd question, could this be related to to the number of o= pen file descriptors?=20 At the time of the errors - with some hundred+ similar build failures while using zfs in poudriere - I'd noticed that the single user gvfsd-trash proce= ss had approx 10603 file descriptors showing under 'fstat -p'. I've terminated this process and tried the poudriere build again. Those errors as I was see= ing here are not showing up now. As a workaround, I'm going to use the following to try to disable gvfsd-tra= sh in effect: ~~~~ mkdir -p /usr/local/etc/gvfs/mounts for F in /usr/local/share/gvfs/mounts/*.mount; do install -l rs $F /usr/local/etc/gvfs/mounts/$(basename $F); done rm /usr/local/etc/gvfs/mounts/trash.mount ~~~~ then in /etc/profile ~~~~ if [ -e /usr/local/etc/gvfs/mounts ]; then export GVFS_MOUNTABLE_DIR=3D/usr/local/etc/gvfs/mounts fi ~~~~ Of course, this would not guarantee that /usr/local/etc/gvfs/mounts would s= tay in sync with /usr/local/share/gvfs/mounts/ then. Alternately, one could pat= ch the devel/gvfs port to add an option to remove trash.mount before packaging This correlation may not illustrate a causal relation - e.g between the num= ber of file descriptors in the gvfsd-trash process and the build failures under poudriere with ZFS. After closing then disabling gvfsd-trash, I'm not seeing those failures now, in the local ports build. I'll try rebuilding the kernel with those options. My kernconf from sysctl kern.conftxt: ~~~~ kern.conftxt: options CONFIG_AUTOGENERATED ident XMIN machine amd64 cpu HAMMER cpu HAMMER cpu HAMMER makeoptions MODULES_EXTRA=3Dacpi/acpi_rapidstart makeoptions WITH_CTF=3D1 makeoptions DEBUG=3D-g options IPI_PREEMPTION options MSDOSFS_ICONV options CD9660_ICONV options LIBICONV options FDESCFS options FUSEFS options GEOM_PART_VTOC8 options GEOM_PART_LDM options GEOM_PART_BSD64 options GEOM_PART_APM options X86BIOS options ENABLE_ALART options DUMMYNET options VT_ALT_TO_ESC_HACK=3D1 options MSGBUF_SIZE=3D(32*PAGE_SIZE) options PANIC_REBOOT_WAIT_TIME=3D-1 options HZ=3D1000 options IICHID_SAMPLING options HID_DEBUG options EVDEV_SUPPORT options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options IEEE80211_SUPPORT_MESH options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options PPS_SYNC options COMPAT_LINUXKPI options PCI_IOV options PCI_HP options IOMMU options EARLY_AP_STARTUP options SMP options NETGDB options NETDUMP options DEBUGNET options ZSTDIO options GZIO options EKCD options KDB_TRACE options KDB options RCTL options RACCT_DEFAULT_TO_DISABLED options RACCT options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options CAPABILITIES options CAPABILITY_MODE options AUDIT options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=3D128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=3D5000 options COMPAT_FREEBSD12 options COMPAT_FREEBSD11 options COMPAT_FREEBSD10 options COMPAT_FREEBSD9 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options EFIRT options GEOM_LABEL options GEOM_RAID options TMPFS options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options KERN_TLS options SCTP_SUPPORT options TCP_RFC7413 options TCP_HHOOK options TCP_BLACKBOX options TCP_OFFLOAD options FIB_ALGO options ROUTE_MPATH options IPSEC_SUPPORT options INET6 options INET options VIMAGE options PREEMPTION options NUMA options SCHED_ULE options NEW_PCIB options GEOM_PART_GPT options GEOM_PART_MBR options GEOM_PART_EBR options GEOM_PART_BSD options GEOM_PART_BSD options GEOM_PART_EBR options GEOM_PART_MBR options GEOM_PART_GPT options NEW_PCIB options SCHED_ULE options NUMA options PREEMPTION options VIMAGE options INET options INET6 options IPSEC_SUPPORT options ROUTE_MPATH options FIB_ALGO options TCP_OFFLOAD options TCP_BLACKBOX options TCP_HHOOK options TCP_RFC7413 options SCTP_SUPPORT options KERN_TLS options FFS options SOFTUPDATES options UFS_ACL options UFS_DIRHASH options UFS_GJOURNAL options QUOTA options MD_ROOT options NFSCL options NFSD options NFSLOCKD options NFS_ROOT options MSDOSFS options CD9660 options PROCFS options PSEUDOFS options TMPFS options GEOM_RAID options GEOM_LABEL options EFIRT options COMPAT_FREEBSD32 options COMPAT_FREEBSD4 options COMPAT_FREEBSD5 options COMPAT_FREEBSD6 options COMPAT_FREEBSD7 options COMPAT_FREEBSD9 options COMPAT_FREEBSD10 options COMPAT_FREEBSD11 options COMPAT_FREEBSD12 options SCSI_DELAY=3D5000 options KTRACE options STACK options SYSVSHM options SYSVMSG options SYSVSEM options _KPOSIX_PRIORITY_SCHEDULING options PRINTF_BUFR_SIZE=3D128 options KBD_INSTALL_CDEV options AUDIT options CAPABILITY_MODE options CAPABILITIES options MAC options KDTRACE_FRAME options KDTRACE_HOOKS options DDB_CTF options INCLUDE_CONFIG_FILE options RACCT options RACCT_DEFAULT_TO_DISABLED options RCTL options KDB options KDB_TRACE options EKCD options GZIO options ZSTDIO options DEBUGNET options NETDUMP options NETGDB options SMP options EARLY_AP_STARTUP options IOMMU options PCI_HP options PCI_IOV options COMPAT_LINUXKPI options PPS_SYNC options VESA options SC_PIXEL_MODE options IEEE80211_DEBUG options IEEE80211_SUPPORT_MESH options AH_AR5416_INTERRUPT_MITIGATION options ATH_ENABLE_11N options USB_DEBUG options XENHVM options EVDEV_SUPPORT options HID_DEBUG options IICHID_SAMPLING options SCHED_ULE options NUMA options PREEMPTION options VIMAGE options INET options INET6 options IPSEC_SUPPORT options ROUTE_MPATH options FIB_ALGO options TCP_OFFLOAD options TCP_BLACKBOX options TCP_HHOOK options TCP_RFC7413 options SCTP_SUPPORT options KERN_TLS options FFS options SOFTUPDATES options UFS_ACL options UFS_DIRHASH options UFS_GJOURNAL options QUOTA options MD_ROOT options NFSCL options NFSD options NFSLOCKD options NFS_ROOT options MSDOSFS options CD9660 options PROCFS options PSEUDOFS options TMPFS options GEOM_RAID options GEOM_LABEL options EFIRT options COMPAT_FREEBSD32 options COMPAT_FREEBSD4 options COMPAT_FREEBSD5 options COMPAT_FREEBSD6 options COMPAT_FREEBSD7 options COMPAT_FREEBSD9 options COMPAT_FREEBSD10 options COMPAT_FREEBSD11 options COMPAT_FREEBSD12 options SCSI_DELAY=3D5000 options KTRACE options STACK options SYSVSHM options SYSVMSG options SYSVSEM options _KPOSIX_PRIORITY_SCHEDULING options PRINTF_BUFR_SIZE=3D128 options KBD_INSTALL_CDEV options AUDIT options CAPABILITY_MODE options CAPABILITIES options MAC options KDTRACE_FRAME options KDTRACE_HOOKS options DDB_CTF options INCLUDE_CONFIG_FILE options RACCT options RACCT_DEFAULT_TO_DISABLED options RCTL options KDB options KDB_TRACE options EKCD options GZIO options ZSTDIO options DEBUGNET options NETDUMP options NETGDB options SMP options EARLY_AP_STARTUP options IOMMU options PCI_HP options PCI_IOV options COMPAT_LINUXKPI options PPS_SYNC options VESA options SC_PIXEL_MODE options IEEE80211_DEBUG options IEEE80211_SUPPORT_MESH options AH_AR5416_INTERRUPT_MITIGATION options ATH_ENABLE_11N options USB_DEBUG options XENHVM options EVDEV_SUPPORT options HID_DEBUG options IICHID_SAMPLING options HZ=3D1000 options PANIC_REBOOT_WAIT_TIME=3D-1 options MSGBUF_SIZE=3D(32*PAGE_SIZE) options HZ=3D1000 device isa device mem device io device uart_ns8250 device cpufreq device acpi device smbios device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device isci device ocs_fc device pvscsi device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device iir device ips device mly device twa device smartpqi device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device pmspcv device twe device nvme device nvd device vmd device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device vt_efifb device vt_vbefb device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device iflib device em device igc device ix device ixv device ixl device iavf device ice device vmx device axp device bxe device le device ti device mlx5 device mlxfw device mlx5en device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device jme device lge device msk device nfe device nge device re device rl device sge device sis device sk device ste device stge device vge device vr device xl device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wpi device crypto device aesni device loop device padlock_rng device rdrand_rng device ether device vlan device tuntap device md device gif device firmware device xz device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device rtsx device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device kvm_clock device hyperv device xenpci device netmap device evdev device uinput device hid device smbus device smb device intpm device imcsmb device ipmi device nvram device dpms device atpic device mptable device acpi_hp ~~~ This kernel build had also used the following, in files locally included un= der /usr/src/sys/amd64/conf/ ~~~~ nooptions WITNESS nooptions WITNESS_KDB nooptions WITNESS_SKIPSPIN nooptions LOCK_PROFILING nooptions CALLOUT_PROFILING nooptions SLEEPQUEUE_PROFILING nooptions TURNSTILE_PROFILING nooptions UMTX_PROFILING nooptions MBUF_PROFILING nooptions INVARIANTS nooptions INVARIANT_SUPPORT ~~~~ I'll try adding the options recommended above ~~~~ makeoptions BUILD_OPTIMIZED=3DNO makeoptions COPTFLAGS=3D-O0 ~~~~ --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Oct 22 16:55:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MvnWZ0bRmz4gQfM for ; Sat, 22 Oct 2022 16:55:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MvnWY138lz3y83 for ; Sat, 22 Oct 2022 16:55:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MvnWY07htzcdF for ; Sat, 22 Oct 2022 16:55:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29MGt4R6091710 for ; Sat, 22 Oct 2022 16:55:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29MGt4GS091709 for fs@FreeBSD.org; Sat, 22 Oct 2022 16:55:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267009] OpenZFS: panic: VERIFY3(0 == nvlist_lookup_uint64(nvl, name, &rv)) failed (0 == 22) Date: Sat, 22 Oct 2022 16:55:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_severity assigned_to bug_status see_also keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666457705; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=R91WWDtSvi3U92kB5O5HfSFELfl/SjvRGyTu2nHtkIE=; b=E10DjPmtDCwtuZFuPZ3V9x2iv1Taeu3tKyMmfuw+b/42WTlc64QuaMkfMJwuw5E18g2jVA 4QtppYvKe4Gj5cP7879MKzb8ggP3sOAzFHDFVDqx0ZyrXdrgSznrxPE+nbSPOsxELB8Zrv C8/uZTQODzseQb4KWyUTg6epPCb9IJwiyeH74ziESm/oWSmgKA3t5jcA01uaX2cwtqMK2X FG1I1oxHTpAaQf+yQXVpC7WxSza3ttVKYgJZ/fXeJe/grMAP7TRwDShXKdsIXQ1BukV2F9 fUzbdhBJrO1eRKybrt6/uTI5K3y2tkn3cWGMJrMjQqoxNPczHvFGDBKYZ4MvkQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666457705; a=rsa-sha256; cv=none; b=bdgTochQrIboNcGWLTvo6MkPd7SfpRDwm2Crzj3gYJYtV72bNKB7MzOq29xI4tFysJXLIf 1ko1SGMUw8VjTyfilmlH2+KkpmVafE+YW7Cscb3voEKPWXvcTYVfMtwbuuq6rzVFY/0Sx3 FEZVhC+/XpTN0JbPT3sad3kaLTLjpwfdwtalPH89SeqHO1YvO9hUN7MU/PNbEI/FB486rT 3Ei8XQ6601C5NwOztUJbrACvzNtuqDeb3PwK8AaRDg1QpbpDArEK5XzqgeiKbeFVSBaWiC gP4YDIuLc9F4ashTeI5ZBjKQEG5IMNPJ4wOqlZxOMnfBR6d+BJjXig5+GWCXQQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267009 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Affects Only Me |Affects Some People Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Status|New |Open See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 563 | |68 Keywords| |needs-qa --- Comment #3 from Graham Perrin --- (In reply to tlb from comment #1) > Good times ensued. For clarity, please: did that imply a _bad_ time? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 22 16:55:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MvnWZ6z54z4gQfR for ; Sat, 22 Oct 2022 16:55:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MvnWZ1VdZz3yB8 for ; Sat, 22 Oct 2022 16:55:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MvnWZ08hszcdH for ; Sat, 22 Oct 2022 16:55:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29MGt5Yb091739 for ; Sat, 22 Oct 2022 16:55:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29MGt5fX091738 for fs@FreeBSD.org; Sat, 22 Oct 2022 16:55:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Sat, 22 Oct 2022 16:55:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666457706; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qra5Sc6plUb5s+xvUilRcE2mpLE7lAea/ML8vxoVzEA=; b=dnSb8u/I2oFarH8uSBXKpIvqxQ7J2FiZ9bM7GS0iSDcfLYtG5IEE0n9EEsi7uKDFPyNZdD iZ73DdRhMrzU9LR2mw4BAshsyBdiBuQ5z732NaRdw3/ISRKMiH6aqS4I77jo/N51eTTxba x4aizf9i9lUud6tX4av32B0eEG+omISDcRcOk7KLby48J7FVRiVCPHWF0/ekjvq5lanAno B3XPQMmF6iEeXCWK02R3rplLX/5AELz0HJxPJQkKe3t3nf+7c7YObB5LfiO9HOJkVRqrdZ kEDyR5DvPmDjCrAvdqENwznMa31ET3kPHVp2ehiaR2T7/PWSOoGaRC5K28BV8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666457706; a=rsa-sha256; cv=none; b=bdL3bB6p1ml7TtlKWB/FDRKFkxf8yDblfk1ciHYQ/DP4ske1uBSg1s00b0aILFmEAp36ES WcE0AeFTs0dNCrJzXpjcpgrjZ1HbJWf1Zl8ouSXCkDIPTJAU66HT++ucMYO2fMzoqvV7Y5 L8c19P4oWMkhpSXhMn9MhwarnEF3iVUI/ZAiCSvXHXXlEoUnCJXC/EHktghd5zyNSQqyQN GLyMN/+/1WKAMoT9yTygUiZTDPtM54bmQ5i8mWrKpWW+KI97UWwgRjs4LrAtXoexJX24IR mrFjQrx2+H/nUiGpKFopZ5n7O2I2JVsQd/MA2ZnFKgpJo9kER+rjEChHRDABcw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 670 | |09 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 22 16:57:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MvnZ22G2Rz4gQq7 for ; Sat, 22 Oct 2022 16:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MvnZ21GDPz41J7 for ; Sat, 22 Oct 2022 16:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MvnZ20Cx9zcdK for ; Sat, 22 Oct 2022 16:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29MGvDWM092719 for ; Sat, 22 Oct 2022 16:57:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29MGvDJ8092718 for fs@FreeBSD.org; Sat, 22 Oct 2022 16:57:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Sat, 22 Oct 2022 16:57:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc cc keywords bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666457834; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y7rFT+vm6R9cyI68nq7mWLdR/6fs+Lx4Svsko11sEtg=; b=lZBwRIL9pfsSwET4ReJqt5LRnMW0shf91UwVXt4VOPt+EJ7LF9k8R7YKXmrbeEsc3Vdtp0 bsUXrVBOA1VUq9umIUzvN3cdL44EWXoLaHrEbegeBPxnv2+kHUUcjMSqii3J3j9DPPDThY NYycOAZpYFZdNnsJE/Ye4UL9mF+elNjDp3CY0siLuKhZhgZw0XnoQVQCDFm/Fr/xgtri55 9rRVl2wIbP0VvKilzQgpts7dVgikAB45Bl4nqOqqNgZT8OFfM+mQ4892h5nY65TtQzUuni gFy6jlS+PaMqVqKnyA5yGDcSwITSpId9gCuybchiV9kNS43i+vVInDNS3sClBw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666457834; a=rsa-sha256; cv=none; b=Z5Pd1WB/eqA75EwymtWiREJEdPXp4663txzmZeeRvtU9I0jkqfueaxc6WLjrl1YbfdSPr7 I0GoHkt+0MShD28nw32F4l736RoEl9mYbFMmEtBppAp1HJKRR3NX4LKOSiAuOqcDGDqaQt eAWRHDNXL/wEBu0tDQ0FehvxhIyQl0gEZ9cEYvbAs28NlD+p6bQDvGRGKEmta/OTv6uhrX hFTOGibhJyIAeyKrLZpkqvseCMo2WPENdsBoML5XYnHFv745mwPRDi7V9Qv8tU+KBl309G zVb+/hEqopPc8bx1BxdLkPvYP578ifsX4QipgUw4KVM2Rrkb+hVL6075BI45Mg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|FreebBSD 13 does not boot |ZFS: FreebBSD 13 does not |after ZIL remove: panic: |boot after ZIL remove: |VERIFY(nvlist_lookup_uint64 |panic: |(configs[i], |VERIFY(nvlist_lookup_uint64 |ZPOOL_CONFIG_POOL_TXG, |(configs[i], |&txg) |ZPOOL_CONFIG_POOL_TXG, | |&txg) CC| |grahamperrin@freebsd.org Keywords| |crash, needs-qa Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 23 03:57:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw4D92jLtz4fvPl for ; Sun, 23 Oct 2022 03:57:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw4D86d4Pz3k6l for ; Sun, 23 Oct 2022 03:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw4D850jrzmNM for ; Sun, 23 Oct 2022 03:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N3vi04042013 for ; Sun, 23 Oct 2022 03:57:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N3viHc042012 for fs@FreeBSD.org; Sun, 23 Oct 2022 03:57:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244899] zfs: xattr on a symlink target > 136 causes "bad file descriptor" (on 12.1) and panic on (13 CURRENT) in sa_build_index() Date: Sun, 23 Oct 2022 03:57:44 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lab+bsd@thinkum.space X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666497464; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gayKISUnX6UWfmMv8yGZbiwc3tVa6E9LkM11d9zDito=; b=Kx4btSqBmocDoKfIsCD3ZIDjLgx8/tLumtpgCDat71C09VxRb0bKpBomh71qdFLWem0ZHt PKwfq25Yx/VCCsK6dg2VZX/MbD4UBVjyr7G57IuSkV13Cwznc7VRSU8OOjWOaV3wBQ5T/u Reuvfr4/pcak3d8/oQWmfO3hwTuEUAQsJmi/KUi22xhkZgy4+9d0LUt6pAkhD3bLRXzkGw RiE6p3sQsIzzFhXwm4rQdC7QD1rpaNhCTHrNjOTpu/tgst0PEiF6n5TA9eDMJnCfLEP2Wx gUCG3GgmIhqoD5pHNaX+Ehl5i7PwLJBV1cWebb7RFIIKkBH1UYrceXZVcud9kA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666497464; a=rsa-sha256; cv=none; b=T10pGY5zq/Cfx1gPDpgTTr1RHVvB6kHnuOIrDMLN/hNuuxKjdsNNsZiqObxBQCbw1pkSB8 ujBJRostoAIDoshv0CDwmrakNjgEQgfjFI2gQt/lR8GpCyaKGJEfXDDtLEl5MA5/TYKP/s CXn6JP0nar1/nHZrv2+HfXEFgotH5SgSN8QxSzbRa6Ot2hOXcggb74cJU3nh+OWpVQIdxW F/3KoNZfcveJ2/m4FzVeTkgETlX9NOdIK7be8ZgzjI9eFz8DkcUAOvRJ1JflVhCPaHeG+0 miynvA7kyb3/aYqm6ic6sdUG8XLNASv8S5EDz+DxbddCD8Viy3kNAfiggRtU4g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244899 --- Comment #9 from Sean Champ --- After rebuilding the kernel from changeset b63021e001d in stable/13 with the additional makeoptions, still seeing the similar (?) error in port builds w= ith ZFS in Poudriere ~~~~ =3D=3D=3D> Returning to build of binutils-2.37_4,1 =3D=3D=3D> binutils-2.37_4,1 depends on executable: msgfmt - not found =3D=3D=3D> Installing existing package /packages/All/gettext-tools-0.21_1= .pkg [xmin.bld.cloud.thinkum.space] Installing gettext-tools-0.21_1... [xmin.bld.cloud.thinkum.space] `-- Installing libtextstyle-0.21... [xmin.bld.cloud.thinkum.space] `-- Extracting libtextstyle-0.21: .......... done [xmin.bld.cloud.thinkum.space] Extracting gettext-tools-0.21_1: .... pkg-static: Fail to chown /usr/local/share/doc/gettext/examples/hello-java-awt/po/.pkgtemp.zh_HK.po.B= fvtcrBEkY7V:Bad file descriptor [xmin.bld.cloud.thinkum.space] Extracting gettext-tools-0.21_1... done Failed to install the following 1 package(s): /packages/All/gettext-tools-0.21_1.pkg *** Error code 1 Stop. make: stopped in /usr/ports/devel/binutils ~~~~ Albeit, the symlink example above is not erring here.=20 I've noticed the bug - as above - at some points, with symlink files. Previously, it was happening during pkg staging. Once installed under a builder jail, the file /usr/local/share/doc/gettext/examples/hello-java-awt/po/zh_HK.po is not a symlink. After some previous occurrences of the bug, during pkg staging in poudriere, I'd thought that it might be related to the item above. Maybe it's a separa= te bug of some kind. The 'Bad file descriptor' message continues to show up in port builds local= ly, when using ZFS in poudriere. There's a workaround in using tmpfs for all builder filesystems in poudriere builds.=20 I'll try to make an isolated test case for the bug that I'm seeing with my local FreeBSD build - something beyond the bad FD messages here. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Oct 23 06:08:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw77V4GlYz4gDM7 for ; Sun, 23 Oct 2022 06:08:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw77V1gSHz3qxP for ; Sun, 23 Oct 2022 06:08:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw77V0d4kznlj for ; Sun, 23 Oct 2022 06:08:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N68r72003774 for ; Sun, 23 Oct 2022 06:08:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N68rMx003773 for fs@FreeBSD.org; Sun, 23 Oct 2022 06:08:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235683] [zfs] Panic during data access or scrub on 12.0-STABLE r343904 (blkptr at DVA 0 has invalid OFFSET) Date: Sun, 23 Oct 2022 06:08:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Feedback Timeout X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666505334; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=P83q8MmzYNeOGW5jxyIys0yr28B6Z68tDPk324cJ2qo=; b=uD1hDoj/saLjKrTGctHdxWiRXDAczalzC29SzDWGyVk3NXVOkdQTFElC5KsxnEAY1ThP9x yRyKyTBE5tSXG80dRySdmNGLf4rfQCxUweZAiAi5CyPWlHhjCTDi4CrlIIpyd2s/TpwkCI D9dFWxpy3PiaVnbjhPbMqHgBNXex6oLFbvSD37xyrS+jvg4Rvm03MUPL4R4O64Lr4YbvKN qGCklkfcHqF9A3RkqbyXZr+b2wDbsqVb9FEuak/V+ZPy7A1Tvn48SKCcpDLoVJ0hZ3ucV3 lD6Vo3YrYORh1af06xFs6vWB3BfdWxLBJCAlsix2Cqc9awNfmJJUYosdvmHVEA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666505334; a=rsa-sha256; cv=none; b=reVgQXAmRN86oSS8D5XOb35VwCL5SGIuqyBzBOQTZNIlI/6lgKvPJbkjA3EXOSynFiC4RR D9xkjZkObwfGOLS0aHpET5Rja2joJMI+UkR5Sx07SHa53tX0Q6u3FQBN2cI2qMtdcp6Q+l Ho/OLHAHift/d/SlxAdumuifRD+WSGpLk6i6N+xqIqoFI5HoRkXHzjaZkJj/RbX/K18e0K RVk0ybBLBqmSvoromzwGlFgyjNoHXzbP7NOv2ZyUdH83gdRBY7XJ2Q+jVdWKJhKpQzl/Yr 4EXNg2N/clORG0YoffwNPX5RldFkTsGRa6SaKjsdPKOHB2KpkRjkP0JYEM6dQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235683 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Feedback Timeout --- Comment #16 from Eugene Grosbein --- Feedback timeout. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 23 06:13:51 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw7FC5bMqz4gFQf for ; Sun, 23 Oct 2022 06:13:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw7FC4Pjgz3s9t for ; Sun, 23 Oct 2022 06:13:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw7FC3TFkzp3Y for ; Sun, 23 Oct 2022 06:13:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N6DpHl022200 for ; Sun, 23 Oct 2022 06:13:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N6DpLR022199 for fs@FreeBSD.org; Sun, 23 Oct 2022 06:13:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227465] [zfs][iscsi]repeatable panics on iSCSI target/zvol creation Date: Sun, 23 Oct 2022 06:13:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666505631; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UiHGOZ366sIL3nfPgrcN6bIApkAiWwS2AijQziVIiXI=; b=ZzAA06tvKOA7KIjekxslgJ3jp3AXLnkW2LIiV+7BPlIVuvWKuqVc6gMSwAoyvQR/iMXBA5 11rL9SK7qJiGI0D/zAe5pCpgE2MrKSSRgScV3aLKlZGwcXKZt62wVY3JjTr49LtJjKs9oS 9JNHVwSPXCHo2WEhGjjG/Fc0iaKtg9x3EcNBVBDicqTz+cMtY0V0ecrWXVzSN2k16JqiCT wnweX4W5hxCrPQTnwj0aW8Bmk54rNLmQyX+pZE1N5zz0zp5vNLUfCr+i7795YNNehJ+SNz RdY0c2WwacfeYk+0FziwS3KsYR00WsMhQwEFSyGfSAS/Kf8rl1TYNt3CFwbMNA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666505631; a=rsa-sha256; cv=none; b=ueLpDhmL9OZOeZ7gqQmF1vv0LDGiSSMnsudAn01+Dm5q5NUI8FwV7vIn7SxTazuaezH0yl gM3m+0v9L378M4XYlCtaDd4q3sxJ92aiRNrbOZLNgmcTY5T4zXYqqaQ+npx2M4PCc12fy7 yDkasTOkElYyLsg2le5izSxnVSN1ZEXVQ/8m53YIb3nK/7MY17JUjDvTC6Ga3xxz/BSKNc zXud30dYpRcMrCrp4FdP6EB/wuf0h3W55KYpfHsJ1kI0BrH8IWwZgreDVdCvtjLMeCbBh/ PgNm0yaHvzanfXF7bTffQmcKGy2+Pfev1lLWO3nwFMwopJCxEXj5RnVwUEnD9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227465 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Overcome By Events Status|New |Closed --- Comment #8 from Eugene Grosbein --- volmode=3Ddev is the key for stability for noted setup --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 23 06:45:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw7y36sSlz4gKMw for ; Sun, 23 Oct 2022 06:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw7y35rFYz3tpV for ; Sun, 23 Oct 2022 06:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw7y34jqjzpNK for ; Sun, 23 Oct 2022 06:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N6jlUR054759 for ; Sun, 23 Oct 2022 06:45:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N6jlVF054758 for fs@FreeBSD.org; Sun, 23 Oct 2022 06:45:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244899] zfs: xattr on a symlink target > 136 causes "bad file descriptor" (on 12.1) and panic on (13 CURRENT) in sa_build_index() Date: Sun, 23 Oct 2022 06:45:47 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? X-Bugzilla-Changed-Fields: keywords flagtypes.name bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666507547; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=H5q1QaSzoeZEbOzsqw5JCIPh7ek2a60jWXn+uX8le24=; b=cBLHxP++HBZ68xr9DDltLN/bI/zsuyoiDItKx2RB1mZqRLfff76vgQS/tjlyzVr/bdrIuZ 9/elEPWgn7WeYBjHCKKWv5ZLRuTEiRs7rrcEY/rrlZ44pOryCS7aepW9t7pt6Crm5VkkyG DGaFt5zhKVvxnneYoFMRkbZK6NmB8LT5q5v3jBSV68uIp5KTD6I2kHUP1rFtmOd5Iwdvs3 2RXUgbQMKqChUQUzhj6Ts4zKfID0zYJ3dSuGhNbAC3IhrJ0TytaMtGEJSdWQtx6qJvlXpM BkfBDC9i2gXD9FrJmbJhEEnSjMcJICDG0m4fusahbzl20HbCJkuFmla00mh5/Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666507547; a=rsa-sha256; cv=none; b=xVtaJu5yBAR4Y0Oy7i9KMNiUgWSqn4kM8x0Zsjm/G0TVqvGGzpSK5w0D1vZhQcquUNNZ6r 49AAmyQd9978HqhU5lXGzPpXHp+2pqiINu8AZRF1aMnvYKzkxIlnqAXNo+S0XsDtD4YA59 tPjAB7T2dLsjtqkVvFkJmrF71S7n6W/+RcTV5xOHqqBwM1IOwSgLrbOPazKBmUG3Hbaa2R HLVsDJ5ONtpTcsFvEhTb8pSadyMVO71xv+GL2zDr4Rx9XGn8772UZlWSnYhJLZqDdf/1/V lseZakNZKYhJVgnTQafypU7Yh2LkeW2jIoiTMouHCuQ0d3/Kfg4xHpATc8kioQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244899 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords|patch | Flags|mfc-stable11? | Status|Open |In Progress --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Oct 23 07:47:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw9Jq24flz4gT6s for ; Sun, 23 Oct 2022 07:47:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw9Jq0VnFz40hx for ; Sun, 23 Oct 2022 07:47:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw9Jp1GKnzqJ6 for ; Sun, 23 Oct 2022 07:47:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N7l6X4027938 for ; Sun, 23 Oct 2022 07:47:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N7l6PU027937 for fs@FreeBSD.org; Sun, 23 Oct 2022 07:47:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 235683] [zfs] Panic during data access or scrub on 12.0-STABLE r343904 (blkptr at DVA 0 has invalid OFFSET) Date: Sun, 23 Oct 2022 07:47:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Feedback Timeout X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: eugen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666511227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VpuIVEcPWcbZUKG8I1T74IEdd+oaBqV/2Q719U0974k=; b=fWQY+W+EWS+dET5/TNsetUBjX1zOixUVCbQSgKejBW9Ths9uD8BvVI3hqmVeEfCdVwvCc+ SnfCCo9M5SGzjHGm5roxZYlf0JM/CBmkNy/pNRzKd/420qv3kwoTeqJCUEpYnB2914/VY6 9wqyYymVfJ+5cV3HQFUvYrOngXiiZCALAjBRfe1X5SUG5RuppBbyjiIpxLF5MRAT88AzN1 X9TZ6LUHgO4rq5Zjd7wdA4jHqdlTTlbP0FOlHlexxuk+RDJbapFHlIWiC5LEm89KOzuSH7 EUYIhBGmhPsoDczaxBj8vdtZFjSPTRtCK7CmzgbjKARGgYIy+YYu6afgvh1Z4A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666511227; a=rsa-sha256; cv=none; b=GB2unHC3zRroa0YnexOieFSZ31pc0yx7D78eIjkzjuWUqlsm9HCZ9VnmFJ/HVS/YmEpR5W EqXN3a0rxFZecjPza0Ld1axuogOx9SxHofFDayKr/A3GE4BIwTtWVOaTUtCbfNuCI2KHns 6IwAXPKGLRAkDMGpiszKNVi/JQmr+t3WXKldfUOSs/b4aNJgni6U5GXtYxaTAKB6SGrDgK lcM9PM2U87AKb6dmckjldhEa8+d5IMY2gQlowRfZBIw6kfiuDub1IKQomQmaIp0fu7fUb7 1wJKRoD4g2LhNKos5JLA6FFyADoPB5rAgJwjQKv/6SGuL8sBwrF6N48TsmRJ9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235683 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |eugen@freebsd.org --- Comment #17 from Graham Perrin --- ^Triage: with closure, there should be assignment to a person. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 23 07:48:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mw9LF4nQsz4gStD for ; Sun, 23 Oct 2022 07:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mw9LF2qXJz41bR for ; Sun, 23 Oct 2022 07:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mw9LF1tpvzpqm for ; Sun, 23 Oct 2022 07:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29N7mLBO028422 for ; Sun, 23 Oct 2022 07:48:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29N7mLSC028421 for fs@FreeBSD.org; Sun, 23 Oct 2022 07:48:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227465] [zfs][iscsi]repeatable panics on iSCSI target/zvol creation Date: Sun, 23 Oct 2022 07:48:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: eugen@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666511301; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IS7gOwd4/8OZhsFZKjzLdgoRWbKtxShaLtVui47OmeY=; b=BYGDHxEVevVilSzJlf9cpPRNp5EkAXKhwcyXYLDR0ekFnRJ6mQYcuc3KJCoJ4PV++Hl+lJ eHksIL2XFMQ3vCkb+mIA+qCbYQh5SAsrlDq95uoKEUp58dOSED3Abl1dISD7OJ7REbeGdb oUis4YhHi9DAL0dKQrx7Zx9DFSrm7D1tFdpe90aHycCwoXtLAeuRJegty9VM3R1pxyAVoN Fra1io9rApmmSnE14TjCJnEkTkYg9AA6rRoSCppsGSJ/VJI7J4pUaGsm32xMx0S0q/VGd3 c4ES4qbLkUGZdAwDun0SFKSKq4C8YNXR437AlI3clQTxfF24DZ97Bgj8nFk14g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666511301; a=rsa-sha256; cv=none; b=CwFT17dOGoofgS+uFNeEb3nI2VzDx3yzya5TdvWXyMuydlo53v8yDLDgMg/O+7oi8gD1Hy 04bVRO20+yzJztsps/nFrW703fjwhgoIpg6kYVAf4np0HmQhAzwBGV9SATrXZp9bD4+vME 4I35C7gvdVK+VSh2MRX9fy4AydXLs5penUMA/4t9L0osjQn48mTJ6ghiWXu97yBMcbHQWv Mu1hzUlidkXURjy7MEzmGZLSMb2OusIUPACE1GNKL62AH34IstSsMkzRJnmB/9CBUsHMvj KKC3rhzvzSw0kOH1uR8OpEwcQSQ9yDNfwLY/96mpBawaT0si4ZsKgzlXM4MsFQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227465 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |eugen@freebsd.org CC| |grahamperrin@freebsd.org --- Comment #9 from Graham Perrin --- ^Triage: with closure, there should be assignment to a person. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 23 21:00:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MwVwR1Nzmz4gJCg for ; Sun, 23 Oct 2022 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MwVwQ5jFhz3FCR for ; Sun, 23 Oct 2022 21:00:38 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MwVwQ4qW5z11Wv for ; Sun, 23 Oct 2022 21:00:38 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29NL0cB0039499 for ; Sun, 23 Oct 2022 21:00:38 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29NL0cKt039498 for fs@FreeBSD.org; Sun, 23 Oct 2022 21:00:38 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202210232100.29NL0cKt039498@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 23 Oct 2022 21:00:38 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16665588383.85e28E.36386" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666558838; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=BKdF009Do/AqZPxwFZuwaIgJyJLPa1LMp7mTIuAkn20=; b=o4+L79oigNqV07o92e4C6H65w2z7h0o96fwN2DBuZPi+6cqommJhBm8L8CHg73yN27w/pq MkXuIH10IYDrPx1NBagdAngvHpgwjrt2oWTMtJHyVnIZcByZC3NxEjEqj79oaYgkScgHua m6jFsDUxsI86l0bPuyfYGKhTbUeXEZzOMBn0S7ZmlX8Dpql458L7pd9lFna5Q5HNnvdX1D JR3gU62Bn6E9Sbv2xEN0Fp1QHFQwGHG4eLy5BgyoucXvBFANKIHAV2Gilolk6/Iy4wSwEW ojjddp1zxT9QbYGhEOhVWAyGqZzsvi9BUMWJxPU2m8d62sI96wIPVBdZPKOK1w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666558838; a=rsa-sha256; cv=none; b=IfKJ+EC0JVuUM2kNZh2VU4n8kWHyz4aT/WN5ycmqAA9/GpHrcybySkDgB9olbMZq0QkPt2 JQ1yS/aPOh1eCW5cqtfXr9MhPOvUwS1vX9EZUa0lu5dTklR1RU6lJvADDlnCiLxQvOIU5M oomFbnsYKtjSF3E2M/rqva/Uqr5ILYCoq0Zg6UBU63GfM4kAwyip0xAuUtIkJNCb0zPaLN IWoOTpGDbsDxlM77QlGd9NNB7iCUlxvqf+A0lk76I9Qe64sz6fjmGTX7eDnTjeb74KZVUf vzTJnZuskmCwsLugx2+84Faf7DOp3lSDlKYHpuIb4rTUwvm487RdTa+gP2PGXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16665588383.85e28E.36386 Date: Sun, 23 Oct 2022 21:00:38 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16665588383.85e28E.36386 Date: Sun, 23 Oct 2022 21:00:38 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16665588383.85e28E.36386-- From nobody Mon Oct 24 15:09:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mwz4T6VMBz4fwGF; Mon, 24 Oct 2022 15:09:13 +0000 (UTC) (envelope-from avg@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mwz4T5hcyz3Q7T; Mon, 24 Oct 2022 15:09:13 +0000 (UTC) (envelope-from avg@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666624153; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SG02+7iOKx1wHG7FydUO9S9HJyJzfp/eUVJlZnvvbbw=; b=MbPHpHOotKtKpue2bApBkQ/rpgS6wCJ9N6yvTB1ARH0Y5hPLjKHt95ZScKFM7/qNMj1Y0Q gZ1A+JYsfN/P44VnCCoGywjES90uAeUjKZ8Y9WVfKGICNPvbHuZWCdeLFP5TaXZ5MKAItL Kuk9p2WB4ZyKFHnup+crqUyopOxMnvrYmZtjudymfPHxhKssX/6Jr2ZmKOaDrRqblGdlGm UM8k62EnpCyPOBcW+oqFyT0nzYf3MrApBw7ansuUuR6wtoT3w9wQR2iHEssDj62pAHlgjY D3hwUOqiG9R3zBj6NjzAPdEJNCZ5Ap+CeTHWDYDzZHR30GzVGiU8cRrnIRpXbA== Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Mwz4T1CfFzrDQ; Mon, 24 Oct 2022 15:09:13 +0000 (UTC) (envelope-from avg@freebsd.org) Message-ID: <2f586acb-a8ee-fa17-bbbb-740f41dbfe82@FreeBSD.org> Date: Mon, 24 Oct 2022 18:09:11 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Firefox/102.0 Thunderbird/102.4.0 From: Andriy Gapon Subject: Re: panic: condition seqc_in_modify not met, while replaying ZIL Content-Language: en-US To: Mateusz Guzik Cc: freebsd-stable List , freebsd-fs References: <93085f3c-4592-8f46-fadb-ba0ee2d2ffa9@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666624153; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SG02+7iOKx1wHG7FydUO9S9HJyJzfp/eUVJlZnvvbbw=; b=F/B34JbW6uK/9u2P7EJpWFfjfNSwikKdxs3SpQ1z7uENcOclcmmvIGgTDpWnEjilUPsa7M g89zKQ4/A/6rytlwDOUH3BucH0mtU813m6x9pUkBwiXm7XH23ufdEoFhgWW7vWCH5cqnJe 9SLYIotF0qhInardlNYwrAPfjKp7mPYnW4oVZ0wLbn8un0AspMA/LCFLglcObIJMgiSrwD r7yWh15sMOvLAs1noovFTLGyjO7nggYvgC/+9wVT1me/BvJgWnUeozBl7OwuEe7zNr4pBh v4qspG2i3NTq1K1YUhPCP++wXu4NgaG5mZqpsPsDSMDKcWNOLeO1Vr1LwXk9Cg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666624153; a=rsa-sha256; cv=none; b=NGXGzWU0dzEZpUgi1lAkYAtAFrsMPTlXNedqQxAQaSWwYI4FUKf7xROm6lya4bl+03UXBy BDv+ybvXZrRm/9cP1UvculDjtqh3wIcNFHKz4YQsGhKBUJ1ef9/FyEmsDleI+V8LwAmqok 4UhHu+BxxEm7XMT6I4qZM3yPFLr6oZhs9CAxKd/Qmo4EcGaSkGtKXNGM+xEHszxzT7jEju Ub4PGGiB0sj/AF4Ug8Cxpa4gnXWe74++aJT3/TmGwWMCvSlHoGM7CsniWEznWS1RVHzz88 1szsSBlUo1QZhSDUNR71fU9Is7NFgUwYiebZ/HHCDMHPuxa4npmsebB79euieg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 20/10/2022 17:32, Mateusz Guzik wrote: > This is a false-positive -- the seqc stuff is not modified on replay > and zfs internal asserts check for it. I think the easiest way forward > for this one is to appease the assert by entering it seqc. > > That said, could it be it is an invariant there are no nc entries at > this stage anyway and the call to cache_vop_rmdir can be avoided? I > can add cache_assert_no_entries or similar routine to be called > instead. I've checked the code and, indeed, the name cache is doubly disabled while ZIL is replayed. ZFS sets z_use_namecache to false and z_replay to true before the replay. And either is sufficient to disable ZFS name cache calls (which is redundant, but that's a different topic). So, I came up with this small proof-of-concept patch (and it helped with the problem at hand). It does not assert that the name cache for the filesystem being mounted is actually empty. That would be a good addition, if you wish to add it. diff --git a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c index f6bc9c0c6afb..87fa271dfd5c 100644 --- a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c +++ b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c @@ -1622,7 +1622,8 @@ zfs_rmdir_(vnode_t *dvp, vnode_t *vp, const char *name, cred_t *cr) dmu_tx_commit(tx); - cache_vop_rmdir(dvp, vp); + if (zfsvfs->z_use_namecache) + cache_vop_rmdir(dvp, vp); out: if (zfsvfs->z_os->os_sync == ZFS_SYNC_ALWAYS) zil_commit(zilog, 0); > On 10/20/22, Andriy Gapon wrote: >> >> This happens on stable/13, custom kernel compiled with DEBUG_VFS_LOCKS, from >> >> mid-September after an ungraceful reboot (unrelated crash). As far as I can >> see >> in kgdb, both dvp and vp have v_seqc == 0. >> >> VNASSERT failed: ({ seqc_t __seqc = (_vp->v_seqc); __builtin_expect((__seqc >> & >> 1), 0); }) not true at >> /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 >> >> (cache_vop_rmdir) >> 0xfffff8004bc0bd58: type VDIR >> usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 >> hold count flags () >> flags () >> lock type zfs: UNLOCKED >> panic: condition seqc_in_modify(_vp->v_seqc) not met at >> /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 >> >> (cache_vop_rmdir) >> cpuid = 5 >> time = 1666250711 >> KDB: stack backtrace: >> db_trace_self_wrapper() at 0xffffffff8061549b = >> db_trace_self_wrapper+0x2b/frame >> 0xfffffe01ce6c7090 >> kdb_backtrace() at 0xffffffff80942927 = kdb_backtrace+0x37/frame >> 0xfffffe01ce6c7140 >> vpanic() at 0xffffffff808f4fb4 = vpanic+0x184/frame 0xfffffe01ce6c71a0 >> panic() at 0xffffffff808f4d63 = panic+0x43/frame 0xfffffe01ce6c7200 >> cache_vop_rmdir() at 0xffffffff809b9b9f = cache_vop_rmdir+0xdf/frame >> 0xfffffe01ce6c7220 >> zfs_rmdir_() at 0xffffffff80391cff = zfs_rmdir_+0x1df/frame >> 0xfffffe01ce6c7290 >> zfs_rmdir() at 0xffffffff80391af8 = zfs_rmdir+0x48/frame 0xfffffe01ce6c7310 >> zfs_replay_remove() at 0xffffffff804fc53b = zfs_replay_remove+0x7b/frame >> 0xfffffe01ce6c7340 >> zil_replay_log_record() at 0xffffffff80508462 = >> zil_replay_log_record+0x212/frame 0xfffffe01ce6c7490 >> zil_parse() at 0xffffffff80502f4b = zil_parse+0x5cb/frame >> 0xfffffe01ce6c76a0 >> zil_replay() at 0xffffffff805081d8 = zil_replay+0xd8/frame >> 0xfffffe01ce6c7700 >> zfsvfs_setup() at 0xffffffff8038f09d = zfsvfs_setup+0x24d/frame >> 0xfffffe01ce6c7930 >> zfs_mount() at 0xffffffff8038c9b2 = zfs_mount+0x652/frame >> 0xfffffe01ce6c7ad0 >> vfs_domount_first() at 0xffffffff809d0d66 = vfs_domount_first+0x216/frame >> 0xfffffe01ce6c7c00 >> vfs_domount() at 0xffffffff809cdd43 = vfs_domount+0x2d3/frame >> 0xfffffe01ce6c7d30 >> vfs_donmount() at 0xffffffff809ccb6f = vfs_donmount+0x81f/frame >> 0xfffffe01ce6c7dc0 >> sys_nmount() at 0xffffffff809cc318 = sys_nmount+0x108/frame >> 0xfffffe01ce6c7df0 >> amd64_syscall() at 0xffffffff80c31d16 = amd64_syscall+0x186/frame >> 0xfffffe01ce6c7f30 >> fast_syscall_common() at 0xffffffff80c0889b = fast_syscall_common+0xf8/frame >> >> 0xfffffe01ce6c7f30 >> --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0xb6aac9dd1a, rsp = >> 0xb6b538f468, rbp = 0xb6b538f4d0 --- >> Uptime: 37s >> Dumping 1426 out of 32644 MB: (CTRL-C to abort) >> ..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% >> >> -- >> Andriy Gapon >> > > -- Andriy Gapon From nobody Mon Oct 24 15:41:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MwznN2GD9z4g1bQ; Mon, 24 Oct 2022 15:41:12 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-ot1-x329.google.com (mail-ot1-x329.google.com [IPv6:2607:f8b0:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MwznM4rSmz3W4Y; Mon, 24 Oct 2022 15:41:11 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-ot1-x329.google.com with SMTP id w6-20020a056830110600b00665bf86f012so956003otq.0; Mon, 24 Oct 2022 08:41:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=BXpKxykWz9/4+msPwY01RpqkxFtpNqiL+QkrXvH+t98=; b=KeJmHZ6IfYKP/ZN5W2oD/OIJYK92P6jDEEkJNRabhvHrVv5CuwJBSCHcx1PSD3B3OF W0Oj08K9Hu7k7jPLUwvbkTh/0SfkB/V2C25MnrHWthMZA666SpmZW5PSWxL3QD7B8TJ7 SFY2vs28xGjm20evF4Jog1aF5Fy8fafgzbochgVX+E79g9WVZyI4qPyWVhI+UMB1EPV6 AVaz7I4q6BhR+c1LeyTUC6I5HWluVC6Ksjjz2oWBKHaFeLxnaxhr81If8yNSxJxPy3gA zkPOJXVnAf9pcUroJDSlv4d6Jb4tbMulCIBVaSZIoBSkm5Y7REjjShZU5Xo1m8l7yVqe +psg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=BXpKxykWz9/4+msPwY01RpqkxFtpNqiL+QkrXvH+t98=; b=0W2oYuxDrG6Cy/EEz9bwUUaAWxw3cMjM5wcYqj8dMJAlN/dbQZZ0EoX3k0QAoy9N5m zIJ01BaZ+1xXYlhQ/N/pR7tL4IRt/WTLfHpZQfSzy3QP5KAXRxyCkWE/ci2MLhorEOvd Rv9qtAOuBba19Z8RyBqz+avxzFRTh447riMzm0uHbGUig8YcD3aKXdyBrAIQOI+E5H3e b35Cw1c2mT7TpdoVu1LPLNiw23JhoTx8yIf1Z6sSw3ZGHiVtbuBhFulu8LziTnKQWstY eaSIZEJJLR1sPjL7IHm0qn+rk12Hqk2QXAyo+RTeFysBw/x/A35nDz+t/rE/isyZMoRM VJdA== X-Gm-Message-State: ACrzQf2f6azS88WTGsVhz9BDDpW/WMt92eJMEKxlwTD29J9JrWn7JrRD 7NJH8qpp+eJURA4NMjIZXZGKrIyjhyAOJFbOYwNAP6eY X-Google-Smtp-Source: AMsMyM7rGNkumkNgQcrIZ3rZJ8fxes2Wf5AEbs2AuelP+e0wvJxF2mrBc4aPghXypTVRxrfafm4+Nu3vza5tOv1v3fA= X-Received: by 2002:a9d:7458:0:b0:662:1044:791c with SMTP id p24-20020a9d7458000000b006621044791cmr11537125otk.281.1666626070857; Mon, 24 Oct 2022 08:41:10 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:351:0:b0:478:5e54:a9c8 with HTTP; Mon, 24 Oct 2022 08:41:10 -0700 (PDT) In-Reply-To: <2f586acb-a8ee-fa17-bbbb-740f41dbfe82@FreeBSD.org> References: <93085f3c-4592-8f46-fadb-ba0ee2d2ffa9@FreeBSD.org> <2f586acb-a8ee-fa17-bbbb-740f41dbfe82@FreeBSD.org> From: Mateusz Guzik Date: Mon, 24 Oct 2022 17:41:10 +0200 Message-ID: Subject: Re: panic: condition seqc_in_modify not met, while replaying ZIL To: Andriy Gapon Cc: freebsd-stable List , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4MwznM4rSmz3W4Y X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=KeJmHZ6I; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2607:f8b0:4864:20::329 as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-3.66 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.66)[-0.660]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[stable@freebsd.org,fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::329:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 10/24/22, Andriy Gapon wrote: > On 20/10/2022 17:32, Mateusz Guzik wrote: >> This is a false-positive -- the seqc stuff is not modified on replay >> and zfs internal asserts check for it. I think the easiest way forward >> for this one is to appease the assert by entering it seqc. >> >> That said, could it be it is an invariant there are no nc entries at >> this stage anyway and the call to cache_vop_rmdir can be avoided? I >> can add cache_assert_no_entries or similar routine to be called >> instead. > > I've checked the code and, indeed, the name cache is doubly disabled while > ZIL > is replayed. ZFS sets z_use_namecache to false and z_replay to true before > the > replay. And either is sufficient to disable ZFS name cache calls (which is > > redundant, but that's a different topic). > > So, I came up with this small proof-of-concept patch (and it helped with the > > problem at hand). > It does not assert that the name cache for the filesystem being mounted is > actually empty. That would be a good addition, if you wish to add it. > > diff --git a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c > b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c > index f6bc9c0c6afb..87fa271dfd5c 100644 > --- a/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c > +++ b/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c > @@ -1622,7 +1622,8 @@ zfs_rmdir_(vnode_t *dvp, vnode_t *vp, const char > *name, > cred_t *cr) > > dmu_tx_commit(tx); > > - cache_vop_rmdir(dvp, vp); > + if (zfsvfs->z_use_namecache) > + cache_vop_rmdir(dvp, vp); > out: > if (zfsvfs->z_os->os_sync == ZFS_SYNC_ALWAYS) > zil_commit(zilog, 0); > Added the routine in https://cgit.FreeBSD.org/src/commit/?id=d653aaec7a311a7d1455e9721904b2a341b32a65, just call it for the else clause. > > >> On 10/20/22, Andriy Gapon wrote: >>> >>> This happens on stable/13, custom kernel compiled with DEBUG_VFS_LOCKS, >>> from >>> >>> mid-September after an ungraceful reboot (unrelated crash). As far as I >>> can >>> see >>> in kgdb, both dvp and vp have v_seqc == 0. >>> >>> VNASSERT failed: ({ seqc_t __seqc = (_vp->v_seqc); >>> __builtin_expect((__seqc >>> & >>> 1), 0); }) not true at >>> /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 >>> >>> (cache_vop_rmdir) >>> 0xfffff8004bc0bd58: type VDIR >>> usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 >>> hold count flags () >>> flags () >>> lock type zfs: UNLOCKED >>> panic: condition seqc_in_modify(_vp->v_seqc) not met at >>> /usr/home/avg/devel/freebsd-src-new/machines/trant/sys/kern/vfs_cache.c:2976 >>> >>> (cache_vop_rmdir) >>> cpuid = 5 >>> time = 1666250711 >>> KDB: stack backtrace: >>> db_trace_self_wrapper() at 0xffffffff8061549b = >>> db_trace_self_wrapper+0x2b/frame >>> 0xfffffe01ce6c7090 >>> kdb_backtrace() at 0xffffffff80942927 = kdb_backtrace+0x37/frame >>> 0xfffffe01ce6c7140 >>> vpanic() at 0xffffffff808f4fb4 = vpanic+0x184/frame 0xfffffe01ce6c71a0 >>> panic() at 0xffffffff808f4d63 = panic+0x43/frame 0xfffffe01ce6c7200 >>> cache_vop_rmdir() at 0xffffffff809b9b9f = cache_vop_rmdir+0xdf/frame >>> 0xfffffe01ce6c7220 >>> zfs_rmdir_() at 0xffffffff80391cff = zfs_rmdir_+0x1df/frame >>> 0xfffffe01ce6c7290 >>> zfs_rmdir() at 0xffffffff80391af8 = zfs_rmdir+0x48/frame >>> 0xfffffe01ce6c7310 >>> zfs_replay_remove() at 0xffffffff804fc53b = zfs_replay_remove+0x7b/frame >>> 0xfffffe01ce6c7340 >>> zil_replay_log_record() at 0xffffffff80508462 = >>> zil_replay_log_record+0x212/frame 0xfffffe01ce6c7490 >>> zil_parse() at 0xffffffff80502f4b = zil_parse+0x5cb/frame >>> 0xfffffe01ce6c76a0 >>> zil_replay() at 0xffffffff805081d8 = zil_replay+0xd8/frame >>> 0xfffffe01ce6c7700 >>> zfsvfs_setup() at 0xffffffff8038f09d = zfsvfs_setup+0x24d/frame >>> 0xfffffe01ce6c7930 >>> zfs_mount() at 0xffffffff8038c9b2 = zfs_mount+0x652/frame >>> 0xfffffe01ce6c7ad0 >>> vfs_domount_first() at 0xffffffff809d0d66 = >>> vfs_domount_first+0x216/frame >>> 0xfffffe01ce6c7c00 >>> vfs_domount() at 0xffffffff809cdd43 = vfs_domount+0x2d3/frame >>> 0xfffffe01ce6c7d30 >>> vfs_donmount() at 0xffffffff809ccb6f = vfs_donmount+0x81f/frame >>> 0xfffffe01ce6c7dc0 >>> sys_nmount() at 0xffffffff809cc318 = sys_nmount+0x108/frame >>> 0xfffffe01ce6c7df0 >>> amd64_syscall() at 0xffffffff80c31d16 = amd64_syscall+0x186/frame >>> 0xfffffe01ce6c7f30 >>> fast_syscall_common() at 0xffffffff80c0889b = >>> fast_syscall_common+0xf8/frame >>> >>> 0xfffffe01ce6c7f30 >>> --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0xb6aac9dd1a, rsp = >>> 0xb6b538f468, rbp = 0xb6b538f4d0 --- >>> Uptime: 37s >>> Dumping 1426 out of 32644 MB: (CTRL-C to abort) >>> ..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% >>> >>> -- >>> Andriy Gapon >>> >> >> > > -- > Andriy Gapon > > -- Mateusz Guzik From nobody Mon Oct 24 23:29:22 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MxB9l6Gbwz4ftLv for ; Mon, 24 Oct 2022 23:29:31 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YQB-obe.outbound.protection.outlook.com (mail-yqbcan01on2048.outbound.protection.outlook.com [40.107.116.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MxB9k5k6bz3LWY for ; Mon, 24 Oct 2022 23:29:30 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=muI3+PLXaA6IECFksvbcTMbF7SzXbEM0xr2BV1c6csMda+0hbed4B9/zBWjzW3E/XL0UN8EW1SmjraJI1uqxTascoLVGUnY3ODpQscbneAhNa1LTGC63uNTueRRny7/8MHFxagPBD4ihdXxhRwV6/mcmv8YqMzW9Y0hu2Ay0hdNAHtRlnlvZThExD8j8N4h1m8Jv8+NrxhLpnQaLaNSk9+AiJyfHirVZOm/gDZtAWy0MbxZ2mnyk+3kFY0RAOJIEUo6A5N9cdUWsXpQFbFWw/mWfalnKLhhL2vKLXrqm044JRaeelPbK8JcGzxKSf4azWZ2UaJDoDjG3ZcyLvgr3zQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=LLUXU2DtTj2sr5wmCUlGue8jIEkv23I4bQfFo30rCE8=; b=Bnbfhy1nJJuxqXA1CsKOjmOKwlTOR2PIKjoKKqM3suBs6uppCBChFpHwQGDqwfgXhaiI8VLuD8dwm49xCq1szviVmgR9LHJvH10rJyo66V/h7hTHZzEnaG3guugrYckOPg32tawX/OtNmbM1mCofhwDC9nz95evF1gulIWrr41jYVaFRctyQmKoMIGkW+J6885z6NhAyh9b9GlprsTtyYNzL9cbtbdSlidf5zsF2MDDov5HE/SaJlHJ/lw/YVsaoWuFjtFyMfI5ATVlZDemO8IJnEE7bPra4CeOoZRbKdIHkJ+8MCt1LCaNpajGqPCTEEJKshhYxQ0NnwDfRREgTHA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LLUXU2DtTj2sr5wmCUlGue8jIEkv23I4bQfFo30rCE8=; b=VwF6i/u8b2owfIxppzOSGwrHAFPiM8WaQP63gtlhzA5t+PWtIK7etdk8zT7QqCeaJIigDJ8johy9Gc6SPyzEVG5CWXNC5K8TrGy3GKdMEiUXIIyE443+bHmSEJB7FlgQG0yHgeX3N4Ejm5Az4u3vvWtDua7ZnEahM86IGDM6UuhT4SVCf2F4mwTGWen7Vsu7mytFrEHdgvf/cj/8AYQmS5xojf2RLihUq0e6CyYXT/ofwy7LksnzzFszobaAYuZ+phRZ2gy8/8if+17UMB6yVAE/nUuSM1XfZ1hDs6Q6jrOVIAOc6HsWduIiBMVEsWcjrNiWNHqNy1XNqVAuQTxOOg== Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:6::7) by YT2PR01MB5268.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:53::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.27; Mon, 24 Oct 2022 23:29:28 +0000 Received: from YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::c170:753f:fac1:45f5]) by YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM ([fe80::c170:753f:fac1:45f5%4]) with mapi id 15.20.5746.026; Mon, 24 Oct 2022 23:29:22 +0000 From: Rick Macklem To: FreeBSD Filesystems CC: "brad@facefault.org" Subject: RFC; Should rpcb_getaddr() be changed to not use UDP? Thread-Topic: RFC; Should rpcb_getaddr() be changed to not use UDP? Thread-Index: AQHY5/6z6yyrRac0k0y4eWgimCQQ2g== Date: Mon, 24 Oct 2022 23:29:22 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: YQXPR01MB4150:EE_|YT2PR01MB5268:EE_ x-ms-office365-filtering-correlation-id: 35e1d63f-2196-4061-607b-08dab617951c x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: PC2b/dvJd343LVd9X+tY78jOUMqzI/7FtdyX2UXaol2KBTsKuDqw5PfBikIpteDLQoCK7TmUHv/XgIXTYgSnBjXnFmRQWOLTil2pHzJixLd1CbyFOtSyeoonM0nDr4WPKN4fxjHCUfIFDxHKDhMqOswfM/IyTrs9b3gXPMniIofegzzHJ7TxWQ2nL1/iXp6WGb5gj34EDt06TWGkuuEJ+ucQvrceoZYQa4qp0m1PcdnVn8tO3jBfiB4subyw7mp+LVvxX6WcGL65aF/9V5y3f56WLG1ai1PKrcjKR8TkvcEBntq3EkysePFs68kUFMH07lEC69p9Iw8xS2J+rWICn1vFioff6TrdEjfSCPsRMETynYHtjPYVJMryWz5sx9wIjQMLor1Uwb/aCMafTTkDh3ul+viWFTOVJXfOJIFxYvvryuTsbz/2mYLyc3n/PFIEKUqIwt63zE5YuAo/UrYvdIc2H3gdzz/t0csJnFaf87HPaG93AKj0DEvGLoaaLIqzqorglebP0GHQlz0eCJGmh77w4bj9tsf1QxVJADUHfxKbyE5ahAFQzYfjgPB/ZUtJGfe3jjoEaE3ZKAg1kRcy01WcWT4ZnXTGcZEtsj+2GIeQ7A+mWjxmIuoAWjbBHMaCSjFc5uiEN7vPFbZIL/bTHcGrlnIdMILWnAfZi92WnM9pLE3t91mRg9lESU8MUU6OwvYTvJ26dYaYTrkFSGLDoLiGTVrb/oQVlwCt4jgL9L8LbpKH1egNm0xGRzQa68+RgJAtfeq7umMRBQZQGe+TMA== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(376002)(39860400002)(346002)(396003)(366004)(136003)(451199015)(38070700005)(76116006)(86362001)(33656002)(66476007)(66446008)(8936002)(38100700002)(122000001)(5660300002)(52536014)(66556008)(66946007)(91956017)(8676002)(41300700001)(64756008)(4326008)(41320700001)(2906002)(7696005)(6506007)(186003)(6916009)(786003)(316002)(55016003)(478600001)(71200400001)(9686003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?Mn9B0Pz3mMDmRHZS/M1PE6cl93v0bvVqcPG3n7ftYFyfA4j4WF7Hnw7VYu?= =?iso-8859-1?Q?J5CmSh0Ue4yMHf/c0+UyN/05QCaaC8MQ0COEzEp62CGz/og4kx14XxgR4j?= =?iso-8859-1?Q?CjrTau8a6BJ0/y215lS/DtRZu/cfXMPWaVoQ765yj3uWvAXLMTx0NJsXaA?= =?iso-8859-1?Q?F32QkZNkjYsYIiK+KHehMfC+WxI0E2ml05oxsjb5F/tv1/LyKD9CGMZP3q?= =?iso-8859-1?Q?MrWBTetBoFuAcE173vPGXMkM7cqprcPoFMbVy/LQGNOsrm3YcrKNCG8eQH?= =?iso-8859-1?Q?QHhcw9wJmvn9mVAfsmla/HQ1VNnqTv33yB2FSnD3gfvSADI7F/UKYeG8Fm?= =?iso-8859-1?Q?NvQmM+KAmRVA5bkuw789enX+4n09ut4EdYdnUkUJv2mu0skEKor/VwSCQn?= =?iso-8859-1?Q?N0fLISDTuGJoHh6Fy6ETKT/6Clgn6mQHZtADl4359N9nZz+/SQ8ezE9lnf?= =?iso-8859-1?Q?2LfgbLoezbGcUIGfyieizRgZgxAGLhBvkuxu+wBxisooBvn5I1TzvUtBQF?= =?iso-8859-1?Q?9BYXj8U8vF6w8XqJQ1/+nFh5rfV2b7CKRIZ/ZsQSIkIDw6rN53e3qkla5x?= =?iso-8859-1?Q?bJ/mt0gaMrBAoqbGIRgk+PYdsHzN45490EaPma1PXtjV2C6Zd8iqrb/8+9?= =?iso-8859-1?Q?ukpmGywNeEOd7BAUvo8SpPlXlWtHegbO8TqVHNL2SyE5z9FKS0n0HAXbE7?= =?iso-8859-1?Q?RuWT2/U/JyOESx/ca+AOu4AHkZ3IEi52CXLbb96iLA6URJkrXrC3Mic5B0?= =?iso-8859-1?Q?TgC+phTexEDBnEKscIWwxVyCq4kZjVXBE6FxjEgc6aqYZfmDQtCluboCNA?= =?iso-8859-1?Q?lGG4cUyywdCq2FX/y5khZrd+GiKs2YUcZmlIrwdB5YwtQTVgH0Djz6zgV1?= =?iso-8859-1?Q?GUjhtQLhJwo9e7VVetVuNwRZl4vktR2hAW2b/UbJ5KYRIpcQyAbkVtqLr3?= =?iso-8859-1?Q?tM8IMQnxm3gIaxrSv1F8Ind5FtKdZki8wJPJ/oSYErgT30prubxb0yYPLA?= =?iso-8859-1?Q?hhfa5BiDWcEd6QPbNB2tcsY3VLYztKb3y4T+Xd7P6tkxL9zQHzKuHbU+PJ?= =?iso-8859-1?Q?KxEG4w5KFNPDcdZc1p2U8tLJ1j4lVumMf5aWaMyn5KcM72Uchy6TIrqt2d?= =?iso-8859-1?Q?dPdOT4GdSGu2wD1pmCVvnlqfOVkpluQbGDWGdHQaIaWFR6OdNwV5Joj5Ga?= =?iso-8859-1?Q?CkrjF2A/G5BI68lfvx5ulf0EWqNw03CauYCGp2x9Rr8xum4Vdo0XO7maMO?= =?iso-8859-1?Q?vPUR8/HuEK758fFuQ/baKO3vZnmAJ9fDLFXe+f51PbVeywczMiR0Ii/ve/?= =?iso-8859-1?Q?wYdvEgZ6A1f+yBmhH0rFgXC07cBzLWczHJr0vw1yn5HS3XEqw26Ao3KSA+?= =?iso-8859-1?Q?OFZWf98/rEbDg61i26swaQN/NlP6KbkAnakodiUgCzFLTEKn92qxpdPk7n?= =?iso-8859-1?Q?E16eafMgIBgntGP9AMZ7htxWHYKQQ876/XXgupF32+ESyGhLC3ckoy1QkH?= =?iso-8859-1?Q?0mA5JxdqwvhSjvFnpw/HXcur2AWj4s3pKVxy0zz5EIFx+8mAVSY9MXxjPK?= =?iso-8859-1?Q?3TudweGb30acWs1KIlZZcpb2ltcaD4KJ68oa8iNKVvSXShMoXGJmzyp/RY?= =?iso-8859-1?Q?5Hat9r4uS8zyapeBxZ6qbDABJ3WJPN1RvNdGYqUoeAzDYgkU3NS2MWxOOQ?= =?iso-8859-1?Q?l8ttS+qfx2d/mTa2z7PLjZpp5T7m3CkPb/InxlEp?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4150.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 35e1d63f-2196-4061-607b-08dab617951c X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Oct 2022 23:29:22.8358 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 5sonfbSCxMRZDDooJ6CncuMVydPLzu4TXjU1S8fhm6r7M2OUyM0m4Ogb83YEuN2iff3jt5A9qwGXbgJ5Ky1sMg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB5268 X-Rspamd-Queue-Id: 4MxB9k5k6bz3LWY X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b="VwF6i/u8"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.116.48 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-4.94 / 15.00]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.94)[-0.943]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[40.107.116.48:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[rmacklem]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.116.48:from] X-ThisMailContainsUnwantedMimeParts: N Hi,=0A= =0A= PR#267301 reports a problem with an NFSv3 mount, due to the=0A= fact that UDP is always used to contact rpcbind/portmapper for=0A= the address. The code in rpcb_getaddr() looks like:=0A= /*=0A= * Try UDP only - there are some portmappers out=0A= * there that use UDP only.=0A= */=0A= if (strcmp(nconf->nc_proto, NC_TCP) =3D=3D 0) {=0A= struct netconfig *newnconf;=0A= =0A= if ((newnconf =3D getnetconfigent("udp")) =3D=3D NULL) {=0A= rpc_createerr.cf_stat =3D RPC_UNKNOWNPROTO;=0A= return (NULL);=0A= }=0A= client =3D getclnthandle(host, newnconf, &parms.r_addr);=0A= freenetconfigent(newnconf);=0A= } else {=0A= client =3D getclnthandle(host, nconf, &parms.r_addr);=0A= }=0A= It is pretty obvious why it uses UDP.=0A= However, the question becomes "should that still be the case?".=0A= =0A= Unfortunately, changing this function in libc will affect everything=0A= that uses rpcbind/portmapper, so it could either be considered a=0A= bugfix or a POLA violation to change it.=0A= =0A= The reporter notes that Azure expects TCP to be used and it appears=0A= that Linux now uses TCP, as well.=0A= The code has been like this since it was imported into FreeBSD from=0A= NetBSD 21years ago.=0A= =0A= Comments w.r.t. whether or not this should be changed would=0A= be appreciated.=0A= =0A= rick=0A= From nobody Tue Oct 25 05:40:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MxLPd3DXZz4gkXS for ; Tue, 25 Oct 2022 05:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MxLPd1Mpxz3nPG for ; Tue, 25 Oct 2022 05:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MxLPd0HvnzTrJ for ; Tue, 25 Oct 2022 05:40:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29P5eKxW089313 for ; Tue, 25 Oct 2022 05:40:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29P5eK2j089312 for fs@FreeBSD.org; Tue, 25 Oct 2022 05:40:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: corrupted zfs dataset (zfs issue) Date: Tue, 25 Oct 2022 05:40:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dpy@pobox.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666676421; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iT93RZe1QBUu06UhVtQUkSMcNiefJNDC3WBpXwQEX6k=; b=qEuIotb5fb2JHz9dbG3mgEnRIPwyDaju3BL0M4CjUQmpSOvOsIEuAU7BxBzAfokOuLCtFo awoY1j+oqQKr/nU7TSo7b+nDeLQptBs6mgsbFCrOYzbgmDzPQj7WtqYPvO/0tjq1/zgWIP v8okk72E8xxs/6AY/aKYIVIJ6N5nK7IrvjEOHwmhpECiWobkpeZviMg+aYwLnrQCia2NeJ y1ii5gWDgx9refGWzyr+/KWcqZVNO0elZYZh7ZNwHg1dnjqiQ5JpHfKwaIVMF+rLmyFWbK nwEuH3lc8W0rt0vP62WVCBkuLNtjaApDFGmZZxRMiiw2o3856ctqDXrLlW57UA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666676421; a=rsa-sha256; cv=none; b=Kq1TIlOuAh193ohVhV3JYPBarBmQUQoqTEKqi6CsBzCEpyJk7RDGpIwTadRiXWv4NvEruJ emue2b18obxJA5ugRGeBaMPMqlMeaxTS+UvVu4tAV5+NZ+XhlZzNZNziKwIHa/FmqiBYOF A9RKPk95RLSqwn1sGnpdKloFgOWMJQEpKgCqEuR/wOWTV8jy5Ngvkl9m9FnUxlbp05M08H hN/9eXhC7htjuXxiT0OX8O9AXRjVefdijWcCTuf8QKFQqODhhPHoq8FtSGmPadxa3uu+bJ Owm14b0w2db2lM550kGVNxF8u9e/zIQYl6F/FjUz9jAQQcZ+gQo4mUpu93dgdg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Duncan changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|panic: on long running find |panic: corrupted zfs |(zfs issue) |dataset (zfs issue) --- Comment #5 from Duncan --- I got back to trying to move forward with this issue (re-enabling full EOD runs) and found out where the problem was. In my nextcloud jail, part of the /usr/src file system would cause a panic = if accessed (i.e. running a find over it). I haven't gotten around to locating the exact directory/file. Now the interesting thing is that this dataset is encrypted and would mount when decrypted (using a key from higher up the filesytem hierarchy (typed in password as part of startup)). The panic would only occur on access to par= ts of the filesytem dataset. I tried replicating the dataset (to keep for later diagnosis), but upon mounting, machine would panic, requiring a boot into single user mode and deleting the copied dataset (probably should just modify "canmount"), before booting would complete without a panic. My backups(?) consisted of dataset replication onto other pools (in the same machine and to another (soon to be offsite machine (running truenas)). Whe= n I entered the key and mounting occurred, both other systems would panic. My only solution (I could think of), was to create a new dataset and copy o= ver (using rsync in this case) all the folders except /usr/src. I copied /usr/= src from another jail. I have renamed and kept the original dataset for potential debugging in the future. Moral of the story: Proof that ZFS replication is actually NOT the same as= a backup. The corruption was propagated in a more virulent form (mount =3D= =3D panic) to the replicated dataset. At some time I would appreciate being able to help someone figure out what = has happened to the dataset, and how to stop similar in the future. It has sha= ken my faith a little (in ZFS). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 25 23:25:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mxp2d5dfdz4gKs0 for ; Tue, 25 Oct 2022 23:25:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mxp2d4VhLz3v4w for ; Tue, 25 Oct 2022 23:25:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Mxp2d3YfGzvYs for ; Tue, 25 Oct 2022 23:25:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29PNPTYk017599 for ; Tue, 25 Oct 2022 23:25:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29PNPTfg017598 for fs@FreeBSD.org; Tue, 25 Oct 2022 23:25:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: corrupted zfs dataset (zfs issue) Date: Tue, 25 Oct 2022 23:25:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666740329; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kcDPecFtTjIQUWc5AWEbLLQxHV7TsnJv/aedLD8tjgE=; b=yX7nyOjjtVyyG60iKMNgjYuO7IniJUEXDSTQ5GTFkfPs543XmNQfiwy7Vhqbkf5Xm1P9w2 Tipo+KkudG8+NITQ1ZHQ7lNmozYPcUdYBHDs2c2uRl/X69oyZ1o+18R2ggHYjrb9pNHJ1c a8IQnV2ALvFiAvqKZd1tSUARrGgoRlOs9uPJWvs316TQDJYHFdQ/R2S5TNGjr3P7TNfDBT vsG/7bsZtCl55ySXMPUR0JAqEM/7TBasXjnXkAvZCC3h7PaU+D31+iTt8azRBugtky1E6z N2cJbfHAlfcdafJPCQr929xLpP9WXVLHMlsVi5WvEE2Ab880Bk8yvf/CySoCmw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666740329; a=rsa-sha256; cv=none; b=vxut/8tt98sT9yBB+tG7G6GRa+NcVBHL9cqSYvV0X5Nr8eS0p9i2pVawNae5IdIuLZRGa3 q/ejKddleivT2XVnVQor4ol4IEDsrZ7TJRh+z9M9MkxO0hs5RDfw2HH4dWkaMRIliGXNRS /VvKdqQAjHynTV+cwwUDJ8gguqc/+MQ52MXHy4m/Y8meFSYjvFsuWv55G9/5M1EZB1YGiC tfHcJxkj7P05CyoYmW0mLufRDRrGNdDXcSRlkewOo6lMUZiOl2hb7bCQf149i4tulsci/c 2pQbrs4q+64h8I296o7ifDhP5oCoykR8xn06rLbgD8ee0rF/LwZDfxsANkOnXQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open --- Comment #6 from Graham Perrin --- (In reply to Duncan from comment #5) > =E2=80=A6 I tried replicating the dataset (to keep for later diagnosis), = but upon=20 > mounting, machine would panic, =E2=80=A6 Was the try entirely successful?=20 Is it the same type of panic?=20 >From = (I can not verify this):=20 >> =E2=80=A6 Replicating broken snapshots/datasets isn't possible. Even if = there's an=20 >> unrepairable CKSUM error in a data block inside a file, and all the actu= al=20 >> metadata is intact, zfs will refuse to send that snapshot. =E2=80=A6 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 26 00:18:08 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MxqCN1lmVz4gSdP for ; Wed, 26 Oct 2022 00:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MxqCN0kXTz3yg2 for ; Wed, 26 Oct 2022 00:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MxqCM6vbZzxbv for ; Wed, 26 Oct 2022 00:18:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29Q0I7bC003118 for ; Wed, 26 Oct 2022 00:18:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29Q0I7d9003117 for fs@FreeBSD.org; Wed, 26 Oct 2022 00:18:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: corrupted zfs dataset (zfs issue) Date: Wed, 26 Oct 2022 00:18:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dpy@pobox.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1666743488; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7sG6E+bteVZ76UIvIRYTEW7cKyC7PlkoagcEx3Odsug=; b=iEdaffsjFGT4GygRehAmHQqONwtDXnkvcElWM1ghCOJSI5mzgi2rrQfqaMlp3YfJQ1OQZD Tf9lbBcjzU4asaKDvpda33q8VnUwmqNmv74BzsZihoQspJKHxJAb3v270SddiFZz1FHnL1 bzVkWTJZU23oTn2eTcoWkrU5K5okxZwCiVNLF759TiTcnaqkzPs2EAP39j9jEQxU3MN++k ZSKz97SGUvDYkL+LinrHiD/YZCxTHTOVY5O+V6e7Wosz+F4/AVd2ydFtxAXlixXajlsXGh DELoJ3zYjjh2DtermJG661IVfVnkjCWBC8/1Wwfg4ZtWly8a9dO8tUtuSOWVSA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1666743488; a=rsa-sha256; cv=none; b=YBk5ryBSFqPD1Nf5PqY3dK1JE9Qt9ikdNzn3Ewtz9Ts3/aH8r2f+oxmVbZWUQNGPLGG1NS xokIeSEQRv3J9hjC0Lm1r/EGUBmyH0CqkKiYolBEeVZ/KkJ1dsiZdmNT0k3ijVtlPuQW/l 1tImf7P+/Q22j+d5It24w9p/ZOBQA2Z2jOqM5wD3/e1Y0a8kvBEi8xA16WDWAkCroKEjn0 vqNYlN8FoSgMMWpZXsW2n44Kg29Wa2K6kBIXMYwL6+15E706DSNh+P/6T3Z3obIDluvFxq nvHnAaDEUrGI3P7qxS1wNHnIPKdWaQnyWv10zVry0D2SgHV7EDFMd7U4jyh4mg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 --- Comment #7 from Duncan --- (In reply to Graham Perrin from comment #6) The replication I beleive works fine, as long as one doesn't then try to mo= unt the dataset. I will check this properly and perphaps try setting up another machine to run the panics on. It is a bit of a pain to keep knocking over = my main server. I should get back to this within the week.=20 I did get a different type of crash dump, I believe from the mount and it is different, i.e. Unread portion of the kernel message buffer: panic: VERIFY3(sa.sa_magic =3D=3D SA_MAGIC) failed (1122422741 =3D=3D 31007= 62) cpuid =3D 5 time =3D 1666406111 KDB: stack backtrace: #0 0xffffffff80c694a5 at kdb_backtrace+0x65 #1 0xffffffff80c1bb5f at vpanic+0x17f #2 0xffffffff84ff4f4a at spl_panic+0x3a #3 0xffffffff851948f8 at zpl_get_file_info+0x1d8 #4 0xffffffff85060388 at dmu_objset_userquota_get_ids+0x298 #5 0xffffffff85073f24 at dnode_setdirty+0x34 #6 0xffffffff8504bd49 at dbuf_dirty+0x9d9 #7 0xffffffff85061fc0 at dmu_objset_space_upgrade+0x40 #8 0xffffffff85060a5f at dmu_objset_id_quota_upgrade_cb+0x14f #9 0xffffffff85061eaf at dmu_objset_upgrade_task_cb+0x7f #10 0xffffffff84ff6a0f at taskq_run+0x1f #11 0xffffffff80c7da81 at taskqueue_run_locked+0x181 #12 0xffffffff80c7ed92 at taskqueue_thread_loop+0xc2 #13 0xffffffff80bd8a9e at fork_exit+0x7e #14 0xffffffff810885ee at fork_trampoline+0xe Uptime: 13m13s (ada0:ahcich1:0:0:0): spin-down (ada1:ahcich2:0:0:0): spin-down (ada2:ahcich3:0:0:0): spin-down (ada3:ahcich4:0:0:0): spin-down Dumping 13911 out of 130858 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(stru= ct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3D) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff80c1b75c in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff80c1bbce in vpanic ( fmt=3D0xffffffff85250fe8 "VERIFY3(sa.sa_magic =3D=3D SA_MAGIC) failed (= %llu =3D=3D %llu)\n", ap=3D) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff84ff4f4a in spl_panic (file=3D, func=3D, line=3D, fmt=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_misc.c:107 #5 0xffffffff851948f8 in zpl_get_file_info (bonustype=3D, data=3D0xfffffe035db250c0, zoi=3D0xfffffe027e72bc50) at /usr/src/sys/contrib/openzfs/module/zfs/zfs_quota.c:89 #6 0xffffffff85060388 in dmu_objset_userquota_get_ids ( dn=3D0xfffff8160ebcf660, before=3Dbefore@entry=3D1, tx=3D, tx@entry=3D0xfffff80ec760a100) at /usr/src/sys/contrib/openzfs/module/zfs/dmu_objset.c:2215 #7 0xffffffff85073f24 in dnode_setdirty (dn=3D0xfffff8160ebcf660, tx=3D0xfffff80ec760a100) at /usr/src/sys/contrib/openzfs/module/zfs/dnode.c:1691 #8 0xffffffff8504bd49 in dbuf_dirty (db=3D0xfffff8160ebd3b90, db@entry=3D0= x0, tx=3Dtx@entry=3D0xfffff8160ebd3b90) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:2367 #9 0xffffffff8504c074 in dmu_buf_will_dirty_impl (db_fake=3D, flags=3D, flags@entry=3D9, tx=3D0xfffff8160ebd3b90, tx@entry=3D0xfffff80ec760a100) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:2517 #10 0xffffffff8504aea2 in dmu_buf_will_dirty (db_fake=3D, tx=3D, tx@entry=3D0xfffff80ec760a100) at /usr/src/sys/contrib/openzfs/module/zfs/dbuf.c:2523 #11 0xffffffff85061fc0 in dmu_objset_space_upgrade ( os=3Dos@entry=3D0xfffff80408629800) at /usr/src/sys/contrib/openzfs/module/zfs/dmu_objset.c:2328 #12 0xffffffff85060a5f in dmu_objset_id_quota_upgrade_cb ( os=3D0xfffff80408629800) at /usr/src/sys/contrib/openzfs/module/zfs/dmu_objset.c:2385 #13 0xffffffff85061eaf in dmu_objset_upgrade_task_cb (data=3D0xfffff8040862= 9800) at /usr/src/sys/contrib/openzfs/module/zfs/dmu_objset.c:1447 #14 0xffffffff84ff6a0f in taskq_run (arg=3D0xfffff801e5ab5300, pending=3D) at /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_taskq.c:315 #15 0xffffffff80c7da81 in taskqueue_run_locked ( queue=3Dqueue@entry=3D0xfffff80116004300) at /usr/src/sys/kern/subr_taskqueue.c:477 #16 0xffffffff80c7ed92 in taskqueue_thread_loop (arg=3D, arg@entry=3D0xfffff801dfb570d0) at /usr/src/sys/kern/subr_taskqueue.c:7= 94 #17 0xffffffff80bd8a9e in fork_exit ( callout=3D0xffffffff80c7ecd0 , arg=3D0xfffff801dfb570d0, frame=3D0xfffffe027e72bf40) at /usr/src/sys/kern/kern_fork.c:1093 #18 #19 mi_startup () at /usr/src/sys/kern/init_main.c:322 #20 0xffffffff80f791d9 in swapper () at /usr/src/sys/vm/vm_swapout.c:755 #21 0xffffffff80385022 in btext () at /usr/src/sys/amd64/amd64/locore.S:80 ---------------------- I would say this is a similar but different problem. I had months of replicated copies on two different pools. Because I copied (send/recieve) = them encrypted and unmounted on the destination, nothing showed up. As soon as I tried to mount them, panic. Currently I have renamed the original dataset (currently unmounted), but I deleted the backups (they wouldn't mount, but I'm sure I can re-create them= ). I will do more experimintaion when I have a couple of hours spare (within t= he week) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Oct 27 13:26:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MymfK5LK3z4g2WW for ; Thu, 27 Oct 2022 13:26:17 +0000 (UTC) (envelope-from tdtemccnp@gmail.com) Received: from mail-ed1-x532.google.com (mail-ed1-x532.google.com [IPv6:2a00:1450:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MymfK1nGRz3HvT for ; Thu, 27 Oct 2022 13:26:17 +0000 (UTC) (envelope-from tdtemccnp@gmail.com) Received: by mail-ed1-x532.google.com with SMTP id i21so2689334edj.10 for ; Thu, 27 Oct 2022 06:26:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=vpErSzIABwFAsUF7SpgF84+/aqc303HdgJYl1u4N2K8=; b=ZyOIduGvjvRqHZdE0O5wquAFuM4CFv3o/dVZest+p1DUSlkkmXSdWdsn3BFRtd6/o8 /3bzhypSVxjVnz4c/UQDop+B7EepqOvVXkg+7sM94dW+jnnUxPvO2aRvC5bQMX6BhkkK LGPYeIDLrWvVcY0E+O0FBYhLv8gD7DbhAoryASw5iNEIhfvdEa1rDqHMfhBTMxpoPV3T 3rx7hXmYnyisFgRGsy/5so5pMiB5WCZx8a2E04UOBwqZ9rHZRHHwe74A0vcEZbmYRHeE mBzdo5PGPlsiqM8MUp6jL4PdShoZL1TUdAla1nm198BIpFDy2whQ5p2JpmQZ1v+o0ZQl rC7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=vpErSzIABwFAsUF7SpgF84+/aqc303HdgJYl1u4N2K8=; b=NtFV2mEE2s1UKT+Ws+QQJQ6cBPq0KzHIAVOTWsypZ2IvKNEzJbnzcDmehjHQIh0LVV c1P/Eu2fXLmr+dMWcAk8XOfPh1zoNAZJd4vVFKq5KUuAdiWTRohhOtWcERMRM56iL8qD D08PEX3f5hVFaVzjb/Svm5WdVKr+UNEZiCMcao412ibONPanAQtbm08DFAyIt77jyfmG PCg8y5CRU5H1gjONahJ+sLvl+h9vgKabC8cTyBQuDC7RIeMdwr0dmupr5J3QyvFfJSBj piaA/wOh/xmwDahZonW1ai56Jri2H0AnDZLT174QNGpJwIbns8ZKb4sbF2+lOncyP4I+ 7N4g== X-Gm-Message-State: ACrzQf3VPQdjdYpdPaw+5/67XXisB+fpwfAB+ZWoyrpQ+0zRmaV/XGTh 7Qd8JCDEm9vSJzwrBCgHJRUj9OS1AT+VZwW2HWPB7O++GmA= X-Google-Smtp-Source: AMsMyM7BcBF3ryhAA62xav+b9kjhLMl2XRoY1pFyy+ODeEpYo4oWSpoRHXGeEfxfJ9mvI2GQqx/HER/d4+nMdPkfhDQ= X-Received: by 2002:a50:ee87:0:b0:461:a09b:aae5 with SMTP id f7-20020a50ee87000000b00461a09baae5mr22927249edr.24.1666877175771; Thu, 27 Oct 2022 06:26:15 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Turritopsis Dohrnii Teo En Ming Date: Thu, 27 Oct 2022 21:26:08 +0800 Message-ID: Subject: Does OpenZFS support taking snapshots of the entire operating system? To: freebsd-fs@freebsd.org Cc: ceo@teo-en-ming-corp.com Content-Type: multipart/alternative; boundary="000000000000f235a705ec041538" X-Rspamd-Queue-Id: 4MymfK1nGRz3HvT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=ZyOIduGv; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of tdtemccnp@gmail.com designates 2a00:1450:4864:20::532 as permitted sender) smtp.mailfrom=tdtemccnp@gmail.com X-Spamd-Result: default: False [-2.83 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-0.97)[-0.972]; NEURAL_HAM_SHORT(-0.96)[-0.962]; NEURAL_HAM_MEDIUM(-0.90)[-0.897]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::532:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000f235a705ec041538 Content-Type: text/plain; charset="UTF-8" Subject: Does OpenZFS support taking snapshots of the entire operating system? Good day from Singapore, Does OpenZFS support taking snapshots of the entire operating system? Please advise. Thank you. Regards, Mr. Turritopsis Dohrnii Teo En Ming Targeted Individual in Singapore Blogs: https://tdtemcerts.blogspot.com https://tdtemcerts.wordpress.com --000000000000f235a705ec041538 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Subject: Does OpenZFS support taking snapshots of the enti= re operating system?

Good day from Singapore,

Does OpenZFS su= pport taking snapshots of the entire operating system?

Please advise= .

Thank you.

Regards,

Mr. Turritopsis Dohrnii Teo En M= ing
Targeted Individual in Singapore
Blogs:
https://tdtemcerts.blogspot.com
https://tdtemcerts.wordpress.com
--000000000000f235a705ec041538-- From nobody Thu Oct 27 13:29:21 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mymkf3cxfz4g2p6 for ; Thu, 27 Oct 2022 13:30:02 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mymkd2HXgz3KCK for ; Thu, 27 Oct 2022 13:30:01 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id C53352110B5 for ; Thu, 27 Oct 2022 09:29:24 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 671E72A9280 for ; Thu, 27 Oct 2022 09:29:24 -0400 (EDT) Message-ID: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> Date: Thu, 27 Oct 2022 09:29:21 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.4.0 Subject: Re: Does OpenZFS support taking snapshots of the entire operating system? Content-Language: en-US To: freebsd-fs@freebsd.org References: From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms090807010207010804050601" X-Rspamd-Queue-Id: 4Mymkd2HXgz3KCK X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-4.90 / 15.00]; SIGNED_SMIME(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[karl]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_NONE(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms090807010207010804050601 Content-Type: multipart/alternative; boundary="------------MjRFIkfueLjNyM8VTHUzpAnt" --------------MjRFIkfueLjNyM8VTHUzpAnt Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit You can snapshot a running root filesystem if it is ZFS; that has always been true of ZFS. If the "entire operating system" spans more than one filesystem or pool, however, you cannot get an atomic snapshot across them. Thus if you want that capacity (e.g. an atomic snapshot that is an "instant in time") the "entire operating system" must be contained in one ZFS filesystem. On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote: > Subject: Does OpenZFS support taking snapshots of the entire operating > system? > > Good day from Singapore, > > Does OpenZFS support taking snapshots of the entire operating system? > > -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------MjRFIkfueLjNyM8VTHUzpAnt Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

You can snapshot a running root filesystem if it is ZFS; that has always been true of ZFS.

If the "entire operating system" spans more than one filesystem or pool, however, you cannot get an atomic snapshot across them.  Thus if you want that capacity (e.g. an atomic snapshot that is an "instant in time") the "entire operating system" must be contained in one ZFS filesystem.

On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote:
Subject: Does OpenZFS support taking snapshots of the entire operating system?

Good day from Singapore,

Does OpenZFS support taking snapshots of the entire operating system?


--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------MjRFIkfueLjNyM8VTHUzpAnt-- --------------ms090807010207010804050601 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B 3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5 CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY 2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5 c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj 7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn 3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6 Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g 3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG 7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c 5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yMjEwMjcxMzI5MjNaME8GCSqGSIb3DQEJBDFCBECmRsf8G7l8C0RRnqIy HflX8Wg/iBgY3r/MvXoxC784l0GO4JrDK+L5tpQcyuaM9Ocgwvn/g5SL+xry2N+O3E8wMGwG CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgCUrhYO9pimg+ZtpjJ6lzOQOuoefe7+BCjZ5KgV JRs/zJFRLYFwDs/xhbnj00IjOi49qtokQhXYNetlX8JL7STl64RHNdIFo2iSeIPz18po5vLk gut1cMowDv7Ll+bYccEavadHgvHKLeSO98fKpf1BbhKurcVGLXiao1KTKfqKtenFQedsSIJs i4k4wl8FNbxBoUtkyApqnMxH0VrBQnyroGNSexItt1cUON9XP9C9xt61tVqpD+0wgIODhhvj CN08D1Q9P5xMxez6CXnuzfn+gfRotZP8rth581XGJKXqBo0cOfAC6ZmblIcVPibR4O11gDpS /94kECAUF52qWMoRrthQnno2Ch8+VnmjRIP1XGH3GxAkrwJ2UMnoJTZsppROa82l9EBsgAQS Hykbo5/ArfH7qAp5OR1yvsKsa9gtzCAnPhe/YiMWBwILxMLugiXvhoqHSE3QslRPr6LzITV9 XO5PSLBA4ezIEZiQ2nC9Xuq5oOrGVI1wfu3cLtNrE2Ogw12AQCd40qLIhEC92vMRTR7CimrP XAjPq7Y3qFWaDj3dKmJDvTgXBKGcAA2JGzb5Qz+cdgBMFqizETnOKSqZgcrVNn+BUxxLwKJP QJkcwYSyDDnYKqFTx1PEHsLcqwh45JvmPyV6BPGe+onxXlu0st7nWeU5zXfdbg6ddhIuMAAA AAAAAA== --------------ms090807010207010804050601-- From nobody Thu Oct 27 13:32:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mymp92F6Pz4g3Zf for ; Thu, 27 Oct 2022 13:33:05 +0000 (UTC) (envelope-from tdtemccnp@gmail.com) Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mymp826n2z3LjY for ; Thu, 27 Oct 2022 13:33:04 +0000 (UTC) (envelope-from tdtemccnp@gmail.com) Received: by mail-ej1-x62e.google.com with SMTP id d26so4574300eje.10 for ; Thu, 27 Oct 2022 06:33:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=3Siyv4RDdowvPBtO+LCh2v/fYJUWqDjKOMlSqDj8zTs=; b=WKJ6j2WCa9csdfyXA5mizzfNCqCsnMmsRF/2/Kf7lYlLC3G14m28V3WM+MSonvLpUR wuB5P2OsMYDkyBXc7Wo8w5uPATiLCfh1THnLbbKpWWpzW3PkKaXlZ7a39xM9XWE3oBBw NbOqMiCtH6UJZjozHVF/xypwXPuKzTbdeVJPpTZIFBdHdfX7/ePQG+ZLfUGFFmzTzdaw /BDJiz8wjSnrVbAgqCfIqLQHJnOVZIEgFGIlZEr4w5fr7JgpFK8ZzbQU1zSNRIq7idDJ XWfWdwOukTyJlyI12b9eb8h/F239+oiWOb7nq5pkzOxbKwDQH2ws8ubn9o7xdzaOlHmh RUAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=3Siyv4RDdowvPBtO+LCh2v/fYJUWqDjKOMlSqDj8zTs=; b=ZmfVSNQ67zwlU2BtpDn9l00O5hl2dan3rIkoN+YWnGJXowHSRLH74/ngNZAk5c3VLn +h6Pne/Jo2CVSBm+ffb3DDjiPrpcW6lr4k9ofI+VF+rPtl+g8Lt8tIklMqSnxi9kb3fh nTGEIGETi7HE64ETjMuM5iS8y4vm04HD7ZcvW8oM0BEAHZP0K6syeE94uZ6ihmD1lvRm 34BI2X2+mehCInq91saImY5ZrrhQA8c5tWc8a/qKzebueiUqQk6vLbXAEGKwIhhXKheP CcBierxJyAt8R+b+SEIh5aPv5IR6BH+EXOV/0bTU2+GxAkh1Lhue+8nBdp4pp47M2hlS nyHg== X-Gm-Message-State: ACrzQf3sGmB6cbZ/r7/yiAJaxy0L0Kg4aA+Xc1723DsaADREAojVjiTT Nq4Cva0OQRwrQyjuRR1K+43RPRXoGt83KknqQ5NIDryX X-Google-Smtp-Source: AMsMyM6QzHb2hEIMR6Xb5fgNOEbovHzksVgFEPUJQ982Ijdc0GgwUCr7tATkllrHb5hKVh2qwwj/P9qVBtrwr1ebL9Y= X-Received: by 2002:a17:907:761b:b0:7a3:86dd:d330 with SMTP id jx27-20020a170907761b00b007a386ddd330mr22562857ejc.34.1666877583014; Thu, 27 Oct 2022 06:33:03 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> In-Reply-To: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> From: Turritopsis Dohrnii Teo En Ming Date: Thu, 27 Oct 2022 21:32:56 +0800 Message-ID: Subject: Re: Does OpenZFS support taking snapshots of the entire operating system? To: Karl Denninger Cc: freebsd-fs@freebsd.org, ceo@teo-en-ming-corp.com Content-Type: multipart/alternative; boundary="000000000000383f0805ec042e5c" X-Rspamd-Queue-Id: 4Mymp826n2z3LjY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=WKJ6j2WC; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of tdtemccnp@gmail.com designates 2a00:1450:4864:20::62e as permitted sender) smtp.mailfrom=tdtemccnp@gmail.com X-Spamd-Result: default: False [-2.93 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.98)[-0.977]; NEURAL_HAM_MEDIUM(-0.95)[-0.951]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62e:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000383f0805ec042e5c Content-Type: text/plain; charset="UTF-8" On Thu, 27 Oct 2022 at 21:30, Karl Denninger wrote: > You can snapshot a running root filesystem if it is ZFS; that has always > been true of ZFS. > > If the "entire operating system" spans more than one filesystem or pool, > however, you cannot get an atomic snapshot across them. Thus if you want > that capacity (e.g. an atomic snapshot that is an "instant in time") the > "entire operating system" must be contained in one ZFS filesystem. > On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote: > > Subject: Does OpenZFS support taking snapshots of the entire operating > system? > > Good day from Singapore, > > Does OpenZFS support taking snapshots of the entire operating system? > > > -- > Karl Denninger > karl@denninger.net > *The Market Ticker* > *[S/MIME encrypted email preferred]* > Noted with thanks Karl. Mr. Turritopsis Dohrnii Teo En Ming Targeted Individual in Singapore --000000000000383f0805ec042e5c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Thu, 27 Oct 2022 at 21:30, Karl De= nninger <karl@denninger.net>= ; wrote:
=20 =20 =20

You can snapshot a running root filesystem if it is ZFS; that has always been true of ZFS.

If the "entire operating system" spans more than one files= ystem or pool, however, you cannot get an atomic snapshot across them.=C2= =A0 Thus if you want that capacity (e.g. an atomic snapshot that is an "instant in time") the "entire operating system" = must be contained in one ZFS filesystem.

On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote:
=20
Subject: Does OpenZFS support taking snapshots of the entire operating system?

Good day from Singapore,

Does OpenZFS support taking snapshots of the entire operating system?


--
Karl Denninger
karl@denninge= r.net
The Market Ticker
[S/MIME encrypted email preferred]

Noted with thanks Karl.

Mr. Turritopsis Dohrnii Teo En Ming
Targeted Indi= vidual in Singapore=C2=A0
--000000000000383f0805ec042e5c-- From nobody Fri Oct 28 08:26:19 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MzFxy50ysz4gP2w for ; Fri, 28 Oct 2022 08:26:30 +0000 (UTC) (envelope-from matt@userve.net) Received: from smtp-a.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.userve.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MzFxw75nwz3DJH for ; Fri, 28 Oct 2022 08:26:28 +0000 (UTC) (envelope-from matt@userve.net) Received: from dc.ad.unitron.net (owa.usd-group.com [217.196.1.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp-a.userve.net (Postfix) with ESMTPS id CB00F238396; Fri, 28 Oct 2022 09:26:20 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=uk1; t=1666945580; bh=QFBGvMAf4O/+GHGD+rEr5gZ7sqvyXjsH2dNuPtcuKTs=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=pPBtz1TUYUUDoZY7zbTXWmIPQ63hjF1/tOIa4LySxOEu2yqFtHWS/LE6PcRCr37Rc /qZ3sZF/zvURvdYunxLgzJdQ0laq8lhSeH2YtN00GsQZXfpCqEs7vbdgHkqH8JsdaT /KCS6N0Pm2Sp4fsWFvSruHHNaqTDn2BSrWSeo7rM= Received: from dc.ad.unitron.net (192.168.0.100) by dc.ad.unitron.net (192.168.0.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.7; Fri, 28 Oct 2022 09:26:20 +0100 Received: from dc.ad.unitron.net ([fe80::5f3:fd35:db1:9809]) by dc.ad.unitron.net ([fe80::5f3:fd35:db1:9809%6]) with mapi id 15.02.1118.007; Fri, 28 Oct 2022 09:26:19 +0100 From: Matt Churchyard To: Karl Denninger , "freebsd-fs@freebsd.org" CC: "ceo@teo-en-ming-corp.com" Subject: RE: Does OpenZFS support taking snapshots of the entire operating system? Thread-Topic: Does OpenZFS support taking snapshots of the entire operating system? Thread-Index: AQHY6ge1GYnOQp4p1Eu3itZIUxAfsK4iK2uAgAFNsrA= Date: Fri, 28 Oct 2022 08:26:19 +0000 Message-ID: References: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> In-Reply-To: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.8] Content-Type: multipart/alternative; boundary="_000_eccf1dfa00df4b8ea44dd721b3f2c111uservenet_" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Rspamd-Queue-Id: 4MzFxw75nwz3DJH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=userve.net header.s=uk1 header.b=pPBtz1TU; dmarc=none; spf=pass (mx1.freebsd.org: domain of matt@userve.net designates 217.196.1.22 as permitted sender) smtp.mailfrom=matt@userve.net X-Spamd-Result: default: False [-2.40 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[userve.net:s=uk1]; R_SPF_ALLOW(-0.20)[+ip4:217.196.1.0/24]; MIME_BASE64_TEXT(0.10)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_EQ_ADDR_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:20652, ipnet:217.196.0.0/20, country:GB]; DKIM_TRACE(0.00)[userve.net:+]; RCVD_COUNT_THREE(0.00)[4]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_XOIP(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[userve.net]; FREEFALL_USER(0.00)[matt]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --_000_eccf1dfa00df4b8ea44dd721b3f2c111uservenet_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 LS0gWW91IGNhbiBzbmFwc2hvdCBhIHJ1bm5pbmcgcm9vdCBmaWxlc3lzdGVtIGlmIGl0IGlzIFpG UzsgdGhhdCBoYXMgYWx3YXlzIGJlZW4gdHJ1ZSBvZiBaRlMuDQoNCi0tIElmIHRoZSAiZW50aXJl IG9wZXJhdGluZyBzeXN0ZW0iIHNwYW5zIG1vcmUgdGhhbiBvbmUgZmlsZXN5c3RlbSBvciBwb29s LCBob3dldmVyLCB5b3UgY2Fubm90IGdldCBhbiBhdG9taWMgc25hcHNob3QgYWNyb3NzIHRoZW0u ICBUaHVzIGlmIHlvdSB3YW50IHRoYXQgY2FwYWNpdHkgKGUuZy4gYW4gYXRvbWljIHNuYXBzaG90 IHRoYXQgaXMgYW4gImluc3RhbnQgaW4gdGltZSIpIHRoZSAiZW50aXJlIG9wZXJhdGluZyBzeXN0 ZW0iIG11c3QgYmUgY29udGFpbmVkIGluIG9uZSBaRlMgZmlsZXN5c3RlbS4NCg0KRnJvbSB0aGUg WkZTIG1hbiBwYWdlIOKAkw0KDQrigJwtcjogUmVjdXJzaXZlbHkgY3JlYXRlIHNuYXBzaG90cyBv ZiBhbGwgZGVzY2VuZGVudCBkYXRhc2V0cy4gU25hcHNob3RzIGFyZSB0YWtlbiBhdG9taWNhbGx5 LCBzbyB0aGF0IGFsbCByZWN1cnNpdmUgc25hcHNob3RzIGNvcnJlc3BvbmQgdG8gdGhlIHNhbWUg bW9tZW50IGluIHRpbWUu4oCdDQoNCkl04oCZcyBwZXJmZWN0bHkgcG9zc2libGUgdG8gdGFrZSBh biBhdG9taWMgc25hcHNob3Qgb2YgZXZlcnkgZGF0YXNldCBvbiBhIHBvb2wuDQoNCi0NCk1hdHQN Ck9uIDEwLzI3LzIwMjIgMDk6MjYsIFR1cnJpdG9wc2lzIERvaHJuaWkgVGVvIEVuIE1pbmcgd3Jv dGU6DQpTdWJqZWN0OiBEb2VzIE9wZW5aRlMgc3VwcG9ydCB0YWtpbmcgc25hcHNob3RzIG9mIHRo ZSBlbnRpcmUgb3BlcmF0aW5nIHN5c3RlbT8NCg0KR29vZCBkYXkgZnJvbSBTaW5nYXBvcmUsDQoN CkRvZXMgT3BlblpGUyBzdXBwb3J0IHRha2luZyBzbmFwc2hvdHMgb2YgdGhlIGVudGlyZSBvcGVy YXRpbmcgc3lzdGVtPw0KDQotLQ0KS2FybCBEZW5uaW5nZXINCmthcmxAZGVubmluZ2VyLm5ldDxt YWlsdG86a2FybEBkZW5uaW5nZXIubmV0Pg0KVGhlIE1hcmtldCBUaWNrZXINCltTL01JTUUgZW5j cnlwdGVkIGVtYWlsIHByZWZlcnJlZF0NCg== --_000_eccf1dfa00df4b8ea44dd721b3f2c111uservenet_ Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: base64 PGh0bWwgeG1sbnM6dj0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp2bWwiIHhtbG5zOm89InVy bjpzY2hlbWFzLW1pY3Jvc29mdC1jb206b2ZmaWNlOm9mZmljZSIgeG1sbnM6dz0idXJuOnNjaGVt YXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6d29yZCIgeG1sbnM6bT0iaHR0cDovL3NjaGVtYXMubWlj cm9zb2Z0LmNvbS9vZmZpY2UvMjAwNC8xMi9vbW1sIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv VFIvUkVDLWh0bWw0MCI+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIg Y29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjxtZXRhIG5hbWU9IkdlbmVyYXRv ciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTUgKGZpbHRlcmVkIG1lZGl1bSkiPg0KPHN0eWxl PjwhLS0NCi8qIEZvbnQgRGVmaW5pdGlvbnMgKi8NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6 V2luZ2RpbmdzOw0KCXBhbm9zZS0xOjUgMCAwIDAgMCAwIDAgMCAwIDA7fQ0KQGZvbnQtZmFjZQ0K CXtmb250LWZhbWlseToiQ2FtYnJpYSBNYXRoIjsNCglwYW5vc2UtMToyIDQgNSAzIDUgNCA2IDMg MiA0O30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6Q2FsaWJyaTsNCglwYW5vc2UtMToyIDE1 IDUgMiAyIDIgNCAzIDIgNDt9DQovKiBTdHlsZSBEZWZpbml0aW9ucyAqLw0KcC5Nc29Ob3JtYWws IGxpLk1zb05vcm1hbCwgZGl2Lk1zb05vcm1hbA0KCXttYXJnaW46MGNtOw0KCWZvbnQtc2l6ZTox MS4wcHQ7DQoJZm9udC1mYW1pbHk6IkNhbGlicmkiLHNhbnMtc2VyaWY7fQ0KYTpsaW5rLCBzcGFu Lk1zb0h5cGVybGluaw0KCXttc28tc3R5bGUtcHJpb3JpdHk6OTk7DQoJY29sb3I6Ymx1ZTsNCgl0 ZXh0LWRlY29yYXRpb246dW5kZXJsaW5lO30NCnNwYW4uRW1haWxTdHlsZTIwDQoJe21zby1zdHls ZS10eXBlOnBlcnNvbmFsLWNvbXBvc2U7DQoJZm9udC1mYW1pbHk6IkNhbGlicmkiLHNhbnMtc2Vy aWY7DQoJY29sb3I6d2luZG93dGV4dDt9DQouTXNvQ2hwRGVmYXVsdA0KCXttc28tc3R5bGUtdHlw ZTpleHBvcnQtb25seTsNCglmb250LXNpemU6MTAuMHB0O30NCkBwYWdlIFdvcmRTZWN0aW9uMQ0K CXtzaXplOjYxMi4wcHQgNzkyLjBwdDsNCgltYXJnaW46NzIuMHB0IDcyLjBwdCA3Mi4wcHQgNzIu MHB0O30NCmRpdi5Xb3JkU2VjdGlvbjENCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQ0KLyogTGlzdCBE ZWZpbml0aW9ucyAqLw0KQGxpc3QgbDANCgl7bXNvLWxpc3QtaWQ6MjkzNjMzNjEzOw0KCW1zby1s aXN0LXR5cGU6aHlicmlkOw0KCW1zby1saXN0LXRlbXBsYXRlLWlkczo3NTc2NDg4ODIgNDI4NDAx MDg4IDEzNDgwNzU1NSAxMzQ4MDc1NTcgMTM0ODA3NTUzIDEzNDgwNzU1NSAxMzQ4MDc1NTcgMTM0 ODA3NTUzIDEzNDgwNzU1NSAxMzQ4MDc1NTc7fQ0KQGxpc3QgbDA6bGV2ZWwxDQoJe21zby1sZXZl bC1zdGFydC1hdDowOw0KCW1zby1sZXZlbC1udW1iZXItZm9ybWF0OmJ1bGxldDsNCgltc28tbGV2 ZWwtdGV4dDrvga47DQoJbXNvLWxldmVsLXRhYi1zdG9wOm5vbmU7DQoJbXNvLWxldmVsLW51bWJl ci1wb3NpdGlvbjpsZWZ0Ow0KCXRleHQtaW5kZW50Oi0xOC4wcHQ7DQoJZm9udC1mYW1pbHk6V2lu Z2RpbmdzOw0KCW1zby1mYXJlYXN0LWZvbnQtZmFtaWx5OkNhbGlicmk7DQoJbXNvLWJpZGktZm9u dC1mYW1pbHk6Q2FsaWJyaTt9DQpAbGlzdCBsMDpsZXZlbDINCgl7bXNvLWxldmVsLW51bWJlci1m b3JtYXQ6YnVsbGV0Ow0KCW1zby1sZXZlbC10ZXh0Om87DQoJbXNvLWxldmVsLXRhYi1zdG9wOm5v bmU7DQoJbXNvLWxldmVsLW51bWJlci1wb3NpdGlvbjpsZWZ0Ow0KCXRleHQtaW5kZW50Oi0xOC4w cHQ7DQoJZm9udC1mYW1pbHk6IkNvdXJpZXIgTmV3Ijt9DQpAbGlzdCBsMDpsZXZlbDMNCgl7bXNv LWxldmVsLW51bWJlci1mb3JtYXQ6YnVsbGV0Ow0KCW1zby1sZXZlbC10ZXh0Ou+CpzsNCgltc28t bGV2ZWwtdGFiLXN0b3A6bm9uZTsNCgltc28tbGV2ZWwtbnVtYmVyLXBvc2l0aW9uOmxlZnQ7DQoJ dGV4dC1pbmRlbnQ6LTE4LjBwdDsNCglmb250LWZhbWlseTpXaW5nZGluZ3M7fQ0KQGxpc3QgbDA6 bGV2ZWw0DQoJe21zby1sZXZlbC1udW1iZXItZm9ybWF0OmJ1bGxldDsNCgltc28tbGV2ZWwtdGV4 dDrvgrc7DQoJbXNvLWxldmVsLXRhYi1zdG9wOm5vbmU7DQoJbXNvLWxldmVsLW51bWJlci1wb3Np dGlvbjpsZWZ0Ow0KCXRleHQtaW5kZW50Oi0xOC4wcHQ7DQoJZm9udC1mYW1pbHk6U3ltYm9sO30N CkBsaXN0IGwwOmxldmVsNQ0KCXttc28tbGV2ZWwtbnVtYmVyLWZvcm1hdDpidWxsZXQ7DQoJbXNv LWxldmVsLXRleHQ6bzsNCgltc28tbGV2ZWwtdGFiLXN0b3A6bm9uZTsNCgltc28tbGV2ZWwtbnVt YmVyLXBvc2l0aW9uOmxlZnQ7DQoJdGV4dC1pbmRlbnQ6LTE4LjBwdDsNCglmb250LWZhbWlseToi Q291cmllciBOZXciO30NCkBsaXN0IGwwOmxldmVsNg0KCXttc28tbGV2ZWwtbnVtYmVyLWZvcm1h dDpidWxsZXQ7DQoJbXNvLWxldmVsLXRleHQ674KnOw0KCW1zby1sZXZlbC10YWItc3RvcDpub25l Ow0KCW1zby1sZXZlbC1udW1iZXItcG9zaXRpb246bGVmdDsNCgl0ZXh0LWluZGVudDotMTguMHB0 Ow0KCWZvbnQtZmFtaWx5OldpbmdkaW5nczt9DQpAbGlzdCBsMDpsZXZlbDcNCgl7bXNvLWxldmVs LW51bWJlci1mb3JtYXQ6YnVsbGV0Ow0KCW1zby1sZXZlbC10ZXh0Ou+CtzsNCgltc28tbGV2ZWwt dGFiLXN0b3A6bm9uZTsNCgltc28tbGV2ZWwtbnVtYmVyLXBvc2l0aW9uOmxlZnQ7DQoJdGV4dC1p bmRlbnQ6LTE4LjBwdDsNCglmb250LWZhbWlseTpTeW1ib2w7fQ0KQGxpc3QgbDA6bGV2ZWw4DQoJ e21zby1sZXZlbC1udW1iZXItZm9ybWF0OmJ1bGxldDsNCgltc28tbGV2ZWwtdGV4dDpvOw0KCW1z by1sZXZlbC10YWItc3RvcDpub25lOw0KCW1zby1sZXZlbC1udW1iZXItcG9zaXRpb246bGVmdDsN Cgl0ZXh0LWluZGVudDotMTguMHB0Ow0KCWZvbnQtZmFtaWx5OiJDb3VyaWVyIE5ldyI7fQ0KQGxp c3QgbDA6bGV2ZWw5DQoJe21zby1sZXZlbC1udW1iZXItZm9ybWF0OmJ1bGxldDsNCgltc28tbGV2 ZWwtdGV4dDrvgqc7DQoJbXNvLWxldmVsLXRhYi1zdG9wOm5vbmU7DQoJbXNvLWxldmVsLW51bWJl ci1wb3NpdGlvbjpsZWZ0Ow0KCXRleHQtaW5kZW50Oi0xOC4wcHQ7DQoJZm9udC1mYW1pbHk6V2lu Z2RpbmdzO30NCm9sDQoJe21hcmdpbi1ib3R0b206MGNtO30NCnVsDQoJe21hcmdpbi1ib3R0b206 MGNtO30NCi0tPjwvc3R5bGU+PCEtLVtpZiBndGUgbXNvIDldPjx4bWw+DQo8bzpzaGFwZWRlZmF1 bHRzIHY6ZXh0PSJlZGl0IiBzcGlkbWF4PSIxMDI2IiAvPg0KPC94bWw+PCFbZW5kaWZdLS0+PCEt LVtpZiBndGUgbXNvIDldPjx4bWw+DQo8bzpzaGFwZWxheW91dCB2OmV4dD0iZWRpdCI+DQo8bzpp ZG1hcCB2OmV4dD0iZWRpdCIgZGF0YT0iMSIgLz4NCjwvbzpzaGFwZWxheW91dD48L3htbD48IVtl bmRpZl0tLT4NCjwvaGVhZD4NCjxib2R5IGxhbmc9IkVOLUdCIiBsaW5rPSJibHVlIiB2bGluaz0i cHVycGxlIiBzdHlsZT0id29yZC13cmFwOmJyZWFrLXdvcmQiPg0KPGRpdiBjbGFzcz0iV29yZFNl Y3Rpb24xIj4NCjxwPi0tIFlvdSBjYW4gc25hcHNob3QgYSBydW5uaW5nIHJvb3QgZmlsZXN5c3Rl bSBpZiBpdCBpcyBaRlM7IHRoYXQgaGFzIGFsd2F5cyBiZWVuIHRydWUgb2YgWkZTLjxvOnA+PC9v OnA+PC9wPg0KPHA+LS0gSWYgdGhlICZxdW90O2VudGlyZSBvcGVyYXRpbmcgc3lzdGVtJnF1b3Q7 IHNwYW5zIG1vcmUgdGhhbiBvbmUgZmlsZXN5c3RlbSBvciBwb29sLCBob3dldmVyLCB5b3UgY2Fu bm90IGdldCBhbiBhdG9taWMgc25hcHNob3QgYWNyb3NzIHRoZW0uJm5ic3A7IFRodXMgaWYgeW91 IHdhbnQgdGhhdCBjYXBhY2l0eSAoZS5nLiBhbiBhdG9taWMgc25hcHNob3QgdGhhdCBpcyBhbiAm cXVvdDtpbnN0YW50IGluIHRpbWUmcXVvdDspIHRoZSAmcXVvdDtlbnRpcmUgb3BlcmF0aW5nIHN5 c3RlbSZxdW90OyBtdXN0DQogYmUgY29udGFpbmVkIGluIG9uZSBaRlMgZmlsZXN5c3RlbS48bzpw PjwvbzpwPjwvcD4NCjxwPkZyb20gdGhlIFpGUyBtYW4gcGFnZSDigJM8bzpwPjwvbzpwPjwvcD4N CjxwPuKAnC1yOiBSZWN1cnNpdmVseSBjcmVhdGUgc25hcHNob3RzIG9mIGFsbCBkZXNjZW5kZW50 IGRhdGFzZXRzLiBTbmFwc2hvdHMgYXJlIHRha2VuIGF0b21pY2FsbHksIHNvIHRoYXQgYWxsIHJl Y3Vyc2l2ZSBzbmFwc2hvdHMgY29ycmVzcG9uZCB0byB0aGUgc2FtZSBtb21lbnQgaW4gdGltZS7i gJ08bzpwPjwvbzpwPjwvcD4NCjxwPkl04oCZcyBwZXJmZWN0bHkgcG9zc2libGUgdG8gdGFrZSBh biBhdG9taWMgc25hcHNob3Qgb2YgZXZlcnkgZGF0YXNldCBvbiBhIHBvb2wuPG86cD48L286cD48 L3A+DQo8cD4tPGJyPg0KTWF0dDxvOnA+PC9vOnA+PC9wPg0KPGRpdj4NCjxwIGNsYXNzPSJNc29O b3JtYWwiPk9uIDEwLzI3LzIwMjIgMDk6MjYsIFR1cnJpdG9wc2lzIERvaHJuaWkgVGVvIEVuIE1p bmcgd3JvdGU6PG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxibG9ja3F1b3RlIHN0eWxlPSJtYXJn aW4tdG9wOjUuMHB0O21hcmdpbi1ib3R0b206NS4wcHQiPg0KPGRpdj4NCjxwIGNsYXNzPSJNc29O b3JtYWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEyLjBwdCI+U3ViamVjdDogRG9lcyBPcGVuWkZT IHN1cHBvcnQgdGFraW5nIHNuYXBzaG90cyBvZiB0aGUgZW50aXJlIG9wZXJhdGluZyBzeXN0ZW0/ PGJyPg0KPGJyPg0KR29vZCBkYXkgZnJvbSBTaW5nYXBvcmUsPGJyPg0KPGJyPg0KRG9lcyBPcGVu WkZTIHN1cHBvcnQgdGFraW5nIHNuYXBzaG90cyBvZiB0aGUgZW50aXJlIG9wZXJhdGluZyBzeXN0 ZW0/PGJyPg0KPGJyPg0KPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjwvYmxvY2txdW90ZT4NCjxk aXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj4tLSA8YnI+DQpLYXJsIERlbm5pbmdlcjxicj4NCjxh IGhyZWY9Im1haWx0bzprYXJsQGRlbm5pbmdlci5uZXQiPmthcmxAZGVubmluZ2VyLm5ldDwvYT48 YnI+DQo8aT5UaGUgTWFya2V0IFRpY2tlcjwvaT48YnI+DQo8aT48c3BhbiBzdHlsZT0iZm9udC1z aXplOjcuNXB0Ij5bUy9NSU1FIGVuY3J5cHRlZCBlbWFpbCBwcmVmZXJyZWRdPC9zcGFuPjwvaT48 bzpwPjwvbzpwPjwvcD4NCjwvZGl2Pg0KPC9kaXY+DQo8L2JvZHk+DQo8L2h0bWw+DQo= --_000_eccf1dfa00df4b8ea44dd721b3f2c111uservenet_-- From nobody Fri Oct 28 10:24:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MzJZW1Clvz4gg1d for ; Fri, 28 Oct 2022 10:24:51 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4MzJZV02rwz3Rmk for ; Fri, 28 Oct 2022 10:24:50 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id 1FB242110A8; Fri, 28 Oct 2022 06:24:49 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id B5A562ACE2E; Fri, 28 Oct 2022 06:24:48 -0400 (EDT) Message-ID: <5c223067-fd88-0257-d2a6-0c45064c5a33@denninger.net> Date: Fri, 28 Oct 2022 06:24:47 -0400 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.4.0 Subject: Re: Does OpenZFS support taking snapshots of the entire operating system? Content-Language: en-US To: Matt Churchyard , "freebsd-fs@freebsd.org" Cc: "ceo@teo-en-ming-corp.com" References: <5391a765-a526-fb19-2f24-bd9067d2f125@denninger.net> From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms070306080004000501080707" X-Rspamd-Queue-Id: 4MzJZV02rwz3Rmk X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net X-Spamd-Result: default: False [-4.89 / 15.00]; SIGNED_SMIME(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.99)[-0.986]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[karl]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; HAS_ATTACHMENT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms070306080004000501080707 Content-Type: multipart/alternative; boundary="------------QUeTnuakWcCfnMw0MQJ1ovuo" --------------QUeTnuakWcCfnMw0MQJ1ovuo Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Assuming they're on the same pool or the components are direct descendants (thus you can use "-r" and do it with one command), yes. On 10/28/2022 04:26, Matt Churchyard wrote: > > -- You can snapshot a running root filesystem if it is ZFS; that has > always been true of ZFS. > > -- If the "entire operating system" spans more than one filesystem or > pool, however, you cannot get an atomic snapshot across them.  Thus if > you want that capacity (e.g. an atomic snapshot that is an "instant in > time") the "entire operating system" must be contained in one ZFS > filesystem. > > From the ZFS man page – > > “-r: Recursively create snapshots of all descendent datasets. > Snapshots are taken atomically, so that all recursive snapshots > correspond to the same moment in time.” > > It’s perfectly possible to take an atomic snapshot of every dataset on > a pool. > > - > Matt > > On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote: > > Subject: Does OpenZFS support taking snapshots of the entire > operating system? > > Good day from Singapore, > > Does OpenZFS support taking snapshots of the entire operating system? > > -- > Karl Denninger > karl@denninger.net > /The Market Ticker/ > /[S/MIME encrypted email preferred]/ > -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------QUeTnuakWcCfnMw0MQJ1ovuo Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

Assuming they're on the same pool or the components are direct descendants (thus you can use "-r" and do it with one command), yes.

On 10/28/2022 04:26, Matt Churchyard wrote:

-- You can snapshot a running root filesystem if it is ZFS; that has always been true of ZFS.

-- If the "entire operating system" spans more than one filesystem or pool, however, you cannot get an atomic snapshot across them.  Thus if you want that capacity (e.g. an atomic snapshot that is an "instant in time") the "entire operating system" must be contained in one ZFS filesystem.

From the ZFS man page –

“-r: Recursively create snapshots of all descendent datasets. Snapshots are taken atomically, so that all recursive snapshots correspond to the same moment in time.”

It’s perfectly possible to take an atomic snapshot of every dataset on a pool.

-
Matt

On 10/27/2022 09:26, Turritopsis Dohrnii Teo En Ming wrote:

Subject: Does OpenZFS support taking snapshots of the entire operating system?

Good day from Singapore,

Does OpenZFS support taking snapshots of the entire operating system?

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------QUeTnuakWcCfnMw0MQJ1ovuo-- --------------ms070306080004000501080707 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B 3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5 CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY 2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5 c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj 7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn 3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6 Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g 3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG 7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c 5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yMjEwMjgxMDI0NDhaME8GCSqGSIb3DQEJBDFCBED8dQkGYgBc0Wj94Bc8 ndio+C62BFjozXOUG4o3AW1S01w0Lflsbv0skeqJl6v+3Rl+mZ+yZJa1jolpkQEeYd2kMGwG CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgAmX2yekfZ9V3u/LXVqfxtYPlHER50XGhC5JxWV bKkV32UU+yO5pxESLd2E0AR5n3TyllyjAkvcJQZko4VTaY/fJapDcIapSiFcSPAI5b40pqbY e14XRfdXujYVEpeuNkuDn67+ELzF/9aeDwgoa0W0622yEZ19X1+mya7rV0BY0S14jIgkjc6A oUOkXiX/w/t/qDdlZF24xa70PA6bqHiAm7gV3VKO55+QIldrE5asnH9pv4OPTPWB+eB7MJB7 JRNlt8pmU8WLbGhjXBAg7+aMQ+otFfpo8Pb8M3JChqUZI3NgU30Sd2cmF/aY750MQSPKYJG0 jgIfvXbcylqUQZBF54MdCoDwxSbpRHELfoGy6EzarlC92PwjJ+BsnxspqN3DNbx61ZADX1VL 9mrtX0d/l+MoCEHDvjwz9k1kMNX06ulwF/agKzq0sdaHCEoYhywaCR5HunQDt5E3AusYgGil 1U+o9n2EyVB9oDK+Kx0fQF1VAfBa/fIJ6V4fR9s4IOcjAcwSJgoEuhudlZYLZpI4itWTPhsI rhI4ucMiW5YvfiWwKkbZh9+rI8/iP1Ri4UDLDRHcdEeceZbb3yd9+d6ydlgTm4FidnsRjQ1h A/oSACGeM2UsqOR3AYU13bJASn1FF8wqLRR3isa1nLMwiM4mEXc+1uHPf5WPYDjRCkpBFgAA AAAAAA== --------------ms070306080004000501080707-- From nobody Sat Oct 29 17:56:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N06YW22f4z4gRdW for ; Sat, 29 Oct 2022 17:56:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N06YV5vPQz48m5 for ; Sat, 29 Oct 2022 17:56:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N06YV4shYzRX1 for ; Sat, 29 Oct 2022 17:56:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29THukpr015129 for ; Sat, 29 Oct 2022 17:56:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29THuk8m015128 for fs@FreeBSD.org; Sat, 29 Oct 2022 17:56:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Sat, 29 Oct 2022 17:56:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mav@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667066206; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5Au78chHpE3p/iGMbtB7U6LxOWZ6+h86/PQ8ft6yp5A=; b=MsOKo7dHgqtvb1cxdvo7Z5SGoLTX5wdR6DbQ5rmJbG3kqKIVPexf+J1vA5ZaphU7r1K8ZA eOXVdyLmysE9zQmCojxhVppuLHW6Yig+bFyosi0bHj37ZcDvaFuuZd0E/c+9N79rT/0A73 tD8zUFVzuY4wp/mv3CKxgEEk6qwGve1/JPxVm0lqnih6ESVWX7Lcn2Dznv78gWGGUyFWZq Pzneu3EbBDPN2WXNKMt+ZmPbZqr3542nGZTq+GXr9qfkvQ67MSVEndQFQgeBZc40K5ivtd EqUl3s/pU7ywxKtHLA0vkNmulDDdu5FcwTU3cRvSoNLBS7xOLDFxQNELkKAyVw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667066206; a=rsa-sha256; cv=none; b=sTQb4gmTHbGqfTjFZ5CkSKuyjuWHL+jbB0giJKgzRP3YTLjoSLKa0m/f4EZ60QL2+riGiE FaEENlKRWUa3l5t6B1gUuUtX7qdv8Z78w/eO710UaEKPMtJEHj1Nt1ZVNkvR1ZP8xKAeB2 uVxeHulJVcPvmFloB+fTeKwgbHqS/Bmrj4lqOd7J570yAV0MyH9ZF0TKp+XT8uzN662RlJ b2vc8zNtDSz5dVZ3rFqDl5ES//0dnlNFvkZ7zFC227TY0s8aA0yfFDpJT3z3Rax3JoEJmk UAOQoCgd9UadJadftFQItcQABdsQa5AiFm7/rv0ThsoH5qtJ7nbbeCVBjyA6yQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 Alexander Motin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mav@FreeBSD.org Resolution|--- |FIXED Status|New |Closed --- Comment #3 from Alexander Motin --- Unfortunately fix implemented more than a year ago was not merged to stable= /13 branch. I've merged it recently after I hit the same issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 30 08:29:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N0Twq5Fmdz4gHbD for ; Sun, 30 Oct 2022 08:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N0Twq1NHCz3Hpl for ; Sun, 30 Oct 2022 08:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N0Twq0PxfzqY7 for ; Sun, 30 Oct 2022 08:29:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29U8TkB9009585 for ; Sun, 30 Oct 2022 08:29:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29U8TkMb009584 for fs@FreeBSD.org; Sun, 30 Oct 2022 08:29:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Sun, 30 Oct 2022 08:29:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ronald-lists@klop.ws X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667118587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rTLh0t5jk5P3HwEhHayVs1FDyKPssz7b2lPKoUY+ITY=; b=C2d3xQQUgsFrmSVj5ZWvk06p50MNLGAiR/wT7D2BTp2GFTE3+gQKPqu9Qpk8RDhY3RzQiY Sw/8fjKTXhnR/CQkYbJremWPcWYtHzw1s8uFF+HHSG0n7ARctOsD6gsj685eco9VL6G1aY Kf+kwb+ypz1Pvi2z5tobf9rC1Iz2jyDifeQetL2nIudg2mxsrl06mkgr6dTVrcjvUuD2zf Lk5eDYK5o+YzCJgMIKqPOwH49gjp6lvtSx3ae06fTdeDpBL1ysQHeBrAAyVPu0SmM6qffL MgWxYjg9ivC1uisPMDyyMkecMP+WB0rwshVOQOaL9/pg/xDmEtvgJsUfZQxX4A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667118587; a=rsa-sha256; cv=none; b=NZ9Gw6Gzj2rsJC8krVBAeE68HWtOYvLWq4i+fHMjnnsGGfLSTAwlFSpxkhCMAv91rWtPJb MOM52Owkzs6D3e8z8sx8tlAiARgM8T7gq2HvrdGfdQjkUeuCc3hkt6HcsUJ+f5sDFoj+hy bG8/5WACNI3u2LRGZsLdkn3yr75N7DbA+9g9boiwilv0xuwcG79ntrjYRE1LP1vVkz8XCV CaQ0/QdOnK6Vy0bT2r/kNVr/raIEb3G5IRjX17ZwMiTw1QcFs488vsLTOeE8BvSuC9Vbdt nQcvfKqYGk8WsXemn/RGPhbz0G40yYzL0YeE2eUc2z0o4U2X7GHN3qMsqq2JRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 Ronald Klop changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ronald-lists@klop.ws --- Comment #4 from Ronald Klop --- (In reply to Alexander Motin from comment #3) Would you mind adding a URL to the commit to this issue? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 30 21:00:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N0pZr3yJdz4gZp5 for ; Sun, 30 Oct 2022 21:00:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N0pZr1sKfz3mlh for ; Sun, 30 Oct 2022 21:00:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N0pZr0yxZz19FZ for ; Sun, 30 Oct 2022 21:00:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29UL0KBW007877 for ; Sun, 30 Oct 2022 21:00:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29UL0KBE007876 for fs@FreeBSD.org; Sun, 30 Oct 2022 21:00:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202210302100.29UL0KBE007876@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 30 Oct 2022 21:00:20 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16671636200.bf350.5939" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667163620; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=dahgitUMnj5r29tGfoAT3UooP/nw//hFfiFheMblTA8=; b=GNPgvo6ieutkwOIFu85r2J2DeCNHv2qqW8r8514+JmDJqXhzJo8yXKSXaJwmhU2Hc9Auu1 Ow84mb7z9w3weYMg+UgTAOWDJUvYvmFu2/+/aB/YQ75V2tG4gcxDQbYMQX6RmrFjxkOk84 5NcOX1K4nRwKamuDO2R6EOYukXtUb22Qj1xA+RXTLIqtCiiGxXmbmUQCyBbSzMieLfLVcm oQktzlwKN4omHlrLE6nzH17wg9qvpdB7848pFarS6r91Z8qEKJCy+auIYMlVWgVL3T+PgQ vqYCPvenCK8ljMGdMNU89ac/ucfIcL6qVA80eIlo1FDklY3j0zZ5jmxiVeKk7A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667163620; a=rsa-sha256; cv=none; b=skX4oHP5lV3pCPSRtnpTKNq7YdH8uX6hzS2mENqOi/l+OkSjLlp9iYu4ouRs6focJ1iqvp N7coGGumj5EkPGjirItNJxfyrCdTEmOEIoMh2/Udl2qqp0xRj9wvZc9bsz4GuapGZxIERz o7ERQ4G79xKug3L29q6bjQLUlFd3uPpKElVvXGZqsGAFWpcOrjeQh4Rsr/6uAnxpliX/9T xx5or0jk/IYRkyzVVK8YFyJ/L6z+29XL/IG70iKBm9TfWefP++Cnv+z6jgC1UaEDgow1Td hAhMhjP0VCdObTftgicFioGFcHRgjVQZNHa1ALU7m0iQ9ilJOn1K9Pn7KPocIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16671636200.bf350.5939 Date: Sun, 30 Oct 2022 21:00:20 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16671636200.bf350.5939 Date: Sun, 30 Oct 2022 21:00:20 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16671636200.bf350.5939-- From nobody Mon Oct 31 12:50:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N1Cgj2JV7z4g82x for ; Mon, 31 Oct 2022 12:50:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N1Cgj002fz3CTY for ; Mon, 31 Oct 2022 12:50:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N1Cgh69b9zclQ for ; Mon, 31 Oct 2022 12:50:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 29VCou3x005459 for ; Mon, 31 Oct 2022 12:50:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 29VCouQ6005458 for fs@FreeBSD.org; Mon, 31 Oct 2022 12:50:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251342] fs/unionfs: VOP_UNSET_TEXT without VOP_SET_TEXT leads to panic Date: Mon, 31 Oct 2022 12:50:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667220657; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=huzcVow9194EyGcT21vDk6U9oofA6qqBWJTVT+mt+pE=; b=QEyCLpuQ/hwLO1EJu9T2NwRYYt+UiakpMrZoaUg99zgwXfpR0nb191tvom/cH9l8Oe9HTS HQNErdoL96b6fDu8hxgbuILTBbYuhGfAKnN1Wsv271dqAJrxeVYvLM3GVOs57q2dVXpOc0 vMs5edZ+wlYPz3SP9mlJGF31cyH+J74U9MJgwFOKkvRTZxnta7OPRc5qYfaivhBkNjqhGR S96qeguLAvsyv4PMqYKm5laFAg1isgeROS6FZoFCVOW2CfbsiN3FYDkBtgcjGtgWzMlgxe W7mpTZboy0YfDPYuc9635r6SkwGNer9wkA4nAgxPPY3Vee1LCL2jDcfivualpw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667220657; a=rsa-sha256; cv=none; b=VNtE097wDc1GOjJPJzciPQ+jhOdt31rUEs2vW5JYk0lw50wiuXdWr5WYXZ80LnC0aCm63F 8yv9/wOAzLH+6Raojfw1jJo1hLK/WCMQjv7zhaDb9YnXqkqoD7YzZLXjVrKe1oi4sl4/Wa JLNKd3tJ7660V2B23xyNwQmLW53kRw6C8VKsJXqnB3NuuUQ/4F+IO5Jl4t0PPfH0ruACsn HovxzbjpCdmGMtOiA2Ba0QG+JERni2pm4hf44JL8m7hxwmGo6y+JOiFovulKek997BD54I T64M7a+cA/BI/DNNfYJGFa0eerEDK82Vc/rQ25UiaYirBF8hHcZ+Cbr1AdoD/Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251342 Ed Maste changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |emaste@freebsd.org --- Comment #3 from Ed Maste --- Any reason this shouldn't be MFC'd? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Nov 1 23:24:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N25hn3KfRz4gLSC for ; Tue, 1 Nov 2022 23:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N25hn2Cqjz3mcc for ; Tue, 1 Nov 2022 23:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N25hn18MHzZGn for ; Tue, 1 Nov 2022 23:24:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A1NOvJ9021349 for ; Tue, 1 Nov 2022 23:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A1NOvi5021348 for fs@FreeBSD.org; Tue, 1 Nov 2022 23:24:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 253890] [zfs] panic: Assertion lock == sq->sq_lock when sending ZFS snapshot Date: Tue, 01 Nov 2022 23:24:57 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667345097; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qPHHgvGTtaF4bPfFSGQSJQDhCApzUhdo6omwp+WBRg4=; b=U8SbzhJwBQBC4hLC2i98QLuafEbCWe0HLeB7wVVDi6khc7nBn9wEh9aMTSh+1QMlDzdrIB 0GxM/jE6EO+oQ9Z00ZlJaRCHeR/drDCD5c2z/PesK8Etb90nsrXJwSohssG2BbCSevcTMo mtfFalDo6Sjze01n8sqt/5LYtGw1uLHr9wJZJ+WuBhZnBVuJWGlCukNCVwTmT/so40Lkv6 B0KuRDomTCp7liE29U2LZZMTCW4mtrmrXRpfxbxsxwWF3SZwBuz/UHNe68X83xt6JO5LMO p2tRE7o+7rpYwQJH9uBfjpF5ZmXDduNnWAdRbTWBT0Y7yI31lwM2TeGYBtAygQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667345097; a=rsa-sha256; cv=none; b=kAJbiSlozELAA/wHthaDiIxL9tDHdGgDFXunESw/b6tLCb32gG5EIoipZ4RwXO+EKMxMZ6 8qbfUb+aWxJzGfQIAZwJzl/DlFBz5SATad40S7PGins6GF9EgztVYmDfOcrqgUZNjkTK4F 4DFJsJ6Fh7IcLmeeyF+Ev34M2QIzcRRqlg9APcLrQx7HzTfr7FK0JRDZy06OOEts4g1vhm +VmzxfKSVwoxK+KfmRwWLgSySPRycXnBlWXNdrPlbFP1x3OSVTNSz/H4sKJY+49AYT3ebR oNWY0z6bZ49oCUgyF4E87KnC0RJReY60zmjBWVI8UV1nAoSzdrPMijZb8vO/jg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253890 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa CC| |grahamperrin@freebsd.org --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Tue Nov 1 23:35:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N25xB1gjrz4gMbb for ; Tue, 1 Nov 2022 23:35:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N25xB0bRxz3qtH for ; Tue, 1 Nov 2022 23:35:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N25x96nSczZr7 for ; Tue, 1 Nov 2022 23:35:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A1NZfsN037234 for ; Tue, 1 Nov 2022 23:35:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A1NZfPD037233 for fs@FreeBSD.org; Tue, 1 Nov 2022 23:35:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 259093] Panic: NULL pointer dereference on "zfs send --raw" of encrypted filesystem Date: Tue, 01 Nov 2022 23:35:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc bug_status see_also keywords cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667345742; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+Jw+Si2rjB/Q2zsajuETrbN04ZIOjISj7Su+FF5lRDA=; b=sHLLd4FEwPebcacGq6qaA3aOJuQ45pekRipnekyiPsogQiRIUtyTH1X7OMk4L2GSRz3eL8 LF3Xc7bVTGhQwEoPJoKhHwiLIxNTITvMSvoWzrOpxrm0fAomCFqt6k6TaWZz/B/fNAz1Ph 1sbV3D1DZTyX5eBi73wTTztf+G1bFQrFcL3cfMrLgrbw4U8x/DVwQf6gRbJZo09uZWHogp i4P328ptrwWiIT71rG5Y3NbdUmirsTyifL07Z8ElV2T/XIo6dXFbrbdAoiftqOJXUW1N3K R2ZWufW9hsilh+MBuQEF2932vYiRmmmHF53SdJsmGxMoAqhr6Ke3vcWI+/OWHQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667345742; a=rsa-sha256; cv=none; b=umXk6rIR8she+cgtf+sL1gm5/va5oEmZhls1NNGfz+4eTDRkESpA8c30DEZtu9vfeBygAd hmTtohCJUQSOG++RzP747IYt+zD8uBcK+Q63zcUc794bsvSGlkmcr7wFltMcQKeFPFwAOr THFftCl7Xu4SlpL29x3yHOumxZgBF0ELBog9+QrDVFts+0fR9Q32/+qQDcCdWPs19sG75z Ls8BKuBLoO/CJI9cY9SMnMe6iDAvmeexK7Kiu2HRl6dg1PAUJgnalYDDZ7TTNptSwvTGWb Nz5n7w6lXHq4XrZLERnnuJ2K3PB1JmwZSRrHRd6HxnDJm2eTQOAJs9vVHCJVog== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259093 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[zfs] [panic] NULL pointer |Panic: NULL pointer |dereference on "zfs send |dereference on "zfs send |--raw" of encrypted |--raw" of encrypted |filesystem. |filesystem Status|New |Open See Also| |https://github.com/openzfs/ | |zfs/pull/12438, | |https://github.com/openzfs/ | |zfs/issues/12275#event-6888 | |665864 Keywords| |needs-qa CC| |grahamperrin@freebsd.org --- Comment #3 from Graham Perrin --- Is this reproducible with recent 13.1-STABLE? (In reply to Peter Jeremy from comment #2) Closed 2022-06-27 (PR merged), subsequent commits. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Nov 1 23:53:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N26KL0gY8z4gQ4H for ; Tue, 1 Nov 2022 23:53:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N26KK5bCNz3w15 for ; Tue, 1 Nov 2022 23:53:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N26KK4dwHzb1t for ; Tue, 1 Nov 2022 23:53:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A1Nr9jV066001 for ; Tue, 1 Nov 2022 23:53:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A1Nr9Dx066000 for fs@FreeBSD.org; Tue, 1 Nov 2022 23:53:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 231794] zfs: Panic due to ARC related KVA memory exhaustion: in pmap_growkernel() > vm_map_insert Date: Tue, 01 Nov 2022 23:53:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: short_desc bug_status keywords see_also flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667346789; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7QAvpwqQRBY3tG4QEMErFXdUooMTzicV1q5OAtzOUWE=; b=Izw2kiQ2KsUl1nTjdudMlmjxJ6SEVlEURlJYUDN8b4E505C0nwcHbAo6xQwcyeOsacpKvF XnOzpkqgaxaBURbmqhStQmtTtsUyPIRJmJGmtFjPNoaYt1C2dMDpH5k4lkIBtc5nywZ2CW GkHLwNHrkclqV/jHsOLB4/ee0jDyxSc5beepolsIww08mJVc2Ap5VY+/CPj96NDOxqHRlI xe5TEYS1rprw5wnkzacujeNozNA2tEih7VGXdODLkDEZ07NO4ZvkDr3ChZpY3fh8HSKQQ4 Zr0YGzQGrC6cWGlK65jfVYHK9Y9r/GQEZsLqYhYSzqjT1VuSa0E89m0uSbVDKw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667346789; a=rsa-sha256; cv=none; b=Mkz5w8wwdDUOAZbzyfxk9CdNaHIh9/Jmjf+n8cAQltxynY3iBtSnCvZyHeWDT3xAU4TZnw 88xy/u1ZGEqwR5ZnABgD9sDc7/ylbjlSK4rc9aS5vVQH2kinil8Sxi+kCUuLEXKozkF0vT 9Reu2s00kXFUHw79zOH7WjG3o9nbOp3X9N4s7qvfoJt+8WUmrh6tL6pYrPoRgedmVD9c8v QsQLp1NCkatKaDsYgnWV3uoA2HqzkijcqioOkfe0NVfxvUE/4Vc0rPFwuTZZkrtyoPE8aY as/UMVLYHut0K+Jvmkt9ObqpLyY+MKvkFX2vw4iab0z4CwFTZAv481mXOkUt8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231794 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|Panic in ZFS due to arc |zfs: Panic due to ARC |related memory exhaustion |related KVA memory | |exhaustion: in | |pmap_growkernel() > | |vm_map_insert Status|New |Open Keywords| |needs-qa See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 312 | |96 Flags| |mfc-stable13?, | |mfc-stable12? --- Comment #3 from Kubilay Kocak --- ^Triage: Report is for EoL 11.2 (12.0-ALPHA7). Needs reproduction against currently supported versions. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Nov 2 00:36:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N27Hj6Xdsz4gWmK for ; Wed, 2 Nov 2022 00:36:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N27Hj3xHRz431N for ; Wed, 2 Nov 2022 00:36:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N27Hj2zpTzcJw for ; Wed, 2 Nov 2022 00:36:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A20anMf041912 for ; Wed, 2 Nov 2022 00:36:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A20anpA041911 for fs@FreeBSD.org; Wed, 2 Nov 2022 00:36:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266014] panic: corrupted zfs dataset (zfs issue) Date: Wed, 02 Nov 2022 00:36:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667349409; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XlbbrL54y9232lPVP8O+1amaa+q78663hZQtRgJ9V+Y=; b=mXJ6lExZW+rg2KSrKNZSNibvAgeMoFRzRpqvW3F0a7a1CkKbR4I2hgvUAQd1QjEonTSNdF TjKQEDxPqaZ45rvNNJetOiHsbtvXVPppU39K+oz9ySdQO+A47BCvEIo+aw2FxW+jKZuU9J pjzaq0p0O5eT6Vjl29wOdMeBOGpmzCLO5/OOM4BYyuv9C1oLohGgt49bWFcIzvabGyVkos bTJC32FwUz/COyTLZB4S/wqAHDVnXJxAbBD8DrnTQE4KDNri99P6ihQq4/YtaI3fkZOm2O ceGL/wc/ACLuV4Zxq7vh9mnCQm0sb9I50KtNEiuAdZPZGSRKUWLawjyPaQ/puQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667349409; a=rsa-sha256; cv=none; b=d99M8RNGf/2xkYOTlVLC0jr2k8NgznNYpkr5fKzd39aE0GT1zL5skui8p1uPVNmvjGt4Pc 45vnwYCd5NmbWAqxFZSxooN/0Q/TbzjdIMAc/FeNzsUFYENSdXNXH9T9D3rsUuioUjoBCq ppHyQzUXn2J68H5vR9YWSWqoO7OdDkXnzhxts52zXt6sHJKjMnOpPiHKp6wDRv3He67xbK WrhPBc+roIZUHDqLCpOXYQvn2Z9iLfcrcReE75KvT6X/y9w3gchTLR7x5DvRakBpWICLVZ TBEnPk+fsOpb2I0OM64yBRnvhZrMyo40SY+8ZApk2kpudZ6Hmt/23Xk2kk/CWA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266014 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa --- Comment #8 from Graham Perrin --- (In reply to Duncan from comment #7) Thanks.=20 Given the differences, I suggest a separate bug report with 266014 as 'see also'.=20 I have bookmarked a pull request and some (GitHub) issues as food for thoug= ht; not sharing them here, because I don't imagine this particular food relatin= g to comment #0. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Nov 2 22:56:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N2j1R6fKBz4h8jl for ; Wed, 2 Nov 2022 22:56:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N2j1R5M53z3PML for ; Wed, 2 Nov 2022 22:56:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N2j1R4HBDz1Cph for ; Wed, 2 Nov 2022 22:56:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A2MuRUm047222 for ; Wed, 2 Nov 2022 22:56:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A2MuRSK047221 for fs@FreeBSD.org; Wed, 2 Nov 2022 22:56:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Wed, 02 Nov 2022 22:56:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mav@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667429787; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mBPBDYOIAb7rBt2v0FPZRBhNzK9zgfqh/ynlOeMXCZs=; b=OwM2S5yjs7t0tE4hShJkdLRrTvDWzMhCE/2JfQKTFG5MAC+ljHRAs4/wc2f+be+DB+Hqkt IH3wIuM49c0Eeh3sBK5XJ8KnF5uv8xgNZGKd3tDG3qMKPzUqpWEsKc2D2DgiVfCm11IsCf 6oIwoDXpb+ZoULx5KSbrjGjxU64rjCbWrnmwUjurw6QOn8pRiWTeYK+SXeIcvpFXTBC2UI qyjV5deSk8xNvrw765+0onrEr3n/fjzkF+PaGLvznbnMRdfG3sjRSEpXNEAwTTC21W0qWK Dg4N6WZYbWN7Ez5vEqLGysIzP2WX/5aacVzTg2Vnz1kloqA9Zaiij2jpMtZahQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667429787; a=rsa-sha256; cv=none; b=iaxwfzZHpXp42VoVL1fDjtA/aV7LkeVllREslm4Cctu2g0ufCZE/5Qpg9BWChPfm3MwlJp +1CRu5I0dVgIwAA7lSs97S/wStyUQJm6mHVqyY5JdQZWZbFOnGZxPllF+QznN9auHhjBHi QHEunG0L2epeqRCtNUC/ga3sra1NeDf61YVs2YXToU5aM2Fy7aphLU+BE6P+XWZJpj3ldC anekxsUh7Dw0ndUjn9tRs17xsWrHdDJC1pRETi8KTz882wUxam1vp/pPTpyppt3qQXRpnK mrokDKwVhwQP8IPgYClKf0h0ctbQO894kCq5jXy7JPFBilJJJ/jfJ3YKgrGwJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 --- Comment #5 from Alexander Motin --- https://cgit.freebsd.org/src/commit/sys/dev/vmware/pvscsi/pvscsi.c?h=3Dstab= le/13&id=3Df51c1d1dd595ce51059489d7e1248ff6ba39664a --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Nov 5 02:21:24 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N41T44W9Lz4hP55 for ; Sat, 5 Nov 2022 02:21:28 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N41T357qWz3WJM for ; Sat, 5 Nov 2022 02:21:27 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id F26925C00CE for ; Fri, 4 Nov 2022 22:21:26 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Fri, 04 Nov 2022 22:21:26 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to; s=fm3; t= 1667614886; x=1667701286; bh=tfdPKpRI+QPUZzimUOuqnpgSFTKJ+epo9jk X58YbbeQ=; b=biwuXHSqtKZWIUzH/iVV19dcFSvGb3jL9W3hyq9Xz3gze8Yixr5 olLCwej3qcx6HEkPttZnljVj9zTHiusSm7rxesNvQzx3wGSF4pRYXhGTk33FneFL 9XgxySjmSiOTZhu/tGt/DTv5/sjT00RS5LJ5Ndwp/MD9ATixV8RlpwSl5o+aKxxg zbinUzeCffG1SPJFSWWPFrxCIY/Z70+nxEDg3sYl80Ssv1Koh9GP7DE+Glms5IQq xJaKb9Mtjx6Da6psTQRQ5bArSq8ob8JyPZV1ac02yH3pLSgz/d+F4N4yIMslC0dv x4hxI/ThiWlSUgHEj8ftfUsl+MRmtv4TU8w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1667614886; x= 1667701286; bh=tfdPKpRI+QPUZzimUOuqnpgSFTKJ+epo9jkX58YbbeQ=; b=s mwCTkhhqHDP82+ghT1jxKz3j45QPKw5WdccwwYQdu7mCzrshy9wd/w6QOzrWe8aG QPxNP7oNgQTEw58KhFiI/lgo2IbNr1N4ZfsH5Ni41YNGMPDnrJgdlzEu946YK/+k uwmj+hPGKPnv6jXz0gFQK0xri+BcigzCGc/HK+Ocqmx3AC7D2mnav/VLN7xVcSNV hKRd88ttAlaic6PGloqzcnDrg57hddBqNfC8cgDkbRVwIw6BUlJfWfOaRvPJvZc/ pxJZRmj1BrMzKooaqxGstvlfo7l5vwSyaPh1iw2YsZ7ZQgTtPm0fYaffgYOQZHz1 xoFonwJizjgQtf92nO0Qw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrvddvgdeggecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfggtggusehttdertddttd dvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrghtthgv rhhnpeevudffiedvffffgffhgeefjeefffdtieetheetkeefhfdvfefgtedtueehgeffue enucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhi ugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 4 Nov 2022 22:21:26 -0400 (EDT) Date: Sat, 5 Nov 2022 02:21:24 +0000 From: void To: freebsd-fs@freebsd.org Subject: zfs compression on a volume Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Rspamd-Queue-Id: 4N41T357qWz3WJM X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=biwuXHSq; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="s mwCTkh"; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.26 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-5.20 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.26:from]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N Hi fs@ If a vm is created in bhyve on a freebsd host, and that vm is zvol-backed, and the guest itself is encrypted with for example lukfs(?) if it's linux, if the zvol compression is set to for example zstd, does the vol get compressed, or are cycles wasted compressing the uncompressible? TIA, From nobody Sat Nov 5 03:40:21 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N43DN6ydbz4hXhL for ; Sat, 5 Nov 2022 03:40:36 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vk1-f181.google.com (mail-vk1-f181.google.com [209.85.221.181]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N43DM2tTbz3cdw for ; Sat, 5 Nov 2022 03:40:35 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-vk1-f181.google.com with SMTP id i15so3568389vka.0 for ; Fri, 04 Nov 2022 20:40:35 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=36OQmlXigsN7bdSWtwaufTyIcQhk1GLyLm2nDpV9cT4=; b=GvnLHsq+oliAjrkO9kfcgcBdc5pZSzUUpLB8aRbr9jgnm+eT7bSTsPBZ6vd73HBAC4 tpNFztKzLDPwFSUQ1zNJEWLI+jlZMiYM3czkUJHB/SjjOIxp1AXClCI98jRZhNHPGqSm WsHgo+vFzVKeDN6NH3uO9I7zpOr8vTDGfNdhRYPoLTle7Qqdw72sMASf75EpRtKIKqmJ tCMsI9ainaaAEU3zuoDuyJquMi4SufgmsX/nHMkymCjzKU2Q/UCuHYEFoiMIF/Xx5fs0 1sZHXJBV9vkGTeSiO9M9R+Be7yKy6yxP+TTsWd9YROZo38tyZZ+TL6860swv0skA8IlL fFGQ== X-Gm-Message-State: ACrzQf13Ajyln+23vyTOD4ZzUkxlWdK9t3Y/zTYYWV3xypK2VrCeCvCO B27Wh/rowRJtnw81K0E2FOnpwB7R8s8YPFHYc99Hpwgd X-Google-Smtp-Source: AMsMyM7V8XB8Qp22iQjZG4Dr+ISxKSHlGY4hkyfQzgD3vJ0A5bXbHvbC55Kwluqw3SMtOJTGufgK+g6so7X890kZoP0= X-Received: by 2002:a1f:9d82:0:b0:3ab:1049:dbfb with SMTP id g124-20020a1f9d82000000b003ab1049dbfbmr21946192vke.34.1667619634043; Fri, 04 Nov 2022 20:40:34 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Fri, 4 Nov 2022 21:40:21 -0600 Message-ID: Subject: Re: zfs compression on a volume To: freebsd-fs Content-Type: multipart/alternative; boundary="000000000000e861e105ecb0f3e0" X-Rspamd-Queue-Id: 4N43DM2tTbz3cdw X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.221.181 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[209.85.221.181:from]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.221.181:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; DMARC_NA(0.00)[freebsd.org]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DOM_EQ_FROM_DOM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000e861e105ecb0f3e0 Content-Type: text/plain; charset="UTF-8" The cycles are wasted because the data is incompressible. On Fri, Nov 4, 2022, 8:21 PM void wrote: > Hi fs@ > > If a vm is created in bhyve on a freebsd host, and that vm is > zvol-backed, and the guest itself is encrypted with for > example lukfs(?) if it's linux, if the zvol compression > is set to for example zstd, does the vol get compressed, > or are cycles wasted compressing the uncompressible? > > TIA, > > --000000000000e861e105ecb0f3e0 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The cycles are wasted because the data is incompress= ible.

On Fri, Nov 4, 2022, 8:21 PM void <voi= d@f-m.fm> wrote:
Hi fs@

If a vm is created in bhyve on a freebsd host, and that vm is
zvol-backed, and the guest itself is encrypted with for
example lukfs(?) if it's linux, if the zvol compression
is set to for example zstd, does the vol get compressed,
or are cycles wasted compressing the uncompressible?

TIA,

--000000000000e861e105ecb0f3e0-- From nobody Sat Nov 5 03:53:05 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N43Vs2Swhz4hYY8 for ; Sat, 5 Nov 2022 03:53:09 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N43Vr3Ydqz3fkt for ; Sat, 5 Nov 2022 03:53:08 +0000 (UTC) (envelope-from void@f-m.fm) Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id B41A75C00CF for ; Fri, 4 Nov 2022 23:53:07 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Fri, 04 Nov 2022 23:53:07 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1667620387; x=1667706787; bh=AIl1vt1pBI Ck4OrJkdTCjxt3U10LF4ALwBjSTIKiaRk=; b=yVITcsQF1WYJV4/25LBPCJKZMR UiR+i1m7kNs7We7RSXNiSXAHY6VMagCEAF+Vy8WiKTSZjcc3gRpsHRYZoSyKG9AX PVcj15xoFhCe+v6tKUjUjDXNYo6Uy9GRxL5Pagy85trb9BjpD14tCgGaWigSul6q c/pXujz6sCDu9dRvIqdD1b94Fkhu6h5m5yMZQM6y/SEsLFLN3NPfFHUxZ3M1zuqf YkGwJ5ezqn7hCJDl9TEGzMjv9IX2TYpUfSKnjbh5Z5jbXekQYlbCvPKCdC4xgl5/ 3cDt+ryj0n+8pMM/ozxd3lPhNRlkKw3AZnNpL8+iJw4aivznjAu6bfnnfvfg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1667620387; x=1667706787; bh=AIl1vt1pBICk4OrJkdTCjxt3U10L F4ALwBjSTIKiaRk=; b=f1KEg17W9GXoaw8bsJJyUxGB6UYqTiFpwdq1GZC4Nt3d mECSFbfGanL0te71k0AKLs87xhOpazedCwbeHnF+rC52FEEddHW1qbxoOyqVyagP 1kISHKsomUbr0FFY4FBbjuoUl+rqswgphWl2ZTyRk5QOnQINLIAZVWIhKFmOVMSl GluJw6xOKdOqOVl+fpCW/3qh2ZsraQjT2tJD1IguiYsvT4b2vlACTrHRZbnDOssH KkaDGn6C6iej0Knt76qZ4t76s7FG9DvtAp7KK7SKUcRlVWNSvg9qmKK5Iv9YD4Kt rOYYLJ8BRaNG7W6DoDmpHXIoiMsyyPTSJhTTXWmEEg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrvddvgdeigecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 4 Nov 2022 23:53:07 -0400 (EDT) Date: Sat, 5 Nov 2022 03:53:05 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: zfs compression on a volume Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4N43Vr3Ydqz3fkt X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=yVITcsQF; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=f1KEg17W; dmarc=pass (policy=none) header.from=f-m.fm; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm X-Spamd-Result: default: False [-5.20 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Fri, Nov 04, 2022 at 09:40:21PM -0600, Alan Somers wrote: >The cycles are wasted because the data is incompressible. ok, thanks From nobody Sun Nov 6 21:00:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N56FF6YKjz4h6Kc for ; Sun, 6 Nov 2022 21:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N56FF48JWz3C9Q for ; Sun, 6 Nov 2022 21:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N56FF35f3zbNR for ; Sun, 6 Nov 2022 21:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A6L01x7011651 for ; Sun, 6 Nov 2022 21:00:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A6L01YY011646 for fs@FreeBSD.org; Sun, 6 Nov 2022 21:00:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202211062100.2A6L01YY011646@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 6 Nov 2022 21:00:01 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16677684010.1CA9F.10960" Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667768401; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=bFdJJUEP0sUEKb7810Y+QF8vWR533byAuozFCdycLuU=; b=C0DspO1M3jDN300JidsauMAi+BGJWJkryJcP2rmCvGlSeL6GRCfu/J79NQcUU6USrW3nyZ uVEbUMZ0EgaxkPAKnxb8DZ+4eeWMqtuNn5Ox9iOyBn3phD0Z2kdfVL7glQgJ8qarK10RW0 otf9dCMG8r/bm9LUvt6sok4iCLz7qcqTEOz7AtrpJfPiiGqwAyJMLklufJEjHpMDJvqiaI hlIEYiUcJXFfE1L28jb4vWr08gqDMNRoRoMKAVgHFExJPHApHqsNh719+YmCiWK2pczZnf lcLifk5bQ12obvAe2d4OtdBgMVoKzzXhfDjouehA59dXJbHRwaYvmeZMIQ0wnA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667768401; a=rsa-sha256; cv=none; b=D6rf1oDCQNpGuj1n5qayOamRS2m6aI0MRwYFyXccxGprU64gBI2PCl+FMzdYuUql8Wv7H3 6RyPr3P5wkZ3mSlo0CNFRx6T/7MvMnuzHqSZlX3DXr4Uhp/c3GGck++VIF9PhzK3sX9SKg UjL7CqGVJ0TrFiqkuUuNbeHJSm/9xcV7se5Z/EJwXr6Ha93ckmX4XVAZhmiwwuWjK6jbn7 7yfa11UB5jAsFlbYY8ab5Uu4Ep6cvMF/pjkuEp7hZKy8Wp5vR5q9bSNJheJEagYE7ktIxV HVjOugEgxhW95dreQ0IUcii0sdYdPOPMUcBjMe8oiXGZiHjcOjtpAqMU64Kojg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --16677684010.1CA9F.10960 Date: Sun, 6 Nov 2022 21:00:01 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16677684010.1CA9F.10960 Date: Sun, 6 Nov 2022 21:00:01 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16677684010.1CA9F.10960-- From nobody Mon Nov 7 23:43:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N5nqs00cfz4gkjw for ; Mon, 7 Nov 2022 23:43:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N5nqr38BVz5VyG for ; Mon, 7 Nov 2022 23:43:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N5nqr2GTwzKk7 for ; Mon, 7 Nov 2022 23:43:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2A7NhqdP086883 for ; Mon, 7 Nov 2022 23:43:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2A7NhqPa086882 for fs@FreeBSD.org; Mon, 7 Nov 2022 23:43:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 246750] ZFS: Confusing error message when creating ZFS pool on vdev Date: Mon, 07 Nov 2022 23:43:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dan@sunsaturn.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1667864632; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=O8XXe/yCUS2UtfJQHOgKO87kYC761+cqkdZ5kUKCE34=; b=SwTznLrv/aKLeGwqR76NVuQCHBilGROyS82i8gCs/oMAgOtVD8Ei+mVdnqTxjX0pbfJ6jy b1cnaCnXaa9OTGa1xhGbTIoFdeXJCso/4uxZrWaMh9VOlcTmpjiYdHkVdspZDLWHEfTvl5 NOcYHHy9kqM2zKNkafr3uy9baE1OU2rC9L3uzjAYDyIwFR6HY/BTso9XNtVS9XQ/abpnK4 iwXsZrdLrtEC/JN1IJaQ0W8WmwQt+hB1kOm9sramJmeUkSzUGlhrDjfZ31zYbWb3l+RG5s zaYs7U43ZmPKCgJUynXqgx0nkq2mSPDvPDbs+YvxvsIX4k3fFYjrp9+FkjLs9w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1667864632; a=rsa-sha256; cv=none; b=K9BSAoGyduh5H32/4jnJHbEQaS7QcpRXnwlfGGu3YRbAm49EX9rzwisw+LNwO2zetbqOVS a69kZNYXYUeqWNxlSvLdZkGUy811VHy4kGFN2HVDPzexW7NKhDwYpxoW8Bv+MFirTCJ8iF uCbO0frEvqDNdAqqo+uyown0U7SmQoadLQKyHz2zMzRP54zJAiW4mNdKaJjJ0S+a5Zz5Q8 AC8DCB8X1z01Ls8khIwrp7G7bJNRid563wSz1Q4tnjNIstk/1H34SUzd1pIOm5lxzNxaYB iZsxpK1YtqTILBcY4/te5tnZ8IVdjo3gRo0Tuq3o4KTriAX+IV/IzWYCscCWQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246750 dan@sunsaturn.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dan@sunsaturn.com --- Comment #4 from dan@sunsaturn.com --- Pretty serious bug, no way to mount a zfs pool from a zvol without it. Any progress on this? Issue: zfs create -V30G -o volmode=3Dfull zroot/asterisk2 (install a ZFS guest on it) router:~ # gpart show /dev/zvol/zroot/asterisk2 =3D> 40 62914480 zvol/zroot/asterisk2 GPT (30G) 40 532480 1 efi (260M) 532520 2008 - free - (1.0M) 534528 16777216 2 freebsd-swap (8.0G) 17311744 45600768 3 freebsd-zfs (22G) 62912512 2008 - free - (1.0M) router:~ # gdisk -l /dev/zvol/zroot/asterisk2 GPT fdisk (gdisk) version 1.0.9 Partition table scan: MBR: protective BSD: not present APM: not present GPT: present Found valid GPT with protective MBR; using GPT. Disk /dev/zvol/zroot/asterisk2: 62914560 sectors, 30.0 GiB Sector size (logical): 512 bytes Disk identifier (GUID): 8ACD2112-5EBF-11ED-8F56-00A098E3C14E Partition table holds up to 128 entries Main partition table begins at sector 2 and ends at sector 33 First usable sector is 40, last usable sector is 62914519 Partitions will be aligned on 8-sector boundaries Total free space is 4016 sectors (2.0 MiB) Number Start (sector) End (sector) Size Code Name 1 40 532519 260.0 MiB EF00 efiboot0 2 534528 17311743 8.0 GiB A502 swap0 3 17311744 62912511 21.7 GiB A504 zfs0 router:~ # zpool import pool: testing id: 8013833172609421701 state: UNAVAIL status: One or more devices are missing from the system. action: The pool cannot be imported. Attach the missing devices and try again. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-3C config: testing UNAVAIL insufficient replicas zvol/zroot/asterisk2p3 UNAVAIL cannot open router:~ # sysctl vfs.zfs.vol.recursive=3D1 vfs.zfs.vol.recursive: 0 -> 1 router:~ # zpool import pool: testing id: 8013833172609421701 state: ONLINE action: The pool can be imported using its name or numeric identifier. config: testing ONLINE zvol/zroot/asterisk2p3 ONLINE zpool import -fR /mnt testing This hangs forever.... The only way to import that pool from the zvol. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Nov 10 13:49:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N7NVh2v74z4dXCf for ; Thu, 10 Nov 2022 13:49:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N7NVh1Pt2z49f4 for ; Thu, 10 Nov 2022 13:49:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668088172; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vC+Y9ZKqHLtpfci6hLjim2ofVQtWNdvciQmb5vfarLE=; b=hlfKz/JaJajIvIB9idt1/aL15ASyPCxKQPqg5bkV9D65LKp6kD3R1cVlg7MatsYxmkji2F q7L06hkLlJno1SUBG/Hlufme5v0zHfNtyG7LI9SboWqIB8LK42kGqoOCnUOcMFIGGYbPl2 nwSAXaOiR3VHGWSKlOIJt3zEc0TFp8OUr8JFbOnmT6iGO/+cHEwplygBHu4mwgptN6i8Tv 2Nz4/7PqkJzwRVmPo4b9s5/0utJpVRn62mDz9j+/p02OxJ9R3ZxGXw6smAR3DXOukt7vPQ Y0ULHWvHGSXVfdJCV/QVaro0o8AAHFEGm6xpxcFsICjevTILhfSTAEW5nGB6YA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668088172; a=rsa-sha256; cv=none; b=TOfEUjS1btGuArQQbPwq/+hAG6rcxw923zhkoQhjUdlS6Om+NW6tsJiw2kr08iUxgmLD+c qzKoGk4EtQ3Yk3T1TkM9RNepx/5uKajE7AgYzO0xNdqGzXTkFApU+AK7u5yUAzkOoqCGBg hRBKgiwQyuzIiIsVcc5YBoRUafYKQWrVgH81feAAg48GbHVnNb3orNjLPwVP9Z+4cMh0VF ffdCUIJRJf2uUHkoiMvj2ZzKMk6WCCk6ffyI5BBMWD0p+X1Me+DSFww0wxLUNwyrt/s+Xz exmuW3mcybQa5pTe88ZK0CCVWG9hE7JPiTGyYC5gkywZ8LOigh5GXdCxHTiL2g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N7NVh0FNXz13QW for ; Thu, 10 Nov 2022 13:49:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AADnViP088010 for ; Thu, 10 Nov 2022 13:49:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AADnVw6088009 for fs@FreeBSD.org; Thu, 10 Nov 2022 13:49:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267687] [PATCH] Port HAMMER2 from DragonFly (read-only support) Date: Thu, 10 Nov 2022 13:49:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ae@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267687 Andrey V. Elsukov changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |ae@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Nov 10 23:00:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N7ckc3XqLz4dHVf for ; Thu, 10 Nov 2022 23:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N7ckc28Jwz4ST9 for ; Thu, 10 Nov 2022 23:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668121240; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0YLkgIcHUY6tKW8a9TlzJIfSYLi8FEwPGEGmGlCUjKk=; b=w51lHZkm10fUbu4OK9xv/f6n82if2c1fvjrrYfXm74eknHMMUpsut+uhbFVh7AKVVpWxth cPQExL1A5LxDcAAVDGoZ1JlzcxcwuCL9oBHnlXBroM2eXM8KuNfOjAfLsht0MWhtlvizpP 9vypNQO+BsaAmd7NHMXxtDcGFMrea8B7/9cV2mu66sHuYoNBdmHy9X0+D6NJD9PknneJTu 8hWWe2afHlufORwUABvOuZJ6Of39SciiGbYY8/OyQg4B/cw6AcO+4uhRgB6KEyficlVhn7 LA495L0RLZAWN6rF8nhkmL4v1O8GoPi6q53YJ6GLlr+hpApzoXdrQa7kJ5/nmg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668121240; a=rsa-sha256; cv=none; b=arv3bpg48Ori6EPHKde12ed9GGaigNzIVFl9zdd4D8Gzx3pzpv23U4L/1a9XecEvpx5BTz Olmo989uh+L1eARdsb7v+3W1RT6+JFlOWbI8atKSkemPTS/F8jNXydCHPT8q4eTBtAOSrt fSajR4r0FKhGn3sNiKJGwbiIq1f5fkps6B/naDBAUCu2OGaCBQeFgUJbdTBisyzDHX1IT3 Bvnl9E1ctxtM4S6uQCdlnBDH/WfKNUTJP9rFwJcpdAVdkF0322QxAk8C+acknM615wcQrG FbsZwQZwvM6m6xU0Y/94hjeMafBsbYCavcTRS/zBp5LqDNOzu3J9blVLFSuPvA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N7ckc1FWnzJwR for ; Thu, 10 Nov 2022 23:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AAN0eYR082461 for ; Thu, 10 Nov 2022 23:00:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AAN0ejp082459 for fs@FreeBSD.org; Thu, 10 Nov 2022 23:00:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Thu, 10 Nov 2022 23:00:39 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #10 from Kirk McKusick --- Please try this patch and see if it helps: diff --git a/sbin/tunefs/tunefs.c b/sbin/tunefs/tunefs.c index 11956f946ff5..bad31512daab 100644 --- a/sbin/tunefs/tunefs.c +++ b/sbin/tunefs/tunefs.c @@ -312,6 +312,8 @@ main(int argc, char *argv[]) on =3D special =3D argv[0]; if (ufs_disk_fillout(&disk, special) =3D=3D -1) goto err; + if (ufs_disk_write(&disk) =3D=3D -1) + goto err; /* * Check for unclean filesystem. */ --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 11 05:45:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N7njC1KMTz4dYxY for ; Fri, 11 Nov 2022 05:45:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N7njB4nYBz4594 for ; Fri, 11 Nov 2022 05:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668145502; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UUa5dA0LFj1qLRjPZQfK/dEZHACZFrPt4oYl/wXfM4w=; b=RqCn69S0iDd/38l3DwFenG5QFiRwx/iQEeELghoV74Kw/DrZeOCcoRpzt/KW+FUDKwYqZr APiWdKUQQcICdnu72bBw3yF013XhnfMP67zFJu6EODdd1GAdp2vWlFDg2kpLdHEc/Q1N/R o6Zkpt1cx0bvLwg2CIMfqLW9cxcczEGxtHKaev6XMSREC16A+g1P/BziukiCYptJ0hKTdp DB1j/KBZC9SJ50hfIplLl5zqOgH9NaaU9ApKUsMTwZVk8lVMmNCXLpUGw6img4Bii85jzt 6Fvi9zCRgiJvpvcqWYFMlWdfR/RBCR289uENRCeLY8Ph3hI8VvdX+UBoK6jpew== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668145502; a=rsa-sha256; cv=none; b=e4lvx+CJebGUZtpPJhWaaOP6CA4Wt/2IzrZvEz9aPu2XfkmchvqPSK2DmJyuBYiweksunt wG8QqRX7kdQk+h2Bk1KikXI+OyjRZWL9yxmDxUMAZps4TqTJzv1AL8+goHfr4yzcx20CVE Uf7Ud8iDxDKtxzU6FiHFPTAWV/5kY1c8eDBrs90p5B6MDCa1jfw1NnA+4ltMdk+qwsf5kC oTOo0oz7jDPDrAQp6A2RPtjUMPZCYL1WHrqZnN5ZSQGcTsADYHIXmArP/uyZXLUgJrGdiU kYG4uxCiYijnFGIN0gwJ3HYzKU2cLshRxiJbZz0bgOXyN9Ke2R/fIcPCMq5PwA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N7njB3lmczVyW for ; Fri, 11 Nov 2022 05:45:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AB5j2Sb041725 for ; Fri, 11 Nov 2022 05:45:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AB5j2gt041723 for fs@FreeBSD.org; Fri, 11 Nov 2022 05:45:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267687] Port HAMMER2 from DragonFly (read-only support) Date: Fri, 11 Nov 2022 05:45:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also component cc bug_file_loc keywords short_desc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267687 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 541 | |02 Component|misc |kern CC| |grahamperrin@freebsd.org URL| |https://github.com/kusumi/f | |reebsd-src/commits/hammer2_ | |1 Keywords| |needs-qa Summary|[PATCH] Port HAMMER2 from |Port HAMMER2 from DragonFly |DragonFly (read-only |(read-only support) |support) | Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 11 06:25:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N7pbK6FRfz4dxLV for ; Fri, 11 Nov 2022 06:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N7pbK2vWfz4Chf for ; Fri, 11 Nov 2022 06:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668147901; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NNzlviJ9vVFCYkQYfgjATwsZ0T8JjKse61K8kniUnAI=; b=TICqPgYFD2/0eskTbOHyQBugosEMMFyJraQDCfr5zP0AnOk3e/aQm4WYJcE74bchBky9tg 1XnAm4evw4ZxI/WeXljkQ+r6ky0StDi6BSIHzNxAyYdL47V3Z+vzNQuhpE0XtA2TNk/uIx rSCjayUoRlpF4UkGHYwQvGEE+qDrzZtjbij63gdLhyBIjqg4YCds9TqQdgh0uNimBblUJh 0aJZzvZrnlgvcDzwLO9hmQqJ7V052dGU0xV3ngyR0dlNmou69VHYcLtoYr61jy6/LHOuzr Km5vYvhy055qqUB7IQ3cAygpNCb+bOk9jdPRUM6e6yacj+vmAldVYOLPwHaUKQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668147901; a=rsa-sha256; cv=none; b=lyhew2jmPwR6DJMiUwZGjVSpkv5T0l6a4ZenKTkLrAAF7XMhXDg7OpGY/EiOIt6QElS4X/ k1RkoOYwMpJGkhQmHPvDNHw8KehgUjJV765vOSsV7DqxT2MsSpT3PvYHl2IC9rxOPfOCMw 2NiZcmaOnfSFvFZbyczuFuXbi1rxn4hddRSn7yB7hAmPKZbkLnQIBus9LcMeCZpKulU6E2 HQttlWlGs6RrgDx7FG4NgHoZttSPOMyQ2Dxp99a7LX4SLUnheBzmmsGlRl4peV5CjDDo+2 rkUrp0fqkMqbkBaBBeIMGg6fjRn3FELhTqoxeyQV7mYan06oSrHfHIYKqQZ94g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N7pbK1rmLzWmS for ; Fri, 11 Nov 2022 06:25:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AB6P1OE012799 for ; Fri, 11 Nov 2022 06:25:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AB6P105012798 for fs@FreeBSD.org; Fri, 11 Nov 2022 06:25:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267687] Port HAMMER2 from DragonFly (read-only support) Date: Fri, 11 Nov 2022 06:25:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gbe@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: gbe@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status assigned_to bug_severity see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267687 Gordon Bergling changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress Assignee|fs@FreeBSD.org |gbe@FreeBSD.org Severity|Affects Only Me |Affects Some People See Also| |https://reviews.freebsd.org | |/D37354 --- Comment #2 from Gordon Bergling --- Thanks for the contribution. I have created a differential for it. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 11 17:42:44 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N85dV0DKKz4dRFm for ; Fri, 11 Nov 2022 17:42:54 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N85dS5Nknz3P5q for ; Fri, 11 Nov 2022 17:42:52 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of andy@time-domain.co.uk designates 62.3.122.138 as permitted sender) smtp.mailfrom=andy@time-domain.co.uk; dmarc=none Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2ABHgjJo029698 for ; Fri, 11 Nov 2022 17:42:45 GMT (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2ABHgiYF029695 for ; Fri, 11 Nov 2022 17:42:45 GMT (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Fri, 11 Nov 2022 17:42:44 +0000 (GMT) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: freebsd-fs@freebsd.org Subject: Odd behaviour of two identical ZFS servers mirroring via rsync Message-ID: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="951801389-1707386074-1668188565=:29479" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip4:62.3.122.136/29]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[time-domain.co.uk]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[andy]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4N85dS5Nknz3P5q X-ThisMailContainsUnwantedMimeParts: N This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --951801389-1707386074-1668188565=:29479 Content-Type: text/plain; format=flowed; charset=US-ASCII I have two identical servers, called clustor2 and clustor-backup, each with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and two SSDs for the ZIL and ARC functions. clustor2 stores user data from a HPC while clustor2-backup uses rsync to mirrors all the data from clustor2 every 24 hours. However, the disk usage on the mirror server is considerably more than on the other server - attached is a screenshot showing the two servers side by side, with the mirror server on the right, and displaying the contents of the same subdirectory choen at random (named 'ratio_10.0' in this instance); as you can see, the sizes of the files within each of the folders are identical but 'du' reports very different space usages for each folder and 'zpool list' also reports a significant difference in ZFS pool size. I'm not sure if this is relevant but both servers have ZFS pools with no compression although lz4 compression is enabled on the ZFS filesystems & both run FreeBSD 11.3 with ZFS version 5. Perhaps using zfs send/receive instead of rsync for mirroring might solve this disparity? Thanks in advance for any suggestions, Andy --951801389-1707386074-1668188565=:29479 Content-Type: application/octet-stream; name=file_usage_issue.png Content-Transfer-Encoding: BASE64 Content-ID: Content-Description: Content-Disposition: attachment; filename=file_usage_issue.png iVBORw0KGgoAAAANSUhEUgAABWUAAAGXBAMAAAApKC8YAAAABGdBTUEAALGP C/xhBQAAACBjSFJNAAB6JgAAgIQAAPoAAACA6AAAdTAAAOpgAAA6mAAAF3Cc ulE8AAAAD1BMVEVGgrRfX1////+/v78AAACOJtCNAAAAAWJLR0QCZgt8ZAAA ABBjYU52AAAPAAAABLAAAAHTAAAAAq8qRL0AADMdSURBVHja7Z0LuuQorq37 zuDsOhO4SWoC1dUjUDP/MZ0MIwmBn2BssEN0f7krIvwK+Q/MY7H0r39ZsWLF ihUrVqxYsWLFihUrVqxYsWLFihUrVqxYsWLFytHy/36stC7/Y/G9rnxi6nT5 y1mpKWnc/r9m1uJ7svxKX+Yx/WUxrQtrGrf/WWPW4ltRftJQTzH9J5a///rH SkVJ4/Z3yqzF91z5+Z28mmL6t7WR2paMWYtvw/K/xOy/Y8372x5Fx8tK3P7K mbX4lpffy3H+9ZuYVZ//9W8L19Hyazluv2bMWnzLiw6oit8PM+tUe+u3tZ8O t7OW4/YzY9biW9FB+L0YZ2PWmDVmjVlj1ph9ELOhwfW/xuwFzIbG7S9jtjGz IXLG7CXMhjefwqw3Zr8wugeYlbrXmC1kdmoO7DI7bHyHZvbfn5CtM8vvjRVT /4//j//v5///9dP/xmP29wfTfWZHjO/I0Q3MfkL2QGbD//7jffgvY/Y7ovtc Zv/UARzVf4zZb4ruc5n9hPFPLL3/z3+N2a+K7vPr2X+M2S+L7hFmg9BryPbs 58k1LrO/fn6OMDtifEeObmD2E7Knjc9+4vif0LMdldkYty1mh4zvyNF99pzC uMXmwYzZhzP7K+jojdkrmOW2lTHblFl525htzqy8bcwas8asMWvM3sLsrx8X lzX+9cuWdh4uK3H7K/WRsfjWFB0oFb+fXz/BmyeJt5XDZTVumfeRxbeC2eU4 /5D3EXvLoK32bLNkNPORsfg2XOtMPjJ/W0zbMvsrb89afNsx+2MxvYLZv43Z y5j9fSGzMHsH889g6TO3sd9DbnxTZnEjsLgS2AM3BN7I7J8X4MPXw4UAer9D HUAxs39OhAtRxem/MT8KbN9mOj8k15W9ml2Dpy93A7OH4vt5C4uZ9UlsUH2G 8gnsVwKgz5+GxM/inVwDfSO4oH7ZY5YRWogpQbTBLEJ5/bDILDjNLByoKTSz W7V0yix8bmjY9WRlfpTZ/fguXcvuT//PG0vMYsIsFjK7VUunzHq593hBZb7D LDhfySxewOwuqXXMqo+QbymefHIeZHY3vnABs7ukVjIbPwIFR/uKdsYs/Hla wZ9A/nkwef/n1Z93PNUHQG9+/qDn7692wIlS/Hz2eeZB/AwcHQVw2pI+oz9I n9GJ5Azgvez3OQTGV9OJ6PlEr8IlhfOFKHsBAjzmOE+H/pzhcxR+DF/PbGF8 k5DE4KmIovyhiKr4QniTjjl9hsjfN2z5OS09wMMroObKFHsIEfVMqfc5zvJV 5PbwL+ZGZvHzswKgMML0Sl7wTcWpvRS+UdwBIX6GLgRj2h2Rj/InJFR/AMof 79SRP00xPgpXNRj4RJddCzCSclp6BVk9i3njja8MdIRvYbYsvqEFSiGJwVMR 9TFqFNEYX6Q3Ud4MzR95JWcnvngHfuXTehZmfQkvV63DfDezbh5TuR50ErIQ 0D8/QeITnAQgvfIZs865tbjpm8dEJTyrLRFcZPbzCmVzmLUN+BHqvbpBrguz RfGNFzVndhaZ+DNWgRWi8qDTlhBa1RSSEFbaPFYKGBsrjh9goELbn1m3GlPA GFOnv+qErvMps6iZ9T5UHQDTN07QoDASUZ+z+vB0pzd1dStbAspvPbxC3WXO 2ga6l8tXzYe+ndmy+PJvnZgNwftEVCITf4EBnkDUVFuH+8JvYsIsveklJOEV 6BGcvG2ghgFAgkmXNAyz3DSk6wEdU3D6kRJ21tUmpvWsI2ZhhgZmzQCqi11e LSTPPl3POlXPulhV6D4YzpnFTvVsSXwhZ5arQETM0dDVLt8J9W3mzEJezzpV zzpYqGdnPWH1UxmEWYjouaknNb3JMaVvotqzE7WhJcoNMt02QGEW9B3hx2La nqUWgHzm1QNUPwixrj0rzGLKrFwJ3sDsfnypVk3aBqEZFiNDFYSLgdXt2XBW +Uzas+r2SDOpvD0rzELKrBz/jrGu8NCkfmbooU+v8NOJpDenDmZ4lnAP3HMf 1CPyMAC3G6ZeQPgzfW/vl5kNR0EeN6DnPJ8s7EdHCc3oMK6wPm4A3HZANW5A V83PPLl4/syHgf6r5hQK4xufWN5T8PiXSpGZMRsO5kEiQ8cMn4U2BR1laoKF xhoHfWHcgJhVcYoNBm4b0Bm8bPmpNcL71zPb4Ji4cqhrZhzRNbz0ZodqN3d7 0wQ4HLkTpy/dmJ2dFryv/gLee9euPI7Z5JgnYnHmFnRk1orpuoxZY9bKFrPp 8yZO6/GU3+VV/8uZXYyvzCRbcM8zO5siearoclBmo6wLF6SbVs4xi3HY1Epj ZuOgrZUKZklLpSRV9AGN4Buz55hdjC+NxEPToYvvYXY+X0rVAk0SoDW5TjG7 GN8wjo9gfbSzzLolZv1jlxENx6xL9SiZLMJKDbNRuZerAa20YDZTRrL8xcoJ ZlEvScp0l1bOM5vKrZOmmJVCZknlpiTsQYGBWgdspZrZeXy1IstKObOOOrQs ePpEkeXAqULKSg2zS/ENS6q0bMpKEbNWrmXWijFrzBqzVoxZY9aYtfiOwmzY mLw1fJiJVN0IEir5BR0wiZimzggvgNGfe6+vhVRl0VtjdTDzoPr5IcxubAzr 0noVNenXIQU9vQV6dQKtgwFlw4ZuUWGPS9F+CrOko/v8S2uDQE8/imETLknt ox+CT++BvAJ1oLCsNl8V+3Jm4RSz0XeCQ4mZHxKoVW+8kjlbfv46Zmlpm6PF guQkk7oXwrJeicULk0fPCrOomaVxTfHdwC9gFhswiyqUc2ZBGU/Syl45MoJ7 ErMYlsruB1UunAwJwmrx5FBksTELKPLvWJhldyneW98ysaFJXAtJr8NuVqKW Yo+qUZktiy8bmoUSjLqADM3CZ7y8OdsbxN0gWnx4dTBIapNoUaMdDemGpC5j yk5tGGY9T3odjWmYPXegn+iOrOZ4MX9aaEW2E8h9+K2j8vXDBHGYu8OSXscn ZknRo2pYZsvii2LdEH69/EXJoUt9+6xewLCoREIJygrM6dgLozhzjmW3g9Rl LNqpjcEsrXlHXgi/8GcWU+X9FMPgVZt1vjIZHfuvAm+u6V5hlt8krwjlwkHO AbHGGJXZ4vimQJJRVzSXUd9+Xs+Sq5rYpyQHW2EWtdO0at1GQzGn7dQGqWeR Y3OoHojsoEvbs+vMas8jUex7NqwL8UzsilJVGUTXNBcXiXN97wdQSG23DQrj 61Jmo4WZ9pGbN7+UMRGdi4zQokGRtjLS4h2n2rPELNuikc8Xv/tkZiGDbhbT nFlmUHxdxOnP0ZCLT8K/zWz8JYjfz2uZxXk9SyzlzHIrgj1fQB8MkzFI3GU2 qaFew6zL69nMHnLGbOyapmZR2bAASqctH+viVkC8Qcqj6t3McrjYcConSD/O 5Seu2rPpsABZBM7c4ZRCPbqMKTu1oZg9sKAuapIgjl1rRyd0mY22yz7z5DfN R+FxA56g4I09mVNjPqcAoZfHu5Naij2qRmb2cHxzZh2bk5O3FjWz5uMGXq0/ RxV05NvmFbP04I+eXJpZn7uMeTZSH6ee7Vcq6sbOV1zDbOtwlelusfY0o5TH Mju4f8WtzJbpbo9fgh9Tz2samScz+53FmDVmv4rZsHGNrmv6eOqDQezJpZ9t 6bq4rDUlvFc9wC6tiAF0XU7kc/SML9J17V0EyIR56JTd2IropOtyasx7wXh/ T9e1w2wyPYRdarf+ui66Iy6OXxfpuvaYVdmFENyt/bROui6JOjpXoevau9na Xgy69Hv767qES5kPKNN17V1cNmN0Y7XQSdclW2CS++iwrivmYeQ0DjBlKQyf hQQ66EZl9h5dF7MNaV6ko7qumKORoj1lgYyD6SxXGITZG3RdKp6s0SrQdcW8 NSozjiQiClOZPtlvKGbv0XWpasHzkY7rulROm5g1x0nOrKDuQL1fR2Zv0XUp Zp1ItQp0XTE/GLLPhWaW69kRmb1N16WYZVVMia7L6VRQc2blXo/ArLtD16Xj KQ2zAl1XzMNIP5nILB0lTYI3Vj1bGt8qXVdSLfCEWYGuS+Vo9Dmz4ShZUsfn MVum60puBrpSXZfOwwjT/dL1rEsV4K9j9piuy6lgaJ3xQV1XkqNxSlWY1LNZ SunnMntc1xXjmYqKj+u61Gk/qdeY2STFM7qDDccnMrun64r7ZlE7rutSFYVH YRZc1iTBm6uFTrouesAEKbGToxzVdak8jJ77WlPk4rIlkBmNMZm9XtflwrMK ZTKhSNelcjSG3amPwBkblTIPcABm+5Wq7z5LZjtAeZWuyy0kuu1Y3sDsiFaN r9B1qTKSwss0Mk9m9juLMWvMfhWzYeMiXRfnFwpv8lJOZ7qu9fguli29AXWu gtyKO6LOdF3TZaPscljXxVPYNErisvWd+o6YrquOWZ5hQGAFEqxpZEzXdUTX FfVZUSWHznRd6/GtYhZAzdJkq5V17WG6rgO6LiW7oPn1OCFuuq7F+JbqupKJ ybBl1HWYrotjelzXRYP883ld03WtxbdU10WNr/xhY7quNKbHdV3glW4AneLZ dF2tdF0+KhL0LTBdVxLTEl3XGrOtdF26bvlWXdcKs810Xeq0X6DrSh838bOW ui74bl1X2mpSNWtLXRd+ka5LcjliMlJiuq5iZld1XSAPc5cM+Jmuy9XpusDL UyeOSMtRTNc1j2+5rssjN57ULXCm67qomK6rJlym63ocs6brMl2Xlacw+53F mDVmv4rZsHGRrmtq+avOAYq/QY2ua630N0ztqOuaog2xj+vF36BK11VxcQMz W+fXBTQNICMl2T2QVwd0Xe9mtt6vC2kaQAb86N0aXde7mK3z68Ko60Jc6fqe 1HW9hNlqv65J/BIHUeOWDXVdozF7qV8X8pg16jqgXNcFPv6JShu/5Q82CrNX +3WJQQ/oR1mFrisO6MZZC1J5dbRZv92vS6TeQbAklBbrulDNBGE2eTN4PXu1 XxfyrPa0jVBarOvyMnEGfAu0Gcc4zF7s1xWZ/bOlV5SW6LpSucKzmL3Br0uY /dSzCvkSXVcqVxicWXetrgs5pjP9TIGui7YMf9zj6tnS+BbqukD2wqwOLtB1 sSdXSKv0TmaP+nURs+jO6br00pGpVQLfw+yeX5fkuXXndF1qBZSbWuD+hcwe 0HXFhUlLzBbqulAGLJTOGam5+HZm1/26OJ7LzJbpujjlImq5fhiu7FYx3K7r Cvv5sANv4op1XdxXnmIddEciOIJeCQJLmL1Q14VB+Ebh4gyV5bquIEIMjl8Q 5HOsm0PsmOfyJbqu29d3nGK2dbju0XX1Wqb0SmZVbf2dzN6j6xpGPmcamScz +53FmDVmv4rZsHFpHsa8cyBThars6LrmVykJ3NXF9Wzfds7DmPdxMQReb7uj 65oHbx77Tu3bPnkYkwWhfv7193RduHIL38XsqTyMydg44DwiO7ouWPgFwfOZ rc7DCMmC7oo8jN/B7Kk8jJgs6F5hdkPX9TRmr87DiFwPRKLLdF3oeKSR5V1c ubCGZrKq6kht7zyMIFFDnhYo03WFVcx8Bhqm5Yunnac376e2Rx7GCazJ5oEs J8M5S3RdILojngkK22FkGrvOhvXOwxgaq1NnIio4y3RdyDeEzsCL+l1k2nWZ DeuThxHDtFWyQ5Gui/8FcfhJWsUo+pDxmL0pD2OYh/XRu8wV6rrkX7mDSasY ZKp8jHoW3YV+Xep7s8qN6+Xjui5kzwi25khdbOk513GeoXseRlBNMAllka5L rE/ImsOlLrbUgX4ys8fzMCqbJxK7uWJdF8z0nUvMjto2OMnsgTyM6SYUykJd F85kygvMjtE2OMGsO5SHEaKCCHVC1iJdF6btWc0s9wdh3D5YC2Y38zCiBEw5 GhfquiBrz2pmkRofOEwfjB8qO6U2DyPZPHnM5hSO67roaSXjBj4OhE/yrimm 2FPS0TkPI7mVgXfZnMJhXRc1uuK4gY49dbud7zKi+GiNDLq1JK/dy1t0XSs5 4bti8iJm/UjarrfoujK/az+Ctss0Mk9m9juLMWvMfhWzYeNKXRflYYTYk1Pl jK6LEqqkf+SKb2rtjqHrovhSq6mdrmseX79wZSMye07X5WKOCtdS1yWe3/rP I5k9r+tyOswNdV2z+EKy6ndgZs/putJ4ttN1zQbC05XqD2L2vK4rqRba6brm 8cVkpLcHs7foupzCtqWua5XZW8VeY+i6NLYNdV2rzN4j9uqn6woyreg/20rX tcXsfRO6Y+i66L64Kr+udV3XFrM3TOh21HWpp3nYvI2ua4/ZexoHY+i69NPc tdN17TJ7bbXQUdelGxWhXm6i61pl9lax1yC6LkyYbaXrWm/P3iL26qfrUmF3 LXVde8wO0DY4yexxXVeUz8Ub0kDXtcfs7W2DE8wW6bqUn5RrqetaHuu6W+w1 hq4LnKv369rQdS2PdeFNYq+Oui501X5d27quxTFvvFfsNYiuy7lav65tXRcu Td3cJfZ6oa6rwYEvZrZ1uO7XdZ0/sDErFccoxXRdX8Psa4ppZIxZY9ZKE2bD xuf8uhrputwIBietmd3YuMivq42uy43i09Pdr2s9p12JruuVzDbz68Ilyop1 Xa9gtolfV1Uexu9gtplf1yqzRbqusZm9068L4qPohK6Lr9p1NZI6yuzdfl0+ tqhO6LrcKH5o3f26JOvnOV2XG8FI6iizd/t1sYLlnK7LjeKH1t+vq5GuawQj qUPMdvDraqTrGsUPrbtfl2ul6xrASOpoPVsa37N+Xa10XYP4ofX362qi65oz O3Lb4CSzxX5dbXRdbhQ/tO5+XW10XSrqHY2kbmW2wK+rja7LjeKH1t+vq42u y41gJFXC7J1+XW10XW4UP7S36bo6X/8xZluH615dV3c/tJcwO4bgqBez9+i6 htHNmUbmycx+ZzFmjdmvYjZsfDIPY+yDqVKr6+prJNWa2Y2Ni3Rdqg+mbwPW 6bq6+6GNoOtC10zX1ddIqjGzDXVdLfy63Ch+aCPoulaYrdB1dTaSasxsQ13X CrM1uq7+fmg9/boyX8QGuq7ORlJHmb3Rryv1RWyh6+rvh9bTr0vHs42uq7OR 1FFm7/PrSnwR2+i6+vuh9fTrSphtouvqbCR1iNlb/boSZtvouvr7ofXUdWE6 zdJA19XZSOpoPVsa33pdV1otNNF19fdD6+vXpSz7mui6OhtJ3cRskV+Xqhba 6Lr6+6H19etSj602uq6+RlK3MnvQr0tVs210Xf390PrpuuY5QFrourCnkVQJ s7fouuY5QFrounr7oX2FX1eHL/Vtfl13ir1M1/UCZk3XZeUxzH5nMWaN2a9i NmxcquuifrOjWVdOh1Ki64oF1q5q5cNHMbux8Z7egAQgsRvsCnVdm5cBh65x RGZrdV1TbJC86WV6u0TX9R3MntF1eUcTkRw8V6jreimztbquz36ISiPkSnVd 38HsCV3XJ6wASuq2zOyGrutpzN6g60LaDqBG1wWI2YAuKONK0Xx17OgOoOsC npJCrNB10YnUDqj9Vzn2PcZreui66EHEtl0Vfl0AkE6c6fQ1Ub00aj17g66L mgRs21Xu10UnUjuoE0G8WUPUszfougKzmE72lui6iFnQyZmRP0WpW4Zk9h5d V3iLWrRY4dfFPw6MEqh4oqj5Gqdt4K7VdSELBpxuPhXouj7M0pBEbFrQ9ONU G3vkd0esZ0vjW6HrAhYMqKgV6bo+J6KIqoTiNIsOrPkaqD1bwexxXVeobLx6 jrtSXVeoZ12spiH/Bb2Z2QO6Lhp8jFvGG3JQ1xVO5FQ1jTE/uZz9+cwe03XJ akOSd8lY13Fdl2rPat0dPa0gMtshoncxu6nrktWGIMEr1HWp9iwm6V7V2Z3r 4uXXR9eFtCU/zl2hrgsmXde0Q3CQAnU+QG4buFHHDUriW6nrookentZRN+SY riucKOwQjNDQRfMvL20DuL9aeLRG5txe/ZhtHa4LdV0n9zJmH1TeousasZhG 5snMfmcxZo3Zr2I2bFzj18WdL1r54s7rulD+DIFFf78uGUtFXm98VtcVW899 m3Dd/Lqit1Z2D+RVma7rhcye9uuKCw1py3O6rjcwe8qvy53Jw7jA7KHa6VnM nvbrcifyMG4GdEBmr9d1ee2tJeTX67qCkgRpbNbFg9GWYzF7i64r+JOlzJ7S dU0iGU9js+ENWpML8zbb7cxe79el5h25PXtK1xUm3EG1Degz2nIsZm/x69LG GZ6PdEbXFZbiY2wb8Gc4m4W7m9mb/Lpm0J3SdWntAuqKQ5QJwzB7n1+Xm0F3 SteltAuQPP/wyDz01fUsusv9uhb0M2d0XXNmyWtqPGbdab3BUb+uuQnvKV3X nNn483sms2V+XStOUNW6rjmzOGo9e57ZY35da4Zm1bquGbPw9Hq2zK8remtV 5WHMdF0Zs0z3sO3ZJszu+XUpb62aPIy5ritjVqqpIdqz7g6/Lh7Cjp+d0XXF x5QPxw0mXtO4QdhyPGYv9+vi2ANW5WHMdF0utrb4niJZpvGWfZntV1r9WrHl wZoz2zpcd+i6Vs7dg5c3MLtmJPU1zF6v61r1QzNm31NMI2PMGrNWmjAbNi73 66Ldks8qdV17Fzed6anMbmy8qzegwPkwnS2eyTr+eFDXtXURruZ7dWS2XtfF H0dDglpd15uZPaXrks+iIUGtrutNzFbruuQLxwHqWl3Xm5k9peviz9Q8S62u 6xHMXq3rCl+YR/7kAAV5GONIo9farXFsu3rrumhjHsBGPtzxPIwgA+aQaLf6 23Z18etKak+RyBTourzM6MT52c/W49h29dZ1JbWnSGRK8jBiMtMW57r623b1 0XVltSdtXpCHMTk0iAPgOLZd3XVdee0ZblVBHsaoZHJ0ucnvoKNtVx9dl2Y2 3o3jui7OtUSPPxKJjGTb1V3XlTCL8up4HkbKteSoFYd8Buxu29XFryupE6vy MIr+ntoGabN6ANuu3n5dyS2oy8Moy0josRAvvrNtVxe/LgExXcN4XNflc2aH s+3q7dcVQUzWMBbkYcSc2WFsu3roumR36nk5OcrhPIwedduAtFsj2XZ11nWp WwCxOVuUhxHEkyuM8ExnGMK265kaGTyzc39mW4frCl0XnNnZmB0zcgMxe4Wu a2DnNNPIPJnZ7yzGrDH7VcyGjSt1XSLTIguI835d8aOlHsG9D7sxdF0i08Jw o/S2VX5dKoi+7IIHYfacrksm0Hx6D+RVsV8Xbgbvecye13WxTCscqYFfF2zH c3xmz+m6WKYFp3RdsByxVzB7XtfFMi1cYbbYr2tcZkl3FJ2JlIGO/uLCbI2u i+UDUKHrAg+0IJQ9uRKjLm5FxAWhyaG7M1sW3xO6LpYPMLNFfl2fSWLkK/OQ GXVRK0Kta/bJdd7NLOmOVJrDOH2yGNMaXRfLtDhEJbquEEOMHgapGQfPmGFi R3GrkOOIrutgfE/oukimJc58JbquUBUoD4PUjINmzCBxVfG3PM02dV2UEOnz AwLWpUAiXXFndF3o9A6lui7UXjHa9IivTDMLpQPv1zFbHN8zui4Qm99wq8p0 XZB4xaj2LEqcI7Pa2atDPYsUm/izUZWUd/OY1um6QrtBzlGo6wJcZlZGGKYK iJU2fhhmK+Jbr+sCgo4OXqjroqjNmZURhk+twKNCZUufLmJW9fjjz3+xHqjR dcW2LroKXVfs3uXMRjUNqIvF8Zg9HN9qXVe8L/GGFOi6pDGcM+uimgYRsqdh V2ZTF27Utecys0W6LkGwIg+jtGd90p4FFfzZn/GYPRzfal1XvC/qhhzUdXF7 FtL2LGa3PPnTmVnQo1TLMT2t68J0TqHAr8uTXxdETy7u/oXTBvFTGD6AxNlr EGYPx/ecrstncwrH/brCuMH0c+AhGC9rm/iWI09CJM5ePZjtV6D5hp2+1Bv8 urD8Sm4p72IWbl3/OQyzF/l1LW/oeyxjHpnZ1xTTyBizxqyVJsyGjWt1XZOV gz+p69q+tIczu7HxUY0Mqu5sY7+ubqrwjroupI1O6brezOx5XZcMxCL9TSJ0 0q/rkcye9+tyWiOTM3vKr+sNzDbx61IDaY39usZi9h6/LvqnTteFypoLoiKK Xvl7E6mUMnubXxfFpU7X5ZU1Fy/GdZJkAfxYzN7j1wVhKLpO1wXKmis36hBb mVGZvc+vi2ZUqnRd+tAzow5E123Iq59fF5C9Q42uCxKfE5U2G93907SFzN7p 1+V5TpaCWpSHUdv1KOcUcDdO0x6vZ9Hd4NclJmYVui7qKngyhJDKl0yth2a2 Ir7Vui65BXSukjyMIBImdLrypXGgNzBb69dVpeuK6nvQV80ijpczW+zXVaPr Ut1nuQwlhHJvYbbYr6te1zVrz6JevDB4e7YJswf9uup1XbP2LOjFC0O1Z92N fl31uq583AB8FHuNP25QEt+zfl3Vuq7ZuEEI7KDjBv0KVG/ZG9ISZluH66o8 jFh7c4zZk1u+n9mr8jAOVg8MyuxrimlkjFlj1koTZsPGJ/Iwei+mydW6rs8H NNaLUfQxbdax/TBMHkagBTDuhK5rGoUJR/FRutMtsXhHXRc7x2N6D+TVMV2X GpBVK/lfwWwDvy4anoiTLvoHcVjXhSr/YJw8eySzJ/26OCfSGrPHdF2QhC8V 6Dyc2fO6Ls6JBCvMHtR1YRLRrE4ahNmoO1ImVwteTJhAg6V+XWG1bDxKma6L jKQgrMKliSDWLgSvqY4rlw7quo7E94xfFw3mRrzKdF1kKIZTRCm7krQIgdNd DsFs1B0l/iawGtNav67aPIxxRifkp/AkPgGWzEG3ZHZHmC2L7zm/ruo8jHFi MqRZwdBpYUpp1nGMejbRHbGfFL3ZNg8jOleZhxGS9GIYjSeUB9qozBbH96Rf V2UeRi2Rk+CrW8m3dQhmnZ4P384cLTGt8uvK1yeU67rQuVVmSfw0ZD1bGt96 vy5MmK3RdckBFpid/LoezGy5X5eirV7XtcrsyG2Dk8wW+HWhbhvU6rrWmB2n bXCC2TK/LpwzW6LrmtqsIulUzIJqz3aI6F3MHtF1gZszW6DrCm1WUSYrZjG2 Z++vGHZ0XZsxPanrQvHWkqMU6LrCfXI8bkCPqWnYm+RH3rlRxw1K4ntK1xVv j6vQdX380OjSvDRJwn2ToHdQfT5WI3PtMa5ltnW4rtJ1XXsMY3aw8gpd16DF NDJPZvY7izFrzH4Vs2HjYl3X1M730s9q4tc1WqOis64rTO+i9LOQ3kw3KfTr GuX31kHXBUIqRvngWb+uNzJ7QtclEzmg5INn/brewGylrktPAGArv643MntC 16UGU6GZX9fQzF7u14Vqhxq/LozmQSQ/6m4+XcLsHX5d8jSDujyMnFnMiYpu GA/1Ln5dMA380w6Vfl0OtYPUs+rZO/y6pviSH1qtXxckRmgD17M3+HWxyRae y8P4TGZv8utC58QPrT4P40OYddf7dSEzixIXV56HUfvPPKueLY1vha6L51wB dJ1emodR2sHvZLZA1wXaSKo6D+P3MntE14XaD606D+MXMHtQ14WpkVRdHsYo 60Z0vqeEqxOzm7ouyPzQNHvH8zCKrDv8KnCQiqGDXxeQPovnDSrzMAa1kVhH PWrcoCS+VbouH26IzBuguiHH8zBy15oc0Lob920x26/ApZuPwmzrcF2q6xoE 1NcwO24xXdfXMPuaYhoZY9aYtdKE2bDxGV1XmA6jN9NNjui60iEev3Bxj2Z2 Y+Pjui6aDnO1ui7dU8u6YZ1acn11XcqWpErXlY6iwcuYbaPrwiSxT7bJvq4L 0t2ezux5XReudH2P6rrQrYfw+cw20XWpScgqXRe49aiOxOxtuq6E2QpdF5KE JDRJxLFyABXSMLquhNkKXVcw8OTsFdF4taOYrq+uCyOlNboubkLHeLtRZhqH 0XUp5Gt0XWRRxxNuqWxnmHr2Tl2XV5TW6LrQxQndpzB7s65LI1+j62KXE513 bThm3a26LlUHV+i6IrPRzfoB9WxpfM/puhSlFbquyCyIKftbmK3SdeXZf0t1 XcLss9oGJ5kt03W5LIl1oa4rMjtw2+AEs8W6rnnG6jJd15zZUVRIw+i65onX y3Rdc2a7i+n66rpE3lWp60KXObcOo0IaR9fF8q5aXdcUf+WT219M9zaNTOfr P8Zs63Dd69fVXcdkuq4XMGu6LiuPYfY7y6XMwsZvHGab4OG64QE3vimzuBFY XAnsgRvy1IfaJrPoWHWlOjTxvzhJzGpsAYqZBcx0B/FKMiXDdtQxOT9uMoD5 hdG3PdOLO8Tsofi6BeHBPrM+0xbEz1R2hf1KAJLzw2aVBLMLo+tv3VPbYxZl jN8tAIPbzCKU1w+LzILTzMKBmqKeWR8zt5yoiI4yux9ftzCktPvTzwZPMfmm 86hcwCyoJEMnfvsVzAJJL8uZxQuY3SW1ntl48HRU/WJmd+MLFzC7S2o9s+qU yQTQtcyygodmv4FG/niGNIzQ8SDfdGvjDjR3S+KYaa6KPgNWBX2Sc3j5jP4g fUYnkjOAFzUR5VqUV6jmK1VWRie5FqYqk0YikxH3cJ3Td5WvKYd2WRaM9swW xjcJSQyeiijKH1YreR37zx8fhW+UT9HLlpTfQyIDADqfQogoDZrrCc0p6OFj OlE2Fn8nsxinp6a/GKdNVYIzz3MkTu2AED9DLQeiyZsQEpBEKPzHO506zcfp Gj1p61PZwWo+FpnLjHk2AJNGHIpFWJzljdLcq5kti29ogXpWt0bBoETUx6ih U1n++ESok9JxPsU4d7mWOojnumI9y5lqXAw6KgASNc3NzLp5TOUK0KmZbFpR A6LF4ACkd3/GrHNuLW765smENuQambAlQszjCrSQgTaHpG2gLilkGuVnnU4l eB+zRfGNd3/O7CwySq0UAxu1F1nQlRYvMqsm2lFVCqiqBnqAgTS9tFK3G7Nu NaaAMaZOf9UJXedTZlEz64MY6RP1kBcJNDZAc4RRJB4TKflMI8NvYrTz8Hrd TVweom2V4sw66jYkpxK8k9my+Co5zIdZumAt73JaKoiONG5RtMRz3JkOht6U lXe8eG+mMQVtnSQh8TLm4eQujcEsNw1RlmugTtvpEudjTKtNTOtZckMFmH0f zJoBwOpFWPhMhLSg82WjWreEq/UsXXDM6Ao96tmS+ELOLFeBSt6VMZs8wJxO pJgzC3k967SgCdbrWReraKfv4AjMQkTPxcR7HFN0eXt2oja0RL32jKIIozAL +o7wYzFtz1ILQD7z6gG6oOTaa8963Z6Vp5+kEtTM8uVdMtZVGF+qVZO2QWiG xcgo4zOM3Mf74uiY4HR7Vlt6oWrIbbdnIWnPQsospszKt8MbmGW5VehNU7LE kHgvPFt9GA4Pj14QXRfL4jzGVXTT7sh/pi9FraEZs5xgmwch6AFEJwPWdWGi NKJO6+K4ATW4phyC6bgB6LYBYCIZC82OkykGN5ktiG98YnlPweNfKjfOc2ZJ 4wYSGcff0Ek+RTpKFMU5DvrCuAEvVvXyVHAyWKPaBs6naRwn4sHfPKdQWXDl UNfMOKJreOnu0AWdYbbBhcyi1mICHBp98e2TGrOz08K51bbQbrHu45hNjunP raj11y7INV3XNcV0XcasMWtlnVk2x4L1x/BtCp43MjvNpfpNmbbFt4xZGbPb 6PDdpuB5I7MhUpuDvxbfcmZpKTZs1bOqGrhu9PiFzEaZ4zazFt/jzLrI7CxC tyt43srsSoZOi28ts5BNjaqY3q3geSOzZKO1NGNh8b2A2bsVPG9klqYD/YIn h8W3llmUueSlZQa3KnjeyGx0jF5i1uJbwyzJiKJpWxpTe3adZxZXxg0svpXM YjTgXmf2JgXPm5ldwM/iW8csm2OFRQjzmN6q4Hkhs2KjhcvMWnzLma0/lNUB h5i1+HZm1nv76V/JrMW3PbNWrmXWyt3Mml+X+XXdzSy+xa8ruSiUP3DdT+CV fl1JUVIzvPcn8B1+XUu/mzGYfZRf19K9hOGYfYlf1wqze3fsemaf5de1xuzx 23INs+/z64K4llelEmSJsHeXZGx8oV+Xl7W8KuslWZ9CmtjsbmZf59c1KVJU ApfIbDRUuZHZx/p1ZReftA1uzbz0BX5d2THT9ize3TZ4rl9XdsyEWejbNnBv 8+tK879lzM6Swd3A7EP9uhyuM+v8QMy+wK9rk9lzrlznmX2QX9cms3dqzr7A rytUA1vt2Qui/UK/Lkju9VJ7Fjsy+y6/rmzcQLJHsnHVJRkbX+jXlY4biPm3 F7OzbuMGDY6JK4fq6Nd1Uw1wgNniI43k1zXGbO+X+HUZs3vMJsdck5O9l1kr pusyZo1ZKxvMqrmVKsFxaJ5/HtJqd14gHbsfUsKWmO1A3YHYbQqvvHzswwUi DSOC5/lDnB1aJ1JKrtN5vXwoXDh6/u68A0cCuPfn0+QM9KaXXt50ndvrbvfj S1/bh1DKNcrQUsxwr0Iy9Yf0DtQ7lWujqPHnIIF1ckk0ne3nh9Y2Icl1Arrk lGEHHmh38muFOAL82cSnyRnoTa+mtlcaemt+XYCANXWCmmFRuyPEBdLZktP4 ZtpOQ4w+THoCjGsrGUYDXtqO+QpsGZKA+ehhNunjZMxLn1ZdS0wfgPpgyZt6 6GiT2QPxjRN+oC+aLnGWI0K9mbZuOTKzCbA09hwL1IvZs0PDkmPTLL7AK2Ah u9d0k2HJSid9MxtNO8AsT1OfZBZmCJYym0xQ+JxZgXUamM2nO/NbssjsYkxn O8SLxxmz6ZvHmD0WX2EWcwSLmdXzuoA5sxCnk9Xgay7RW13hvh2u1fhmzKZv VjMLWMusU2m3Vph1+8wm4oWDzKbVbMrswnV2ZXYnviiwbDDr9pnl21/EbDZA kCA4v84BmAWJaZW4zAsQqjm7xayXBmmyA81gS9sgeS7R2DtzQtM8mDPrsZBZ jwvMxkYugRRbezXMHosvfxnQzdYtZqUdnu7AEgZmNmkm0UwAc0Kzjj5n1vtC ZpMdUI7iY3xJX9WKWYckraiqZ5m15ClCkpfVepbmaOb1LOeY4RlNXQtxtpnP zA59x+xrxjmhz+SPWzitz/oIEeS0D4byHbJ6Nr7pPR5szx6LL4l3kq9EkpfV epbmz2b1LF1baGRm9ax4Kfhpin1S1S4tAaJNPLqF0y6Ei9ibxZdlO0k9q96k 3nchs4BrldOxEiccD7cNwC0wC1HnJvrZvG3A0+Ig7niLh15sz2bXkrcNXGHb INUHbTB7ML4Q578Ptw1wgVl5U+lnZ20DVmkgB23x0IvtWbcRrtX4brQN8HZm 4RCzmMODa+MGBcziIrP5MEByhpbMOmzJLB5hdtYHgxmzEN88yCwsMwtuuw/W jFmoYdY1YHYJweKxLkiYXRzrcsr+aqN7h+j8PrPpWFcxs8fHuo4zi2XMLo4b yOVvjHU5rcxb7d7B3DV3gdlsrKuU2ar2rOzUbE6B5ceeRUwLYC3OKTin5hSS PpjP201LcwoxpioP4+wMyYXzqHrKrMxh+Dmz6k214uwIs8VzCipOszkFTMIc j8JExTkF3QfzmDfjF+YU1G9k5pqrzqAv3PMNSZmVOQycMxvfzFac7TPrrLQo Nnd7XTFmjVlj1ooxa8was1b2mY0tcGUTElr2uPBRXkSmhbyrpJp3pHuSLem0 6Q7tCimyABf6YCFtH2bfZ7bYRvcH/dG+6TazG/FVBVimpeVs0WdEhwvVGmS4 wABUun6z5Q3sFpKbf31i6LMtY39QumLtmF0ytJGVsrvMgpIdyJao3ssx4ZnK S2TwQXcEa7qu2OX1vHk6PqlHxcAdHQPcZnYjvqpglB3onXG+vQbkooXENKeW f3lxY9HyzFALZcPlmKhCcD1jYhdmcYPZpZsgo1aXMBt+3fm4opAYNQ6JKU26 pY/M4m3MwnK4IK0YOH4AGenNf/pTKL1bYRbVtbjlAWSQ4PHi6lbMkttTGCcj 1XVYixmgi9pmGjYGv8BsMr4W3CNwm1m8hln+Km6RWT1/Dml1ABcxuxPflBLv MRmWjq9gPkmbkt6+mnULWSDI+0bHF5M6IRmDvYjZzJII5GROVm/L9WD8LPl6 IslQt52Xyic3gZd3Ozala1/ya4koZ/MUW8zysy8Io440F7fXKWzEV10i+Nn0 H7Bh7ZKwgL7vJczy7Zkd2i/9ftaYVa45CFDbe1n0N4iuDcrEhMRLyKKrRJmZ fY3Um5eOi/IZpltqo6pN/Pa/5MImsOwj5xEzY7SEWVAaekfKMZqR1PXs6iUd yXc7j2964ag8xVxei64xu9+ePWBguLQJLrbeYH6NmlnVNSCjJ2YWkgUYRb3G LWZZwprogMnDAcNPb003MWcWExeeZEtC6qo+GCw+1Lie88vMukz8GwV0cK5t sBffhM91ZjNTtxJmKwutfFsiGZ2Ob8IsYMIsxD6Yb9o2iAIG1DFFfU9xU58G 87bBFrM+nwhvGWnSgy/ruuZjXcv17DXMLsV3fokO88BuMIvXMCumdEv102SK BIfq2cuYRbk3LBJWEdLtWZhOjceZxSVmUZ32CmbDiNaM2enyAVJmkce6cu1W s7GuvfgeYTY6y2XM4pXMQhjsWoivS+KLvHm+RvS6sS7yYpq0/Rhk7Ki8RZDd pZD0UvNxg7kuh1RIkDptO34zdqfbB5uWk888uXhZSWwDBPMv5122akrWrWOT OYWd+OpLXArXNBeCGbPeK++yS9oG5MTqFu51WAeC6lpcCHraeZF16/6aOYXC n2BBrXf0zU6l2bVcOncLl1/+VRfYpNzL7PcU0xuMzOzwBXok4Hwhs/6SZCmj MXu3pd/qVdz/LHhhHkYc5Rf3BXkYx2X2UHydGyQP42OYxVRMlAGD28wilNcP i8ymiQ/gQE0xHrMYSnF8nRskD+NTmH1DHsYxmIWpFMcXLmB2l9RnMPvrR6rG 9+Vh7MLsT8Lsn/hSPfvcPIzjMPtrYvYnMotvy8PYhdmflNmfH65nn5uHcRxm f0Lb4Jcw696Wh7FPPevStsEvqWeL4uvkszmzs8go7193QR7GcZh1v96eh7EP s79W2rPF8c1y2vXLwzgQs6/PwzjWuEFhfCFnlum5Pw/jOMy+Pw/jWOMGhfEd KA/j2My+LA/jcPXsM/Mwjstsg2PiyqGumXFEt3Pp447PHio3TYDD7p0YkNmF eZpHMKuPuSjJHEQjUxvfu0Uby1peN6JGproesHKIWYtve2Yb1rNWWtazVlaZ tXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2Z tXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2Z tXrgWmYtvu2ZtXrgWmYtvu2ZtXrgWmYtvu2ZpdcW04uYtfi2Z/bHSssyY9ZC 0q4Qs0kdYT/lurp1o561+J6sWxfq2X9i+fuv3/9YKS9J3P6dMWvxPVd+dAR/ k/eRfq7Z06euPZC8yryPLL7nyq/k1SymVlqUdWatnC7/smLFihUrVqxYsWLF ihUrVqxYsWLFihUrVqxYsdK3/B94LJmEb+oTcAAAAABJRU5ErkJggg== --951801389-1707386074-1668188565=:29479-- From nobody Fri Nov 11 20:02:19 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N88l52vl0z4frmw for ; Fri, 11 Nov 2022 20:02:57 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-yw1-x1132.google.com (mail-yw1-x1132.google.com [IPv6:2607:f8b0:4864:20::1132]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N88l43nLtz4J0M for ; Fri, 11 Nov 2022 20:02:56 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1132.google.com with SMTP id 00721157ae682-3704852322fso53077377b3.8 for ; Fri, 11 Nov 2022 12:02:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=7pqxBKwTBI6APTQkWcsnzTCkRERpj4PG0ICAWP/56WI=; b=WTzh2qBdIlFe36W7VoWg9QEex9Ysd1LHesg21W8b36I2+0n/jDK2s1vNvvaDQkSYY6 vSvzFUtSy0NbPCDgATcxxNqC2hp7zwBPzG3E1svZb+PfUFOTMCMSZRyBekmGGUZ/6cv0 DhUbMkGRzwY5zmUXaz5zdLl812qezFs9qR5NnJeGJvxga0K5P7kvLb41XsFtJG+Vn35+ gpn5hvXeE3QRM3deNvvk6xqk9M3EP5pTGQ+OYrNqwTIz+qjrR+d3g4Vu4KNoERqgld0f uqmGEr/WH+rHOY4Lqqdo4OVc+A1r0G41ekxMXChDBKN87qGX/JX+s14AAPAmsRg4T2Hy 62Mg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=7pqxBKwTBI6APTQkWcsnzTCkRERpj4PG0ICAWP/56WI=; b=Z4HmmMZGraJ9SAc6hQ3bYGa3ec/TPDF3IkvitMdBXrPRQ+lsZdQktjq6bkRL+z2z5y njHl7B+m3WL/F8IYhG+drlyqakXnP5V+p04ajlLsQ/rbzBzlAhMcw2CscimXEKwaAX2i hEaa/L5wUM4w8j2EhqGe5Qj6yWqvE/+jzV8Nwh6KNjDisjr42uLjQiWmvd8dq4qUemqh rNNRqnT4o3iZ2tA5oloVKjqkKodZxGonC42pjRfoRr8Rj698fefJRF6CeVDe3Ndj55Y2 Ds1gH7H4tayhCQPkOHJUFzeYQqwQEd4aQ6cqcpofZjgQJInM4JYHJqxX0LKPYi1RdKRp 2WlQ== X-Gm-Message-State: ANoB5pmeIiM8kcb6m52J7twr94sHJWaKpBCVEL2L5QQj+5O2iLKkVFel amuft2yY0rmCuT2704VykAk7M18dKpLwySEy3/N3+Nzu X-Google-Smtp-Source: AA0mqf6k3nRVZMD8iwXufnmHeAF/picmHcrxU6z9OtRbPccWdPJSOFjo4w683+bZ+UbzbRiKvFp/kDDEx8De2I5Jx7M= X-Received: by 2002:a81:a52:0:b0:356:dca3:de35 with SMTP id 79-20020a810a52000000b00356dca3de35mr3359488ywk.12.1668196975685; Fri, 11 Nov 2022 12:02:55 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mehmet Erol Sanliturk Date: Fri, 11 Nov 2022 23:02:19 +0300 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: andy thomas Cc: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="00000000000026b43905ed376002" X-Rspamd-Queue-Id: 4N88l43nLtz4J0M X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --00000000000026b43905ed376002 Content-Type: text/plain; charset="UTF-8" , Nov 11, 2022 at 8:42 PM andy thomas wrote: > I have two identical servers, called clustor2 and clustor-backup, each > with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and two > SSDs for the ZIL and ARC functions. clustor2 stores user data from a > HPC while clustor2-backup uses rsync to mirrors all the data from clustor2 > every 24 hours. > > However, the disk usage on the mirror server is considerably more than on > the other server - attached is a screenshot showing the two servers side > by side, with the mirror server on the right, and displaying the contents > of the same subdirectory choen at random (named 'ratio_10.0' in this > instance); as you can see, the sizes of the files within each of the > folders are identical but 'du' reports very different > space usages for each folder and 'zpool list' also reports a significant > difference in ZFS pool size. > > I'm not sure if this is relevant but both servers have ZFS pools with no > compression although lz4 compression is enabled on the ZFS filesystems & > both run FreeBSD 11.3 with ZFS version 5. > > Perhaps using zfs send/receive instead of rsync for mirroring might solve > this disparity? > > Thanks in advance for any suggestions, > > Andy Your question I am understanding the following points . I am using rsync in Fedora Linux . There are parameters of rsync such as --delete to delete files from the destination drive when they do not exist in the source drive . Please carefully scan rsync parameters and use suitable ones for your application . If a parameter like --delete is not used , rsync copies new files from the source drive and it does not delete any files from the destination drive . With my best wishes for all . Mehmet Erol Sanliturk --00000000000026b43905ed376002 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

, Nov 11= , 2022 at 8:42 PM andy thomas <andy@time-domain.co.uk> wrote:
I have two identical servers, call= ed clustor2 and clustor-backup, each
with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and two =
SSDs for the ZIL and ARC functions. clustor2 stores user data from a
HPC while clustor2-backup uses rsync to mirrors all the data from clustor2 =
every 24 hours.

However, the disk usage on the mirror server is considerably more than on <= br> the other server - attached is a screenshot showing the two servers side by side, with the mirror server on the right, and displaying the contents <= br> of the same subdirectory choen at random (named 'ratio_10.0' in thi= s
instance); as you can see, the sizes of the files within each of the
folders are identical but 'du' reports very different
space usages for each folder and 'zpool list' also reports a signif= icant
difference in ZFS pool size.

I'm not sure if this is relevant but both servers have ZFS pools with n= o
compression although lz4 compression is enabled on the ZFS filesystems &= ;
both run FreeBSD 11.3 with ZFS version 5.

Perhaps using zfs send/receive instead of rsync for mirroring might solve <= br> this disparity?

Thanks in advance for any suggestions,

Andy



Your question I am understanding the following points .



I am using=C2=A0 rsync=C2=A0 in = Fedora Linux .

There are=C2=A0 parameter= s of=C2=A0 rsync=C2=A0 such as

=C2=A0--delete

to delet= e files from the destination drive when they do not exist in the source dri= ve .


Please carefull= y scan=C2=A0 rsync=C2=A0 parameters and use suitable ones for your applicat= ion .


If=C2=A0 a par= ameter like=C2=A0 --delete=C2=A0 is not used , rsync=C2=A0 copies new files= from the source drive and
it does not delete any files from= the destination drive .


With my best wishes for all .


<= /div>
Mehmet Erol Sanliturk






=C2=A0
--00000000000026b43905ed376002-- From nobody Fri Nov 11 20:20:37 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N897Y5lBRz4fvSS for ; Fri, 11 Nov 2022 20:20:41 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N897X2s9Gz4NQf for ; Fri, 11 Nov 2022 20:20:40 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of andy@time-domain.co.uk designates 62.3.122.138 as permitted sender) smtp.mailfrom=andy@time-domain.co.uk; dmarc=none Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2ABKKbIC030680; Fri, 11 Nov 2022 20:20:37 GMT (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2ABKKbt1030677; Fri, 11 Nov 2022 20:20:37 GMT (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Fri, 11 Nov 2022 20:20:37 +0000 (GMT) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: Mehmet Erol Sanliturk cc: andy thomas , freebsd-fs@freebsd.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="951801389-1876059679-1668198037=:30520" X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.30 / 15.00]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip4:62.3.122.136/29:c]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[andy]; TO_DN_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; HAS_XAW(0.00)[]; TAGGED_RCPT(0.00)[]; DMARC_NA(0.00)[time-domain.co.uk]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4N897X2s9Gz4NQf X-ThisMailContainsUnwantedMimeParts: N This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --951801389-1876059679-1668198037=:30520 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8BIT Yes, I can confirm the rsync --delete option is being used and in fact, 'du' reports some of the mirrored folders as having identical sizes on both servers, mainly those containing only small amounts of data. It seems almost as if ZFS is not freeing up blocks when rsync has deleted or shrank files, leaving unwanted blocks lurking around in the folder that 'du' then discovers and adds to its tally when it works out the space usage of that folder! I suppose I could always destroy the zfs dataset on the mirror server & resync the whole thing but will take days to complete even over a 10 Gbit/s network link (the servers ought to be upgraded to FBSD 13.1 as well). Andy On Fri, 11 Nov 2022, Mehmet Erol Sanliturk wrote: > > , Nov 11, 2022 at 8:42 PM andy thomas wrote: > I have two identical servers, called clustor2 and > clustor-backup, each > with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one > spare and two > SSDs for the ZIL and ARC functions. clustor2 stores user data > from a > HPC while clustor2-backup uses rsync to mirrors all the data > from clustor2 > every 24 hours. > > However, the disk usage on the mirror server is considerably > more than on > the other server - attached is a screenshot showing the two > servers side > by side, with the mirror server on the right, and displaying the > contents > of the same subdirectory choen at random (named 'ratio_10.0' in > this > instance); as you can see, the sizes of the files within each of > the > folders are identical but 'du' reports very different > space usages for each folder and 'zpool list' also reports a > significant > difference in ZFS pool size. > > I'm not sure if this is relevant but both servers have ZFS pools > with no > compression although lz4 compression is enabled on the ZFS > filesystems & > both run FreeBSD 11.3 with ZFS version 5. > > Perhaps using zfs send/receive instead of rsync for mirroring > might solve > this disparity? > > Thanks in advance for any suggestions, > > Andy > > > > > Your question I am understanding the following points . > > > > I am using  rsync  in Fedora Linux . > > There are  parameters of  rsync  such as > >  --delete > > to delete files from the destination drive when they do not exist in the > source drive . > > > Please carefully scan  rsync  parameters and use suitable ones for your > application . > > > If  a parameter like  --delete  is not used , rsync  copies new files from > the source drive and > it does not delete any files from the destination drive . > > > With my best wishes for all . > > > Mehmet Erol Sanliturk > > > > > > >   > > ---------------------------- Andy Thomas, Time Domain Systems Tel: +44 (0)7866 556626 http://www.time-domain.co.uk --951801389-1876059679-1668198037=:30520-- From nobody Fri Nov 11 20:51:06 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N89pp3Zzsz4g1XW for ; Fri, 11 Nov 2022 20:51:14 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N89pp15s5z4TrV for ; Fri, 11 Nov 2022 20:51:14 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Authentication-Results: mx1.freebsd.org; none Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id 2ABKp6Qw007917; Fri, 11 Nov 2022 14:51:06 -0600 (CST) Date: Fri, 11 Nov 2022 14:51:06 -0600 (CST) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: andy thomas cc: freebsd-fs@FreeBSD.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.20 (GSO 67 2015-01-07) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Fri, 11 Nov 2022 14:51:06 -0600 (CST) X-Rspamd-Queue-Id: 4N89pp15s5z4TrV X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US] X-ThisMailContainsUnwantedMimeParts: N On Fri, 11 Nov 2022, andy thomas wrote: > > It seems almost as if ZFS is not freeing up blocks when rsync has deleted or > shrank files, leaving unwanted blocks lurking around in the folder that 'du' > then discovers and adds to its tally when it works out the space usage of > that folder! This would be completely expected behavior if zfs snapshots are used. The rsync block sizes can be adjusted to be a better match for zfs block sizes (e.g. 128k). For example, zfs will do a 'sync' to write new data to disk and it will help if all of the data in an new/updated zfs block is provided at the time of the 'sync' (rather than 1/4 or 1/2 of the block). Network buffering can also be a factor since it effects the timing of data delivery to the backup server. If the sending side tends to stall, then add more buffering. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt From nobody Fri Nov 11 20:51:34 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N89qx6st3z4g1wm for ; Fri, 11 Nov 2022 20:52:13 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N89qx1dkGz4VLx for ; Fri, 11 Nov 2022 20:52:13 +0000 (UTC) (envelope-from karl@denninger.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net; dmarc=pass (policy=none) header.from=denninger.net Received: from denninger.net (097-081-026-048.res.spectrum.com [97.81.26.48]) by colo1.denninger.net (Postfix) with ESMTP id 803A62110B3 for ; Fri, 11 Nov 2022 15:51:37 -0500 (EST) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 3AB702401DC for ; Fri, 11 Nov 2022 15:51:37 -0500 (EST) Message-ID: Date: Fri, 11 Nov 2022 15:51:34 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.4.2 Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync Content-Language: en-US To: freebsd-fs@freebsd.org References: From: Karl Denninger In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms090109010601050609040103" X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.90 / 15.00]; SIGNED_SMIME(-2.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; FREEFALL_USER(0.00)[karl]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4N89qx1dkGz4VLx X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms090109010601050609040103 Content-Type: multipart/alternative; boundary="------------z7dqCKJCEbxiqibeBbpS56ey" --------------z7dqCKJCEbxiqibeBbpS56ey Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Are you sure there are no snapshots that are holding blocks?  If so those become copy-on write and will not be released even if the alleged file is deleted, as the snapshot copy is still there and valid. On 11/11/2022 15:20, andy thomas wrote: > Yes, I can confirm the rsync --delete option is being used and in > fact, 'du' reports some of the mirrored folders as having identical > sizes on both servers, mainly those containing only small amounts of > data. > > It seems almost as if ZFS is not freeing up blocks when rsync has > deleted or shrank files, leaving unwanted blocks lurking around in the > folder that 'du' then discovers and adds to its tally when it works > out the space usage of that folder! > > I suppose I could always destroy the zfs dataset on the mirror server > & resync the whole thing but will take days to complete even over a 10 > Gbit/s network link (the servers ought to be upgraded to FBSD 13.1 as > well). > > Andy > > On Fri, 11 Nov 2022, Mehmet Erol Sanliturk wrote: > >> >> , Nov 11, 2022 at 8:42 PM andy thomas wrote: >>       I have two identical servers, called clustor2 and >>       clustor-backup, each >>       with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one >>       spare and two >>       SSDs for the ZIL and ARC functions. clustor2 stores user data >>       from a >>       HPC while clustor2-backup uses rsync to mirrors all the data >>       from clustor2 >>       every 24 hours. >> >>       However, the disk usage on the mirror server is considerably >>       more than on >>       the other server - attached is a screenshot showing the two >>       servers side >>       by side, with the mirror server on the right, and displaying the >>       contents >>       of the same subdirectory choen at random (named 'ratio_10.0' in >>       this >>       instance); as you can see, the sizes of the files within each of >>       the >>       folders are identical but 'du' reports very different >>       space usages for each folder and 'zpool list' also reports a >>       significant >>       difference in ZFS pool size. >> >>       I'm not sure if this is relevant but both servers have ZFS pools >>       with no >>       compression although lz4 compression is enabled on the ZFS >>       filesystems & >>       both run FreeBSD 11.3 with ZFS version 5. >> >>       Perhaps using zfs send/receive instead of rsync for mirroring >>       might solve >>       this disparity? >> >>       Thanks in advance for any suggestions, >> >>       Andy >> >> >> >> >> Your question I am understanding the following points . >> >> >> >> I am using  rsync  in Fedora Linux . >> >> There are  parameters of  rsync  such as >> >>  --delete >> >> to delete files from the destination drive when they do not exist in the >> source drive . >> >> >> Please carefully scan  rsync  parameters and use suitable ones for your >> application . >> >> >> If  a parameter like  --delete  is not used , rsync  copies new files >> from >> the source drive and >> it does not delete any files from the destination drive . >> >> >> With my best wishes for all . >> >> >> Mehmet Erol Sanliturk >> >> >> >> >> >> >> >> >> > > > ---------------------------- > Andy Thomas, > Time Domain Systems > > Tel: +44 (0)7866 556626 > http://www.time-domain.co.uk -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------z7dqCKJCEbxiqibeBbpS56ey Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
Are you sure there are no snapshots that are holding blocks?  If so those become copy-on write and will not be released even if the alleged file is deleted, as the snapshot copy is still there and valid.

On 11/11/2022 15:20, andy thomas wrote:
Yes, I can confirm the rsync --delete option is being used and in fact, 'du' reports some of the mirrored folders as having identical sizes on both servers, mainly those containing only small amounts of data.

It seems almost as if ZFS is not freeing up blocks when rsync has deleted or shrank files, leaving unwanted blocks lurking around in the folder that 'du' then discovers and adds to its tally when it works out the space usage of that folder!

I suppose I could always destroy the zfs dataset on the mirror server & resync the whole thing but will take days to complete even over a 10 Gbit/s network link (the servers ought to be upgraded to FBSD 13.1 as well).

Andy

On Fri, 11 Nov 2022, Mehmet Erol Sanliturk wrote:


, Nov 11, 2022 at 8:42 PM andy thomas <andy@time-domain.co.uk> wrote:
      I have two identical servers, called clustor2 and
      clustor-backup, each
      with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one
      spare and two
      SSDs for the ZIL and ARC functions. clustor2 stores user data
      from a
      HPC while clustor2-backup uses rsync to mirrors all the data
      from clustor2
      every 24 hours.

      However, the disk usage on the mirror server is considerably
      more than on
      the other server - attached is a screenshot showing the two
      servers side
      by side, with the mirror server on the right, and displaying the
      contents
      of the same subdirectory choen at random (named 'ratio_10.0' in
      this
      instance); as you can see, the sizes of the files within each of
      the
      folders are identical but 'du' reports very different
      space usages for each folder and 'zpool list' also reports a
      significant
      difference in ZFS pool size.

      I'm not sure if this is relevant but both servers have ZFS pools
      with no
      compression although lz4 compression is enabled on the ZFS
      filesystems &
      both run FreeBSD 11.3 with ZFS version 5.

      Perhaps using zfs send/receive instead of rsync for mirroring
      might solve
      this disparity?

      Thanks in advance for any suggestions,

      Andy




Your question I am understanding the following points .



I am using  rsync  in Fedora Linux .

There are  parameters of  rsync  such as

 --delete

to delete files from the destination drive when they do not exist in the
source drive .


Please carefully scan  rsync  parameters and use suitable ones for your
application .


If  a parameter like  --delete  is not used , rsync  copies new files from
the source drive and
it does not delete any files from the destination drive .


With my best wishes for all .


Mehmet Erol Sanliturk






 




----------------------------
Andy Thomas,
Time Domain Systems

Tel: +44 (0)7866 556626
http://www.time-domain.co.uk
--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------z7dqCKJCEbxiqibeBbpS56ey-- --------------ms090109010601050609040103 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B 3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5 CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY 2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5 c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj 7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn 3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6 Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g 3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG 7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c 5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yMjExMTEyMDUxMzZaME8GCSqGSIb3DQEJBDFCBEA/aEwGb1WkRbxbkwED 4PCY20yiklgu5Qn+ldj0I+B3pL1/3TQ7Y65C0DNT+lFnTlJDvy5ywbyA81DUFuFl8/iEMGwG CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgCwXofq7rIRqEafdvtgPTU3DtGLsqZBnDDMaLv3 3xbaYhNZV2PJ2/XQAykMSC9OS6jTkrtNP882Z2SENU8paLyBmAjOzxLKIhPjxfb3kIHpMUED 3VmM2iZHQZhdHXhdkRjeSTdE1CizYdtzu404KLk116p18TnMAZm3gdSR+W9vGPfc8YhgsJZG MWx2g8iy5j6K43Um6J7Cj+JLBaTnSYssKqj144B5sWtjyxGTDOX/+lFAIrMm0/i0JPNIHuCf n9IUqpJVKT1FVjBEYnP7nRl0OwX0bxP2vHqFx77LBl57/rsRhW6Mr7syzvdI8KxzXv+U+Pyd 5/VovPSAYopYYu2IXHVrXq8ltLuRFVThM23rILOHJWVfLMWJRwcVOyxlbNHTqeMdPeHOWLBM Gx1/tfZORn+8RTkBozyy0AbqAOlb8o4R12fzGze9JclXnBkYLLADXsiPp5lZN33EwtmiI8ci Jhz+FftV0ZwhF2mSCW0E1H7/uww+aNR0I1EF7EWQUhvj7ertQ5FNKUBNYNvhp7Yywj1T5d5X I/cJ83HSkw/GTA/YFaP1KUdP49HGj3AoucR8egNItfw8Z0GxgC6ZaCJ5Tag27L+IIWSd4UGH EJjZaCruX18qUNajEgEqNOWHzmHxzDFEBux8z4p31gWN85LQ63OQsinfPH9Ba5MRFuaW1QAA AAAAAA== --------------ms090109010601050609040103-- From nobody Sat Nov 12 08:24:27 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8TBl24NVz4g55y for ; Sat, 12 Nov 2022 08:24:31 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N8TBk5npDz3GVn for ; Sat, 12 Nov 2022 08:24:30 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Authentication-Results: mx1.freebsd.org; none Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2AC8OSGM039820; Sat, 12 Nov 2022 08:24:28 GMT (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2AC8OSRb039817; Sat, 12 Nov 2022 08:24:28 GMT (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Sat, 12 Nov 2022 08:24:27 +0000 (GMT) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: Bob Friesenhahn cc: andy thomas , freebsd-fs@FreeBSD.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4N8TBk5npDz3GVn X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB] X-ThisMailContainsUnwantedMimeParts: N Thank you for the suggestions, I'll set up a pair of test servers and experiment with adjusting the rsync block size to match the 128k ZFS record size, noting disk usage on both for varying file sizes. Buffering could well be an issue here with data on the server being mirrrored contantly changing within the HPC it supports (30 Linux compute nodes with up to 700 simultaneous user jobs) and this might be something I will just have to live with. Andy On Fri, 11 Nov 2022, Bob Friesenhahn wrote: > On Fri, 11 Nov 2022, andy thomas wrote: >> >> It seems almost as if ZFS is not freeing up blocks when rsync has deleted >> or shrank files, leaving unwanted blocks lurking around in the folder that >> 'du' then discovers and adds to its tally when it works out the space usage >> of that folder! > > This would be completely expected behavior if zfs snapshots are used. > > The rsync block sizes can be adjusted to be a better match for zfs block > sizes (e.g. 128k). For example, zfs will do a 'sync' to write new data to > disk and it will help if all of the data in an new/updated zfs block is > provided at the time of the 'sync' (rather than 1/4 or 1/2 of the block). > > Network buffering can also be a factor since it effects the timing of data > delivery to the backup server. If the sending side tends to stall, then add > more buffering. > > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt > > ---------------------------- Andy Thomas, Time Domain Systems Tel: +44 (0)7866 556626 http://www.time-domain.co.uk From nobody Sat Nov 12 09:37:18 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8Vpt3Gnxz4gKDp for ; Sat, 12 Nov 2022 09:37:26 +0000 (UTC) (envelope-from kisscoolandthegangbang@hotmail.fr) Received: from EUR05-AM6-obe.outbound.protection.outlook.com (mail-am6eur05olkn2058.outbound.protection.outlook.com [40.92.91.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N8Vps3Fdwz3LgJ for ; Sat, 12 Nov 2022 09:37:25 +0000 (UTC) (envelope-from kisscoolandthegangbang@hotmail.fr) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of kisscoolandthegangbang@hotmail.fr designates 40.92.91.58 as permitted sender) smtp.mailfrom=kisscoolandthegangbang@hotmail.fr; dmarc=pass (policy=none) header.from=hotmail.fr; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mgmHpYDZZMtIRsu5OektaCYNvWJgWPuaxWcMqhYJ1PE1rLLLckcyrhU9yZ6PqlE+Y0SI0UYvPyV0JbqxjcF3e5f4w1p1tnxQZVK+nn6J3OmnqNo5yQpSrfMRJWJsasiRNZIPtQzV2WA75PBG0mqrcRo601q+eBNR2UIh9t3+fxBhI/hCmc/Uulxu7zVKXeuTgqCir+5IkCNp9XOTfNlCyw/zJYpKiJrEE46Np+xiFbdZXb1toJDmqI/EKtpG9LvncUrb9uYDPanpLkDM51I1rxYQVVEJgyCV1Th4m8yKfbtE5hcaTcM03YaUvhAu26FVgPUzvV++jM6QdTn3+iVLHQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=DJPRdSR/5SlCLPLimx5IsXaqu4stORJemJuSNgZLG20=; b=cgkRLy60YtezHrDfHLFxX3lrU2/yEee0D6MhR01FO4Kg17VV7LzfV32Woc4Fr8F4bQVKq30I3iuib+LTFgeeXFaDdveP/D4CtEQXwHePNPVZqxHp6EydVbn7i8EPtFbHSbg8c50Z14Hvo6pJ0gxI3eB9MnIILHc3DB8lAGbUmw3ENVw1paP18JONX6p9wGuTrDY/r0aeTyuiJNZs4E8H96zlwyB/iS3BO2FRTRIzU4AMBfqzOkhCwsQ6CtOvKu9OfgTDXFFjSM2rEAcX7SDt438+NeLCL/KXCZHFTjI35Hcd+AsG20SO5hnYK3kudYcAA1+8WciIx5tdjtIRVAwkzQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none Received: from HE1PR0402MB3452.eurprd04.prod.outlook.com (2603:10a6:7:82::29) by AS8PR04MB8449.eurprd04.prod.outlook.com (2603:10a6:20b:344::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5813.13; Sat, 12 Nov 2022 09:37:23 +0000 Received: from HE1PR0402MB3452.eurprd04.prod.outlook.com ([fe80::aa73:c2c4:a8d2:daad]) by HE1PR0402MB3452.eurprd04.prod.outlook.com ([fe80::aa73:c2c4:a8d2:daad%5]) with mapi id 15.20.5813.013; Sat, 12 Nov 2022 09:37:23 +0000 Date: Sat, 12 Nov 2022 10:37:18 +0100 From: kaycee gb To: freebsd-fs@freebsd.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync Message-ID: In-Reply-To: References: X-Mailer: Claws Mail 3.17.6 (GTK+ 2.24.31; x86_64-slackware-linux-gnu) Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-TMN: [tO6JH/kRRQgeY8HWf1xE8ZNgwLqNnCSo] X-ClientProxiedBy: AM3PR05CA0088.eurprd05.prod.outlook.com (2603:10a6:207:1::14) To HE1PR0402MB3452.eurprd04.prod.outlook.com (2603:10a6:7:82::29) X-Microsoft-Original-Message-ID: <20221112103718.0ed4cdd2@slackstro.home.lan> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: HE1PR0402MB3452:EE_|AS8PR04MB8449:EE_ X-MS-Office365-Filtering-Correlation-Id: 7d6bb773-6935-4ac4-f7e8-08dac4917ff6 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: DJRvDEiAuOqYA68+z7Lav2zlpGbFZvaA8/6gVK4vQco6rBAV0phYCz3Xuod0GsNN7PP4ruxD8LTYRrWs6zEBxEQcXbZHAqCN2LslOoA4KcULg2ngHf4l2Kvuc0CYnCefnd38QfmSFan5zGj/aEO7E0E5r3CAtHZBJR9C2G30BBi93dLJuxJX/T5b/2WhUaiHh9Sn0QVn1y9QASH9g/iLpyF/lpCyCtiN7q+L5LhmSKFtvCK6d5rvFfmSPwgQmOma8LZ1qpJwNmY2ABk3fBMXNt9MO1B69fgwBgH1ptd5sOTkS861biz2tfnQzSa6u79syUDNaZoHDI7JkxZrOFOSxwdd/cHosBlxnYc7CdncJY2m+1IeWk78R0JZcAsaYu3DYh29EaHpF6In5XfyZVgvlGRpH65xBPadNaeJaO10lXinzcoSwxpXZZZXHJGZxOA4cdTBixBsJmIY+KIXXZbTZl4NyymZEhiTrEWyyASVZioEIQfZSNgQSEmTvegtdrJ0KfhhHlGmjM3SuV82Zjk5BKnKlYXBDLt0SbFD8QiDi1GF0YNcfPlJ4bYmB4BdPFBjfcsbJ74CY3sCrvGxha8Aq76bbnlnuw1yAeRUbVaH8aak7tJPaKwE7q1BQxK9CXmfKxAVNtgThZqp/MZ5IFe5AnTlcShJweK3UD0QhedKWpYNDcVNIV4NuAdaLMepwU64 X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NFdOSXZFOUtVeDJLRDJDbkhMaWs4Tkh5KzZncytNd0d6UmdzRm01Q01ONXlm?= =?utf-8?B?SzNMbkxPaW5sZlVMWGxIb0pld0Q5RndzWDRENFFHbGZCSWh0cksxVmhZem4y?= =?utf-8?B?TTJWV2VCSS84Z1M2cnl3RXRXblE4VnVCOExieWZ2WkRuQmFTMEFJUytnZm9R?= =?utf-8?B?T3VseE5jNEs2THNJWXdaY0d0eU8wYStkVldqN1M3UG1YcTNXeTlRRXlhdmZP?= =?utf-8?B?RTBoREIzZ3ZMMGdoTjl4YjJqWmVKQ3RYdzE1MWdnNy9YU0ZGdDNNMDBpTDZo?= =?utf-8?B?aTZzdWk5U2VQeDhNd3BleEcrVUtlc25IekFKLzBlbFVNSW1kVDRJMjNzTWxs?= =?utf-8?B?eUN1QTg5SDFuRm1RcDc0NXRkeisxeWZWSTZxcktOMXdCNm1oYVdlSVF3RDh0?= =?utf-8?B?Y2FUcjNvUjNnMDEveURZWHVlaSsycWR3NEVKTStjeGUxZFVGY3VpeUZnSGcz?= =?utf-8?B?ZlVmZEw4NFliaXpnWVdPQU56d2FZRXQ4SzVhU2VROWR2aDQ2QjRQdGlJRjR4?= =?utf-8?B?dzJZM1B3U1lvdVhmaUYwQkVWMWRDZklXS2c3YlVIZXdFMEtQTXFoN0N3ZFNx?= =?utf-8?B?eUtmdDZ3ZitnWkZJNE5RQ283YW40K2xDbVI1NXVnS0FvTWQrQUlQT2VnRE54?= =?utf-8?B?L2hoNTdZYlc3c3lSSzBxU2I1T28yeXYxQ2x0enpreDByQTFLWW9FYTV5T2ZL?= =?utf-8?B?Y1AvUWJrWTZ1Yy9SZXJwR0M2MWQyN2YxU2c2YU1UM3M4TjNDNEVUMzJ6U3hE?= =?utf-8?B?Z0RIK3NuUlZEQUdpMVJvK0JDR0JPVGFPSkp6QXF2NnJLVlIrSzgveDhEL1Mx?= =?utf-8?B?Sm1SZXpPbWpzVERYN2IzQjRtOG5LYUFZdlpvclpwdVkzVStWNFJIZHVweG1z?= =?utf-8?B?RVh2c25qZWprVzlHOHVlWnROMmJSWlhoOEVFTWoyak9CMWlmRm9EeXl6N2Ra?= =?utf-8?B?dG16UmtYcnhIWWZHU3JKTlI0MDR2NHpRU2hnU09JVUgzSWRhNXUyeWdrYmVZ?= =?utf-8?B?QWtSRFFoZTFYTndYaU5obXhzcW1Ya1g1VzdDZUY3dWRIc25FQ3hUcW9EaXhj?= =?utf-8?B?dDFzWW1lSk9oNkdVOWprbUZOclA2TXpmV0VJeUpmUVZvbk81aVptVzhIdHAw?= =?utf-8?B?cjJYMVhDUXRab0ZDMXdxdW96MVBlRGJrZVdsNEN5RFpYMlJJcmxqb3daRlB3?= =?utf-8?B?VllRVC9OYWxWNGxBOUNCUmJMMmxZdWZHUE5LV0k1cFFZdkgxRVN3enBJSXpo?= =?utf-8?B?d2pROFdOYmNqQi9SNGpFWU1ncUN6OXNlaXVSMUxVM1Jka0Nqa2NSZE50Nzkx?= =?utf-8?B?Z20zcE5wLzBtRUJwc2xkdHdvZEw2c2cxdlo1TngyeFJjSTZVWDJwaG9BTitO?= =?utf-8?B?b0o3M3FEdG5paXMyek9JdjBrdVphREZSRHpja1pTeE9sSDF0QUpRRGs2Zm9F?= =?utf-8?B?eVErQS9rTG5WeDByd3k3V09RMWpFeDdDU3N5TXZCR2NraDZXcDFWeTFXeFp4?= =?utf-8?B?Ly9LQXhIdUQxTGUwT0tvY29YUGMzOExRL0RQMGhHMzRhY1RhbmNqUG00OUJF?= =?utf-8?B?dWFFOExYKy9sZnJvb2lNdTlVV1VnNW1UR0NoODhjWmEwejF2M0Zsd2hZK25Z?= =?utf-8?B?RE5Id0gweFRDcEJrYU1qVTBJaWUxN1UydG5aYVp2OFFBclM4QU9BSC9sRGxD?= =?utf-8?B?amZUZTN6cUMvWG43QWVqQ0RxZytIWFJENFVkUmtCQmdHb0NZUFltbVhIaG1a?= =?utf-8?Q?UGTIoDQgtqP1Wbnol0=3D?= X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-03a34.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 7d6bb773-6935-4ac4-f7e8-08dac4917ff6 X-MS-Exchange-CrossTenant-AuthSource: HE1PR0402MB3452.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Nov 2022 09:37:23.3164 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR04MB8449 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.40 / 15.00]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_SHORT(-1.00)[-0.995]; NEURAL_HAM_LONG(-0.99)[-0.994]; NEURAL_HAM_MEDIUM(-0.61)[-0.608]; DMARC_POLICY_ALLOW(-0.50)[hotmail.fr,none]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_NONE(0.00)[40.92.91.58:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.fr]; ASN(0.00)[asn:8075, ipnet:40.80.0.0/12, country:US]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.92.91.58:from]; MIME_TRACE(0.00)[0:+]; FREEMAIL_FROM(0.00)[hotmail.fr]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4N8Vps3Fdwz3LgJ X-ThisMailContainsUnwantedMimeParts: N Le Fri, 11 Nov 2022 17:42:44 +0000 (GMT), andy thomas a =C3=A9crit : > I have two identical servers, called clustor2 and clustor-backup, each=20 > with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and tw= o=20 > SSDs for the ZIL and ARC functions. clustor2 stores user data from a=20 > HPC while clustor2-backup uses rsync to mirrors all the data from clustor= 2=20 > every 24 hours. > Hi, For the mirroring part I would give zfs send/recv a try. I like rsync but I= 'm sure in this case zfs send/recv would be more efficient and faster.=20 K. From nobody Sat Nov 12 15:55:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8gCq4GFzz4gHpk for ; Sat, 12 Nov 2022 15:56:07 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-wm1-x32c.google.com (mail-wm1-x32c.google.com [IPv6:2a00:1450:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N8gCq2MRZz4G16 for ; Sat, 12 Nov 2022 15:56:07 +0000 (UTC) (envelope-from rincebrain@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wm1-x32c.google.com with SMTP id h10-20020a1c210a000000b003cfd7f339bdso611608wmh.0 for ; Sat, 12 Nov 2022 07:56:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=XprNF4QTjAgHpniq6mvoX2IbQ1wgxJAqp0DbnGgL3So=; b=X91JeZYjQDXYlq50GSvtMgGcsMiqdqkB4gpnC4YA/MktIdD4PNtiQQ6S2l2P0U/5gU yUkWjnaPy7YGtznz4e5UXGRy6NP94DtpqUBXw3Jj+jevmjdbjHoDakS1sOq6GLw79Pt9 73q6ioQ9rrgAt7ZVkL3q/vbe6j+VZ7xIuv6rJjnKEOxtgk+CKEbwwJXHsJDTjt/hjWAW 7Dcak1YuCXwU2xJw1gJODIca8+24mIu3UVQNFD0tp83KCm45uwe3Pj1ipi9+Al099r4O YVynKDbfETICtNXVv+Zd/ZlIyeviVme7QeHuyE6m4dn2f/+24DpKnkZu/tDCQKdf0ZNs YIFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=XprNF4QTjAgHpniq6mvoX2IbQ1wgxJAqp0DbnGgL3So=; b=DG2fk9g2jSaiXXSSBv/uwG1Xz4hoVfi2bYGLa7f4Tw+ZF6HeLzlHWB042gNUyTr7uX kUKgES2bWfH2aFe9EIloDq3BUwH7cQ2BZomzTIZ3n0CXFvUTRIXJyt4MpOBWGwjsGh9P fllt1rrJFZmBei3NHMnQQ6iRbotEnepco644YdyBcjIAn09ZYEMkQssJoy+uBiv1NWBQ FcFRZFHH2IeOwg8r5Dm9DU2+iCMHXLA7WpC5ADeFmd1++VnB6i5efa+bIgPdUCZl7B/c xj1mjmdyOVfPy9CqEdXFwqeB8urHftMz2qsIyqrNd5+txOxXgR/VsNmjqun/0UfUfZFk 4dEg== X-Gm-Message-State: ANoB5pllqFOM6qmDLYeA1HxHdEs9cWXNKSrMJ+QwEWIAXAwbD3qM7IFA eTbyLmpnqtQItV7GAndsjTf7wJJNI/WW+wLLuSMWQ9sfPPY= X-Google-Smtp-Source: AA0mqf5neFLu4FafIvKKuc81EU9Tkhljty5BL+CJe8rvF5IQvEc2xfpxTLlEeXu2TNrq/7/PjBhUFveoT5tyTGWEwkY= X-Received: by 2002:a05:600c:17d0:b0:3cf:a6e9:fad6 with SMTP id y16-20020a05600c17d000b003cfa6e9fad6mr4101115wmo.206.1668268565869; Sat, 12 Nov 2022 07:56:05 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rich Date: Sat, 12 Nov 2022 10:55:53 -0500 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: kaycee gb Cc: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="0000000000004239a505ed480b86" X-Rspamd-Queue-Id: 4N8gCq2MRZz4G16 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-ThisMailContainsUnwantedMimeParts: N --0000000000004239a505ed480b86 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi everyone, If you have an example file that's claiming to take up more space on one side than the other, you could use zdb to see what it's doing on disk. e.g. $ ls -i /workspace/mirrors/centos/CentOS-8.1.1911-x86_64-dvd1.iso 441 /workspace/mirrors/centos/CentOS-8.1.1911-x86_64-dvd1.iso $ sudo zdb -dbdbdbdbdbdb workspace/mirrors/centos 441 Dataset workspace/mirrors/centos [ZPL], ID 1069, cr_txg 33536418, 501G, 359422 objects, rootbp DVA[0]=3D<3:7023204000:1000> DVA[1]=3D<3:7421125000:1000> [L0 DMU objset] skein uncompressed unencrypted LE contiguous unique double size=3D1000L/1000P birth=3D39305123L/39305123P fill=3D359422 cksum=3D1a2c0618fec098ea:27ad9c57dd26336a:a79b9e5413f126d7:98eb32d7beb1b658 Object lvl iblk dblk dsize dnsize lsize %full type 441 3 128K 128K 6.83G 512 7.04G 99.99 ZFS plain file (K=3Dinherit) (Z=3Dinherit=3Dzstd-unknown) 288 bonus System attributes dnode flags: USED_BYTES USERUSED_ACCOUNTED dnode maxblkid: 57639 path /CentOS-8.1.1911-x86_64-dvd1.iso uid 1002 gid 1002 atime Sat Mar 7 19:34:54 2020 mtime Sat Feb 22 15:58:48 2020 ctime Wed Apr 8 23:11:42 2020 crtime Wed Apr 8 23:11:02 2020 gen 24292265 mode 100764 size 7554990080 parent 4 links 1 pflags 40800000004 SA xattrs: 112 bytes, 1 entries user.DOSATTRIB =3D 0x20\000\000\003\000\003\000\000\000\021\000\000\000 \000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\00= 0\000\000\000\000\020\006 c\341\364\325\001\000\000\000\000\000\000\000\000 Indirect blocks: 0 L2 DVA[0]=3D<2:399307d000:1000> DVA[1]=3D<0:6c92a673000:1000> [L2 ZFS plain file] skein lz4 unencrypted LE contiguous unique double size=3D20000L/1000P birth=3D33536573L/33536573P fill=3D57636 cksum=3D4c5a8422b0199ec:8bda69b65610ddec:8ba4cc6c09a562b7:f5320ee2c5db878d 0 L1 DVA[0]=3D<1:57316ff4000:b000> DVA[1]=3D<2:54335f23000:b000> [L1 ZFS plain file] skein lz4 unencrypted LE contiguous unique double size=3D20000L/b000P birth=3D33536565L/33536565P fill=3D1022 cksum=3D23bc863675aeedbe:1ce9e654a1463229:cd17146a117928cd:cfb1524c72123546 0 L0 DVA[0]=3D<2:4f75e232000:4000> [L0 ZFS plain file] ske= in zstd unencrypted LE contiguous unique single size=3D20000L/4000P birth=3D33536565L/33536565P fill=3D1 cksum=3D910008c8d6d0acfb:a5c6a7ee6f8d39de:8a5fcf7b14323a94:e5a9b7cfb00a4e98 [...] And you can compare the block entries it prints and see why it might be taking more space on one copy than the other... - Rich On Sat, Nov 12, 2022 at 4:37 AM kaycee gb wrote: > Le Fri, 11 Nov 2022 17:42:44 +0000 (GMT), > andy thomas a =C3=A9crit : > > > I have two identical servers, called clustor2 and clustor-backup, each > > with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and > two > > SSDs for the ZIL and ARC functions. clustor2 stores user data from a > > HPC while clustor2-backup uses rsync to mirrors all the data from > clustor2 > > every 24 hours. > > > > Hi, > > For the mirroring part I would give zfs send/recv a try. I like rsync but > I'm > sure in this case zfs send/recv would be more efficient and faster. > > K. > > > --0000000000004239a505ed480b86 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi everyone,
If you have an example file that's cl= aiming to take up more space on one side than the other, you could use zdb = to see what it's doing on disk.

e.g.
$ ls -i /workspace/mirrors/centos/CentOS-8.1.1911-x86_64-dvd1.iso
441 /= workspace/mirrors/centos/CentOS-8.1.1911-x86_64-dvd1.iso
$ sudo zdb -dbd= bdbdbdbdb workspace/mirrors/centos 441
Dataset workspace/mirrors/centos = [ZPL], ID 1069, cr_txg 33536418, 501G, 359422 objects, rootbp DVA[0]=3D<= 3:7023204000:1000> DVA[1]=3D<3:7421125000:1000> [L0 DMU objset] sk= ein uncompressed unencrypted LE contiguous unique double size=3D1000L/1000P= birth=3D39305123L/39305123P fill=3D359422 cksum=3D1a2c0618fec098ea:27ad9c5= 7dd26336a:a79b9e5413f126d7:98eb32d7beb1b658

=C2=A0 =C2=A0 Object =C2= =A0lvl =C2=A0 iblk =C2=A0 dblk =C2=A0dsize =C2=A0dnsize =C2=A0lsize =C2=A0 = %full =C2=A0type
=C2=A0 =C2=A0 =C2=A0 =C2=A0441 =C2=A0 =C2=A03 =C2=A0 12= 8K =C2=A0 128K =C2=A06.83G =C2=A0 =C2=A0 512 =C2=A07.04G =C2=A0 99.99 =C2= =A0ZFS plain file (K=3Dinherit) (Z=3Dinherit=3Dzstd-unknown)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0288 =C2=A0 bonus =C2=A0System attributes
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 dnode flags: USED_BYTES USERUSED_ACCOUNTED
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 dnode maxblkid: 57639
=C2=A0 =C2=A0 =C2=A0 =C2=A0 path =C2=A0 =C2= =A0/CentOS-8.1.1911-x86_64-dvd1.iso
=C2=A0 =C2=A0 =C2=A0 =C2=A0 uid =C2= =A0 =C2=A0 1002
=C2=A0 =C2=A0 =C2=A0 =C2=A0 gid =C2=A0 =C2=A0 1002
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 atime =C2=A0 Sat Mar =C2=A07 19:34:54 2020
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 mtime =C2=A0 Sat Feb 22 15:58:48 2020
=C2=A0= =C2=A0 =C2=A0 =C2=A0 ctime =C2=A0 Wed Apr =C2=A08 23:11:42 2020
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 crtime =C2=A0Wed Apr =C2=A08 23:11:02 2020
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 gen =C2=A0 =C2=A0 24292265
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 mode =C2=A0 =C2=A0100764
=C2=A0 =C2=A0 =C2=A0 =C2=A0 size =C2=A0 =C2= =A07554990080
=C2=A0 =C2=A0 =C2=A0 =C2=A0 parent =C2=A04
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 links =C2=A0 1
=C2=A0 =C2=A0 =C2=A0 =C2=A0 pflags =C2= =A040800000004
=C2=A0 =C2=A0 =C2=A0 =C2=A0 SA xattrs: 112 bytes, 1 entri= es

=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 user.DOSA= TTRIB =3D 0x20\000\000\003\000\003\000\000\000\021\000\000\000 \000\000\000= \000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\00= 0\000\020\006 c\341\364\325\001\000\000\000\000\000\000\000\000
Indirect= blocks:
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 L2 =C2= =A0 DVA[0]=3D<2:399307d000:1000> DVA[1]=3D<0:6c92a673000:1000> = [L2 ZFS plain file] skein lz4 unencrypted LE contiguous unique double size= =3D20000L/1000P birth=3D33536573L/33536573P fill=3D57636 cksum=3D4c5a8422b0= 199ec:8bda69b65610ddec:8ba4cc6c09a562b7:f5320ee2c5db878d
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0L1 =C2=A0DVA[0]=3D<1:57= 316ff4000:b000> DVA[1]=3D<2:54335f23000:b000> [L1 ZFS plain file] = skein lz4 unencrypted LE contiguous unique double size=3D20000L/b000P birth= =3D33536565L/33536565P fill=3D1022 cksum=3D23bc863675aeedbe:1ce9e654a146322= 9:cd17146a117928cd:cfb1524c72123546
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A00 =C2=A0 L0 DVA[0]=3D<2:4f75e232000:4000> [L0 ZFS= plain file] skein zstd unencrypted LE contiguous unique single size=3D2000= 0L/4000P birth=3D33536565L/33536565P fill=3D1 cksum=3D910008c8d6d0acfb:a5c6= a7ee6f8d39de:8a5fcf7b14323a94:e5a9b7cfb00a4e98
[...]

And you can compare the block entries it prints and see wh= y it might be taking more space on one copy than the other...
- Rich

On Sat, Nov 12, 2022 at 4:37 AM kaycee gb <kisscoolandthegangbang@hotm= ail.fr> wrote:
Le Fri, 11 Nov 2022 17:42:44 +0000 (GMT),
andy thomas <andy@time-domain.co.uk> a =C3=A9crit :

> I have two identical servers, called clustor2 and clustor-backup, each=
> with a ZFS RAIDZ-1 pool containing 9 SAS hard disks plus one spare and= two
> SSDs for the ZIL and ARC functions. clustor2 stores user data from a <= br> > HPC while clustor2-backup uses rsync to mirrors all the data from clus= tor2
> every 24 hours.
>

Hi,

For the mirroring part I would give zfs send/recv a try. I like rsync but I= 'm
sure in this case zfs send/recv would be more efficient and faster.

K.


--0000000000004239a505ed480b86-- From nobody Sat Nov 12 23:38:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8sTZ44dHz4hG0s for ; Sat, 12 Nov 2022 23:38:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N8sTZ20gyz47cl for ; Sat, 12 Nov 2022 23:38:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668296322; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VNfCMMAShldsKi+a6y29q5FDgymuzU0ewdqDBuUl9Bw=; b=awLB5Lopu1UH+Dq9FxtAUeGEY1CVwn+bz+1kdODMF0znckrATd/TG3mGTwYMIx2IKRAxRv YsxNYzWJljZTfSMj+GNwKPy6qlFdWR1eMX/aF76GdvkHNfCLSG5Due8H/tehVNXoS6pTxx Xv4ZQgtNb3Nxh43jnDXHmPnhUskAcup2TO2SWNOHgZjpBwKJfKXe8OCc7Iw0K4qYn17rAj SJc400J4n1NSzazLgIg7tCFGom08ucy1hPSSEqPCIjvH2F5wpyMKI6LZts+cimG+DEtPyf x9SOu8UKmYZG8IhmmJFBP0WfaJLcP1zHoLIORPL2ybxcPSWHM7WSLfzlOrvHog== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668296322; a=rsa-sha256; cv=none; b=j1wujcZDi+SjyQ3w/wNzEDSup2eJbGgxX75/uW5hSEAh5tU2fGOJBeu01sZ7VQGv5XLXVf wJOA6B0GIyhHnSutBSdXSclVDgd7sy8XhfccA6BeIUZuXA5zAgfPs6a4ic7hHfgeQjlVXX IRUVIN4RSUknWI9uFxOwZy6TsYUheXsKsCd01CUtFuV2xEXe2206C/LvulKJvkUKQs1j+5 HcS6ZUDozIEcq3FHW+u1hFla7g3j4GgnQZjr6Qy+dDrfu04qp93cM1Iu01aEGy2q0mvCrW sY9GzL0XXxd/FlzMw761Wd3zVHW4ngMetiF+3vDq0bcxELHgEfxhbDb0vykfKw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N8sTZ14GKzh3w for ; Sat, 12 Nov 2022 23:38:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ACNcgNV098477 for ; Sat, 12 Nov 2022 23:38:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ACNcg2C098476 for fs@FreeBSD.org; Sat, 12 Nov 2022 23:38:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Sat, 12 Nov 2022 23:38:42 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 --- Comment #11 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D5c7ba6bdf83fda82cce70f384e2ec8218= f13002e commit 5c7ba6bdf83fda82cce70f384e2ec8218f13002e Author: Kirk McKusick AuthorDate: 2022-11-12 23:36:07 +0000 Commit: Kirk McKusick CommitDate: 2022-11-12 23:37:27 +0000 Fix for tunefs(8) unable to add a UFS/FFS soft update journal. The reported bug is UFS: bad file descriptor: soft update journaling can not be enabled on some FreeBSD-provided disk images =E2=80=93 failed to write updated cg. The UFS library (libufs(3)) failed to reopen its disk descriptor when first attempting to update a cylinder group. The error only occurred when trying to add journaling to a filesystem whose first cylinder group was too full to hold the journal. PR: 259090 MFC after: 1 week Sponsored by: The FreeBSD Foundation lib/libufs/cgroup.c | 4 ++++ 1 file changed, 4 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 13 01:53:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N8wTc4dSRz4fhdv for ; Sun, 13 Nov 2022 01:53:56 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N8wTb3FPKz4NVy for ; Sun, 13 Nov 2022 01:53:55 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of bfriesen@simple.dallas.tx.us designates 65.66.246.90 as permitted sender) smtp.mailfrom=bfriesen@simple.dallas.tx.us; dmarc=none Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id 2AD1rlR6019797; Sat, 12 Nov 2022 19:53:48 -0600 (CST) Date: Sat, 12 Nov 2022 19:53:47 -0600 (CST) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: andy thomas cc: freebsd-fs@FreeBSD.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.20 (GSO 67 2015-01-07) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Sat, 12 Nov 2022 19:53:48 -0600 (CST) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.21 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.988]; NEURAL_HAM_MEDIUM(-0.92)[-0.918]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dallas.tx.us]; ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4N8wTb3FPKz4NVy X-ThisMailContainsUnwantedMimeParts: N On Fri, 11 Nov 2022, andy thomas wrote: > Yes, I can confirm the rsync --delete option is being used and in fact, 'du' > reports some of the mirrored folders as having identical sizes on both > servers, mainly those containing only small amounts of data. I forgot to mention that a proven solution when using rsync is to use the '--inplace --no-whole-file' options. These options help rsync to avoid doing wasteful things when updating existing files on a ZFS filesystem. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt From nobody Sun Nov 13 16:13:56 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N9HZB1q26z4hVCm for ; Sun, 13 Nov 2022 16:14:10 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N9HZ90kBBz3lMl for ; Sun, 13 Nov 2022 16:14:08 +0000 (UTC) (envelope-from nonesuch@longcount.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=longcount.org header.s=google header.b=VXrlsRpB; spf=pass (mx1.freebsd.org: domain of nonesuch@longcount.org designates 2607:f8b0:4864:20::829 as permitted sender) smtp.mailfrom=nonesuch@longcount.org; dmarc=none Received: by mail-qt1-x829.google.com with SMTP id w4so5617210qts.0 for ; Sun, 13 Nov 2022 08:14:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=longcount.org; s=google; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=uK4m0aLF7qM0zsQ0ZzGsMO1mHf8qCKDFOfK+bvZtuYE=; b=VXrlsRpBKKd0hcSMqPkxhoqfykOxortzlNCvZXftfXl0FYrHf7avqx6aQOxwxiRluM s6Bi4FGDF1S2a6S5cn2YFyCyZcDPrtIYwjyH74YQkBSgswgac3BNddkgzURm6OKgcPLk fC0Z3aJtGoUWNwXxSqEvQCF6Inv1475FePI+XHDt432NnEztWKimu7f4C9Cl3MLxh/Xe x41gth5DxjniTWwW2O8FLsMcZ8SKEm594N3LuVSirhA7z0V1yRpG9c26xi+rSkw0pw4z nhMfqBMzBj9Tpf9XzUbhEF2+wyFUdcijHKR2AJus96VHij5O+aqzLLfs/+B6vIFsJxX0 IvQg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=uK4m0aLF7qM0zsQ0ZzGsMO1mHf8qCKDFOfK+bvZtuYE=; b=civgxcAOGfvs81bxRnS6d4TXHxeTauCYOFionRGu9usjcTc2eHDOmujB+oHzJlzH9j IuKxVQtBrgfjs0hMYuG+UZz6NmFxXpEX/EYj+XGBoz3pcymc371c8WuSFAvsqbsi5mvy GfY63SQhboyg+pWPcS4EHSyUJRn4FKbZ+nmjgJ1RdfuHEMhhyh7ygg6qbVSTY0i+xlbw l1wfbrEH/mTautyscseU3HiyQTTMaMAfG0JiZ+iTDJeLdts806muzDYpwgi+RaqAwwFg /VqlaFdZYOkYgDo+bQevt6kgwCfAY/ua716aqmp2sBhb3oMhA0HcVqiSTmHip2GsnCAC Reng== X-Gm-Message-State: ANoB5pnpq1EWWMigJ2zhaf6brylGeG81/4zCnfIPawd/oy/grsRVEYcC 3OalwVvGnOsGXUoSFGcqNY5rnjZ8hCciYMtYcyDOaaZ+SIv3Xw== X-Google-Smtp-Source: AA0mqf6bz7YGAJdDp9HN58rKceLlqt1FaQmZW4x1ZCdDUCGNp+TMQ40SOQ1ilUkceKNplKu0nsen7gSo+b+LYovEZOE= X-Received: by 2002:a05:622a:4d0b:b0:39c:44cd:34a9 with SMTP id fd11-20020a05622a4d0b00b0039c44cd34a9mr9073416qtb.220.1668356047544; Sun, 13 Nov 2022 08:14:07 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mark Saad Date: Sun, 13 Nov 2022 11:13:56 -0500 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="00000000000092b96f05ed5c6903" X-Spamd-Result: default: False [-0.50 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[longcount.org:s=google]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::829:from]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[longcount.org:+]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[longcount.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4N9HZ90kBBz3lMl X-Spamd-Bar: / X-ThisMailContainsUnwantedMimeParts: N --00000000000092b96f05ed5c6903 Content-Type: text/plain; charset="UTF-8" On Sat, Nov 12, 2022 at 8:54 PM Bob Friesenhahn < bfriesen@simple.dallas.tx.us> wrote: > On Fri, 11 Nov 2022, andy thomas wrote: > > > Yes, I can confirm the rsync --delete option is being used and in fact, > 'du' > > reports some of the mirrored folders as having identical sizes on both > > servers, mainly those containing only small amounts of data. > > I forgot to mention that a proven solution when using rsync is to use > the '--inplace --no-whole-file' options. These options help rsync to > avoid doing wasteful things when updating existing files on a ZFS > filesystem. > > Bob are you saying when the target is zfs --inplace --no-whole-file helps or just in general when you have large files ? Also have you tried using --delete-during / --delete-after ? > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt > > -- mark saad | nonesuch@longcount.org --00000000000092b96f05ed5c6903 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sat, Nov 12, 2022 at 8:54 PM Bob F= riesenhahn <bfriesen@sim= ple.dallas.tx.us> wrote:
On Fri, 11 Nov 2022, andy thomas wrote:

> Yes, I can confirm the rsync --delete option is being used and in fact= , 'du'
> reports some of the mirrored folders as having identical sizes on both=
> servers, mainly those containing only small amounts of data.

I forgot to mention that a proven solution when using rsync is to use
the '--inplace --no-whole-file' options.=C2=A0 These options help r= sync to
avoid doing wasteful things when updating existing files on a ZFS
filesystem.


Bob are you saying when the target is = zfs --inplace --no-whole-file helps or just in general when you have
large files ?=C2=A0 Also have you tried using --delete-during / --= delete-after=C2=A0 ?
=C2=A0
Bob
--
Bob Friesenhahn
bfriesen@= simple.dallas.tx.us, http://www.simplesystems.org/us= ers/bfriesen/
GraphicsMagick Maintainer,=C2=A0 =C2=A0 http://www.GraphicsMagick.org/=
Public Key,=C2=A0 =C2=A0 =C2=A0http://www.= simplesystems.org/users/bfriesen/public-key.txt



--
mark saad | nonesuch@longcount.org
--00000000000092b96f05ed5c6903-- From nobody Sun Nov 13 17:46:42 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N9Kd23vvXz4hlvZ for ; Sun, 13 Nov 2022 17:46:46 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N9Kd16dRhz3w0J for ; Sun, 13 Nov 2022 17:46:45 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Authentication-Results: mx1.freebsd.org; none Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id 2ADHkgq5026015; Sun, 13 Nov 2022 11:46:42 -0600 (CST) Date: Sun, 13 Nov 2022 11:46:42 -0600 (CST) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: Mark Saad cc: freebsd-fs@FreeBSD.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.20 (GSO 67 2015-01-07) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Sun, 13 Nov 2022 11:46:42 -0600 (CST) X-Rspamd-Queue-Id: 4N9Kd16dRhz3w0J X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Sun, 13 Nov 2022, Mark Saad wrote: >> > Bob are you saying when the target is zfs --inplace --no-whole-file helps > or just in general when you have > large files ? Also have you tried using --delete-during / --delete-after ? The '-inplace --no-whole-file' updates the file blocks if they have changed (comparing the orgin blocks with the existing mirror blocks) rather than creating a new copy of the file and moving it into place when it is complete. ZFS does not check if data content has been changed while it is being written so a write of the same data will result in a fresh allocation based on its Copy On Write ("COW") design. Writing a whole new file obviously significantly increases the number of blocks which are written. Requesting that rsync only write to the file for the blocks which have changed reduces the total number of blocks which get written. The above helps quite a lot when using snapshots since then fewer blocks are in the snapshots. I have never tried --delete-during so I can't comment on that. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt From nobody Sun Nov 13 19:03:15 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N9ML06MQpz4dHCr for ; Sun, 13 Nov 2022 19:03:52 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-yb1-xb2b.google.com (mail-yb1-xb2b.google.com [IPv6:2607:f8b0:4864:20::b2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N9ML04T8bz438f for ; Sun, 13 Nov 2022 19:03:52 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yb1-xb2b.google.com with SMTP id f201so10000738yba.12 for ; Sun, 13 Nov 2022 11:03:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=XjKXLVDOaCfKDEn/udFPGSAmTCJSduQmTy7N/klTUPY=; b=I5ygKeeITB+FcE2qtyib7TA4/7wRzQa0XPRuFt2SlGuWf7p112m4ViYOtE/p+wW0BX bVU3VZLeVxzvJu1ki0wL3+k3QatNmfWTmBvb9EsRNs3Q5xhlKa+JuLQQw36JkRFvfbPQ Uwh/wYcHFoSohCVVN0XkmpS6zyt6FyNFjaFmnxtQbkCbKwEU+xDUa8vHgdRJ3TkCWKQu 5VdEbqcZTrxbGDni17XUgIu/Zs5I+yZnnpBVylPFfeeUflh7V+fbCY/2EwvRS3xvT/H3 peMBSrfHWM409p3xzaqEfmu/iUDI6mjmnE4PptBY3nT604n8bsbkatVby0lfSOOq0W8q fwgQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=XjKXLVDOaCfKDEn/udFPGSAmTCJSduQmTy7N/klTUPY=; b=oYyHrtzB9R4mPycXoV+WdTT56S2KKpV041l07a5rv5KJrcNwaBES/dc7VGg9c6yRt2 JY29W33jesSg75l6MpH0ZPRE7Vtd0ZnPjylwKdK90nqXdH13EeHyJMYZhCOcAi4HnrSQ HrELdSmmSpfGzoqcWPCY18QseJV/BTtNF4ULBOm7uOTgWaKuuKmyF2i7lymicyt6uE60 2P4W4dfEZADGm9IuYt6AeirV82ct8rmUzGN17foxCrPG1N5wqlEN3aTP8M4+EKCDiNYn SBsqzS630HT5dgjAqfesNXZe3yGf6OJbSR/mK5/gLTxkTkwqAV4J2mxm1YMgPPdKhjwt 6QXQ== X-Gm-Message-State: ANoB5pnJxV8idclbEdYonxYlp0zHvDL4Bn6YOU2N0gWoyryyCi+OUA1s kQJmmK6WrJWfI6gRYSIfcNkq/YxM4YrqUcVx8mwzkrfiSHk= X-Google-Smtp-Source: AA0mqf64h6njLM0prYKtyeV9DqjMMgXYokecPa4SBNl9vhByfc0728T2SelX4kZ+s8DuDZYNVRjQIIDTiolE62SqM54= X-Received: by 2002:a25:cad4:0:b0:6ca:aadc:c4d2 with SMTP id a203-20020a25cad4000000b006caaadcc4d2mr9996348ybg.77.1668366231846; Sun, 13 Nov 2022 11:03:51 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mehmet Erol Sanliturk Date: Sun, 13 Nov 2022 22:03:15 +0300 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: Bob Friesenhahn Cc: Mark Saad , freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="0000000000009ac45d05ed5ec8bc" X-Rspamd-Queue-Id: 4N9ML04T8bz438f X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000009ac45d05ed5ec8bc Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Nov 13, 2022 at 8:46 PM Bob Friesenhahn < bfriesen@simple.dallas.tx.us> wrote: > On Sun, 13 Nov 2022, Mark Saad wrote: > >> > > Bob are you saying when the target is zfs --inplace --no-whole-file hel= ps > > or just in general when you have > > large files ? Also have you tried using --delete-during / > --delete-after ? > > The '-inplace --no-whole-file' updates the file blocks if they have > changed (comparing the orgin blocks with the existing mirror blocks) > rather than creating a new copy of the file and moving it into place > when it is complete. ZFS does not check if data content has been > changed while it is being written so a write of the same data will > result in a fresh allocation based on its Copy On Write ("COW") > design. Writing a whole new file obviously significantly increases > the number of blocks which are written. Requesting that rsync only > write to the file for the blocks which have changed reduces the total > number of blocks which get written. > > The above helps quite a lot when using snapshots since then fewer > blocks are in the snapshots. > > I have never tried --delete-during so I can't comment on that. > > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen= / > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > Public Key, http://www.simplesystems.org/users/bfriesen/public-key.tx= t > > More information on zfs and rsync : https://www.google.com/search?q=3Duse+of+rsync+command+for+zfs+volumes&sxsr= f=3DALiCzsZALxJWD--EizNVNAHl-u-j6BOndw%3A1668365903483&source=3Dhp&ei=3DTz5= xY6XbGrCQxc8Plbyl8A0&iflsig=3DAJiK0e8AAAAAY3FMX56shwXahupzkNcfFLLhJJd0xL1U&= ved=3D0ahUKEwjlvp6o66v7AhUwSPEDHRVeCd4Q4dUDCAc&uact=3D5&oq=3Duse+of+rsync+c= ommand+for+zfs+volumes&gs_lcp=3DCgdnd3Mtd2l6EAMyBQgAEKIEOgQIIxAnOgsILhCABBD= HARDRAzoFCAAQgAQ6CAguENQCEIAEOggILhCABBDUAjoFCC4QgAQ6CAgAEIAEEMsBOggILhCABB= DLAToGCAAQFhAeOggIABAWEB4QDzoFCAAQhgM6BQghEKABOgQIIRAVOggIIRAWEB4QHToHCCEQo= AEQClAAWI6bAmCtnQJoAHAAeACAAbkCiAHkLJIBCDAuMzUuMC4xmAEAoAEB&sclient=3Dgws-w= iz use of rsync command for zfs volumes Mehmet Erol Sanliturk --0000000000009ac45d05ed5ec8bc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Nov 13, 2022= at 8:46 PM Bob Friesenhahn <bfriesen@simple.dallas.tx.us> wrote:
On Sun, 13 Nov 2022, Mark Saad wrote:
>>
> Bob are you saying when the target is zfs --inplace --no-whole-file he= lps
> or just in general when you have
> large files ?=C2=A0 Also have you tried using --delete-during / --dele= te-after=C2=A0 ?

The '-inplace --no-whole-file' updates the file blocks if they have=
changed (comparing the orgin blocks with the existing mirror blocks)
rather than creating a new copy of the file and moving it into place
when it is complete.=C2=A0 ZFS does not check if data content has been
changed while it is being written so a write of the same data will
result in a fresh allocation based on its Copy On Write ("COW") <= br> design.=C2=A0 Writing a whole new file obviously significantly increases the number of blocks which are written.=C2=A0 Requesting that rsync only write to the file for the blocks which have changed reduces the total
number of blocks which get written.

The above helps quite a lot when using snapshots since then fewer
blocks are in the snapshots.

I have never tried --delete-during so I can't comment on that.

Bob
--
Bob Friesenhahn
bfriesen@= simple.dallas.tx.us, http://www.simplesystems.org/us= ers/bfriesen/
GraphicsMagick Maintainer,=C2=A0 =C2=A0 http://www.GraphicsMagick.org/=
Public Key,=C2=A0 =C2=A0 =C2=A0http://www.= simplesystems.org/users/bfriesen/public-key.txt




More information on zfs and rsync :


https://www.google.com/sea= rch?q=3Duse+of+rsync+command+for+zfs+volumes&sxsrf=3DALiCzsZALxJWD--Eiz= NVNAHl-u-j6BOndw%3A1668365903483&source=3Dhp&ei=3DTz5xY6XbGrCQxc8Pl= byl8A0&iflsig=3DAJiK0e8AAAAAY3FMX56shwXahupzkNcfFLLhJJd0xL1U&ved=3D= 0ahUKEwjlvp6o66v7AhUwSPEDHRVeCd4Q4dUDCAc&uact=3D5&oq=3Duse+of+rsync= +command+for+zfs+volumes&gs_lcp=3DCgdnd3Mtd2l6EAMyBQgAEKIEOgQIIxAnOgsIL= hCABBDHARDRAzoFCAAQgAQ6CAguENQCEIAEOggILhCABBDUAjoFCC4QgAQ6CAgAEIAEEMsBOggI= LhCABBDLAToGCAAQFhAeOggIABAWEB4QDzoFCAAQhgM6BQghEKABOgQIIRAVOggIIRAWEB4QHTo= HCCEQoAEQClAAWI6bAmCtnQJoAHAAeACAAbkCiAHkLJIBCDAuMzUuMC4xmAEAoAEB&sclie= nt=3Dgws-wiz

use of rsync command for zfs volu= mes



Mehmet= Erol Sanliturk





=C2=A0
--0000000000009ac45d05ed5ec8bc-- From nobody Sun Nov 13 21:00:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N9PwN07WNz4h6ZL for ; Sun, 13 Nov 2022 21:00:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4N9PwM4qHNz4P8d for ; Sun, 13 Nov 2022 21:00:19 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668373219; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=j1UwmGew7fwVR/bS2sXnOH/DbFjNK/PgKcp91abUt9k=; b=RN8ziqR9N3x6xGp7IW/LScXcWaUdvL57gz3+nvEUGWyiJ9wof0WBJlZnkeDfRx0XljIeMi IxSdD7n0N9jYxYd2up1rEKg/yg+OM3yNDQKGONX7YiXs9Fhxm2Vp9GjLu4GpM1FOfS4wdF GP3vYbDPBUsssTCakrtowqcmRuf6ThUS6u93I7OIYA8lIm9RD9sUVKVslERLUG6jRHjNOe PXoxctCz/JO5EJQxR5TjnTSGhnJf5EZl75imhgd4BippXk7K6KmPhbqR3E4yhUjMLQ8zWj 15MC5EIFivbmvo9hoTL7QarRSx2oJVOKCXWMMXFJap6pS/p9+0IP8lJILHaIwQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668373219; a=rsa-sha256; cv=none; b=kgbKffQZrJxE004x2/nINfX3KgWPUSaJAOT2/73mIpkNKw5+jYwMJmQzrTH0i46aUmrvOI V3M9iGq5b6blgJ4WMcituEc3Z/lLaMRdmMPfyPX9+nfqu1NKEJEYWA9rMxd7VRJcXArceE p8Wc01WmtZjsh1ubBOazyCIi2A4F8zUr9v0E9gziMtgimHtDaBjX0DsNjN7RAfI2qnlUFx LLE/FisaBHokvSNjB8tnz4MyuRCOa33kP4y3fWe65n7zF9/sIxLqdVKWvPW4f1v1JX8DFJ RhVivcmmscBvJLalQZqhv3qF9Fs4YFIJAXYFbj06ZkKCA2IlMD+RtmtiYpODDA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4N9PwM3gclzGv6 for ; Sun, 13 Nov 2022 21:00:19 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ADL0J3W056563 for ; Sun, 13 Nov 2022 21:00:19 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ADL0Je1056562 for fs@FreeBSD.org; Sun, 13 Nov 2022 21:00:19 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202211132100.2ADL0Je1056562@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 13 Nov 2022 21:00:19 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16683732192.c386.54999" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16683732192.c386.54999 Date: Sun, 13 Nov 2022 21:00:19 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16683732192.c386.54999 Date: Sun, 13 Nov 2022 21:00:19 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16683732192.c386.54999-- From nobody Wed Nov 16 23:15:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCJmW1m5zz4hMJ2 for ; Wed, 16 Nov 2022 23:15:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCJmW0dpCz4D37 for ; Wed, 16 Nov 2022 23:15:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668640507; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MKQZDcq0WkRmGAeXmBWh/cxJbyF1QnSc7Nt7VjhRJ1c=; b=IuOmrlFuKgPzYd7JV3lYxXltnFHgcnZL7HPpf687qfX2tSNyiqghULeOVT+dYXsYb0FBTK YhHgprbnCQXw3/j1A2ezFpoRVJk12k5gUg10GKeOa6ZwdtNtZKTj7xk4kZVHu8ojcEe96Q zJpPtRdSO4xH9sa7LSOxR45p2f1YC9ZISfRCIkFAGhL307j14bHgPyO4+DxYX6m9RutVpY GnL950bjU4aRSpIb2pCbCMXN3Ozca4T9n9ZTqKVQsdwKtrPvd3PiLiv8deIKqTaWYFrt0h xk9hz01AoX/2wgtzv0Pe3b+5x35mkFWf3mYstuLlX1SZyulQk9hoB32ePxDV2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668640507; a=rsa-sha256; cv=none; b=dnKUA8RknA5i7+Qzi/JOt0Au3Sjd+4wf6puPomZKBt7SLXNXdtOtZOO8Wyf6yxKrHTbc9X OEN+XmrB2Z8jd99XSS8OKfgUCj2fjXUfCL0JqOAznMQNkZQQdYYAZnUskL3IeoDXc26B4w AXafXRzXlh7QjWugFbfHNcy8HKFo1a6Yteisb3zIGKSTukKCTKm3W7qELSs51HZoKYfBtY /j7XvMhAoXZSMAno/30ZXCwk+pLj2FiYVFsZM0ZdoxftzL+HfnBYdGxJ7HGn3PWxJK6n0a Cz7lpsB5FYsIrjvhr7TGrduuD2DYO2meBIZOPe4rozJjkhp9xllpwTQWPT9Okw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NCJmV6nh7zKKx for ; Wed, 16 Nov 2022 23:15:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AGNF6tA004412 for ; Wed, 16 Nov 2022 23:15:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AGNF67s004411 for fs@FreeBSD.org; Wed, 16 Nov 2022 23:15:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 238112] Unable to create ZVOL Date: Wed, 16 Nov 2022 23:15:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D238112 --- Comment #10 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=3Dd8a259a74e52a1c77a92b514cebac17= 2bf46428a commit d8a259a74e52a1c77a92b514cebac172bf46428a Author: Dave Cottlehuber AuthorDate: 2022-11-16 23:07:43 +0000 Commit: Dave Cottlehuber CommitDate: 2022-11-16 23:07:43 +0000 net/seaweedfs: update to 3.35 - hand over maintainership thank-you Boris! Reported by: portscout Sponsored by: SkunkWerks, GmbH PR: 238112 net/seaweedfs/Makefile | 17 ++++++++--------- net/seaweedfs/distinfo | 10 +++++----- 2 files changed, 13 insertions(+), 14 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Nov 17 08:50:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCYXQ3GX9z4hYK1 for ; Thu, 17 Nov 2022 08:50:30 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCYXP22rQz45SB for ; Thu, 17 Nov 2022 08:50:28 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of andy@time-domain.co.uk designates 62.3.122.138 as permitted sender) smtp.mailfrom=andy@time-domain.co.uk; dmarc=none Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2AH8oLC7046302; Thu, 17 Nov 2022 08:50:21 GMT (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2AH8oKlG046299; Thu, 17 Nov 2022 08:50:21 GMT (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Thu, 17 Nov 2022 08:50:20 +0000 (GMT) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: Bob Friesenhahn cc: Mark Saad , freebsd-fs@FreeBSD.org Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Spamd-Result: default: False [-1.96 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.34)[0.337]; R_SPF_ALLOW(-0.20)[+ip4:62.3.122.136/29]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DMARC_NA(0.00)[time-domain.co.uk]; HAS_XAW(0.00)[]; FREEFALL_USER(0.00)[andy]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4NCYXP22rQz45SB X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N I thought I would report back that changed my rsync options from '-Wav --delete' to '-av --inplace --no-whole-file --delete' has made a significant difference, with mirrored directory sizes on the slave server now falling and approaching the original sizes on the master. The only downside is that since whole-file replication is obviously a lot faster than updating the changed parts of individual files, mirroring is now taking longer than 24 hours so this will be changed to every few days or even weekly when more is known about user behaviour on the master server. Andy On Sun, 13 Nov 2022, Bob Friesenhahn wrote: > On Sun, 13 Nov 2022, Mark Saad wrote: >>> >> Bob are you saying when the target is zfs --inplace --no-whole-file helps >> or just in general when you have >> large files ? Also have you tried using --delete-during / --delete-after >> ? > > The '-inplace --no-whole-file' updates the file blocks if they have changed > (comparing the orgin blocks with the existing mirror blocks) rather than > creating a new copy of the file and moving it into place when it is complete. > ZFS does not check if data content has been changed while it is being written > so a write of the same data will result in a fresh allocation based on its > Copy On Write ("COW") design. Writing a whole new file obviously > significantly increases the number of blocks which are written. Requesting > that rsync only write to the file for the blocks which have changed reduces > the total number of blocks which get written. > > The above helps quite a lot when using snapshots since then fewer blocks are > in the snapshots. > > I have never tried --delete-during so I can't comment on that. > > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt > > ---------------------------- Andy Thomas, Time Domain Systems Tel: +44 (0)7866 556626 http://www.time-domain.co.uk From nobody Thu Nov 17 09:31:02 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCZRS01mqz4hfQ0 for ; Thu, 17 Nov 2022 09:31:16 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-wm1-x330.google.com (mail-wm1-x330.google.com [IPv6:2a00:1450:4864:20::330]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCZRR4rM4z4CN1 for ; Thu, 17 Nov 2022 09:31:15 +0000 (UTC) (envelope-from fjwcash@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wm1-x330.google.com with SMTP id j5-20020a05600c410500b003cfa9c0ea76so1358841wmi.3 for ; Thu, 17 Nov 2022 01:31:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Ld2W/X3ruLbjZPKorS4VZSJBhyOs5fZvq6zDK+tgX/g=; b=o1DzoQp/h5gUV3SRydfdMBgcpzA7X1+vlONLep1U7jUvjRJ17ZmLqpqUwIXXS4Oj4W MpR8XT6xDfIssmCshkJEIzaDs6pT/TMonrlfww6VZpgaTcZ1muN8y5p6SmU3GGRvV3LQ WjJOQTDl2xmWAMnAOIvNIA9iwz++vXr4rrO/W7r9KahHH2pRsSKqT4mBajlb1xBfTMiX SLtnssuyoP8a6xnu20H0c4MwGs5+KRNvjFlOe/XSFTO/zhbn5IIATY6SVklqlHmyUr2E Tk/+zAvhw1lDnkcmEkaxDFvoo1wEq5Wa0Dj+/rap42RXyVSeDPwXrw2AOyh+Fe+Rjs1m IR1A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ld2W/X3ruLbjZPKorS4VZSJBhyOs5fZvq6zDK+tgX/g=; b=jSRY2/ElO+7J7vRB4GyKvNWOCcF0AHQzj6MIY88vFDjyXR10KV/A/HLgQ46Amurkqq eldXdVTBxTyj8Bfm3Kskwm/7bvkNh+UGObJwIyusaVrlouimdWV+6J7If4G1YmJFVUD/ qxIrRgjIecYIqJFo76b6AL0tRXGNWqQ688LQIHi0yKf8kEaHD8rKc818ugMsGlUg2zyD F3MfrcVi1pZx5txdKEhyCE9h827YmOBNJki0nCRPQ2MSemx+t23uinOit3VMV19WKoJ1 epYwLPjidyZOsxmIhZe4wqISwJySUzaLADRIlGR201F1pJ6EqvrecXIK5bkY6ZoT4Q54 vUBQ== X-Gm-Message-State: ANoB5pkKVBtp0nYBhAxQKkYRKqdIi0qclfj4CKYuTJqp3Zvzes1sXR1b 8EgmeWq6v/YAwDaTRpdebsL8GPQBUTzOIKMB5hk= X-Google-Smtp-Source: AA0mqf7ZTH7WkvDH1Y7EgyVhhcrd2VYMGe2TPBoFHkTY1HRcAqaIKUIaV/3gOIFb78JSorCpWDWEv0tMn5V7swwjnik= X-Received: by 2002:a05:600c:511c:b0:3cf:6c05:809e with SMTP id o28-20020a05600c511c00b003cf6c05809emr1103350wms.74.1668677473755; Thu, 17 Nov 2022 01:31:13 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Freddie Cash Date: Thu, 17 Nov 2022 01:31:02 -0800 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: andy thomas Cc: Bob Friesenhahn , Mark Saad , FreeBSD Filesystems Content-Type: multipart/alternative; boundary="00000000000011651005eda74014" X-Rspamd-Queue-Id: 4NCZRR4rM4z4CN1 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --00000000000011651005eda74014 Content-Type: text/plain; charset="UTF-8" Now that you have it working with rsync, you should look into using ZFS send/recv as an alternative. You should find it finishes a lot quicker than rsync, although it does require a bit more scripting know-how (especially if you want to use restartable/interruptible transfers, or use a transport other than SSH for better throughout). ZFS send/recv works "below" the filesystem later today rsync works at. ZFS knows which individual blocks on disk have changed between snapshots and only transfers those blocks. There's no file comparisons and hash computations to work out between the hosts. Transferring the initial snapshot takes a long time, though, as it has to transfer the entire filesystem across. Transferring individual snapshots after that takes very little time. It's similar to doing a "full" backup, and then "incrementals". When transferring data between ZFS pools with similar filesystem hierarchies, you really should consider send/recv. Cheers, Freddie Typos due to smartphone keyboard. On Thu., Nov. 17, 2022, 12:50 a.m. andy thomas, wrote: > I thought I would report back that changed my rsync options from '-Wav > --delete' to '-av --inplace --no-whole-file --delete' has made a > significant difference, with mirrored directory sizes on the slave server > now falling and approaching the original sizes on the master. The only > downside is that since whole-file replication is obviously a lot faster > than updating the changed parts of individual files, mirroring is now > taking longer than 24 hours so this will be changed to every few days or > even weekly when more is known about user behaviour on the master server. > > Andy > > On Sun, 13 Nov 2022, Bob Friesenhahn wrote: > > > On Sun, 13 Nov 2022, Mark Saad wrote: > >>> > >> Bob are you saying when the target is zfs --inplace --no-whole-file > helps > >> or just in general when you have > >> large files ? Also have you tried using --delete-during / > --delete-after > >> ? > > > > The '-inplace --no-whole-file' updates the file blocks if they have > changed > > (comparing the orgin blocks with the existing mirror blocks) rather than > > creating a new copy of the file and moving it into place when it is > complete. > > ZFS does not check if data content has been changed while it is being > written > > so a write of the same data will result in a fresh allocation based on > its > > Copy On Write ("COW") design. Writing a whole new file obviously > > significantly increases the number of blocks which are written. > Requesting > > that rsync only write to the file for the blocks which have changed > reduces > > the total number of blocks which get written. > > > > The above helps quite a lot when using snapshots since then fewer blocks > are > > in the snapshots. > > > > I have never tried --delete-during so I can't comment on that. > > > > Bob > > -- > > Bob Friesenhahn > > bfriesen@simple.dallas.tx.us, > http://www.simplesystems.org/users/bfriesen/ > > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > > Public Key, > http://www.simplesystems.org/users/bfriesen/public-key.txt > > > > > > > ---------------------------- > Andy Thomas, > Time Domain Systems > > Tel: +44 (0)7866 556626 > http://www.time-domain.co.uk > > --00000000000011651005eda74014 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Now that you have it working with rsync, you should look = into using ZFS send/recv as an alternative. You should find it finishes a l= ot quicker than rsync, although it does require a bit more scripting know-h= ow (especially if you want to use restartable/interruptible transfers, or u= se a transport other than SSH for better throughout).

=
ZFS send/recv works "below" the filesyste= m later today rsync works at. ZFS knows which individual blocks on disk hav= e changed between snapshots and only transfers those blocks. There's no= file comparisons and hash computations to work out between the hosts.

Transferring the initial sna= pshot takes a long time, though, as it has to transfer the entire filesyste= m across. Transferring individual snapshots after that takes very little ti= me. It's similar to doing a "full" backup, and then "inc= rementals".

When tr= ansferring data between ZFS pools with similar filesystem hierarchies, you = really should consider send/recv.

Cheers,
Freddie

Typos due to= smartphone keyboard.

On Thu., Nov. 17, 2022, 12:50 a.m. a= ndy thomas, <andy@time-domain.= co.uk> wrote:
I thought I wo= uld report back that changed my rsync options from '-Wav
--delete' to '-av --inplace --no-whole-file --delete' has made = a
significant difference, with mirrored directory sizes on the slave server <= br> now falling and approaching the original sizes on the master. The only
downside is that since whole-file replication is obviously a lot faster than updating the changed parts of individual files, mirroring is now
taking longer than 24 hours so this will be changed to every few days or even weekly when more is known about user behaviour on the master server.
Andy

On Sun, 13 Nov 2022, Bob Friesenhahn wrote:

> On Sun, 13 Nov 2022, Mark Saad wrote:
>>>
>> Bob are you saying when the target is zfs --inplace --no-whole-fil= e helps
>> or just in general when you have
>> large files ?=C2=A0 Also have you tried using --delete-during / --= delete-after
>> ?
>
> The '-inplace --no-whole-file' updates the file blocks if they= have changed
> (comparing the orgin blocks with the existing mirror blocks) rather th= an
> creating a new copy of the file and moving it into place when it is co= mplete.
> ZFS does not check if data content has been changed while it is being = written
> so a write of the same data will result in a fresh allocation based on= its
> Copy On Write ("COW") design.=C2=A0 Writing a whole new file= obviously
> significantly increases the number of blocks which are written.=C2=A0 = Requesting
> that rsync only write to the file for the blocks which have changed re= duces
> the total number of blocks which get written.
>
> The above helps quite a lot when using snapshots since then fewer bloc= ks are
> in the snapshots.
>
> I have never tried --delete-during so I can't comment on that.
>
> Bob
> --
> Bob Friesenhahn
> bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
> GraphicsMagick Maintainer,=C2=A0 =C2=A0 http://www.Gra= phicsMagick.org/
> Public Key,=C2=A0 =C2=A0 =C2=A0http://www.simplesystems.org/users/bfriesen/public-key.txt
>
>


----------------------------
Andy Thomas,
Time Domain Systems

Tel: +44 (0)7866 556626
http://www.time-domain.co.uk

--00000000000011651005eda74014-- From nobody Thu Nov 17 14:43:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCjMx5BJjz4hRXb for ; Thu, 17 Nov 2022 14:43:41 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Received: from mail0.time-domain.net (mail0.time-domain.net [62.3.122.138]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCjMx1Xr6z3MyS for ; Thu, 17 Nov 2022 14:43:41 +0000 (UTC) (envelope-from andy@time-domain.co.uk) Authentication-Results: mx1.freebsd.org; none Received: from mail0.time-domain.net (localhost [127.0.0.1]) by mail0.time-domain.net (8.15.2/8.15.2) with ESMTP id 2AHEhclU050556; Thu, 17 Nov 2022 14:43:38 GMT (envelope-from andy@time-domain.co.uk) Received: from localhost (andy-tds@localhost) by mail0.time-domain.net (8.15.2/8.15.2/Submit) with ESMTP id 2AHEhcIO050553; Thu, 17 Nov 2022 14:43:38 GMT (envelope-from andy@time-domain.co.uk) X-Authentication-Warning: mail0.time-domain.net: andy-tds owned process doing -bs Date: Thu, 17 Nov 2022 14:43:38 +0000 (GMT) From: andy thomas X-X-Sender: andy-tds@mail0.time-domain.net To: Freddie Cash cc: Bob Friesenhahn , Mark Saad , FreeBSD Filesystems Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.22 (BSF 395 2020-01-19) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="951801389-1544439091-1668696218=:50255" X-Rspamd-Queue-Id: 4NCjMx1Xr6z3MyS X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:13037, ipnet:62.3.64.0/18, country:GB] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --951801389-1544439091-1668696218=:50255 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8BIT On Thu, 17 Nov 2022, Freddie Cash wrote: > Now that you have it working with rsync, you should look into using ZFS > send/recv as an alternative. You should find it finishes a lot quicker than > rsync, although it does require a bit more scripting know-how (especially if > you want to use restartable/interruptible transfers, or use a transport > other than SSH for better throughout). > ZFS send/recv works "below" the filesystem later today rsync works at. ZFS > knows which individual blocks on disk have changed between snapshots and > only transfers those blocks. There's no file comparisons and hash > computations to work out between the hosts. > > Transferring the initial snapshot takes a long time, though, as it has to > transfer the entire filesystem across. Transferring individual snapshots > after that takes very little time. It's similar to doing a "full" backup, > and then "incrementals". > > When transferring data between ZFS pools with similar filesystem > hierarchies, you really should consider send/recv. Point taken! Three days ago, one of our HPC users who has ~9TB of data stored on our server decided to rename a subdirectory containing ~4TB of experimental data stored as many millions of relatively small files within a lot of subdirectories. As a result, rsync on the destination (mirror) server is still deleting his old folder and its contents and hasn't even started mirroring the renamed folder. Since our servers have been up for 5.5 years and are both well overdue for an O/S upgrade from FBSD 11.3 to 13.x anyway, I think this would be a good opportunity to switch from rsync to ZFS send/recv. I was planning to do the O/S update over the upcoming Christmas vacation when HPC demand here traditionally falls to a very low level - I will set up a pair of test servers in the next day or two, play around with this and get some experience of this before upgrading the 'live' servers. cheers, Andy > Typos due to smartphone keyboard. > > On Thu., Nov. 17, 2022, 12:50 a.m. andy thomas, > wrote: > I thought I would report back that changed my rsync options from > '-Wav > --delete' to '-av --inplace --no-whole-file --delete' has made a > significant difference, with mirrored directory sizes on the > slave server > now falling and approaching the original sizes on the master. > The only > downside is that since whole-file replication is obviously a lot > faster > than updating the changed parts of individual files, mirroring > is now > taking longer than 24 hours so this will be changed to every few > days or > even weekly when more is known about user behaviour on the > master server. > > Andy > > On Sun, 13 Nov 2022, Bob Friesenhahn wrote: > > > On Sun, 13 Nov 2022, Mark Saad wrote: > >>> > >> Bob are you saying when the target is zfs --inplace > --no-whole-file helps > >> or just in general when you have > >> large files ?  Also have you tried using --delete-during / > --delete-after > >> ? > > > > The '-inplace --no-whole-file' updates the file blocks if they > have changed > > (comparing the orgin blocks with the existing mirror blocks) > rather than > > creating a new copy of the file and moving it into place when > it is complete. > > ZFS does not check if data content has been changed while it > is being written > > so a write of the same data will result in a fresh allocation > based on its > > Copy On Write ("COW") design.  Writing a whole new file > obviously > > significantly increases the number of blocks which are > written.  Requesting > > that rsync only write to the file for the blocks which have > changed reduces > > the total number of blocks which get written. > > > > The above helps quite a lot when using snapshots since then > fewer blocks are > > in the snapshots. > > > > I have never tried --delete-during so I can't comment on that. > > > > Bob > > -- > > Bob Friesenhahn > > bfriesen@simple.dallas.tx.us, > http://www.simplesystems.org/users/bfriesen/ > > GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/ > > Public Key,    >  http://www.simplesystems.org/users/bfriesen/public-key.txt > > > > > > --951801389-1544439091-1668696218=:50255-- From nobody Thu Nov 17 17:04:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCmVK6zCqz4hm93 for ; Thu, 17 Nov 2022 17:04:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCmVK5mrMz3vq1 for ; Thu, 17 Nov 2022 17:04:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668704665; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G1fiPVRhy0vSntqgWbvjaRUCZxfF9hT2HRtu5Iz+HDc=; b=BgiOrNArSCe44gEfIhMJlGOgDkSBGx/V4AF1xn54JHdJqU56jTTTooefdBwj5tHYDLGIug 2R4a/ZxH8N0WblxbqH0b4rLKycz+mFslBUYVed/5T7GqmJWSasSJvnqUld/pRZ21vBmOE/ 9Por+Nxuywe7xwEIsxqVryGR62tnuvNgl6+dkkdsDnn3TdlZFWJ7+wa4uxrDU+8tTuDkAp 8MoYlzIWyVt27zv5PdxBwAD5qgDbV+kpcqY+V/rewokq2VsNZ4O3OZ6ww6ZwNNuGzZ/9FD oLCbmFimvtnm8GW7pwc//iO9akBIxrz8zfIK6+mKrGsOWW9lci+6EX+ceS2Upw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668704665; a=rsa-sha256; cv=none; b=MSaWe7mWyTJuhCnylq8hboCEc5q76SvMyB54Zkn31wvEjuzKDrwURDXYldsmwN0JTpDW55 h4vHlnKOn5fWQtL1pdlvtp5+1V/nYeVtmnRPf50/ViW1RHuNS4OLKY6ToeoZNlQnNm/LzG YTFDIHTPm3HKKsy5iY1olNwgHl85tIRVrOrSCvwy8YafCi6bXI0rEefJ4Tilj6KsI804gT CagB+bK0E6oX/63A7oTdx05U7QoLaMg1P6nKdEm9BpyWRq/Sq+EnHq85GX0lrPuO6MCa68 k1N+xAIEvwS+S01AmWOD1IfFlBuVYfcg2G+37s85H/I1LHYwPVMpRAprzNrE4A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NCmVK4fhDzpHp for ; Thu, 17 Nov 2022 17:04:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AHH4PEw073629 for ; Thu, 17 Nov 2022 17:04:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AHH4PXg073628 for fs@FreeBSD.org; Thu, 17 Nov 2022 17:04:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250323] OpenZFS L2ARC size shrinking over time Date: Thu, 17 Nov 2022 17:04:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: crwhipp@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250323 --- Comment #3 from crwhipp@gmail.com --- I have observed this on: FreeBSD 13.1-RELEASE-p3 amd64 With a 48G L2ARC configured, after 14 days of uptime on a mostly idle home server, `zfs-stats -L` reports 18G of L2ARC: ------------------------------------------------------------------------ ZFS Subsystem Report Thu Nov 17 10:01:09 2022 ------------------------------------------------------------------------ L2 ARC Summary: (HEALTHY) Low Memory Aborts: 20 Free on Write: 25.03 k R/W Clashes: 3 Bad Checksums: 0 IO Errors: 0 L2 ARC Size: (Adaptive) 18.14 GiB Decompressed Data Size: 30.34 GiB Compression Factor: 1.67 Header Size: 0.15% 46.42 MiB L2 ARC Evicts: Lock Retries: 183 Upon Reading: 1 L2 ARC Breakdown: 13.35 m Hit Ratio: 61.47% 8.21 m Miss Ratio: 38.53% 5.14 m Feeds: 1.21 m L2 ARC Writes: Writes Sent: 100.00% 71.80 k ------------------------------------------------------------------------ Rebooting restores the L2ARC size to it's correct value. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Nov 17 18:07:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCnvY1488z4hvGV for ; Thu, 17 Nov 2022 18:07:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCnvX74GJz44j2 for ; Thu, 17 Nov 2022 18:07:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668708473; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=X77iIngYjSH9uMD88ZGjhZj9d4i2uXUJOnrUu08AxzI=; b=EMpM8/glgVbnnFKDJw+yrnsiRveizsnRnqOhr+jrwCPsOGrnihP0gDXRr34iUb8Q8/wen6 7uD3S4XM17MaWdedtJspNZZAvUSXsUKHGhAdXRLu+XHGQEeFsPLGrGaX3avqbp10DGqJ/N JzkXYXQj3qdcNbhC+mP3VZABHWf7tdJ7zZQ3SD37zz1NtbiYNws/WF0GRduq36EhVjZdus mcocO3PHMz8h8LJgsAOosMgZWXOG2XS/W1ReGQu16rS5jwwEdLDRntG/CLvj2li2uWiZ9r FLQd8ZpHVCOxkck3nJMnCyBUe+fIEQZibFXiM7rgg2gv2YykqYvczi/bIv2yWw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668708473; a=rsa-sha256; cv=none; b=p5YGuY1GY35UQCf8kKf01jAsHgTMVVgsV7SJcv8xWUkxZUw7nqiqHfHViwN3Ir5gEHI7ck +aVfggCw9M4JH0DPMW29xEYYU/d9z1t609QCg1IkHe+ku9EmSiCtJYiWePLVzE1XnsPbza zy8TPyG/fyImmYcAYEd5TUL5sdbJgZqYfvBDN49fwd7SSGcrdRfSxxIukdLXtwa7RS7+VL bYqQZuAzVxvOlwCZyM0rjaocWIZaCOcwdkIR3n+9gZM5W1gTfukX7jKqBU2EGefHGHNGiz mjEvNX6SLmI2X9/ijAzsFi+KsrA0oTeyAM5zmtPLOCAwmn6Z/+hvFErto0vdrA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NCnvX643RzqsK for ; Thu, 17 Nov 2022 18:07:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AHI7qgB059322 for ; Thu, 17 Nov 2022 18:07:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AHI7quJ059321 for fs@FreeBSD.org; Thu, 17 Nov 2022 18:07:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250323] OpenZFS L2ARC size shrinking over time Date: Thu, 17 Nov 2022 18:07:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250323 John F. Carr changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jfc@mit.edu --- Comment #4 from John F. Carr --- I see this on two systems running 13.1-STABLE but can not confirm any effec= t on performance. Try doing a small I/O and running "sync" for a more controlled test. Running "sync" causes the decrease to appear sooner than it ordinari= ly would. I recall that ZFS likes to merge writes on a time scale of several seconds. In the openzfs code the sysctl variable "l2_asize" is the struct field arc_stats_t. arcstat_l2_psize. This is more obscure than it ought to be. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 00:47:12 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCymY6cZ3z4hgPJ for ; Fri, 18 Nov 2022 00:47:25 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-pl1-x633.google.com (mail-pl1-x633.google.com [IPv6:2607:f8b0:4864:20::633]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCymY6RPJz3mDk for ; Fri, 18 Nov 2022 00:47:25 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Authentication-Results: mx1.freebsd.org; none Received: by mail-pl1-x633.google.com with SMTP id k7so3190698pll.6 for ; Thu, 17 Nov 2022 16:47:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=4PG3XFMNTqUd7blJbERke3tcR5zqJLmpB1iB+YZ7Hrk=; b=VozB2uqqCSZbw5PHgfNQT2dUCF6kZ37i82YuVfJphBqznf3u4LWllFicbtlH5zFwM3 ubDPb/lT87tSCfxipnY7kxe95ikay1TxOkK4u6BlQn9GCJnWNYjRFa2EdsSapVnQOp6d ++plS0ckvY7rRInN8/LjFn8xR9pkmT6eNC2Z81DTdl6Mi0xl5tHHgCyJy/khBFZZKw6Y fV6vzhpMeW+CMGog51x99GXaPSwkBGRsQltp070Rzd3Hf+rHXXhHnhQOQD7ltaghfOtw BtayR16U6ezw8Uj+6rrZIbItkpRpcIf7HXU2R12MoxTB7NYsOK/KooN2raIDUn8Yafm8 ZgXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=4PG3XFMNTqUd7blJbERke3tcR5zqJLmpB1iB+YZ7Hrk=; b=4LlNSR3+x9+IHyZI4DDZ37y2zDaLj98QsAG1oL5jGPNxNegcvT+2TuBkPf2PZwO65g XmN9wvX5nhpFaRlx1eDBkpUQA66pf8GLX6lgbYPjHqhqAMxHEPSOfnk613mwychAE0XT eUvVQl2vw1Pb/MNx9Thv2qPr5uDPNUvjCgcYdjTiQunhHe4R52IhUPj6IuMEnZEn7Z4f 9aywfkht/gtkrtKsYvIWRFR8rEuiu4Du3Gm/vslpabG44xFZD4oAJKW6Do0laqwREurn oQS6wgN28OccO0jd4rgeqnuFEAhFNn1b9VNSszURpdS0iYYqxt3JKMBsnKcDiv1+aVkE VAKg== X-Gm-Message-State: ANoB5plCiZB1HRI5homtWs3OKXWcoQfIQ+s9v5qS0d1ZZngm/GaixJh9 JBDKRvNv3kOqKONLBi9T1LJn57n86t2YKz1hhR9oZAPkNzI= X-Google-Smtp-Source: AA0mqf7myWtO83kW3+xevTG28ZNnde4B+YgPYxey/97cI8m7C5IgLV69RjqdJlC2R7b/A1/f8ZVEcfo/O+z7AQFO+l4= X-Received: by 2002:a17:902:7289:b0:188:f6ba:8521 with SMTP id d9-20020a170902728900b00188f6ba8521mr3106937pll.105.1668732443248; Thu, 17 Nov 2022 16:47:23 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Eric Borisch Date: Thu, 17 Nov 2022 18:47:12 -0600 Message-ID: Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync To: andy thomas Cc: Bob Friesenhahn , Freddie Cash , FreeBSD Filesystems , Mark Saad Content-Type: multipart/alternative; boundary="000000000000815acb05edb40c44" X-Rspamd-Queue-Id: 4NCymY6RPJz3mDk X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --000000000000815acb05edb40c44 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Take the time to figure out send/recv; it is a killer app of ZFS. Note that your initial sync will have to send the entire filesystem; there is no way to start with an rsync-ed copy due to the nature of send/recv. Also note you cannot modify the receive side and then update the backup; as such you should typically set it to be read-only. (Otherwise you will have to roll back to the synchronized snapshot before updating). You can still recv into a read-only zfs filesystem, as the read-only is a statement of =E2=80=9Cread only through the posix layer=E2=80=9D. - Eric On Thu, Nov 17, 2022 at 8:44 AM andy thomas wrote: > On Thu, 17 Nov 2022, Freddie Cash wrote: > > > Now that you have it working with rsync, you should look into using ZFS > > send/recv as an alternative. You should find it finishes a lot quicker > than > > rsync, although it does require a bit more scripting know-how > (especially if > > you want to use restartable/interruptible transfers, or use a transport > > other than SSH for better throughout). > > ZFS send/recv works "below" the filesystem later today rsync works at. > ZFS > > knows which individual blocks on disk have changed between snapshots an= d > > only transfers those blocks. There's no file comparisons and hash > > computations to work out between the hosts. > > > > Transferring the initial snapshot takes a long time, though, as it has = to > > transfer the entire filesystem across. Transferring individual snapshot= s > > after that takes very little time. It's similar to doing a "full" backu= p, > > and then "incrementals". > > > > When transferring data between ZFS pools with similar filesystem > > hierarchies, you really should consider send/recv. > > Point taken! Three days ago, one of our HPC users who has ~9TB of data > stored on our server decided to rename a subdirectory containing ~4TB of > experimental data stored as many millions of relatively small files withi= n > a lot of subdirectories. As a result, rsync on the destination (mirror) > server is still deleting his old folder and its contents and hasn't even > started mirroring the renamed folder. > > Since our servers have been up for 5.5 years and are both well overdue fo= r > an O/S upgrade from FBSD 11.3 to 13.x anyway, I think this would be a goo= d > opportunity to switch from rsync to ZFS send/recv. I was planning to do > the O/S update over the upcoming Christmas vacation when HPC demand here > traditionally falls to a very low level - I will set up a pair of test > servers in the next day or two, play around with this and get some > experience of this before upgrading the 'live' servers. > > cheers, Andy > > > Typos due to smartphone keyboard. > > > > On Thu., Nov. 17, 2022, 12:50 a.m. andy thomas, > > wrote: > > I thought I would report back that changed my rsync options from > > '-Wav > > --delete' to '-av --inplace --no-whole-file --delete' has made a > > significant difference, with mirrored directory sizes on the > > slave server > > now falling and approaching the original sizes on the master. > > The only > > downside is that since whole-file replication is obviously a lot > > faster > > than updating the changed parts of individual files, mirroring > > is now > > taking longer than 24 hours so this will be changed to every few > > days or > > even weekly when more is known about user behaviour on the > > master server. > > > > Andy > > > > On Sun, 13 Nov 2022, Bob Friesenhahn wrote: > > > > > On Sun, 13 Nov 2022, Mark Saad wrote: > > >>> > > >> Bob are you saying when the target is zfs --inplace > > --no-whole-file helps > > >> or just in general when you have > > >> large files ? Also have you tried using --delete-during / > > --delete-after > > >> ? > > > > > > The '-inplace --no-whole-file' updates the file blocks if they > > have changed > > > (comparing the orgin blocks with the existing mirror blocks) > > rather than > > > creating a new copy of the file and moving it into place when > > it is complete. > > > ZFS does not check if data content has been changed while it > > is being written > > > so a write of the same data will result in a fresh allocation > > based on its > > > Copy On Write ("COW") design. Writing a whole new file > > obviously > > > significantly increases the number of blocks which are > > written. Requesting > > > that rsync only write to the file for the blocks which have > > changed reduces > > > the total number of blocks which get written. > > > > > > The above helps quite a lot when using snapshots since then > > fewer blocks are > > > in the snapshots. > > > > > > I have never tried --delete-during so I can't comment on that. > > > > > > Bob > > > -- > > > Bob Friesenhahn > > > bfriesen@simple.dallas.tx.us, > > http://www.simplesystems.org/users/bfriesen/ > > > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ > > > Public Key, > > http://www.simplesystems.org/users/bfriesen/public-key.txt > > > > > > > > > > --000000000000815acb05edb40c44 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Take the time to figure out send/recv; it is a kille= r app of ZFS. Note that your initial sync will have to send the entire file= system; there is no way to start with an rsync-ed copy due to the nature of= send/recv.

Also note yo= u cannot modify the receive side and then update the backup; as such you sh= ould typically set it to be read-only. (Otherwise you will have to roll bac= k to the synchronized snapshot before updating). You can still recv into a = read-only zfs filesystem, as the read-only is a statement of =C2=A0=E2=80= =9Cread only through the posix layer=E2=80=9D.

<= /div>
=C2=A0- Eric

On Thu, Nov 17, 2022 at 8:44 AM and= y thomas <an= dy@time-domain.co.uk> wrote:
On Thu, 17 No= v 2022, Freddie Cash wrote:

> Now that you have it working with rsync, you should look into using ZF= S
> send/recv as an alternative. You should find it finishes a lot quicker= than
> rsync, although it does require a bit more scripting know-how (especia= lly if
> you want to use restartable/interruptible transfers, or use a transpor= t
> other than SSH for better throughout).
> ZFS send/recv works "below" the filesystem later today rsync= works at. ZFS
> knows which individual blocks on disk have changed between snapshots a= nd
> only transfers those blocks. There's no file comparisons and hash<= br> > computations to work out between the hosts.
>
> Transferring the initial snapshot takes a long time, though, as it has= to
> transfer the entire filesystem across. Transferring individual snapsho= ts
> after that takes very little time. It's similar to doing a "f= ull" backup,
> and then "incrementals".
>
> When transferring data between ZFS pools with similar filesystem
> hierarchies, you really should consider send/recv.

Point taken! Three days ago, one of our HPC users who has ~9TB of data
stored on our server decided to rename a subdirectory containing ~4TB of experimental data stored as many millions of relatively small files within =
a lot of subdirectories. As a result, rsync on the destination (mirror) server is still deleting his old folder and its contents and hasn't eve= n
started mirroring the renamed folder.

Since our servers have been up for 5.5 years and are both well overdue for =
an O/S upgrade from FBSD 11.3 to 13.x anyway, I think this would be a good =
opportunity to switch from rsync to ZFS send/recv. I was planning to do the O/S update over the upcoming Christmas vacation when HPC demand here traditionally falls to a very low level - I will set up a pair of test
servers in the next day or two, play around with this and get some
experience of this before upgrading the 'live' servers.

cheers, Andy

> Typos due to smartphone keyboard.
>
> On Thu., Nov. 17, 2022, 12:50 a.m. andy thomas, <andy@time-domain.co.uk> > wrote:
>=C2=A0 =C2=A0 =C2=A0 =C2=A0I thought I would report back that changed m= y rsync options from
>=C2=A0 =C2=A0 =C2=A0 =C2=A0'-Wav
>=C2=A0 =C2=A0 =C2=A0 =C2=A0--delete' to '-av --inplace --no-who= le-file --delete' has made a
>=C2=A0 =C2=A0 =C2=A0 =C2=A0significant difference, with mirrored direct= ory sizes on the
>=C2=A0 =C2=A0 =C2=A0 =C2=A0slave server
>=C2=A0 =C2=A0 =C2=A0 =C2=A0now falling and approaching the original siz= es on the master.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0The only
>=C2=A0 =C2=A0 =C2=A0 =C2=A0downside is that since whole-file replicatio= n is obviously a lot
>=C2=A0 =C2=A0 =C2=A0 =C2=A0faster
>=C2=A0 =C2=A0 =C2=A0 =C2=A0than updating the changed parts of individua= l files, mirroring
>=C2=A0 =C2=A0 =C2=A0 =C2=A0is now
>=C2=A0 =C2=A0 =C2=A0 =C2=A0taking longer than 24 hours so this will be = changed to every few
>=C2=A0 =C2=A0 =C2=A0 =C2=A0days or
>=C2=A0 =C2=A0 =C2=A0 =C2=A0even weekly when more is known about user be= haviour on the
>=C2=A0 =C2=A0 =C2=A0 =C2=A0master server.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0Andy
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0On Sun, 13 Nov 2022, Bob Friesenhahn wrote:<= br> >
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> On Sun, 13 Nov 2022, Mark Saad wrote: >=C2=A0 =C2=A0 =C2=A0 =C2=A0>>>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>> Bob are you saying when the target = is zfs --inplace
>=C2=A0 =C2=A0 =C2=A0 =C2=A0--no-whole-file helps
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>> or just in general when you have >=C2=A0 =C2=A0 =C2=A0 =C2=A0>> large files ?=C2=A0 Also have you t= ried using --delete-during /
>=C2=A0 =C2=A0 =C2=A0 =C2=A0--delete-after
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>> ?
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> The '-inplace --no-whole-file' = updates the file blocks if they
>=C2=A0 =C2=A0 =C2=A0 =C2=A0have changed
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> (comparing the orgin blocks with the ex= isting mirror blocks)
>=C2=A0 =C2=A0 =C2=A0 =C2=A0rather than
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> creating a new copy of the file and mov= ing it into place when
>=C2=A0 =C2=A0 =C2=A0 =C2=A0it is complete.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> ZFS does not check if data content has = been changed while it
>=C2=A0 =C2=A0 =C2=A0 =C2=A0is being written
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> so a write of the same data will result= in a fresh allocation
>=C2=A0 =C2=A0 =C2=A0 =C2=A0based on its
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> Copy On Write ("COW") design.= =C2=A0 Writing a whole new file
>=C2=A0 =C2=A0 =C2=A0 =C2=A0obviously
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> significantly increases the number of b= locks which are
>=C2=A0 =C2=A0 =C2=A0 =C2=A0written.=C2=A0 Requesting
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> that rsync only write to the file for t= he blocks which have
>=C2=A0 =C2=A0 =C2=A0 =C2=A0changed reduces
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> the total number of blocks which get wr= itten.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> The above helps quite a lot when using = snapshots since then
>=C2=A0 =C2=A0 =C2=A0 =C2=A0fewer blocks are
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> in the snapshots.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> I have never tried --delete-during so I= can't comment on that.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> Bob
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> --
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> Bob Friesenhahn
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> bfriesen@simple.dallas.tx.us,
>=C2=A0 =C2=A0 =C2=A0 =C2=A0http://www.simplesystems.= org/users/bfriesen/
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> GraphicsMagick Maintainer,=C2=A0 =C2=A0= http://www.GraphicsMagick.org/
>=C2=A0 =C2=A0 =C2=A0 =C2=A0> Public Key,=C2=A0 =C2=A0
>=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0http:= //www.simplesystems.org/users/bfriesen/public-key.txt
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0>
>
>
--000000000000815acb05edb40c44-- From nobody Fri Nov 18 01:22:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NCzXx4J32z4hlvC for ; Fri, 18 Nov 2022 01:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NCzXx398gz3rqW for ; Fri, 18 Nov 2022 01:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668734545; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+yHR7VJVyYFSrVG4z0FzV/8YtODFz8GgZT+SHDqTMQU=; b=WQ6LXcKnNMBOc5+q2BaZj2Us1ia8JXacsn76LU5qCnyl5L4V4dx2UeStRubu/p/Hwshtk7 VCGnYTGx8i6iCgN0bolSHvM60PCuqLV8Q+xXT8ZOkQ4JtmXWATgrh0lGY/PnvXIwjVJQsF 4hx09OlyofbrJFi28lklcDuY4wIASytDaFPrSKDVJ3bgQqqNK/nk4J2RGwUSsSEU/7zJ6x ot3Ut47vBvNLsFjLbVW5V4XC7N4y2fS2OeJhRmqy8ldWr0zC8NQjPVEpDC7WVHTI2yG6Er Q0QUiaHmuo8OAWe2+e8Aw1BBau4U+zcIV0kTYTnjzPwvWNZdo+bNoRChb1mM+A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668734545; a=rsa-sha256; cv=none; b=FRhFYza6bxWb/1dMRzjt0DDoDttHAVG9R76h/0XUGxsf49LUzFz1DybYFvtqOOiayFloUu drvayXbj+3CfhBOEunOxrqKsUQdtvY5bjOvWhXVP/ar1cguvwmvHkStKbXkfS+zl1r79+J 3PalSf5FsIjASB/uVQFJeWlhJji/KZ99aiSefjnFO6uxC+gZPuMBZosIRgGE2xZv/2rhgu rydjrsIn40KO0tAzKGNdRtHVIKVU5+L/eisuuBj1BYoHaYN9eUE9KTuo6UmTQMpEpuahC4 Yuk7NLYRdUs83mo3aDofNZHyGBpTUZbR4+7iBIWDhNy80M/JgMjZAsI3bRlRQg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NCzXx2BxVz13JF for ; Fri, 18 Nov 2022 01:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AI1MPZK090714 for ; Fri, 18 Nov 2022 01:22:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AI1MP4X090712 for fs@FreeBSD.org; Fri, 18 Nov 2022 01:22:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 01:22:25 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #7 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Db999366aab4e2d59cb8869b0e5ef0f70a= b9b9bbe commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe Author: Kirk McKusick AuthorDate: 2022-05-27 19:21:11 +0000 Commit: Kirk McKusick CommitDate: 2022-11-18 01:19:41 +0000 Do comprehensive UFS/FFS superblock integrity checks when reading a superblock. Historically only minimal checks were made of a superblock when it was read in as it was assumed that fsck would have been run to correct any errors before attempting to use the filesystem. Recently several bug reports have been submitted reporting kernel panics that can be triggered by deliberately corrupting filesystem superblocks, see Bug 263979 - [meta] UFS / FFS / GEOM crash (panic) tracking which is tracking the reported corruption bugs. This change upgrades the checks that are performed. These additional checks should prevent panics from a corrupted superblock. Although it appears in only one place, the new code will apply to the kernel modules and (through libufs) user applications that read in superblocks. Reported by: Robert Morris and Neeraj Reviewed by: kib Tested by: Peter Holm PR: 263979 Differential Revision: https://reviews.freebsd.org/D35219 (cherry picked from commit 076002f24d35962f0d21f44bfddd34ee4d7f015d) (cherry picked from commit bc218d89200faa021def77732f3d9fde4f4dee13) (cherry picked from commit 800a53b445e7eb113ba193b1ac98631299178529) (cherry picked from commit 50dc4c7df4156863148e6a9609c03e852e2aeb35) (cherry picked from commit f3f5368dfbef4514686ba2d67f01f314b275227e) (cherry picked from commit 9e1f44d044a58fcd2caaca3f57e69cf6180db3dc) (cherry picked from commit 5bc926af9fd1c47f74356734f731c68145e31c6f) (cherry picked from commit 904347a00c1f9a29f3b17e6e676805036d2494f1) (cherry picked from commit 36e08b0127f97928a2f2c062feed8df9087b2b35) (cherry picked from commit 548045bf57c46cb2f4d43d3d7fa5d8ad37ec7f9a) (cherry picked from commit 3e40d2cc61a00a7d69e99b0fda4040cd1df04c57) (cherry picked from commit 184e3118c1057a97e16230baf0f0433adeeed723) (cherry picked from commit f0be378a66a75ebf335e9388ef0d319a70064d94) (cherry picked from commit 9dee5da7450e8530c9fec51c9a16ecd42da78e55) (cherry picked from commit 82ee4e1c42d70345cbaa1f6dd1874ae98a004910) (cherry picked from commit dcdba3460dd779a0180ec7769ab8cd47c932799e) (cherry picked from commit 017367c1146a69baca6a1a0bea10b0cb02c72d85) (cherry picked from commit 8435a9b20684ba8bcda3df31d06b4d5eac9431a7) sys/ufs/ffs/ffs_subr.c | 303 +++++++++++++++++++++++++++++++++++++++++----= ---- 1 file changed, 257 insertions(+), 46 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 14:49:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDKSM1X5Xz4hZs3 for ; Fri, 18 Nov 2022 14:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDKSM0BJQz3s0H for ; Fri, 18 Nov 2022 14:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668782979; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0NFGXrYbTSp06Ul5XefSlpCwXznmkWGl/El2b+qZ170=; b=N9V3SskT6bIXRR1oa3/Bni+pornJQpmH2C8kL8N2EFb+SBl19lTrHpeP4qt7h76cS0xvUA DH7n6UlQMqS2l8Zdk9RKjESrUH0UlW9ptZW4JhLWVN2/X9lI+AM4cMAy3S3GwA8wh95syj U77GIOz+QGpO+aKRYH/bgcrJ0e/IY4vFbjhi9ekZOFtdHCiUrCWSkEH4KJBTNPwFmgfmqh nEn+Gc/VfVR6orZJ4CQ5HmUfDNxTlcHWXH3QV8LqzxvGeyd/hlKOoeKs8QIpse9O1UPbnD IhWCYP3v9xAIoZ7iCjYwbHB3hEMq+RGZk4lpQogd+duNpRv3TBi6My8qsvr+pQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668782979; a=rsa-sha256; cv=none; b=QAA3GFmN3BrjqHUYrV9npuhuBdYmWRMNOYe0lDn5+/n4b4oWWGwhmEIBaG/HxAy7CWC20S 2vz/oJWfM95wrzBb7fG8mD2s3zg3lZxcBlzfjr4ZnC33iBlGk8kub0dHxs+jS7w0k0vzJr uGNcVRk10qyiOjbPo+fh+6rCFkVRGCspyxjBJDNmc3ziwJkH+u1lgEjcmXOaeMxYg2GPLQ ZlPM+4JQKNaZeTcmj4UXtRtXAvH7TWqcXebV+ke8q+LkL2X0ERNXn0F8r9O5ZWAxKxI7Hp 8HuGTQbwXTRkYt1O0hp2fAvK6Oy0COqT3mq4d2Tr4LS489LNCnAa/D6QTgu7Dg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDKSL6HhKz1Ny8 for ; Fri, 18 Nov 2022 14:49:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIEncEc057919 for ; Fri, 18 Nov 2022 14:49:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIEnc7O057918 for fs@FreeBSD.org; Fri, 18 Nov 2022 14:49:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 14:49:38 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Boris Korzun changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |drtr0jan@yandex.ru --- Comment #8 from Boris Korzun --- There'is a regression after b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe. buildkernel falls on amd64: --- kernel.full --- ld: error: undefined symbol: sysctl___vfs_ffs >>> referenced by ffs_subr.c >>> ffs_subr.o:(sysctl___vfs_ffs_prtsberrmsg) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 18:22:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDQ9h5B6Kz4d7VT for ; Fri, 18 Nov 2022 18:22:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDQ9h3vzbz4GZ6 for ; Fri, 18 Nov 2022 18:22:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668795736; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VCX4XDD2VmO5i+Yt3Of2xiS2iDByn4z/B6txPRdc6V4=; b=Gob+XwwWtvO6IdEAh56DQnEB4IlJzXpPzTaUOK0xH6rC3R5U5hO2WG/5xU82wxyze7zbfi xgxN3CDNnop1QSZDhKsSAVvXkmYqt0Rv4LyCnogVxogsERysR+3QsdYJ2FW76Sru65NgF4 caC0m8IeiE7Tx0a474g99ZTXNDQSvivsLPs61fGEgPAphWkFWNSW+jl6/SXQa0Pw/uDWGT xzkiGja2DNYZjgB4AIYFavzT4EVzwDwham8wrsINRqRiFB+7ENpKhYoanikNnIh1snmjpM coyWPAap7LxeRvNaMh1I967gbJwrH7APYWlUAoWWRJzMryMHzRoRVjfjKjwFqA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668795736; a=rsa-sha256; cv=none; b=PefTeMd/F3vlptubUhaNEopn+uMu+zSyqUN+pxaE5hfQHBIpk1Oi5f4KkNJrSjFOcu0L8K IsFBhmJdrX11JaKKIDDCNMNW9tnHQrXQN1kWM/9mQ0M8K7UIYwsLypIEHajH+vCt3ZWGHx IVLCx/TuCQb11tofA4OLakwT5PQU1wlnAgahsbxZJVpGRMj1bgphpnYhypdOXplNmGr0VW i8xpSHQgjS7jYyCPUR96Cs3VdIrG0FIn8WHVUZ/j7wiTU9DJimpSz7HOo+ojnWe92I5FOH m13oVsAW9/KB5IEdgQPGOsKDTxZADm76HSaEwMeDziSyJ6swBR/kz6/MrftiEA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDQ9h31cxzG6x for ; Fri, 18 Nov 2022 18:22:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIIMGE2076548 for ; Fri, 18 Nov 2022 18:22:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIIMGVH076547 for fs@FreeBSD.org; Fri, 18 Nov 2022 18:22:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 18:22:16 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Mark Millard changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |marklmi26-fbsd@yahoo.com --- Comment #9 from Mark Millard --- (In reply to Boris Korzun from comment #8) FYI: https://lists.freebsd.org/archives/dev-commits-src-branches/2022-November/0= 07958.html reports: From: Kirk McKusick Date: Fri, 18 Nov 2022 05:06:50 UTC=20 The branch stable/13 has been updated by mckusick: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dc2a74ca2c3d9ad3465f7cb88ea60907a0= 97fbdbc commit c2a74ca2c3d9ad3465f7cb88ea60907a097fbdbc Author: Kirk McKusick AuthorDate: 2022-11-18 05:03:01 +0000 Commit: Kirk McKusick CommitDate: 2022-11-18 05:06:16 +0000 Fix to b999366aab4e for compilation on i386. Reported by: jenkins, Philip Paeps . . . --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:20:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWSx0Gc7z4hVgR for ; Fri, 18 Nov 2022 22:20:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWSw5DY9z43cY for ; Fri, 18 Nov 2022 22:20:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810048; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RiLFyJTw2bv4s184+3OtUDbo8/MjqNRqPdoeJAAPVSs=; b=wcvbAnTRZ3k8VP0LP7LrIFi4DmSfa6dMf+j2qbrPqfeZ71otgfSLnQrTXyMVbSpgrRMkdm ksR7bbNeyHClExhswnzbZA+gpGjCQ2EAZ7awAkj5M4y8UZKuaDdNBL/VIiCjVSeqTA3LIX 8AMPCjd5Ab8+ND654fQwOa1MTucMtWLoFdIk85ek3Ml+9qhHHxVXlGOSHI+mNzr+adYGSc tAoRxWUAa03hAF9uwUestluaDErbltCipTTLT8FINsmPRQ5VIEE2kf/7VRdE7iHbl4Q346 3qDvmmO7WgOQCDQ6qOGEUnehx6qcBWzMZXAug+27hlZApl1opeX+o5quAu9xiw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810048; a=rsa-sha256; cv=none; b=VezejI9wjCRpl/hA2t16ofWAyKSCFiAxnVYVV2DyzI7BDx9BmrtojqTlzk9gfQ5sSsGZ9F YGVoQigCSxeTtpbnJOkk9LmwX827LTifpugN7ZygMyq62KsdaATx0km5tyYbiFP/Oykl0m rD+AEhyBL8XBzYZrVuMQzKccvGs7gFQhqmAOBJpBb8cihp/1UXoGkQ77Z2HpfnEDYvKyPB Lm9fYzSknD1XxBX5g9bxUBgqq0VeCm/K/mFjuZg/n9qsM1t2052NZf9dUVANPE4H22FKhe LMOX/p3Nyb9mzZpr4b+UXzKOONv4X6zYAOnbQlT1OrT3dY+8LeuaKfu2BR+yEA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWSw4JrDzNJp for ; Fri, 18 Nov 2022 22:20:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMKmZO011226 for ; Fri, 18 Nov 2022 22:20:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMKmWa011224 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:20:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263971] ffs: malicious superblock can cause buffer overflow during tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffffc07cb67000 Date: Fri, 18 Nov 2022 22:20:48 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #8 from Kirk McKusick --- MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Nov 18 22:20:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWSy5xDhz4hVPn for ; Fri, 18 Nov 2022 22:20:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWSy4fCbz43s3 for ; Fri, 18 Nov 2022 22:20:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810050; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HN4IGcDti5r0KsUls+oG/kzCGmwt2KZp149oA4EB6Fo=; b=aXkTvo+wbCd1jGv42pH0AWM5PYSbJ8XzzT56xC1fzxqXuxpxTV+Cfiz0or/3DqoO/BItl4 1JzbEPtwuaDPBHT3gZyClnRJrUJ6Ec6x31T0A8aRYRKIaDM2KpE8EcmbsM1DHzL2m+sRrQ 7YzXQPJbPLcDXUsaoh2vNEG3FHzgQ9QzS9EFDyOIdhHsaWxbggcI9SvYMwW+R4a/DzUlmY rEOcKHpMwCeUwtG/Ss48g8EqONzzei/oUQF/t/ZFSUgsZI6UQoCl7vZuuntV0+x703Q29T NoAMezIhM7DBm4eYYGCkOQCjD9J6bFRf7Q40+zOwl5dhDypc9NxUIwWFgqLDyw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810050; a=rsa-sha256; cv=none; b=VyUOmXyTqDDJAYDUfGKSI4mvZW7bGfkeZRRLuWC9pvWngqMIlTJrZkUu50KnfTjJnwm8S3 TcARSZhy7ctsqq/VuBN1hJgGnUaTzTCpZWreeJDfQmBUeLn9mSDquwsaa1F7GQ3L5W2ram eh2oRctQnzhIhhdibyTfrKX+gqouHTGab7o6rJpxjG6cb1e+RLATzly9wasmNfmGKYVQ/x hZGtRch0AYwrXdLGeQgh3j53vWwB9sZObXU9/GquJJCd64LHvF0yrFHNBYHY3XkzOR8zMY cOswSAYLWib1L8XZ7B3CwqUrSua9Usx9Yyx3vOXxXrokSDEmetaEZ2ScCuLn9w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWSy3gBZzNPh for ; Fri, 18 Nov 2022 22:20:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMKota011282 for ; Fri, 18 Nov 2022 22:20:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMKoDA011281 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:20:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:20:50 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263971, which changed state. Bug 263971 Summary: ffs: malicious superblock can cause buffer overflow dur= ing tasting: panic: vm_fault_lookup: fault on nofault entry, addr: 0xffffff= c07cb67000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263971 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:33:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWlb56gwz4hX7j for ; Fri, 18 Nov 2022 22:33:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWlb3tBvz45Hd for ; Fri, 18 Nov 2022 22:33:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YlgkHoGe1Cm0IwewJP+Z7twMAuEpnBKa773xc5oZzoc=; b=xsS3Oo+Bqmlq5xo/VFPlNvNJTFn2y1SG4UARJ86krG0Pqt2xMS7RBvKH4jHext9lWOmc+1 3InG2WDK898wVPDg4PoJX/4j0K3dsRGIrw1OwIR4QIgAwkEPSDID9jbByAFqnckwjiGFVR NiZhVw+W/8l8AflNfpIVvReOhadA/8px2RhO+g0FZUMbQ/KkX4lqEdPqce1+09VYmmbSsn rPjbZsgaCtIlyPdkbKABgEhvSqrcC28pUIGDkkBidKLYbWhQMKtYPsNKBlFDZVQYC+icfK IBNVaNdUS98LHJwxAdyqMRfJmL207XmW69PsIS/zgdiuOMoceQkZHYKlLccnaQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810811; a=rsa-sha256; cv=none; b=OTBeaRQiBTEoMbSc1bo0jWl+Ps4R/jqpo1ALYoCuA++wNp3bCjtsI+ZBz/51u5SHiDQVXu WM8XMSmSpLRYvv8dDKj74obd1VbJeQb9ngMJVS0PFVtEETRmq8OfyWQXmoKaR7srWdx6a6 VU8ABnGfWup82GnXdHh2eslsdAEE11ZMKFeMixeiEUdsT0ocxvE9cgL/IeO22XfS2iuOOa K579xlX4dauuIKmnn9XpQHmN1bAWCyvoFnvDQPggwBmJwSRa5hL75l609sfcw4kXLJUsOX Ficawq7F9ikgyx4isxexmTR5svoQdclSX+DeF/IzpdjeTvTRbhoF9TnjExNF0g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWlb2wPmzNg8 for ; Fri, 18 Nov 2022 22:33:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMXVJE036823 for ; Fri, 18 Nov 2022 22:33:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMXVfF036822 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:33:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:33:31 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263934, which changed state. Bug 263934 Summary: buffer overflow in ffs_sbget() if superblock fields are= broken https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263934 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:34:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWn32jhxz4hXVm for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWn31f0xz4622 for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810887; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LKhA3viKebArWKJkweZ5BPbv6TzRUHfQOcKNsqir8lA=; b=p7fHYgUCY6GNMsH4Bl1q+TU4wfoc3GuQjMXRGW04vc4hNwfIKW9vMjY8E5MnxmWmwa2WGb kAZ+4AxOCfp7Et8eQZw+xktSlMiw1C7nsbVFoYftuc133q3dpHEiKwFBrJM0Ph8aZLlCOx pWJMU4SnINPNMl9TYuO69GnNGCxkIp063bdumxV8EtnAzKv4HyCKMzzLbKE4K3V5uu8E46 ZTlMmXjY1RnXd5ECwmTyex7JtbbEqgzifh5SQdHUZBeqorAz3T4AmP8ilQ+CNIKlVeGXaf zsK5Yy89gULye/A/rY0ecOGwBWfPrTgDjXQSONgr4kifpPY7eom9OP8HYWopTg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810887; a=rsa-sha256; cv=none; b=t6m4/0g47NUq96mAHkvHOLTewdQhua9pEoAx5qLHG7Hr1ChrTtAt6/ZgK2AQ2CYlru5JCX Yus1MbFcz1tHJcNYacmqG0IyuUD80C5SZ/2j5BqdBpDFDuVHJhy8NnP+bjmNaZhCkgDMs9 S9x7J6rVUdTqSUg3YYX5TBEhGtaN1RvuK09UymJKRyo9ARC3ryQRZhkU388Kj5NySYExr0 q85l5+1WE79atXQs+p/KbvCTlDr72A8Gzv4IKCWqk+qvh+cY5pOFkhFIqxUXLG7ZvNKCyv 2mfT+YsrotBbl74c8fKnXLRnt0meKuCJTyqSdpdVzqdavPtLS0OgvhDd98Xyhg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWn30kYqzNFF for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMYlOf037342 for ; Fri, 18 Nov 2022 22:34:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMYlBW037341 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:34:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263836] ffs(4): Crash or hang in taste call to ffs_sbget() if not an FFS superblock: panic: g_read_data(): invalid length -268744963 Date: Fri, 18 Nov 2022 22:34:47 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #6 from Kirk McKusick --- MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Nov 18 22:34:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWn35V31z4hXKp for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWn343R9z4624 for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810887; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4kK3ZEIL2PGAUcCkGu/wlruGXd/q/LthVOD2kuHpTP4=; b=dY03iQaHR0JsNWVL4rM2ANgFo75nijyafAI7vd1So8+42HZ+znmrAaLjBpl6jppS8WGVLC YigS9iUOkI+9tDYU+UrVZGLXd/0jHUQptbufZCFW5TtvGIICF2MICdw4f9yefID+5wXTRY UAeaUDPiHDe90I7a7ig4/lOolPHvqqoQllVt+LOIQJ3Q9y1op2qoM8mSdColdxm67sb7BT 5vC1bOoPtEYnpp2gDrHgUAMmfKuURHArBm4Cx+xl/PSlOZOf6Z2ICOzuPtCecnkFvIRtAW 9qBAL+mACP1XFqZ6pHoMrytLY+//nl+zj/gsyGz0QQQOdRrAc8L2pEzfUVpmRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810887; a=rsa-sha256; cv=none; b=wWLVmsZN6TAFWu2JFf9oU4me2nlPJj0N98Ujn/lJeU8RQBOYgs6zs5IqhWB/P3QEt1OvXV fjNrWeJuQCXuCXVKXCFuYyduB/PzG8uWleXkyIw5VutySLhboHph0FXDmBPHevI+exyFJJ eCHpDKzdh1uwPpCQ1ErBUYyOCBSuIIFY6UvfvEcSxOzqj8R1UAMq2HU4JJKxdDBVkaIVDL cbCfelaRoZcRuWEgxzFVX1uJXLSyoPV+FauRvVLxGAVpZJa/vFfGktD9bRv7+dQSDM4lYj N5NS1kJ586VNYd0ZyLTHAt3+kf+WrUil9PSnSJv7xobPEl5vSSFfZBj8y3dPQg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWn337dYzNFJ for ; Fri, 18 Nov 2022 22:34:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMYlGD037355 for ; Fri, 18 Nov 2022 22:34:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMYllT037354 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:34:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:34:47 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263836, which changed state. Bug 263836 Summary: ffs(4): Crash or hang in taste call to ffs_sbget() if n= ot an FFS superblock: panic: g_read_data(): invalid length -268744963 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263836 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:35:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWpG3SP7z4hXpj for ; Fri, 18 Nov 2022 22:35:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWpG2LqVz46vk for ; Fri, 18 Nov 2022 22:35:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810950; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LW3fb49cW9kEJ4/gpXFuIW9HLTRHiL/PpZ3aXWW82eE=; b=ybXxLc1VjfMsaMW4J5brYqrPUHwBc+l1ZRQogvpC7vy5n+42WhZuqXwMecMFlfnsoX87vk boJMslgznTtOro/7LBkiVfk6KNSMMpO+Vn9bI/DQd7P0s6mRWE8iLoPmoH2zGQwx+zPl3o mbUZNJpOYTHiJAAhcmb+SWKWSSpyqdSaQIC3wYcg9lLVmub0bLSCLvvRpNV+TZFNcoBnHu XOx2ADqUIWn2o5xmGbkocMI+N1R7DTnkVNnjKTuMvjSmV6T2FJpL7roAXUKhX/OKIPzzl8 P39uo4XDXm2lu2PCMxqmK/UUjNewx+/I7gbtXiiI5qApUuZvq0WWTDAtaNaTbQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810950; a=rsa-sha256; cv=none; b=cMRAk7v9aNBMNXwAYXnViZBEVnTKdRcyZcyiQLr/rS4TXpOJ4y7anQiS+yCGMm1lByoeZc SweERJWm9E9+FG4j+Pl69ybXwPhREcCO3AtdG3JF8WenI8kB6cFtarrrsaComOB5a+PjIQ JP+cyh99GLpZjdk3KnNAu3TgS9fOGeky3TNOwxhm4EP9fJsXPmcHV+ZzYDepihjjfS1k74 4p9lsOKYeoNLY/1lEw1g0ta3AbCyO+4EDcS9qL9YrFjQrhrgpnbiVeAK1MfUpIrKFFCwy9 JPnVPYly853xveXgX4uKQT4dwB5erTJk5fH0sxazcdr+mmCHRwkckOvNzxRL8Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWpG1RZPzNTq for ; Fri, 18 Nov 2022 22:35:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMZon5037921 for ; Fri, 18 Nov 2022 22:35:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMZoZj037920 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:35:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263822] ffs(4): malicious USB memory stick can cause panic in FFS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/kern/subr_vmem.c:1332 Date: Fri, 18 Nov 2022 22:35:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #6 from Kirk McKusick --- MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 22:35:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWpH22vgz4hXcn for ; Fri, 18 Nov 2022 22:35:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWpH0lqVz46nn for ; Fri, 18 Nov 2022 22:35:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668810951; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cVzyYARy/VDiFxeyeZdfDCbb5pQWVttQBwH1h0yC8f8=; b=UZRd8LRYM/MVad2M6TqplRpm4z3hj1mxsbAGo2R8WVgPjT60opE/2eUkRIf37qFYoAlh5i mGZaEwTD70yembyCtpdhO6s1XFwTTPu4VG8y2ykujulUO++YZJDJ2us57iN92Ve7vGmWm3 cNZmRam6tzrQ41OFN8Jp8rshuCpdS75D0uuggSJp1R2F5IE/F8sPeu+Urjj2zCGEvDaBKD xmVO1AjKdsQyVr90P8NF5N/Ll5deTJNNFZUTDKANvJWERpr9kOxERwpwfKZ1SsMuTrFzbm e0KN6FP9kkU/jqxsofeqhDim5MoJz5hmfZ2XapQ2JRCNiRRhJpipNn5GMNzl+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668810951; a=rsa-sha256; cv=none; b=Pu8DcRQrUZYahG4lwOnGuvQMy3qdsMPDsXndeSFbR77Ta1r9lRbxx+jyVN1OH3BsOQ3XKA KKMj472WgEuHoN7cEi2cmzVhpGi6PayZY6GAcV2x9D3CEGrVQzaBC+3zeelja9MYPfPDLk 4o8AQKZMWZ04Du7Itlv2jnmNIFAn2hHSM3AQgxcvx1HrHLvk9P6JvbIml2tLmR0bFYpIbC OoNCCoJ7Drr5NtA/T3XuQfulUCB+tb/M4OOfgkEN7YbJEJAfHaQv0nQMe+gD9aumRTy0NL gSGPnhOCjNEADZdh/IAV9vg26jN5STwlhI2Z7xJXTemxxxRjJ+IXnbINOMi6+A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWpG6j7lzNFN for ; Fri, 18 Nov 2022 22:35:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMZoQs037953 for ; Fri, 18 Nov 2022 22:35:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMZoxa037952 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:35:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:35:50 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263822, which changed state. Bug 263822 Summary: ffs(4): malicious USB memory stick can cause panic in F= FS taste code: panic: Assertion size > 0 failed at /usr/rtm/symbsd/src/sys/= kern/subr_vmem.c:1332 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263822 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:37:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWqg43Ffz4hXx8 for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWqg2Tp8z47wm for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811023; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bJRa4DR60v7y2TDn5rMFxfqixdpQnUetaeNvxkbp0aU=; b=b52m1MCYpgrBy0UiMe7oT3+iBN4IxPCKK/wkU99qoWv9w8VTreyF8qr4p3Ql5WphdIl7tK dfU9Q5seDwwH5eaCYFHZik7r67aTB/Hzp8Ox3l0j3w1NS0jr7iRZIyV5wRhPNwRgcksvga kR6Z2JH8K8IWx/+IqoAebdzzEvGQ5oHrnn1Z7bM1EdgjC9RHRuwLNfxxjO5j9qyzgz/sKx rXSV5KvvEoSgY2JUtrtpgLJl7gIa/JKqT3eZDqdSTbQgOszarO+enzeLkDH9go8cljUAZT mGJOE+MqMJTTfHoUyyyEKXG6SjhQUdX7/btunh/kaBC/+saTngfspfOJivsziQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811023; a=rsa-sha256; cv=none; b=Tu+58VivD9jEt6JhW6qkG1vQZcWNKVj17hKQi4LCm8cmLzb3WQvWHFfCL0mlqN/6Qgh+bt 56CurHaFGt9uPXwNu+7GeEW+DUFy1TsLBEOXxRD4Yhvoykf1/RiECT+5CZxDK6ykgpkSQ2 EnawJJrF+yqWCurCrNOwCq/q8LlQyKVaWP8M2QgKCZ1p4ABTKnmV2k4fXrF7FFTLeXSajH 3wrZvRv2uOslWDfOoOO/S3zyxmZA31BbTgS8xTmAJT+S8J2riXaJEKr+ehq6NUgIqhfMXp KZ4/bijIr57OviRXdnTOTgccx+fkCTT9oBLoAssMtqlI7XWqEX5cJ22r3OAefg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWqg1Z35zNTt for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMb37R038464 for ; Fri, 18 Nov 2022 22:37:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMb32X038463 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:37:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263811] ffs(4): Disk with garbage can cause crash in taste ffs crc32 code: panic: g_read_data(): invalid length -268744963 Date: Fri, 18 Nov 2022 22:37:03 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #8 from Kirk McKusick --- MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Nov 18 22:37:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWqg6ZR7z4hXs3 for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWqg5MyTz47pF for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811023; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n9GAdkN+NPxmaPFAW8BIDCNF3segRbICcdk4QjBBm18=; b=HFESywwmUmkUWKnrWfqgdJi5SmIZZJMaOiFjJKjANDE0ms2UwnoE5np96na0/FKiMVBfuf 7XydY6XzqxQWsxg7q8i2bmWfqxXLpSrzeAN/Qkivs6S7uurzuYiwc64x2vKcONVb5gN+cM dWzHKOWxh4R69YXYduiqLv6ReBLABxdnno8gCLpcsUyBq5k7oOdNbSDCVMv6t6yUM2kdxx nl+9zbv5FZaytY2u8pJs8upyAxxMTefy83b4SDyAqD6wicgxj6y9XN9w2lF8mgKYFzwJsq jkpGAECtigOIxLh15NUUDLzB4hkU0H62wBYAc3bzyCVbwj/LXDHq2QtBCTNmbg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811023; a=rsa-sha256; cv=none; b=JNtSmXPd7g+P/HCYim6nkjXox8Y2wl5wAHP36pmZQxqc9hE68QfzwW+yTCiDbLD9QC9rAa giD6+Wz9eUMu8Rg02gn86sR6cpcdeQbnpbRWyRaGOjTWdU7kfrexQTwe5o0ffeVQUk9OHF YnOWWAMK0G7jS+zqYQbUJWObv2jumMF/7TA0l2L+uX07/mtVyuEF2kaMnuRhrlO5x4oUt9 Y+5l/A+hyYxk8dzlwlCDswE9jgsCOrzeVwS8DYrQ1JTZOl0C7XBRYLkG+J+pyXDmI/MW2m WxHajaci26E0OlZ/SzbRxV+W67uyKWaxRAQis9RrPAMlBVQo9dthsesfG3B/PQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWqg4SpQzNTy for ; Fri, 18 Nov 2022 22:37:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMb3Gf038480 for ; Fri, 18 Nov 2022 22:37:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMb3IH038479 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:37:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:37:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 263811, which changed state. Bug 263811 Summary: ffs(4): Disk with garbage can cause crash in taste ffs = crc32 code: panic: g_read_data(): invalid length -268744963 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263811 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:38:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWsQ3YqWz4hY3S for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWsQ2R5Lz49Pl for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811114; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RXE0ojWadgx5f3Q85XyFAqsx06Placgng6o2kkcsesY=; b=pk+XoqTFzX0RYSRzknbwrLv9Bp1kc2yxGgMWqZ5WBYFOzcxCLW5y3soWbyHeBsoc1Vr39l tNrXAPOak+UaoarGm2F4m4MC05isLh+O0zqaAOxmD8tfOEmKxwTTz6JhjAOHUwm7+C4YQC F7mnt5/RIpR5hMlaIBrDx0+aAdexZcHg1ohmrjzbxsYXPHszAEvxZUa4mxzCnAXcwGX++I Ep/x7+OsrAb+fLH9mrbJSGDlI4rxg2YPWSLZsMzFuNmPzgLgWc0T7CE3b3EWRgBJ66rAAV SeqXLUu1g/JZmAGNp/7UGaNZup43J0LVTsbKUlsjJ040dZQ4gYrxWkLmrON7OA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811114; a=rsa-sha256; cv=none; b=jV10DdNPi9Q4csFlLJh5GI91mE4jJILnjWAF7bbEV6K1tViShUkMnpyDGLV8oOg4TbaSPd 7wpWHXuwx8nhfk7TmraTTMKUTwDV47D+P+HroUEQ3zya3oVHd6LQe4k5VtkdXIbNpdL/v3 cdUPm8ebHKdmaDSCOvdAt+XXFp3BhXWysEer1WzwJBZqC5s5hHnjXH9R6hMY7gkqjBoREE ZNiVVA9rbdFTe5jHhc7ucljaFy/bDj/jTsRii0EVKV36jki8oYmnzRWG/03buYiKvncqLQ gHxx1hlo8j4dhKsf5csXIQDOS2UoaJJKxHjtLatxk8vmeGhy6vTb9mllBqMuOQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWsQ1Tc3zNgJ for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMcY0c039024 for ; Fri, 18 Nov 2022 22:38:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMcYoZ039023 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:38:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 257557] geom(4): Garbage on disk (or USB memory stick) can cause GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 Date: Fri, 18 Nov 2022 22:38:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #5 from Kirk McKusick --- MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:38:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWsQ6k4qz4hY3W for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWsQ5Qwdz49jg for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811114; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e9fh/luScMyMAr6awwKqhGXhpe9t+lLPvgAjLlDUsq4=; b=Pwpy3QDUtFMG2xLp1jow4ZfV+gmVD+6u6LrttVPFohhJcACyp5h3ZpsFYg5kL2iT4h0ioN pVmJzGykgzfU/OW4covnRotfGaf2bmlEJ0l4LYGN1RLpChxqr1LGdeUhufXbmvLZm4OB2p RaFLxqyCXZm8UI19u5VVs2/WzvlWzTUNAnKC7mnMKYcMV/iREQGG+qs4lJWciXbDDwq+bV lEPOoov3roBr7hZ8a5uTeBTSqa0DQ18F7SvB9Uld6/H2bEIdQsz/nAkm2gLAfoE83VeCXl SycK3xzZtDV3CUyLd9Nm2i2az1oHMOStuKbwrr3R0TXdnBJVFGHcFBQQhti9tw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811114; a=rsa-sha256; cv=none; b=fnAGkFxQE/NGYTNzuXJLlpd8mK/Mzh0dGDS36w91p2kYYCkDN3bHOYKneTP5hQ6hF2TsL7 dxFBjC+8bKsbA6PtH7awc03ffJxbgnzdTDHy4MWUg3wxzaAfwsqO5SNmfYs9YhxYVvMJBB CODN7DKZLCsLQLsZHLq/TBvL5KDczqfQhXQRxmq1y20SB3LacqcMQezLajLGvDeLdqez/w X5YK654PWFjeG+nopmGvRa+nNaaN+M0feGvaBdujViLk2w6CwhBEABqh3uNcpl79kOgkWu ZTP4tAxl1T1/axrg6b/xemVG1g39OpTvsmdP4ZhMcTjPMZcLsA7UibqesTSAUg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWsQ4S3GzNmn for ; Fri, 18 Nov 2022 22:38:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMcYQn039042 for ; Fri, 18 Nov 2022 22:38:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMcYX7039041 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:38:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:38:34 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 257557, which changed state. Bug 257557 Summary: geom(4): Garbage on disk (or USB memory stick) can caus= e GEOM taste ffs_sbget() to crash via g_label_ufs_taste_common: panic: vm_f= ault_lookup: fault on nofault entry, addr: 0xfffffe0009409000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257557 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 22:43:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWzG0Hvlz4hYmQ for ; Fri, 18 Nov 2022 22:43:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWzF64sXz4CsC for ; Fri, 18 Nov 2022 22:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qu3uH7EivJCZJarbH1dezeMCtLM9a/rFIF1Av24uG+k=; b=sfHP9Ap8/UicddSDhzRvWdaBUUZaZE/kmSpwXbvfzr3/Q9el6RLYHcAhr2mLFzDrzr4C5g iro27T8TICEg6R20ice23eT5iKlHPgeqYMQ4opAd2qzP98P8rpsjFICdnPPe2Rg+iRmo4M WGUkcR+HTCiU92UN3Xo27ITfwjRjBS7LGrHaETPtE2q+ChRMNR6GKkecaHuoks/6lC19Z7 bdKXuQDwjAqEqcyZi3qTGmyy72/QhqPtISL6LStNlnPZPoEYCftiKEPSSS2M/ab7uhiTsr A+Ny3iNiq8oxN+vFsTYCJgehKY7ZkuuadpM3DtPEn+zsvCxQmGD3wGbQ4W1aCw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811417; a=rsa-sha256; cv=none; b=URpKVQtS4Pma9Za+3DPAdXOmgJyKMBibci4utlhuyUgolP/+R3rOdW0PecTI0ZLddio2pA FP/fJZlgzASlpcUkaqsTphGdTt2Rx0YFERzlAgnUdpN3fKMZ6mVyy30NOF43C7n+QfsRA3 d4crenw2hpY6nfxt+42PtcwSZqdiu4jeuzOj5Mjl1o9ubyYTLghdfNpPyzZ0DfYNTcDz7v p1AqjfjmsWMHEMCKV/KleySSe9MPCFrbUVTRqYCPxV0J27XNJL+u34P6KJanevMD8tPdlZ 6aPP0VXDvcmMwhlrAbI+4kK88NImmu2PoKOpZ3+RN2nkjbSxkDgAVRNEQTKV/w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWzF52W0zNHn for ; Fri, 18 Nov 2022 22:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMhb8H049295 for ; Fri, 18 Nov 2022 22:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMhb2k049294 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244352] [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2 at offset 154: mangled entry] observed while mouting the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Fri, 18 Nov 2022 22:43:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #2 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 22:43:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWzG46z1z4hYm2 for ; Fri, 18 Nov 2022 22:43:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWzG2Tdmz4D3f for ; Fri, 18 Nov 2022 22:43:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811418; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ikjAsFNoMWNsrfN9dxoSD1YtiW8ONLUvJXC/J5iFHLs=; b=AsqJIHDYxW2BH9FXREu17zz4RNwdj910NNa/CTk4kplVhjjpLgwoe5BsnmhSIcuWDfXf9b sA0Ta79pgOGoB4u/0o9lcRXFOhxL5WrUWToMtmHvw3cerWQE8q6cT0ON9t07yb2hOEFFdq vn+I9ZL1TgAgTUqvhubNpmDTDL+P6WrYUzoZ5mWg+AlDmcs1e9b98Ou+dMXBloPEOOSmmU g1JFnNpZf8ZIgGzMvRuxHvMoE2k7NUit1rSqfYE9+bwQ/SVZJch6fYEaRTt9snqAJB0Nsv ZVcA6XcxvEsWN6pYmXLKp1UPJBqCi0yf1PlnGIeR4d+BzBiduQb6a0OAOJFjGw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811418; a=rsa-sha256; cv=none; b=AVaxPLm3m8pBTsvl79S83YRpHP5mMni1udPtwilO58lc53CEcLwbqAPFSL7kVqjGm9qYlT FFM1z2zFzkGCgDkZPtDbOCTxAE0KDLsMpEIjJd44I1CcssdZ9VaurG8Wf/xZSiUSaBrOfz plz4JoXiZGsRhPQFgxlvHuANvXednPxJrmcl561KjkfrGzLQyNvEniyO+3L3//ndSGcUYq LIP0qv6CwfrKVC7JRxY5pg6p2inLSJhTMeXUd1aeerDVxH6OCxNd6Yl/xmd6ET8Q4QN3kP mRGWPC8AMD29SVM4YrJsEGtwGAgKarzGv5rcqCVVuQTBf5drbFPT+EyTUv87Bg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWzG1TVSzNh8 for ; Fri, 18 Nov 2022 22:43:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMhctA049315 for ; Fri, 18 Nov 2022 22:43:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMhcr6049314 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:43:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 22:43:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244352, which changed state. Bug 244352 Summary: [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2= at offset 154: mangled entry] observed while mouting the UFS USB drive on = FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r35= 8121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 22:43:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDWzH3KvTz4hYCX for ; Fri, 18 Nov 2022 22:43:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDWzH27w3z4D5K for ; Fri, 18 Nov 2022 22:43:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668811419; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qC9NmcnFiMiY+U2XMT7sT5d20qn3an9+K92jM0kPuo8=; b=pzkv95aVjCk7Xt7lRGLtH0D4WMDTJkwSfIqe0ToiIlK6iG9bT+gxxrSg3809/OUI3wny1O rO01GIOpgLPIw9AT2dTAqHVG14xn5cR/IL8bhMM/Q5Q0y8JS0n3T8RHJbJw7oIYr5sPNNz erPFT9kB2XFQAKOwgVga+0sziX4lISBjEkIgDSUHLQUfCenf5M3OLLQ3fmu4HvdAnwiJWq gasXCFFSEdwgGP/IZXQBQfmLY6LXKzwCuamNQQUjjSbyaWPQhr6hTqLHjP6SVmUhh1Q4dy 0IWFauzoKsVxXjcrKvdh/Z4gbrB/gCeceGEKvsTA5XVxggu5k9xTL7DommY9ew== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668811419; a=rsa-sha256; cv=none; b=xXigPwYNTQMx/RIdc1tknzJZN2rblSrI+6Af6Sg8WxzWSjNWqurFNsk4N50YFLapkQZD2S uEM5xqdEuuNxn4xep88pWrfgtYOGer0pOzuJ0HqxwPYV02355GONBISwbGVqSEN4xqoy2h b7SYdHnn5iuBXs+A6ncvjH32ECSqPVhCDJ3U9KcGcuFGwxntQmuFyDzZntMql/XZvA3C66 Mr32vjqMig6t+EuMyVV62JzlT+QhI+vJQYytaqNrodun/r5vQt7lzaZuof+Y01bmFR1NGq Rwd/vmlYHseWeENmHjX92ZSzvNzhkKeO3dlf9yoVrxf1WCs/vSplDcS5wQBllg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDWzH1GQBzNRh for ; Fri, 18 Nov 2022 22:43:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AIMhdq2049336 for ; Fri, 18 Nov 2022 22:43:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AIMhdwS049335 for fs@FreeBSD.org; Fri, 18 Nov 2022 22:43:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 22:43:39 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244352, which changed state. Bug 244352 Summary: [8] [Kernel panic: ufs_dirbad: /mnt/test: bad dir ino 2= at offset 154: mangled entry] observed while mouting the UFS USB drive on = FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r35= 8121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244352 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:25:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXvc5YJkz4hg1l for ; Fri, 18 Nov 2022 23:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXvc45Kdz4Hcm for ; Fri, 18 Nov 2022 23:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668813932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1AALfT5kN6pIfxOo8G+bsBiuw8PmkxN28xMo7ZzD9rc=; b=FGmz/1Q2Xauqf6+JlND/K5Nl7kViFRWQ8Ar86emIal0sZhnI+ZkUjSXzqFtAE2h6FEQXeP NUEh91lY6YC08C7zFYHPOfU2JUez/qcFo90bz5Q8ZGWS/eu8s8Ux9SRY19gluGDb+xLZ9M pRKM+lW3trAR4QZwFwfw+2iazHLw6lZ4sCKpgM3pYbWUBkk831RFFb1OTAudUohV6l88mv Nagev65Ami7iUiydWj20kk64CrX5BISvuhs9IeVovInPKnctXZv/POtL8ifeglxP5qa9zB xO0hVFrGDcB+c+F+d7yCU0Sbf16HwA9ObtwhCCQUUbMGsMaovnklBDadtgQn1g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668813932; a=rsa-sha256; cv=none; b=MsHtdXvkz46MWAW/sumRMWG9vADlNmjMXFHzGtaZgFBQ5NlYYhfyKL4qGgtgeWLk9NKAmc qVXo6eDieN/FzhlzY5aLDDQUqWGW58k5nLXm9ccoIrr10QhZ7pjcbRWNtJWcsPV7Y4BjQV w+VWVDrZGztLYnjj5ilIM+jqpOQXo5bOhQo2XIG/6/7AE3TWB35yinY/zSwpn7O+x9viM4 v94hutSPA5E/4wJOHPCVlomonbLCBRvRMubnYMw64yr3EWo3dwgWqLNhycMzQXcrN9mp+y nKKUrp+u1AhOPEblylSzqgboSfo4poH057KNB42kN7RYV3D92SPfmKFUchXOwQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXvc33HjzPnm for ; Fri, 18 Nov 2022 23:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINPW53005960 for ; Fri, 18 Nov 2022 23:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINPWNq005958 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244351] [7] Kernel panic observed while plugging the UFS USB drive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STABLE r358121 Date: Fri, 18 Nov 2022 23:25:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #2 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:25:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXvd1cCyz4hfq0 for ; Fri, 18 Nov 2022 23:25:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXvc5vJbz4Hxt for ; Fri, 18 Nov 2022 23:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668813932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UcvYCHynU171Joh7pRt0KZFit5tsMPeeHWW+EJK/LK0=; b=ilOhJPi/cI0ufRNVIOhFCAoqN+ewJZyJ8CjK7BeWnGdnsAt//aiNzchI70kf4TUnraEEFM Py1suIOLUU11OvJ4/j5sFYAoVqhZVRayKYQISqaBmEmdDykDP9bc8HHNgLoigYJTq4YxHY GomPaadD921iCkfNZYatLkpprTh7BELQhSdGyx6o/moQR4gepZqhyW+CCb94yJWSJ1xeSB wZCrIV5H/Llg63aMhdMS/6ACj0ghjCLOjDGebHLhTIY4IKU2Z35VRauIVW+eOX4M85GD3+ nqch/lFjDdM4RI8PJyrLAXYOKm74muCR8zHRCqgZviNA/5mHCiN+RKFz9kMY5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668813932; a=rsa-sha256; cv=none; b=XdMCZpf6IdbCfn9wRNZ4y8nePhbEFFwLxsMtuw8zT27QDpo7Z4pt7Qtlyi0JQocxiuDUF/ tw7AdsSY+9vlgq/IyWjnVeKYfffc6NczBzImkDuuKQ6qxMN2IeQztH8pAFH7iJg5qvNoep lSfRntsSQskgmmjoxAQdAmo/CbTEdciAw6VxPld1Wl+ZZktQvk56DTi9jFTdsIyripWoik QbIYLXHL/GqRvN5Zzjs558BfTZEAKuEvAwCnWTteGCNd9iPVCIb9PoBSMQZhIOT4sPe8il +EEw/FGqLP1xwRhZgLSjFHY5nb9gE8HYYb8AJqT6gkoLnmwzcwAuSGa6MJix9Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXvc4Bq7zPnn for ; Fri, 18 Nov 2022 23:25:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINPWdq005966 for ; Fri, 18 Nov 2022 23:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINPWvH005965 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:25:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:25:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244351, which changed state. Bug 244351 Summary: [7] Kernel panic observed while plugging the UFS USB dr= ive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STA= BLE r358121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:25:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXvg29dTz4hfkn for ; Fri, 18 Nov 2022 23:25:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXvg0ywWz4HtH for ; Fri, 18 Nov 2022 23:25:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668813935; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=E2lWVtQ2+Auc8pUfo4lXRk+8MlSJYRH1cIzsSTftvhk=; b=LwtOVTBRwMufAnzfA1i9+ft7UTUCYpyPTONV1N4iyXBFfbchktjsOcJqOJmZbaWqWCUMtL IXC+SgO31kOyHvWm1xDgOWPNWuex5ujQ4yuX+4EuwFaNEL2yg9+1TeDPmTY2vm2XCqf6IE jo38P45ycA+iwFcjpSnrLpst/QIpNrtnWvrsfpgILN3zpN7/Op41OFIbcjBl9XFB35+ea8 j2ZnDGBmEfl3kW4v6+QKzQJyEyJdEucZvdzp1ReUAVRd3E6rqGPFGtXN7MaHELcYs6hZvY TFfnx1VYZ4/JtFdjgbBf4Fka9f/B0PLmX8APuoz4VytsNTy+3P2wKnEo3Dm5uQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668813935; a=rsa-sha256; cv=none; b=L0+YZiAkAoizZ2Mv+9791lcfIuoJrHH4YP6UOpqVXpjDl8nZ1jJNI7DrXpOrrsv1Lfw9mx d71CIGZ2NUZAtiahErj93+Msc25sW3eY0f+XKBt8/xO5NxLY3tVqsjd/3d9ZK4+uXIQVNW 70n9atNPxq2KET3Fm52+Cxi2+ZZlgZD6T5JMOoTmJIkidpRt2KX17eKjpY29LJtYb9MF/P eSuPVAWZGwfZwkbauHUDFAko2wb4aKLqScD3As06CQBHuRfuTQ7PMCguNtS+TvTyakrALS XP2NFdezQJ1P6N1VfVVu7FnA4uMao82cRFQbg4lFEURYAifuLSMEftR0Up5iNw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXvg01BDzPks for ; Fri, 18 Nov 2022 23:25:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINPY0T006036 for ; Fri, 18 Nov 2022 23:25:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINPYVD006035 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:25:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:25:34 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244351, which changed state. Bug 244351 Summary: [7] Kernel panic observed while plugging the UFS USB dr= ive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STA= BLE r358121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244351 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:26:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXww27c7z4hgB0 for ; Fri, 18 Nov 2022 23:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXww0xcCz4K2M for ; Fri, 18 Nov 2022 23:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814000; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FA5XdNyY9gS167olLxdyolnLMw8z318WyOGGg2PLak8=; b=aTZ/yVAPpNCG3VkI8IH2Z4V9J4VXLsJQ76X7bc2Iine/q0MaoNsVjlFZRfDJwUlaK2zz9A 0t8CU+8frWNBEGpCYmpB++DAYe7dW0fjsfQMFnhd+RtB6iHEJ3x3FRRcs2P8rC+/yEsBUL GyzjMAFIySyHBFmiYgQiFaILRJbg2uVEcL7qBOr0RlXy6u7rUBwBRrYGUNuajQa0fZIlsW ll7EwjA+kKAL45MrDWMehPb64FYfvSv6E7YrdcRUdrsFrG+/r60MyvJuuTmatM8ClrqMNj UTs6uRWrbZWtZi0ZZ4S+m0qAG3pctLadbNM/wBWeAPd9ZRYh2iV9kJpnEajcQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814000; a=rsa-sha256; cv=none; b=vM511t9XO/NcFAxuYNzsfM7FlQHlJk6LLAOOJE8LSYlqoBezGUYnQ/R6pbJZFPGkbHTLkM 05pvoX9y4LTbQ7gCRikx1hDbdbExmQLcJTE1uMLu6qFtoHmGGgf7YyeF6hj8/5PuZg0Rg8 qS71ZXMU4JuAFmL5Fr+t2LHJ9szI9iolYa1nbeoK9iQlobrNa00inERl8Nti7cffdUTBK1 CjkU1m+j2WTfTbUmrKs30W4h+2HG5uxFqI8XusFTfh9TBKfuS1gVBpEsZTA15a9ni1UI/2 gSSl6cBzwQWo2VMIInTAV64Wn1NRwCqgIiLTtV8AQBMFY64sKT2JlENXwSa5CA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXwv6nn1zPw0 for ; Fri, 18 Nov 2022 23:26:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINQd3c006446 for ; Fri, 18 Nov 2022 23:26:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINQdjn006445 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:26:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244350] ffs(4): Kernel panic mounting UFS USB drive: panic: getblk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Fri, 18 Nov 2022 23:26:40 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #3 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Nov 18 23:26:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXww6djlz4hgQ8 for ; Fri, 18 Nov 2022 23:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXww4zNVz4K4c for ; Fri, 18 Nov 2022 23:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814000; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=axujENM919WeHPCT0W7f+/1ibPE9ZkOkY530DLfHUWQ=; b=mPcbFiI5HPs/GUKEzJ/OBaP7Zw6pPeHsm210Q00/2/RlstEwXZXhlsQKiudNc/WRgS7RFU RZXDrTiM5U+nFlzbjXrXgUCtP7WWkpqLgUzQTYwlId7iO/YJ/3I1gW0sBScQD0Q+8YCMx6 J0eNYu6zn2PT5NDMrrp4manSzWtphil3b2AtYMBSGIFJFG7xDj6yWEO4BaxEBlsbBW6LYp fbZZYuRxDdYro8diwhEoPUWJlHWwTOredWBLnX9gym45d92Eku/9vS5GgWfmkkgpa5Jzq2 OmlRmGWvKaqgjDG2aDwvoJDVanzKtvrZS4ajrReWQHUu0mCmTdpzNJ+x1F2FVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814000; a=rsa-sha256; cv=none; b=NPWwnTjH9z4SO0+dR89M5oz4NgRyxXGJFKjWzSnj0iDIuQX3kUoBz6eVcltwqF/2+Yjkho Ir6bYIr09xDQ5O2R94MMDoOOgwXApQsIo+BdF4wME/kw2qFbJQ1ZudNC0ZGAckFHSSfhMq fL4trv/NQciq19iR4PJfMQhPQmw6q6dd/cMjtn9tf8Tr+DEXpoplLQsfRxST5V34yPQdN9 FweEfs24Kld72PekgZ2BeV2OwBS0QqgkbjFgtvjrYBnumfAkQpAWFVs7y2g/d6C73xzVX0 9Spzuu9psT5MV1HZYh4ggi5uSoHlXeW9htG79XSukWDmGzGN9EwTTwQvKrze3g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXww44W0zPwg for ; Fri, 18 Nov 2022 23:26:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINQetK006475 for ; Fri, 18 Nov 2022 23:26:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINQe7H006474 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:26:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:26:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244350, which changed state. Bug 244350 Summary: ffs(4): Kernel panic mounting UFS USB drive: panic: get= blk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.= 1-RELEASE r354233, 12.1-STABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:26:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXwx4gHgz4hgDF for ; Fri, 18 Nov 2022 23:26:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXwx3YrYz4KFD for ; Fri, 18 Nov 2022 23:26:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814001; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=05mlatUEnGaDmh6F6fg+9s83LiN1ryhH8nO4Uky3Qu8=; b=m5SyUbyXAqfBwGubrGC8Mnp8kcOz5zKzHxt4IuL+81MG/r2KaeAM0sizBHTRAUQHI7z67G Ge4DPvYy1ZWvdqhCuKPQ6SSCNahd75oeDewhM0+Gys3bEcXdvVvCM36QcMGIEHlUwcaCpN P6OFy9pvpLZ5VMgDzo3L2GTCfxxXEwh9uKDoBBigDdktMIzO7U3FU1gnWrKymKThgk+fvh VIviDMu8uG9rQ6C/R16wf0Nmxa4WrhHS+bMFNpv/2+aHzge1IHpHgln2S9/IgqjySu5li2 sVTkjbIeWLYDqNZuIBLhwA+uWWezbIPScJJDKejZUXoDft3T5Va1McNsWNYsiw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814001; a=rsa-sha256; cv=none; b=I/8fOipSWGs9VekEBYKPSH1331Z5tDZo/JDLFZvTqCKJSbmfwt/ODF2qxgwlAZByCq7ors 57lOnD9wVJh/zSg43ewnPFT+YxQWMOBemblGa57u6HCcOjepF6lG2QvGOcjltVD7V+KYH3 7NiCkhlGs6D8Khf8ps804IjX2Q2OLXwGn5WxqbqOcVu42rDoPkxXwMyBTaTVD1JXWPGisE BiCtWMslFa1r3hmzt+bzZvJjD48DH4rYzLAoB2F3kBxnSxQm5pW0W3oWp4uw35XS68Kur2 WNVmcI6fGgmUMfNpm8W7PQM5bqKDxTZeQMxQ2oJ4e7OfmasC1QF9xfuz+09QOg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXwx2b5RzPw3 for ; Fri, 18 Nov 2022 23:26:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINQfT7006513 for ; Fri, 18 Nov 2022 23:26:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINQfhW006512 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:26:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:26:41 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244350, which changed state. Bug 244350 Summary: ffs(4): Kernel panic mounting UFS USB drive: panic: get= blk: size(75776) > maxbcachebuf(65536) via ffs_use_bread() (13-CURRENT, 12.= 1-RELEASE r354233, 12.1-STABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244350 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:27:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXxt62LHz4hgTX for ; Fri, 18 Nov 2022 23:27:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXxt4Xpyz4L9W for ; Fri, 18 Nov 2022 23:27:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814050; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=C+yJCQ4rmleGialclooh28yHwRZNBbWzT4nl04fwuBA=; b=NNSkAk19CONsxnxhFI3SQz0aKEnXiB08f9RNqN5BlUbcRpUWj6IuIYu/KkDIOyg1nyJxGH 4W401CLj5EuJ1qs2BUCQL1S3mO+HCodsBz5Q96tIwGXGB0xDZbVb4rLzgPjt6EybR10HGA vmi8l4/ijRjcAudtCO+OukgFG8ueLG7NSnpbSgKnOpJPTboirS+EeXTqspThHK7u20Vs9v 2tEQx4S6ejCrsIjaLuZL5bJfqgB8ke4zYIGFr+87tbLNxQltKASIHaEhietSGa4NrCU9B9 cAtnZ+Eade9Ge06IO8VOnGd96XKrh7Xny+lgwWj2A+b0oXlPItMBwGaFlfnJHw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814050; a=rsa-sha256; cv=none; b=p23ICWqKYTMKndF8I9kgx/JjlMo2fvwzkKN7DhjPNtatacNNTXTdYP3kLNvy9rhSV6K4IO JTCWqyNb7EFr1W19mIUdyxhq0oQTXmW21BColbigYBoB2Rh5FrqA1qADq2HiT2TVhBriSI 0HS/xwCRkAf7MmgYIyqsVhDUi9ST9LYCbrCwTqPXSTdrYk7fICwN/wZYc6cpb2kGYqN3LJ enQFUpymEWczKJAuyRTWG86MRFaNoFvDi70owX4XzUBVyq3T27Hnw3O6gs2EKblg9Y9y+i Xsa0USubVHVzH1NUSvz7lKYzHSyLmowZGpOKl8NYdcFPhRCHPukVVhsNNajDcg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXxt3dySzPky for ; Fri, 18 Nov 2022 23:27:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINRUfk006868 for ; Fri, 18 Nov 2022 23:27:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINRUhF006867 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:27:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:27:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244349, which changed state. Bug 244349 Summary: [5] [Kernel panic: wrong length 34560 for sectorsize 51= 2] observed while plugging the UFS USB drive on FreeBSD 13-CURRENT https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244349 What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:28:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXyW59QYz4hgd4 for ; Fri, 18 Nov 2022 23:28:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXyW40ZNz4Lkx for ; Fri, 18 Nov 2022 23:28:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814083; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/JMrEFBMbvXPCVIaqLa0V9CRshbDw4QcK/u+V9Gd63k=; b=KPRZr9AkV/UElQbHCGA97mqjFbq6xZrACc2dvyuRQHhR1+mMzfevWRxJK2+TdSkyUYIYxP TECWWPhz0gHcpJpNKa9VhKzmfYr5kld6/BDgm+fCc+0zjT0ekt8BkeYJZ59Rkn/yl0xrQA L8qW2/fHvGw7mmLtOdMvKkYp+q/X9lqMMnioGpILpzQ3gcViecbJAmt9m3DDGFD9LdEh1Y Lc0hfqx+keJN1ILk5dgCqj4Noj5PPXbQg4dJSEMQiLha1dwpUXKL0Va7Ms9TemnqSQ3cZQ ywHxm7WXStMR3mB38ZQpqemwLRSG6ByOGR19Ta75xTZyiDWLkLhqcmYT4epIEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814083; a=rsa-sha256; cv=none; b=GClCeFreJRJoCZkf7GPolmzPKrx2pib0wSUqH7Fp847QA6OOUkKWyWhs69cZOeUvFWb/LH Qpp7wbOwisW96eknP7QPv7gTUV977o+TBxo/u7K/cJraf1xruMXSuG3ZtCO0yGwpRKDmTz R9VQOp/VyM0tJWdFAenIYkuUskmEv2fdvleDLBnZJ7SxT5maXUrmT6jdhuMboDbF68RiwK H47y02OV2Yz99wJbBqRyZ8hRzkwG/jhuoyQkOBn3zzmnwJmUsnQxyRhUbAMLJPj3B2XENC v9ORil4JFlg91kGdL6QRoiW9QqbvDIqzvq87LBJF/VBVszdp2IK+RY+/nNPLaQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXyW36XrzPp2 for ; Fri, 18 Nov 2022 23:28:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINS3JE007109 for ; Fri, 18 Nov 2022 23:28:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINS3Da007108 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:28:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:28:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244348, which changed state. Bug 244348 Summary: [4] Kernel panic observed while plugging the UFS USB dr= ive on FreeBSD13-CURRENT, FreeBSD 12.1-RELEASE r354233 and FreeBSD 12.1-STA= BLE r358121 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244348 What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:28:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXzB3Zhlz4hgXm for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzB1v9Kz4MFP for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814118; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DAxBoRSVcMepw13LWlc8SCaPWOmTBOHumwcrEpqVfBs=; b=iKcmy5+HjUC9WG9PVlDT6KOTRJdfkec8dbr0esfCcw/rWZ1C8f5pvimMRp2zL1chYLcMD7 X+T9IdTZPXq+t6SxbXOLqVHAmtoJeU6xKMqhmcw5rd6Xeo0BKt6Yxry4vijhSV74BfsTx+ cop/I3ll0Ra+9Jy1j6m0jSx830ipmAhwZeNAD76ADq1xij2TWMHC/fuqeubCV8hYfrpnd5 HpICQBqzyVQB7ofLD5TXiwjKR02xTEQ3JcZI01p57YqFeG/iqUQRV3sg0+XqKyHpvttH6F ad9LCNZNcUI61hMeL6gyKRs+XeXTv4F0bUqoZW1JObLgvfgoRig+iIdjYBQtWA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814118; a=rsa-sha256; cv=none; b=QT4+IJsSFDdP1D4XvcTnhSzg1QBCuVdUPBYAHhuglm53Fn/rL21SoFWeaxtIcLQ+qy+gRJ bhVYKURdzuO7mEbTdmAsHnhYkxXXIHjk/a5mUtmx7evAyqlLXd6EX/RFPtN1YPQX4PIr6+ kuVSrg3DWr5ReDJFGFqmzwvpkyHbXI7ReY2eFOnY/LBT1I5OzxJyezDI2UdLsYBoEUgBgJ ItOUMD+wzeqD3Y2RhFb8LD7vesGQujvBEAZuhBUF2HGLZQlgpaYO3eDzLJdbre/z6S4zpi pyXZ+x9HuCWkNMQbFzAKPDejh8RAhVMqI6/epMy7FdClZJlOPVVOH05FXmeewA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzB0zxVzPl3 for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINSckQ007301 for ; Fri, 18 Nov 2022 23:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINSc4J007300 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244346] geom(4): Kernel panic plugging in UFS USB drive on panic: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( FreeBSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_common() Date: Fri, 18 Nov 2022 23:28:38 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12- X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --- Comment #2 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:28:38 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXzB5cBkz4hgXp for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzB4S3Dz4MFQ for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814118; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wLjvIDl1j65PnSWcOcTjmHTIMey1R4rrdVqnBVLqB9U=; b=qwwL1euJe1wm82ylAK6l/7E9fCUoicLu8ZoawsckBDmWRLe/WB4QSmT5ZOMpr07T3laKlB C9TUmdOtnDfMOJ1jR4QVzR0xnZGcXt4U0T/g2jR4qRCf8Vjp/bgcW+fngFdehOFSI5BwmH lrdGIb3NpFyF/nF33ovsUM4sRv5SO9AyzBAaqCPMoJZTJa0JWFniCs1LfIbHwgxHcCHt1t /N45DHBWCcRBadpTdzwvKkkombbs8RYzZaU35gB+6XuFR2iEzhP1HaUlF/wT/S1BQFA7fg qkYGTgtb/o2siwr1QLPHo6AH2DkNI6jOdEQ+KtGsRm42Fplf1t0dhDnmZQMVfA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814118; a=rsa-sha256; cv=none; b=rs2FzYc97JsW9z3NPiQg+UXeRVN1FqP46ZJmJ8RXgCb+lAqb6u2CyFsweGekc6AKspjfkd 31JfKwxyqRVQQvTMm+gW8n7IxUja/c2Ii0bCK5Mdms/oNuEUMzAvTf8BUFly1Dp9mVcPKc /8ggu/gQQbg0cw+aOC5sX8V6Lqt4jGv4LLcxjfQM6fghNKb5FN4SC5gkxlbX42kW81mIwM pHkbUeGMRoAE255RSBzydvPnMaTOq9KhI5qFWn19Zq/OXzQVpDHQHS4Ykq6HACzBxq5oo4 Ds7gThB2pMNEaDkyABzqWL8qi5qc22ts8mGqumnLBl8dQsM32x93SL9c0xhoCw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzB3M7lzPf3 for ; Fri, 18 Nov 2022 23:28:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINSc9T007315 for ; Fri, 18 Nov 2022 23:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINScXY007314 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:28:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:28:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244346, which changed state. Bug 244346 Summary: geom(4): Kernel panic plugging in UFS USB drive on pani= c: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( Free= BSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_common() https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:28:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXzC35Rhz4hgbR for ; Fri, 18 Nov 2022 23:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzC1Wt9z4MSC for ; Fri, 18 Nov 2022 23:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814119; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=i8d8Wt4H7c7mHf6TuhwhC7h6EMLqVOeaay4WUzYzvgI=; b=h3WzJbyhUXiZQQMcOXCaBJV2TE+GZseuRVfzMKSm7ycS9GVyQQdWsI4hDpv1teSaeieDno uYb6W6YGewo7PWK0JqLdHS6bDRzRWY7b+xrNh5j46queU7HoEBj+GpMt0IhpS8Yf+HE4Us qffBl05E0da6MiSrX2/nYRubSF0zoaUl70uiIdBegsU06gtoJmxiJlwR6wCKMTU+LzE8+D n9xsNatMKMNUZgqLb2qTjhPzZ99dVqhQ1vhWaqU7qsDpRDWsNaf+jS6y14OPcerNs6lyMY W8Ox1GgZrqHKwIQjys2k3OlNcv/IS2BvALUccXqSlmqq7x11Zh5QfidgUlJjlg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814119; a=rsa-sha256; cv=none; b=E8dXaKEfCU0+8Yv4Izlc+cKDLlP47J66TdWyXakY25Z+lH9+PkD7vyqjGYiw9E6Fmx9z/K 6Epzyo5UqcEmYDLWGvLpgxqPYm/XR2BtJX7dngnei0XsYUKJC/kjAk3sC9A2zKRnkzWgsX RIpXrgVrUgOxff5ahduDzMSKeT0JTD2akcWYHrq7vRWkTqrmYgHTJT8EaFmfnGCRVWBPlk iZmE5gG7SGT0sDc2YmZSSjljLeA4dZnIpMsyGJ1BQC7y3JRUcazRH3MUPlKeSrmxW+baf5 mu2l5hjU/FjNQbDSE2J5Oj2LNlr+IOtflVCwDQTuNxnmfd/LIZakSPBp3lmjeg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzC0cvLzPw5 for ; Fri, 18 Nov 2022 23:28:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINSdUF007345 for ; Fri, 18 Nov 2022 23:28:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINSdst007344 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:28:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:28:39 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244346, which changed state. Bug 244346 Summary: geom(4): Kernel panic plugging in UFS USB drive on pani= c: vm_fault_lookup: fault on nofault entry, addr: 0xfffffe0032000000 ( Free= BSD13-CURRENT) via readsuper() / ffs_sbget() via g_label_ufs_taste_common() https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244346 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:29:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXzz4VPhz4hgbd for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzz3Jdwz4NYb for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814159; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=namIW8KmkVmvgbe+9KtdaBniISUO+tPx4myvHkgDm6A=; b=xUxI1UVl9yPX8+6RBr6qdwRB1Yi5wrOF+OfIlhvGwBFxLTRlwRIAH4YtcPTk4S2+QhzcsH Zt9xrJSZ6NYopxSrk5Uh51d9rHFJz0cAb9fSYXiA3p9WbH6L/ka/T974wRviIx/lKnWL4l 0lvYgvh/zk0xFLvtA2Xdoil13/OF4Oe0dqyZuot/uO26ljvWdxCMM2fugWbRYU1B8iV9Ns zKi7qJDdnCextzypQh0CbDN4B3XQMpjI5B7zFjoYRHStdZP3eJTd5t69AacRjiR7Q4u4Pd XWzBYh30h5Q2sar9rGiWfqf37Ud61VZ5s2rp9WzVZ8b0rb+7kqEbz4DotxA/Pg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814159; a=rsa-sha256; cv=none; b=TLMPtVdFcx4lDN4wi1iI3Q1xmMsihsCB0uXtVcnN4YOdOm5W4zDCv6+LNnZ012IKnPyaTe s5HHIlrujPRLoq9GrWTHKmYiJ89yV463CO8XMPV0SMene/wn5TsgqNGYShClFySlmAAabW u7PlqqcI6Dz9dBkZFL9scolaymKbJhE04soTsq5MMTPD3d0Bx2bU5MTypGZRs+FMrER3FN tu+FJjBGWGRkKvHUVcW9XmW948ZewgM3MoWnh1vNT6lt7Y+BKIFhmAlyQKmPIaRICMdVoO cWH4WUb+6LlqLhia444rdAyETB9efDT/h90LHxbJE+4d2XaJgGV3OsVsH6+BZA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzz0CvMzPwq for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINTI0N007687 for ; Fri, 18 Nov 2022 23:29:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINTIhV007686 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:29:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244344] geom(4): Panic plugging in UFS USB drive: Memory modified after free 0xfffffe003a559000(65528) val=4 @ 0xfffffe003a559000 (13-CURRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) Date: Fri, 18 Nov 2022 23:29:18 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: geom@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #2 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:29:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDXzz6Tg4z4hgbf for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzz5KNSz4Nhv for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814159; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5Rj2BTzAaCZMMmHO3hVcYGGwo3I54hIIYHmkJO28h1o=; b=euggLx7jl+VB4x+JT4Y6Y5eFnCUtkQ+sZSCMpVtpCYf2A0nynxfJde6X/FraiHAYilJXjH Pjg5gvXq1z+E8PaiTpERDMxdb/1HlMNkXLXc5w4nZaUmtfZjABz3gGIM0K3NiY95EnVezN IVooudpQXcOHXuvf69MyX4kj4ltEpXv/foPzdIxmStcyvbz4NupNdmjXvKkwpN1TVMFAwI pQzE2nak6YzBpdqd7eoIUpbYzSqkeedyBCuUm/GgyPauz9AzoZVQbx9UvxtA1fCKWUzjn4 jlmywEG+qK+e+NO/hn60+SZy3g+IckMiJ9eEpl7Kjl+CMvWDoLeqPpDVSRzvxA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814159; a=rsa-sha256; cv=none; b=mh+cIqajH9mEMKWvgNFHA9jts+WtoC8PrfIGb4+ekVMOTXl8eyHaERdJhjUBWSYnODcUJ6 kBpqMSkKbnAH+pF3nElEDZz9rBJEfKboZ3AOAoQXfzsbTDkzv0sla1+5G/szWkJX2HVSEa rdfzJwsAAtfzWh/Azu1yXKU9dyzajXeCtYpU64GBV1OvbjTr3L6iXOQ+64iCM0XBlE0/8F K8kZwpNTABAQ/cvdqGGmjyarh6qcAvHf87xjz0O3J1Hi8KBsKga5rywWxYaDNj/I8hsQ4Z hDOP84X0XXmZwmRW5hWBJIa7AX1Q9IKlqvgmUVV03dAPsrJNUJiPwwD49HnovA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzz4J9qzPWn for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINTJ2m007711 for ; Fri, 18 Nov 2022 23:29:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINTJcV007710 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:29:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:29:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244344, which changed state. Bug 244344 Summary: geom(4): Panic plugging in UFS USB drive: Memory modifi= ed after free 0xfffffe003a559000(65528) val=3D4 @ 0xfffffe003a559000 (13-CU= RRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:29:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDY001DV6z4hgbh for ; Fri, 18 Nov 2022 23:29:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDXzz74qkz4Nj4 for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814160; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0FZ0SXR47xYQp47w5Ua6yFLUun8S022Wd2k9x3xKwNs=; b=W2gp/2X7FmWka38MWQh+zyD/csWgq9hm7a3VWuIxUh15YQOsJ7fhgfxesOVWBmoTY4dp2s WF8RCRfRYhus4MVl5hxX2FhrGRqcJnVVulV8MD9RDJ9oIujIuo/Frv18mKEWIHriKOMfth juE9O/fb5WH3Jjf/8TuSqJOLpwD5ygKFL1XGGCuT1nZR5TepIY6U0BFpNeXKym729n3j7K zW44NzmYAloaudEBz8QVsji5g3M634+cxLVOPPo1NbleQ5LR0TEDtlndswWEmo4UrqTdmL CmNzVUVzY9/JaZT2vucs00v764krD3Se2FiRgVR85c6IeoSfSqeEOpw7kxqmaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814160; a=rsa-sha256; cv=none; b=YqtuWsVvzuuDSr+jtBFS2mYRRng8mDJTcE6ieg+wqaCUIt5qEmrwpQxg/6GI8gMjvBIebf 0HAU38GU8uToff9WKFUhIBFBSkw2lmK9IDFRAUxfe75GJ38GazZnfbe2QJySp3Pt50qQ26 qoTLOqLsXoS2KcigwnnTtxg6x6TArZ5Aj9zOrJSnbsY3qwWcZ6bWfz6D+phmZknTSpiFk8 G+U+eA1CtqDikL/zNGp2YwgHZRN7Smfchk6seHeVceyQ9bBvCfRb4zL9uXYLHGFt+yE/f7 ipU6EQhQZHlZm1vBnmKWaj7tpP/RYLe3xtMsZtmyNrm9uI0sPTT6Yl0AAWibow== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDXzz68lJzPwB for ; Fri, 18 Nov 2022 23:29:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINTJnE007723 for ; Fri, 18 Nov 2022 23:29:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINTJ5l007722 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:29:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:29:20 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244344, which changed state. Bug 244344 Summary: geom(4): Panic plugging in UFS USB drive: Memory modifi= ed after free 0xfffffe003a559000(65528) val=3D4 @ 0xfffffe003a559000 (13-CU= RRENT, 12.1-RELEASE r354233, 12.1-STABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244344 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:30:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDY0m2Wwgz4hghg for ; Fri, 18 Nov 2022 23:30:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDY0m1Fbtz4Q2j for ; Fri, 18 Nov 2022 23:30:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Or73k5gw/r8k4PHj77PuMiy4KJtfzRs7fhazzE5uMAc=; b=HcgG8Yovvrfy8QogA7iCvbu9ryb1NNHefHBODnwsEl/UnDAkEVZGWxfXwXTdIR3vWzZol3 BuGMbqNYMPyygtlhfIvi6c63H1gCIHXMhjYZTjqnvguVGhuIKBvVV4U2Hf+2TseMbWTFOT a3Nl9O3gxi+ErsZ/ztuZIwONeEo44SoDBKC9aVpbjMMFeVC2/gtgHwEO5XRJI30egxoAi+ XSFwei2Y41IHV6xNCLn5Zn87P9GdOtVJ2sdUmbIxrIcW+fidOhfPvx/GocsclI7Oib+Zkp wYaOCICckPdkMYPiic8mwcl4H+yg9nqnS4bQ1tmoKYpqThL8093VqyreoHtdQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814200; a=rsa-sha256; cv=none; b=DA+qWVnaNw2j6CbzSxS4wA9PjC92TWpN4jTMElgme1W3tWjO2TK5K1yywaKIb6pPyzogne oftSIcEZH42RdVs9cIk/sKzu8RcalM7unYp8GSezJbUOKM8QSInvyQvOFutHa+HSIB5rjH zG/synrP5LmEFljN5+oAV1D5LviMpwfc9zdiVZvngp77GQYxXjBTKEY40UUQoIxi+tckVv nkz9V0GBR1lmIXxFkKkY5lzk26xyij7Vxs42lKJj1BSDdQVRPov80DnIlkl40lX1LSvP7B IVt8X2bNr7aJdx9uOHgZYhSnmUuJfDqFEARMUVxzB05rP4f1p72mUisx/BnAfQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDY0m09XyzPWt for ; Fri, 18 Nov 2022 23:30:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINTxLl007923 for ; Fri, 18 Nov 2022 23:29:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINTxbg007922 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:29:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:30:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Bug 244384 depends on bug 244342, which changed state. Bug 244342 Summary: geom(4): Panic plugging in UFS USB drive: panic: g_read= _data(): invalid length 11866112 (13-CURRENT, 12.1-RELEASE r354233, 12.1-ST= ABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244342 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:30:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDY0n0GzSz4hghm for ; Fri, 18 Nov 2022 23:30:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDY0m68t1z4Q9R for ; Fri, 18 Nov 2022 23:30:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HwGFxCbLalhw2Fan9Vn44wSBg0HxGWV95OSAPX9eRHI=; b=vAW/ups9+5hKA71x0gD6CwdZrHrR2GS+W1P/OMJhB+GB1VFG/L8+g3y1Cg1xaFT8xZwqQ9 MLLyC9RsUZwjj2+inu7hfUmsKrXRofdjglQsKAXMcgNBzrf6Fl5WN7KZvPswaeDksPjFzR xgu4+VjO/2DCEIRqAgfeh3NoZYhncPQNPhEhrU5KYFOGjnkQXexj7TcBna/eO/szyTCV8W aPRKeUw9u1RY0E1ryZ2SyQBMHYdZ0WeT1ZSJftsYcBs2qRb0pmt29Xz3NbfFNyj6xlAdLl eutlkkbJAI1NS6WqOQuU/7T/4eW2ImNKDZESmCawa4nG+F+X5Avz7I0x/pHRPA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814200; a=rsa-sha256; cv=none; b=hVW2OviON66bqDKwKzWMBtvY/hJ7U1/VgMvSHbFkIpYM6qcoSzT3Rh5hG+iMQbO8XEM8g/ EbOK54nIl+ew/yUpvnCOUFRmB4uvA1mlmExCP4vjDdWW/FUCjYPbye1JlS4Cfxmr0ZDjOr msZGgR6oPClw8c2Xua+UWXz8ShD5raywsTiXnANRv07Avm2tSIrkz1md0+3TI9Z98mcuX2 LNLTLtOyTrvFemYbaJ937p6C85vOYXi20Plq/EJ+NIQVl2GDX696X5RJlbvD3VdDr61l8F DUetEEOiO1x0zDuxi9CdDfaDARQB/pFoI3tKZs6YEXuHkegKhZg2t1ATfJmbFA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDY0m57f6zPSj for ; Fri, 18 Nov 2022 23:30:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINU0wI008185 for ; Fri, 18 Nov 2022 23:30:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINU0gX008184 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:30:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:30:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: dep_changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Bug 263979 depends on bug 244342, which changed state. Bug 244342 Summary: geom(4): Panic plugging in UFS USB drive: panic: g_read= _data(): invalid length 11866112 (13-CURRENT, 12.1-RELEASE r354233, 12.1-ST= ABLE r358121) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244342 What |Removed |Added ---------------------------------------------------------------------------- Status|In Progress |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Nov 18 23:33:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDY4Q6m5Bz4hhDp for ; Fri, 18 Nov 2022 23:33:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDY4Q5Xf9z3CDg for ; Fri, 18 Nov 2022 23:33:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668814390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tniY3cxSfFD0jnybMUqjM1hhIKViGedgpbySFhYwKtE=; b=beLdNBs+6+QE8lLpZctgUYGmBiOXV0yZpUeHUldO4fHLsm1t/Ne/50saDAvSrfYAK8TIlo eAS0oy9dQ9hKlfhTjq3Qa6yyqp6Ay0aF3fkiQN3ASlIWAPLl/RvaRCy7Ho68p7nIUl08pd 0n9w0snjJzqL+l7qvWFoxNaYYQcnFYjifGFrFC/0evWLFmH/e3YMyVNX18bgJ+PeQz6JN+ FxPhAucHgd53KK/oGP81T76v05YAXk+T5ny2bWl6xGysskWm6MjqW8uaXsDDBxRA1euXod 7TBMfUm6rO51eLzNICimrGqVw+jOz8pqkpQ4J+6HiygU+2i83rNfkxDTrF8AEg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668814390; a=rsa-sha256; cv=none; b=P8YEWy57BZYJ4wJgwH5bFc+QxdCS0ESYwEVDN5Ybq0BQss4YRFbBu9r26U7ynoibxe12RY eW2SZL3pTnwnJ1jcU18hRw2v7xbW7zMEmimTX4GXmfUWLK+hDY6pRbT1rNO97PiOfyGXd5 hES9h5YL3bM84abTnNJQ1TAnbj+oanYRZG9chXZ9DzyibMi7sAORWcFspXrWf8EQTYWvAP Nn6+wRBPvMg+REFlZ3j3wl9AAtY4VudA47uvCMk10EQbBvR8x5L2J2Y3VHnVc7twJKyw1Z 9Xo11W697gO3YNX9ylDhyGP+jFGBjEQ079WWhibIt+Mi6QFzmI8gXrjKHtDa8A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDY4Q4c31zPly for ; Fri, 18 Nov 2022 23:33:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINXAOw019964 for ; Fri, 18 Nov 2022 23:33:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINXA5B019963 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:33:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244384] UFS fuzz metabug Date: Fri, 18 Nov 2022 23:33:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244384 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --- Comment #3 from Kirk McKusick --- This class of bugs has been fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Nov 18 23:47:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDYNR3N3gz4hjn7 for ; Fri, 18 Nov 2022 23:47:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDYNR2BQQz3DGK for ; Fri, 18 Nov 2022 23:47:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668815223; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gsQHVSkAnZI0f7vEXJI67U/WHycKNtY0bZk+yihDWgs=; b=InOSw6ndmmKmDhtBYA4xmpPyqaMFcFBJJDGCHiVx8PcEllkmYhCau4F09WmO+EztaFLXcC khJNaWq1WwamEkIup6F1WEjBNqTVkMdi3xhdUdz+MqaQcjjiHOxPWNGj4Rse6Vmng3yRWe f48Px09xgImMLFGfHlxkpMUIwD6HuTmJYW5qxmKvpR7zeMXeUOP3fkBFci0UVpQwWaquUB ILDuzAJHtidMhTDlC/u8xx9ZGQ7jLwJR993AbYX8Al2k6YPAjStQ5t/GELUPkC95RrWJ3y zJYdteHkmjLHa7m54cACHcI74qj46Qq/yugmhPmr3ZV4nsyrW7ftNP6sDKgQYg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668815223; a=rsa-sha256; cv=none; b=eKr8guB09MtoCYIFazzyH8S0jeK60gOxjvXFDbRCVfUlVQVvX9AnPRLq9AVE3hcx2OMQ4C CBbug7oNj8Ges0Y29IU4086dJI0D7dMnXBMTLBdybvGR5DmQCpnHN3oi63pMeCiUTBDj/O GM7sz+419JFjqm5Y0kGbrI4kYTlxKjsNVQicQPysPUnXUSXBq6FIeh+1kQdPp6HfeNb2IB oraQzGcyPoHeG2bMsAZ7P+sZeO59GPUvXbsDQo4+1kd99vXk7Qk6N55LFao8Wrez6K/N9Y Bip11CJKAdXNSIJZX+r/TKoxw60NjOyupZPL1UXk+sm2S8INK0DmbxdKY3PiYg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDYNQ6tySzQNX for ; Fri, 18 Nov 2022 23:47:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AINl2wJ033329 for ; Fri, 18 Nov 2022 23:47:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AINl2pa033328 for fs@FreeBSD.org; Fri, 18 Nov 2022 23:47:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Fri, 18 Nov 2022 23:47:02 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #10 from Kirk McKusick --- This class of bugs has been fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Nov 19 06:02:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NDjjM2mdxz4hwvr for ; Sat, 19 Nov 2022 06:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NDjjM15hSz42WQ for ; Sat, 19 Nov 2022 06:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668837735; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yHRkxBByVRwxJl/cr24WcT/AcKRA8h6rz+9fKTD0UZs=; b=T2IRo3Xg2XrCXkR3re4A6CpVRfAdVk/a+CxIXA/Z09ubH/Jz3+uB+E5AkERuVmyPxfPbKo szsDW88nc+c/slwiY+BTWQkzdk4fUKvkt4Z0mFvhaktVnAsueNmRe7nOk3VqtmfniQ5h0P +H91oIx8Y/QNvNFrSu/uBWj6RYMGr2kHRxGH/lUSDx5sQk2MLZWAwSpLO2J6mEf+enY9ny rL3NGdkcycgCo7XOQyuTIyPg0w1GnCbD+Ix7eSnirMpwkxTWOMp2Tl8idIxl6jc9S818WB IZbDU0RJe4I5rDfeE7iknoTwIgsMPadHDs7zI3vigTDi5wzo5ZxV78oxJbMJsg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668837735; a=rsa-sha256; cv=none; b=co7VJAOJ3qxF0pmIK+jF8XquUZPMsIDcOwnQWOCmzAfwSiwD6GAKcdp46x4pnlRJnQIjiB Af+58TOWWNPzs0cy4/WM5mPpJ3D7qULYdtQzH8Pd32V3pRUIlSHCloEl1Wc66s56aI4TSb RFttL4LBqQwLLB3jQByF46gc6swbmElkEeVrRchvoUTjpNjZSzVsLDY7leIC1P91ctOwWH M8D0UNbBIrSqnrm+HqFW/wr5B1wQ9ugSGYazNnpS6KrYauPK3+JjC8TBbOGCw85nd7abs9 o6Jd24MoGbG9AyxByQx+MMQcWGvu0XYvpVV3IO+6FYdYvmTc1N+WhiE4G92dzQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NDjjM0B0TzZsR for ; Sat, 19 Nov 2022 06:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AJ62Et5084075 for ; Sat, 19 Nov 2022 06:02:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AJ62Ers084074 for fs@FreeBSD.org; Sat, 19 Nov 2022 06:02:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265209] fsck(8) seems to ignore a read error Date: Sat, 19 Nov 2022 06:02:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265209 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org Status|New |Closed Resolution|--- |FIXED --- Comment #1 from Kirk McKusick --- Fixed in 14 as detailed in https://reviews.freebsd.org/D35219 MFC'ed to 13 with commit b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe on Fri Ma= y 27 12:21:11 2022 -0700 Too old in 12 life to be candidate for MFC. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Nov 19 19:56:45 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NF4DK3Tx4z4hp07 for ; Sat, 19 Nov 2022 19:56:49 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NF4DJ3Ylfz4Lst for ; Sat, 19 Nov 2022 19:56:48 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b="PpED/ubH"; dkim=pass header.d=messagingengine.com header.s=fm1 header.b="W 9HlPxf"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id D340D5C008F for ; Sat, 19 Nov 2022 14:56:47 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Sat, 19 Nov 2022 14:56:47 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to; s=fm1; t= 1668887807; x=1668974207; bh=cKQ7cQiWWWx6Xgn2FD2lhLFnJlAzyI/4biH K9fV5OLI=; b=PpED/ubHJgQq/Z7AQqY6Nc116fm1+RRtJWI3UfiDaYXzDKpRva7 xqOdoItAOr8Ie14n15TaHUcGdESexrfEmFc6J4xoe6xatfHaEcE8O+FxXKfdlddB 5FcSZ1uJIfILlIaKY7aWpYBoaVXkt3qGxSdnEdRxzCWhWb9UkxldcE4KGW8RlACd 8CUJgypUmr6/M0xOfhkR5RfCkOuFpSxxVspWK4VPPxGVTkDOEtl/3iImjW6A4GBh sdAeNZiir5DI9UlCxQCNWmQjzdewkkBEsmXtuWDtRcce/z62o2vQdJI4PMLlt97Z YRGEukHGU71fjVPncwc3ditfSjgqyJWJ/Cw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1668887807; x= 1668974207; bh=cKQ7cQiWWWx6Xgn2FD2lhLFnJlAzyI/4biHK9fV5OLI=; b=W 9HlPxfKAdNcQJSta025583tCWSheMkphZqbPxdv/2ZMlvsQ6QfvleiDTPexjqih8 wRfL1Em4vDSnMOGq5SE1iubXqQ+vuP/gouihYjeSiYdpYE/oXYMlNLiR0CYF1B+c fMekdNSgCkuQ8IhVSl+lBfiqeb6VPhw4Sv+GmlhtlZotEEMZFq+bbXcCYFZL1Qca 09U9LsQ/MbOL67JFtfkEvA7iWoMBd4BCI2uKuROsweXpqA7EjFGJFPN4m2qJNiwf 6TN3NH6qXT9FsIHLQKWnQVNsfpeIQTZW2Bu2LnRxWHnVOMlPED9S4CTc5MtyUWfK ZH/6AgOCqzUOxNUB3xdWQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrhedvgddufeefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgrthht vghrnhepveduffeivdfffffghfegfeejfefftdeiteehteekfefhvdefgfettdeuheegff eunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepvhho ihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 19 Nov 2022 14:56:47 -0500 (EST) Date: Sat, 19 Nov 2022 19:56:45 +0000 From: void To: freebsd-fs@freebsd.org Subject: zfs properties across versions Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Result: default: False [-4.81 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.71)[-0.710]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4NF4DJ3Ylfz4Lst X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N hi, I'm worried if I zfs snapshot a vdev running zfs v5 (on 12.3R) to a 13.1-p3 receiving system (so OpenZFS) that I'll not be able to restore subsequently. Will restoring from 13.1-p3 to 12.3R be expected to work? tia, -- From nobody Sun Nov 20 07:04:41 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFM3J453Gz4hJst for ; Sun, 20 Nov 2022 07:05:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-21.consmr.mail.gq1.yahoo.com (sonic314-21.consmr.mail.gq1.yahoo.com [98.137.69.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFM3H22vMz4N5r for ; Sun, 20 Nov 2022 07:04:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=MX4WdKCH; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1668927897; bh=JySt3k2hE9IZL6IGTQ8ysUrkvQFMGXnvibkHZ7AeAVU=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=MX4WdKCHxQDr3Qt9n8NhDaEj+ZHaUh27ZJpciulFbobiP1RzFNEEBJZa6oXiCsLIjvRnPH06lzsTR0GVNEU0CY89nUuZfS5OkDpBn7O65Fx2ukS9Gc3wK/mLoAuA0EbiWhEJCbyIiLiM9rzptNIP4uUaHKkxJWEiY0seWT1pBMLSEdtSoRBGkw/anHGX3D5/hG700N8wDRreQpKMe4a4zCR3IRk/iypfjrtyHGfTcBOfpmEwCHLLt1L7MVkWXF1ha5gH45w5wcsqAgetM+V9uZftEBdWlL228giTRmeov62UobqD7zkEBxXyP8LbiIcTUFfS67LV0WRYfbKlXLzHPg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1668927897; bh=9lN0rUstdTKBrqEFof4Y0VdZ3M+Hjvm2i1Koinx/j/r=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=mVULdtsvnWsoVbscPuPbJACWBRelJAATzuyNLKUHwmEUQJGn1/YQH61xPhLv371JnUSqmjeUk8IGBKj6Gztun9cd/f7boigUIpMXaxnNk3keLZ7ddmvNADKfLs39RTw/1M2FXMdzbOiMp9Kf/bGQIdt9Q5FMOM/Nsf3YbXE0cH8FSBh30w5m1h7kJkHYclnRjCAv4wlGFfaGJubLJOufPD5Rovslc2hoNmjYStN0c4UaG8Airz3lHYDqy0dJzBSBlqk/IvAuJz8W9JWtSF99R1SzVB+ucYRqkDPvUDCnskvWQRhIDYk7cluRQ8F/oXrjsQpg5f95WmlR07aBP9H0tQ== X-YMail-OSG: TV4.zjoVM1kyBg3U0Inktgcn5M5jk4UFOTV84eOLtCv2Te2ofYPvAsF5W_UimQ. mDssO2pNF8QgbgJ.P5QLV0KjtWrXBGslasx4CXE1o7kA_WHLOKios6EeM_1PlkPvQCznaNsxon7v m4km5Q2G71JdM4WVe93wKikvXO93ID0iRnAltVPKBEySm71dgNrrZjUp5r6oyClTIz7.CYugsdym FoQmLG4v8CDdfPuadDaXmsuWfZNigUc7hZg74CCRfl2nndGdlzisihtRq5QQsgFopA7v6rfjhm7g eIaWgRDbY7FfcRAstioN2Ecbl1Wpfc3S8Eb5kJu7k2sZyxgfU.UiehzWMyJF9JjX6g5pUNUrhxfO D6ptfjq.ZpGV7HAj1SR7xg0F7vgu19dBw0ljomNX_gaWHMJaTC6hG2iMjZljcSr.2mhZZhfl8C6f Smb3OaiTEJfDUwTZaEAiuop2xEQw5pt5C9lxEpalxz10qFMeomFIHRv5sxqtB1U3fZR0ZvL8ss28 .JVfRRSAyGNPvf0n3HjnEoQbtpJr3QEMEh3CZc8AUMaYKacVhuQdIQpzf7ir1hxeLz9CqiU_Oy6R IlUmQ8mp_P5lyjIHDaFRX3iT5BXX9k8hQk2kWX3TX3lFZNc3kuTsSGapRAZlDJ66pLWXyBuXiNKI DNW4kNQCSsJcq9SmuKZuBKqMWHq39KmbOblnOkXV5TegVKGBgXksVsZne5pc.0oNzbT3S6f08SSn uTv00lN4t4Z7N_OgjHjfSbLsCpLk_QRPG8juWOHpUFeZ1v3wlMyQpucMT6YDINkje0.uyxBEZmYc nzAjKbNIrVL1udx6z8PMUsorW1tUHnFe1dmUgKsIUCm4S4Qa5vTldDCJ7P1jO0QZf69jJJKI7XOY gk0GcxNRe6GnrESWguQNm2CsncrmAw09InE7ERZKldx.3sVZ3jNFAGq61wfslt8H4m.RmcYLOAuL K8jtvVaPt9.M3MHYYyNnLOSrWSfZbfKFgl8muPJM1wrskgx_qy2UpwTkuPpuOH9HKkEQqnjoFgbe GMon5oUz1ytUkR.4teh7eiQqPI7F8aTmjrw_ewJNtiCCel7F48JSNEUY1uST1CeK5tkPuGWtgOLO ZEDXMNi9lk697Tz40G5lakK_z7yJV6Fgvmyixlpu0Rmzg6xVEGpb7NrJvID286zTKVe_y8iSzIoQ uWgwbJnQoRjZacw4gwZaaDZYUj_y_5Zacy4nJ.32VdItjHMDaYtk7vXIXi5Dev1DCWSVfG8Bl1zD SbOvIcH8v0pXYmWJOe6xjXutdkWeEmeyJ5hQtY_xS2Xd.eziFpLrcN.LJNfgnyRgQaXVzn2djm3n W0PUE8gh3vtf9tWuE.9sHpRTx0xi6FpED2StaH_zKSXBcdDQJMw20wUw_ynHlYGSQKEjK36RypaY MeYkKTtlDwZJJcgm5kxU6e6EIIhT7eCiwNm2iuDXOvuX5fcPVt29ob9wENoEdpefhIoE0a.12HCd p1hMUX4zRBzwwJs5KkowapCmhi7f9jcu5jggIHGo2dPgjX7cRibaspG6ZKpqbAPUz4PhaDDjvMeE S1GEmNqPmKPwVcZ8fbJ4_yzANb.BWePoIVrdvsJpixavtX4cqnAsC1wZ_uQ2OHxjaHe6f3CMqAfs 7MSeFYPHh5PSVXoX6S_6qRxNNXWqiYZAmnaIgFyw0ewRNjTRKRGITWj74HpsaUArowKUDlBWTENo daGUZZ2wyPRDt0aL9g5S5Eun0NZ6fl04X5b584TY0mRzMV8podZwGE0ZaolWb_7Mcgqmu785N43t Am.8QMaOzosaszVklU2qksQUZR5yltLw3OI_NF4Y4E2063SP91i0_6o456h34k.Xo4chTIPRWk8N OoM1Alj_uZqVP0_LtuSh18OtxBH9ryNW_b_JDAxK9Ra4x.T1BtwAVQAFtnZiX8a0M533rzOcT9Co vnCLP4RBdf0no4fOjN8g62XL2DMfVq84w1o8zPUIncZ3VjUQdoSF6aNHxW8WIqZx5zO2KjZa6Ie5 aYVQ6_KJB5CnicjqIjyti4KyhzJn1LeA5MROfQhi2AhScPZcpJOKtCZwqq3JdTn5o9i8wtjTeV68 d5xnMm7iTdIbt8JgTmqdoDnfWZwOSCw.lGti25N3vwllobyrKDJh3qipou.shwI9DXnnBF_OLtxQ LPHLTA0Cp9UUSwaPEzWSZ90Tq1jB0p.OVXwfIkxgR5xsXrAPH.w9T9igkwaHnELr5VziSFOtZeGH XMoLBwKQ0VPHyflMFn0QUqmVBz86W_EngQ8FYKYTZ689q3_e.4CBzxWK_8fwTX_WNvv7PdVS.mYd Peg-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sun, 20 Nov 2022 07:04:57 +0000 Received: by hermes--production-ne1-6bcfb7fb87-cpwkt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 152be051ad528776b66f9011bd325e0a; Sun, 20 Nov 2022 07:04:52 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.200.110.1.12\)) Subject: RE: zfs properties across versions Message-Id: <1E43A143-D308-4ED9-A8C7-650F2FACB2A3@yahoo.com> Date: Sat, 19 Nov 2022 23:04:41 -0800 To: void , freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3731.200.110.1.12) References: <1E43A143-D308-4ED9-A8C7-650F2FACB2A3.ref@yahoo.com> X-Spamd-Result: default: False [-3.44 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.938]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.84:from]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_TO(0.00)[f-m.fm,freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.84:from] X-Rspamd-Queue-Id: 4NFM3H22vMz4N5r X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N void wrote on Date: Sat, 19 Nov 2022 19:56:45 UTC : > I'm worried if I zfs snapshot a vdev running zfs v5 (on 12.3R) to a > 13.1-p3 receiving system (so OpenZFS) that I'll not be able to restore > subsequently. > > Will restoring from 13.1-p3 to 12.3R be expected to work? If you list the pool features for the relevant pools, does the pool on 13.1-p3 have anything active that the 12.3R pool does not? How about at the time of the transfer back to 12.3R? Still true? Such are some of the more detailed questions involved. (The following is from main [so: 14] but is just to give an idea.) # zpool get all | grep feature@ | sort -k4 zoptb feature@embedded_data active local zoptb feature@empty_bpobj active local zoptb feature@enabled_txg active local zoptb feature@extensible_dataset active local zoptb feature@hole_birth active local zoptb feature@log_spacemap active local zoptb feature@lz4_compress active local zoptb feature@project_quota active local zoptb feature@spacemap_histogram active local zoptb feature@spacemap_v2 active local zoptb feature@userobj_accounting active local zoptb feature@allocation_classes enabled local zoptb feature@async_destroy enabled local zoptb feature@bookmark_v2 enabled local zoptb feature@bookmark_written enabled local zoptb feature@bookmarks enabled local zoptb feature@device_rebuild enabled local zoptb feature@device_removal enabled local zoptb feature@draid enabled local zoptb feature@encryption enabled local zoptb feature@filesystem_limits enabled local zoptb feature@large_blocks enabled local zoptb feature@large_dnode enabled local zoptb feature@livelist enabled local zoptb feature@multi_vdev_crash_dump enabled local zoptb feature@obsolete_counts enabled local zoptb feature@redacted_datasets enabled local zoptb feature@redaction_bookmarks enabled local zoptb feature@resilver_defer enabled local zoptb feature@sha512 enabled local zoptb feature@skein enabled local zoptb feature@zpool_checkpoint enabled local zoptb feature@zstd_compress enabled local zoptb feature@blake3 disabled local zoptb feature@edonr disabled local zoptb feature@head_errlog disabled local zoptb feature@zilsaxattr disabled local "man zpool-features" has notes about the status of individual features. Some features are bigger issues than others. Just upgrading FreeBSD does not change the status of zpool features. zpool (feature) upgrades are a separate activity. (But that status of FreeBSD upgrades may not last forever?) I do not upgrade pool features past the likes of, say, what are indicated in: /usr/share/zfs/compatibility.d/openzfs-2.1-freebsd until there is a, say: /usr/share/zfs/compatibility.d/openzfs-2.2-freebsd also usable on the range of systems that I care about for compatibility. But I've no competing criteria to worry about that would lead me to do otherwise. Some of the disabled features in my list above are not listed in openzfs-2.1-freebsd . I've no clue what features are possible to enable for 12.3R are --or what the default features are for 12.3R . === Mark Millard marklmi at yahoo.com From nobody Sun Nov 20 14:39:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFY7X0lCpz4hDhF for ; Sun, 20 Nov 2022 14:39:20 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFY7W21LMz40vW for ; Sun, 20 Nov 2022 14:39:19 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=HpIthIpr; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=N7DaF0R5; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.25 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id 74977320051E for ; Sun, 20 Nov 2022 09:39:17 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Sun, 20 Nov 2022 09:39:17 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm1; t=1668955157; x=1669041557; bh=ovX3tZXdxK RdhB0nGwZOc6onWV9OMYgqBwoAlT/R+ZU=; b=HpIthIprabG2CDijoFXEZ1Bb+K I7nq9QnMUxOvH0cgDy3F7FIxuszJrgoGaOSW0tROKp32sEPshYHlAScCNCO9MZ7e cLFX6pExhicSuSA9Sp7WDE44Op0lCQL3FnXrcMYxG0BKG7d8Q8AzuxJYr3dLgJ6T AV0R10BxtVc+WO3t2MtkeNX8ROkO2VurTN+2Oq7goYpx+19K+eRCZk/SQfYCPnr+ t2Xwfkt+12xKCPdl9w4tNXRa2wm9UyGKziZY+BxK1KGDevGXMIpAfr5swGLgsFUS uDlcHWJoY15K3NSFNvjg+ngqO1QiF0xbJ5kfWjp2B6KYu579LH6NCNbseQkw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; t=1668955157; x=1669041557; bh=ovX3tZXdxKRdhB0nGwZOc6onWV9O MYgqBwoAlT/R+ZU=; b=N7DaF0R5vpqmztSdzzwgUIEYmV/g+pF/Sul+9NsBrN6g ZHXj3Y8tpnld1rga6yRwATg+wQX/oujGA9WcvMrhh3RFSkx3kLoxutZpMhHObW9m hGxyc1U/4oNSvU9Mh6deYYC4c9NSpz+fvHJW2l7dvxehqRDPfOCsuSuYDyeJtFsZ b/hno+nhUH3hw4lgiBJZBgKKj8c8U2nSZfgSwUHg+XpJn2rbOnI+0d/Doof6qvym 1Px3AL6jBSxybPiPHvPbgzGwhB/LJAjreSAHGZV5yG30knI/4Ypc9StD0DB+s4Lb nSszJQXo0Gm6jsTyc/9TLVDEmuAdgQf6S9fcZvszlQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrheeggdegfecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sun, 20 Nov 2022 09:39:16 -0500 (EST) Date: Sun, 20 Nov 2022 14:39:14 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: zfs properties across versions Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: <1E43A143-D308-4ED9-A8C7-650F2FACB2A3.ref@yahoo.com> <1E43A143-D308-4ED9-A8C7-650F2FACB2A3@yahoo.com> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <1E43A143-D308-4ED9-A8C7-650F2FACB2A3@yahoo.com> X-Spamd-Result: default: False [-4.96 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.96)[-0.963]; NEURAL_HAM_SHORT(-0.90)[-0.896]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RWL_MAILSPIKE_POSSIBLE(0.00)[64.147.123.25:from] X-Rspamd-Queue-Id: 4NFY7W21LMz40vW X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N On Sat, Nov 19, 2022 at 11:04:41PM -0800, Mark Millard wrote: >void wrote on >Date: Sat, 19 Nov 2022 19:56:45 UTC : > >> I'm worried if I zfs snapshot a vdev running zfs v5 (on 12.3R) to a >> 13.1-p3 receiving system (so OpenZFS) that I'll not be able to restore >> subsequently. >> >> Will restoring from 13.1-p3 to 12.3R be expected to work? > >If you list the pool features for the relevant pools, >does the pool on 13.1-p3 have anything active that >the 12.3R pool does not? How about at the time of the >transfer back to 12.3R? Still true? Such are some of >the more detailed questions involved. > >(The following is from main [so: 14] but is just to >give an idea.) > ># zpool get all | grep feature@ | sort -k4 >zoptb feature@embedded_data active local >zoptb feature@empty_bpobj active local Thanks for that Mark. I think what I'll need to do is to make a 12.3-R instance and then compare. When the source instance was installed, it was FreeBSD 12.0-RELEASE-p3 GENERIC. If the comparison doesn't exactly match, I could install I guess that 12.0 version instance, and then upgrade the OS to where it is now.. It's not important that it's not the most direct way of doing it, but it's *very* important that the destination can be restored-from. -- From nobody Sun Nov 20 17:15:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFcb8651Cz4hg3q for ; Sun, 20 Nov 2022 17:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFcb8516bz4Hnc for ; Sun, 20 Nov 2022 17:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668964500; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UuOGhQibIQNVFJ2qyNU99KAI4b4aQeocXdfL3A0d1iE=; b=p3QOOQb4FzVD1XqdL7+dFYbT9XAdzQvgdIFVg8DOvgO+jLP/mXVkzSqfFDLXar+JHsHBbM ijiEVrOiJxr60eztFLg/8PQP6xnMTjl02OwoWPM+S3TlNC4vFqshiHIwxJBZjmVJaARhLo ox4D0Wnfx6sLbqQcNMRbiozpRHMivXEQYPKo69D0lJQ49/xgfQ2c1860HlrqRiy6dUz67N /d+U6PXwW33BYEROw5RLCTcQ9ukIbj2ffKjJKXU3eSiwbr1euci9rsbXckFvF3xJEUC4Rv 5eMxscbgRIdSkQ7s/ZjoXiuHMH7izjYVwNER99vDxFxwec982UZityfd97PRMA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668964500; a=rsa-sha256; cv=none; b=tU2O50IAxzy0XBtNdkvKn3wbwmsigS8fiM/ohwm7cdN2qRJ8Cm8S3lW9AKrx9LdewpD6ci OEHXlbksXi1daiMv+DWPl2U07HVaFWBqxPrpomnREwlS0g1xlX5bL0yMNDl9ZL0gA/qR+R qGhRjMiqh1u3VxEctZ8tuKwP+KdGEjN8xJsPJzXv+YuUp9MW8pJDqLU1nF17lbDFhEkDCk itegbXlv9hQaMz79P+AddtlUatCv5Fv0y6lrRK1IBDLUmLO+41jt4ikS5kEq5dtZD7jbfQ z0ojtAU9Iw0bnXjyhyu+vCHHOQ20r61s6JAAABEMQJd/o7xBRsbUiom2Si/7wg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NFcb847CRzXCJ for ; Sun, 20 Nov 2022 17:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AKHF0C2039923 for ; Sun, 20 Nov 2022 17:15:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AKHF0XY039920 for fs@FreeBSD.org; Sun, 20 Nov 2022 17:15:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Sun, 20 Nov 2022 17:15:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 --- Comment #12 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dbca262f0f351e3881d478b7a9764c91cc= b83c260 commit bca262f0f351e3881d478b7a9764c91ccb83c260 Author: Kirk McKusick AuthorDate: 2022-11-12 23:36:07 +0000 Commit: Kirk McKusick CommitDate: 2022-11-20 17:13:49 +0000 Fix for tunefs(8) unable to add a UFS/FFS soft update journal. The reported bug is UFS: bad file descriptor: soft update journaling can not be enabled on some FreeBSD-provided disk images =E2=80=93 failed to write updated cg. The UFS library (libufs(3)) failed to reopen its disk descriptor when first attempting to update a cylinder group. The error only occurred when trying to add journaling to a filesystem whose first cylinder group was too full to hold the journal. PR: 259090 MFC after: 1 week Sponsored by: The FreeBSD Foundation (cherry picked from commit 5c7ba6bdf83fda82cce70f384e2ec8218f13002e) lib/libufs/cgroup.c | 4 ++++ 1 file changed, 4 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 20 17:30:54 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFcxW0W5xz4hhwg for ; Sun, 20 Nov 2022 17:30:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFcxV6Wt6z4L0Q for ; Sun, 20 Nov 2022 17:30:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668965454; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=p8r00XR/CjnqP7e5O9t/FDTlaeXMD2UFz9idsR3mAWg=; b=QeBpDhnXPJ7+yU+H8f3ewyWd7bohBSr9yXJvz0hsZpXk6hThMxQlg3dRBEWiqVniDvgCpJ wuOI6zxOAOI/JFy35lK7Yn+hkxjcYW2WbjtL/z1wPQF9cRUJxO59mafNNKiTxnQbUljKQl MYmnZornvQWg3Y/tRNKelZd66G9f5pftB9FYdAeYIGr8++ViKSryNNMAKczQUNSvZyBmW/ vuBZS+GxZgBrQoONsqigQwMvMhMeJMX74osTMYMAa00B2AerjzOl0V1rd1g3rxyHmw3BSZ Jgh4rcie1q2soCFu4crObBzEw+8AlMctOi2v9sEXCIlXY2JGzl5Af/5r1/m1ow== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668965454; a=rsa-sha256; cv=none; b=iqdrWleQvGvePPq32Yeh1oyCuM0dl1k2835k91WeU8qd2w1741RJIEFCgDa/1utC1vYwoB KBQb1GK8mgSoHTD9nSdKw9I0OrfFLCPO/LFp1WegyMq32WZrsr1oggjTlGyIxbtD+rN6ZG b/ybeX+uIhHKIokGXQh+BxIOnhl2fTnw1rBobc6mUrvZBFfYINidAg5BuTTgoRgCh48W1z 0EhAXuTeTHDRO5+xi/R6OmQys9JGTrBPEKfr7NnS2GTqm3HuuZPA5bfX1hsSNXyHTXHIJo IrUKF3hA9PJ04z/2fRpq1JJWTMSJzu1q1bVOfm3S5hIPLlpE6+Ithv99NgcUug== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NFcxV5YsRzXkv for ; Sun, 20 Nov 2022 17:30:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AKHUsnx056246 for ; Sun, 20 Nov 2022 17:30:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AKHUsUn056245 for fs@FreeBSD.org; Sun, 20 Nov 2022 17:30:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNTkwOTBdIFVGUzogYmFkIGZpbGUgZGVzY3JpcHRvcjog?= =?UTF-8?B?c29mdCB1cGRhdGUgam91cm5hbGluZyBjYW4gbm90IGJlIGVuYWJsZWQgb24g?= =?UTF-8?B?c29tZSBGcmVlQlNELXByb3ZpZGVkIGRpc2sgaW1hZ2VzIOKAkyBmYWlsZWQg?= =?UTF-8?B?dG8gd3JpdGUgdXBkYXRlZCBjZw==?= Date: Sun, 20 Nov 2022 17:30:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259090 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --- Comment #13 from Kirk McKusick --- Has been MFC'ed to 13. Not relevant to 12. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 20 21:00:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFjbk0CqJz4hGKC for ; Sun, 20 Nov 2022 21:00:50 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFjbj4Wccz3D1h for ; Sun, 20 Nov 2022 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1668978049; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Le33+KK/iLdII6Y8q04jcP6Dqvdxgb6cWLhVGqsxwls=; b=dfoetNHfF5h5Sc19pbKN0grx98TQTPbwqU4CNsVkH/eAB9EHaGMFd2jw1Yc4pLbkunL4H8 l5i1MZW9PLEsw1yzy47oBhDx6uzpMpki96Bb/xgouF2IbNsTjt+NHu/FEZuh1yh7FZ7LlW XNW8HnfSatf1VS3iGH8A41btAgEOZd8BsscagtN6Bk4HO4kAQ6USVfJru+3wvXz9ILFMLm 0UBj6z4qCi/5TuxxYVp+QkbdxnSDecnVPzICDjPfaBrn+zDa0ruckUcI21x1s3daBb4VWk 4hb8QRLAJjVsIGSxQIq+ae+Es3UVq7gAh7HdlGDOaqdzaNzjv6+pbldBHSR7ww== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1668978049; a=rsa-sha256; cv=none; b=T8m32COtm46bzIWSQCN+w51JvX8p5rVUp9uOQ6En2P5ThksAT0PApAVGKM7v/ExevJOgCk pfi/O2mIFM0C/fkGe0XhgYgFlbKZo4lmDqUH3JUBrlxG44U4TJoFzrwAII4+Z24xiMtLsO h9oK9tqchEp0FFbfUgun7H/09hLXaN4jIaG1oL4JhDL0VCfXS4Gxnz5KNHL51JL5x0DNEv RKI3DLRnzWAod6UVYq04hSbBhK6hpOT27bKw/i7WwAuCOINI/DEfoR61Fz9rxY+7iiL9tJ M0346M5hEOcWGiGBh/UOk9Y0GCrU1ZzN7qiwFzyI9UsUMubdwv+4Glw7ikrb2w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NFjbj2n8Vzdtc for ; Sun, 20 Nov 2022 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AKL0nk2066503 for ; Sun, 20 Nov 2022 21:00:49 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AKL0nYV066495 for fs@FreeBSD.org; Sun, 20 Nov 2022 21:00:49 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202211202100.2AKL0nYV066495@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 20 Nov 2022 21:00:49 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16689780490.20EaC8c3.61250" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16689780490.20EaC8c3.61250 Date: Sun, 20 Nov 2022 21:00:49 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16689780490.20EaC8c3.61250 Date: Sun, 20 Nov 2022 21:00:49 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16689780490.20EaC8c3.61250-- From nobody Mon Nov 21 10:33:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NG3cr6SCgz4hdCv for ; Mon, 21 Nov 2022 10:33:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NG3cr4wJKz3qYG for ; Mon, 21 Nov 2022 10:33:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669026780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1nTswioOKN2z2gt6wmTKgUY0SVp6fJQvbWGAsiZQa+o=; b=Uu/rSFDZvtlm1aj90AUltM7UDjGevBwRe9JjyyUy32MkiAspbgPjieYRHkomSqDwL/l8hi cx6iqFY0mNAkU1/JWuBiu1hp9KDzK6eKF3KiVP3SHb17/PDyL5FwURxBhoBg+ZNCiGA0qJ BjcE8O4rUTzacu55SKFeSrcAgNue/lEvB6Xo0QEGxjVcNYR59+byTJ9XgPsAFMKGTV85Sq zVSIj6nNmcwU9IqLC+GB6/kpt+7+odtpPrqno79qbiz+vb+C2QaZtN9vXME0HqNYrXRZKc EEHmObzpY52DgbEMnrjZsVOVcpaJZHtCFLvzOeMNxHmfs1kINosV2hht9e9nUA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669026780; a=rsa-sha256; cv=none; b=GBOCoDzGLuvjC1cNMCaG5uNB2B14NMGYm7FhvoUEn6fdKCAihl8GoTf7XtQIGMPUvq8Kon It2ynFBafDYYmxW/khh854lObn3GPZrMC54ONuK4Oeqzp/ggUreiPcz0rX4wrchPTfwJhe t4U6hsj3uFFC2z9jJZCxk77QOydz4V1u5ZgZ1R5F58R7HF4W996vsVcTP+ue3FiIwmVvsV cye/i06HGy//iJnghyhOf9ypr79kmIkNKtO7+TAxqN0vPTTH1pUK5HGq6ca1S814m0wAPi f6eEtHpS26qD9FJW2jzCsnnXC8PX4Clba4DKfoVLhWFXBCV9eQ6jwsidXkq1Iw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NG3cr40PNz10q7 for ; Mon, 21 Nov 2022 10:33:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALAX081039972 for ; Mon, 21 Nov 2022 10:33:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALAX0RI039971 for fs@FreeBSD.org; Mon, 21 Nov 2022 10:33:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 10:33:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #11 from Boris Korzun --- (In reply to Mark Millard from comment #9) The problem is still reproducible after the c2a74ca2c3d9ad3465f7cb88ea60907a097fbdbc --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 11:19:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NG4fS6017z4hkxy for ; Mon, 21 Nov 2022 11:19:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NG4fS4tcQz3t8s for ; Mon, 21 Nov 2022 11:19:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669029568; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pZTQzbo+6RSvqy0wPggzvdMmUMaMevFw0fkyNYGYEno=; b=fxnu2ta89/4PrcdVFfcy7t5jkKNO+jeccnebK3OcPgXFDhm1QSvPgFC5ZctP9bl/1EUy5I Hrhiz6rnYb5hhVnzYNXqxnSHktCV0vMo4RozveI9kIm99k7nWyMX8mfxXIWUpEndRMTi6J aVHit8gSa8bLWR5RorheLbRSgvQN46nwbn1Ih+CEkE6CZoLzLl2Qv4R3syqKjWJGo8/TdM rd5LoXGY9xQo/y67w8MN/Eb1nrRoJbi5kqRiiKVBJBcPTa3cmV9DxujgAIN8F7zweVxAoN gOY3UeoKYN/2uzXtc3/a+t57JQd/jsH/x7g7fqP5D1GT3lRDIWwkDkycUEA4Dg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669029568; a=rsa-sha256; cv=none; b=kTOLxawNh4aofpDlk7r4FDQupGR36sq1nSF5/7JZJNe26RkkwN/JBV2HFn6Bwodau6vwQF y51/y26ZU1fZLaE+8IVS982Vl9sl9GGpKmPWHU55V3md1wLJA5lqLwT2/4EM1Roq25YPyg gkSw+CdSnGY64XqiI9LMutjAUFpWHiTVVV0bzxbHcYj1zMlFw0JHHFNBOKTOdxc1CC3BBd DWyHCAMZ07mHeNhBNm0WhNKag8P/UDnXSqcp5VR7LK93HfyaePcRcFcTFc3OMNLRiCCgVO n5kr7OtaGjNrcYUgtZycfEM2Cj0XIFVsWlpexK+KsNSFCxHpZKqakQUCIt9b2A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NG4fS3rsgz11X1 for ; Mon, 21 Nov 2022 11:19:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALBJSmP095895 for ; Mon, 21 Nov 2022 11:19:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALBJSQn095894 for fs@FreeBSD.org; Mon, 21 Nov 2022 11:19:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 11:19:28 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #12 from Mark Millard --- (In reply to Boris Korzun from comment #11) https://ci.freebsd.org/job/FreeBSD-stable-13-amd64-build/ reports for the official builds on the build servers: Last build (#2244), 2 hr 5 min ago Last stable build (#2244), 2 hr 5 min ago Last successful build (#2244), 2 hr 5 min ago Last failed build (#2237), 3 days 6 hr ago Last unstable build (#1532), 8 mo 29 days ago Last unsuccessful build (#2237), 3 days 6 hr ago Last completed build (#2244), 2 hr 5 min ago The successful builds since that last failure are of (increasing time): c2a74ca2c3d9ad3465f7cb88ea60907a097fbdbc (the fix mentioned in #9) d3b97a1ea01233486ddc7693e8a53c59d331c8c2 (more recent commits) d878a66a9a77fc67801000bfab8fa77b2b3faecc 689a5b194435e93baeda7cd132f2a6d1d8fe88eb 640799e5f2d0b09b359ce040bf7cbbcb6f33393d bca262f0f351e3881d478b7a9764c91ccb83c260 7a5de4db8cf1862673f18b8b3b3d524c3847e51e I expect a problem in your environment. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 13:10:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NG76K69jCz4j0w6 for ; Mon, 21 Nov 2022 13:10:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NG76K55BFz43sy for ; Mon, 21 Nov 2022 13:10:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669036217; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nDew4nbnjN+DTT4NmyvgW7m4jj0eVflvJ+PIFcKyzvA=; b=Pvdtj86fL0if/lLqbdyDTNbv/5o1hXi1HhpCuqnNL/L5Npjg86ECtZ7gG4VjQhmoarklWy dZJNGOVGlRClg3R1MTy0A4sBm2siLq1GoHwVzpSYmnGbb6v5grv56WQqGtKg09WRfRNvCl GpFGVfOCtLrLxcKYc7IyOCEo5AD8DEdDFzZf7DO9CIQLddQCiQ1Lr7HR9B9V8LtWMOZEcD DzLxzpDQcm6dDeAFeOhIBQar6LQNH0Sd/GXHNhWCBJ/JFvCMYFKgAH6KoKGtl9MScDDug7 qusCobA1SjNmUO+WijU8ZPLt0+IDu5fO9mrLvFCTU7lOTm2bZmoQ/ya1j0XKwg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669036217; a=rsa-sha256; cv=none; b=h9O6gecYVqrzE1bUqLC2KsFy6W2U0z1f/t3UBf7RnCB91AYd7I6fQ/O6k2eUkhVaup6e+v rgbVBioYZNYDBxLCuT99CwEkxmC22XmPpAq1bMlmgf0HiK8X9gDpzR0mp8Lcdn6LEwbATv Mm2cugJdMNWkrOhbF2Nrz0S90I6DmijUVSm6DgHHpKfkfjgRaFPgHkoqGbwmMdLCfFM9pK 1wLHhpCxyRJhfwhcil11SMPzJdIGzBRR5k/i224epsutYmabQU37wSv0Q9fAuxrN3JWKai 8UWoTTEldEf0yni8bj69elaRn0BCB1lWb78aML+QISqKjHaHJHtuXUXCvrEAig== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NG76K44g4z14Xp for ; Mon, 21 Nov 2022 13:10:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALDAH8H053636 for ; Mon, 21 Nov 2022 13:10:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALDAHtE053635 for fs@FreeBSD.org; Mon, 21 Nov 2022 13:10:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 13:10:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #13 from Boris Korzun --- (In reply to Mark Millard from comment #12) Yep, I don't use an FFS option in my KERNEL. =3D=3D=3D=3D=3D options FFS # Berkeley Fast Filesystem =3D=3D=3D=3D=3D The buildkernel process is ok with this option. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 16:22:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGCNK0szVz4jPMP for ; Mon, 21 Nov 2022 16:22:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGCNJ6qz8z4Q5g for ; Mon, 21 Nov 2022 16:22:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669047761; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5laT6QMJbUDMMcdtQOMJaPOL0wD5XG/nJDEICTW15Zc=; b=Alnlmfz7vL7xAoo7KMvtgP6SDHuFU+1RdYc0ATMO3panY7ZuY2dfH9PVzgFoTDzd2TvnqY +nxf8v16J0kqoSNzsOjDTEW9fd4VjrG0W6BPNvehHBsU8I/Zfc3WhiZa7EWYx8bynyj7X5 ktsdEfgBGLpdHCwAYerQqIeJFNeBUyVnc1ftuZmNPgzTvxvDfZb/nujJ3kAVPFHNeMUVCQ s32g3QSAC0X0QCIEHICRnnrT83IoqeKrZzDB84nbG2QuYMYcwvlUM4cjqcFSC4MWgMRzUo Zj7w1os1glcOqF+C7rb0AkeFBR/NLX2RkDotYZkz5Y2swa7/nwKR1yQDVtWHAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669047761; a=rsa-sha256; cv=none; b=lrp0YoSKg4FB2itLkO52Osm2kSx/psyOAiDhOMgrp4mprNLldkFktja8h8UaDzh/wUNxnY CoUEmDj/BwYjIWyA8GbK0a23gIxyUaaoWNYqC314Y1erbrYOFaCu/kaoU26cwjtoK9eGof aoBuXyfyqnNiZZO2TQTDm+xKwVdmebbEki5ml5FKbp5k5sNVE5W+DoG7EXoG4iXrkh62UF b85oWDwcImiWQS9qUJS9J2LQvCL1bzYJTyfx7q3m7kDeq9rrcQmylFyEw416sZbOtCVcaW sUsdTHsWUrGDEaLJbIdHUpoX408SOg1SevuSZKfdsa8dGD57KN9C2Z7bsBHimQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGCNJ5v7Cz18hx for ; Mon, 21 Nov 2022 16:22:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALGMe44038277 for ; Mon, 21 Nov 2022 16:22:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALGMes6038276 for fs@FreeBSD.org; Mon, 21 Nov 2022 16:22:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 16:22:40 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #14 from Kirk McKusick --- (In reply to Boris Korzun from comment #13) I just built a 14 kernel without the FFS option and it worked fine. I will = try building a 13 kernel without FFS to see if I can reproduce your build failu= re. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 16:33:44 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGCd46kknz4jQKn for ; Mon, 21 Nov 2022 16:33:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGCd45Nrwz3CcY for ; Mon, 21 Nov 2022 16:33:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669048424; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JjbiGn1Pk83jyk2MvhkVfOJ+PLgE/uzsq2rBGP4bMs0=; b=G6XgZ1G3YG16ptFDCK3/cBu58PCNzk0rnXQMnvv6uZCY6bD1dFpl2IeY897xX4+ARHp4b/ BFlsyKeMfgASPIiH/YqwLp5Fdv7/8DKazjHJ/m/RyM0g1MvKY5oylD4aqc7mIdcmpi2iHq DPI4CsWw/17SLus8o7OwCIwJjgmxI/2181MiCJe2xAZlqUOsiDJIUETqYEYlgAI4gP2IfU bGKCVk4Z0tDD8ZhcPZHZXVnuVD4G5fl32J0CSOI38NEGhxyTCFh7wt+U0h0ETs0Jc77U0c NnGJqVmpqn47fI7YzpZNhAMSP45vV/ueFHnlf1KM3GjPrmv7A6pcdjW9bZlF+w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669048424; a=rsa-sha256; cv=none; b=XrldwuDT90HeEiDW63N9fEDM81ypQM6EDoCKee+H0JJj/87xHzBeR9Lo5Imj/wKZyEiEkU iupo0KKkFQ483o3q4KK/jQbL8rn80PSqBNAv9pnSu5dD0izLla/O80xjrlbXldYF5Fpd6g uOe5ONmRvj2zaON1t+72SzbAhdSiln/zluoHq3DjuMHZCTbEHtpSWrWFwhsOXN+skkFaYk y613W+qCv73B4cTgbHpaKrRQ4vpjW3cZj5sS5E3aMv6cEltyuvYlK2ONKLHjVT4puDZESq aCa93/qzI54FnYsVCXEUxvcinH34B51rzxbukZ5GZKpnrIWPh7O1269Yp4J5YQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGCd44SQHz195G for ; Mon, 21 Nov 2022 16:33:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALGXiv9053922 for ; Mon, 21 Nov 2022 16:33:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALGXiZl053921 for fs@FreeBSD.org; Mon, 21 Nov 2022 16:33:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 16:33:44 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #15 from Kirk McKusick --- (In reply to Boris Korzun from comment #13) My 13 build was successful. Can you please provide you configuration file s= o I can try building with it. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 16:39:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGCmF17BWz4jQsr for ; Mon, 21 Nov 2022 16:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGCmD63W1z3DT0 for ; Mon, 21 Nov 2022 16:39:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669048796; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vs4a0W/7O0+9iG+ZAP8boBLZ1sWRlN2knfWZZ+nTUUA=; b=j6qiXf9oK9hfVv4iHixNn8LeV2rz+yjjEWP4iW5sqaRzvIPVH4gD/49+gybOPFfJuvJyJ+ nf8RcSVZvgwIQQZCOXTaff7Iy6XVU+PstGiJG4glqedZQAAtb5/YgdKn7EYIe4nXgO4s1v rgk0bB2UVFhC85HPF9HB9yl4jzfb2CKb1XSYs38Hk9H6K9yBJFw7CmhmuYEwvp6jDLcEBK UHH9kuMhPDKmJ/lBF8xcmNn30Jj78X5fNs2mflSmYHkgkdg8pbCmYFA10o5ZF8bpHj3sst xK6eFPg/87uEolTlPCXiMoSZBvEGtsNBGPk/FFNlHE00kFJ1zvKSgaLFeMJ++g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669048796; a=rsa-sha256; cv=none; b=NpJQN2Geq/QtA7QpmSh5dnz0zExmEnXDuEudnRxf8/VNlGq/tGozNg/yfhJWUN8ZhIo1ba UimhXGXouPSKc1jX1v8oylujixN9Pg3v+1pcKnpiP/P0ZBTVwk8y5vq02Pr1WZQu94grTR z10H9n7ywluTpHFaaEOJtLO1+UW+uR9CNSO9XKAuQ6whx6Re2ExGOZSVxgIpmkVLv3+ZvT vG82wrFEmoeUIooW4La8+9Ko17AgdAMk4I72ildCJOMZ9vGmQUpaeDcLJg/OU3ObH0Sfnc QCajuyI1wU0g+qguTAdEWexTNLRKhBqBIuvhjG7n6SDc74v9gg6Xc4M19VYBRw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGCmD54YJz18vd for ; Mon, 21 Nov 2022 16:39:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALGduJY055663 for ; Mon, 21 Nov 2022 16:39:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALGdu9v055662 for fs@FreeBSD.org; Mon, 21 Nov 2022 16:39:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 16:39:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #16 from Boris Korzun --- Created attachment 238218 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D238218&action= =3Dedit GENERIC-BUG (In reply to Kirk McKusick from comment #15) Only commented FFS options from GENERIC. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 16:47:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGCx459Mjz4jRdK for ; Mon, 21 Nov 2022 16:47:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGCx41N8Sz3G68 for ; Mon, 21 Nov 2022 16:47:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669049256; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=T6umOzu8RLRvGTMdOSjPq/7cX//fcMgiDUis0W1wQSY=; b=YLZDw3nuKrZKfEJPcF2ExG7m0lzVuoOCsmp21YRD0QyBa9UTYrGC0ZrqdpfxhxRho+gvLM f/ZzDh2mlmt+Zmk3lSh51UBN61ByuCFmKPZc/tGYhPd+skwSm0Vm3SHVSxUeeDvoyi62LK wxCPODALjLAmaS6UGhc+N3ylkbzhqY85+NsViFe+TDan52MBCicPlXhxjKoNa0wWfNjNYn TfBFgOJbZvZ4kTdKtBjdFWB7M+F9UIYVUHUt4heAN12zfiSAOEEY8NDgiH0XrAIqVykHlh TU1B+nV/ReYRKfKREk1RzbHIVXdgThNIihlceTSWtWuoWgYPtYkDG7gQ9KNGXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669049256; a=rsa-sha256; cv=none; b=gmtUnmW1lRNegTZf5YMa2eCtrGu2Yh6Bo7g+f0Dc8GbUuIuzH6IfaL1d0gF5zyMbdWMDqd 5/Oiz6engWsQFA6KOp31usNFs+6i0Ypr4EI01jZ59cXILGjmIPkIoHeXDsrjRzKn+dg7Vq fgJvOq40pobH0G5VBOejD6YFL+fB8Po1gau0jgwykyNCqi6ttfkT623OtQ+DDc1nY74JVz wvSwz9/GzPKDdTMkSj9zo7hxJIiHfVOpcn7n0u7Nlm0bEIHLw2HSrj3tNOnMFAlw6ma66D b8Wnw1KMnmi3qaaC4WG9IZhFYmz2YF1R/zPAFlPeY2GFTy0FNyRCWDioaJVjSg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGCx35xtsz19Kp for ; Mon, 21 Nov 2022 16:47:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALGlZD9068330 for ; Mon, 21 Nov 2022 16:47:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALGlZfj068329 for fs@FreeBSD.org; Mon, 21 Nov 2022 16:47:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 16:47:35 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #17 from Kirk McKusick --- (In reply to Boris Korzun from comment #16) Just commenting out FFS from GENERIC builds fine for me. Can you send me the output of your build that shows the error? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 18:27:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGG8s2w8yz4h9gF for ; Mon, 21 Nov 2022 18:27:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGG8s1PYPz3QGg for ; Mon, 21 Nov 2022 18:27:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669055277; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=S4P2LhBqGNjtbsCLWvXvzTION5Svy8D2NzUi8BFQhHc=; b=y0G4GWFuooL/+1z2oCwXuSPQj6Gr0wNPEsp1aoHvUWdbkmdFe2Ab0bSRh2KGZhk89UvXCS YX3miI/+fZulR4DOiIJFV5xAknE3VX0/kpYtVh3ep88JdCmjRfbRw14RgjrlGBWC9HSQbj wSKkAr38eOf14/68nzL5XmGDlABopchhdfodVdDwwRUlp5a4A/L6a7ZMhgPiLa7HjvhJbv FFoKtFBgghRX/DrSKF1/FBDK936WArrQ6/ABQqG15IVXoTpfNHv6fTwLfpfkm8kddHBmPp iQ8+ov//yHeCQGlFxO+gKXwfdO/l3ihZhTT6YPrXQoM3iQjL5Ys+iNQbMrZj5w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669055277; a=rsa-sha256; cv=none; b=Gd6FR2BEvhxoEfJmdgqgP8fnfKEJFMaGnpIShDCQW//f2CSdLlzV90hdstvuICzfHy2Qbk Cb9KgGerakbBwtu5CkbcQb09YqqedROAgVuucjanizO5pjc2YXLCkIy0QkOia2VIb03kLf 8nv57NEHLxZR01ODiuJ3LnP3OIseu/8N9jrLHRidSwsoAbfGZANkfeJuD8q6xi0baqRJ2h 86faaMBPqfT5l87U5MapkcJ5upM1/saC3/F6DJubEgAh5U/QZt1t7mgv2DEzTVSb+hT1QC JeGXtjFcaW9f9yb8xXRci3KjE0x2y4Q5PpQLpk5GIf5ilp3s1yOMuAvQ4Y813Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGG8s0RLgz1CqK for ; Mon, 21 Nov 2022 18:27:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALIRvxs012625 for ; Mon, 21 Nov 2022 18:27:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALIRv1f012624 for fs@FreeBSD.org; Mon, 21 Nov 2022 18:27:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 18:27:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #18 from Mark Millard --- (In reply to Boris Korzun from comment #16) src.conf ? make.conf ? Anything else that might contribute to your buildkernel details? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 18:38:32 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGGP42l63z4hC18 for ; Mon, 21 Nov 2022 18:38:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGGP41V5Pz3hBP for ; Mon, 21 Nov 2022 18:38:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669055912; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eKiPPIimqS/ZzSuxFHGCuu/7kdgLrf2eaha4CCWqT8s=; b=J4aZyBAKjXODx5pU1/78RyCpozqy7B69rupfsZcI0VD4Xhki+c27EranzHe/mEd1OnCAJP 9tbGuM878jnNtOaBEp2A8yaqsEGlftguBGeo76o21uDEcDZpuRov723sJFQFD3wHuTgXgo Swji3yyns5osojs357SV03eWnPT9DFMUQjDChAshy5xTQWoKZA1W4jmL57eM1OrJTVOLGF v0/T1maZax5k7BAVgj20VXrHJw9K2sqfDcxXj1uq8o9kGTT5uWJBk2Xip1I4wq8TpUQW5S Vf+i7iFj0GKNzAgTCPEQZDYmceT+f1zWrvp72CDUSIs9jCpRSNJhpR/S0bMC8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669055912; a=rsa-sha256; cv=none; b=VvQCKcsqJuLzNd7wGxshsQMmgYxFHHcpz/XWL9Xa3ueUPYe6COH+508wR+Cp8Imgh3Hel1 ZwJKJtbYdHn/6Kjyo44YGU2oRlHkulg4ymuLf5fAsxrSHrt971GqXELKiT9U5ezbI+19Ee kLMer22y4L9cCiU5YBrTkTBZkIgyCsSVNGO7+bA5t8EX9gngjifzpoh0CVX4Yi0tJkJBM/ vYd7qfcX7tNrGbFY1/4Yn7Ll/7IRUTBLWRQ6Ep++QrGbvBjl1xUZ0Q+9x/Dt9PYo1BTUY+ YAMy/3Fwl4DNMSaPOyuNwCrPNRNqgBUnlmFITWXmH6Vy2+kTnBS9OxE/zfPtLg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGGP40Rh2z1Cfy for ; Mon, 21 Nov 2022 18:38:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALIcWx1025608 for ; Mon, 21 Nov 2022 18:38:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALIcW4i025607 for fs@FreeBSD.org; Mon, 21 Nov 2022 18:38:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 18:38:32 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #19 from Mark Millard --- (In reply to Mark Millard from comment #18) Cross checks on work tree status? : git log --oneline --no-color -n 1 git branch --show-current git status --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 21 21:39:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGLPh1tDYz4hbnJ for ; Mon, 21 Nov 2022 21:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGLPh0kYvz44hn for ; Mon, 21 Nov 2022 21:39:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669066760; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Up5akjjgLyJNIjnYTCflzq1nPw4hixhTeYpM1FFgME0=; b=hThJ3NgKyJNdDpCQ9i1fbtLz3zSI76+4G/jchRbZOFxWMpI+VYHtw3EK76BeZbLrLuav7N l2zR9d6Sfrrmq3GOkNG3cyC5tWvbty/uvipJZA92BdHWqS8vba7yfJRPixbU1Md13twl2p SN7tHOK8a43UHsLiDKhF81/BR0FWwOx24e95pZ58R57RIYjuEssZC2xto1fb8W1ZDhIGdv znYcLSMScB32ytvbIzRtrPBcYrktoigZrkX1QlBt7L2Ya6eVpTy1uqF0B8oInCCL9FBHRK 7TxRZxhNQmOmcvoYf8KQlxFR5M+mz4uwBpNG108q2iQhA56GSGYLIotP4azcFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669066760; a=rsa-sha256; cv=none; b=C7n+KCz5F3FOORhBoYtmkhQzSRwdAOOS2/qrUb/4niuAl4Pe6/U0EV57X/HveIm8K6oIQu pDd03U6n6P2mjNcm50DxxszHCzfKN0FqmspjHexYYl6qRlcZ8JE1f/uDM23AKX7LRVLSdm N+3U3+4rx4fSnVQ/vjMFUwex9ucwwWxHNEUw02sRhe6W8Te7Dvi4sPN0zcqQvDa4/pY0h/ nuofRTAMl/Wtx9cKkqd7pVOKs/rlgn4/PiTXpiJb1dqS9cY7dyV8zknCG4+s1UslqJALz3 UwVlXA/2DaOchAY2G8M2xDTKXhOh8iN1a6tJx51RMbZPRLBwqXvvxR7+BL9aCg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NGLPg6wskzJ5x for ; Mon, 21 Nov 2022 21:39:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ALLdJI6081082 for ; Mon, 21 Nov 2022 21:39:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ALLdJcO081081 for fs@FreeBSD.org; Mon, 21 Nov 2022 21:39:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 21 Nov 2022 21:39:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #20 from Boris Korzun --- (In reply to Mark Millard from comment #18) There're no src.conf and make.conf. root@boris:/usr/src# git log --oneline --no-color -n 1 c2a74ca2c3 (HEAD -> stable/13, origin/stable/13) Fix to b999366aab4e for compilation on i386. root@boris:/usr/src# git branch --show-current stable/13 root@boris:/usr/src# git status On branch stable/13 Your branch is up to date with 'origin/stable/13'. Untracked files: (use "git add ..." to include in what will be committed) sys/amd64/conf/GENERIC-BUG nothing added to commit but untracked files present (use "git add" to track) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Tue Nov 22 18:42:36 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGtRZ11pxz4jHGh for ; Tue, 22 Nov 2022 18:42:50 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f41.google.com (mail-vs1-f41.google.com [209.85.217.41]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGtRY0VD5z3r1L; Tue, 22 Nov 2022 18:42:49 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.41 as permitted sender) smtp.mailfrom=asomers@gmail.com; dmarc=none Received: by mail-vs1-f41.google.com with SMTP id t14so15315328vsr.9; Tue, 22 Nov 2022 10:42:49 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=DRrViaMGJZhKEEWmxHV7ZiqiIv44uiLOWmGiCo9Jmak=; b=3p9dm+h0A/CITF1loJLWhT4YDZSKViaXsnCfMPuwFeszFxWJT4y+Mzkne5Y1aHNu3A OovrHmcfkW25dhBvKusED03v+MvDUUT9u6yjYIU0Z8fhv+sKuPD3j98yL12Kv6TxgFLF UxrG1hof9wxzkAxYT2/uuETfFde4HFQtWcQRiYbGIBT+I92J8jdzYwsJt7IIYd0hbYEP evmkjm6G6hJVhyWzz1NjWqfwx5OirbDR2Hyvt7/btWgFCFTbWS/iJcfRosj4/58oEn0T DimVxOhlttnGF0RIOAk/3Gw7iRX2Yhdg9lozm/KWkA/CRz6mpGBMtYNYJ6/6oflH22lB Jg8w== X-Gm-Message-State: ANoB5pn9QW13ugUJIHoTx18vcyP+QXzK3fVsTR00Oeip7SNWTsnp8Rx2 zbmYtpvbMiEGkmMdKdsLCTm3d4Jk+VxTeO26EsY= X-Google-Smtp-Source: AA0mqf7NMv/UnIeC0TuzM74f88SzIZtypOtz05bJOhQ60k2GE0ZZeTtgCZV4hUUc60Fe390BVzwzi4WYnPr6xOWpx+4= X-Received: by 2002:a05:6102:3911:b0:3af:b08c:9bbe with SMTP id e17-20020a056102391100b003afb08c9bbemr14450581vsu.76.1669142567941; Tue, 22 Nov 2022 10:42:47 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <20220531123221.n7ubs365ceeqo2d4@x1> In-Reply-To: From: Alan Somers Date: Tue, 22 Nov 2022 11:42:36 -0700 Message-ID: Subject: Re: UEFI question To: John Kennedy Cc: freebsd-fs@freebsd.org, Nathan Whitehorn Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [-1.17 / 15.00]; NEURAL_HAM_SHORT(-0.99)[-0.989]; NEURAL_HAM_MEDIUM(-0.98)[-0.980]; NEURAL_SPAM_LONG(0.80)[0.802]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.41:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.41:from]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4NGtRY0VD5z3r1L X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N On Tue, May 31, 2022 at 9:27 AM John Kennedy wrote: > > On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: > > I have a Dell R340 server on which installed a 13.0-RELEASE and then > > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used (raidz2). > > > > The system has the following partitions: https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 > > Some things regarding UEFI are not clear to me: > > - as you can see in the partition list, the installer created an EFI > > partition on all 4 drives, however it looks like only the first one has > > has been populated (an mounted): https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf .. why ? > > - if I understand well if my da0 disk dies the system becomes > > unbootable (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee).. correct? > > - what's the correct way to fix this? should I newfs_msdos on each EFI > > partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or > > should I use efibootmgr? > > > > Thanks for enlightening me :) > > I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs > picking it via UEFI/BIOS on boot manually). I'm multi-booting windows > and FreeBSD, so I'm being (justifiably) paranoid, but not based on > being burnt in recent memory. > > Depending on how your system works (drives are enumerated at startup), > in theory any of your disks could be da0. If you've only got a working > EFI partition on one, that is probably hedging your bets a bit but yes, > if that drive died, you'd probably be dead. > > In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) partition > on both disks, I split my total swap between the two (not mirrored), and > did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs partitions. > > In my case, using the UEFI/BIOS from the motherboard, I could manually > pick a disk to boot from which let me vet UEFI or ZFS bootblock changes > for sanity before committing to both. But yes, I'd upgrade them both to > the same thing once I was sure it would work. I just noticed the same problem. For mirrored installs, the 13.1-RELEASE installer only formats the efi partition on one hard disk. Shouldn't it do both? From nobody Tue Nov 22 19:50:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NGvxW5Dhwz4hRDP for ; Tue, 22 Nov 2022 19:50:23 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x633.google.com (mail-ej1-x633.google.com [IPv6:2a00:1450:4864:20::633]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NGvxW34j0z41Wv for ; Tue, 22 Nov 2022 19:50:23 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x633.google.com with SMTP id n21so38117864ejb.9 for ; Tue, 22 Nov 2022 11:50:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=8LaCptmn5zuPVUCrH+K6I/hUwnlxcL/isLODo1Z489I=; b=u33vF6610RaGOPMijS+T1T0WudG7MXRIeD0parTJJt3RUEhiKi4kGZ+8erb6oN2m9/ +fGh9r+G2fwQ9ylRIgQ4WviTVxC/JjqnNEM8UvNubqlynNCLx+HKDz46CnFY4iyhKHGK jq/ejWCZCZESiNKuTDul9TFQnKLlkOgnLEX0KSj8jtCjC4rcctDsnmqF0tzS4dGsJEW8 YCUnJbtLT8g0hzR8emVl4Bv6KXiNBoqtF4XfVNLpMR21eybUWPw+ol2mFa3tORrsXo7J 4nli/t9QmHEtNHCYRg/fdef0+ySRVYm/pjCYSnuDt8zFfmY1hw+wilfQE5LcoqbLI7sD 6/iA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=8LaCptmn5zuPVUCrH+K6I/hUwnlxcL/isLODo1Z489I=; b=qdtxwxnXLXbpknRYrXmO9WdarqjVt1HkE8t3k1JhC7p6Z8fMZ97qSiol5OUKntqLVT vSTWnd7hHTaqd6ljzN2tndumIWvdUPf72iLAUytJZbTVbRnHiJNwF/Ipd9jU3Q2eGPOe v3UboCmb9ibG0+wMVUSCf/TfqmkkIXFOniew9a/QYFpnW9iKpZcx/e1InYNfr+ftu09c LOvqHECKwHXmmVES6i4wXHRG1zilAE6GV1lS2uWy4ZzKEWLu6TZdQV1gC0pVuKskcRHU UK0z0qf9k3ALWkJCI9IFiNOf2C2dCF52HQkivPXaRc+5N/ZZ9CV30wqktYCbJ+qbETSs XCQg== X-Gm-Message-State: ANoB5pnDmxXJlHzrSLrHrcSrfJ9Dn8yyVmZcq/aDKWdhxk0YEtGUtW76 uj2S1X7Fk6SOxc61a53IdOf8uFmz7ZBwuo9fGQnrAaVxF4k= X-Google-Smtp-Source: AA0mqf7IgYPwc/ZPAI5SOi3+LNHSoPtECWntZFxWCkpayIvto+Pv89HzQIcS+bqMgXyLpBNjwzbacg+euP+zq3cmEX0= X-Received: by 2002:a17:907:11d1:b0:7a7:1d4f:c7dc with SMTP id va17-20020a17090711d100b007a71d4fc7dcmr6958865ejb.252.1669146621901; Tue, 22 Nov 2022 11:50:21 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <20220531123221.n7ubs365ceeqo2d4@x1> In-Reply-To: From: Warner Losh Date: Tue, 22 Nov 2022 12:50:09 -0700 Message-ID: Subject: Re: UEFI question To: Alan Somers Cc: John Kennedy , FreeBSD FS , Nathan Whitehorn Content-Type: multipart/alternative; boundary="0000000000007a15c505ee147bcb" X-Rspamd-Queue-Id: 4NGvxW34j0z41Wv X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000007a15c505ee147bcb Content-Type: text/plain; charset="UTF-8" On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: > On Tue, May 31, 2022 at 9:27 AM John Kennedy wrote: > > > > On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: > > > I have a Dell R340 server on which installed a 13.0-RELEASE and then > > > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used > (raidz2). > > > > > > The system has the following partitions: > https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 > > > Some things regarding UEFI are not clear to me: > > > - as you can see in the partition list, the installer created an EFI > > > partition on all 4 drives, however it looks like only the first one has > > > has been populated (an mounted): > https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf .. why ? > > > - if I understand well if my da0 disk dies the system becomes > > > unbootable ( > https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee).. > correct? > > > - what's the correct way to fix this? should I newfs_msdos on each EFI > > > partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or > > > should I use efibootmgr? > > > > > > Thanks for enlightening me :) > > > > I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs > > picking it via UEFI/BIOS on boot manually). I'm multi-booting windows > > and FreeBSD, so I'm being (justifiably) paranoid, but not based on > > being burnt in recent memory. > > > > Depending on how your system works (drives are enumerated at startup), > > in theory any of your disks could be da0. If you've only got a working > > EFI partition on one, that is probably hedging your bets a bit but yes, > > if that drive died, you'd probably be dead. > > > > In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) > partition > > on both disks, I split my total swap between the two (not mirrored), and > > did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs > partitions. > > > > In my case, using the UEFI/BIOS from the motherboard, I could manually > > pick a disk to boot from which let me vet UEFI or ZFS bootblock changes > > for sanity before committing to both. But yes, I'd upgrade them both to > > the same thing once I was sure it would work. > > I just noticed the same problem. For mirrored installs, the > 13.1-RELEASE installer only formats the efi partition on one hard > disk. Shouldn't it do both? > We go back and forth on this question.... I think we should, but others got grumpy when I suggested it. Maybe just all the drives in the zpool used for the BE? Warner > --0000000000007a15c505ee147bcb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Tue, Nov 22, 2022, 11:42 AM Alan Somers <asomers@freebsd.org> wrote:
On Tue, May 31, 2022 at 9:27 AM John Kenned= y <warlock@phouka.net> wrote:
>
> On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote:
> > I have a Dell R340 server on which installed a 13.0-RELEASE and t= hen
> > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used (r= aidz2).
> >
> > The system has the following partitions: https://gist.github.com/silenius/2defdd5480c5c1b= c9ba2ff8940756466
> > Some things regarding UEFI are not clear to me:
> > - as you can see in the partition list, the installer created an = EFI
> > partition on all 4 drives, however it looks like only the first o= ne has
> > has been populated (an mounted): https://gist.github.com/silenius/1220c953f905d868c1615fd= 0e7122bbf .. why ?
> > - if I understand well if my da0 disk dies the system becomes
> >=C2=A0 =C2=A0unbootable (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165= ee).. correct?
> > - what's the correct way to fix this? should I newfs_msdos on= each EFI
> >=C2=A0 =C2=A0partition and copy /boot/loader.efi as /EFI/BOOT/BOOT= X64.EFI? or
> >=C2=A0 =C2=A0should I use efibootmgr?
> >
> > Thanks for enlightening me :)
>
> I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs<= br> > picking it via UEFI/BIOS on boot manually).=C2=A0 I'm multi-bootin= g windows
> and FreeBSD, so I'm being (justifiably) paranoid, but not based on=
> being burnt in recent memory.
>
> Depending on how your system works (drives are enumerated at startup),=
> in theory any of your disks could be da0.=C2=A0 If you've only got= a working
> EFI partition on one, that is probably hedging your bets a bit but yes= ,
> if that drive died, you'd probably be dead.
>
> In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) p= artition
> on both disks, I split my total swap between the two (not mirrored), a= nd
> did ZFS "raiding" (mirroring-ish, usually) across the freebs= d-zfs partitions.
>
> In my case, using the UEFI/BIOS from the motherboard, I could manually=
> pick a disk to boot from which let me vet UEFI or ZFS bootblock change= s
> for sanity before committing to both.=C2=A0 But yes, I'd upgrade t= hem both to
> the same thing once I was sure it would work.

I just noticed the same problem.=C2=A0 For mirrored installs, the
13.1-RELEASE installer only formats the efi partition on one hard
disk.=C2=A0 Shouldn't it do both?


We go bac= k and forth on this question.... I think we should, but others got grumpy w= hen I suggested it. Maybe just all the drives in the zpool used for the BE?=

Warner
--0000000000007a15c505ee147bcb-- From nobody Tue Nov 22 23:50:08 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NH1GP3XwYz4hxL8 for ; Tue, 22 Nov 2022 23:50:21 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-pj1-x102f.google.com (mail-pj1-x102f.google.com [IPv6:2607:f8b0:4864:20::102f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NH1GP08pTz3HWV for ; Tue, 22 Nov 2022 23:50:21 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Authentication-Results: mx1.freebsd.org; none Received: by mail-pj1-x102f.google.com with SMTP id a22-20020a17090a6d9600b0021896eb5554so382560pjk.1 for ; Tue, 22 Nov 2022 15:50:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ADtC74B0P5GXvITWyyV+bJSHoX9QgtoO5tyCtoEj1NI=; b=RJf236Unw6Gw4AMINjv+iMJ16lW49U1qw71ANC3bVJyw61fKdq2GIfcY5+Ys+WnMgj BX6TAMEOHs4pdwxajwono+W874fANRDKqoR9uiMnzSbBUeISJiKwg2NhCDclRBIiutH8 UHvQhSMVU67r9qgb64QIL5+D5rXRa3bxAW+DH9vIh/0Ovdb1scGUpySMhVD6/Cu9gJTU Ya4L6bMBDdIB06lPwPMe7HUlmpPJWaMK9eO22Nh/o/xSrZfdEViomhJOqcYJ8kkGwxh2 Ph0IxTtRTZeKW2Lzs/E0UkxDyjMCBir4v3knK7AlOj0w/2x9wERGOfY7qRzte/O6A+t3 dhow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ADtC74B0P5GXvITWyyV+bJSHoX9QgtoO5tyCtoEj1NI=; b=yRae9VOXvZtdCYd0w3XL/V08iAOvf2mCw/Sj6ZupkwcEpHVNx9OskkFF+zH1E8c7Q5 UUKw9DDPULCQlqzy+OnH41lVTfJ9eqjlg5yZpP5jP+qEvsposYh8EMt4lIXtg8+EWQC9 67pbTmUffKZYp6wUyTlNK4Sy6LE/JFqrZUaOxy7wZTKnYBXv7Qb8Hn+aFfhdzPZfDIRq ATHJ7S49a3m4FK8Dx5PA5LoU5oJLgAX36tandgBphKq4gT6HOzFJ/CwH1qy8hMSK7wi0 siKgl/+mviy+yL4soQ4CtDf2sIP0qJmIe7ja1gB/NvGf70KjYnWQxSYvVJYebk0jrelh 9pxw== X-Gm-Message-State: ANoB5plVA4qtf17HvEW6PcKbnTqxhnwnlPI2rbQLWbNlrsCqP5MidFs2 oXRF7OfVLEcMPNb/FlcvY7bGmtcOfOxcKfmxsSpJ5Q== X-Google-Smtp-Source: AA0mqf6+hRvbxx3SiUGnupNgMQYA/Vq4wHe7KPCD2wEP6MO55sfJojYaLFkus8DhnvW9B9VvvVP5Fu1+ycNZMnZzSsw= X-Received: by 2002:a17:902:bc43:b0:186:da90:5936 with SMTP id t3-20020a170902bc4300b00186da905936mr6732472plz.158.1669161019603; Tue, 22 Nov 2022 15:50:19 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <20220531123221.n7ubs365ceeqo2d4@x1> In-Reply-To: From: Eric Borisch Date: Tue, 22 Nov 2022 17:50:08 -0600 Message-ID: Subject: Re: UEFI question To: Warner Losh Cc: Alan Somers , FreeBSD FS , John Kennedy , Nathan Whitehorn Content-Type: multipart/alternative; boundary="000000000000a58ef805ee17d589" X-Rspamd-Queue-Id: 4NH1GP08pTz3HWV X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --000000000000a58ef805ee17d589 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Nov 22, 2022 at 1:50 PM Warner Losh wrote: > > > On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: > >> On Tue, May 31, 2022 at 9:27 AM John Kennedy wrote: >> > >> > On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: >> > > I have a Dell R340 server on which installed a 13.0-RELEASE and then >> > > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used >> (raidz2). >> > > >> > > The system has the following partitions: >> https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 >> > > Some things regarding UEFI are not clear to me: >> > > - as you can see in the partition list, the installer created an EFI >> > > partition on all 4 drives, however it looks like only the first one >> has >> > > has been populated (an mounted): >> https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf .. why >> ? >> > > - if I understand well if my da0 disk dies the system becomes >> > > unbootable ( >> https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee).. >> correct? >> > > - what's the correct way to fix this? should I newfs_msdos on each E= FI >> > > partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or >> > > should I use efibootmgr? >> > > >> > > Thanks for enlightening me :) >> > >> > I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs >> > picking it via UEFI/BIOS on boot manually). I'm multi-booting windows >> > and FreeBSD, so I'm being (justifiably) paranoid, but not based on >> > being burnt in recent memory. >> > >> > Depending on how your system works (drives are enumerated at startup), >> > in theory any of your disks could be da0. If you've only got a workin= g >> > EFI partition on one, that is probably hedging your bets a bit but yes= , >> > if that drive died, you'd probably be dead. >> > >> > In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) >> partition >> > on both disks, I split my total swap between the two (not mirrored), a= nd >> > did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs >> partitions. >> > >> > In my case, using the UEFI/BIOS from the motherboard, I could manually >> > pick a disk to boot from which let me vet UEFI or ZFS bootblock change= s >> > for sanity before committing to both. But yes, I'd upgrade them both = to >> > the same thing once I was sure it would work. >> >> I just noticed the same problem. For mirrored installs, the >> 13.1-RELEASE installer only formats the efi partition on one hard >> disk. Shouldn't it do both? >> > > > We go back and forth on this question.... I think we should, but others > got grumpy when I suggested it. Maybe just all the drives in the zpool us= ed > for the BE? > > Warner > Just a =E2=80=9Cyes, please.=E2=80=9D If you=E2=80=99re installing zfs root= on a mirror of disks, POLA suggests the required boot bits are on both disks, too. Thanks, - Eric > --000000000000a58ef805ee17d589 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Tue, Nov 22, 2022 at 1:50 PM Warner Losh <imp@bsdimp.com> wrote:


On Tue, Nov 22= , 2022, 11:42 AM Alan Somers <asomers@freebsd.org> wrote:
On Tue, May 31, 2022 at 9:27 AM John Kennedy <warlock@phouka.net>= ; wrote:
>
> On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote:
> > I have a Dell R340 server on which installed a 13.0-RELEASE and t= hen
> > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used (r= aidz2).
> >
> > The system has the following partitions: https://gist.github.com/silenius/2defdd5480c5c1b= c9ba2ff8940756466
> > Some things regarding UEFI are not clear to me:
> > - as you can see in the partition list, the installer created an = EFI
> > partition on all 4 drives, however it looks like only the first o= ne has
> > has been populated (an mounted): https://gist.github.com/silenius/1220c953f905d868c1615fd= 0e7122bbf .. why ?
> > - if I understand well if my da0 disk dies the system becomes
> >=C2=A0 =C2=A0unbootable (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165= ee).. correct?
> > - what's the correct way to fix this? should I newfs_msdos on= each EFI
> >=C2=A0 =C2=A0partition and copy /boot/loader.efi as /EFI/BOOT/BOOT= X64.EFI? or
> >=C2=A0 =C2=A0should I use efibootmgr?
> >
> > Thanks for enlightening me :)
>
> I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs<= br> > picking it via UEFI/BIOS on boot manually).=C2=A0 I'm multi-bootin= g windows
> and FreeBSD, so I'm being (justifiably) paranoid, but not based on=
> being burnt in recent memory.
>
> Depending on how your system works (drives are enumerated at startup),=
> in theory any of your disks could be da0.=C2=A0 If you've only got= a working
> EFI partition on one, that is probably hedging your bets a bit but yes= ,
> if that drive died, you'd probably be dead.
>
> In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) p= artition
> on both disks, I split my total swap between the two (not mirrored), a= nd
> did ZFS "raiding" (mirroring-ish, usually) across the freebs= d-zfs partitions.
>
> In my case, using the UEFI/BIOS from the motherboard, I could manually=
> pick a disk to boot from which let me vet UEFI or ZFS bootblock change= s
> for sanity before committing to both.=C2=A0 But yes, I'd upgrade t= hem both to
> the same thing once I was sure it would work.

I just noticed the same problem.=C2=A0 For mirrored installs, the
13.1-RELEASE installer only formats the efi partition on one hard
disk.=C2=A0 Shouldn't it do both?


We go bac= k and forth on this question.... I think we should, but others got grumpy w= hen I suggested it. Maybe just all the drives in the zpool used for the BE?=

Warner

Just a =E2=80=9Cyes, please.=E2=80=9D If you=E2=80=99re installing zfs r= oot on a mirror of disks, POLA suggests the required boot bits are on both = disks, too.

Thanks,
=C2=A0 - Eric
--000000000000a58ef805ee17d589-- From nobody Wed Nov 23 02:01:50 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NH4BL20b1z4jDBZ for ; Wed, 23 Nov 2022 02:02:02 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NH4BK5JFCz3hCt; Wed, 23 Nov 2022 02:02:01 +0000 (UTC) (envelope-from ler@lerctr.org) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Type:Message-ID:References:In-Reply-To:Subject:Cc:To: From:Date:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=RhXu8pZIABzMi9CLz0YbHTqvnAJ9MhLVXRhSDyiGVOE=; b=E25VTLXF0vskCdXI+iYZrthEFk bUNrbib6O7qLLNMurAWtJj7+LIyY5C9yEEq0laJMN09/8Wx2bektgubkIjXYgLXL9pmAiwRpefPE2 3B1GbOhW5ltxB0yGqPkaw+9TFWID0zP7f2uwJa3PFHIPDB+ALxHQRMpDgwbMk2L+GWFz1J4STHU33 PfHNSpIDcDrR7Re2hPafYJvBfIHQQbbex3sJHFsqhyQge6hK0HF+7idhGtXvt1IHnSFC1pg932Fix 4ewNi2+5hB0b+IHL9jVPqfkhGEoiFgX+Yp3OXBzGhwCysz3E00RxEYG0DxEO7LiJQWL54E5WJfGwo rlInfngQ==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:48149 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1oxf5C-000IQ2-GX; Tue, 22 Nov 2022 20:01:50 -0600 Received: from 2600:1700:210:b18f:785a:29fa:3f63:a575 by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Tue, 22 Nov 2022 20:01:50 -0600 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Tue, 22 Nov 2022 20:01:50 -0600 From: Larry Rosenman To: Eric Borisch Cc: Warner Losh , Alan Somers , FreeBSD FS , John Kennedy , Nathan Whitehorn Subject: Re: UEFI question In-Reply-To: References: <20220531123221.n7ubs365ceeqo2d4@x1> Message-ID: <1e6a680f170f85563caba1d0842bfa46@lerctr.org> X-Sender: ler@lerctr.org Content-Type: multipart/alternative; boundary="=_7e89b74620cdf99cbfe4dd82a77f1676" X-Rspamd-Queue-Id: 4NH4BK5JFCz3hCt X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --=_7e89b74620cdf99cbfe4dd82a77f1676 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8; format=flowed On 11/22/2022 5:50 pm, Eric Borisch wrote: > On Tue, Nov 22, 2022 at 1:50 PM Warner Losh wrote: > > On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: > On Tue, May 31, 2022 at 9:27 AM John Kennedy > wrote: >> >> On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: >>> I have a Dell R340 server on which installed a 13.0-RELEASE and then >>> upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used >>> (raidz2). >>> >>> The system has the following partitions: >>> https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 >>> Some things regarding UEFI are not clear to me: >>> - as you can see in the partition list, the installer created an EFI >>> partition on all 4 drives, however it looks like only the first one >>> has >>> has been populated (an mounted): >>> https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf .. >>> why ? >>> - if I understand well if my da0 disk dies the system becomes >>> unbootable >>> (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee).. >>> correct? >>> - what's the correct way to fix this? should I newfs_msdos on each >>> EFI >>> partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or >>> should I use efibootmgr? >>> >>> Thanks for enlightening me :) >> >> I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs >> picking it via UEFI/BIOS on boot manually). I'm multi-booting windows >> and FreeBSD, so I'm being (justifiably) paranoid, but not based on >> being burnt in recent memory. >> >> Depending on how your system works (drives are enumerated at startup), >> in theory any of your disks could be da0. If you've only got a >> working >> EFI partition on one, that is probably hedging your bets a bit but >> yes, >> if that drive died, you'd probably be dead. >> >> In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) >> partition >> on both disks, I split my total swap between the two (not mirrored), >> and >> did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs >> partitions. >> >> In my case, using the UEFI/BIOS from the motherboard, I could manually >> pick a disk to boot from which let me vet UEFI or ZFS bootblock >> changes >> for sanity before committing to both. But yes, I'd upgrade them both >> to >> the same thing once I was sure it would work. > > I just noticed the same problem. For mirrored installs, the > 13.1-RELEASE installer only formats the efi partition on one hard > disk. Shouldn't it do both? > > We go back and forth on this question.... I think we should, but others > got grumpy when I suggested it. Maybe just all the drives in the zpool > used for the BE? > > Warner Just a "yes, please." If you're installing zfs root on a mirror of disks, POLA suggests the required boot bits are on both disks, too. Thanks, - Eric > This is my common setup for every FreeBSD box I build: ❯ gpart show => 40 3905945520 mfid0 GPT (1.8T) 40 532480 1 efi (260M) 532520 16779224 3 freebsd-swap (8.0G) 17311744 3888633816 4 freebsd-zfs (1.8T) => 40 3905945520 mfid1 GPT (1.8T) 40 532480 1 efi (260M) 532520 16779224 3 freebsd-swap (8.0G) 17311744 3888633816 4 freebsd-zfs (1.8T) => 40 5859442608 mfid2 GPT (2.7T) 40 532480 1 efi (260M) 532520 16779224 3 freebsd-swap (8.0G) 17311744 5842130904 4 freebsd-zfs (2.7T) => 40 5859442608 mfid3 GPT (2.7T) 40 532480 1 efi (260M) 532520 16779224 3 freebsd-swap (8.0G) 17311744 5842130904 4 freebsd-zfs (2.7T) => 40 3905945520 mfid4 GPT (1.8T) 40 532480 1 efi (260M) 532520 16779224 3 freebsd-swap (8.0G) 17311744 3888633816 4 freebsd-zfs (1.8T) => 40 3905945520 mfid5 GPT (1.8T) 40 532480 1 efi (260M) 532520 16777216 3 freebsd-swap (8.0G) 17309736 3888635824 4 freebsd-zfs (1.8T) ler in 🌐 borg in ~ via C v14.0.5-clang on ☁️ (us-east-1) ❯ Disk number and sizes vary but the setup is the same EFI or BOOT or Both, swap, and ZFS on *ALL* disks -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 --=_7e89b74620cdf99cbfe4dd82a77f1676 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

On 11/22/2022 5:50 pm, Eric Borisch wrote:

On Tue, Nov 22, 2022 at 1:50 PM Warner Losh <imp@bsdimp.com> wrote:=


On Tue, Nov 22, 2022, 11:42 AM Alan= Somers <asome= rs@freebsd.org> wrote:
On Tue, May 31, 2022 at 9:27 AM John Kennedy <warlock@phouka.net&g= t; wrote:
>
> On Tue, May 31, 2022 at 02:32:21PM +0200, Jul= ien Cigar wrote:
> > I have a Dell R340 server on which installe= d a 13.0-RELEASE and then
> > upgraded to 13.1-RELEASE (through = freebsd-update). ZFS is used (raidz2).
> >
> > The sy= stem has the following partitions: https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466<= /a>
> > Some things regarding UEFI are not clear to me:
>= ; > - as you can see in the partition list, the installer created an EFI=
> > partition on all 4 drives, however it looks like only the f= irst one has
> > has been populated (an mounted): https://gist.github.com/silenius/1220c95= 3f905d868c1615fd0e7122bbf .. why ?
> > - if I understand wel= l if my da0 disk dies the system becomes
> >   unboota= ble (https://gist.github.= com/silenius/51d202053295270eaaeb2c02316165ee).. correct?
> >= ; - what's the correct way to fix this? should I newfs_msdos on each EFI> >   partition and copy /boot/loader.efi as /EFI/BOOT/B= OOTX64.EFI? or
> >   should I use efibootmgr?
>= ; >
> > Thanks for enlightening me :)
>
> I u= se UEFI to multi-boot a lot myself, but not through efibootmgr (vs
>= ; picking it via UEFI/BIOS on boot manually).  I'm multi-booting windo= ws
> and FreeBSD, so I'm being (justifiably) paranoid, but not base= d on
> being burnt in recent memory.
>
> Depending = on how your system works (drives are enumerated at startup),
> in t= heory any of your disks could be da0.  If you've only got a working> EFI partition on one, that is probably hedging your bets a bit but = yes,
> if that drive died, you'd probably be dead.
>
&= gt; In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) partit= ion
> on both disks, I split my total swap between the two (not mir= rored), and
> did ZFS "raiding" (mirroring-ish, usually) across the= freebsd-zfs partitions.
>
> In my case, using the UEFI/BIO= S from the motherboard, I could manually
> pick a disk to boot from= which let me vet UEFI or ZFS bootblock changes
> for sanity before= committing to both.  But yes, I'd upgrade them both to
> the = same thing once I was sure it would work.

I just noticed the sam= e problem.  For mirrored installs, the
13.1-RELEASE installer onl= y formats the efi partition on one hard
disk.  Shouldn't it do bo= th?
 
 
We go back and forth on this question.... I think we shou= ld, but others got grumpy when I suggested it. Maybe just all the drives in= the zpool used for the BE?
 
Warner
 
Just a "yes, please." If you're installing zfs root on a = mirror of disks, POLA suggests the required boot bits are on both disks, to= o.
 
Thanks,
  - Eric
 
 

This is my common setup for every FreeBSD box I build:

=E2=9D=AF gpart show
=3D>        40  3905945520  mfi= d0  GPT  (1.8T)
          40      532480=       1  efi  (260M)
      532520    16779224    &= nbsp; 3  freebsd-swap  (8.0G)
    17311744  3888633816      4&nb= sp; freebsd-zfs  (1.8T)
 
=3D>        40  3905945520  mfi= d1  GPT  (1.8T)
          40      532480=       1  efi  (260M)
      532520    16779224    &= nbsp; 3  freebsd-swap  (8.0G)
    17311744  3888633816      4&nb= sp; freebsd-zfs  (1.8T)
 
=3D>        40  5859442608  mfi= d2  GPT  (2.7T)
          40      532480=       1  efi  (260M)
      532520    16779224    &= nbsp; 3  freebsd-swap  (8.0G)
    17311744  5842130904      4&nb= sp; freebsd-zfs  (2.7T)
 
=3D>        40  5859442608  mfi= d3  GPT  (2.7T)
          40      532480=       1  efi  (260M)
      532520    16779224    &= nbsp; 3  freebsd-swap  (8.0G)
    17311744  5842130904      4&nb= sp; freebsd-zfs  (2.7T)
 
=3D>        40  3905945520  mfi= d4  GPT  (1.8T)
          40      532480=       1  efi  (260M)
      532520    16779224    &= nbsp; 3  freebsd-swap  (8.0G)
    17311744  3888633816      4&nb= sp; freebsd-zfs  (1.8T)
 
=3D>        40  3905945520  mfi= d5  GPT  (1.8T)
          40      532480=       1  efi  (260M)
      532520    16777216    &= nbsp; 3  freebsd-swap  (8.0G)
    17309736  3888635824      4&nb= sp; freebsd-zfs  (1.8T)
 
 
ler in =F0=9F=8C=90 borg in ~ via C v14.0.5-clang on =E2=98=81= =EF=B8=8F  (us-east-1)
=E2=9D=AF
 
Disk number and sizes vary but the setup is the same EFI or BOOT= or Both, swap, and ZFS on *ALL* disks
= -- 
Larry Rosenman        = ;             http://www.lerctr.org= /~ler
Phone: +1 214-642-9640           &n= bsp;     E-Mail: ler@lerctr.org=
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
--=_7e89b74620cdf99cbfe4dd82a77f1676-- From nobody Wed Nov 23 06:25:14 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHB284G1jz4hpPv for ; Wed, 23 Nov 2022 06:25:20 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHB271KCRz3xxD for ; Wed, 23 Nov 2022 06:25:19 +0000 (UTC) (envelope-from ler@lerctr.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b=Tvfj+pDp; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) smtp.mailfrom=ler@lerctr.org; dmarc=pass (policy=none) header.from=lerctr.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Transfer-Encoding:Content-Type:Message-ID:Subject:To: From:Date:MIME-Version:Sender:Reply-To:Cc:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=XXwHtslXLKD2B8GSM23SVNSia7hfE4lm8a7vN+HacMA=; b=Tvfj+pDpAB+3UIDP6Awc1y9CKb R25HxlifDyc1EqsXBrMcsnsePMhglFW8OsWp29cO2fJh8EFPurUqK+Lg8pOSbI58+XY3iC56BgMvu xp7n2GegzZ53CyrEVMOD+yL3FqijXmdfM9AYjCgEn9QnyeD/Jfedkr6ofObv51WCvDvhRK6Gi73R1 5D6jG/TmlcYhJSghQxZ8A1YaLX2UEa1YcRjnt4BiJ6NYmTM8RV4kZemezxrRlXIsYdklU4J/To7FN V8py2xdigsBWzHZtHE/BFTCaUQz821bREQED55vl2drR+G5N06YJXruN4T+z2TblpTY9BeCryP5Zp DuhL/hbA==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:32340 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1oxjC6-000Mu1-JK for freebsd-fs@freebsd.org; Wed, 23 Nov 2022 00:25:14 -0600 Received: from 2600:1700:210:b18f:785a:29fa:3f63:a575 by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 23 Nov 2022 00:25:14 -0600 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Wed, 23 Nov 2022 00:25:14 -0600 From: Larry Rosenman To: Freebsd fs Subject: NFSv4.2: One share not automounting Message-ID: <74b67036bfd95d1ec831f265c1712e31@lerctr.org> X-Sender: ler@lerctr.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-3.95 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.95)[-0.955]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[lerctr.org:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[ler]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NHB271KCRz3xxD X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N I have the following 2 entries in /etc/fstab: ######### freenas.lerctr.org:/mnt/data/TBH /vault/backup/TBH nfs rw,nfsv4,minorversion=2,nconnect=8 0 0 freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs rw,nfsv4,minorversion=2,nconnect=8 0 0 the top one (ending in /TBH) doesn't mount at boot, but if I do a manual mount, it's fine. How can I get data to diagnose this issue? This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov 22 23:59:16 CST 2022 ❯ uname -a FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29 ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST 2022 root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 From nobody Wed Nov 23 08:17:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHDX64BRqz4j3W3 for ; Wed, 23 Nov 2022 08:17:58 +0000 (UTC) (envelope-from SRS0=mx3Y=3X=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4NHDX61bjhz46S4; Wed, 23 Nov 2022 08:17:58 +0000 (UTC) (envelope-from SRS0=mx3Y=3X=perdition.city=julien@bebif.be) Authentication-Results: mx1.freebsd.org; none Received: from x1 (94.105.107.162.dyn.edpnet.net [94.105.107.162]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 2ACB11474B; Wed, 23 Nov 2022 09:17:51 +0100 (CET) Date: Wed, 23 Nov 2022 09:17:48 +0100 From: Julien Cigar To: Larry Rosenman Cc: Eric Borisch , Warner Losh , Alan Somers , FreeBSD FS , John Kennedy , Nathan Whitehorn Subject: Re: UEFI question Message-ID: <20221123081748.g3jiad4udh4pxzyd@x1> References: <20220531123221.n7ubs365ceeqo2d4@x1> <1e6a680f170f85563caba1d0842bfa46@lerctr.org> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="nvnzkhq26mu6l3s7" Content-Disposition: inline In-Reply-To: <1e6a680f170f85563caba1d0842bfa46@lerctr.org> X-Rspamd-Queue-Id: 4NHDX61bjhz46S4 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --nvnzkhq26mu6l3s7 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Nov 22, 2022 at 08:01:50PM -0600, Larry Rosenman wrote: >=20 >=20 > On 11/22/2022 5:50 pm, Eric Borisch wrote: >=20 > > On Tue, Nov 22, 2022 at 1:50 PM Warner Losh wrote: > >=20 > > On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: > > On Tue, May 31, 2022 at 9:27 AM John Kennedy wrote: > > >=20 > > > On Tue, May 31, 2022 at 02:32:21PM +0200, Julien Cigar wrote: > > > > I have a Dell R340 server on which installed a 13.0-RELEASE and then > > > > upgraded to 13.1-RELEASE (through freebsd-update). ZFS is used > > > > (raidz2). > > > >=20 > > > > The system has the following partitions: > > > > https://gist.github.com/silenius/2defdd5480c5c1bc9ba2ff8940756466 > > > > Some things regarding UEFI are not clear to me: > > > > - as you can see in the partition list, the installer created an EFI > > > > partition on all 4 drives, however it looks like only the first > > > > one has > > > > has been populated (an mounted): > > > > https://gist.github.com/silenius/1220c953f905d868c1615fd0e7122bbf > > > > .. why ? > > > > - if I understand well if my da0 disk dies the system becomes > > > > unbootable > > > > (https://gist.github.com/silenius/51d202053295270eaaeb2c02316165ee)= =2E. > > > > correct? > > > > - what's the correct way to fix this? should I newfs_msdos on > > > > each EFI > > > > partition and copy /boot/loader.efi as /EFI/BOOT/BOOTX64.EFI? or > > > > should I use efibootmgr? > > > >=20 > > > > Thanks for enlightening me :) > > >=20 > > > I use UEFI to multi-boot a lot myself, but not through efibootmgr (vs > > > picking it via UEFI/BIOS on boot manually). I'm multi-booting windows > > > and FreeBSD, so I'm being (justifiably) paranoid, but not based on > > > being burnt in recent memory. > > >=20 > > > Depending on how your system works (drives are enumerated at startup), > > > in theory any of your disks could be da0. If you've only got a > > > working > > > EFI partition on one, that is probably hedging your bets a bit but > > > yes, > > > if that drive died, you'd probably be dead. > > >=20 > > > In my dual-disk setups, I'd see an EFI and a freebsd-boot (BIOS) > > > partition > > > on both disks, I split my total swap between the two (not mirrored), > > > and > > > did ZFS "raiding" (mirroring-ish, usually) across the freebsd-zfs > > > partitions. > > >=20 > > > In my case, using the UEFI/BIOS from the motherboard, I could manually > > > pick a disk to boot from which let me vet UEFI or ZFS bootblock > > > changes > > > for sanity before committing to both. But yes, I'd upgrade them > > > both to > > > the same thing once I was sure it would work. > >=20 > > I just noticed the same problem. For mirrored installs, the > > 13.1-RELEASE installer only formats the efi partition on one hard > > disk. Shouldn't it do both? > >=20 > > We go back and forth on this question.... I think we should, but others > > got grumpy when I suggested it. Maybe just all the drives in the zpool > > used for the BE? > >=20 > > Warner >=20 > Just a "yes, please." If you're installing zfs root on a mirror of disks, > POLA suggests the required boot bits are on both disks, too. >=20 > Thanks, > - Eric >=20 > >=20 >=20 > This is my common setup for every FreeBSD box I build: >=20 > =E2=9D=AF gpart show > =3D> 40 3905945520 mfid0 GPT (1.8T) > 40 532480 1 efi (260M) > 532520 16779224 3 freebsd-swap (8.0G) > 17311744 3888633816 4 freebsd-zfs (1.8T) >=20 > =3D> 40 3905945520 mfid1 GPT (1.8T) > 40 532480 1 efi (260M) > 532520 16779224 3 freebsd-swap (8.0G) > 17311744 3888633816 4 freebsd-zfs (1.8T) >=20 > =3D> 40 5859442608 mfid2 GPT (2.7T) > 40 532480 1 efi (260M) > 532520 16779224 3 freebsd-swap (8.0G) > 17311744 5842130904 4 freebsd-zfs (2.7T) >=20 > =3D> 40 5859442608 mfid3 GPT (2.7T) > 40 532480 1 efi (260M) > 532520 16779224 3 freebsd-swap (8.0G) > 17311744 5842130904 4 freebsd-zfs (2.7T) >=20 > =3D> 40 3905945520 mfid4 GPT (1.8T) > 40 532480 1 efi (260M) > 532520 16779224 3 freebsd-swap (8.0G) > 17311744 3888633816 4 freebsd-zfs (1.8T) >=20 > =3D> 40 3905945520 mfid5 GPT (1.8T) > 40 532480 1 efi (260M) > 532520 16777216 3 freebsd-swap (8.0G) > 17309736 3888635824 4 freebsd-zfs (1.8T) >=20 > ler in =F0=9F=8C=90 borg in ~ via C v14.0.5-clang on =E2=98=81=EF=B8=8F = (us-east-1) > =E2=9D=AF >=20 > Disk number and sizes vary but the setup is the same EFI or BOOT or Both, > swap, and ZFS on *ALL* disks By default disks are partitionned but.. that's all. You need to=20 newfs_msdos and cp loader.efi on each but first EFI partition. I don't understand the reason but I think some people will be upset when the first disk dies and the system won't boot anymore... >=20 > --=20 > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --nvnzkhq26mu6l3s7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmN91yAACgkQCLYqJMpB HmlvGxAAvgI9g111bg2kLVQVIMLE7WDP3gy+KK1+t+lVdqrE982GJxClKQWFelh8 2KD5w7o1NTryZDkRA4rqz5k9pLu0sEblt6un9VJrlszMHFwrmIQ6Gps1fm30N2zz ARlQqv3sf/F6KYazzcb7n4nT3u2BWX9qG3nMmYjcMGZZJLyzA6DqRnqmSraxaWvx lV6FzcBOWT8dNrA3BQcCoDWsTwsA0QkkxOSALwwZtZ0ZzpjJGjOLxQaw6yt28orj z1eFXu5ZEp/eb2wfsxAnmpQlwpTkZOAW/nNpIrUvi7TSWlGgmUpZFoAXwmZfgXd6 ZE1GhACoTgs6KtXmYseKDZ8JB/YsKms+2iDsgyeeKU66vttCQgYcmjzF0wkQHkTV u1Koece4DzbYWoGp70g3q2NTmgHusn3lcC1Au7TItRGqFN1uawgg3D6hxvkRRIxD jwUVlsENj+vRlUXTOHjkKPVZGPq/JDC/XqWzdlLc2g3H4CSU+uiJDKThm5fvacPq zZGsS6rTxjXVm/VBDfJPg90EVbzrBnd0Gm94ZnfO4MVUFCN8OhDXN8c9Dps3wwTt C6d8yWy6HOWL5ZmedZ3Cyj65OLOC8M2lfK8NtXdMRJB/fNQaY13cJPRvcHryEIgO w9V/xGXTWUOvfO4u0069Sv6wO05jwd/nUaFJ/NBUalBnPwOauBY= =QiNu -----END PGP SIGNATURE----- --nvnzkhq26mu6l3s7-- From nobody Wed Nov 23 12:47:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHLVh68jcz4jY7H for ; Wed, 23 Nov 2022 12:47:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHLVh3QPxz4VnB for ; Wed, 23 Nov 2022 12:47:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669207628; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nR9CUDHlWVyslnDMKetn0p6aTv/E+bW7i2G9UfFyPCQ=; b=S2ejoTDOFYdhRQxY4CRELj1oNovO63Haby1be4sdiC1dUlRbhFQS/jIT4NL7u5fXf94Yvu 5+Y3wWu2+1zOutQaM3JOO40oL3hhOnjfvSO3ZYYn47Ld7oQ/Gq89egTo1/Cv9qP0aV1Tdd QqquPp7FdN9+kzozFpL6ptp10woOwQ5au1G/fyjmlOz1WHwedNtCbsM3Gd/bUPfZYnW9/6 WmoCGztBnGS3nT4SJgCMisBB/06Tl2iega0vu6son50C5JD9KqUNw24wF9QhojTDnYLJaB IplogFRpnGcsVESabsFjb446b4i6pPfS/eZWOZe2UW/ajTU+0e1kwbyf/4KcWw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669207628; a=rsa-sha256; cv=none; b=Nr6dJV58Sx/V3q+mXmxIJu3CIetqmxwant4ou3P/8edwlqilwRSa44B+G70snz8UjJeNwb sEI9tXvBDw8+foHz7ePN+/NkBSWOGRANImhc7F9D8LQD5aHRn+0BVu841ybJJ+RlSYvVZ9 mVgjNdJpurISPUZyKw0Eynyhj4+cI7V2jA6KyYAgY//FEZjsqCY1PkOUuf35PTCHRj5mRa AUPn9UhfKtT4vtVF81aBTccPPgu1hFaaGqMKYc7tUM8Yl9aDTjDQiZ4hi7MtZORXj6XJA9 jHegYxQlkUTGAwn6DRAmXC/bGK6atkYiRmgWAuy9LL0MuOPRyf4cA/clBv1EHA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NHLVh2PJFzN5w for ; Wed, 23 Nov 2022 12:47:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ANCl8eW076182 for ; Wed, 23 Nov 2022 12:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ANCl8PL076181 for fs@FreeBSD.org; Wed, 23 Nov 2022 12:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Wed, 23 Nov 2022 12:47:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: nvass@gmx.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 nvass@gmx.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nvass@gmx.com --- Comment #6 from nvass@gmx.com --- Created attachment 238278 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D238278&action= =3Dedit script to trigger the bug Hi, I still see this on CURRENT. It gets easily triggered by gunion: sh g_union.sh da1p1 da1p2 (Regarding NVMe: sh g_union.sh nvd0p1 nvd0p2 deadlocks as well printing "nvme0: nvme_payload= _map err 27") The script is attached --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Nov 23 15:20:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHPvg5fnTz4hcrM for ; Wed, 23 Nov 2022 15:20:31 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pj1-x1033.google.com (mail-pj1-x1033.google.com [IPv6:2607:f8b0:4864:20::1033]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHPvf6Lp7z3FpX for ; Wed, 23 Nov 2022 15:20:30 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=MTevmWUF; spf=pass (mx1.freebsd.org: domain of rick.macklem@gmail.com designates 2607:f8b0:4864:20::1033 as permitted sender) smtp.mailfrom=rick.macklem@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pj1-x1033.google.com with SMTP id j10-20020a17090aeb0a00b00218dfce36e5so1928908pjz.1 for ; Wed, 23 Nov 2022 07:20:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=/WZ9xpjFMIix0jkrfPhgRPnlhDJfm1VDTKL0zjNcrH4=; b=MTevmWUFqU0dcdsBBCfG4HmK9fonrhR6jZCbMKVbP3428VxBVxnQLuNLyO/Nwd4Lr3 PUX3xNcW3WVihjYCKFRh7pz+/dYc7YAwDIOY8doLUnfoHmZICHvA/qIcpujL7/AV/Jyo gjazX8pS3BLmrjyV2x9vsblsg2qvpzzXmfznST9n/vtsaCmSfckqeENDnazDdH01qD/+ 3ZydnGfoyvwd4yXRnqfNeSGI0lDLJGUyGw8u3Qbnfa2xwdXBEkIRbI6oHawJL1U+2vo4 NHbQtc3C3jwfsWDvsYyhVRzimxjcA7/bL/Z42sEDQeJQACs8k0JOXPFAent1a8OSOEap SAJg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=/WZ9xpjFMIix0jkrfPhgRPnlhDJfm1VDTKL0zjNcrH4=; b=DzE1uCpdT/2l/Xy2mWO+MxHZM5o4vU9JELT103mHGn9tnz5qoC6pdk09ipTyqUmBis uJN3FxyiXH6HLUDZwu7wK7nfJIp2Gjm7zzI4vEKKjqSCP10LxVKMTm1YcznciM/mVVdB pUcetV7anUr39V6DuNxHp2KOlf5Bur5Xz/Z529cp+YGJvV1X2fhku5Stg+TFt78VQC/0 le6iVuyItb/zrQMz7V+4wtZ8m9p7vP9uzG5l+9NswFDT8i6rNjeDE0GrE2WknOF6fM1X /XODfsjAJb52n5/MhkV8/21myaMewVLfFvJfGf9pKUVbg2kHEF05H5UFdT8PRMLJ1UgS AXOw== X-Gm-Message-State: ANoB5pmOcWwi7pq8BVIuuuB3hx42rn3kSqUnuzO3+IKV70rywE6RSlaq CWzgTUTwsXootsUfcmYYVYMV5JoCsoV3UJvwteJkZarVFQ== X-Google-Smtp-Source: AA0mqf6Xzevidmw+FvlWIuSJ/c3g8swdJEQwqT9eCM40n5KkfqjKKa0KplrjqBinSr/xmLacT2PNNDEH1/LUZrjlggc= X-Received: by 2002:a17:903:40cb:b0:188:7dca:6f4a with SMTP id t11-20020a17090340cb00b001887dca6f4amr9291863pld.60.1669216829704; Wed, 23 Nov 2022 07:20:29 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <74b67036bfd95d1ec831f265c1712e31@lerctr.org> In-Reply-To: From: Rick Macklem Date: Wed, 23 Nov 2022 07:20:20 -0800 Message-ID: Subject: Fwd: NFSv4.2: One share not automounting To: Freebsd fs Content-Type: multipart/alternative; boundary="000000000000300c6a05ee24d409" X-Spamd-Result: default: False [-3.91 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.912]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1033:from]; ARC_NA(0.00)[]; TAGGED_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4NHPvf6Lp7z3FpX X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N --000000000000300c6a05ee24d409 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman wrote: > CAUTION: This email originated from outside of the University of Guelph. > Do not click links or open attachments unless you recognize the sender an= d > know the content is safe. If in doubt, forward suspicious emails to > IThelp@uoguelph.ca > > > I have the following 2 entries in /etc/fstab: > ######### > freenas.lerctr.org:/mnt/data/TBH /vault/backup/TBH nfs > rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0 > freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs > rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0 > > the top one (ending in /TBH) doesn't mount at boot, but if I do a manual > mount, it's fine. > Is /vault/backup a mount point on the client? (You didn't show the rest of your /etc/fstab.) If so, it might be a timing thing w.r.t. when /vault/backup gets mounted. You could try the "late" mount option, to see if that helps. Other than that, I cannot think why the first one would not work. rick ps: Normally NFSv4 mounts a tree of file systems on the server and, as such, a single mount to a server is used, but doing multiple mounts should work. > How can I get data to diagnose this issue? > > This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov > 22 23:59:16 CST 2022 > > =E2=9D=AF uname -a > FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29 > ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST > 2022 > root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 > > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 > > --000000000000300c6a05ee24d409 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Tue, Nov 22, 2= 022 at 10:25 PM Larry Rosenman <ler@ler= ctr.org> wrot= e:
CAUTION:= This email originated from outside of the University of Guelph. Do not cli= ck links or open attachments unless you recognize the sender and know the c= ontent is safe. If in doubt, forward suspicious emails to IThelp@uoguelph.ca


I have the following 2 entries in /etc/fstab:
#########
freenas.lerctr.org:/mnt/data/TBH=C2=A0 =C2=A0 /vault/backup/TBH=C2=A0 =C2= =A0 nfs
rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0
freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs
rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0

the top one (ending in /TBH) doesn't mount at boot, but if I do a manua= l
mount, it's fine.
Is /vault/backup a mount point on the client?=
(You didn't show the rest of your /etc/fstab.)
If so, it might= be a timing thing w.r.t. when /vault/backup
gets mounted.

You could try the "late" mount option, to see if that helps.

Other than that, I cannot think why the first one would not wor= k.

rick
ps: Normally NFSv4 mounts a tree of file systems= on the server and,
=C2=A0 =C2=A0 as such, a single mount to a server i= s used, but doing multiple
=C2=A0 =C2=A0 mounts should work.
=C2=A0
How can I get data to diagnose this issue?

This has been happening for a while.=C2=A0 FreeBSD 14-CURRENT as of Tue Nov=
22 23:59:16 CST 2022

=E2=9D=AF uname -a
FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29
ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST
2022=C2=A0 =C2=A0 =C2=A0
root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64



--
Larry Rosenman=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0http://www.lerctr.org/~ler
Phone: +1 214-642-9640=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0E-Mail: ler@l= erctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

--000000000000300c6a05ee24d409-- From nobody Wed Nov 23 16:41:44 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHRjY19P3z4hn1l for ; Wed, 23 Nov 2022 16:41:53 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHRjX3GGyz3MF8 for ; Wed, 23 Nov 2022 16:41:52 +0000 (UTC) (envelope-from ler@lerctr.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b="RP/EWqHS"; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) smtp.mailfrom=ler@lerctr.org; dmarc=pass (policy=none) header.from=lerctr.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Type:Message-ID:References:In-Reply-To:Subject:Cc:To: From:Date:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=KVYsiEfJa0JlMQCJ5bdhCyWV8F2Ze5jm9ZWh7a/O2uM=; b=RP/EWqHS/Da1ZI9Am/W9VOAGs/ uBhdgggvIOWN3ZQl9ff/cZYqJVt1QK2lscZj6tYQ+hq4S1N8ThP0um1LClS6kBcHG3ojEj1/H37oT Ki6fXaT2gejAsBby/9wOIM+e5yLwHyip6z0MzTh6mCox3KSzNEYAJXDo0ekiwRXlZI0QPbmwZbZna 7maslF5+pRASviVdAcMzuKEXSiPTqpBPCndFJaiI38DLQDiR+mZJEeF7Nd90iSkjauk5o5x4PwN0n iEwpserfCE1f0QGA6Sar50rh08FnwmRQbrnhz1SiNmy3aLQ2H3Rd2gugEX6JEtDgpTo2FMMo6/LLZ rra7cQiA==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:56106 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1oxsoi-0008j1-9x; Wed, 23 Nov 2022 10:41:44 -0600 Received: from 2600:1700:210:b18f:3147:522c:1f71:d794 by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 23 Nov 2022 10:41:44 -0600 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Wed, 23 Nov 2022 10:41:44 -0600 From: Larry Rosenman To: Rick Macklem Cc: Freebsd fs Subject: Re: NFSv4.2: One share not automounting In-Reply-To: References: <74b67036bfd95d1ec831f265c1712e31@lerctr.org> Message-ID: X-Sender: ler@lerctr.org Content-Type: multipart/alternative; boundary="=_11c58a9d645c402a30f1ff3334450a12" X-Spamd-Result: default: False [-2.96 / 15.00]; URI_COUNT_ODD(1.00)[11]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_LONG(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.97)[-0.967]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[lerctr.org:+]; FREEFALL_USER(0.00)[ler]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TAGGED_RCPT(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NHRjX3GGyz3MF8 X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --=_11c58a9d645c402a30f1ff3334450a12 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8; format=flowed /vault/backup is just a directory local on the client. Late causes other issues with both mounts and the rest of the boot sequence. On 11/23/2022 8:59 am, Rick Macklem wrote: > On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman wrote: > >> CAUTION: This email originated from outside of the University of >> Guelph. Do not click links or open attachments unless you recognize >> the sender and know the content is safe. If in doubt, forward >> suspicious emails to IThelp@uoguelph.ca >> >> I have the following 2 entries in /etc/fstab: >> ######### >> freenas.lerctr.org:/mnt/data/TBH /vault/backup/TBH nfs >> rw,nfsv4,minorversion=2,nconnect=8 0 0 >> freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs >> rw,nfsv4,minorversion=2,nconnect=8 0 0 >> >> the top one (ending in /TBH) doesn't mount at boot, but if I do a >> manual >> mount, it's fine. > > Is /vault/backup a mount point on the client? > (You didn't show the rest of your /etc/fstab.) > If so, it might be a timing thing w.r.t. when /vault/backup > gets mounted. > > You could try the "late" mount option, to see if that helps. > > Other than that, I cannot think why the first one would not work. > > rick > ps: Normally NFSv4 mounts a tree of file systems on the server and, > as such, a single mount to a server is used, but doing multiple > mounts should work. > >> How can I get data to diagnose this issue? >> >> This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov >> 22 23:59:16 CST 2022 >> >> ❯ uname -a >> FreeBSD borg.lerctr.org [1] 14.0-CURRENT FreeBSD 14.0-CURRENT #29 >> ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST >> 2022 >> root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL >> amd64 >> >> -- >> Larry Rosenman http://www.lerctr.org/~ler >> Phone: +1 214-642-9640 E-Mail: ler@lerctr.org >> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 Links: ------ [1] http://borg.lerctr.org --=_11c58a9d645c402a30f1ff3334450a12 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

/vault/backup is just a directory local on the client.

Late causes other issues with both mounts and the rest of the boot seque= nce.

On 11/23/2022 8:59 am, Rick Macklem wrote:

 

On Tue, Nov 22, 2022 at 10:25 PM La= rry Rosenman <ler@l= erctr.org> wrote:
CAUTION: This email origin= ated from outside of the University of Guelph. Do not click links or open a= ttachments unless you recognize the sender and know the content is safe. If= in doubt, forward suspicious emails to IThelp@uoguelph.ca


I have the fo= llowing 2 entries in /etc/fstab:
#########
freenas.lerctr.org:/mn= t/data/TBH    /vault/backup/TBH    nfs
rw,nfsv4,m= inorversion=3D2,nconnect=3D8 0 0
freenas.lerctr.org:/mnt/data/BACULA /= vault/backup/BACULA nfs
rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0
the top one (ending in /TBH) doesn't mount at boot, but if I do a = manual
mount, it's fine.
Is /= vault/backup a mount point on the client?
(You= didn't show the rest of your /etc/fstab.)
If s= o, it might be a timing thing w.r.t. when /vault/backup
gets= mounted.
&nbs= p;
You = could try the "late" mount option, to see if that helps.
&nbs= p;
Othe= r than that, I cannot think why the first one would not work.
&nbs= p;
rick=
ps: = Normally NFSv4 mounts a tree of file systems on the server and,
&nbs= p;   as such, a single mount to a server is used, but doing multiple
&nbs= p;   mounts should work.
 
How can I get data to diag= nose this issue?

This has been happening for a while.  Free= BSD 14-CURRENT as of Tue Nov
22 23:59:16 CST 2022

=E2=9D= =AF uname -a
FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14= =2E0-CURRENT #29
ler/freebsd-main-changes-n259398-496d4d928269: Tue N= ov 22 23:59:16 CST
2022     
root@borg.lerctr.org= :/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64



= --
Larry Rosenman              &nb= sp;      http://www.lerctr.org/~ler
Phone= : +1 214-642-9640                &n= bsp;E-Mail: ler@lerctr= =2Eorg
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


= -- 
Larry Rosenman        = ;             http://www.lerctr.org= /~ler
Phone: +1 214-642-9640           &n= bsp;     E-Mail: ler@lerctr.org=
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
--=_11c58a9d645c402a30f1ff3334450a12-- From nobody Wed Nov 23 21:33:52 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHZBj0J47z4h88s for ; Wed, 23 Nov 2022 21:34:05 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pg1-x52d.google.com (mail-pg1-x52d.google.com [IPv6:2607:f8b0:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHZBh36TTz42Ln for ; Wed, 23 Nov 2022 21:34:04 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52d.google.com with SMTP id f3so17863626pgc.2 for ; Wed, 23 Nov 2022 13:34:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=/agxs4QvQpLDxyy4BGxpNUwpB/fPS1TI6GtmhPTjA0k=; b=alfgpyC8YnWfhgfwXOZwZXZo1gjVnfHc8EZtYKxKLk10oydWVYGP2AW+fyprXzqTDA fWPIaFFuXo4tgeSXI4QKaZC2E2f1jHXPufl5hWXb5aorKO3m8QkD5sjM3plx44fTZoWi id4wtWlGpN3y+iq+OyTCRpDr2C6JQZb3pJKPF8SlRlUX94HibXP8pYTNMKZw8+xoWWiF 10YyzwWjihtvV5gRcQ2qgulfZJ8eOQEhI25ZxYnTr2+nEMLkwyLbvyWECQkvUgDoKM5D mDa7FMidDmwvwmfHo9dgbm2hTi9n0YdbOQrewJpVApDSzOyvvjOcBwELpIxIlndwv8Cs MvxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=/agxs4QvQpLDxyy4BGxpNUwpB/fPS1TI6GtmhPTjA0k=; b=JfVrZlv6b9cO5seHiUMP+cC7vsjs/Hw9N5zdAuEzvT4ePf41RMoWLSaaWKDoYCQhUH SCjv89A08LisP4MJPmP8zysR2j7RnuBk2uYDTUek/0f4W1hrPeTNjpI7xvp0c8Rnp/mM 5ZKpdzPPXqAJqn3kYdjrQDd3ZwjwCAWTNFgW3+BD1zYKA/fG/DnR6oJ52bVz++SU5ktJ JrnDlFwEqFs+MbQZqLl7aacnlsPI1/MkPz/flHHBTekAK4Jvek0y7Ak77AJ7n5zL2XeI Ng7gJ0uYnE0yEUCUyGp+ir5MnPjGNPxjAJIwbpCbg/oP+guAnH1MSPra+OxAG+MoR/cK BCrQ== X-Gm-Message-State: ANoB5pn2SlKbYs9kYUw+/c/p0VvxYGRvsuSN5ggDlu4jWJJRwht6uG+S f/0gP673OuIuT31uerTNAlCZ+FkY8LjuRDtme39QGNkDyg== X-Google-Smtp-Source: AA0mqf4jivYHX48vBW8tUn2fnKKwvpChTfQRmUOc0Tiz3UMWtq6PmjMEd17G8L6rwPA04OuB3wHEpxKFsI20ODLLmMI= X-Received: by 2002:a05:6a00:1f10:b0:573:578b:e773 with SMTP id be16-20020a056a001f1000b00573578be773mr14228277pfb.11.1669239242907; Wed, 23 Nov 2022 13:34:02 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <74b67036bfd95d1ec831f265c1712e31@lerctr.org> In-Reply-To: From: Rick Macklem Date: Wed, 23 Nov 2022 13:33:52 -0800 Message-ID: Subject: Re: NFSv4.2: One share not automounting To: Larry Rosenman Cc: Freebsd fs Content-Type: multipart/alternative; boundary="0000000000001e66d805ee2a0ce6" X-Rspamd-Queue-Id: 4NHZBh36TTz42Ln X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000001e66d805ee2a0ce6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Wed, Nov 23, 2022 at 8:41 AM Larry Rosenman wrote: > /vault/backup is just a directory local on the client. > And /vault/backup/TBH is just a subdirectory of that file system? I vaguely recall a PR that looked like this, where there were nullfs mounts and I twiddled things so that "late" could be used, but that might only be for FreeBSD 14/current. I can't recall if the changes were MFC'd. You did not mention what version of FreeBSD you were using. rick > Late causes other issues with both mounts and the rest of the boot > sequence. > > On 11/23/2022 8:59 am, Rick Macklem wrote: > > > > On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman wrote: > > CAUTION: This email originated from outside of the University of Guelph. > Do not click links or open attachments unless you recognize the sender an= d > know the content is safe. If in doubt, forward suspicious emails to > IThelp@uoguelph.ca > > > I have the following 2 entries in /etc/fstab: > ######### > freenas.lerctr.org:/mnt/data/TBH /vault/backup/TBH nfs > rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0 > freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs > rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0 > > the top one (ending in /TBH) doesn't mount at boot, but if I do a manual > mount, it's fine. > > Is /vault/backup a mount point on the client? > (You didn't show the rest of your /etc/fstab.) > If so, it might be a timing thing w.r.t. when /vault/backup > gets mounted. > > You could try the "late" mount option, to see if that helps. > > Other than that, I cannot think why the first one would not work. > > rick > ps: Normally NFSv4 mounts a tree of file systems on the server and, > as such, a single mount to a server is used, but doing multiple > mounts should work. > > > How can I get data to diagnose this issue? > > This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov > 22 23:59:16 CST 2022 > > =E2=9D=AF uname -a > FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29 > ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST > 2022 > root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 > > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 > --0000000000001e66d805ee2a0ce6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Wed, Nov 23, 2022 at 8:41 AM Larry Rosenma= n <ler@lerctr.org> wrote:

/vault/backup is just a directory local on the client.

And= /vault/backup/TBH is just a subdirectory of that file system?
=

I vaguely recall a PR that looked like this, where there were
=
nullfs m= ounts and I twiddled things so that "late" could be used,<= /div>
but= that might only be for FreeBSD 14/current. I can't recall if
the c= hanges were MFC'd. You did not mention what version of
FreeBSD you = were using.

rick
=C2=A0

Late causes other issues with both mounts and the rest of the boot seque= nce.

On 11/23/2022 8:59 am, Rick Mac= klem wrote:

=C2=A0

On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman <ler@lerctr= .org> wrote:
CAUTION: This email originated from outside of = the University of Guelph. Do not click links or open attachments unless you= recognize the sender and know the content is safe. If in doubt, forward su= spicious emails to IThelp@uoguelph.ca


I have the following 2= entries in /etc/fstab:
#########
freenas.lerctr.org:/mnt/data/TBH=C2= =A0 =C2=A0 /vault/backup/TBH=C2=A0 =C2=A0 nfs
rw,nfsv4,minorversion=3D2= ,nconnect=3D8 0 0
freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACU= LA nfs
rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0

the top one (e= nding in /TBH) doesn't mount at boot, but if I do a manual
mount, i= t's fine.
Is /vault/backup a mount point o= n the client?
(You didn't show the rest of= your /etc/fstab.)
If so, it might be a timing thin= g w.r.t. when /vault/backup
gets mounted.
=C2=A0
You could try the "late&quo= t; mount option, to see if that helps.
=C2=A0
Other than that, I cannot think = why the first one would not work.
=C2=A0
rick
ps: Normally NFSv4 mounts a tree= of file systems on the server and,
=C2=A0 =C2=A0 as such, a single = mount to a server is used, but doing multiple
=C2=A0 =C2=A0 mounts should work= .
=C2=A0
How can I get data to diagnose this issue?
<= br>This has been happening for a while.=C2=A0 FreeBSD 14-CURRENT as of Tue = Nov
22 23:59:16 CST 2022

=E2=9D=AF uname -a
FreeBSD b= org.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29
ler/freebsd-ma= in-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST
2022=C2=A0 =C2= =A0 =C2=A0
root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MIN= IMAL amd64



--
Larry Rosenman=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0http://www.lerctr= .org/~ler
Phone: +1 214-642-9640=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0E-Mail: ler@lerctr.org
US Mail: 5708 Sabbia D= r, Round Rock, TX 78665-2106


--=C2=A0<= br>Larry Rosenman =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 http://www.lerctr.org/~ler
Phone: +1 214-642= -9640 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 E-Mail: ler@lerctr.org
US Mai= l: 5708 Sabbia Dr, Round Rock, TX 78665-2106
--0000000000001e66d805ee2a0ce6-- From nobody Wed Nov 23 21:37:55 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHZHH5zjlz4h8mC for ; Wed, 23 Nov 2022 21:38:03 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHZHG3ssdz42nv for ; Wed, 23 Nov 2022 21:38:02 +0000 (UTC) (envelope-from ler@lerctr.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b="QR/QXElE"; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) smtp.mailfrom=ler@lerctr.org; dmarc=pass (policy=none) header.from=lerctr.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Type:Message-ID:References:In-Reply-To:Subject:Cc:To: From:Date:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=X9bXF8ekLWqA/PdzuF37RecKzfb500S7PHK6Vn2+VhU=; b=QR/QXElEygioXWOtzwkCa9blxs zWIUHdsGfHtGOxd/mixDJ+PNrHh5HovYsoOeAnAJ/SVK1LSqAC1DvJV54qPcUVYzrdx0e7Enh1x2b PYXdbqqRG8l/LWvhv5CaC79ldpy3G0/f8iTYCPR5pH7fWMCjHyoVQo1MvQ4JdiaMYPcsA64IfYXEw Z9fN+s5/V5cdzRznvpeS8S04m3qLlgyMhp24pzCoYnklKchqOdLCTIKvLuZSrUXlC0C4fXuHusD7A CmraPYCKik3CCkIV+02shurrYw8x2TGwaNud7ixEfp9433iNd335vtEyoYdcKdnk6CNxmwzXSZi6i rDkvJR0Q==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:46664 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1oxxRM-000Eml-25; Wed, 23 Nov 2022 15:37:56 -0600 Received: from 2600:1700:210:b18f:3147:522c:1f71:d794 by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 23 Nov 2022 15:37:55 -0600 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Wed, 23 Nov 2022 15:37:55 -0600 From: Larry Rosenman To: Rick Macklem Cc: Freebsd fs Subject: Re: NFSv4.2: One share not automounting In-Reply-To: References: <74b67036bfd95d1ec831f265c1712e31@lerctr.org> Message-ID: <32fbd19648313962fa64d99896382a0e@lerctr.org> X-Sender: ler@lerctr.org Content-Type: multipart/alternative; boundary="=_e76da9c965e2cbbad314b83976c7753f" X-Spamd-Result: default: False [-3.00 / 15.00]; URI_COUNT_ODD(1.00)[17]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[lerctr.org:+]; FREEFALL_USER(0.00)[ler]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TAGGED_RCPT(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NHZHG3ssdz42nv X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --=_e76da9c965e2cbbad314b83976c7753f Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8; format=flowed yes. just a subdirectory of /: ❯ df /vault/backup Filesystem Size Used Avail Capacity Mounted on zroot/ROOT/14-2022_11_23-0001 7.8T 3.4G 7.8T 0% / ler in 🌐 borg in ~ via C v14.0.5-clang on ☁️ (us-east-1) ❯ and I did mention what version: This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov 22 23:59:16 CST 2022 ❯ uname -a FreeBSD borg.lerctr.org [1] 14.0-CURRENT FreeBSD 14.0-CURRENT #29 ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST 2022 root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 On 11/23/2022 3:33 pm, Rick Macklem wrote: > On Wed, Nov 23, 2022 at 8:41 AM Larry Rosenman wrote: > >> /vault/backup is just a directory local on the client. > > And /vault/backup/TBH is just a subdirectory of that file system? > > I vaguely recall a PR that looked like this, where there were > nullfs mounts and I twiddled things so that "late" could be used, > but that might only be for FreeBSD 14/current. I can't recall if > the changes were MFC'd. You did not mention what version of > FreeBSD you were using. > > rick > > Late causes other issues with both mounts and the rest of the boot > sequence. > > On 11/23/2022 8:59 am, Rick Macklem wrote: > > On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman wrote: > CAUTION: This email originated from outside of the University of > Guelph. Do not click links or open attachments unless you recognize the > sender and know the content is safe. If in doubt, forward suspicious > emails to IThelp@uoguelph.ca > > I have the following 2 entries in /etc/fstab: > ######### > freenas.lerctr.org:/mnt/data/TBH /vault/backup/TBH nfs > rw,nfsv4,minorversion=2,nconnect=8 0 0 > freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs > rw,nfsv4,minorversion=2,nconnect=8 0 0 > > the top one (ending in /TBH) doesn't mount at boot, but if I do a > manual > mount, it's fine. > Is /vault/backup a mount point on the client? > (You didn't show the rest of your /etc/fstab.) > If so, it might be a timing thing w.r.t. when /vault/backup > gets mounted. > > You could try the "late" mount option, to see if that helps. > > Other than that, I cannot think why the first one would not work. > > rick > ps: Normally NFSv4 mounts a tree of file systems on the server and, > as such, a single mount to a server is used, but doing multiple > mounts should work. > How can I get data to diagnose this issue? > > This has been happening for a while. FreeBSD 14-CURRENT as of Tue Nov > 22 23:59:16 CST 2022 > > ❯ uname -a > FreeBSD borg.lerctr.org [1] 14.0-CURRENT FreeBSD 14.0-CURRENT #29 > ler/freebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST > 2022 > root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 E-Mail: ler@lerctr.org > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 Links: ------ [1] http://borg.lerctr.org --=_e76da9c965e2cbbad314b83976c7753f Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

yes. just a subdirectory of /:

=E2=9D=AF df /vault/backup
Filesystem               = ;        Size    Used   Avail Capac= ity  Mounted on
zroot/ROOT/14-2022_11_23-0001    7.8T    3.4= G    7.8T     0%    /
 
ler in =F0=9F=8C=90 borg in ~ via C v14.0.5-clang on =E2=98=81= =EF=B8=8F  (us-east-1)
=E2=9D=AF
 
and I did mention what version:
This has been happening for= a while.  FreeBSD 14-CURRENT as of Tue Nov
22 23:59:16 CST 2022=

=E2=9D=AF uname -a
FreeBSD borg.lerctr.org 14.0-= CURRENT FreeBSD 14.0-CURRENT #29
ler/freebsd-main-changes-n259398-496= d4d928269: Tue Nov 22 23:59:16 CST
2022     
root= @borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64



On 11/23/2022 3:33 pm, Rick Macklem wrote:

 

On Wed, Nov 23, 2022 at 8:41 AM Lar= ry Rosenman <ler@le= rctr.org> wrote:

/vault/backup is just a directory local on the client.

And = /vault/backup/TBH is just a subdirectory of that file system?
&nbs= p;
I va= guely recall a PR that looked like this, where there were
null= fs mounts and I twiddled things so that "late" could be used,
but = that might only be for FreeBSD 14/current. I can't recall if
the = changes were MFC'd. You did not mention what version of
Free= BSD you were using.
&nbs= p;
rick=
 

Late causes other issues with both mounts and the rest of the boot seque= nce.

On 11/23/2022 8:59 am, Rick M= acklem wrote:

 

On Tue, Nov 22, 2022 at 10:25 PM Larry Rosenman <ler@lerctr.org> wrote= :
CAUTION: This email originated from outside of the= University of Guelph. Do not click links or open attachments unless you re= cognize the sender and know the content is safe. If in doubt, forward suspi= cious emails to IT= help@uoguelph.ca


I have the following 2 entries in /et= c/fstab:
#########
freenas.lerctr.org:/mnt/data/TBH    = /vault/backup/TBH    nfs
rw,nfsv4,minorversion=3D2,nconnect= =3D8 0 0
freenas.lerctr.org:/mnt/data/BACULA /vault/backup/BACULA nfs =
rw,nfsv4,minorversion=3D2,nconnect=3D8 0 0

the top one (en= ding in /TBH) doesn't mount at boot, but if I do a manual
mount, it's= fine.
Is /vault/backup a mount point= on the client?
(You didn't show the rest of y= our /etc/fstab.)
If so, it might be a timing th= ing w.r.t. when /vault/backup
gets mounted.
 
You could try the "late" mount= option, to see if that helps.
 
Other than that, I cannot thin= k why the first one would not work.
 
rick
ps: Normally NFSv4 mounts a tr= ee of file systems on the server and,
    as such, a singl= e mount to a server is used, but doing multiple
    mounts should wo= rk.
 
How can I get data to diagnose this issue?
This has been happening for a while.  FreeBSD 14-CURRENT as of Tue= Nov
22 23:59:16 CST 2022

=E2=9D=AF uname -a
FreeBSD = borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #29
ler/f= reebsd-main-changes-n259398-496d4d928269: Tue Nov 22 23:59:16 CST
202= 2     
root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd6= 4/sys/LER-MINIMAL amd64



--
Larry Rosenman = ;                    http://www.lerctr.org/~ler
Phone: +1 214-642-9640  &nbs= p;              E-Mail: ler@lerctr.org
US Mail: 5708 = Sabbia Dr, Round Rock, TX 78665-2106


--&= nbsp;
Larry Rosenman               =       http://www.lerctr.org/~ler
Phone: += 1 214-642-9640                 E-Ma= il: ler@lerctr.org=
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106


= -- 
Larry Rosenman        = ;             http://www.lerctr.org= /~ler
Phone: +1 214-642-9640           &n= bsp;     E-Mail: ler@lerctr.org=
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
--=_e76da9c965e2cbbad314b83976c7753f-- From nobody Thu Nov 24 07:39:59 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHqfR25d4z4hTKP for ; Thu, 24 Nov 2022 07:40:31 +0000 (UTC) (envelope-from Alexander@leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) client-signature ECDSA (P-256)) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHqfQ4VZxz3lhB for ; Thu, 24 Nov 2022 07:40:30 +0000 (UTC) (envelope-from Alexander@leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=3u1aaUL0; spf=pass (mx1.freebsd.org: domain of Alexander@leidinger.net designates 89.238.82.207 as permitted sender) smtp.mailfrom=Alexander@leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net Received: from outgoing.leidinger.net (p5b165cc5.dip0.t-ipconnect.de [91.22.92.197]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) client-signature ECDSA (P-256)) (Client CN "outgoing.leidinger.net", Issuer "R3" (verified OK)) by mailgate.Leidinger.net (Postfix) with ESMTPSA id 69A0A22DF8 for ; Thu, 24 Nov 2022 08:40:25 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1669275625; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=RtbGenjkRfGxQ42pg8lN12zXvK4qRkSpE8amrJ58Vuc=; b=3u1aaUL0gJ+hhlvlKTYM6bmecFTTEXZRR9kr3PRyFVxlGVZWnl+YrskTzM4l6Oo+twIRuB U2HbWGPjuW5ahe1+sinHFcmiXXcgk3ZKZzuR5iYnoQZB5BoI8a9OJ59i/0YQ/uk8zdX5g0 4uWybmoN7tbwPAcK2xn1FBzroRRD0M9LHfXG35e+IW/u33YmvSlUHoSIF/6P6EbHHZCyMa 2Dhduv3kXF2DgD/dgXs25U4lUPzau4EuDl48M55rnA1ARnF3b61RfZFo7g+cAfwtQj5ocq Z73E6Z+Z/xPsIamCZ7DwQqHwzcgbb8PIOSf6yYoYNqtuBFC6TuSVoGJerwB4Uw== Received: from webmail.leidinger.net (localhost [127.0.0.1]) by outgoing.leidinger.net (Postfix) with ESMTP id D1E713839 for ; Thu, 24 Nov 2022 08:39:59 +0100 (CET) Received: from www (uid 80) (envelope-from Alexander@leidinger.net) id 8a9af by webmail.leidinger.net (DragonFly Mail Agent v0.13+ on webmail.leidinger.net); Thu, 24 Nov 2022 08:39:59 +0100 Date: Thu, 24 Nov 2022 08:39:59 +0100 Message-ID: <20221124083959.Horde.OuPEDUTGTdU8KNqv5AvN04y@webmail.leidinger.net> From: Alexander Leidinger To: Eric Borisch Cc: Warner Losh , Alan Somers , FreeBSD FS , John Kennedy , Nathan Whitehorn Subject: Re: UEFI question References: <20220531123221.n7ubs365ceeqo2d4@x1> In-Reply-To: Accept-Language: de,en Content-Type: multipart/signed; boundary="=_aWP2gTUCynVLSuhMP59XuN6"; protocol="application/pgp-signature"; micalg=pgp-sha256 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-Spamd-Result: default: False [-6.10 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; FREEMAIL_TO(0.00)[gmail.com]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_FIVE(0.00)[6]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4NHqfQ4VZxz3lhB X-Spamd-Bar: ------ X-ThisMailContainsUnwantedMimeParts: N This message is in MIME format and has been PGP signed. --=_aWP2gTUCynVLSuhMP59XuN6 Content-Type: multipart/alternative; boundary="=_kjiPzK6rTi2FFqwh863fEk9" This message is in MIME format. --=_kjiPzK6rTi2FFqwh863fEk9 Content-Type: text/plain; charset=utf-8; format=flowed; DelSp=Yes Content-Description: Textnachricht Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Quoting Eric Borisch (from Tue, 22 Nov 2022=20=20 17:50:08=20-0600): > On Tue, Nov 22, 2022 at 1:50 PM Warner Losh wrote: > >> On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: >> =C2=A0 >> >>> I just noticed the same problem.=C2=A0 For mirrored installs, the >>> 13.1-RELEASE installer only formats the efi partition on one hard >>> disk.=C2=A0 Shouldn't it do both? >> >> =C2=A0 >> =C2=A0 >> We go back and forth on this question.... I think we should,=20=20 >>=20but others got grumpy when I suggested it. Maybe just all the=20=20 >>=20drives in the zpool used for the BE? >> >> =C2=A0 >> Warner > > =C2=A0 > Just a =E2=80=9Cyes, please.=E2=80=9D If you=E2=80=99re installing zf= s root on a mirror=20=20 >=20of disks, POLA suggests the required boot bits are on both disks, too. > =C2=A0 N disks instead of both disks please. All disks which are part of a redundant root pool should get=20=20 /everything/=20what is necessary to boot in case the primary boot drive=20= =20 of=20the pool fails. Theoretically we only need the amount of boot=20=20 redundancy=20to the level of redundancy degree of the pool (can't=20=20 rememeber=20if we now have support to boot from raidz, I only have=20=20 mirrors,=20but some of them with more than 2 disks), but as we can't=20=20 predict=20which drive fails until the redundancy level is reached, the=20= =20 only=20option we have is to mirror the freebsd-boot partition. If this is via gmirror or via independent partitions is another question. If we want to provide a drive failure resistant boot experience (and=20=20 the=20zfs pool types which offer redundancy make at least the users=20=20 believe=20we want to do that), there is not really an option to not do=20= =20 that. And=20while we're at it, I think we should mention in our upgrade=20=20 instructions=20(e.g. src/Makefile and src/UPDATING) how to update the=20=20 EFI=20parts too. Bye, Alexander. --=20 http://www.Leidinger.net=20Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_kjiPzK6rTi2FFqwh863fEk9 Content-Type: text/html; charset=utf-8 Content-Description: HTML-Nachricht Content-Disposition: inline Content-Transfer-Encoding: quoted-printable

Quoting Eric Borisch <eborisch@= gmail.com> (from Tue, 22 Nov 2022 17:50:08 -0600):

On Tue, Nov 22, 2022 at 1:50 PM Warner Losh <imp@bsdimp.com> wrote:


On Tue, Nov 22, 2022, 11:42 AM Alan S= omers <asomers@= freebsd.org> wrote:
 

I just noticed the same problem.  For mirrored installs, the
13.1-RELEASE installer only formats the efi partition on one hard
disk.  Shouldn't it do both?

 
 
We go back and forth on this question.... I think we shou= ld, but others got grumpy when I suggested it. Maybe just all the drives in= the zpool used for the BE?
 
Warner
 
Just a “yes, please.” If you’re install= ing zfs root on a mirror of disks, POLA suggests the required boot bits are= on both disks, too.
 


N disks instead of both disks please.

All disks which are part of a redundant root pool should get everything= what is necessary to boot in case the primary boot drive of the pool = fails. Theoretically we only need the amount of boot redundancy to the leve= l of redundancy degree of the pool (can't rememeber if we now have support = to boot from raidz, I only have mirrors, but some of them with more than 2 = disks), but as we can't predict which drive fails until the redundancy leve= l is reached, the only option we have is to mirror the freebsd-boot partiti= on.

If this is via gmirror or via independent partitions is another question.
If we want to provide a drive failure resistant boot experience (and the zf= s pool types which offer redundancy make at least the users believe we want= to do that), there is not really an option to not do that.

And while we're at it, I think we should mention in our upgrade instruction= s (e.g. src/Makefile and src/UPDATING) how to update the EFI parts too.

Bye,
Alexander.

--=_kjiPzK6rTi2FFqwh863fEk9-- --=_aWP2gTUCynVLSuhMP59XuN6 Content-Type: application/pgp-signature Content-Description: Digitale PGP-Signatur Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIzBAABCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmN/H84ACgkQEg2wmwP4 2IZfYQ/9HvEP+0NzZAPO9sqJkw/kpr2BVEEv21ghA2+d0LSyJialmIYyLuEP/ibR Z3P4rvUAAjqB+/E90fMrjPcXmBOyCKBe/Vys8UA6wem4L1ul/JV06vb6A9CRzG+7 A5JBpMGd8R0s1kRrl6I9lO9ShcH5/jEZjvSmJrgY19ipee0/cYsGIz+4SL+X39mk HzA244tILoSoBi9ZVb+5rjJniYMiCrrX8NeDaICfPImLXbr4TMMjyHLMnF3ig50I qmvEmJNmsJCYmZ4IoipbAc2Vw/ZiozYfH5BiO+ghavA+MoOShJQ4xde8bnI72h9z U724b6zUEo5AAOngW02XJyGvP+rF6WYJ7A3aeoaP2OJGedXGvyWxQxI5QM6JAyjQ Ng2ayBZc4xPV/VPc+w/QhU3JcuUpsSV6GmtD0KAkpAwI5LrJFtNTPijKUycWipwn xtSjL0LHpuaF3a0mJdCW+dEr9nxW5PKe5dJD7VgAensIe9co7o20Vt9fJNbtdZW8 KXzJoMMdrNLyuA+HZT8aPteQF2NnO75KbqrDce5o9MxyELBz/5QsR4O2GNpl0uxh YShQGg0eiruf68SlC6PaxWpPC1DJXpnSa14l2vS2AHGn8urG3JWWkVuW4WhavvFl tknVbKeMGjUxj+IaplJrmKbLx2CREPl/1c4Q/lSxwXL5ucRQCAM= =bKeM -----END PGP SIGNATURE----- --=_aWP2gTUCynVLSuhMP59XuN6-- From nobody Thu Nov 24 11:00:43 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHw5W0yhQz4hv2r for ; Thu, 24 Nov 2022 11:00:47 +0000 (UTC) (envelope-from nvass@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHw5V0ZBhz3xkh for ; Thu, 24 Nov 2022 11:00:45 +0000 (UTC) (envelope-from nvass@gmx.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of nvass@gmx.com designates 212.227.15.15 as permitted sender) smtp.mailfrom=nvass@gmx.com; dmarc=pass (policy=none) header.from=gmx.com Received: from [5.203.237.3] ([5.203.237.3]) by web-mail.gmx.net (3c-app-mailcom-bs05.server.lan [172.19.170.173]) (via HTTP); Thu, 24 Nov 2022 12:00:43 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Message-ID: From: Nikos Vassiliadis To: freebsd-fs@freebsd.org Subject: filesystem created but no event in history Content-Type: text/plain; charset=UTF-8 Date: Thu, 24 Nov 2022 12:00:43 +0100 Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K1:6p5lV3L2RCwePGHndW5fQ42f6TiCO/AhZDhjG9yEhnGMEdXADzZj5KI8sxmDV+A1QPQEr WXQDhMoGakz6tsL7qcAEo0K+75/wQ6MtWDCfgT7sUjV7wkwHvUdYYRqtt6t5rrVJywUp43i+OsmT DCK29CbNAmglLmBrVDMTGiKeu7eiIOQxcDHl8MXVmMsVULZFhVLszJXqnwciKyRuH92u4OsoU6TQ OpkVSF/S9cPwKbSMjJw5qxyLinxSqN36pl/Ha08WrC6k1NWexB3u0k5TZIcM3k0lH/50j1pCy0EM 9c= X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:i/4ohZCeG60=;K6DEA2Av9ufCwdjvdD0SBqbOc35 cy5y2PvbSnlV6aa5m2FEE+6/Z38ZCXqCDU44gNKAMOOzYMgezGMKzTD28YyzuNrlyeUpVspNa 9AIMQajm1lezWqUC1UaH+Y4FGC/GvS8YeChp5wZdRKjlc+0d2x6uzoA5t5aX8y/LanJtg7rid ZWujd6GC0cM9LhAb0RFfGbvVJYjwHoHpic5kibKLjHLeJIuPmGJqGMJmamxXVJg0LaqdaOjLB DVP52bTHffiKBHn5dSJhbMuPeotqfXY0rTSUH62pJ9zfCIoBrHZAtnaTjcF6xYi3j5/BUTk5D SeiJBzNXTNp1Ef7LNZvu+RgW+DO9wM/wq+cYi5WpLTVBxJLoPokkFe9Utbj+4G35mmOyGm3s1 PQYL4fib6OcdUnugJEMqTZ15eRPbPtRzQJtMQXlXrcx+Tj5RNghQgQwNAszTiBDoauAQA3nst t34W04wtLqWBEaNYwwS6t6NgLd8v4lyGH762nbFdfZuNYVm12Km572kHruAPpcSvSDEqXxlNB 2K/Bjqzex44FZJgM1a9fY+QfcmBeJhFkgtBEGxGTopMhGKM/BMy+ghsFgw93ZI3AGYXbGaZJp KLf4hJPH5gQvJGLpJTDhx7A1XdNiPWSYl277r8EyqzqmoMtc5oiMdWrxjD55irbsXDSfXG4oD KcStg5Voe70KOqvBHISWYXzWBbrVNz0e9lvcqdHnS2s+CP1Jvck8vR51bNHjI9lY2W3OmSkIS jQCfqfTY6QnQofgnW5CdYseU0H1Ub/OAke9bT5ZEK9Nq7IPAcDjJu8Okw7lzoybFrVebhbcJC mgwSP5MbWq36KsLPmqXoIhtQ== X-Spamd-Result: default: False [0.62 / 15.00]; NEURAL_SPAM_LONG(0.99)[0.993]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[gmx.com,none]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/24]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.15:from]; NEURAL_SPAM_MEDIUM(0.07)[0.073]; NEURAL_HAM_SHORT(-0.05)[-0.048]; FREEMAIL_ENVFROM(0.00)[gmx.com]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; HAS_X_PRIO_THREE(0.00)[3]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.15:from]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_FROM(0.00)[gmx.com]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4NHw5V0ZBhz3xkh X-Spamd-Bar: / X-ThisMailContainsUnwantedMimeParts: N Hi, There was a new fs (danae/ROOT/12.4-RC2_2022-11-24_105735) created by freebsd-update root@danae:~ # zfs list -t all -r -o name,type,creation,origin danae | sed -n '1p; /105735/p' NAME TYPE CREATION ORIGIN danae/ROOT/12.4-RC2_2022-11-24_105735 filesystem Thu Nov 24 10:57 2022 danae/ROOT/default@2022-11-24-10:57:35-0 danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.48--1d snapshot Thu Nov 24 11:10 2022 - danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.52--1d snapshot Thu Nov 24 11:10 2022 - root@danae:~ # zfs list danae/ROOT/default@2022-11-24-10:57:35-0 NAME USED AVAIL REFER MOUNTPOINT danae/ROOT/default@2022-11-24-10:57:35-0 2.82M - 4.97G - root@danae:~ # I would expect that this event would be recorded in the pool's history but there is nothing there: root@danae:~ # zpool history danae | tail -20 2022-11-24.00:00:05 zfs snapshot -r danae@2022-11-24_00.00.00--1m 2022-11-24.00:01:00 zfs destroy danae/ROOT/default@2022-10-24_00.00.00--1m 2022-11-24.00:01:00 zfs destroy danae/ROOT@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/tmp@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/usr/home@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/usr/ports@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/usr/src@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/usr@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var/audit@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var/crash@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var/log@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var/mail@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var/tmp@2022-10-24_00.00.00--1m 2022-11-24.00:01:01 zfs destroy danae/var@2022-10-24_00.00.00--1m 2022-11-24.00:01:06 zfs destroy danae@2022-10-24_00.00.00--1m 2022-11-24.11:10:52 zfs snapshot -r danae@2022-11-24_11.10.48--1d 2022-11-24.11:10:56 zfs snapshot -r danae@2022-11-24_11.10.52--1d 2022-11-24.12:41:55 zfs create danae/nikos000 2022-11-24.12:42:17 zfs rename danae/nikos000 danae/nikos001 I thought that the pool's history contains everything. Really confused, thanks in advance for your help Nikos From nobody Thu Nov 24 13:52:58 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NHzwR50KXz4jDWM for ; Thu, 24 Nov 2022 13:53:11 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f48.google.com (mail-vs1-f48.google.com [209.85.217.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NHzwR34Sfz4DnR for ; Thu, 24 Nov 2022 13:53:11 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-vs1-f48.google.com with SMTP id t5so1585967vsh.8 for ; Thu, 24 Nov 2022 05:53:11 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=AHaXBU5W2/NoiWMR7sRsVIWHuM4OvKP/vhhND3pKc4w=; b=ASh4Q5x39nvzSCXcU7T0ISCA9rh2VAqKUYKCl4kuOLrx/4Ep4AMOF1RekXVchRvb31 au6sBi/Qnitufm/DM92IC/9HXndY/tYZ2RkmcaEK66H2DC94gtrxu9GUXfuu66R70t7C 66NKC/hTT/QIMTGwGsbQN2NZHFCF6Hkz7PkO7+CfGAe4DchXUOlQguHPe3MHo4ckq1hH sb9kUUIlZMvXWVz6YHER28lt0OjQ+XhTJ+tV8tzrr/c9jJSCxh10zDTEMrsjtJ0o6qbo CCam+N9GdyettuX8p53xy3MAi7PR/lrCG5NmZDREEY4YR3yRx5cDNMsDUzlo9sFpdXd3 Eosg== X-Gm-Message-State: ANoB5pnD0LqCSO0+Utbj0GKxL4kI85uhyDZMY/Dc/KKPK0i1QTifA2rS Y+YXuM/fD4bfZFLKu+tvQMufUqE8uA+DyZaBeh4+soaD X-Google-Smtp-Source: AA0mqf7YfwuI6FkJRPHU0gFGQvioBzuaycFtEAoQSYPB00FlZwUDjXQ0p0Xt7F9Ktd+pco9trVEkOftFXTjBwNOHfQc= X-Received: by 2002:a67:ca85:0:b0:3af:c69b:50bf with SMTP id a5-20020a67ca85000000b003afc69b50bfmr8020973vsl.0.1669297990140; Thu, 24 Nov 2022 05:53:10 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Thu, 24 Nov 2022 06:52:58 -0700 Message-ID: Subject: Re: filesystem created but no event in history To: Nikos Vassiliadis Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4NHzwR34Sfz4DnR X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Thu, Nov 24, 2022 at 4:00 AM Nikos Vassiliadis wrote: > > Hi, > > There was a new fs (danae/ROOT/12.4-RC2_2022-11-24_105735) created by freebsd-update > > > root@danae:~ # zfs list -t all -r -o name,type,creation,origin danae | sed -n '1p; /105735/p' > NAME TYPE CREATION ORIGIN > danae/ROOT/12.4-RC2_2022-11-24_105735 filesystem Thu Nov 24 10:57 2022 danae/ROOT/default@2022-11-24-10:57:35-0 > danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.48--1d snapshot Thu Nov 24 11:10 2022 - > danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.52--1d snapshot Thu Nov 24 11:10 2022 - > root@danae:~ # zfs list danae/ROOT/default@2022-11-24-10:57:35-0 > NAME USED AVAIL REFER MOUNTPOINT > danae/ROOT/default@2022-11-24-10:57:35-0 2.82M - 4.97G - > root@danae:~ # > > > I would expect that this event would be recorded in the pool's history but there is nothing there: > root@danae:~ # zpool history danae | tail -20 > 2022-11-24.00:00:05 zfs snapshot -r danae@2022-11-24_00.00.00--1m > 2022-11-24.00:01:00 zfs destroy danae/ROOT/default@2022-10-24_00.00.00--1m > 2022-11-24.00:01:00 zfs destroy danae/ROOT@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/tmp@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/usr/home@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/usr/ports@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/usr/src@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/usr@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var/audit@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var/crash@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var/log@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var/mail@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var/tmp@2022-10-24_00.00.00--1m > 2022-11-24.00:01:01 zfs destroy danae/var@2022-10-24_00.00.00--1m > 2022-11-24.00:01:06 zfs destroy danae@2022-10-24_00.00.00--1m > 2022-11-24.11:10:52 zfs snapshot -r danae@2022-11-24_11.10.48--1d > 2022-11-24.11:10:56 zfs snapshot -r danae@2022-11-24_11.10.52--1d > 2022-11-24.12:41:55 zfs create danae/nikos000 > 2022-11-24.12:42:17 zfs rename danae/nikos000 danae/nikos001 > > I thought that the pool's history contains everything. > Really confused, thanks in advance for your help > Nikos Try "zpool history -i". From nobody Thu Nov 24 14:30:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NJ0lt2kSPz4jJP8 for ; Thu, 24 Nov 2022 14:30:50 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NJ0lt0SXqz4Kw9; Thu, 24 Nov 2022 14:30:50 +0000 (UTC) (envelope-from ler@lerctr.org) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Type:Message-ID:References:In-Reply-To:Subject:Cc:To: From:Date:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=9Am/NS4poYSFxDDitbgCltHFu5/GPgUeyYw74F6SG2o=; b=RJ+gCu0SJEuBKqYNwE9n3vsHdz RGDy+m/HKJM+YdllmSaOKdGlMgbt5nA/FnTKaqKxYuvsAxirvwLDZNVDeQ4zIYgp3lQcFE7tJs3NA Mg1OBLMdzhpiFIR00BlRYRTFNDwM2OTgRbtVsU4pXxnvYXBgISXPy964Zebdoksbs0n/uvXgXB6+4 1GmmYjAxZ63XcD7BdJLLEV9aZJQdjbfi1B6mvAYqy+f/yJ0B4Jk2G7N5l0/D3E/HqPxHQjvoUr8LW xnJsHMwF0kxWbaraYOuOv2vqfaDLwq3FPScfXgPFRDSP5dtFara8mPpf8V7cS+XpFm/qJR9TFfRt5 XTR+H3xg==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4 as permitted sender) client-ip=2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2602:fcdb:0:10:7ae3:b5ff:fe1b:23b4]:22781 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1oyDFO-0005K6-Bn; Thu, 24 Nov 2022 08:30:38 -0600 Received: from 2600:1700:210:b18f:f0bd:abce:6ea9:ec29 by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Thu, 24 Nov 2022 08:30:38 -0600 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Date: Thu, 24 Nov 2022 08:30:38 -0600 From: Larry Rosenman To: Alexander Leidinger Cc: Eric Borisch , Warner Losh , Alan Somers , FreeBSD FS , John Kennedy , Nathan Whitehorn Subject: Re: UEFI question In-Reply-To: <20221124083959.Horde.OuPEDUTGTdU8KNqv5AvN04y@webmail.leidinger.net> References: <20220531123221.n7ubs365ceeqo2d4@x1> <20221124083959.Horde.OuPEDUTGTdU8KNqv5AvN04y@webmail.leidinger.net> Message-ID: <900ef03a19ecd63d315220a41f0ce4dc@lerctr.org> X-Sender: ler@lerctr.org Content-Type: multipart/alternative; boundary="=_8640340bae758ce35d97828238a5889c" X-Rspamd-Queue-Id: 4NJ0lt0SXqz4Kw9 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:55103, ipnet:2602:fcdb::/36, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --=_8640340bae758ce35d97828238a5889c Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed On 11/24/2022 1:39 am, Alexander Leidinger wrote: > Quoting Eric Borisch (from Tue, 22 Nov 2022 > 17:50:08 -0600): > On Tue, Nov 22, 2022 at 1:50 PM Warner Losh wrote: > > On Tue, Nov 22, 2022, 11:42 AM Alan Somers wrote: > > I just noticed the same problem. For mirrored installs, the > 13.1-RELEASE installer only formats the efi partition on one hard > disk. Shouldn't it do both? > > We go back and forth on this question.... I think we should, but others > got grumpy when I suggested it. Maybe just all the drives in the zpool > used for the BE? > > Warner Just a "yes, please." If you're installing zfs root on a mirror of disks, POLA suggests the required boot bits are on both disks, too. N disks instead of both disks please. All disks which are part of a redundant root pool should get _everything_ what is necessary to boot in case the primary boot drive of the pool fails. Theoretically we only need the amount of boot redundancy to the level of redundancy degree of the pool (can't rememeber if we now have support to boot from raidz, I only have mirrors, but some of them with more than 2 disks), but as we can't predict which drive fails until the redundancy level is reached, the only option we have is to mirror the freebsd-boot partition. If this is via gmirror or via independent partitions is another question. If we want to provide a drive failure resistant boot experience (and the zfs pool types which offer redundancy make at least the users believe we want to do that), there is not really an option to not do that. And while we're at it, I think we should mention in our upgrade instructions (e.g. src/Makefile and src/UPDATING) how to update the EFI parts too. Bye, Alexander. http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF we boot fine from RaidZ.... All my boxes have all the disks in RaidZ. See my previous post for what my gpart show has. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 --=_8640340bae758ce35d97828238a5889c Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

On 11/24/2022 1:39 am, Alexander Leidinger wrote:

Quoting Eric Borisch <eborisch@gmail.com> (from Tue, 22 Nov 2022 17:50:08 -0600)= :

On Tue, Nov 22, 2022 at 1:50 PM Warner Losh <imp@bsdimp.com> wrote:=


On Tue, Nov 22, 2022, 11:42 AM Alan= Somers <asome= rs@freebsd.org> wrote:
 

I just noticed the same problem.  For mirrored installs, the
1= 3.1-RELEASE installer only formats the efi partition on one hard
disk.=   Shouldn't it do both?

 
 
We go back and forth on this question.... I think we shou= ld, but others got grumpy when I suggested it. Maybe just all the drives in= the zpool used for the BE?
 
Warner
 
Just a “yes, please.” If you’re install= ing zfs root on a mirror of disks, POLA suggests the required boot bits are= on both disks, too.
 


N disks instead of both disks please.

All disks which a= re part of a redundant root pool should get everything what is nec= essary to boot in case the primary boot drive of the pool fails. Theoretica= lly we only need the amount of boot redundancy to the level of redundancy d= egree of the pool (can't rememeber if we now have support to boot from raid= z, I only have mirrors, but some of them with more than 2 disks), but as we= can't predict which drive fails until the redundancy level is reached, the= only option we have is to mirror the freebsd-boot partition.

If= this is via gmirror or via independent partitions is another question.

If we want to provide a drive failure resistant boot experience (an= d the zfs pool types which offer redundancy make at least the users believe= we want to do that), there is not really an option to not do that.
And while we're at it, I think we should mention in our upgrade instruc= tions (e.g. src/Makefile and src/UPDATING) how to update the EFI parts too.=

Bye,
Alexander.

http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2= 772BF
http://www.FreeBSD.org    netchild@FreeBSD.org  : P= GP 0x8F31830F9F2772BF

we boot fine from RaidZ.... 

All my boxes have all the disks in RaidZ. 

See my previous post for what my gpart show has.

= -- 
Larry Rosenman        = ;             http://www.lerctr.org= /~ler
Phone: +1 214-642-9640           &n= bsp;     E-Mail: ler@lerctr.org=
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
--=_8640340bae758ce35d97828238a5889c-- From nobody Thu Nov 24 15:17:57 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NJ1pJ23KFz4hQRV for ; Thu, 24 Nov 2022 15:18:00 +0000 (UTC) (envelope-from nvass@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NJ1pH4kdzz3Bpg; Thu, 24 Nov 2022 15:17:59 +0000 (UTC) (envelope-from nvass@gmx.com) Authentication-Results: mx1.freebsd.org; none Received: from [5.203.237.3] ([5.203.237.3]) by web-mail.gmx.net (3c-app-mailcom-bs05.server.lan [172.19.170.173]) (via HTTP); Thu, 24 Nov 2022 16:17:57 +0100 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Message-ID: From: Nikos Vassiliadis To: Alan Somers Cc: freebsd-fs@freebsd.org Subject: Re: filesystem created but no event in history Content-Type: text/plain; charset=UTF-8 Date: Thu, 24 Nov 2022 16:17:57 +0100 Importance: normal Sensitivity: Normal In-Reply-To: References: X-UI-Message-Type: mail X-Priority: 3 X-Provags-ID: V03:K1:RNjMQRXHiAlynpf5z7LVw9QvqBO+w9kRRWx49424ZArVOBl8WGdZYz7qvqaoMic2RxYQh jfEtDmS/lMQ6bjU0pDIsrvg8LwcPryZQc8xUsEOxaketVmcoK7IGfKEdHUZFZAmEafLX1Rfr7BdY HtTYXXuKD8FJFIugSH/NcFr+uAVTIuUVrMAxvpPenEnAcIC+E3vriqkonIMEYvGEDl3RCd+hXDqh fLxHWDQ2ekGyBcJBahhJQgqrcQCqA2hI1Z9kkV/qBiBwW2+QJSW2CGC8S5F9Iw2Xx8LygqI4WXem +Y= X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:oFzPD8fJxyo=;MAorqOyTPStyiOf+oTEurDFP8dQ ypnfm7Ha5HLahnEJhec4iw3TblKB2nvKd4IV4U787nTRT+yNxYRyMjKo2jPynw27QuSmqeXMZ MEeB61KwbWbfIaeo9/O8509IBSfbDNTf7WOQ6YWrwgCFWNuUbENiu8zSEFksfLfav5KFUQuhS Ry0ZC1aFq2TTxA71iTT1KjozgcFIOq+W+Ul/3ddKmGn1fXoT9tbPfVGhukRe4nfLThNXPqYXp 8WQSXwzXa7VYCitdrM9Ax/ZvM81tK/DH5ACrQpdfp/OUtagr7xVS8l9zYn+evkxK/wfXKl2aJ rjR5t2PjOgTfp4rIHccJ2bgmNa9JSy1ZPc/HCfs9m1mDA9ZFAZyy+gM2ODfJFYwymfT3FJHs8 9WfTlskHn9TntVb3jD/PJ+fFeKRYteyGLzSjvH/CexUeyL15FnoDl6Ddo7htubU9FTjh168pd lczMln6iR4k4yjZwpP+gMWT4YMivDgLucd0jfzRkREAbnOFgJmTyuBrD2OE/mOwAGCRiSCwEN OaZHYmClI8HmpbA89bW/aua+z0yhtXTVw7dFt3eetuWRbJhJ8ljsGtvwUb5fFMhBoE0sEK710 E9cj1xCemew4CAoYC1e4/bQWo6DTysU1cK4F26j4k3pcZpBHqRJOdvyRreelAPiMGT/xkc+Bn tem4cA1OXZlJXxhyYXrL6yjeXbHcl8udKcrD/YArgzZlRJf9tFAKDJMpQjRAbFe4hazKHEAnc aQbvkLurScuX2hINepjwwFFh82lKa6REYIlDE+hbqMKw9fHPXskZa8X4JjwhpEOngeTswx5qN lSBE+/PLUYJU8EvbIK6shyDQ== X-Rspamd-Queue-Id: 4NJ1pH4kdzz3Bpg X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > Sent: Thursday, November 24, 2022 at 3:52 PM > From: "Alan Somers" > To: "Nikos Vassiliadis" > Cc: freebsd-fs@freebsd.org > Subject: Re: filesystem created but no event in history > > On Thu, Nov 24, 2022 at 4:00 AM Nikos Vassiliadis wrote: > > > > Hi, > > > > There was a new fs (danae/ROOT/12.4-RC2_2022-11-24_105735) created by freebsd-update > > > > > > root@danae:~ # zfs list -t all -r -o name,type,creation,origin danae | sed -n '1p; /105735/p' > > NAME TYPE CREATION ORIGIN > > danae/ROOT/12.4-RC2_2022-11-24_105735 filesystem Thu Nov 24 10:57 2022 danae/ROOT/default@2022-11-24-10:57:35-0 > > danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.48--1d snapshot Thu Nov 24 11:10 2022 - > > danae/ROOT/12.4-RC2_2022-11-24_105735@2022-11-24_11.10.52--1d snapshot Thu Nov 24 11:10 2022 - > > root@danae:~ # zfs list danae/ROOT/default@2022-11-24-10:57:35-0 > > NAME USED AVAIL REFER MOUNTPOINT > > danae/ROOT/default@2022-11-24-10:57:35-0 2.82M - 4.97G - > > root@danae:~ # > > > > > > I would expect that this event would be recorded in the pool's history but there is nothing there: > > root@danae:~ # zpool history danae | tail -20 > > 2022-11-24.00:00:05 zfs snapshot -r danae@2022-11-24_00.00.00--1m > > 2022-11-24.00:01:00 zfs destroy danae/ROOT/default@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:00 zfs destroy danae/ROOT@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/tmp@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/usr/home@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/usr/ports@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/usr/src@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/usr@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var/audit@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var/crash@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var/log@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var/mail@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var/tmp@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:01 zfs destroy danae/var@2022-10-24_00.00.00--1m > > 2022-11-24.00:01:06 zfs destroy danae@2022-10-24_00.00.00--1m > > 2022-11-24.11:10:52 zfs snapshot -r danae@2022-11-24_11.10.48--1d > > 2022-11-24.11:10:56 zfs snapshot -r danae@2022-11-24_11.10.52--1d > > 2022-11-24.12:41:55 zfs create danae/nikos000 > > 2022-11-24.12:42:17 zfs rename danae/nikos000 danae/nikos001 > > > > I thought that the pool's history contains everything. > > Really confused, thanks in advance for your help > > Nikos > > Try "zpool history -i". > > Thanks a lot Alan! So bectl creates a snapshot and clones it to a new fs but these actions are considered internal. What do we really mean internal? From nobody Sat Nov 26 18:00:47 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKKKR6JdDz4hhYN for ; Sat, 26 Nov 2022 18:00:59 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKKKR1Mbcz46H4 for ; Sat, 26 Nov 2022 18:00:59 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=2jgKUJHe; dkim=pass header.d=messagingengine.com header.s=fm1 header.b="v wvtFRQ"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 8CD9D5C00DA for ; Sat, 26 Nov 2022 13:00:50 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Sat, 26 Nov 2022 13:00:50 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to; s=fm1; t= 1669485650; x=1669572050; bh=BPfbNvxn1veeShdPS+yjZOVURG4pH6VOA6e di6ytToc=; b=2jgKUJHe0nokOk+xAcyk0LwDTGpLaDdN6COhqdKct04AApLRw0F kWkkvxU3cUSb2VtiuwjpK4tZt6KLpWgOHrf+RLQq7hnHlCNJ+z5PyM8eqV8RSEq+ 6LiPobXzYZs/CCfcNAB10md1gBZXT9TAiI4LfyOJh3w7bpi7yQ+PCXEINfB7dUSI s3ayxp5XBb6UjT8dMFc24YKPYQoLMdi/xJL6ntfY14R+uV/KaJDdzJirfNRwapwJ IVbcXC5EeeSEW7eLQWiT7ocXbDeT4oVrQLC/3lFhdeyx05IZpLdGvbVvT8NWQ81g rKlYmdqfo6au9sxjaO956kuVMITzv9GbX+w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1669485650; x= 1669572050; bh=BPfbNvxn1veeShdPS+yjZOVURG4pH6VOA6edi6ytToc=; b=v wvtFRQ5JPcaCveOud7bhXcAVb3lnpSrOhWNJyV7z3GWgwZZ4FwqSEAgoPtN66Ljs jB6I6ToCxdJXupSmVhTaRGwFe+jflUu6beMa0i/zq2mPaqhqx4u6i9Btke2NzQ+l RHmsDOogun1jizGMZrOMg/Oqj3oS1/wFix17mp1dUz7yEmXlL8XCj/tIqzmimJgS W/jtQvn1dFfkNpmfhITq9xjZi8S4wYsi+i82e6d+qA0kz2S8lWURKbpPiTRf6JaG gomgUr9We+Wiofb/pWFMe4P647mdV37amq0CQ5IbrJe+2ImHwSdKamw5v1DuoaSu 9hzE8t4N/EOfODf64yZYA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrieejgdduuddtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgrthht vghrnhepveduffeivdfffffghfegfeejfefftdeiteehteekfefhvdefgfettdeuheegff eunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepvhho ihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 26 Nov 2022 13:00:49 -0500 (EST) Date: Sat, 26 Nov 2022 18:00:47 +0000 From: void To: freebsd-fs@freebsd.org Subject: message persisting in zpool status Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Result: default: False [-5.10 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4NKKKR1Mbcz46H4 X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N A machine (13-stable) has a message like this in zpool status -v pool0 ### remove: Removal of vdev 1 copied 123.92G in 0h5m, completed on Sat Aug 28 02:27:11 2022 ## This was subsequent to a disk going bad in a mirror (pool0) which was then removed. it's now a stripe. (I think just removing one half of the mirror makes it a stripe?) The message persists despite zpool clear pool0. How can I fix? -- From nobody Sat Nov 26 18:31:20 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKL7L3bMxz4hmhw for ; Sat, 26 Nov 2022 18:37:18 +0000 (UTC) (envelope-from gldisater@gmail.com) Received: from mail-il1-x12c.google.com (mail-il1-x12c.google.com [IPv6:2607:f8b0:4864:20::12c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKL7K5NcKz4C8x for ; Sat, 26 Nov 2022 18:37:17 +0000 (UTC) (envelope-from gldisater@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=El1mDYGN; spf=pass (mx1.freebsd.org: domain of gldisater@gmail.com designates 2607:f8b0:4864:20::12c as permitted sender) smtp.mailfrom=gldisater@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-il1-x12c.google.com with SMTP id h17so3299575ila.6 for ; Sat, 26 Nov 2022 10:37:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id:from :to:cc:subject:date:message-id:reply-to; bh=Rpr2fYt0Xr31GJf9rGEvT+DKRjs5d/Y0YT8MY/KrrlI=; b=El1mDYGNfUqougtI6i+IeulH4Bk9Kl94KYV9vGoNb3sl7v6KR9K9wZOYOyQU+x4qwA Ld5Lm1zVLk03nRZCvYibR+oy1znco5uy56Xt4ywNtkV4nQusaHyChEXPU9Bb5FPR6nsc RaPt9mpCYDSETT2UeHLkbe0rBjMAIMnDcV+vXi7ZSUzDPi0TUBlgCONRz0xCtWLfbuMv QKTcehKTW8/pWRk2yFW4kzJWXFiASVYSOF+yclU3hbQV86z+XR85XRK7h8r46aXRQFA1 IcN5QsyQMUlzKkr+4yHhzrO72y9IFO8OrnLa783WksBYZ5v9qjvymN4xU5TRMVO26KqR Ga6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Rpr2fYt0Xr31GJf9rGEvT+DKRjs5d/Y0YT8MY/KrrlI=; b=AmuH9G1gHF/G5dEosT6U1hRjpPQb9aqrZ5YibianSEsMf5K8izIeNncjAtXhwQBBb4 cANpkqfUbd/jV3wqjeCPNXJIwcfvfRSy+TGYj0hEkGC5RFM8alZbX6x26AqFCT66omjN /HvQ/C0/DsEX/zxvu/p2sXz5pgw1Fd45Rqzno7L8OfBtvtY3eYpzvRv23qebMlWDr+b2 fOtKJMxhnk4uPZbjgxZt6iHwSYAQnInaQR80AKkfz4rVpjjEopY+sTEQql9zW/PDNUeL R3cmGmjzUNCGYSy2INkOEoiyIJlKX6BM9xljqRLvi27GuO+z9/KrEnmJVyqEH2JI2VP1 levg== X-Gm-Message-State: ANoB5pl1tE6y5cF5yY+L62/Jh6WDbt6f5Jj890GiSJAoaHtKa0+BzoRY h6YjVApxmETeyS6sF0FceK/VHgCyUhk= X-Google-Smtp-Source: AA0mqf7REIgB06xRi7iSYgFbwNFHKCgNj9XSD6BjiieCZP/TGti8i1SuJTwUedi4cThSSVrpiQuZSA== X-Received: by 2002:a92:d083:0:b0:302:ff1b:c585 with SMTP id h3-20020a92d083000000b00302ff1bc585mr2806776ilh.12.1669487484496; Sat, 26 Nov 2022 10:31:24 -0800 (PST) Received: from [192.168.1.201] (dhcp-198-2-84-8.cable.user.start.ca. [198.2.84.8]) by smtp.gmail.com with ESMTPSA id p13-20020a02b00d000000b00363e61908bfsm2507058jah.10.2022.11.26.10.31.23 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 26 Nov 2022 10:31:23 -0800 (PST) Message-ID: Date: Sat, 26 Nov 2022 13:31:20 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.5.0 Subject: Re: message persisting in zpool status To: freebsd-fs@freebsd.org References: Content-Language: en-US From: Jeremy Faulkner In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::12c:from]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-Rspamd-Queue-Id: 4NKL7K5NcKz4C8x X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N The persistence of this message is intentional. On 2022-11-26 1:00 p.m., void wrote: > A machine (13-stable) has a message like this in zpool status -v pool0 > > ### > remove: Removal of vdev 1 copied 123.92G in 0h5m, completed on Sat Aug > 28 02:27:11 2022 > ## > > This was subsequent to a disk going bad in a mirror (pool0) which was > then removed. it's now a stripe. (I think just removing one half of the > mirror makes it a stripe?) > > The message persists despite zpool clear pool0. How can I fix? > -- -- Jeremy Faulkner From nobody Sat Nov 26 21:55:02 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKQWW6XHHz4j9f9 for ; Sat, 26 Nov 2022 21:55:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKQWV4x3Rz4QXt for ; Sat, 26 Nov 2022 21:55:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669499702; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MZfExSgf+9544xk/VeZg6Qio19v/XxXA4tq6d+1u6gs=; b=jYsTzPT+ht0VO/JsZHlMg1X7HS2SePmataSQ2sKmK747WMQwywQ+qp6MzUUFlYxtVCYIFb 0p0HD12NQTROmrPmuSIYRpCb/+OHkjyCfpaOfJ/S2kS8l+PErrCafyVr2CFvo3NUmeposo lVHSTlprH9LitAzWfcq+sU9I8P+tMH95UZp7yPX8yYWcGG4NF6FVrP7423SsGDetajWGBz tqqoVbSAJmrD/UzTEvjOuQoeRe9xJTs9YPEeeXrVS7ShO1lMXZMR+rf+zuKiUEgme8Mund s0gy5I9cuW6iVHnYzSHdDioWwCqhVy5yfoe0DP2bwLU5+BrNeeJ4u8qpbGvovw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669499702; a=rsa-sha256; cv=none; b=l/IgX/mpHV4ZifURHpK3SlZkh46tJ6pRO2Dwp+BGfNGzTXOWMWzYct/dFTjwbFc4v3foi0 QZbMtUcuxDbvNOgIUQRQYK8CvqHPVbXWxwWOt8LZ7wDPWwW0jBVqlo8Q4iakriAuoyoXuD srP8OGqmkYlozG2V/9wgT3OCjE6UJSR8ZJp68LuiB0Okw7qcFhTfk45rMDSwxlhqd0XX7m 5DxIda2VdjWIMTbToyXxqm+YV0U6JDJCmrFkL8yKsUP+vsTqBqVHNBtibyTgbgLfDUlDHQ c9yf060NV/cOmftovCe2QSejXZ52HMVrS4s9DyWN4CqpCCRvC7S3OPBVK2EJkw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NKQWV39zCzZsp for ; Sat, 26 Nov 2022 21:55:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AQLt23w071633 for ; Sat, 26 Nov 2022 21:55:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AQLt21P071632 for fs@FreeBSD.org; Sat, 26 Nov 2022 21:55:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sat, 26 Nov 2022 21:55:02 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #21 from Boris Korzun --- (In reply to Kirk McKusick from comment #17) I've downloaded FreeBSD-13.1-STABLE-amd64-20221123-b51ee7ac252c-253133-bootonly.iso, instal= led it on clean ZFS system. Tried to buildkernel with commented FFS options from GENERIC only. And got: ld: error: undefined symbol: sysctl___vfs_ffs >>> referenced by ffs_subr.c >>> ffs_subr.o:(sysctl___vfs_ffs_prtsberrmsg) >>> did you mean: sysctl___vfs_nfs >>> defined in: nfs_commonport.o *** Error code 1 124c19b0d (HEAD -> stable/13, freebsd/stable/13) amd64 libc: add missed GNU-stack annotation to memmove/memcpy --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Nov 26 22:17:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKR0y52vdz4jCkC for ; Sat, 26 Nov 2022 22:17:06 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKR0x6dNjz4Sb9 for ; Sat, 26 Nov 2022 22:17:05 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b="GLC4oI/T"; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=KsqU099P; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 6BCC85C0090 for ; Sat, 26 Nov 2022 17:17:04 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Sat, 26 Nov 2022 17:17:04 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm1; t=1669501024; x=1669587424; bh=nd5OB/VXjE hIMF7qWRmkimPguhgF/FLbJbOmoO7/Gf4=; b=GLC4oI/Tv5zKfqS7u0epy0jK23 y0GSGTEDe6pCzXHV0r6Z1ZmEt0Qmmxv1IEH+Tv77TT3LxHdM1sTx+SLftoR+OdaH LXz105wovWB62Z6WXCps78fcGFbaz7NLBUwLWDXlJtQl6R0v2SM8310BTEwUBc+p JEQZmDVRFl9CngWF6g162SSSf/HlFCP5sxUGf7t8XmXT/Qed/8wa696V0+fWVFxL qwOcrXFtTsr61Eta0g4rEutsrb66GuNprFtHjSIL04FQ/EinW4EvGnKY/8kedXE8 FvblYb/RcSb9aIxWMJoUguYZk7z5Enj06AL/JejwhuX/1N6Y5jNTt0YiU02A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; t=1669501024; x=1669587424; bh=nd5OB/VXjEhIMF7qWRmkimPguhgF /FLbJbOmoO7/Gf4=; b=KsqU099P8j7Ce9SxMayUPvS7dUuvhrVFJ/VIU9/6kkYZ inn3CbcL6y+FNAs+FGiJxUUDYCWX62+0PgROQjv5KoKcjxUWZ56Dz7xvbrsIQPIb C61JijfDl0/3lUvlA0eCURv0rFK2keH+tOtXVl3pMq8htyFCP5xGcRLVGISJgF/t NUZruGdt4XCQN3xlspgRMB1yBN7FlywuF+Lub2XWo9hbPUmJR55LnePexiOOz/CN eaZD0bxOZmH1ulRxcc+jsQzC0jkl2Qovn9c7F+SxX0ek3/Vx306W1Wd4EHUek5aU cJtbBpuXcJFjIu4OCFpiHFVsCBN80c0P+tB2B84zig== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrieejgdduiedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 26 Nov 2022 17:17:03 -0500 (EST) Date: Sat, 26 Nov 2022 22:17:01 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: message persisting in zpool status Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-5.10 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4NKR0x6dNjz4Sb9 X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N On Sat, Nov 26, 2022 at 01:31:20PM -0500, Jeremy Faulkner wrote: >The persistence of this message is intentional. Why is there no (apparent) way to remove it? -- From nobody Sun Nov 27 01:18:29 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKW2G5KqNz4jZ2H for ; Sun, 27 Nov 2022 01:18:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKW2G48b9z3JQk for ; Sun, 27 Nov 2022 01:18:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669511910; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FN1+5ANgjdKoATRvvvZyQdJJyoXQnNP7o2CKsfyP5mY=; b=Dj7wNbZSBVSF7coJbpvOVU4Ngj07QZDv4fZhz0M9peggsmAj8bWR3PatAITLZrgZ7ndIQq szIdbyYN3PNgsxC9TbSuNboadpwtxerMWuBbWVcMcURDovEhwNPdsYwBURxHqwJvO5MiKr z4lwbbo1IbIHaFp2yWXTDfFFLJkyEMF9zD3QxmA+NmRe6NWkRzCUJC+UytGKgz0zsdX2BJ OEFdz0SoIhU0ffF9JQJ/nufQFFIUea2jnqzLfP74+6+s+okDXWag+tI8/1UekXD9L6FfDb Y7e+l2WlA0XwxgABZ7Jrb5KtvhvoLbhr7A0PLudQphohILr8kBFR+gAp5t8o1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669511910; a=rsa-sha256; cv=none; b=vW9QX0ntzpiL/esoBKn/L6PdIo8WiSlXvYzhuO+giVlEaqNuzRX0MJPaRlF3u6PAsgwIpC FrLpdVHLkBXiqPe1d+6uE0wPpJp2DvpLyQRYN6BRNr19JWdZDJ8pXiUntSMb5KzBz6miD6 XYn3Lq+ueqpRXXmppLRUEqP4Yu4BcQiT3V/J/IhgUul/MLtQmgdAsV1eJxAtrS5GkvvlBp uiRL1WD/0lJ7bTqrxf6R5GqxUfHUL3z9l3w8AqQjeRwoL9UD3Gx8hlOkjnY8M3v+d2T83L pWNilg6fyVgtKg0x3EXdHoC9DnroLHWlJ6Vd9rIIcShEFR2rfh6zxvMKfnMYwA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NKW2G3CF2zgBg for ; Sun, 27 Nov 2022 01:18:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AR1IUDj060757 for ; Sun, 27 Nov 2022 01:18:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AR1IUjr060756 for fs@FreeBSD.org; Sun, 27 Nov 2022 01:18:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 27 Nov 2022 01:18:29 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #22 from Mark Millard --- (In reply to Boris Korzun from comment #21) So, I info that for: #ifdef STANDALONE_SMALL #define MPRINT(...) do { } while (0) #else #define MPRINT(...) if (prtmsg) printf(__VA_ARGS__) /* * Print error messages when bad superblock values are found. */ static int prtmsg =3D 1; #ifdef _KERNEL SYSCTL_DECL(_vfs_ffs); SYSCTL_INT(_vfs_ffs, OID_AUTO, prtsberrmsg, CTLFLAG_RWTUN, &prtmsg, 0, "Print error messages when bad superblock values are found"); #endif /* _KERNEL */ #endif /* STANDALONE_SMALL */ both STANDALONE_SMALL and _KERNEL are defined, lead to the sysctl involved. But also: sys/ufs/ffs/ffs_subr.c is being compiled and linked in order for that to even matter. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 27 01:52:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKWn3051Kz4hdty for ; Sun, 27 Nov 2022 01:52:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKWn25V4jz3MTr for ; Sun, 27 Nov 2022 01:52:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669513926; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sAAo82W9l4HQsGzY/CkMsvzRhRmTU0xV39Z7Y2194Yo=; b=IGMpVQhQo6ixKvSLnJDX8kXfWqrY9bDef3GSmzmGLr/QSmU5+ls/SBjMBlQA+xy4uMZSSh JkOw20pgT4rXAZyjzj38kjYlcB5el+oz++v/6T3EyZtu76zpfA7pJrmrhDbjdOGgOnlKpU Vv8Wi9Ky6VYdlwqd+nwsEf4Z9+WEttMsZV+574gZsLvpuuwriefpn8Q+WPzhLsMShtrEUB yZZ1t7Dog2DsR/AoGcyhzz2Z8ifzJmXh1CrvdcgDz+i1DyonFP47pyDcYzjRuTxEoP4+fJ CihdnG5CCLtc0HtUtBEEBniFg5DI6S2MimsLxGoAX65XEJww5vIIL+0jhpI4jw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669513926; a=rsa-sha256; cv=none; b=b0BdWFfqUi8lOafn9IjH1WCr2JGWVG02/rwXh/IuUIp0tP7RlGngKw5GK4BJzHvXXfgKhU 3l73WbOYQgMmyLeEFD1HAax8TxMR6LHZXu9hq5oP9fo0+g1SYIXPO7evT9DoDC0oyT6V6I NZrDVpl3aWPgRrEupAMrysOD3t3fLFkLuirwE7N9PD/LkKpm8+kmhmLb5BEUiZGnz+lWwk hU1xDd2z0Zit5xLBVYswQZxOWuWJyzTJcNjlp9fjES8y5hSa8vLy/HOffoo1vZRs10pMYG sCWHTtIptcUIXLcscpEWdbxLRzkg9+PQCLg0yomoLeZMD9d2s9C6LVhB31gIjg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NKWn24Xv5zhFW for ; Sun, 27 Nov 2022 01:52:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AR1q6JR010942 for ; Sun, 27 Nov 2022 01:52:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AR1q67V010941 for fs@FreeBSD.org; Sun, 27 Nov 2022 01:52:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 27 Nov 2022 01:52:06 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #23 from Mark Millard --- (In reply to Mark Millard from comment #22) May be the answer is geom_label not being disabled as well? ufs/ffs/ffs_subr.c optional ffs | geom_label --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 27 16:10:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKtqj4fBRz4j9XN for ; Sun, 27 Nov 2022 16:10:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKtqj3TxQz3vv0 for ; Sun, 27 Nov 2022 16:10:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669565441; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3rQFdUz53JJLsuagLk+DYyryb6xwpcLVWn2HZJegelY=; b=MZwxXEVtlZpG5o43iYBrJI1v2uoheuMMLcKOi2xB46uYwxy5wJipGdguFh1QgWKpmmThwE XLHl2ekFTdis86uKNhU4t/IPh1YAMXeBd0nVSShBlRp7sGBIO8JZtlWDv81mkyrt/MyaCz cChKRnuByPiYi/uFriVz8llZIp7+qixMLxNJYWUG3qTaTTMaPQlyCxcXZCCaqFNY0kBPcC wGtbC26hOdjqrrF5wvPkvEEMxwBzNUHQ9LI1o7Rt4uEwQY4mej1lcHVZn36IDws6TO3HML fhTEcnuOJeWGDD80+EY9rPfhPKnOo98epGhoBu2XZc8el9/FeQYUyziq2g4Mrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669565441; a=rsa-sha256; cv=none; b=jYx6LrI5A0i4gYPE9Ht+iD2+42elKztvRa+IlQfI4U4AZkgs1XDC4vbsQHJBxuqNOKpmyZ H8L5R2YWLLFXTc+GSrU0782H3WCYUfIl4U/95+UohJZabYv5zrgoHvDcnohlQT1J7upnod Y7gsTafPufnUnastDHukPdfCnAPHZ4sN/Pyk2TVrNZzjz8K8qSJ4Nczyl4AKh/eioOrHuc k5sRblLwjfcZWVH2D6o38PnijuchXA9A0Cjg/fiPkIiv1p5MAGrLfe7wwf/Tsii9Rhjy/q fR1+XqzAkNX2PWs4YFpnAct3AOpteCN+80XQGZkGCl/jgb9j7j6O2ruJ9UdZfA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NKtqj2Yshz14Gq for ; Sun, 27 Nov 2022 16:10:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ARGAfIo026897 for ; Sun, 27 Nov 2022 16:10:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ARGAfSG026896 for fs@FreeBSD.org; Sun, 27 Nov 2022 16:10:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter (20) of the FreeBSD Handbook, and other OpenZFS-related pages Date: Sun, 27 Nov 2022 16:10:40 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status assigned_to cc keywords see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress Assignee|doc@FreeBSD.org |grahamperrin@freebsd.org CC| |fs@FreeBSD.org, | |zfs-devel@FreeBSD.org Keywords| |needs-patch, needs-qa See Also| |https://reviews.freebsd.org | |/D37512 --- Comment #14 from Graham Perrin --- I'll take this bug report, as a formality, since I became a (doc) committer= in June, however please note:=20 * it's way too much for me.=20 We need proactive input from people and groups with _good_ knowledge of:=20 * ZFS in stable/12 * OpenZFS in FreeBSD 13.0-RELEASE and greater * OpenZFS in general. Thanks.=20 Today's D37512 for FAQ needs review, should be simple enough. I'm not slavi= ng over it, because there'll be a complete overhaul of FAQ in due course.=20 around three weeks ago was partly wrong, and has been discussed in #storage in Discord f= or FreeBSD. I'm not sure how to correct it. For now, I might simply remove wha= t's wrong. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 27 16:14:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NKtwV0YQFz4j9pD for ; Sun, 27 Nov 2022 16:14:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NKtwT5bzZz3wyL for ; Sun, 27 Nov 2022 16:14:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669565689; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8yiIStjoQN41HlH3rYTJ/yeqKVgIZOmqV4hJHe8Sf1A=; b=D0UEfC+72962huluLpaV6V3cleCcUv/F3lUv61r9irUPM6IBbk0rW37mUD5cPV6zqtKK0A 3C14W5aTBtF1JqsRW38o4FrXlXC///+91QJQCuYvENHhNE6WTlqYUu0UIKSA8VXImteMLo UQ+0Bl8kJcDN38weouqAzQXsEmGSWwVA2PNvfOKsqtWc+IxeKpiw+lWKvOibE4qgwTr1BD AgnCz31jLTNKsgBuvJltpDrvkx4reTGMt/+YKA9FnRZbUUqchZCLyn4yupkWYLwkwaOGHv gYK0DMIJZMKJVmul6lVhAR7xna/aqzRWCHSbQMGaK2Sa81Jn5oGafm5x1Qt5AA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669565689; a=rsa-sha256; cv=none; b=xherYQAcFUVPp6dq2lbWqb8mDbTwd/zr21ncRFhQwLAqwnF4oLJ5POigzXIKa6zVyZ0mLA gr9wfUxVWSMNsf0SfCzfjqAeuNJD7bOu5PHguDlJR0TM8quKzmYgYtMDaI+rRITSm05gNq RK9LmInsUvg9OSVZNbt8/FpgI+mM7tJ8Z69S1jsisK04PUoWALM4P8CfJwfiYwCB6dB2P+ n6KEYbFdocSTt0F3+E6inA8y+4AVchAvdOMBksVMgp4Ic7PIHZTt776s/gisyY7sKC3uBC VJxNJaOWvcrIaaiMSpetpp00QxBMZJTFfaGcf6ZSBATINkk5uR3eGe7VZSjwcA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NKtwT4PHSz14Q5 for ; Sun, 27 Nov 2022 16:14:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ARGEnl1041124 for ; Sun, 27 Nov 2022 16:14:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ARGEnKQ041123 for fs@FreeBSD.org; Sun, 27 Nov 2022 16:14:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter (20) of the FreeBSD Handbook, and other OpenZFS-related pages Date: Sun, 27 Nov 2022 16:14:49 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfs/ | |zfs/pull/13756 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Nov 27 21:01:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NL1H50s4Xz4hnCD for ; Sun, 27 Nov 2022 21:01:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NL1H44KRpz3HWD for ; Sun, 27 Nov 2022 21:01:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669582880; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=sx/3xDGSde19+8QhuDYWo+jLP/c4nceXV/HkC4rNWV4=; b=gvFRdQoJRLgu3Fzy0I1QqV8jJKEa+Vzq361b3QtNdixYCYK691Rh3+jbPeh25r/vR9yxMd bTJ4urWXYkw3mtW7rJ61DMs09aVOyZ5yw58LMkMDiNgLy6Wv2y347WNSaR07U4L0OegEM2 2T+aIs/5AgJ1Kz7iNtUeVuImvKVdd4pDQcejZDz4yPcIhk7NIhZ4ofUhr4AToX3ipCPm+k WoRIR6xSnGHNProHESFXbzZGKvs4iiMVbE5u5OG6JJvJ3XSKlGjnxHNuu0AXKbv7DnfFMc kaUOQrxF80T0gMN8coj376u36rLTBqp/C+8Z4Qj/tegVRfdX5I8x4Uzzbi/OvA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669582880; a=rsa-sha256; cv=none; b=x2pBAIzYLDZnWpFvcQEEaeVKZJGUZFkAkZ77mSYZvr+3RaNJ+JRSQ0plOZgweIMbe6sg7a wvDAKYg5tjcg/cEB5Ls+xPPN6asZhXhWc8S16xDHvDbfJWQzfU3284uAkvoHaX8OZ75QI3 qYbOLNG+PIFZnklJHOMiRixf1jiBu26SWv3mPlZA8g5FWtefJDheNQPu6N58spS5kJDkg+ PsHTWyjfsEb8F+St+WW4osUjnLe0DGW301fRBnAOFCYZ5A3qeFe0iXB7JyTXnwiyNqmKOt Dc0MGA0Y/6k7oOl+5dnaKXp3G+f/pyNCoqSoPugQcx+Qv4g4fP/t+wl3SXFwGg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NL1H43NqQz1BmV for ; Sun, 27 Nov 2022 21:01:20 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ARL1K3X046413 for ; Sun, 27 Nov 2022 21:01:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ARL1KWR046412 for fs@FreeBSD.org; Sun, 27 Nov 2022 21:01:20 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202211272101.2ARL1KWR046412@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 27 Nov 2022 21:01:20 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16695828802.5Bd9a.40312" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16695828802.5Bd9a.40312 Date: Sun, 27 Nov 2022 21:01:20 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16695828802.5Bd9a.40312 Date: Sun, 27 Nov 2022 21:01:20 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16695828802.5Bd9a.40312-- From nobody Mon Nov 28 09:11:28 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLKTY0tQdz4jcV3 for ; Mon, 28 Nov 2022 09:11:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLKTX6sNmz4bfQ for ; Mon, 28 Nov 2022 09:11:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669626689; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fQiIediEmtOPoOxd0iD1uMLFfbKY/sjIjc4nFLlXoXw=; b=NH5XlrdcHez2UPWjii6yXsuaegYwzy1zvj3mYLs+9Cj2HbKF/yEljRv/UcPI1NBkXikMV6 EjqZ1VQ2y6/u6oSO3uYZbDIbh7PDxJ/MQfO0r1PX5O7YS2a0IzoUfkS99qrWepd0btoKNJ uEs/2j74jx9sknq7rXqS0lmBmJYh7CdUn/2B+1TTVYtIdgJoRbIbNVq3oXmULByhjO/q17 ImGG63SKPeqdTx/W/I8Y6mHGEhSn4k0/Vk04UGQFWcFDJtP4FIrNz3EPN8I9XLw5M97bl8 Not1dQNJ9ANZk1Fu/LAe1OGaIhXMGcVUTQMq381r1K1uIPidQp/JRuS6vRfCfQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669626689; a=rsa-sha256; cv=none; b=eFbBlzprJLEdTpo7vGCRIC1L2i/xkThS1lPwpb4icl1DK+RXl8Qghv4nImFgwu6fzt9h7H uH1LaIWppXBeVQRH7H4DOsNTgcfVugNXTCuowz3WRwMMm5kxlg+7WQPzWCsZ6xb8qv8Ejs gIq53rc1eN4oeSvfRjLRu+LSCERWWqkwIkmbX6+PNGZeM5HTUQ9KlEE4NCHxEviUVT7ZeM aGSFPzWh4V+kj1IjCNoVgHyoYyXdWIrA8nvJLSs/1kXWxS4KMBOB8b2yAG1s9QqSyVrySV xFFmPfVCdO6Et9/b+1ndkilxEmMUsEtntsk9XdSh71m3FyBOU9vZ2eA4mDb4gw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NLKTX5yRVzXP0 for ; Mon, 28 Nov 2022 09:11:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2AS9BS7x091544 for ; Mon, 28 Nov 2022 09:11:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2AS9BS1p091543 for fs@FreeBSD.org; Mon, 28 Nov 2022 09:11:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 28 Nov 2022 09:11:28 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #24 from Boris Korzun --- (In reply to Mark Millard from comment #23) Yep, the kernel is built successful without FFS and GEOM_LABEL options. But there wasn't a problem before b999366aab4e2d59cb8869b0e5ef0f70ab9b9bbe = with GEOM_LABEL option and without FFS option. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 28 10:15:09 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLLvD0wN3z4jkf0 for ; Mon, 28 Nov 2022 10:15:20 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from woozle.rinet.ru (woozle.rinet.ru [195.54.192.68]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLLvB5ynsz3DWd for ; Mon, 28 Nov 2022 10:15:18 +0000 (UTC) (envelope-from marck@rinet.ru) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of marck@rinet.ru designates 195.54.192.68 as permitted sender) smtp.mailfrom=marck@rinet.ru; dmarc=pass (policy=none) header.from=rinet.ru Received: from localhost (localhost [127.0.0.1]) by woozle.rinet.ru (8.14.5/8.14.5) with ESMTP id 2ASAF9h9022809; Mon, 28 Nov 2022 13:15:09 +0300 (MSK) (envelope-from marck@rinet.ru) Date: Mon, 28 Nov 2022 13:15:09 +0300 (MSK) From: Dmitry Morozovsky To: andy thomas cc: Freddie Cash , Bob Friesenhahn , Mark Saad , FreeBSD Filesystems Subject: Re: Odd behaviour of two identical ZFS servers mirroring via rsync In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) X-OpenPGP-Key-ID: 6B691B03 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (woozle.rinet.ru [0.0.0.0]); Mon, 28 Nov 2022 13:15:10 +0300 (MSK) X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.70)[-0.701]; DMARC_POLICY_ALLOW(-0.50)[rinet.ru,none]; R_SPF_ALLOW(-0.20)[+ip4:195.54.192.68]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:8331, ipnet:195.54.192.0/19, country:RU]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,simple.dallas.tx.us,longcount.org,FreeBSD.org]; FREEFALL_USER(0.00)[marck]; RCPT_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4NLLvB5ynsz3DWd X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Thu, 17 Nov 2022, andy thomas wrote: > On Thu, 17 Nov 2022, Freddie Cash wrote: > > > Now that you have it working with rsync, you should look into using ZFS > > send/recv as an alternative. You should find it finishes a lot quicker than > > rsync, although it does require a bit more scripting know-how (especially if > > you want to use restartable/interruptible transfers, or use a transport > > other than SSH for better throughout). > > ZFS send/recv works "below" the filesystem later today rsync works at. ZFS > > knows which individual blocks on disk have changed between snapshots and > > only transfers those blocks. There's no file comparisons and hash > > computations to work out between the hosts. > > > > Transferring the initial snapshot takes a long time, though, as it has to > > transfer the entire filesystem across. Transferring individual snapshots > > after that takes very little time. It's similar to doing a "full" backup, > > and then "incrementals". > > > > When transferring data between ZFS pools with similar filesystem > > hierarchies, you really should consider send/recv. > > Point taken! Three days ago, one of our HPC users who has ~9TB of data stored > on our server decided to rename a subdirectory containing ~4TB of experimental > data stored as many millions of relatively small files within a lot of > subdirectories. As a result, rsync on the destination (mirror) server is still > deleting his old folder and its contents and hasn't even started mirroring the > renamed folder. > > Since our servers have been up for 5.5 years and are both well overdue for an > O/S upgrade from FBSD 11.3 to 13.x anyway, I think this would be a good > opportunity to switch from rsync to ZFS send/recv. I was planning to do the > O/S update over the upcoming Christmas vacation when HPC demand here > traditionally falls to a very low level - I will set up a pair of test servers > in the next day or two, play around with this and get some experience of this > before upgrading the 'live' servers. [snip] you may look at zxfer port as a start point of ZFS send/recv scripting excerpt from our backup script: SSHOPT="-i /home/backup/.ssh/id_ed25519 backup@$MACHINE" zxfer -FkPv -U -o compression=lz4 \ -O "$SSHOPT" \ -R $POOL ${BASEFS}/zfs/$MACHINE (initiated from backup machine to pull snapshots missing for the moment; target servers use zfsnap2 port daily with 6d/5w/3m retention for d/w/m snapshots respectively) -- Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: marck@FreeBSD.org ] --------------------------------------------------------------------------- *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- woozle@woozle.net *** --------------------------------------------------------------------------- From nobody Mon Nov 28 13:24:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLR5l5t8hz4hvXJ for ; Mon, 28 Nov 2022 13:24:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLR5l46hhz3hTw for ; Mon, 28 Nov 2022 13:24:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669641883; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6xbtre2F3gOeJfBsjJRgt+DqAacgqo3S5ElBf/2Y6tE=; b=BnDkg0VE7hyHRcN29z+oOAjEmhe8PY4vXqUQCJPhcbJZLsaNoDzB5Gq81m56AHeUKXMV1p 5ySK9BvFoCL1/gwME5EMmfA/7d1SnI0duNIoxMCYAWSEndMdzPot35Y6+kOfMO9ThnbybV LaA8n+QB0T4feFnYWif776hlox3IqD7CrPXZ7xM4OX0OA0TWHg0rPj9XIXns9ZvXAJcyDp fZp3dEnbOv0LaSRUeDADxOaj847npYB5TNL7DOPwywH95fMhptiFglrgh8xgpoZx4kcHGL H60NHy5qiMmh3YhEUXmUi0o0yKQcYyIQib1NDkAivDfuyXVFe3q0kwM2T32DVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669641883; a=rsa-sha256; cv=none; b=VjrU30coughCnHvsSTqjCT98pf18GoElCwUcS6XB+WZYnbX0X4lmKVy+06NsFywI7E/L3L O6gs4q2Kk+xAHteI/PC5Od0+0PzMVo3nA/x3xSSTY7bPNMj3u3VJRgSRrQv77pXESGHAfP Rqx3eSz2wloh7CVAmTifiuvnatv4nLZyCyEg1Cfac1h0CsVKdYbmafUaK1Ehr54dnHh08j Bqre9U1YtUpDLFUMeuQTg/Z9QhwvbdDcXs11+iyFXFonZcAhafU2fjo8sdE2jwtvkNGTnf TRYYubGuoSdrLlDNnZwjH102P71XADsJO3bVUCTQlhSwwYxsvVMt89992MTGGw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NLR5l38sCzfMQ for ; Mon, 28 Nov 2022 13:24:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ASDOhCu053704 for ; Mon, 28 Nov 2022 13:24:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ASDOh2C053703 for fs@FreeBSD.org; Mon, 28 Nov 2022 13:24:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 28 Nov 2022 13:24:43 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #25 from Kirk McKusick --- Created attachment 238401 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D238401&action= =3Dedit proposed fix --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Nov 28 19:11:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLZp15kp1z4hfq6 for ; Mon, 28 Nov 2022 19:11:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLZp14CKQz4QJr for ; Mon, 28 Nov 2022 19:11:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669662697; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FNdPlnKZj1Kv1T4YzIug68udYkGgbYrEL6njAg4BgGM=; b=Oi3YDb83JB7F1NoqA4QOME4GiI9ceJdtyoyYBVRLYOurTgofQ84eVZ10tXuoZqvMTDjygP px8cmozZX25HsI445Ehhb4qUyLZg8GjGTKfDWKwqMa+9UGw9Jnw5gVG6a7VOb8qLzAkx7r 0DuavhMnugkfmPGfXndERf2KBuzsda7VG6QqsW2W7EoW1YY4Bf+IlGQ2k6aGLDmgFoB/By A83YoZzyuhMWOElfWtnZr2CQYjIy5KgK6qtTVlkLdZfbd2whClIjwZNEj2lC8RLV6R3G12 l3iZrD4tBDeDOtX+PwjDFwNiQPgwEOgDsUImFeaGSkfbExrveWStyHjKGJLZeQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669662697; a=rsa-sha256; cv=none; b=vQSCiJKOZFtb43pseB+2CFtPrhog9ywd4OgkQHsZDNx3UtwpOGLStBKktLzLiPHOb6K02E m/anA3TQPYd2/s1KlkLtD+zV5wsmHZXPbrGsqJh9ujDy5AcleVLu7rvlW7mY58MBqvBSJq tHSdQFXecqUzYZO5xYAFNEWNvO06nOfu0RSAqxMzaLReHpt/59nxSxyJO5D4k1lu6Jycph E7BOF+pJUaVoqeU4Vd333h/O71NI3f+fxTKN6Cv6nsTw5RSWMJoM8Ih4J5PhdbI4objK7z f8qQucqku3NQfH3lQpS3y+JAI/+A9GsKfVsYUV9QYdRnCPc0n6JuRx7NiGoR4g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NLZp13H2RzpTN for ; Mon, 28 Nov 2022 19:11:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2ASJBbWr057182 for ; Mon, 28 Nov 2022 19:11:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2ASJBb5T057181 for fs@FreeBSD.org; Mon, 28 Nov 2022 19:11:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Mon, 28 Nov 2022 19:11:37 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: drtr0jan@yandex.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #26 from Boris Korzun --- (In reply to Kirk McKusick from comment #25) Thx. The fix is working properly. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Tue Nov 29 05:37:03 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLrgn5Yvgz4hpYX for ; Tue, 29 Nov 2022 05:37:09 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout4-smtp.messagingengine.com (wout4-smtp.messagingengine.com [64.147.123.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLrgm6tr5z3D6Q for ; Tue, 29 Nov 2022 05:37:08 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=ymUoQmg3; dkim=pass header.d=messagingengine.com header.s=fm1 header.b="O FHc6S3"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.20 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id 466F1320083A for ; Tue, 29 Nov 2022 00:37:06 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Tue, 29 Nov 2022 00:37:06 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to; s=fm1; t= 1669700225; x=1669786625; bh=b23rhQZqokp5V6sp39X1UBnzrt8Ye7uXwW6 0A3W5lVQ=; b=ymUoQmg3exl7kURVo2N14TR4Re2tP7N6tIquV//Gik28zoUjcLc 67jDkcmYiwqKamklJdukfdl66Qm8kG6zF2ujnHC+Xw5Wr/QujyMPCXYvEZd4pGLo 2E5IR1Dh3dKiJCOdGHA9vxq08Q55mEvsfjTyXstvI4z5nPQVTiRmfVlFQXYA5d6M YDj6+KYahIJmmhAv7IBR5m8oNCUc8jUI3Jhhm0Im4J+P4JZPIYUnKtZe/IySNG1R piiNtRTJ61cC7eIpJcYpQa6MdIh83Fj4waz0t1z7RLqWYYcGuW9U4lFoUp2jpzLA M4PiPRI2dDuKlDCAFosWF6qa+LVq0S8aJmg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1669700225; x= 1669786625; bh=b23rhQZqokp5V6sp39X1UBnzrt8Ye7uXwW60A3W5lVQ=; b=O FHc6S3R1bqnfMV9+JbBdtCabDPVjrxLMEm74oS34/4evX1dath5eXRR505ZTp2t4 E9TtN0As1nHRG+xVkkAphwYpe5/za9hiovopZFiPgr1pyYGIz1OzosKFoPRHsOw0 o2Rp4KUH8XYmgOrBuqWhsKTxqjqc7Y4GPPWm2aJ33Rcbw1IfeKTE11ijQryBvRPr pUAsTFg4y1XWP5fcKDcxk6iHmvKJfjx3bnqodmvLi4Sbcf36S3xFO6Zp54/XCTMI GPtEl0e0Kps7j4grSn6GBeELQ3ik96Vqqs7cuk0G0/9XUIRx91oyFB8Xwld/sdZj /PfR6MU0WgdsAg17T4/PQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrjeefgdekjecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfggtggusehttdertddttd dvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrghtthgv rhhnpeevudffiedvffffgffhgeefjeefffdtieetheetkeefhfdvfefgtedtueehgeffue enucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhi ugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 29 Nov 2022 00:37:05 -0500 (EST) Date: Tue, 29 Nov 2022 05:37:03 +0000 From: void To: freebsd-fs@freebsd.org Subject: odd problems with zfs when installing latest stable snapshot Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Result: default: False [-5.08 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.977]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.20]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.20:from]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4NLrgm6tr5z3D6Q X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N Hello fs@, I had to replace the boot/os disk on a 13-stable machine, so grabbed the latest snapshot from 23rd Nov and installed via usb key memstick img. Selected the guided zfs option, which seemed to go ok but did not result in a bootable system. There are 2x SSDs in the machine, so selected the options for 4k (think it was sector size), encrypt swap & fs, striped, 32gb swap size, and selected both of the disks. The first thing is it made 2* 32GB swap partitions (one on each SSD, so 64GB total) and not 2* 16GB partitions as expected, on each of the SSDs. It's not a problem per se, it's just unexpected, because I thought the 32g value would be the total and not per disk. The second thing is that it wasn't directly bootable. I had to wait till it got past the bios screen and then plug in the usb stick again, and then the prompt for the geli password came up. So I'm guessing the bootcode isn't present on the new install SSDs. I understand there's a new way of zfs booting now, but can't find exactly how. Are there newer instructions somewhere on how to fix this? tia, -- From nobody Tue Nov 29 05:51:57 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NLs0z065Hz4hrW3 for ; Tue, 29 Nov 2022 05:52:03 +0000 (UTC) (envelope-from void@f-m.fm) Received: from wout4-smtp.messagingengine.com (wout4-smtp.messagingengine.com [64.147.123.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NLs0y0q8Zz3FRM for ; Tue, 29 Nov 2022 05:52:02 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=n02hTfzI; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=Oo0otWgA; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 64.147.123.20 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id DFD493200063 for ; Tue, 29 Nov 2022 00:52:00 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Tue, 29 Nov 2022 00:52:01 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm1; t=1669701120; x=1669787520; bh=h7tLD9J+LN 6cIpbXd7zoTrNExicGwaAzBDS0dUOZnvc=; b=n02hTfzIVoHlvn0o44vMtqP3o+ GVnHGVeAYVqzeT62IYAGHvf1dGCTuz9XXBemU+5b3Wl18oRp139pOo9noPRI4XwG oUMY9fymt7gdgLVGxm8DO50DWsfxIson0CxcvKrw0XOe5d3VMNy2oe8BB/6k/m3L FKt15V7gyJhUV88s+J9XunkzllynLY6u7Kqv73rJn0PxHNwEGGljUnah2HO0Ll8s b7R8b361vOE6xURrGecymL+jjONJrNSVay3DHbRx9HkjY7Wn5Ke7UT+PgufgCcPr Zo2cpC7WrA/rQvq7eMb0bk3i6/f29DKXHLSAe425FL//vsMA+tpJQGv5qkhQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; t=1669701120; x=1669787520; bh=h7tLD9J+LN6cIpbXd7zoTrNExicG waAzBDS0dUOZnvc=; b=Oo0otWgAilnDq8BJ9EPxFTqGgJ47LL/b+/JQq1XDDhAB fHbUN2T4XWBnM/pIXQr3S8EW0ul8nNeE1vxj/HECq0PqewcwnR3Aa5RMpgkjpLdN 2jREHo75arOtuYKbBImUndGOBeecU0XQMBVguk+xNEcbkAUysXx6H4OR0fSDnkNK pdF0iyvIoYPp4VrsPIRsqU2XxHeAN6UPRz/MGdNIwf2Jv2ViCkl6uR9hjmYHWhVm 0qmwHkZ+2s6TFTv/3/BOKHLcz5/M2CAA0wM3gcGIVadY7kXevcfwArsgN1I63r16 WSb4cPF2ykeb6MDquzzfvcgtNYZpPeYXKCu66FEsrg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvgedrjeefgdeltdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 29 Nov 2022 00:51:59 -0500 (EST) Date: Tue, 29 Nov 2022 05:51:57 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: odd problems with zfs when installing latest stable snapshot Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-4.93 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.83)[-0.832]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.20:c]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.20:from]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; RCVD_COUNT_THREE(0.00)[4]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4NLs0y0q8Zz3FRM X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N On Tue, Nov 29, 2022 at 05:37:03AM +0000, void wrote: > >The second thing is that it wasn't directly bootable. I had to wait till it got >past the bios screen and then plug in the usb stick again, and then the >prompt for the geli password came up. So I'm guessing the bootcode isn't >present on the new install SSDs. The above is slightly incorrect. The usb stick subsequently plugged in to make it boot was 13.1-RELEASE. timestamps on the files are dated May 12 2022. So for clarity, a newly installed 13-stable system zfs on root would not boot unless a 13-RELEASE installer img was plugged in *after* the bios screen (which flickered a cursor then went blank until the usb stick was plugged in) -- From nobody Fri Dec 2 14:48:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NNwmq2b7jz4jdbk for ; Fri, 2 Dec 2022 14:48:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NNwmq0ZYHz3Q1s for ; Fri, 2 Dec 2022 14:48:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1669992523; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=WyB3o3gaWKIgxRSrus1eWYw1c0kbSUNWvCIBWadMyfs=; b=ICMyM/BlHPW4njSQhRe93alHLkb+NxTXH8YqZ/QSRIxETXvyUbNo8nmnkjpIANolMSKgny KpKxKt97TkaspcYY1J/oS6KTZsjWHBWd4STaJ9eVfeepk60poMtVskk14IzoMqLFRtmpDr iL/mcos0JpmHM0F0LeJdbhYvk+YpXZRUp3OZyGFvg3iv4AI8seSBo4dIkXPrORNfSamRCR RZtdV3MA/15xFrjqGAK9j8cp5jHAQbn0GwOnHspMfxQ2XTBxgyCNjXX6mMx3caUBhP19XY V42G+gudBVfjHS5G2DdvZ6OaZliAwTkrPzsrxaw2Rsm6eQsBELu5i3qjScrXhA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1669992523; a=rsa-sha256; cv=none; b=V74VslZLmeaGSSs1As0pNgdq/ET1P2oQoIa9NgZCe3Sj3gFIH/nDXm26vzDE2bylpkrr47 DH6CCwsve9XaLkkZLOLNQTv3UBwcWlr1NBn1Z7gCEpyfC7o8SpPWtEzWk9rE5zjVI//3zw mQM/0kyChgYx3TPVDyuZdR7Q1zEPwHWwyYjikgV35JcfzS7MvmGBLtQS7a9eVs73UL/rWw k7cFXzreS3TB7KosM+sh75Zz2bgRcpNqyFSHE3i58V3zLAmeBxn6PF0Nev7e0OkYAP35Hh yeRpcDSiMl3YbJO8a0g3NYagKrH33jhNv+/Vp8X/zexJcfoRkT+MGKl0nnNADg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NNwmp6fp2zKh4 for ; Fri, 2 Dec 2022 14:48:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B2Emgtf060828 for ; Fri, 2 Dec 2022 14:48:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B2EmgA9060827 for fs@FreeBSD.org; Fri, 2 Dec 2022 14:48:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Fri, 02 Dec 2022 14:48:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: titus@edc.ro X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 titus m changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |titus@edc.ro --- Comment #4 from titus m --- problem described=20 https://forums.freebsd.org/threads/nvme-adapter-with-hp-ex900-ssd-pci-e-nvm= e.85816/page-2#post-589863 patch --- contrib/openzfs/module/os/freebsd/zfs/spa_os.c 2022-05-17 07:18:53.560252000 +0300 +++ /tmp/spa_os.c 2022-12-02 16:33:04.665494000 +0200 @@ -95,6 +95,7 @@ for (i =3D 0; i < count; i++) { uint64_t txg; + if(!configs[i]) continue; txg =3D fnvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG); if (txg > best_txg) { best_txg =3D txg; --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 2 18:59:33 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NP2LG3x34z4hyBS for ; Fri, 2 Dec 2022 18:59:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NP2LG2pZXz45xS for ; Fri, 2 Dec 2022 18:59:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670007574; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EeiAHQvSBGJJeBKnKe0wEYNJc3hepZ2RWJ5qZjRa2pQ=; b=Shsp8RQiL8ZpYp1oPj49dSa8UOUJ0DgBn/diJGE8kz7wlaFlm6TYLCsQlfPpWwT2CTf9NB FW8KSeOjGIScOgD5KIDW6XDvAE+3z8OvWWvgGR6U5zGwuZWhKE3YPUpwllvRGyaToBp/Yz gloPZfW7LGLTiBKBQMABWjxUsInw5wba9EQIdivuq9waLGWzEsYNNP1V8rKDqlCcb2XCnw tiWqIoVonwNSzNMzWYJ0JRy8iXZn+BCRX4gfAVYeGVTtVap7CId/lXEgL0Xpp+oPsZPSUH mfLk8QyXa44CsXiLmev7oUOR9LOMV1/pCA/3UgRyv2KuVzbAJApMAM74orssQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670007574; a=rsa-sha256; cv=none; b=Mizxu8AfzI5rjh5jlRjL64LNnFbbXB6+uXmSkGX0OGxGoEtDUxsW87aP4fKH4WMid802JN CIgRX9UxUDGktcLCP43Pihd51rV/lYU4OiKSXQucqS1wMhqv/11r43ov6wn4fKs9XQuxvq OAyxzU1uOrm4UBGppbn1uK4c/fKdjfvrveYJPsbiWEmhqmcSLj69RCrnoJePKIeMDjgKaO 00CPBGX2ADIe9IXV2OrCiAsa7UIDpApztcB3KXqUuFyZzP1M7U1+RMpBpxWnwSTbMwI0No t+1lF76+XgtC8YXDLMb1+feLmoXkU9zF1RVZk99Lqrq1oAMW8/zYm+wgHi+NUQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NP2LG1mQjzRLn for ; Fri, 2 Dec 2022 18:59:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B2IxYsQ022060 for ; Fri, 2 Dec 2022 18:59:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B2IxYcQ022059 for fs@FreeBSD.org; Fri, 2 Dec 2022 18:59:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267009] OpenZFS: panic: VERIFY3(0 == nvlist_lookup_uint64(nvl, name, &rv)) failed (0 == 22) Date: Fri, 02 Dec 2022 18:59:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: titus@edc.ro X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267009 titus m changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |titus@edc.ro --- Comment #4 from titus m --- i posted a patch/explanation here https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368=20 i assume is the same problem --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 3 07:41:39 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NPMFb45cQz4jsq7 for ; Sat, 3 Dec 2022 07:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NPMFb26JJz44jv for ; Sat, 3 Dec 2022 07:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670053299; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iSWvWDuPEUsp520IgJx8ap1tt/oYoCtNBVKAfoSC2S4=; b=ussjsN4gF4HxbMtme4zakDfyS0GFMdbx50UiY22e+Fht8T/OzRhWY10Q20FlN5paNhIQsr BAp04B2+/EUQ52Y7q0riPBLqlCkHzZ0KSXC/ymyudPzU6Obu+sMe75GYbKsnHZfVTLaG3e 3qSdIIeysjG3muqWDnEYtlrsbaD5G2I6pVx0IAtufomkw6nQVTS0XyGXe+mC3xowy3eoM6 azlxUhfHwsINqeBw701JUXpzu9dw8Xj6LaJDORm0PQ6lr5cPNtP9cMqiH180xHktDzKfYA 0DplC55xMkOlHy81qylMz0SMePfZ//D4PYnoj4ehI9ndmRuDkO2A4Jxyk58djg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670053299; a=rsa-sha256; cv=none; b=NLQClYR6xXkehmFb/NeVZ4ti/JQvsHFJOPU8Ni3gtGIZC3QouXXrzVFzBG5NQTUfNGNVdd J1rvFcjWR2ACAGeIvWO5UzbfCKPQvPkwC9s/qmsnwaMSaT90D/xKh5D9MIF9/LzXVivqdY gEmm5FlIGYvfyom6FQUZfjo5H8kahRAJgnpP9nA8P3JRtS3n2+sYNoDJWYtKTaR0IbBnH5 oyjTGzWECF+Bh5AzLvHFkx6E8/j4n31MIVqM5u+LIZU2kCdFCB+wru/ChT1Y2zaEfcotd4 18JR4czxBti8D46m/4o2K/bpr5rgc3RwNd5LYn4c6DrBBp5tapG3eiBx6nMCRg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NPMFb1Bpszms4 for ; Sat, 3 Dec 2022 07:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B37fdB0020424 for ; Sat, 3 Dec 2022 07:41:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B37fdBA020403 for fs@FreeBSD.org; Sat, 3 Dec 2022 07:41:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Sat, 03 Dec 2022 07:41:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: titus@edc.ro X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 --- Comment #5 from titus m --- (In reply to titus m from comment #4) for some reason the patch fails to apply to a stock 13.1 try this --- spa_os.c 2022-12-03 09:21:13.458192000 +0200 +++ 1spa_os.c 2022-12-03 09:19:32.962406000 +0200 @@ -94,7 +94,7 @@ best_txg =3D 0; for (i =3D 0; i < count; i++) { uint64_t txg; - + if(!configs[i]) continue; txg =3D fnvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL= _TXG); if (txg > best_txg) { best_txg =3D txg; --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 3 09:58:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NPQJ35T5Mz4hxCx for ; Sat, 3 Dec 2022 09:58:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NPQJ34L2Jz4KBT for ; Sat, 3 Dec 2022 09:58:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670061539; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+/bF5pYtff3tlYlkNCZyWrhWFuXg3CeV/2GZFD8hbsA=; b=DemgTjhYd6Fc+Y7sA0cVCTqwB7y8OeU0KpammtFHmP1K02o3TPhL4N+aZyJmvPjgAKJm4b Ekqt8DtkVuO/aTxqOzh8Q5pwBt+GeB1CpkIXUc1qP4zJ+kkhhWGcHxMs48jsESewAzFFfl iwRuVPalGo6ORh6a/eiTSYCOsIvvTpf0KOKTM1YRdDjq1OCxoRMvHN3C92v8qh2PGG8QrV 1xmBC8nJ7iUwDZ+u3KJ7OPgiz51mtqFVVhdC5zB1RWolI7gCsLhP/ipvbCYW/SL0VCQ+6y SBPVoLhjdY+SpIzzOUUu77Z4vOmLWE2qGWYF9koS80OQ+PIQqw/JlX+jfvorzQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670061539; a=rsa-sha256; cv=none; b=mMw9hSLqUqhpVvOy3eeHY3WaHT0rZTFHxV8PbSGFDmqq2KP4b2iPi8KRMkh3mk4sGoMFlq 5y49rd26qeZ8xeWRTjhWGPU+6v8PuQBvRR/VyhjlaiEAeDP925dfNdc40PQaYMhxj9cfnP 73moxX6T93Z32HT1AUMtcPfpF4jFbWkRRpp5SOBd3tshZiaGoHLmU4T8AsLrAEACgxaauE cl1/9pHrKFzXiVX4TUuenh9mXiY2lxOwS7mN3jyfCX4gVa1QJLUfia5tOft6bUpbw5WKSI F9lA/3OTsUosyRUxu6MwKjUegPHi1KwllaqqSNFzDkijBbSEIls4o66JH9kqHQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NPQJ33Dv2zr7x for ; Sat, 3 Dec 2022 09:58:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B39wxpL014068 for ; Sat, 3 Dec 2022 09:58:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B39wx8m014067 for fs@FreeBSD.org; Sat, 3 Dec 2022 09:58:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter (20) of the FreeBSD Handbook, and other OpenZFS-related pages Date: Sat, 03 Dec 2022 09:58:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 --- Comment #15 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/doc/commit/?id=3Dd89e8fd3d40df804a7057b8371221477d= 1f5b3de commit d89e8fd3d40df804a7057b8371221477d1f5b3de Author: Graham Perrin AuthorDate: 2022-12-03 09:39:47 +0000 Commit: Graham Perrin CommitDate: 2022-12-03 09:39:47 +0000 FAQ: TRIM: GELI, ZFS, OpenZFS: pruning, tidiness The ViewVC views of 2013 Subersion revisions are no longer of interest. vfs.zfs.trim.enabled is unknown in FreeBSD 13.1-RELEASE-p3. Questions about TRIM in the context of GELI are not frequently asked. Also, non-contentious grammar, punctuation, and formatting: * surrounding apostrophes ('=E2=80=A6') are obviously missing from some= quotes * missing full stops (.) * trailing white space * AsciiDoc line breaks * et cetera, there might remain a superfluous break, such things can be addressed as a fix to this commit. This commit reduces, but does not fix, bug report 261212: > Update the ZFS chapter (20) of the FreeBSD Handbook, and other > OpenZFS-related pages PR: 261212 Reviewed by: mav, pauamma Approved by: delphij (doc) Differential revision: https://reviews.freebsd.org/D37512 documentation/content/en/books/faq/_index.adoc | 166 ++++++++++++++++-----= ---- 1 file changed, 108 insertions(+), 58 deletions(-) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Dec 3 11:55:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NPStH0Sbvz4jCj9 for ; Sat, 3 Dec 2022 11:55:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NPStG6MQkz3DlJ for ; Sat, 3 Dec 2022 11:55:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670068518; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gFviMuTUhqr/wFoDNrgomyXpIOi9TsFUEK58/hr5frQ=; b=KolI2KOJVH0Md5kwtQXURuCjafJmkYCw924f6zKB1UGgjhM4pl49ulb4LD8oVRZMbQU+i/ rpv/TOrh3XTw9H6Ow7uaEztoFY7In3AOdRfqL3EKcZBoYsFHKL5RmZ48x/t/6MUheRzQaz swN2hjMDablpToz+F+dz1phGMXnHPjk0VxTOjjJ7andUp7LBFFVpMWJPJFLexY4tU/0c0Z ec3e8t4ZhMwRrYaXiWMM2l3Tipd6yBSXA75Pv4MhMu+Sf/Y9GJOOqDRC+GeXzTk09Tq02s OeoKm8oUxbByZQf34KxyqxxlAzHIdQzmU74017PYHNIDh0z9T0LqzeZy0yoHUg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670068518; a=rsa-sha256; cv=none; b=R2N81lRpk5t2yzjNy7Cv/KoU7Z7zgisFrBkua1Xef7hhu5ho/xNkISCus9AKx05NG6X+EA EftFUMZ7PfaZUtkPQknNR0CX5mT12uUHii3FH3HA/vwKngg0nHLsxSRV/JOGmoh9yECqSN Af7+bEoa1bKIVpKi1OdIY1M3nvIXyjDC98xLtawjtgpeVYko4mVLhq7elTAdy77fmU1ijP n9ZOHQBNgmZC4UWHPv5aEU9ENONKgfo9EMJ+TG5OX9wIMFcCJXK5bdjjSmKyFec+98kWLj BJUwnC0voU1Q2irOhF30owgn0Yds/XkLYT+j4OQPaiJ+84kFMwaKXGBVcB7Vvw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NPStG5Q2gztns for ; Sat, 3 Dec 2022 11:55:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B3BtIQm092056 for ; Sat, 3 Dec 2022 11:55:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B3BtIFe092055 for fs@FreeBSD.org; Sat, 3 Dec 2022 11:55:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Sat, 03 Dec 2022 11:55:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: Trond.Endrestol@ximalas.info X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 Trond.Endrestol@ximalas.info changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |Trond.Endrestol@ximalas.inf | |o --- Comment #6 from Trond.Endrestol@ximalas.info --- (In reply to titus m from comment #5) The patch probably fails due to different indentation styles. It's only one line, so you better edit it by hand. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 4 05:21:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NPw5w29npz4jLn4 for ; Sun, 4 Dec 2022 05:21:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NPw5w0zVgz4Pgk for ; Sun, 4 Dec 2022 05:21:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670131316; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y3fvVh90EHPAuh8Xd10aMH+IGcZV6+rnqNeEbAAAYbg=; b=YLCE+C7ZkZWy6PhtRMb9Lgu9+HQypSQxrUDTo9Pm2Pmc4EW2nmWFo+pjSgwffWbDJuF3Iv Y0Yx5zl1zAhn2fGLoubysgA2rxI3rCMBg41Z1N/QjXT5XQcFdNrrcpPfgB7gC/8yijvu80 OtCLa8BbzQijkLOlZzJH12lHT4D00Gt5alC2yJjCbdW1SXzqb8HOClWASM6+wkO4fqbsdk O9X3v5wyOf2hFHWJZXbRo687nf7/NZyRqMHIIY65LX+Dh7JGyxKBOVK/xNH8Uhtm8T4L0l 5B24IN/4CEivyMojzDeKDxLU5hSDUYQAK1dDdhBC9KWCBxfAV1GrZaMFQHhkJw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670131316; a=rsa-sha256; cv=none; b=NLOXWQ2RSTt7LZMtPeEbgH1/snqM5tGx9UPvBC4E/fWG3+VWb3X1Mxc8udKQEa/ouK6Efu X7htI7rZGyMrZODHKefhT5ufXtl+mfHzOWRoua+mC+SP3k2n56oOoKki5EE0LcWFHO4iH2 acTi3GE9dfWjbG6M/aRwvCZtK5vmLnj6A3v/qLs4IEY4RSGMPQWvbuD86u4ZDmXH3/fF9z jcpM/fQ0lqht9ddaVSh7+gMR8Usq865CiKyqAo4+aZUrqKUgiWhIddPBtCvPSDTysQvnqc 1GmCURgaMQ/ZOi1Yp05UUddDrWCTlYLOJVKsDGf9lApPGV9CajLRIQpAI99LgQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NPw5w059dz1MQ1 for ; Sun, 4 Dec 2022 05:21:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B45LtJg084407 for ; Sun, 4 Dec 2022 05:21:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B45LtII084406 for fs@FreeBSD.org; Sun, 4 Dec 2022 05:21:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263979] [meta] UFS / FFS / GEOM crash (panic) tracking Date: Sun, 04 Dec 2022 05:21:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa, tracking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mckusick@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263979 --- Comment #27 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D896c3e6e8a61606adf4414279c4699918= f921510 commit 896c3e6e8a61606adf4414279c4699918f921510 Author: Kirk McKusick AuthorDate: 2022-12-04 05:20:39 +0000 Commit: Kirk McKusick CommitDate: 2022-12-04 05:21:32 +0000 Fix compilation issue when kernel built without FFS defined. This is not cherry-picked because it occurs only in 13 and not in 14 or later kernels. Reported by: Boris Korzun Tested by: Boris Korzun PR: 263979 Sponsored by: The FreeBSD Foundation sys/ufs/ffs/ffs_subr.c | 2 ++ 1 file changed, 2 insertions(+) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Dec 4 16:39:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQC7w75k7z4jg4N for ; Sun, 4 Dec 2022 16:39:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQC7w4wsxz4P6v for ; Sun, 4 Dec 2022 16:39:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670171980; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IEvK/cxcyTUR/nBSCVEQJmlQPUAofEA/ufT9qZc1Cpc=; b=NjNlrLvVg4CZ06ejJFr64giMdLfU+Xy68Uj4pB2ol1W7othLBlowS3Y1X9hsAp+FUPW5ur TrrPJkh5HairA5ij7wW/fF1AdU5lADKgmd3TEI5eRXc15kvNa1+/mBQEKgPtSafvM4Bgcb aoVl819R+agXfMLQIMekPvZhL6tjS/rK4X9DLyO6wXm3qNc51LO3BTQv1y3ZjcTKIr9iNH LXEvmRzypPCNz8enOZSH6MdniQqbvpfy/PRcUBW6LZibCoTVsrwqByfK7Q5gsakgzUxESm t2ZbBqvhz+4FT18YCrTw2jzehcD8YlKlmRRWqkmHjNOHB1bFsctpEUb2iXyueg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670171980; a=rsa-sha256; cv=none; b=Af4P5BWB+RZMwmO3MLIdNNd7j4V1N0VjjraGAvsg7273PcYjZqT4AuTys5zUDf+lrIa9UF ko/2wvImNziyV0AkGYshj897P5GPiEEWmWnYjxBN2004wD9On0q8aZ6zef6Hic2mB9Z4Tw 374A25MhxWIJU80aE8c4MeFfS36dtzF4GlU7oxEixl0NhYbViyc0ds05TDy3isxs/xrLDE aZPyhEcuI/j6xyKS/2b/ph22CXUriFfq+EyjnM8/nO/TBa166ooAcUXU19sznOuK2+aFRH xm+DoMjiF7e4FfEbMXwRQV/RH7nzLv+JbQrgx0hZK3O2sJq7mcIxkZAe15FS5w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQC7w3pjnzQNt for ; Sun, 4 Dec 2022 16:39:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B4GdeCZ044363 for ; Sun, 4 Dec 2022 16:39:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B4GdeLi044359 for fs@FreeBSD.org; Sun, 4 Dec 2022 16:39:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNjgxMTZdIFpGUzogcGFuaWMgKFZFUklGWTAoMCA9PSBu?= =?UTF-8?B?dmxpc3RfbG9va3VwX3VpbnQ2NChudmwsIG5hbWUsICZydikpIGZhaWxlZCAo?= =?UTF-8?B?MCA9PSAyMikpIOKAkyByZWJvb3QgYWZ0ZXIgcmVhZGRpbmcgWklMIGRldmlj?= =?UTF-8?B?ZQ==?= Date: Sun, 04 Dec 2022 16:39:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc short_desc bug_status keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268116 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |grahamperrin@freebsd.org Summary|reboot after readding ZIL |ZFS: panic (VERIFY0(0 =3D= =3D |device to ZFS |nvlist_lookup_uint64(nvl, | |name, &rv)) failed (0 =3D= =3D | |22)) =E2=80=93 reboot after | |readding ZIL device Status|New |Open Keywords| |crash, needs-qa --- Comment #1 from Graham Perrin --- Can you provide more information about the crash?=20 Maybe, the most recent core.txt.=E2=8B=AF file from /var/crash (if there's = no such file, please see savecore(8) and related pages).=20 Thanks --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 4 17:19:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQD1J1l0vz4jldW for ; Sun, 4 Dec 2022 17:19:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQD1J0bpSz3DpC for ; Sun, 4 Dec 2022 17:19:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670174340; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Rup7Nrnxm4GgzdtV8ZbvUFDUINKSsA9lB3No4Fn3ySo=; b=N5wFV66kR0RsjVceub7iMnTk5LmCdkIRVgDiq3Nv85+8DSbrCGBTfDSNufs3ekR5GWiBTy 4Nn4lyWEVqeAj/a7lkHu6zsEDniFmWxJprj9KgxL2DlwuE/TnwnWCgsAwuugeHv8I0Z4Xg nMROOrEaf4LU6guPUYUCr3VPSi+7yAOEawjPl7V9M8aOnKGJNirSsovkc3iTsPXQWpcQWF iri/OuOQxbCmgyqSv04EOHRhf8+wBeZlR6Gh5ao0cY/SnPwb3v1I4C62sZ6CMb7MTSg4/J 5bQuQVzOwnsVefoEzWoDW5Gktb5H719ZpRBh3VSGhhswzXkpK+QAZJsKRC9bmg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670174340; a=rsa-sha256; cv=none; b=VV+valZDR+7kcs3ODRYD9yEYWKNFjrKoDnFHmrIXtkHTzoMnQG/Het4OOn0yZgONiSlfZF kSzrscxmtmIcrUqr4wwR+MrhhzCoaL6/jiwaZMsUL6EGqquTHgo7fO4no3fpZlzoxGPg+e 1IR3menSHEza0Ax4D3Uqdincd4sF3jZ7zxK22GDbrJBp+qLR9LMEs4ysn0gvLz3TUp+Snm gYjTDeM6YdM6A6ovraVCdgIma0p8gsip99zLOGzqL7fwcYHlzNOyvx7sNcH3iODKwIvam6 rTN50D/nZxCp8vl7LwRW5HtU8qkB08+1RnpVjColue3aeMknZC3EeO+agcFXLQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQD1H6h31zQpB for ; Sun, 4 Dec 2022 17:18:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B4HIxX2000158 for ; Sun, 4 Dec 2022 17:18:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B4HIxBO000157 for fs@FreeBSD.org; Sun, 4 Dec 2022 17:18:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268100] 13.1's loader.efi is not able to find a ZFS pool if it was checkpointed on 12.3 Date: Sun, 04 Dec 2022 17:19:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: loader, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status keywords component cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268100 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open Keywords| |loader, needs-qa Component|misc |kern CC| |doc@FreeBSD.org, | |fs@FreeBSD.org, | |grahamperrin@freebsd.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Dec 4 17:33:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQDLX26lDz4jncc for ; Sun, 4 Dec 2022 17:33:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQDLX0DbZz3HxK for ; Sun, 4 Dec 2022 17:33:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670175236; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nGJhaULiD7MyONCXGlVj4rLZYv6pcuIdRr9gPfFpVSI=; b=byCeSiJw4flqR36Ra7p0eKzUFUXcjVJRXlycHNVLbAdM23mXydlOCV9m5AlsxqqG7/aP2p Ql+u5VgN392SuFtW3ToRFcC1F0saOrs3ucG6Ljr95zge83nXAfW1eU8MUX0u5DeRRP3Xlf lhtsOMG1XRb9eeLfv9IxFBvUgWQfUeNk/t/clb0Y58zHkol8WSmryGNqvhDh4SmWM3P6Dt UryEyh96lYmrGHGQKfk2jQS6k3CKdplcd1/lZyphL6N1nA7xsvlmeeyYeC/iI8nVPj5lQB HuL6nwvsyqA9WPd4UvhOBOXukJOdp0uZvy9tiuaG9g/WcTDv1c62r7b6KcrRaQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670175236; a=rsa-sha256; cv=none; b=avABB6otAtm28Fjy5I7fxs9qDMWZKwjlk0HbLf1iDBMKwpuuYvtr8vTMbrUPyilCzkz2/b 5jCNQzKj5vqjNeOE42F8R+3RiJPxsLb7iGZAseYhhBDQBVKD2NZJq89HE5kThZoRLr4Qfx 9FLISl/KDaTx9a/jJHdVFAt5jeMZOMWuPcdyI/TZLDFYP1/uf1Ho0GpEsvwz3wPQNCRRtq bVyX4fjE8SeSb5hJlqUVOKjfW0vfOOWuAtQrGJBYYA4s0hMalTdB3PpTjI7a/bhRar2ICa KySH7VpK32Ao6uZWTY3xNVvJIJB+Zh+Ft+UZsDV3PS6x3oMSWbAl8u83EiXTTg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQDLW6P3YzRFY for ; Sun, 4 Dec 2022 17:33:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B4HXtoR023711 for ; Sun, 4 Dec 2022 17:33:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B4HXtAA023710 for fs@FreeBSD.org; Sun, 4 Dec 2022 17:33:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268100] 13.1's loader.efi is not able to find a ZFS pool if it was checkpointed on 12.3 Date: Sun, 04 Dec 2022 17:33:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: loader, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268100 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #1 from Warner Losh --- I need more specific details on how to recreate this. Why can't loader.efi = see it? What are the characteristics of the ZFS snapshot that gives the loader grief? Does this persist in a zfs send -> zfs receieve? If so can I get that datas= et? How important is this to you working? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Dec 4 18:49:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQG2G2ycXz4jFBf for ; Sun, 4 Dec 2022 18:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQG2G1s75z3Pn5 for ; Sun, 4 Dec 2022 18:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670179798; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iWHFGPz8qXPES18nRvJqKpv06nMAO6AO2CvjSUCo0y4=; b=ylgu/O84/qnZ8D3shjl4VLwgbFw3KUG9tvQN6FKmRVRVPslIwDrxck1/pVn8+FOdO5e1U1 ijgRIgWF+5iU/jNDaC51KZztDPqR8vb0ikuJIGzutJzR6rmaVvUWCT0rCr7GM54S0VCi6L KV8zQeRXB+HpD3R9IRwkRLv83qekj4Jafpx0uCkmtdk3WsRuicwjKsi00C4/5y8qSd+mrs x0Qi6kSFZydL8yzGblu3sw5zBwx/9jgl9Zub9WqjsbzpvChn/B6F6bJ0GwBQHtBxXLW+i4 1HTAZ1sHJXwzzwEeM0/JCStdp7vqkLgO5PNuxEeHFx659Hflx0jrTMrqIE7/xQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670179798; a=rsa-sha256; cv=none; b=nIPpT6Pyo14cDPeK2UxPcIUe09PgMPZUBPrRbmXZlG62R3XqI5HutoZE4LPhmcN4O7Sgxi 8dyaCL61B2tqx3fDu3SaxqBUODy4fQSk885mZzkKq2YZy7I8O+kpG2oZTRjREkMwrJw6Zr cBLeql7Cg6qVRTsROcmLD5+6zlfPAnIKiSF6OVbc1GJCeYYgewm1qrmghfhO6AXHoQkQer wEopkh6P9bLkAjHNwUy3x4PGaIbVBX6eEF47y2D4jHc940yjIV8s3X6IH4twDHqemBJEPJ q3cAV2fnUA5VnEwJ67l/IKExeUP75hh5L9j9t6LmCehNYm9epCQ8LPvgGSsuVQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQG2G0qFHzTNw for ; Sun, 4 Dec 2022 18:49:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B4Inw7b032095 for ; Sun, 4 Dec 2022 18:49:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B4Inwuj032094 for fs@FreeBSD.org; Sun, 4 Dec 2022 18:49:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268100] 13.1's loader.efi is not able to find a ZFS pool if it was checkpointed on 12.3 Date: Sun, 04 Dec 2022 18:49:58 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: loader, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ml@netfence.it X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268100 --- Comment #2 from ml@netfence.it --- (In reply to Warner Losh from comment #1) First off, there are no "characteristics of the ZFS snapshot": we are talki= ng about "zpool checkpoint", not "zfs snap". I have no idea on why loader.efi can't boot from a checkpointed ZFS pool:=20 I only saw the message above ("can not read checkpoint data"). I don't have the original problematic pool anymore: it was a production ser= ver and I needed to boot it ASAP, so I just issued "zpool checkpoint -d" (that = is, as soon as I relized what the problem was). I guess, in order to recreate the situation, procedure would be: install 12= .3 UEFI+ZFS, checkpoint, upgrade to 13.1 (maybe upgrading boot loader is enoug= h). The only thing I could add is it was a zraid5 pool (3 disks); not sure it matters. Importance is "less than bulk" to me: it would have saved me three hours of spreading panic if I had known; now I'll simply check if a checkpoint exists before upgrading (or, if I forget, boot from an USB key and remove it later= ). My only goal was to let other people know, so maybe they won't be hit so ha= rd by this. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Dec 4 21:00:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQJxP3Hqkz4jXkm for ; Sun, 4 Dec 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQJxP0rCQz3vtY for ; Sun, 4 Dec 2022 21:00:57 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670187657; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=1CNnnksXZ/xqluBYdkc7b+0S4qeMvwLKIOThjHrA6Bg=; b=ClZo9APMdz0yKXvb4V2a6Lp2jUuUabbh9TSbu4/yZrG6rTEjnEMvQzKDa1ht6hSLB8TMs5 SkGRPf1L1DLQJmqiJEojY0R0NPqd02tjaB8obFetoqu8IQYP2ioouMVGN0AjhSxLe6/ciU nkmof4usEJtt84iU9u7Q8q7ZB1FK0ziQ33xre7g22oBZ4alyghZlLoyNx4V6FOGlBrMGT4 c+A+NKBHacmidPxvxfrE8sXMBVCkWPK5y9VQPueZdL4dZmtn+xzqdRttjxvsnnNidMJF9u 8un2JceSeqQX2m8yu9+HAAPYWPjELiWDN7qObiYRx7MvTyqHDZ7KZa/Mkl/yBQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670187657; a=rsa-sha256; cv=none; b=FCFB3SaApeaqKuL9c+cvwNQLm5Ac10p2GvQMYul8uVa3/jz2nxd/Y8JlGkfg4+MeaJVS8j OFkLxaRTx6PigSF1fgnnGdQzQJfInltaFDo/ZuE+lEduaIIQJdwitPVBwM9j6+yN4JrdOL i29jk62CTwAetpso2TJ7H9bFSThscRIj2MMddnVyefphQ5OQPvZFByJur453fiDd0xmLLQ gHufSJCaqTMJPPI1F16gu/9934qVAY70c/ZkwK9bbrZQNsKxwOWbaRNn4lpKsFIC7Arrmg Zv7tOi3GHUhIHamIOt7BcVIxPIdV/6KU1wpRMR/CrPcXWzpCwp3xJpW/ymZK9g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQJxN72DrzXKC for ; Sun, 4 Dec 2022 21:00:56 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B4L0uob020716 for ; Sun, 4 Dec 2022 21:00:56 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B4L0uIZ020715 for fs@FreeBSD.org; Sun, 4 Dec 2022 21:00:56 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202212042100.2B4L0uIZ020715@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 4 Dec 2022 21:00:56 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16701876564.0CCeFac.16947" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16701876564.0CCeFac.16947 Date: Sun, 4 Dec 2022 21:00:56 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16701876564.0CCeFac.16947 Date: Sun, 4 Dec 2022 21:00:56 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16701876564.0CCeFac.16947-- From nobody Mon Dec 5 02:35:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQSMF4tgXz4hsXT for ; Mon, 5 Dec 2022 02:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQSMF2JTBz3hpl for ; Mon, 5 Dec 2022 02:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670207721; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PEPBjSdeLI/pN/IpOmRJCjWfmR/kdqg63XpGNkCx5fM=; b=eqLoSgxJRfpnPOr/mbZ+Fsj0PWUAWsXab6QzPeyDywOr5Heiq5sx9+0WJd9Vaf8DBgpVzP uJOGCsaVQhqizwrXK3885MVR2bCQmn4x1+e3pK/7DaRXfAqRLuwPwz1kJlGHqLywl/fFTO I9txClb19/acFz+pal8l8eEaiVXhk4vlfG0xetSGag7gMJNNnEJeqLiyxZR/DFAEkT8aOB h0q0J97QMWq3D1C6psJV1+jQjle2hauqTFjmp6rRgeLKpAl81KxHd3PBeNBsccOVGE3ZWO Obq7CdVqavk6dJP79Pc9fp+ImfGAtCdQKgiFFFNi9WCB7uLkYus8wIaKthKt1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670207721; a=rsa-sha256; cv=none; b=L8vslI8RCvoPYBlUFMFc7KxkG8XJYYGLFVbDIVuQzaU6Is3Tt8WKHvbZRp99VMFG+bSU7+ 6GLS3LLacYLXZGusgPi/Sm8owxorNA+m5sxQnVnbdmKTtcIvF8gx0tOHZVsMk8KoxJB972 PttUxZ0ETHzUbhGhl7MBPrgzryzkoWR82kLi0fTSFVpBd0U0MPFGY93M/2djq73RWRvhOF PpM7rNrA4t6/Rra6RcpnWe+eOohH53nJM87nCzXY1KNAYVMLAFIY3L4S03D2viaxXWMAn6 M9c3TsFkRXh7/u3nxWeD/hxrlTLO/mYPM6SWrECvWvK31nzPfbOsmarJlvyv0w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQSMF1Jf8zhL0 for ; Mon, 5 Dec 2022 02:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B52ZL6E002831 for ; Mon, 5 Dec 2022 02:35:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B52ZLiL002830 for fs@FreeBSD.org; Mon, 5 Dec 2022 02:35:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 02:35:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc keywords bug_status component Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |freebsd-arm@FreeBSD.org CC| |fs@FreeBSD.org, | |grahamperrin@freebsd.org Keywords| |needs-qa Status|New |Open Component|misc |usb --- Comment #2 from Graham Perrin --- Triage: freebsd-arm@ (assignment) and usb (component), both tentative. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 02:53:36 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQSmJ24RRz4hvWP for ; Mon, 5 Dec 2022 02:53:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQSmH6fqqz3ll9 for ; Mon, 5 Dec 2022 02:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670208815; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fcQCT1jEQcSaZIFf3aPfDytsSIHdxoUaSoupt7Taqkk=; b=Tyghix+a13Pivi5gqIw6owDTM1hKjh96B4WDOKo+CRIyJzZDpS0pibGRZBjHyLdpHvtoD9 BZ2r87crr/EnEZbYj/fPwKVbPzAi3esecIdLWm2hX+XgXas2lsc0zdfhjEcF1meq4ig8gZ PpiO88xw+oNJX5cm+U+qoX4ATtkTDJHfUt12jl+8wpTL0pMGlnt737uR3IRRlCXQM7bPT3 f1Yox05tCHK6SV2qeDa7PwDYgeV2o1RvjPLjj9HyVzCCP5SDhgJWYg678hJtOFP2ABwaFo ogeHaPS1U5WpF6V1MZA+ortRQxVJLYVAPQs+Yda8jPLY9cgFzJoLgwnr4Ycdug== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670208815; a=rsa-sha256; cv=none; b=uQdeGi1AJppcpjk/O9VWAdmz6VRA3nhGRZYe8e0h4oScCm5pJV57qkun1jf4RXVA1q7Cn5 VIRd6o1noH/QF9fxzRp74GIk4xYtA68cZM5rvczfa/usJr84G6EnODAPhmvSV4ZUHkV++9 SI5btbmuGkHcReGAlXjCFhngyjYBi46N4gCQsGedlHe2hefABKTTSWA72am2bzJD+pVhTc +l5w35KwOFEKiqZkRMn6ubtuFsOtx/H7rOl54BHk40rpPR4eAvjPDlHfYBUuvaOHRy6TLp 67XShEi2k0qCD9bCp9ByN+lJeS2nUwiHZ1pmBksioouN3Dk3vCBzWuVT5qqqwA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQSmH5jnZzhcj for ; Mon, 5 Dec 2022 02:53:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B52rZLA030133 for ; Mon, 5 Dec 2022 02:53:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B52rZYP030132 for fs@FreeBSD.org; Mon, 5 Dec 2022 02:53:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 02:53:36 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: barneywolff@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 --- Comment #3 from Barney Wolff --- I don't think this is arm-specific, although it may show up more often on systems like rpi which have usb disks. The fix has to be in zfs, but I don't know if zfs can know whether a pool import that's cached is on a usb disk or not. In any case zpool should not abort if a pool disk has disappeared over= a reboot. I can imagine a nightmare scenario where a vital pool that's on a permanently-attached internal disk fails to get imported because an unimpor= tant pool on a usb disk has vanished. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 04:37:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQW4Z2NK5z4jC9h for ; Mon, 5 Dec 2022 04:37:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQW4Z0H8tz3xP2 for ; Mon, 5 Dec 2022 04:37:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670215070; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nWT0jRAfFgQc9zEvrs7JSroJDR7NYlwP5sR944tdqFk=; b=ZfZIponJpcBOka7jQrb0QGwMHmOXeS7/SByRPCIv7rezGP03FPnq2FnJSIIYO0hsAe37vL vBtpVv06XY1FMQnkCh6RZ0P/iCrUe0v0knQqkYBQ2/1XJzTdeLBgS5bO7UGdShJM3dA2Xk Bg8jPsOvMIbMEFwpHMxVhQfzXIYF51Mrw9zhKyhBCnzzZpP6cL9o5aGjbfuaxX6x7XMD4c FiEf38t2p9EKxEbFCoWVwZqpZOkeicmOw20m8htvayedah3GEGVkVQO3CIjTqgPaQ4oEiX 43f7RdS33lzA5wL63fj+Mh/fniDe9m73odNsCS1W3/FdjH2YtP4Ru6cZ7ZuCwQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670215070; a=rsa-sha256; cv=none; b=lOBNEScX0bVJGJNA5kFj6Fw71nyc3VBIC8o9qK3KGLPC9J2GfvZS3jKU14eR6VeLmwfnLm edlrJXWSpmkyE0ZNPd9xFf5qVtaZ7YAUfEoGemlcsLIqiqrxuC01x915l+5M3FbvXHrJFT Iqqayl+MXxSTMNkuEusolBtrwtphdSKSo6zo7AmzoSRhAtzLQjB3kQbBpf5sTUM+sh8qhW pDlW1MY0OcFrWFVmDq4j/U1ZcdJL8dwuACsrEK9jeV/ntp4XKZTHTYsC3NvUE9RD70ZYEH CVxKn8FLVHZbH/LHskh/tJ7IAxA9kPGXsOeOSvmdftH0nqVUPiUBEwAsgpMjQw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQW4Y6D6Vzkhg for ; Mon, 5 Dec 2022 04:37:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B54bnNq077682 for ; Mon, 5 Dec 2022 04:37:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B54bnP6077681 for fs@FreeBSD.org; Mon, 5 Dec 2022 04:37:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268162] zfskeys_enable: each successful load of a key is preceded by 'key not found, empty or unreadable' Date: Mon, 05 Dec 2022 04:37:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? X-Bugzilla-Changed-Fields: keywords component bug_file_loc assigned_to flagtypes.name see_also bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268162 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-patch Component|kern |misc URL| |https://cgit.freebsd.org/sr | |c/commit/?id=3D97aeda22435= 68b | |386d792514996a06daec55eece Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Flags| |mfc-stable13? See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 624 | |68 Status|New |Open --- Comment #1 from Graham Perrin --- Retrospective: 97aeda2243568b386d792514996a06daec55eece=20 > zfskeys: Support autoloading of keys stored on ZFS * paid attention to order. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 5 04:37:49 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQW4Z3H6nz4jCCx for ; Mon, 5 Dec 2022 04:37:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQW4Z1G7Tz3xP3 for ; Mon, 5 Dec 2022 04:37:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670215070; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Io5WySq/e86xHwilFqQbW12TW5dy87m8H9e3Y+g+ces=; b=SFmXCce7TrsKns+MNKNMIlYxk7SQJhu5fSrU8nx/us6tXXAzzmZGl2V42oJCsmR2DgWWZM 7EqpQSNa2Im1Gkz4afxTJk89QmsfVZZ/RncGFLtsX/RpB7PvLDbqNil+yDY/s9ZUNHFMXS h4Z/4bOj20+dtd7DJTPXXQa32XV7fkOMcNWvEtjan8/gk3skN2jA2F6kghmqzN956ST2hH 5h3t2S8mQNNndBqKYQ89XREv5J7ek/VLhp73YxIE6C4MET9odgLe4PvCgdodiX0ypFxI52 yXx/g4zTabbctvbCrD6q7SKeKRVfoQEIWzyjQqKCtZ4OzPmt9D2TMTsg8mCsVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670215070; a=rsa-sha256; cv=none; b=Fxu2CUBXI0CQPPtw6x6LA+ErU/EDhHufFSIQrelCrsVvDeG08F/jjmFRoKvJQTTbRcQKB2 hm5NA8XvypeUu9z7Ux6L2QmpwQmpzLmxTa+jnP4uW4NcEb39ueIMKMk6FFhaxN6EORcx84 McNX7MLOeYUxyh3lVrA4SVotFnefSlFdYptzuWdeidfuq0nP53rvn3pQ5vuz6E8YHvEd7R w6yS2QRku96DifljRMcue54EEOGYjHK4pB2DF9Str0PrSpDQ5EeovtM5d1M8TF1PoqxWVg leQuxGo+hFlMa2POjAOTrVidJv7vveLmI7WstiIuTK4I7V72maX0YyUB5CYx6w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQW4Z0CTLzlH0 for ; Mon, 5 Dec 2022 04:37:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B54bnhS077687 for ; Mon, 5 Dec 2022 04:37:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B54bnVn077686 for fs@FreeBSD.org; Mon, 5 Dec 2022 04:37:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 262468] (13038) zfskeys_enable: encryption key file stored on ZFS not found during normal system startup Date: Mon, 05 Dec 2022 04:37:49 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: mfc-stable13+ mfc-stable12- X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262468 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 681 | |62 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 05:32:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQXHP2Nlpz4jL6c for ; Mon, 5 Dec 2022 05:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQXHP1FdXz43Hj for ; Mon, 5 Dec 2022 05:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670218337; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=00Tu95z5xQai+i3cqpjKnrpHXiZRrZ6rROPq1Z69CDw=; b=Vc/xtykFSAivmycqM2NldU2lhpkjml1dPtBZ/p6ie+aDRj9uyZEjPsVjqucLQ0PVMwJGk8 AFyOBx9iSm0ft4mzv6H3zbb3M0oaULPUYJWXEX6EjCWocKeJKeVQKgkpF0bKudwbCLIASC uaYlWvv0tffF9tx1zEXR+KSGMo5ULb6SepfjCDh3idfrjycn8WHaOlCEI3afjCaqQydNSR TgOyd/OdHSmy3kGB0TR1C7yMqtOJaTGwuQxQi6M7vxCHyGCjPm1xiRCB8na+zHKZCE8xhV j6yllvCPaY8MXyxST3F3mJfi9ygh+UW02Vku+Ydumm8aC8gCJ5+xNp9NxjUrfg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670218337; a=rsa-sha256; cv=none; b=RW02BJXUcYDHyE30tWGosm8kMkf7Ap5wop0u3KFqXgBh7L3nUkKnGNv4MJ9GtZ93nr2L29 Lcmkwq/Hx9/ATK3xdzCdjIeK2EPRmrKfnWlt+n6KTcWijciDD/3+PJ6HJoPTZ6Im/gFeDT qNxV1d4yht8lzTBoMkXlBEIwsoJiIaBuSXEtB7cO/ll41wI2YjG3rjEO1TczwVgTYhMkAv S6l5WznF1nAhNnHbpnin2+4XmSGKnta3sEBoObyV3kj50B+3D/NXKfp+fPRznSG88kPp35 Q+SWEChI2cKFj1bEUJtNckvPTyN4ZWtSl/1Q9CUNHAFGHMLaqhXdH/Zm2Ok+sA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQXHP0KJ8zmGP for ; Mon, 5 Dec 2022 05:32:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B55WGOM057782 for ; Mon, 5 Dec 2022 05:32:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B55WGxs057781 for fs@FreeBSD.org; Mon, 5 Dec 2022 05:32:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 05:32:16 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to rep_platform Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-arm@FreeBSD.org |usb@FreeBSD.org Hardware|arm64 |Any --- Comment #4 from Graham Perrin --- Thanks, now I might have a clearer idea of what you're describing.=20 (In reply to Barney Wolff from comment #3) > =E2=80=A6 a vital pool that's on a permanently-attached internal disk=20 > fails to get imported because an unimportant pool on a usb disk has=20 > vanished. For me, occasionally, boot (from OpenZFS on adao) fails in the presence of = some combination of external USB devices. IIRC multi-user mode either (a) is not reached, or (b) does not progress.=20 The 'offending' device is not necessarily one that contains a pool. Sometim= es it might be a cache device; other times IIRC it might be not storage-relate= d. Sometimes, randomness =E2=80=93 a failure to boot with a particular set of = USB devices might be followed by a successful boot with the same set, with no change to connections. When the bug bites: I remove the device, boot continues. There might be an existing bug report for this type of thing. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 10:16:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQfbt6vXYz4jHj1 for ; Mon, 5 Dec 2022 10:16:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQfbt5nBsz4X4m for ; Mon, 5 Dec 2022 10:16:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670235418; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NPgdS4t43lkao7JqjhtC+1XafBILPOJTipKyjPPhxR4=; b=MXeI+oD3J7bzQhxxmQZFruafgSkLJDTkXrISqdlF5iay/Y4MFwe3TdV0jMh1OCkedf6piz 3EFSFB2/JtkRcVVD6Z9r+20285Hwa6Ld+hkIE0KdPqfQIWPx1LHFqQRWRbd5jYwYgQ0hCk D7Uybmm8ivt+d7Nw36Dd/fdUpjmxrKe50jQKnUsWA/G/hpL326cX29e9swjbxdyHI6U8x0 O4tonsHRTeVqJn8HIWgwbHUVIQNAsJCMgiIzcgklELUYuRTFFNuybOVoGVukAuy2kF6GqF PBAN9GpmV4meozH1Ll/CnHhRWraiGenm4GAUDbRzxvd9jCxQs7dgN6/MgmjA8w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670235418; a=rsa-sha256; cv=none; b=bRzokmdMFLNujM+TlBnd+Y50srfMD4s3ibbsoShUICGucYAVoJLRNHx7DXcpUMjz6Dzxz5 gkO57Jpq1nth6B4Ggx2wnBBbFbSHF04JWuxbbcuR0ixOZGp/AapfVSYiEkEv2B/wFzUJnv MLFonPVZxhy6rpjARXi8DbDkJRXa+2FpX2NJB1llxiVcQIlju6NeG//er4M4//Rx9hVaNU hozgpzIC9cERvCsS1+2hf5x/4+cFb7C9bkOco4PLA7B0S1HBcNtxxLJc0ZR6dU0g6vVca9 LrT4sznp6qIPRpCliKRklliWwxH1Z7VOzhS0Oi6qwaKAX8GexCZkLbP/5LReWw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQfbt4ktdztHf for ; Mon, 5 Dec 2022 10:16:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B5AGwg1062263 for ; Mon, 5 Dec 2022 10:16:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B5AGwDA062261 for fs@FreeBSD.org; Mon, 5 Dec 2022 10:16:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 10:16:58 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: diizzy@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Daniel Engberg changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |diizzy@FreeBSD.org --- Comment #5 from Daniel Engberg --- Related, https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261808 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 16:52:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQqN35GSNz4k8Vb for ; Mon, 5 Dec 2022 16:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQqN34415z44BP for ; Mon, 5 Dec 2022 16:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670259139; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rkCgEJbWuwr/STfUYrp53DBzuLipUzxe0QprrEQJywQ=; b=Z8pCWTMl1Q83rp1l/Rs5rvAoqrHAtB+2Wa5GH7ftehFXFb0oGBG17NWYkaGSxYcci+Q5tu FYREMBxystgVH3bL7ePiXF2ODTUGKiVItDnPvZNPpds2yQu7sYtCGJk6a51NLi6/rrEuxq /FJ5+eYy61qzOXpPukSRThW3mKfb35szaQ9XWBCkRN6SjHtMDfTei+OtrRXw8tB+VkANt3 PtQhFeYQ8RvHnv7ldajKudr61n6wudiJMPc9/S3bAbCLlpvfYmIFttU+wXS8UrvVAmWExr 1L81lHUEmq68vwJlBh3rWeuTTwDU0sLiKAUtMsZPLWoFdqtyq5fh98/jZJWN+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670259139; a=rsa-sha256; cv=none; b=IX2ImG2zcYxt/3sBVK23TnSUDO0UpAmkOx/o6fHm9Q/qGYOhmFTXXnpLJH5P+5abvVc3nO JODoUG4LZP35PtMrRn2Ca9m6N+YIhPxnjv3+gMnmC9WvQ8DVfoFQOO04lnK7c9zqgA7nuo UZHr2AoqwFKPJizGcfSXs/Oyq+8UWR1RVX+dsow1lORSj2PACfuDYCkOZX7t0ZziRy4oZs MBxS21qz/8dFxivoHs0bk2GHNSpgkS/hmrwpJBa7wQQjj/F7B6XsaRo0AovWdQnV5v6D+V Gc95ccWEZ4fe+dYolVkvoaahUyZtuSGyG3v7FgAhND8SAdzeK+aqNLVcLJfRcg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQqN336l4z14ZY for ; Mon, 5 Dec 2022 16:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B5GqJl2035238 for ; Mon, 5 Dec 2022 16:52:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B5GqJK1035237 for fs@FreeBSD.org; Mon, 5 Dec 2022 16:52:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 16:52:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: barneywolff@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 --- Comment #6 from Barney Wolff --- Does appear to be the same problem. As I read the zpool_main code, import -a processes cache file entries sequentially, so if one import fails badly, others will not get done. One brute-force fix for that would be to fork for each one. Presumably there is already code to serialize updates to the cache file, as potentially multiple root processes could do imports simultaneously. I think it's an open question what import should do if a vdev doesn't exist (yet). It might wait forever. I don't know how usb signals that it's done, = or whether zpool import can know if there are any usb vdevs, so always waiting= for usb to finish doesn't seem right. In my own case waiting for root mount would not help, as root is on the sd = card while I want usr, var, home on a usb disk pool. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 16:54:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NQqQP0RYwz4k90B for ; Mon, 5 Dec 2022 16:54:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NQqQN6R8jz46Mx for ; Mon, 5 Dec 2022 16:54:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670259260; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ThrKPpApg3VkLAEIS0VPYjD5Sts44bvKKd3DghVpV7k=; b=r6iBKFvisv9Ov0SWzpprSWrtSK1+IgSotpQtPp4dzcTNenFo7X08VR1UVYKwoojJvTdJMg PtUDiftbFw566G73PXz30bh9tvUDOKCVp05KsOtVYkwV319dObRWBtGgAOVI6WK7j408iL 3aVa52QxKN4OT2Tv3BHkbvC6DEUBEN2XjS3qNlVMXRWEAsVbq9opizmX1z+xQrJPuhHBic e3067Nj9A7q9R1UuyBdZcw5d5f+XHC9c7rpeX+056zM3F6IZ5aRSclTQReAxwyzjYXcRCo Q/k0O082c+qs/1KUhO1YuRm+qIIQubNoJm69b34jFu8Pw7fC8NSA/FIZjf8uzQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670259260; a=rsa-sha256; cv=none; b=M04avGODmXisiuMF3ezlvgy4kpkS9OsgSFYQ1hZorXQIYkVDCxexrOuQwG7tIbohavR9cr 9UQn96Lyt5sdhSwXQNEjroAGZ6E0nEBRyf7Bhe7n6q/A4cXHI57xOk6gvSU7ZiaNwfZV8n J1pl1j1vJ9znYFjS7QiFcOe5uMfqYajAaF+YZc7PjbmItegXLUq2TYtAIyOBn9czsD72o4 oOIcWcSRlU+GKiUkbIixeT/5tzw7WXVo5zwpD5xpRQ102IgFA0a2fgpt1e9JEFCopzLsgo KGpTyAk+ne9tmQnfULsFhULff9ZRMlE8aRh0bJiDdKdnaAMa3VVCa1COtvSXYw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NQqQN5XPbz152s for ; Mon, 5 Dec 2022 16:54:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B5GsKMd035938 for ; Mon, 5 Dec 2022 16:54:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B5GsK9t035937 for fs@FreeBSD.org; Mon, 5 Dec 2022 16:54:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Mon, 05 Dec 2022 16:54:20 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |hselasky@FreeBSD.org --- Comment #7 from Hans Petter Selasky --- There are some tunables and sysctls you can set, to wait for USB disks befo= re kicking init. --HPS --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Mon Dec 5 23:31:40 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NR0F15D1sz4jvfx for ; Mon, 5 Dec 2022 23:31:49 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "fuz.su", Issuer "fuz.su" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NR0F068tHz44Z1; Mon, 5 Dec 2022 23:31:48 +0000 (UTC) (envelope-from fuz@fuz.su) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of fuz@fuz.su designates 2001:41d0:8:e508::1 as permitted sender) smtp.mailfrom=fuz@fuz.su; dmarc=none Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 2B5NVeks034127 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 5 Dec 2022 23:31:40 GMT (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 2B5NVeFZ034126; Tue, 6 Dec 2022 00:31:40 +0100 (CET) (envelope-from fuz) Date: Tue, 6 Dec 2022 00:31:40 +0100 From: Robert Clausecker To: Pawel Jakub Dawidek Cc: fs@freebsd.org Subject: Renaming glabel(8) labels Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[fuz.su]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NR0F068tHz44Z1 X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N Hi Pawel, I've recently had the use case of changing the glabel(8) label of a disk. I noticed that there is no supported way to do that. What worked is destroying and then recreating the label, though that requires first removing all consumers of the label. It's also rather scary as there is no documentation on whether destroying the label and then recreating it would work. Is there a better way to change a glabel(8) label? If not, could you implement a command to do so? Thank you for your help. Yours, Robert Clausecker -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From nobody Mon Dec 5 23:39:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NR0Pd4j40z4jwRZ for ; Mon, 5 Dec 2022 23:39:17 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ua1-f53.google.com (mail-ua1-f53.google.com [209.85.222.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NR0Pd2Jvnz45NH; Mon, 5 Dec 2022 23:39:17 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ua1-f53.google.com with SMTP id v21so4457630uam.1; Mon, 05 Dec 2022 15:39:17 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=PDFZR7sLZCemELZIX2ZY7KM3RQ3s5JmMo+0PWUs3nkM=; b=JzjFxPq0ymQsO7fE9cPnpVe5VOA9RvuGQiFUUFIyC/CprUQlaEyh2SkAVaLyx7tnqa /5hd14WlzFnCEHHUqc5IgdrE1J2axpg89gWlI7Y79qQRCWAIN73YUoX/sX/G88h+ecNh X4idf1iFYAv3o5wNrENv4s6rbUs2+6OujzdwPb89gir01ICM3W9F+zrb0d+8aRdESXFi DC9IMsfjN3ItyagBAJDr4b5D2OsrtIQfH3E+prsBajb+wk3WDPZWRzjAbL0lHSZW6wEB 2CWHXRp34rNsJ0Kk/d96xDdnF8vXDeLKAKvhs+Ksnyqkv7Z7JvIoIV2zEL299cloofBT 0jgw== X-Gm-Message-State: ANoB5pmHwiZjQcz0SUoaxegl6A3Jngus/6Vns2AvrxkmgE5BbKB8RU8L IPJv9WNaxNoiYF0gQ5p9tiM7P+RRJQdZyZZTcqboFomf X-Google-Smtp-Source: AA0mqf7lsJX5aHWOmdb7bq19luUOYkLFMZC5GN41vngRobx+GhuKs3rk8/I0YW17AuD66pSJVHFy6HMx0V85NIdb0qQ= X-Received: by 2002:ab0:a88:0:b0:419:d115:2773 with SMTP id d8-20020ab00a88000000b00419d1152773mr2016393uak.29.1670283556003; Mon, 05 Dec 2022 15:39:16 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Mon, 5 Dec 2022 16:39:04 -0700 Message-ID: Subject: Re: Renaming glabel(8) labels To: Robert Clausecker Cc: Pawel Jakub Dawidek , fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4NR0Pd2Jvnz45NH X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mon, Dec 5, 2022 at 4:31 PM Robert Clausecker wrote: > > Hi Pawel, > > I've recently had the use case of changing the glabel(8) label of > a disk. I noticed that there is no supported way to do that. What > worked is destroying and then recreating the label, though that > requires first removing all consumers of the label. It's also > rather scary as there is no documentation on whether destroying the > label and then recreating it would work. > > Is there a better way to change a glabel(8) label? If not, could > you implement a command to do so? > > Thank you for your help. > > Yours, > Robert Clausecker > > -- > () ascii ribbon campaign - for an 8-bit clean world > /\ - against html email - against proprietary attachments +1. I've wanted to do this too. And also I've needed to rename gmultipath labels, which also requires destroying and recreating. From nobody Tue Dec 6 07:51:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NRCL43HfHz4k9H5 for ; Tue, 6 Dec 2022 07:51:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NRCL42BJ2z47pB for ; Tue, 6 Dec 2022 07:51:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670313116; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gDv6dvR/zZFC7VS5P7L8M1ybbw3pQSyEGaGHlmf5HJE=; b=HPZlWgHvU5AV7GNRbYI9mvzPpKbqZlJd1H4Aj4cabWM1Mvo/+wj2GwVPZbqdCWMpA88jAw oU46YAHTYkSl9wIOM0OMmbmcBm20w3zHJPTdJ/AcqB+kqldWoYQG5kydhSpNuFFN0R9yvK qEUvEN+XcYLrBTtBPmKuhqvaaG+Hg3ts3POVeb6QR7FLpWd1G2TsJ8hM1grqpcOiigBODT hzL77VmZ0f0iHpQbx9CL9mkF5YhPyKepRo2ZNvqoq8uIUfAwmx9RtYjdEtTp0SdeXuagOo DGxLng/L77FwBqlsHEIMwXH4MxAQYVzRvRUYPtjW5ZBQoyyzo3GndrT4L7EVNw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670313116; a=rsa-sha256; cv=none; b=S3xvEtHg119ELe82h+khXYQ78uD5NMwT7uKk+E2U1sYD+cUFJTkCWMQjUxJgeQd+M7qWjs 59wa9qhTsgc/7Eavrp1O5/uJGvb59RzYkqOvGVt6qm0Mo6tzt7ixjBMtSP4k7gOPD5zSO1 NHhXg5nmGlqw2RQe/kAsYRRHwbfk6d/nNil9jPpMsO+9SuruUzipl7R/SC0Q67Gcw8WjyZ hpn32KkofDrjOHYU8bKTEIQkUkX7l4GaAImbs1kLW5rcXa4ysZx4W2nztNV0YfgfAxdLgp tx6u9JpVzE4K5MomujRvgdfT90YHZQsf2q1iEVHeQYV5dBYVmi9ItlCsvyrRsQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NRCL418cMzVVr for ; Tue, 6 Dec 2022 07:51:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B67pux7053400 for ; Tue, 6 Dec 2022 07:51:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B67puFh053399 for fs@FreeBSD.org; Tue, 6 Dec 2022 07:51:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Tue, 06 Dec 2022 07:51:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 618 | |08 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Tue Dec 6 07:53:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NRCMf0LSTz4k9XJ for ; Tue, 6 Dec 2022 07:53:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NRCMd5lcCz49kv for ; Tue, 6 Dec 2022 07:53:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670313197; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lYkpmGI7j0OKt6/JlWSpl5+Jm+W0YZ4ZGoRX4aS/a8k=; b=JTCEVCSjpUdk0KU8m6LmzHNRARgc2ogUfQV5DgjexlM139dFefB42QJ6j84+nsUGjbQ/fZ guANI/9O3ZQ0nMsGBsPjAB6/OxPNee+na646uljTve9F9gRTJwfb6Jzokz4Oo3oS2CNop0 aaFvygUH7riLdcNOjAPEO+jY5sYKeSTJkFROhY5v6t9tuKelMfH3JRXMKmhuxogTxwZysG fQZ5BnaTD+F1tqmnx/JCr+jZieJ5N4rCyCPu6XN21A/UkefKGP7eRwoHngQf2S1koubRJ0 qsx5SvnoREfb+t5pjO7N+n/758eCP+tg/HveQh0rcvlz8bjwwCaQoMcFygGoCA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670313197; a=rsa-sha256; cv=none; b=L4ARBnloOzQuoNVbVy6sMGrSLff/LeA8syxelQV75F3Ba7c6KEC25QpiPdF/aC8AZY/s87 uvG20zbr94Hh9yPyVg/CN8EZFJD6INnaP/YYUXRt4yntX/T9Pk1/h2XjMUCdPMowBmYmsG VHllmy3z595ia4fOwaABmKi7EqV8/maNd3KbJ+gh20ezH6dqEyGW/pB8kBtNcwpBkDJbsg E/SGAwOvpRM7ZOq5mEMp9lBHnk2ZLd/lnq36Gaa1KKcHTmQ253zfn/LV0koKh2GUAYKmPL v/ZTf1YnNhRSFfx6AcR91NIPrvB3sC2/N92fP3eKb8weL7v7iL2LOnD+8DpM1w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NRCMd4kZyzVMf for ; Tue, 6 Dec 2022 07:53:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B67rH0E056050 for ; Tue, 6 Dec 2022 07:53:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B67rHd6056049 for fs@FreeBSD.org; Tue, 6 Dec 2022 07:53:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 06 Dec 2022 07:53:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 6 09:25:24 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NRFPx2PYZz4j7kX for ; Tue, 6 Dec 2022 09:25:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NRFPx1HBHz3CN1 for ; Tue, 6 Dec 2022 09:25:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670318725; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VCIhQ+XjwdUa/KWYTV1vSeeRYNUZIPG8ld8VxkXYkR4=; b=ClrzetZzp34MmkdOjxofydfp7cj71jbp2aqA1rCMdLA3lu927rQR0ukqizajLPs9DJ/YY7 f4Yif4TNGESY/p0JhfqGfDSUuIjQBIUBmhT+xUbzi+qHmipKi44hY70ADMs67id3uCQW3o OQGCIk7ypO+tvdx2Cdj4XB+VyXj48HoXd+9r1s9t/RiMHFlfNaBzXDOht6Jx0GsIhDQAnL EqfptXM8FuMRk3IbazmfT97g0zNXalzlIUIADdyuwOX2y/a2pupVZFkJn6OET+OGguYTrV n50fPRU28wFov3VNoUgArLHrQ2FyaDdtOAJU+epf52bN63rVAn69sxmde3Iyfw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670318725; a=rsa-sha256; cv=none; b=J1NvWrStsAuxXYseZoagsd6cP/5dGB5Qq7ZXa6CNbho3Sn2IEFtlf59pDGZkIrrbf1i9gD VgZ9GsXQaR1+bj3bxWqmoiVoMt1w7HNX6QtSDXasWodNNVYz98vyroalBgtynlk3lXSgg4 pPkHKVXNDiGbgHqCIYb6/tbY3tA/GR2BwHleS48oYBGolSmbyeqPyMoZhSQ0AAeYqN0aSK 7XXgeDlHYUbbVScrXOarDXdTO9hAPOGO52iL7dpM11LslTKvZDKmqy1vUIC4QVq+DZHVNh RdJ+Rjr34x84lPf38CvWGSuGD3+juVWnSqsva1ui7GpxV6HC0d22OGin6jOwzA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NRFPx0F9FzXbq for ; Tue, 6 Dec 2022 09:25:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B69POKE003981 for ; Tue, 6 Dec 2022 09:25:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B69POI3003980 for fs@FreeBSD.org; Tue, 6 Dec 2022 09:25:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNjgxMTZdIFpGUzogcGFuaWMgKFZFUklGWTAoMCA9PSBu?= =?UTF-8?B?dmxpc3RfbG9va3VwX3VpbnQ2NChudmwsIG5hbWUsICZydikpIGZhaWxlZCAo?= =?UTF-8?B?MCA9PSAyMikpIOKAkyByZWJvb3QgYWZ0ZXIgcmVhZGRpbmcgWklMIGRldmlj?= =?UTF-8?B?ZQ==?= Date: Tue, 06 Dec 2022 09:25:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: titus@edc.ro X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268116 titus m changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |titus@edc.ro --- Comment #2 from titus m --- seems to be the same/close to as https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 patch, etc at https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368#c4 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 7 09:49:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NRstt3HW7z4jP0Q for ; Wed, 7 Dec 2022 09:49:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NRsts62FMz3F19 for ; Wed, 7 Dec 2022 09:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670406549; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=weEl+je9dMjWHD9A5UM8BinJBgfVLyH0su2itqhTKfY=; b=j2gYGcDuuYNUSfiTgDjl33LSdzG3KgQMjjgR+Tx8NYfiOmY9s8rz6FbVKdMiXPW7vYRMKJ WjKFIWmZEkeHbiTH5Bb0qT40PpMseuGnOffPcZ0ORekVKgELhiBBxg6qBjGzeZ4QX6Zn9B qzgqeT9uZYe0Fw5iMKdFvcQ7QpDHM+HqVuAUSROes4Tg1PC0eStzv1pQ6AS15HXh9Le6zA SgE7hRl/PGjx0KVnRXpJOtgNTl/tbidjOS5U6RKhk5FAsXOXfZVzqoYlNdozMU9soNwq8i Ge2yS1l9uZYGeqNuAEf8duOOt7V8QktqAtlWHnfgMQ22lvjuC7LgsaaeX0WhzA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670406549; a=rsa-sha256; cv=none; b=GDda3iInhJNrrIn0UCz24d8AS988PsU41YqlrtXNwodRBXbrOE5snX8C4BT3Jb5Syl7geA Z/Cd3iIDRB9uFb5bP2Gsv8jhv84hokMKV9QGVLd2qNYhnP4u9K615Og2TWKT+LUatXe3Jf S6rfHC5nroLEPk9lCXT1Wr6cpjo/NBeYrZYJDGHidGP2xqfKURiPxtR7AJuHUIDdPAQhYy QthfbeVAe9UprbooNfUNbVrUmczIfPblgMg+ilvxD1jbHIDu8Vykz3WWU7PMMIsZEkoGdV pv3DtkeeLJ1CHQ7ghosS9P9atmNXv2vQfVK3jak95vJjpfbMiGw+IxZ3coF+Cg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NRsts514gz1Bpt for ; Wed, 7 Dec 2022 09:49:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B79n9Jl007288 for ; Wed, 7 Dec 2022 09:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B79n9en007287 for fs@FreeBSD.org; Wed, 7 Dec 2022 09:49:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Wed, 07 Dec 2022 09:49:09 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: diizzy@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 --- Comment #8 from Daniel Engberg --- (In reply to Hans Petter Selasky from comment #7) Examples, I didn't see anything obvious looking? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Wed Dec 7 23:50:57 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NSDZB01Kmz4k9wG for ; Wed, 7 Dec 2022 23:50:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NSDZ960VYz49Fc for ; Wed, 7 Dec 2022 23:50:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670457057; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AKOr9FixzWik3Hckacn5fOatIWwQE+NoWa7yVylp0Uc=; b=OJf162gBPJymrsj7d7LLTf9xJhiaH3m6hAXijbGSl0nQ/+Nusf6LYZ9eIQavRkiDPa9T5/ E7RVMlOyS9mJonX6/+dCILMDwf+LVM9eY86k2U2NdpeduJnlVJjh/DIiOakQzWMV1vu3Rw OcviiWdLmQP7MJL1ODeep70FUHRr/2iWDG2k+R6hKw+O558aqzUECcZl4ECS9y46TqnkM4 ls/INjOXpOZQn73IaiWPlm4yXEZmUqmfSn9aHAIo0/3Hk3Bt2WFRGCOgWKRIfCZ3AQtjp8 imX5/RGEaKxlQcrHXYR1umhgKRhCZO7bXmGriB69fyiaIFfbIwTHDOIomFQmYA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670457057; a=rsa-sha256; cv=none; b=kMFFKB12dbbGOl/Qd0TCi6GKoUi/qlhb+MZHlTGBzVszLAlrCdnNmHwIw9g7AJjftSJAMu inwy8LGDfl1ifRf8LP362NeOjWcYS/ilFBHUnFbVCaUAg2WyOo08oBjMqb2atjQie2A96E Rs+HfYnimayinsx/nAmmEtzFL82+LOg4il/eDj0+QzoKE/DuLioC/xF8dlrg346p1yfE/U 4Q++TmkhZPeSPj8wczApFxJDorudIWGLRZZT1YCjkrgb+Hv80Hh2DjwHoiW8HBwwR3I/e0 DWWZnAoJp/e2D1V1kd7ZnZpMtRhCOWOuTwDnlw+W+XHzTsabdD9jzzDPnB0w1Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NSDZ955F2zbJL for ; Wed, 7 Dec 2022 23:50:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B7NovCs030791 for ; Wed, 7 Dec 2022 23:50:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B7Novtl030790 for fs@FreeBSD.org; Wed, 7 Dec 2022 23:50:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Wed, 07 Dec 2022 23:50:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #9 from Warner Losh --- It would be cool if there were a command 'walk the usb tree and finish all exploration and return' We could put that in a script and enable it on boot before zpool import :) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Dec 8 00:24:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NSFJY58kHz4kFX2 for ; Thu, 8 Dec 2022 00:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NSFJY3jr3z4H3k for ; Thu, 8 Dec 2022 00:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670459053; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wR4Tfg1+eX/pW6Re9XzwZWRYpUm5DTxzL7a+6hmBRLE=; b=JgKMGr06o8FX+t6bfu01m7n1W94tzgB+5s9wOdwqczmoFOxIw8ZTPcRMqS1gOMjj3xKENy HYvVk4tfcb1eUmhxK6QWdELFAnFU057Amdl/q5CoZAqoexUVRsRRCjXnoNPpyAFVxj+IAX +e8wsjmfuD59xncqGukWbNsWvxySZpmPxfkdOBay2013/J2DPHSEcu2DBtZ07zv1ddzsRU zFJG1ryPPpl06ta2UydFv/oK2tPFUDh7IpfbXUMzDFXMIrY2eEuyLmE6pNI7mKFQuu1Z5W sfjcHlBImBO8bOBIJjqVh/6rtXRPIcqrCdw9f0pC1QIEks7fqY3InzZdGb4IVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670459053; a=rsa-sha256; cv=none; b=rdLiUx7EvqKZ/zhKr/OGLyQcI58LJEmMdt41w3QnmrzO8/x7RRJ3ruCJo86JL8f0k3pjdg tdyBRuzYDIx/78guMULDRopjeDT0kFUH8VMW7VAmLldrvPL3cCPBvUnsb4pKLjZEezNtGi CDGtNWedcTGyVhgTeSVeMq2PFF8qjyhN44TsIqyuwl6ZN/vZfyoJ605wp01oHjKp3j6fZP CXrf0Tz24GUJq3spN1ceNpT5Q1zJeCIw69kQjI7rLyxRIqDsLbC2OsAEPDmgk6oOlPGigj JmXGCbfbTkRosxrCa2R+YYsNN5F5U839uKeRR1kOhE/UuiRjyvXZ9PKLjUThBA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NSFJY2hjmzbbg for ; Thu, 8 Dec 2022 00:24:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B80ODs8087159 for ; Thu, 8 Dec 2022 00:24:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B80ODVJ087158 for fs@FreeBSD.org; Thu, 8 Dec 2022 00:24:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Thu, 08 Dec 2022 00:24:13 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: junchoon@dec.sakura.ne.jp X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Tomoaki AOKI changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |junchoon@dec.sakura.ne.jp --- Comment #10 from Tomoaki AOKI --- (In reply to Warner Losh from comment #9) As rc.d script with (if possible) configurable timeout? --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Dec 8 01:06:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NSGFh1tjrz4kLLY for ; Thu, 8 Dec 2022 01:06:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NSGFh0tFCz4PJZ for ; Thu, 8 Dec 2022 01:06:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670461608; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kXpn7oEgHIEGj0iKbRM4mDgIAxSRxWVHNpIP6oKI+pU=; b=sZflhZAow97hnRWOjUV5LCSRdPkzAftBjyn/n3D2n2VbO7eGM6oVzUqHNEhpnjI6YzqSGX mtS0QiGcuC2f7zNc5rg2VLd7Zy2sCCBzcVWpEFAxeuaK5osiz/IR/TPvWCy+1CpBnTiOKY PG02dYe3Uo2gu7v3Q+EHvRqFns6YFjwzMnrd31BQAlt2Ae6xgaxHPndm7S20OmvaigtVHS G4PmNRretNsSC8ZkV6g5WtRwWafWOjA3qr50uAMe09NPx8HER0odb8aCGjEdcMOvAGlfQQ iO/zmA8PMRSQSudnZN+GRuqHyqptr6hCrR2CIhWnUBizh0TGHCEtVCI8gdQGWQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670461608; a=rsa-sha256; cv=none; b=vBkADkvRrvnFruStHMclaVTpf6vUcjSQPD7LEETV/ATVef4YFpCLrnirpScfHgzb9zAmCz Y5zvPqO237Xp89tU226mcv/bjAeFoxBAY2USd080qYGoA30kHIkzFrrTgR1S8vzY7NTaQK le3yfUL239wezrbXdqwpvl6VmVIv4UgLj2Kj7kByV5+DBcpljUW8ycAYt17g2gALi2Y3Xj svHC0QMFSszkpMq/BD8PSJUwnHaH0Ycew4v+0v4Eivj8kSfkP2Za23sQlo/A2HxtAvRH+k N0Yi58WxSSiwBkKGqrJ8+/3GQLRxHPXnRI8IcnJtdrk2Dg2CVGNR0I/lQOTmww== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NSGFg74R8zcw4 for ; Thu, 8 Dec 2022 01:06:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B816lnS044918 for ; Thu, 8 Dec 2022 01:06:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B816lh3044917 for fs@FreeBSD.org; Thu, 8 Dec 2022 01:06:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Thu, 08 Dec 2022 01:06:47 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Mark Millard changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |marklmi26-fbsd@yahoo.com --- Comment #11 from Mark Millard --- (In reply to Daniel Engberg from comment #8) Possibly: # sysctl -d kern.cam.boot_delay kern.cam.boot_delay: Bus registration wait time I generally have /boot/loader.conf contain: kern.cam.boot_delay=3D10000 because of some history of running into an issue that it avoided. Too bad no units for the time are indicated. ms if I infer correctly. I also use: vfs.mountroot.timeout=3D10 vfs.root_mount_always_wait=3D1 but those would only be indirectly useful for other media -- and possibly only if the root mount was the slowest. # sysctl -d vfs.root_mount_always_wait vfs.root_mount_always_wait: Wait for root mount holds even if the root device already exists vfs.mountroot.timeout is not in sysctl. Again no time-unit indication. Seconds if I infer correctly. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Dec 9 12:18:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NT9640sPbz4kQ9Z for ; Fri, 9 Dec 2022 12:18:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NT9634VFyz3scb for ; Fri, 9 Dec 2022 12:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670588299; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xFz24+xU9jLB+RVbFRqrYfeDickMEhF0bDIwqJFdfLQ=; b=IEinXOMmAYnhOpucacCE1MsvVnvLW+3jok+qjdNkt7wtj1LDtHGEIIdB8S6bKCYEH4w9p6 wo/2KqekE88t42A7HZuEXMgCa0zodK1HVidWCytxutLWELV9e3OqP21tx5S5Pu3tks4EGY HP+vZybgWVVWu2MZSe/K+dfARIc5KkpylgzLSm71/5eENrNBYukvN6vgXI9ImaTtR7l1fk H0jFVjiT+ALMHw2TsEDhtcrJBUqRkIAiMBw8IiYJN4XDHiSgXAXZBF8s39a5SFLhy0XYOu hHHIOcl3xN/EGv0KhvDG1P8dl7b99ZGe48KRbj0sVpgBgTsoTy/+CVVMCudcAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670588299; a=rsa-sha256; cv=none; b=sT4GLQMV/csbYIyvVFOgwEHF2uS5hptiHBzoXPg+jiL88Fscg+g7jAFXdcS23sfc95OQly 12y2MZvtisBke92G1HfPEERLsDZaQW8s8psh1M0VO3aq4F2UEyzLCopzVMaLgaJiYcQsuS gTNv7sr0LQWBqUFv7FgJQib6333X9mRoLnaqqNcigWgAkXenMHiwlFomZNEAiRSGu/yjKV N5Tsity3CheN8BN7GyR4b1K8ic20x8yMqoYrvMVhkdwFkUwEmNwDroO+34qMILu4+6449b arZPRifxlcn8yne/3ZmRR0MV2e/dl+YgYmpTsVpOWjE/wJoJg6tRYC0d3e0Ykg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NT9632bggzbRC for ; Fri, 9 Dec 2022 12:18:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2B9CIJm4035487 for ; Fri, 9 Dec 2022 12:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2B9CIJ29035486 for fs@FreeBSD.org; Fri, 9 Dec 2022 12:18:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 223015] [tmpfs] [patch] tmpfs does not support sparse files Date: Fri, 09 Dec 2022 12:18:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223015 --- Comment #12 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D37aea2649ff707f23d35309d882b38e9a= c818e42 commit 37aea2649ff707f23d35309d882b38e9ac818e42 Author: Konstantin Belousov AuthorDate: 2022-10-20 13:17:43 +0000 Commit: Konstantin Belousov CommitDate: 2022-12-09 12:17:12 +0000 tmpfs: for used pages, account really allocated pages, instead of file sizes This makes tmpfs size accounting correct for the sparce files. Also correct report st_blocks/va_bytes. Previously the reported value did not accounted for the swapped out pages. PR: 223015 Reviewed by: markj Tested by: pho Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D37097 sys/fs/tmpfs/tmpfs.h | 18 ++++++- sys/fs/tmpfs/tmpfs_subr.c | 118 ++++++++++++++++++++++++++++++++++++++++= ---- sys/fs/tmpfs/tmpfs_vfsops.c | 6 ++- sys/fs/tmpfs/tmpfs_vnops.c | 17 +++++-- sys/kern/uipc_shm.c | 2 +- 5 files changed, 144 insertions(+), 17 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 10 20:08:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NTzTs4nsrz4kLg3 for ; Sat, 10 Dec 2022 20:08:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NTzTs2KTrz3pgs for ; Sat, 10 Dec 2022 20:08:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670702897; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AU1+xqT/RqWNNJEIoGUe1WuhOnG9Voc07Y6GxXhJy38=; b=Wqj8697BtYn8M7pelEYKBjEmuuphCVjRxxmr3LstwUjrV05xsvWPmRBP0ew8Pi1sKNxXj4 BuskqpfAl2/hj23YN0DE5DVfdAKAY6jA2YDIq7l5rp/D5/TD0zX16uXwrwwixCG86EKSmC o1JAU5/Dr2tHbA9YFIuufqYEI4U4O0fhosWL0CqiRPyxylzcxpgXE+0KdFiy4PWMeCxeId CiRJU2FudhQc6qwszyDIPTnHK37keqGG+QcZFoAz65D6tV40RWUypr+ZvJKuXktaRSrYce A+EAHmNqJ2LT+Ue5FutpFeXN8/fzB2j/Fz8/AjH3s+uimZWXGYhkFnQJuAgQ+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670702897; a=rsa-sha256; cv=none; b=xfAICEsdDWKZMebKxar7y9wiTg4EW5peS5zsVrmY5eUcGCCHUv/YFCN45WcfPOZ9RhrfgU KA7JVBNMEU3xUdNAgIJ2acz0CGeT1Bti+HYLyx0ObHKW3rh7eEwtVBsyuPywvKaAE7xWjw q5RCDaTSugAtDtauSZpiYdklDbkg1ym4B0hhgloi0AUEIWGd8Y7JnkFjRuipVl0WnUpwBH cXAZgNWW1k8OWrfVqM/x7Y2lFIEJUwZfRSV989oPrPRPzSlZsq6BefEz/aGuW6ney7tjYH aViBxVcSQmPHVDuuQhJGwtJVI9dgQvMWCr1cYjzozbTz0ULLTVofdH30rx37xA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NTzTs1HdBzT53 for ; Sat, 10 Dec 2022 20:08:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BAK8HPK056214 for ; Sat, 10 Dec 2022 20:08:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BAK8HKr056213 for fs@FreeBSD.org; Sat, 10 Dec 2022 20:08:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268157] /etc/rc.d/zpool runs too early, before usb disks available Date: Sat, 10 Dec 2022 20:08:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: usb X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268157 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 563 | |95 --- Comment #12 from Graham Perrin --- >From bug 256395 comment 2: hw.usb.no_boot_wait Related (2009):=20 * * * --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sat Dec 10 20:12:07 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NTzZH6Xk6z4kLj2 for ; Sat, 10 Dec 2022 20:12:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NTzZH4jdqz3qvc for ; Sat, 10 Dec 2022 20:12:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670703127; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pl09DgQwPAQrZCEToY9r4VxYofFP5MB08cwiajnYq7o=; b=OOLh0qnd5+tlSO8+Y8uP2j766JgMq9oy2tlqn/2VKAkTfYkBAl2ggZKubyikAJg29bG1c9 zF+l4K2oU1VQyA9qcT1rYwCAYOCPLcGqj7SPaEedv0Aobwr6UbU5wa+v/r3NUfPQnzLzUZ JZHw3E+DqwQnexWqSRwOOja+XgtFiWpRguco3mY4R1ISZ8aiOVHSwprxuLdjQcHQbwla2v 81G/LopflqseO0bNgtHclt7IHH4elhlss1tdntZQBAqfcVZIjyk7CIUIlb+gZyYgbpSUqc KhcUgno0stiB7HmdXjGdT+O0D7sVZJ3JmaVyTIyYjn+A+ME/AsV9N/4pkJSIMg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670703127; a=rsa-sha256; cv=none; b=vn7uKens8g//3/qhR4YzRZQs4zaHD5/Qq5JHGYugspPi7uz0FQNbw3pb0H7ArlVe8f8KOA gkBQJW01FKpQ9Q0mQW6FgtPCfuJItr6Ici5b9lX/o4t0jpl/LaKIqud5qZPIMP1ixw0us+ Qpi96+6SYCIEHMzM4Wo2FGStEdP7ffb0HdKa036Qjb0EKTakAaK/SZXTX7spk+iuGBCtgM w+Hn7TqbQL4aHlSn5NzgqdH1jaPVU8VoCmTl/ZyqlpsPdh9pgKgtOIJ7x0Ye4f0KxYokZ6 NIfMBWmvlZ0nIELAWbgoTSU9oLf9RAJkToSWYqxOXcUpi9m+a1qssylu1QBXKQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NTzZH3npmzSRK for ; Sat, 10 Dec 2022 20:12:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BAKC7n1070499 for ; Sat, 10 Dec 2022 20:12:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BAKC7IX070498 for fs@FreeBSD.org; Sat, 10 Dec 2022 20:12:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 162195] panic with soft updates journaling during umount -f Date: Sat, 10 Dec 2022 20:12:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords short_desc assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D162195 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa Summary|[softupdates] [panic] panic |panic with soft updates |with soft updates |journaling during umount -f |journaling during umount -f | Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |grahamperrin@freebsd.org --- Comment #5 from Graham Perrin --- Is this reproducible with more modern versions of the OS? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 10 20:13:48 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NTzcD2QgPz4kMCm for ; Sat, 10 Dec 2022 20:13:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NTzcC6Sxvz3rSY for ; Sat, 10 Dec 2022 20:13:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670703227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PxOs7yJdCQFAk0KHgyG4DEgn6V+ZITWJngqiZD8GJ94=; b=N0XA4vzlBynCnlU9jLSKMKUywXVkC089ZFGfIDiZ/JSx3gVmuZNEahGTS9bX1i9hLHcXOj otAxXYyiiboqJ/y6K9ZKcOxZ6LcW9QBT4MMMhhpEONzo7igt6SCGctpf0Zy3cmlI5HS9bx zjR7iH3pdohi0JyHPterDRCOjlrxfgJ/7Bx/3LVtTTn7+jVZCIbu+yF+bb69veaa5cP8yU RmpxBN/FG9CkktJLx9Cvu+k9vC9mHBqhpYIzY+zCdE0AvH7C/yhvC5WFqHy0BwHFpsgRgl NpWAY6z3FTqdmoBAELEWQwnj0RFjw4B94QzjcEzsHMd48DZ/JgVfWIVZPUL35Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670703227; a=rsa-sha256; cv=none; b=DFA4pOexLQb3bdFoJpdpWDsLcUyQ5kckGngf0p54xKFSJvTsxRiDuyScG8D/mB7q9nnrHM v7jQyk7GXdk+VYedpQxq1Q4g/GFI9oDlPZEBE3ctd1i1DjCEO2OEgqVQsW72LbfhV9bsqg D8jR9QhdBC5XWuC6ME7CzDzJXEl1bmwEH5EUVMysh7rDo/0SbNEsMsQ/D2RsyocIteZKgQ RpikI+0yUV6QAPdYYrpFS8pTqFj3ptehxiBjW55AZb2bIh5siFZdC0vWaQVk8r7ERghCgG fhe7CZDXem9AdATRIfSYPDUuM0SMvc3dTKJKcB8SxTOE8IuC7fmL00v7wmylaA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NTzcC5WBjzTDj for ; Sat, 10 Dec 2022 20:13:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BAKDlXW072770 for ; Sat, 10 Dec 2022 20:13:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BAKDlrg072769 for fs@FreeBSD.org; Sat, 10 Dec 2022 20:13:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 166912] Panic after converting Softupdates to journaled softupdates Date: Sat, 10 Dec 2022 20:13:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords cc short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D166912 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |needs-qa CC| |grahamperrin@freebsd.org Summary|[ufs] [panic] Panic after |Panic after converting |converting Softupdates to |Softupdates to journaled |journaled softupdates |softupdates --- Comment #4 from Graham Perrin --- Is this reproducible with more modern versions of the OS? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 11 06:52:48 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVFnc3Hs1z4kkTY for ; Sun, 11 Dec 2022 06:52:52 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVFnb2hxNz3nLY for ; Sun, 11 Dec 2022 06:52:51 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=J9x8miPi; spf=pass (mx1.freebsd.org: domain of artemkuchin76@gmail.com designates 2a00:1450:4864:20::12f as permitted sender) smtp.mailfrom=artemkuchin76@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lf1-x12f.google.com with SMTP id b13so13508357lfo.3 for ; Sat, 10 Dec 2022 22:52:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=Sa9CINIoDBMpdKFh21Aj6Gvn+N1XBADvAp7xdwT3kXI=; b=J9x8miPiE029zSYUNVqKTCRiiBCHbsdroMkVAp643Rk5VCHyt3QNXkZpxbmDe0W2PY d3Et8XeSx8ePbXi5rUv3Sq5nIoREZoJ+Xg2JLw/gho8hsiB/bFGVMzq2AP4I6KLC6V8z QW9FzM4qhSszulfj8SvxMz3E9epYrf7Nv5/9WC9IQh+G2UG2aBXmc69JGFXJ4xwrtOXQ c32RCwmAUp0nWpRonN6zgOs3r3pUViW0d1teCyl+wR4isqcA02xOUKTvmB41nB9cyCjM k2rBPEmBM3sA4MZVysZP7doZFpe9d5c6Q8ib3GWT+RqnqRPNE/KY1DeS7lq1HqEhzDi1 gvrw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=Sa9CINIoDBMpdKFh21Aj6Gvn+N1XBADvAp7xdwT3kXI=; b=iikI0XaBlOFE15o2ndcG2q/OGpGeEN8zif4Poz/Bc6roasft5/ZzQoYIDc+ISpiDrC ZsV1b4LuPVwAD+MxvuemsfpzSOgTEIHYg7MmZplurxjtZaKKDDVLydAHjbF6GFKg9OYk NjaQ5SObZlovxf+RE1r7F+XZwnIZi2djR8E1SH8YJEwBx7oET5GAHHzg5tQstjwi7HxK HDiQ9Err+QHGTC3H3yflkYFl1Da/0SV/sQJIjvLwUrnOP2tfYLqawZYmvAql2EKD1mqF U4tFlpnA9O/tdRjrYOCvwtQtuaa8VNyjXHy5coculOkX8XliJehZ51t+QoawDfU6XzTB UsCA== X-Gm-Message-State: ANoB5pkN8Y8eKZDMWv29ocYEr3s+i+SQkICV2uVtFOrMLuYfERqwjo9/ 5qsHgW7QgCb+dGhEYm8bdgHJ0mBOAq8= X-Google-Smtp-Source: AA0mqf5CL9Dr0TTqDfPxq2V3TERRSzedzLZjOWFm7kC2WN64qlKWr4mtBGUa5JwM1bWG6RruKvYc8g== X-Received: by 2002:ac2:5189:0:b0:4b5:b705:8491 with SMTP id u9-20020ac25189000000b004b5b7058491mr1349092lfi.9.1670741569221; Sat, 10 Dec 2022 22:52:49 -0800 (PST) Received: from [192.168.0.12] ([185.22.24.200]) by smtp.googlemail.com with ESMTPSA id o19-20020a2e9b53000000b0026bf0d71b1esm827868ljj.93.2022.12.10.22.52.48 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 10 Dec 2022 22:52:48 -0800 (PST) Message-ID: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> Date: Sun, 11 Dec 2022 09:52:48 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.5.1 To: freebsd-fs@FreeBSD.org Content-Language: ru, en-US From: Artem Kuchin Subject: Everchanging bytes at the end of mirror disks Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-2.04 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.83)[-0.828]; NEURAL_SPAM_SHORT(0.79)[0.791]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12f:from]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-Rspamd-Queue-Id: 4NVFnb2hxNz3nLY X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N Hello! I am writing a small utility for myseld and part of it is comparing gmirror disks. After running some tests i realized that some bytes at the very end of disks are constantly changing. For example to runs from the compator: Difference between /dev/ada0p3 [26,0x1A]  and /dev/ada1p3 [95,0x5F] at position 495812794495 Difference between /dev/ada0p3 [217,0xD9]  and /dev/ada1p3 [107,0x6B] at position 495812794496 Difference between /dev/ada0p3 [151,0x97]  and /dev/ada1p3 [0,0x0] at position 495812794497 Difference between /dev/ada0p3 [180,0xB4]  and /dev/ada1p3 [64,0x40] at position 495812794498 Difference between /dev/ada0p3 [96,0x60]  and /dev/ada1p3 [126,0x7E] at position 495812794499 Difference between /dev/ada0p3 [89,0x59]  and /dev/ada1p3 [239,0xEF] at position 495812794500 Difference between /dev/ada0p3 [234,0xEA]  and /dev/ada1p3 [93,0x5D] at position 495812794501 Difference between /dev/ada0p3 [166,0xA6]  and /dev/ada1p3 [76,0x4C] at position 495812794502 Difference between /dev/ada0p3 [185,0xB9]  and /dev/ada1p3 [233,0xE9] at position 495812794495 Difference between /dev/ada0p3 [145,0x91]  and /dev/ada1p3 [2,0x2] at position 495812794496 Difference between /dev/ada0p3 [105,0x69]  and /dev/ada1p3 [3,0x3] at position 495812794497 Difference between /dev/ada0p3 [55,0x37]  and /dev/ada1p3 [166,0xA6] at position 495812794498 Difference between /dev/ada0p3 [23,0x17]  and /dev/ada1p3 [99,0x63] at position 495812794499 Difference between /dev/ada0p3 [35,0x23]  and /dev/ada1p3 [144,0x90] at position 495812794500 Difference between /dev/ada0p3 [118,0x76]  and /dev/ada1p3 [212,0xD4] at position 495812794501 Difference between /dev/ada0p3 [30,0x1E]  and /dev/ada1p3 [149,0x95] at position 495812794502 End of disk is 495812794880, so, the last changing bytes if 378 bytes before the end. I am most likely missing some information about FS/mirror organization. Below is the filesystem configuration. However, if there a part which changes on both disks independently how do i get its offset and size, so i will not compare it.  Thank you. # gmirror status        Name    Status  Components mirror/swap  COMPLETE  ada0p2 (ACTIVE)                        ada1p2 (ACTIVE) mirror/root  COMPLETE  ada0p3 (ACTIVE)                        ada1p3 (ACTIVE) # gpart show =>       34  976773101  ada0  GPT  (466G)          34        128     1  freebsd-boot  (64K)         162    8388608     2  freebsd-swap  (4.0G)     8388770  968384365     3  freebsd-ufs  (462G) =>       34  976773101  ada1  GPT  (466G)          34        128     1  freebsd-boot  (64K)         162    8388608     2  freebsd-swap  (4.0G)     8388770  968384365     3  freebsd-ufs  (462G) From nobody Sun Dec 11 08:22:46 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVHnc4vgCz4jj1n for ; Sun, 11 Dec 2022 08:23:00 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62c.google.com (mail-ej1-x62c.google.com [IPv6:2a00:1450:4864:20::62c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVHnc21gTz3t7v for ; Sun, 11 Dec 2022 08:23:00 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62c.google.com with SMTP id b2so20928286eja.7 for ; Sun, 11 Dec 2022 00:23:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=NVQrVCdcATQ90gtT1NZv6t/9ayUQxhPokqMq8jo0L5w=; b=lboUA1D/AeHnGuCzVg6plHbXoikMqENFZPuKnBHZ9JjUzYw4HOrMQ8zKEvUDlH+TP6 Wbutgp+dOKzkrtDB5W+JMVqHf0AcUre4mdUEe4rCp6Ltk2uL28OQrQ4j++lf/rfKBVLq j8c0S/utRxlMBkgX8wTxVUnmg2NCmQ0L0A8xMM4JtKzWwShNx05etD4ITa/wmMMgZ5yE PLoURqZsUjfOtefRIRUd399YJ3l5gXFh0X3nzaAeWIoPmtOgqyEy8KpdUcODHcpTvClF XiShQKg6zjRtjMTdqJZt4z+UXu8ejv3MXKx1oTcnYVMXF8TjKgO2GF3kTtiqhlkMYV02 tHog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=NVQrVCdcATQ90gtT1NZv6t/9ayUQxhPokqMq8jo0L5w=; b=ca/y13qtKN0c638FjVRqZpjUq/xtzEHRdZmfsYxb5taOLHVxHmpZAmPEcvXQ0cKodM m928mZ+3heDvPis/Y5DpEBOIjgrdaWkSyKmxAKdQ8QoxaXAZBc8BB0gh3UDefO3GrLtf 4qmDUXFN141FqSl86yI6PLXRIO1FDTe6EGB4gJrEM5HMaUw8xTpprG/2DHiYJ7bCi3rT QNxNeUaJZHyC5Y6tQftRuOW1qxji99qf3hkynwLqv34VGKe0BcnhaiBCJQdgxeu47h6A lwuIkArDxZWOoD0dz3Lxyv7le/FsMra11PsOaYAX5mc1+igRp7LknJSPh0mZkhrg94uP ZP9A== X-Gm-Message-State: ANoB5pmnAaaq5ZTip5ejAcBv/214o6CpC6BbxJdU+c41accCYVnTPEof PebvoAvyrU8Y098n2L/Jo+OTDmZfIRX5hF6pCcjreQ== X-Google-Smtp-Source: AA0mqf70MpjrBfYc7U/2OooRY/y+ff9YMs+OryXdLAECmXPSLHCje72vgrNghby4clTMJfR1Qek+U2fnQPxM0fyfYYk= X-Received: by 2002:a17:906:3e09:b0:7c0:e6d8:3e82 with SMTP id k9-20020a1709063e0900b007c0e6d83e82mr15854566eji.451.1670746978032; Sun, 11 Dec 2022 00:22:58 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> In-Reply-To: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> From: Warner Losh Date: Sun, 11 Dec 2022 01:22:46 -0700 Message-ID: Subject: Re: Everchanging bytes at the end of mirror disks To: Artem Kuchin Cc: FreeBSD FS Content-Type: multipart/alternative; boundary="00000000000022b48b05ef89183d" X-Rspamd-Queue-Id: 4NVHnc21gTz3t7v X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --00000000000022b48b05ef89183d Content-Type: text/plain; charset="UTF-8" On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin wrote: > Hello! > > I am writing a small utility for myseld and part of it is comparing > gmirror disks. After running some tests i realized that some bytes at > the very end of disks are constantly changing. > The last sector has metadata about the mirror and about the mirror element. It's this latter data that differs. Warner For example to runs from the compator: > > Difference between /dev/ada0p3 [26,0x1A] and /dev/ada1p3 [95,0x5F] at > position 495812794495 > Difference between /dev/ada0p3 [217,0xD9] and /dev/ada1p3 [107,0x6B] at > position 495812794496 > Difference between /dev/ada0p3 [151,0x97] and /dev/ada1p3 [0,0x0] at > position 495812794497 > Difference between /dev/ada0p3 [180,0xB4] and /dev/ada1p3 [64,0x40] at > position 495812794498 > Difference between /dev/ada0p3 [96,0x60] and /dev/ada1p3 [126,0x7E] at > position 495812794499 > Difference between /dev/ada0p3 [89,0x59] and /dev/ada1p3 [239,0xEF] at > position 495812794500 > Difference between /dev/ada0p3 [234,0xEA] and /dev/ada1p3 [93,0x5D] at > position 495812794501 > Difference between /dev/ada0p3 [166,0xA6] and /dev/ada1p3 [76,0x4C] at > position 495812794502 > > Difference between /dev/ada0p3 [185,0xB9] and /dev/ada1p3 [233,0xE9] at > position 495812794495 > Difference between /dev/ada0p3 [145,0x91] and /dev/ada1p3 [2,0x2] at > position 495812794496 > Difference between /dev/ada0p3 [105,0x69] and /dev/ada1p3 [3,0x3] at > position 495812794497 > Difference between /dev/ada0p3 [55,0x37] and /dev/ada1p3 [166,0xA6] at > position 495812794498 > Difference between /dev/ada0p3 [23,0x17] and /dev/ada1p3 [99,0x63] at > position 495812794499 > Difference between /dev/ada0p3 [35,0x23] and /dev/ada1p3 [144,0x90] at > position 495812794500 > Difference between /dev/ada0p3 [118,0x76] and /dev/ada1p3 [212,0xD4] at > position 495812794501 > Difference between /dev/ada0p3 [30,0x1E] and /dev/ada1p3 [149,0x95] at > position 495812794502 > > End of disk is 495812794880, so, the last changing bytes if 378 bytes > before the end. > > I am most likely missing some information about FS/mirror organization. > Below is the filesystem configuration. > > However, if there a part which changes on both disks independently how > do i get its offset and size, > > so i will not compare it. Thank you. > > > # gmirror status > Name Status Components > mirror/swap COMPLETE ada0p2 (ACTIVE) > ada1p2 (ACTIVE) > mirror/root COMPLETE ada0p3 (ACTIVE) > ada1p3 (ACTIVE) > > # gpart show > => 34 976773101 ada0 GPT (466G) > 34 128 1 freebsd-boot (64K) > 162 8388608 2 freebsd-swap (4.0G) > 8388770 968384365 3 freebsd-ufs (462G) > > => 34 976773101 ada1 GPT (466G) > 34 128 1 freebsd-boot (64K) > 162 8388608 2 freebsd-swap (4.0G) > 8388770 968384365 3 freebsd-ufs (462G) > > > > > > --00000000000022b48b05ef89183d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin <artemkuchin76@gmail.com> wrote:=
Hello!

I am writing a small utility for myseld and part of it is comparing
gmirror disks. After running some tests i realized that some bytes at
the very end of disks are constantly changing.
=

The last sector has metadata = about the mirror and about the mirror element.=C2=A0 It's this latter d= ata that differs.

Warner=


For example to runs from the compator:

Difference between /dev/ada0p3 [26,0x1A]=C2=A0 and /dev/ada1p3 [95,0x5F] at=
position 495812794495
Difference between /dev/ada0p3 [217,0xD9]=C2=A0 and /dev/ada1p3 [107,0x6B] = at
position 495812794496
Difference between /dev/ada0p3 [151,0x97]=C2=A0 and /dev/ada1p3 [0,0x0] at =
position 495812794497
Difference between /dev/ada0p3 [180,0xB4]=C2=A0 and /dev/ada1p3 [64,0x40] a= t
position 495812794498
Difference between /dev/ada0p3 [96,0x60]=C2=A0 and /dev/ada1p3 [126,0x7E] a= t
position 495812794499
Difference between /dev/ada0p3 [89,0x59]=C2=A0 and /dev/ada1p3 [239,0xEF] a= t
position 495812794500
Difference between /dev/ada0p3 [234,0xEA]=C2=A0 and /dev/ada1p3 [93,0x5D] a= t
position 495812794501
Difference between /dev/ada0p3 [166,0xA6]=C2=A0 and /dev/ada1p3 [76,0x4C] a= t
position 495812794502

Difference between /dev/ada0p3 [185,0xB9]=C2=A0 and /dev/ada1p3 [233,0xE9] = at
position 495812794495
Difference between /dev/ada0p3 [145,0x91]=C2=A0 and /dev/ada1p3 [2,0x2] at =
position 495812794496
Difference between /dev/ada0p3 [105,0x69]=C2=A0 and /dev/ada1p3 [3,0x3] at =
position 495812794497
Difference between /dev/ada0p3 [55,0x37]=C2=A0 and /dev/ada1p3 [166,0xA6] a= t
position 495812794498
Difference between /dev/ada0p3 [23,0x17]=C2=A0 and /dev/ada1p3 [99,0x63] at=
position 495812794499
Difference between /dev/ada0p3 [35,0x23]=C2=A0 and /dev/ada1p3 [144,0x90] a= t
position 495812794500
Difference between /dev/ada0p3 [118,0x76]=C2=A0 and /dev/ada1p3 [212,0xD4] = at
position 495812794501
Difference between /dev/ada0p3 [30,0x1E]=C2=A0 and /dev/ada1p3 [149,0x95] a= t
position 495812794502

End of disk is 495812794880, so, the last changing bytes if 378 bytes
before the end.

I am most likely missing some information about FS/mirror organization. Below is the filesystem configuration.

However, if there a part which changes on both disks independently how
do i get its offset and size,

so i will not compare it.=C2=A0 Thank you.


# gmirror status
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Name=C2=A0=C2=A0=C2=A0 Status=C2= =A0 Components
mirror/swap=C2=A0 COMPLETE=C2=A0 ada0p2 (ACTIVE)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ada1p2 (ACT= IVE)
mirror/root=C2=A0 COMPLETE=C2=A0 ada0p3 (ACTIVE)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ada1p3 (ACT= IVE)

# gpart show
=3D>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 34=C2=A0 976773101=C2=A0 ada0= =C2=A0 GPT=C2=A0 (466G)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 34=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 128=C2=A0=C2=A0=C2=A0=C2=A0 1=C2=A0 freebsd-boot= =C2=A0 (64K)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 162=C2=A0=C2=A0=C2=A0 8388= 608=C2=A0=C2=A0=C2=A0=C2=A0 2=C2=A0 freebsd-swap=C2=A0 (4.0G)
=C2=A0=C2=A0=C2=A0=C2=A0 8388770=C2=A0 968384365=C2=A0=C2=A0=C2=A0=C2=A0 3= =C2=A0 freebsd-ufs=C2=A0 (462G)

=3D>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 34=C2=A0 976773101=C2=A0 ada1= =C2=A0 GPT=C2=A0 (466G)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 34=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 128=C2=A0=C2=A0=C2=A0=C2=A0 1=C2=A0 freebsd-boot= =C2=A0 (64K)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 162=C2=A0=C2=A0=C2=A0 8388= 608=C2=A0=C2=A0=C2=A0=C2=A0 2=C2=A0 freebsd-swap=C2=A0 (4.0G)
=C2=A0=C2=A0=C2=A0=C2=A0 8388770=C2=A0 968384365=C2=A0=C2=A0=C2=A0=C2=A0 3= =C2=A0 freebsd-ufs=C2=A0 (462G)





--00000000000022b48b05ef89183d-- From nobody Sun Dec 11 08:45:53 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVJJ46jxqz4jlh6 for ; Sun, 11 Dec 2022 08:45:56 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Received: from mail-lf1-x133.google.com (mail-lf1-x133.google.com [IPv6:2a00:1450:4864:20::133]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVJJ42hkpz3vLL for ; Sun, 11 Dec 2022 08:45:56 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x133.google.com with SMTP id p36so13672206lfa.12 for ; Sun, 11 Dec 2022 00:45:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=dHaI7HkvI1TjmuLmEYHftwpHsbQTb9WB8HPobGtvZSE=; b=GGPExDhRsXmp/k1+BfiQi613hRoFBxSuFJWYOKGHmyTG+nU8Cjw65MJtYFo73oeH0G EZ/4teerzUoqVdsgL5nl7mMuymCOG6U4nmZ3uiy+iLfI4sEUeewp8C8UjXSFm87HDS7G 4SNokn7+2sIdrgAeO+P2XmB0B/gJiiVndQS7WRry9+IoheQSVA6lcpoA2jOfWR7mtwq4 88GjlyWM2uWBhIYZk2+NToxSE3nTikMQTeweWXN8H1fYi0j9UNgrTgFWObPOfBRhns5o u9yDKk3XGOku879cXhLAQGt+zs8ivOXs/QQW2f8r47sCeYDSDFw8ugB0yM7LBu3PJPUG YQPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=dHaI7HkvI1TjmuLmEYHftwpHsbQTb9WB8HPobGtvZSE=; b=fYFJE37/HqmKOlnqA81C5Ro+XA1iys/uPr33trcpz+WQis340t3j59lpTANSDH2HEy 5rRBRvyZv25IlHZ3CmJjEdQCwE1ZdzZP11SqBkNWj2i5C8Ygiu/PCmz7e2Y+Bpim9jJQ rrHoRCEt20ALNbUW3TQTafom2nnvSyWrlJSRjCTJC1bPiPbY41ctdxiW+e9mvWvrPfNQ x/Qt2sTgOHo5EehHkJEUo2ofSg2HloHDZqE6PTnYdbcTndFSVUTRY4i+tlYSwTneH79/ VI/F2fv7GQ7shQ/s3BKCoegEjXODHXbLtfg2YHqnld9rM/wx2xvc2nJBykd1McEo3CFj Dqkw== X-Gm-Message-State: ANoB5pldsFcaaF8MczwLnTOZGDHUfeF60pjv3fku5ghp4hxk1gIbFsQ3 U1O4vg1/uz/tDRDAQDa0qKZ8bNnIe9Q= X-Google-Smtp-Source: AA0mqf7+h9KMbLUsaO+6tUv3Z2ho40Rh+cyVXl4mrtGMYl85VReSPMPv0nWmdE/dlN8wEE4mmQZo7g== X-Received: by 2002:a05:6512:b8e:b0:4b5:a5c7:3286 with SMTP id b14-20020a0565120b8e00b004b5a5c73286mr4940428lfv.9.1670748354733; Sun, 11 Dec 2022 00:45:54 -0800 (PST) Received: from [192.168.0.12] ([185.22.24.200]) by smtp.googlemail.com with ESMTPSA id s4-20020a056512314400b004b5872a7003sm1095587lfi.98.2022.12.11.00.45.53 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 11 Dec 2022 00:45:54 -0800 (PST) Content-Type: multipart/alternative; boundary="------------d7HYquhKCAiWk0mEi15vtdVA" Message-ID: Date: Sun, 11 Dec 2022 11:45:53 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.5.1 Subject: Re: Everchanging bytes at the end of mirror disks Content-Language: ru, en-US To: Warner Losh Cc: FreeBSD FS References: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> From: Artem Kuchin In-Reply-To: X-Rspamd-Queue-Id: 4NVJJ42hkpz3vLL X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --------------d7HYquhKCAiWk0mEi15vtdVA Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit 11.12.2022 11:22, Warner Losh пишет: > > > On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin > wrote: > > Hello! > > I am writing a small utility for myseld and part of it is comparing > gmirror disks. After running some tests i realized that some bytes at > the very end of disks are constantly changing. > > > The last sector has metadata about the mirror and about the mirror > element.  It's this latter data that differs. > Thank you for reply. Then there are several question 1) Last SECTOR is not always 512KB or is it? Do i need to get block size from diskinfo and subtract its size from disk size? 2) Why its content  is changing so often? On every write? How often? The only place to look for description is the gmirror sources? Artem --------------d7HYquhKCAiWk0mEi15vtdVA Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
11.12.2022 11:22, Warner Losh пишет:


On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin <artemkuchin76@gmail.com> wrote:
Hello!

I am writing a small utility for myseld and part of it is comparing
gmirror disks. After running some tests i realized that some bytes at
the very end of disks are constantly changing.

The last sector has metadata about the mirror and about the mirror element.  It's this latter data that differs.


Thank you for reply. Then there are several question

1) Last SECTOR is not always 512KB or is it? Do i need to get block size from diskinfo and subtract its size from disk size?

2) Why its content  is changing so often? On every write? How often? The only place to look for description is the gmirror sources?

Artem

--------------d7HYquhKCAiWk0mEi15vtdVA-- From nobody Sun Dec 11 09:43:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVKYz6r6nz4k7Pg for ; Sun, 11 Dec 2022 09:43:03 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVKYz4s9xz41cL for ; Sun, 11 Dec 2022 09:43:03 +0000 (UTC) (envelope-from artemkuchin76@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x12f.google.com with SMTP id x28so13799760lfn.6 for ; Sun, 11 Dec 2022 01:43:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=kRhRGyPpEMNTt1UGAHVre1MIR4+14b3Ho/zja8uRyGk=; b=cp54x4MI9cSJjYyRAkb68EVL3tw+w61FuxKEsFtbavQmdrEBZvSfgjgdk3oFOl5bf7 UYV4/4IN6D2aq0DCLXWui1ngPXKS6daQyKjb31gAkplpIw4zg3SGIkpVo8GSYmhvOezR spfwnCGgZjf3Vee1/aXP1epnYZ0hHl/Ql6bvNv3n/R3ZRgg7OybdZeR4etcbDSMPJKV5 poCwpn+mH2z12bDm5qrBVw34rSNFpbo20cxNhVcu0xfUhpMvjhYeW5i9kfSlGfkMHl+m VZLb8/FoDhNI/vGyLuD2962k8KL4x19xIJ9hyocX0BasPoG7KR+mDWst85W4wgCJkfU+ HVXQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=kRhRGyPpEMNTt1UGAHVre1MIR4+14b3Ho/zja8uRyGk=; b=OQ+nS+qIJ+maaNZEIZTnc4npVR7Fvn63WPYZKIE53zBpxT2JXz/zdw9JuMgT/xbwtz KjEVM1ckE8zu0LM1/raok/Y+Jekf3qTW3PPXjG14SqWbc9bkNw7YA1FgcXguHph3JwP3 VRvFAJLKPkDPA/CCy970smkRUru2dcovrp0JpgWYcotsvzu9BJE7T4tPIl3Nk8DUGkA9 rEGU1UELm1yiQiqYcz3jOmb1iFvaA+6m5j5HEbKowIkT58C1XfLcD0j43B8xDKA5Ugta FzAUkZe0NKvX/cj14Ra+cpR+2FiPwdYIn1ZbEYPmnxO94J2OlzXGQw9BFwqTKrmGy2/a r2ig== X-Gm-Message-State: ANoB5pkykkWSmrKMB13TJinpgLF1imsahYCmxO8uGIu2vRCdUXe8Rpqd 8lC8ry4sYmZFsiRrmhI9i3CdNIGeRWM= X-Google-Smtp-Source: AA0mqf6TW9uq9kx2Zqs/CWiQmsczdlAheVW6+Lhv/MQCrRcAaHB5cNFHtpRXGFk2HUOtO5zZ+OBTpQ== X-Received: by 2002:ac2:5685:0:b0:4a4:68b9:66c5 with SMTP id 5-20020ac25685000000b004a468b966c5mr3190326lfr.16.1670751781902; Sun, 11 Dec 2022 01:43:01 -0800 (PST) Received: from [192.168.0.12] ([185.22.24.200]) by smtp.googlemail.com with ESMTPSA id 8-20020a2eb948000000b0026dd4be2290sm860836ljs.90.2022.12.11.01.43.01 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 11 Dec 2022 01:43:01 -0800 (PST) Content-Type: multipart/alternative; boundary="------------AKNJiOxeEg7am6oLTbw3W0Ys" Message-ID: <241b816c-6d46-5be3-e523-824737033239@gmail.com> Date: Sun, 11 Dec 2022 12:43:01 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.5.1 Subject: Re: Everchanging bytes at the end of mirror disks Content-Language: ru, en-US To: Warner Losh Cc: FreeBSD FS References: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> From: Artem Kuchin In-Reply-To: X-Rspamd-Queue-Id: 4NVKYz4s9xz41cL X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --------------AKNJiOxeEg7am6oLTbw3W0Ys Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit 11.12.2022 11:22, Warner Losh пишет: > > > On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin > wrote: > > Hello! > > I am writing a small utility for myseld and part of it is comparing > gmirror disks. After running some tests i realized that some bytes at > the very end of disks are constantly changing. > > > The last sector has metadata about the mirror and about the mirror > element.  It's this latter data that differs. > > Looking  at  g_mirror.h struct g_mirror_metadata {         char            md_magic[16];   /* Magic value. */         uint32_t        md_version;     /* Version number. */         char            md_name[16];    /* Mirror name. */         uint32_t        md_mid;         /* Mirror unique ID. */         uint32_t        md_did;         /* Disk unique ID. */         uint8_t         md_all;         /* Number of disks in mirror. */         uint32_t        md_genid;       /* Generation ID. */         uint32_t        md_syncid;      /* Synchronization ID. */         uint8_t         md_priority;    /* Disk priority. */         uint32_t        md_slice;       /* Slice size. */         uint8_t         md_balance;     /* Balance type. */         uint64_t        md_mediasize;   /* Size of the smallest                                            disk in mirror. */         uint32_t        md_sectorsize;  /* Sector size. */         uint64_t        md_sync_offset; /* Synchronized offset. */         uint64_t        md_mflags;      /* Additional mirror flags. */         uint64_t        md_dflags;      /* Additional disk flags. */         char            md_provider[16]; /* Hardcoded provider. */         uint64_t        md_provsize;    /* Provider's size. */         u_char          md_hash[16];    /* MD5 hash. */ }; From this metadata seems like it is updated nearly each write: md_sync_offset (from g_mirror_sync_request), md_hash, maybe others. Poor last sector is written quadrillion times a day every day. It does not look good to me, but maybe i am wrong? Also, does it mean no go for gmirror on ssd? Artem --------------AKNJiOxeEg7am6oLTbw3W0Ys Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
11.12.2022 11:22, Warner Losh пишет:


On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin <artemkuchin76@gmail.com> wrote:
Hello!

I am writing a small utility for myseld and part of it is comparing
gmirror disks. After running some tests i realized that some bytes at
the very end of disks are constantly changing.

The last sector has metadata about the mirror and about the mirror element.  It's this latter data that differs.


Looking  at  g_mirror.h

struct g_mirror_metadata {
        char            md_magic[16];   /* Magic value. */
        uint32_t        md_version;     /* Version number. */
        char            md_name[16];    /* Mirror name. */
        uint32_t        md_mid;         /* Mirror unique ID. */
        uint32_t        md_did;         /* Disk unique ID. */
        uint8_t         md_all;         /* Number of disks in mirror. */
        uint32_t        md_genid;       /* Generation ID. */
        uint32_t        md_syncid;      /* Synchronization ID. */
        uint8_t         md_priority;    /* Disk priority. */
        uint32_t        md_slice;       /* Slice size. */
        uint8_t         md_balance;     /* Balance type. */
        uint64_t        md_mediasize;   /* Size of the smallest
                                           disk in mirror. */
        uint32_t        md_sectorsize;  /* Sector size. */
        uint64_t        md_sync_offset; /* Synchronized offset. */
        uint64_t        md_mflags;      /* Additional mirror flags. */
        uint64_t        md_dflags;      /* Additional disk flags. */
        char            md_provider[16]; /* Hardcoded provider. */
        uint64_t        md_provsize;    /* Provider's size. */
        u_char          md_hash[16];    /* MD5 hash. */
};

From this metadata seems like it is updated nearly each write: md_sync_offset (from g_mirror_sync_request), md_hash, maybe others. Poor last sector is written quadrillion times a day every day.

It does not look good to me, but maybe i am wrong? Also, does it mean no go for gmirror on ssd?

Artem


--------------AKNJiOxeEg7am6oLTbw3W0Ys-- From nobody Sun Dec 11 15:08:55 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVSpF64X3z4kjQ0 for ; Sun, 11 Dec 2022 15:09:09 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVSpF4Lbmz4QDd for ; Sun, 11 Dec 2022 15:09:09 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x535.google.com with SMTP id d20so9604259edn.0 for ; Sun, 11 Dec 2022 07:09:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=GDVW9fgP0QE3kQoCPj2rUsU7fzWSlMY6l6XoHf7payE=; b=qWzjS4F2TFehW8EKGnZXK5FRClvphgre8IUh4ZHR+qnc9c/QYHQ80tqpyhLgMH54FB vnDqok5G38YLAhirDIYkBuhP+HebADiNeuR53i6lzxVzNuz+zdxPf5l+3F7M62iCSc5v oBLbrQfdv+LIrT2EyPpWJxTCjB0rHaTWaLjtdM+g6nQ1mKbwD5SSpbTq7fnSDDivE11u C/m+bwAUr7KMqN07R1dbfNO7CgFre2syA0VIKeeCpywMGPC+QdWkGtxp/+KYrHQDOHfc Dk14ht++00urRKf02q9CwWgtgudxWko5SkV2Ifp3Vo67FEAPFednkuxt+a+tj20nC6+e qL2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=GDVW9fgP0QE3kQoCPj2rUsU7fzWSlMY6l6XoHf7payE=; b=gjGpFsthS2mj8VOEmK79rqdHCH9JPRpF+KCcqq00IyT/HfNhz66BfekzErwN174VWy 5BXRIwKFQJ6vkn56xWljPm4bcQztr2riMjA//qphRfow5qB3+hKZu+XhaXawsKhEyxog bGqQMvJhqKMBi1TNvgDh4EgS5tmORprjwmhAI0UgmBKtejhpcCrubrn2E/bmETKJKd5D FrUpL2W0kxhIk8yxSjW4Xr5Y4qkrnl7TwmvUVhmocOfgc4gNdQ6NP5xkPnjI869x0HPP er69/svmwdl/rAenRbmssnLGyKsehhwa2bulzCq+Zxsrrvu/ruwqSQpXRldLEq0ES9Px ynGg== X-Gm-Message-State: ANoB5plDgGH1dz25FfoUeitmELSRvv/mcqXzBPMZzPNEtD/pmvoEI/ML Nc43xn4TDw5vbExuzCXnmz/ow9KFQEkG+R6HOZnuy76WaXiHe7HS X-Google-Smtp-Source: AA0mqf5rHOoAOkxAHj45LJqWFJX5VG2qb5CACA7duSDNQ6cDwhWCQS7p5E8nZgvM/7sW3tr0alC8UP27XopOUPKVfNg= X-Received: by 2002:aa7:d659:0:b0:46b:1687:2e5d with SMTP id v25-20020aa7d659000000b0046b16872e5dmr44833822edr.136.1670771346627; Sun, 11 Dec 2022 07:09:06 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> In-Reply-To: From: Warner Losh Date: Sun, 11 Dec 2022 08:08:55 -0700 Message-ID: Subject: Re: Everchanging bytes at the end of mirror disks To: Artem Kuchin Cc: FreeBSD FS Content-Type: multipart/alternative; boundary="0000000000009df31c05ef8ec4c6" X-Rspamd-Queue-Id: 4NVSpF4Lbmz4QDd X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000009df31c05ef8ec4c6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Dec 11, 2022 at 1:45 AM Artem Kuchin wrote: > 11.12.2022 11:22, Warner Losh =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > > On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin > wrote: > >> Hello! >> >> I am writing a small utility for myseld and part of it is comparing >> gmirror disks. After running some tests i realized that some bytes at >> the very end of disks are constantly changing. >> > > The last sector has metadata about the mirror and about the mirror > element. It's this latter data that differs. > > > Thank you for reply. Then there are several question > > 1) Last SECTOR is not always 512KB or is it? Do i need to get block size > from diskinfo and subtract its size from disk size? > diskinfo(1) will tell you, it's returned with the DIOCGSECTORSIZE ioctl. > 2) Why its content is changing so often? On every write? How often? The > only place to look for description is the gmirror sources? > When a mirror breaks (that is, writes can happen to one side but not the other), we need to know right away which side is the more current one. The gmirror does this by modifying the metadata to record how many writes have happened to each mirror member (one reason that write is so expensive). > It does not look good to me, but maybe i am wrong? Also, does it mean no go for gmirror on ssd? No. It's fine. All SSDs in the past 15-20 years have wear leveling (and nearly all for an additional 10 years before that). It's quite hard to wear out a device by repeated writing to one sector. You effectively have to write the same amount of data you would if you were writing to multiple sectors. SSDs are rated in 'drive writes per day': how many times you can write to all the sectors of a drive, every day, for the warranty period of the device. This is between 0.3 and 5 typically (though exceptions exist). Any extra writes will be several orders of magnitude below this threshold for all but the most insane write patterns (eg write all the odd sectors, randomly, then write all the even sectors randomly, repeatedly). And if you are doing an insane amount of writing, you likely wouldn't be using gmirror.... It at most doubles the traffic to the drive, but if you have a 64k block size to UFS, you'd typically see only a few percent increase. So unless you are writing your data to the drives at rates approaching the endurance limit of the drive, this extra write won't be an issue.[*] Warner [*] It would theoretically be helpful,though, if gmirror could add an extra N sectors to match the underlying physical hardware page sizes, but the experiments I've done I've not been able to see a speed increase.... --0000000000009df31c05ef8ec4c6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Dec 11, 2022 at 1:45 AM Artem= Kuchin <artemkuchin76@gmail.= com> wrote:
=20 =20 =20
11.12.2022 11:22, Warner Losh =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
=20


On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin <artemkuchin76@gmail.com> wrote:
Hello!

I am writing a small utility for myseld and part of it is comparing
gmirror disks. After running some tests i realized that some bytes at
the very end of disks are constantly changing.

The last sector has metadata about the mirror and about the mirror element.=C2=A0 It's this latter data tha= t differs.


Thank you for reply. Then there are several question

1) Last SECTOR is not always 512KB or is it? Do i need to get block size from diskinfo and subtract its size from disk size?


diskinfo(1) will tell you, it's ret= urned with the=C2=A0DIOCGSECTORSIZE ioctl.
=C2=A0

2) Why its content=C2=A0 is changing so often? On every write? How o= ften? The only place to look for description is the gmirror sources?

When a mirror breaks (that is, writes can happen to on= e side but not the other), we need to know right away which side is the mor= e current one. The gmirror does this by modifying the metadata to record ho= w many writes have happened to each mirror member (one reason that write is= so expensive).

> It does not look good to me, = but maybe i am wrong? Also, does it mean no go for gmirror on ssd?

<= div>No. It's fine. All SSDs in the past 15-20 years have wear leveling = (and nearly all for an additional 10 years before that). It's quite har= d to wear out a device by repeated writing to one sector. You effectively h= ave to write the same amount of data you would if you were writing to multi= ple sectors. SSDs are rated in 'drive writes per day': how many tim= es you can write to all the sectors of a drive, every day, for the warranty= period of the device. This is between 0.3 and 5 typically (though exceptio= ns exist).=C2=A0 Any extra writes will be several orders of magnitude=C2=A0= below this threshold for all but the most insane write patterns (eg write a= ll the odd sectors, randomly, then write all the even sectors randomly, rep= eatedly). And if you are doing an insane amount of writing, you likely woul= dn't be using gmirror.... It at most doubles the traffic to the drive, = but if you have a 64k block size to UFS, you'd typically see only a few= percent increase. So unless you are writing your data to the drives at rat= es approaching the endurance limit of the drive, this extra write won't= be an issue.[*]

Warner

[= *] It would theoretically be helpful,though, if gmirror could add an extra = N sectors to match the underlying physical hardware page sizes, but the exp= eriments I've done I've not been able to see a speed increase....
--0000000000009df31c05ef8ec4c6-- From nobody Sun Dec 11 16:23:01 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVVRZ2mFgz4jcZn for ; Sun, 11 Dec 2022 16:23:06 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qv1-xf34.google.com (mail-qv1-xf34.google.com [IPv6:2607:f8b0:4864:20::f34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVVRY5HBpz3H0J for ; Sun, 11 Dec 2022 16:23:05 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qv1-xf34.google.com with SMTP id c14so6730790qvq.0 for ; Sun, 11 Dec 2022 08:23:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :from:to:cc:subject:date:message-id:reply-to; bh=hj8bBurKqXBsRstuhP9P2yDYK/gG0s+S4ie0unxVKS0=; b=BizJu49DfjlVnOeJ/U0GcisjLWeHhLUEPQZK9qZPG1SUiAcui4Q00+HshHxxd4zNjm AC7SQbzkx8Mmql8960PGWOUVGMe3QkV0+Z2/taFqqJ+Purqq1ZaivdXF+rgPkHVQdlVc daT/Z7Zs95D9lQBXP+0zt9eHTEe7uw+S7icSafq5jCOh/gXKuOYSON8JSbRI5tS3tA57 T+veUCEkj1vgsIusJ4wyhLJCBKXfOAjsiRZBhCUTjFxldq017GoExbE+kt8CGk3XarU0 I7DMFDoYF464syzFtNWUvARG3EbyvvYpcylPUbVQr5tPqg4NkepvkX+aDeNtZsqfXAEj cCYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=hj8bBurKqXBsRstuhP9P2yDYK/gG0s+S4ie0unxVKS0=; b=Wk046sIh780GzAcZMFSsjlHTggfaHwdp758KksP5D2HGAthxNqb/Zvfcf8M22vKCaJ acVBimc67q5psjQbFgodiH8y423vbjo507YlspqWhTpur7u7EoK6SfrzgBPP7FDU6CzB cFt/7coV2JwUFmCoC50Q25LKj9ztOUK1LofFPwMgKFV3G00NQ2zvGxJHIYWf3dE/DCmr ZySND2TEPaNFt53WWYaYUIYQTFmXYmIpE7rHFSgeSalUceb3ZUwdEoV9myxeNbTBX3BJ XFkk3nMwpWaHtKPOwcwO2Uu0H1tLZe/HuwTcN92OR0fz31DeLtrh/OFHctbqTeu89F2K oeIw== X-Gm-Message-State: ANoB5plrExTaVKwb4NAjzyONvr5cLteicqWlAnoRe8MVcnAE6PhS9fBk wF8+/0jUrSGgvIKEfZ7K0sbbKx8TnhE= X-Google-Smtp-Source: AA0mqf7qmB4PhMVXiCa18OMYvi5boecEY0OtroM6gWykUDg/mL9GGsw675pEsJzI2eU59czGP+qa6g== X-Received: by 2002:ad4:4e0b:0:b0:4c6:fdd0:df7d with SMTP id dl11-20020ad44e0b000000b004c6fdd0df7dmr18083066qvb.27.1670775784956; Sun, 11 Dec 2022 08:23:04 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id ay42-20020a05620a17aa00b006ef1a8f1b81sm4158357qkb.5.2022.12.11.08.23.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 11 Dec 2022 08:23:03 -0800 (PST) Date: Sun, 11 Dec 2022 11:23:01 -0500 From: Mark Johnston To: Warner Losh Cc: Artem Kuchin , FreeBSD FS Subject: Re: Everchanging bytes at the end of mirror disks Message-ID: References: <85c5a64c-915e-d790-e617-c94f3fb7cd9a@gmail.com> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Rspamd-Queue-Id: 4NVVRY5HBpz3H0J X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Sun, Dec 11, 2022 at 08:08:55AM -0700, Warner Losh wrote: > On Sun, Dec 11, 2022 at 1:45 AM Artem Kuchin > wrote: > > > 11.12.2022 11:22, Warner Losh пишет: > > > > > > > > On Sat, Dec 10, 2022, 11:52 PM Artem Kuchin > > wrote: > > > >> Hello! > >> > >> I am writing a small utility for myseld and part of it is comparing > >> gmirror disks. After running some tests i realized that some bytes at > >> the very end of disks are constantly changing. > >> > > > > The last sector has metadata about the mirror and about the mirror > > element. It's this latter data that differs. > > > > > > Thank you for reply. Then there are several question > > > > 1) Last SECTOR is not always 512KB or is it? Do i need to get block size > > from diskinfo and subtract its size from disk size? > > > > diskinfo(1) will tell you, it's returned with the DIOCGSECTORSIZE ioctl. In particular, it's much more likely to be 512B than 512KB. > > 2) Why its content is changing so often? On every write? How often? The > > only place to look for description is the gmirror sources? > > > When a mirror breaks (that is, writes can happen to one side but not the > other), we need to know right away which side is the more current one. The > gmirror does this by modifying the metadata to record how many writes have > happened to each mirror member (one reason that write is so expensive). Hmm, gmirror doesn't work like this as far as I know. The main source of updates to the metadata blocks is to set the "clean" flag: when more than g_mirror_idletime (default 5) seconds elapse without any writes to the mirror, all components are marked clean. If the system crashes when a mirror is clean, gmirror can skip having to synchronize the mirror components upon the next boot. gmirror does maintain a couple of generation counters ("syncid" and "genid") used when picking the most current disk after an unclean shutdown. They're only updated in fairly rare cases though, like after an I/O error or as part of administrative commands such as adding or removing mirror components. Definitely not after every regular write. When synchronizing mirror components, gmirror does periodically write the synchronization offset to the metadata sector, but this only happens once every 5 seconds. > > It does not look good to me, but maybe i am wrong? Also, does it mean no > go for gmirror on ssd? > > No. It's fine. +1 > All SSDs in the past 15-20 years have wear leveling (and > nearly all for an additional 10 years before that). It's quite hard to wear > out a device by repeated writing to one sector. You effectively have to > write the same amount of data you would if you were writing to multiple > sectors. SSDs are rated in 'drive writes per day': how many times you can > write to all the sectors of a drive, every day, for the warranty period of > the device. This is between 0.3 and 5 typically (though exceptions exist). > Any extra writes will be several orders of magnitude below this threshold > for all but the most insane write patterns (eg write all the odd sectors, > randomly, then write all the even sectors randomly, repeatedly). And if you > are doing an insane amount of writing, you likely wouldn't be using > gmirror.... It at most doubles the traffic to the drive, but if you have a > 64k block size to UFS, you'd typically see only a few percent increase. So > unless you are writing your data to the drives at rates approaching the > endurance limit of the drive, this extra write won't be an issue.[*] > > Warner > > [*] It would theoretically be helpful,though, if gmirror could add an extra > N sectors to match the underlying physical hardware page sizes, but the > experiments I've done I've not been able to see a speed increase.... From nobody Sun Dec 11 21:00:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVcbb0Hlgz4kQMC for ; Sun, 11 Dec 2022 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVcbZ21Wrz40r5 for ; Sun, 11 Dec 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670792426; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=la5u/fiLckchsH/xRBEwPDmbuzOPLvB1bdG94zCicZ8=; b=lTGB7Vm5VHokOc8AmNZf3onW5iO/yZLd14efqdiAwX5jaEDCq8yEVtQJIP01e4bBmhdNfx 19z/zuGNNp66sITkaUuEnyKS9acv/nDmoGQoSR4gcq83xe3et/eCML45y4k/i1eEmMQMRc Bh9EInExsMIIchl7cAiH5/P5kYHolhacIuaoGyBVuuBznXIP/2P5rmaxg5u+SdajIK0G85 0Ixw2kNfekbjzEKz7GVbpVnxzzygUh5Lpqi8QVPXR/JI+XFWIYSpLMQdc0repJaxytRrQx awm6zX0wYP8lH+4z+2t7iiUENrtD37wuQwvLLfzIIngFsbfOroEZcuPh6NyxDw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670792426; a=rsa-sha256; cv=none; b=Hej8eB/A2gX8GLVz2qQczxFViDoUsvc9LwQBCjEc6E19ThEupKQLUTU7erXn+x/1r3kEJ7 KdjewRVgvViES5P3QbuTh8joloHOnqxhQo+AzhcHsdjmKFilqMK3Z8HrkqNqzFaPaxVmCS 2fggLyY7CNAjZ06eYvCpIO3xUMYxB2ducGh/lhy5VR6/V/1mjsK9gYENXLs7d0sxMz3ptv bXMBGU99cDTb5Punz10SCr9/81+d2MyZvWkDh6i//IbovEE0vMLGXHyMEUFl0pOLI6TAUH N7lSb/KBrOgntfXmS4tI4QQn+cx1yGuIKdK/LEX3y3v/NONWFcvp4SRwcFKcNQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NVcbZ14nGz183g for ; Sun, 11 Dec 2022 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BBL0QCQ029579 for ; Sun, 11 Dec 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BBL0QRO029578 for fs@FreeBSD.org; Sun, 11 Dec 2022 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202212112100.2BBL0QRO029578@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 11 Dec 2022 21:00:26 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16707924260.cCaAF.27513" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16707924260.cCaAF.27513 Date: Sun, 11 Dec 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16707924260.cCaAF.27513 Date: Sun, 11 Dec 2022 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16707924260.cCaAF.27513-- From nobody Mon Dec 12 00:12:01 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NVhrf5pjSz4kq77 for ; Mon, 12 Dec 2022 00:12:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NVhrf4Vfpz4Khh for ; Mon, 12 Dec 2022 00:12:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670803922; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/uwzT6YWU9G1j+fjOrRaVcdITdo5uLIcEOiYmTw1PXw=; b=oqU/cGJOO0KWnoDBAivQaFO91C9PWJ70kJu/3NOewNX7cHWMbGKuxInjniTxoybRXnOJaK UZqNu4wAKWdO6ax68Ji3UIs3i7Hn7IHKmGhx8ql/u/1Yr4VlZvAM4hUpRpL7xaEFGOh4kl drB9pzspjoSnTtykJzrmMMHiZlXJEU5KoSLjiQ9LVvPsDS4nOsxXsQ+HM/6drASdtim197 jzTsPrKQLHerdL+lx+5h8Tsc2vSPsjhSkg+Rsqd85axIIibvkjPE0RJRBC8fVCY7g23dpB R6/Uc4Jh7WkWJHWNXE7Uei1MkZX5MgP89UYMySR9fjqRj9ifMji90yUEH2EDbA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670803922; a=rsa-sha256; cv=none; b=Ov4U/j82IEdeljdrOVBhsMvZA9p5F89uiYOCEPZtzyOa9LKazOGE4HR9a3LKhIf0cm1KRb gxGXCPGtpISljPrtFINuqry7m/fJLaDZeh8e2bDCQd9OV3t1SLEdZAl0GLKo9ckiNUTJY5 gE5g99xj6BthaeTnmxjA+TYgp3ZjOrFlGWgCtuzHdXeCwSBxjO6d4tEiT/Skx0DWEui+XP 7kH4tGR7semvySdpsdp7L2WwnOQcLDhAauisiSEcc5w87QCdDcJryVOHFqDlbyqkq1PKLh ZbPfXPFpJjaPBkQA5cy7/GKOdmxnOF9ZKVofH1Z8VqlxM5BT6s90ZhfUSLUS0w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NVhrf3ZsXzDvn for ; Mon, 12 Dec 2022 00:12:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BC0C2dN013013 for ; Mon, 12 Dec 2022 00:12:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BC0C21w013012 for fs@FreeBSD.org; Mon, 12 Dec 2022 00:12:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 223015] tmpfs does not support sparse files Date: Mon, 12 Dec 2022 00:12:01 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: kib@FreeBSD.org X-Bugzilla-Flags: mfc-stable13? X-Bugzilla-Changed-Fields: bug_status cc bug_file_loc keywords see_also short_desc flagtypes.name bug_severity assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223015 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress CC| |fs@FreeBSD.org, | |grahamperrin@freebsd.org URL| |https://cgit.freebsd.org/sr | |c/commit/?id=3D37aea2649ff= 707 | |f23d35309d882b38e9ac818e42 Keywords|patch | See Also| |https://reviews.freebsd.org | |/D37097 Summary|[tmpfs] [patch] tmpfs does |tmpfs does not support |not support sparse files |sparse files Flags| |mfc-stable13? Severity|Affects Only Me |Affects Some People Assignee|fs@FreeBSD.org |kib@FreeBSD.org --- Comment #13 from Graham Perrin --- Thank you.=20 Triage:=20 * assignment to the committer of 37aea2649ff707f23d35309d882b38e9ac818e42 * status, URL, CC list, see also, flags * the 'patch' keyword is deprecated * summary line tags such as [patch] are no longer used. Please see (changes, to the right); (updated); . --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Mon Dec 12 18:59:20 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NW9sN4J5Lz4l1NZ for ; Mon, 12 Dec 2022 18:59:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NW9sN1stKz3sTK for ; Mon, 12 Dec 2022 18:59:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670871560; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pPp3E2F/z1tDrVmrGponUqHRIkM+9CBexX/MzU4fSec=; b=ayfRgZBEkbPM0XsbtmcU3Zxc6+qKR4KWdfm4OFdUY4v8W3V545OostTSZy46i3F5JWblKV PqGMy4aA1g97hdieh/EyHbBfLSI4pFNG486h/CHq7fDSMQG75y22at0tCYqUGZP4l+O1e9 Ccd7m7e/74q8ci9JJdqCMbUpiG2RaZWkVqdFpc6wlh9mbxvEtq5DDb0wh+IcAtzbi8pdnu ZGqYl1RQ9/teRjk1wdOYXcsCbkYcHPhKT7DOGpwtBD8cREY2aFSFueS84Au9n3GsF9OZQj E9aN37mEkJ7ufKC4UyQfp42grz+SL6rzEdTpU4GVwEJD2jdouI/y79TQQgMVCg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670871560; a=rsa-sha256; cv=none; b=jAzWhJBUzSZVqO5ymFdrLadSWFMz73qiFO3DEyJ3KVEzzIzX7k/a53MpfLvVu5UvhNanFx Qbe6/MPDH0PMLgjECwxSPnWm0qS7fhPdIOhPrtRh7ERKoLT45pEbCKwv0dXrIp6oYYivhx WUsQRwxZy2ljAw9SI2zRVSh7j8Snvzq5plVbd1Z9jsrFkvkK/vCCgPB1naVmg+Zl9BuQrN GxGCHtJXPMvpNhcvaWCM4cptEsqcnZxvD41N1ji196cl3G/u6++DFWD4qRNo9eAoqf9mWB HRYqEupUd9trBg6PvrZ1amDJywZsQlF83A85HBk0lcxW0483Qhg/dFDDH3HpRw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NW9sN0xpxzlSB for ; Mon, 12 Dec 2022 18:59:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BCIxKik088927 for ; Mon, 12 Dec 2022 18:59:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BCIxKfu088926 for fs@FreeBSD.org; Mon, 12 Dec 2022 18:59:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268338] zfsdev_ioctl prints an error message if called with FIONBIO Date: Mon, 12 Dec 2022 18:59:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status cc keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268338 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Status|New |Open CC| |grahamperrin@freebsd.org Keywords| |needs-qa --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 12 19:20:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWBKZ4kCfz4l390 for ; Mon, 12 Dec 2022 19:20:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWBKZ3H8wz3vg3 for ; Mon, 12 Dec 2022 19:20:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670872818; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gHEbX/uZbegdZPJlhAN3f2t0u/INbS94QCTo1W+l/UM=; b=R7VlhO/A69R+3b0ey7gdIYg9IQeXxBcpbjIH9wEnk4k7h8to++elhwuRA9xkoQall5irCs KKcwSjKtnsHLRgJIS02A9nhoOXs9vdWueabBmx0jHUcdSfw4G1hhucVb20Nqy+bIIgiaSw h6OTcs6QLoNJOPVNIELVmSHyG5R/Za0/tJvPWhRV19syVM24fu06rAXy03ef6FjqIFzTY/ XIMgNCX71Q0mJBjYNtUyDJTyiwe/zuDgbexZgovy15Sh/iwVpDwsKN2Z2bNjVyx4UJOSN7 6L9fGI3qfKbeTUCevast9VWDe6d6xrGoxqjwFzhrIyUvA8r3w1SGWP+V582nYg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670872818; a=rsa-sha256; cv=none; b=FdTYLCF2VN+S6cUUbYUW3Sv32two7LBICooPve1PUJHkU++A2RFLh7n23hMxslue7+EaM+ 8XxSwGUJ//Pilm3B9jL6vWPOJ4WWNZ5bMEx0OKQn/AwLhPsPk2PDocz15tIjg1gGGO27L1 XZRKJYRW38lG4bWyi2SAtLU7lNRaFAo3d8pcU7uG2UQtdWzmTcLH0NqiKIqy0CyIDVgMIX rGMqG8JptbWHzOxOqB36pYG+fwtx0XcuFEOUb4NinPHUvIHuANpvg4Rl/NzXF2wDJqiznp 79czjE88aPhj+Ducbf0OCWHt8IYYuzCAv7Hq30omjASV7bQmBQxK2tkOsYTUsg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWBKZ2LgSzlTx for ; Mon, 12 Dec 2022 19:20:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BCJKIol019779 for ; Mon, 12 Dec 2022 19:20:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BCJKIvW019778 for fs@FreeBSD.org; Mon, 12 Dec 2022 19:20:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] kernel panic during boot ; ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Mon, 12 Dec 2022 19:20:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@freebsd.org Status|New |Open Keywords| |needs-qa Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 12 19:42:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWBqc2Zntz4XyQy for ; Mon, 12 Dec 2022 19:42:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWBqb6qkYz41PH for ; Mon, 12 Dec 2022 19:42:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670874172; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NqijJF/igrI6v+pA2mHrchjWXn8NdWf+1TPdv2iaIks=; b=Gne09nCDERqyUfLhfxEYmSFKgiOhqPz9iXNBvn2TS+W/jhMI4/8zPsryaDR1dxqeCKCxOr jdxxTSYL9M/zgXLSEDtaTDsVqZhO7LD1kQF1jEF1HWdbxbKwc+Ggc8Muuaej6EmkUstnm5 a7vPuyJY6c/rRAkN+Gq63FdxH5xqUnVBfyp41ki0PteZcR6EPsFLXPqpmHv/5JODqK+yBk fEPoRNcGNrllHEE0dVUHGLuWC+nCYGQB8SzF387hL6VUULdyOn0MYXvu2c67OJZXzzvouB 7o8UqcDrSuVyUVJw9v6xjiKkkt3j1PzXLgsuzktX2qHbpF7XDPiAU39sjwIYYw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670874172; a=rsa-sha256; cv=none; b=EEqYVsxPD/6RhHE69n38B4+EpaU+eI/wC3IdrOgGJLh+JU7iKsUpk/fXZ5VQ254FLdliKj z3Rpfd0UfCsDug+3bD9tYT+COP8d8z6eLAiNaD3dvsFBxEibeRFaGk0wGnGZFsBZzBSmFZ 7xNAlKxg4O+XyJMEZFBHH7Vt3C6AaRSNw3s212cvMtcKtRAv6/ZFdvVFXOwALCMCx5szDU GFwQWn+zv62torTN/9HrrJ67SKMS1Vnfgd68a+tY6cfO37Ukr/xuc3Lw1faj75DXGbJHkn xQ/ZBvkqoPhJe8unsiE+BnZ+pvl84F8dxhTA+vgg/IrWbnpkGc71kMf5xe54FA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWBqb5t6ZzmMn for ; Mon, 12 Dec 2022 19:42:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BCJgpWG060522 for ; Mon, 12 Dec 2022 19:42:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BCJgpEC060521 for fs@FreeBSD.org; Mon, 12 Dec 2022 19:42:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] kernel panic during boot ; ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Mon, 12 Dec 2022 19:42:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: martin@bxlr.sk X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 --- Comment #1 from martin --- It seems bug is very similar to this KB: https://support.oracle.com/knowledge/Sun%20Microsystems/2421977_1.html (MOS is needed to read it). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 02:11:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWMSM2LTCz4kRW4 for ; Tue, 13 Dec 2022 02:11:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWMSL5xG6z3npQ for ; Tue, 13 Dec 2022 02:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670897506; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aIwXGIKUwZKmR763s911MWrpnoXfIXeTFG+nvCnlg9s=; b=uC9ad4KGdxVEk+Ux9wr5QRQQpDA+sDiL2p+rOabbvO+4WqcNc6jrXan1PYS9GNy2kAdtMp X6v8wM27jt2fIsDN3MZd2f8ocV1LDm+WxNFhUJLEQRgQ7NHv+skFWpYY9rb6cm2BGzngqS NmWpNSb3P4jKYb/q0BsEzbn5lcqXLsJBi5crDrUihUUM54O5FJAayhfm+6STCfP9m8lf5Y ZagJsLcIHdtQOHX74jYAYe3eYXFe1AdsLtSZkQ1opfZZ14uR2Grca2h9+Bu4ZtOUKFVj5X Xs3YFmsCuj3Q79R+a9Q9r8cZ7EpG6NussqA7pe0YIWuveCU7gzYXZPkSs4Zw2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670897506; a=rsa-sha256; cv=none; b=jtHhLU3Yfhi7lMynSQ5Vx1TTQpYNFFD/e1vlzmf9+ewFwnLkfbuss1sXEiuvooGCVQewiB PZ5SHxdvTzrH0EKobRyD3sb6qUtfgFv4p1b7ICzNp5z6gSxVPZ3R3EgItfDZwT1Tibo6px g0ndycrRUoKHnFjNC00Q1JRf63CS8I+XxU347NU7n9N20lsTyKF2eXPl6VhWfzVVG2kwFn S9kokbCFi/ynl0JdItQR74OQOxT5r9yxo/jXrEy1P+ATCqEI1FUF/wE7j0tXCiWla0K7y3 YPULGqdxdEPRu7zjmUMW/C65ygKV5FuW5tDL9Rng8FFKIb8ARX+BMcYzRGVE9Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWMSL52GzzxKc for ; Tue, 13 Dec 2022 02:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BD2BkeV041635 for ; Tue, 13 Dec 2022 02:11:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BD2BkY2041634 for fs@FreeBSD.org; Tue, 13 Dec 2022 02:11:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] reboot: clearing /tmp: kernel panic: ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Tue, 13 Dec 2022 02:11:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also short_desc keywords bug_file_loc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfso | |nosx/zfs/issues/313 Summary|kernel panic during boot ; |reboot: clearing /tmp: |ZFS ; VERIFY3(0 =3D=3D |kernel panic: ZFS ; |zap_add_int(zfsvfs->z_os, |VERIFY3(0 =3D=3D |zfsvfs->z_unlinkedobj, |zap_add_int(zfsvfs->z_os, |zp->z_id, tx)) failed (0 =3D=3D |zfsvfs->z_unlinkedobj, |97) |zp->z_id, tx)) failed (0 = =3D=3D | |97) Keywords| |crash URL| |https://codeberg.org/FreeBS | |D/freebsd-src/src/branch/re | |leng/13.1/sys/contrib/openz | |fs/module/os/freebsd/zfs/zf | |s_dir.c#L256-L281 --- Comment #2 from Graham Perrin --- > zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx Google finds this, from OpenZFS on OS X in 2015, closed but non-conclusive:= =20 * a backtrace, but no address-to-symbol translation * two more panics, no backtraces. Whilst the matches are remarkable (I'll add the issue (see also)), I doubt = that it helps to progress things here.=20 ---- martin, when was the pool last scrubbed (and free from error at the finish)= ?=20 I assume that boot following the panic did succeed. Can you now scrub the affected pool?=20 zdb(8) might be more useful, but a scrub should be simple enough for starte= rs.=20 Is the data backed up? Can you describe the hardware? The storage media, in particular (HDD, SSHD,= or solid state; and so on). (In reply to martin from comment #0) > during boot Given lines #0=E2=80=93#13 (below the nine-line stack backtrace), I'll tent= atively edit the summary line here.=20 How exactly did you perform the restart? Through the GUI of a desktop environment, or at the command line?=20 /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_dir.c:278 in this ca= se (kernel 13.1-RELEASE-p3) is (in the midst of | ). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 02:21:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWMg42rs6z4kSjC for ; Tue, 13 Dec 2022 02:21:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWMg41mvBz3pYW for ; Tue, 13 Dec 2022 02:21:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670898064; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AiNG73RFK8w0ylPT+yeTOskoKtamqsm5KcFVAg1ONEE=; b=G+EzrA5R3n+/6ENEFJB+Yl6WuIxeewXDaPmWGwgD1gu75T9+R7ltCdQgG3LlosQGrkk/aC DoOKkp6O/y50syL+IdCPOzrXBvXJr2NUIKgPDxyI4BfEKhDAdX7SF/MVJJomxgst6BWK6r uUbkNT8yffBf6WXNoJb3n9HnRwBtn59wzZBwATaNsU0t0Mr2g3B73YSlNq+QyGieDrobfI Gmv8QqOvuFwvFlwSShq6273Dn6mvjXeIz2aKRzd4M3Fj8OeWcFzFIkUEz1rax5HyLSZpSF nxryMxnNNi9RVhHzLCSqN8YO9emfxVqwyLsES0m0R0VZqExh+l8kY0hwQK0J8w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670898064; a=rsa-sha256; cv=none; b=sI4kP9gJl1y6KK2y/UivfV8+XdB0uOC5hxt87z1Kh2goNWWXjN4Xkz5Q8IqZzPcWnyCbv5 Xl0T9iPOcH3Du1fAYwzZxinfUxZQDB7oLz4eXzif3jMWVxO/Y/beuO0Hh5cLlm/I8erOy5 vQqjBA0hAq0OuVG0wxYEGZ9BrYpt02yiwDqZEaOUXc4c5xSI9XI8j18Mg1ovT0OKbb7XPN ZbLU1H7eiB19sg0kxwioAziciDLEgVsNajZux/auZUtbwHzJ4myOe7ZwlVaW2n3sBmQPV+ uvGicrSZp8mnwFptJbbn1ERpcOGeG4dT9kp5jUvepHR5wHW233mha5aUAgiGkA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWMg40rvjzxSB for ; Tue, 13 Dec 2022 02:21:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BD2L4bf048576 for ; Tue, 13 Dec 2022 02:21:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BD2L4YM048575 for fs@FreeBSD.org; Tue, 13 Dec 2022 02:21:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] reboot: clearing /tmp: kernel panic: ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Tue, 13 Dec 2022 02:21:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 --- Comment #3 from Graham Perrin --- Suggested attention to hardware (comment #2) is partly based on ; the (remote) possibility of assertion due to an I/O error. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 03:12:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWNp35zZ8z4jZs1 for ; Tue, 13 Dec 2022 03:12:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWNp34vvxz3t9Z for ; Tue, 13 Dec 2022 03:12:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670901131; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0Q6bbs6EFXeEynCpIN2bY0b9/H+qiTWjZ8onkhejKgw=; b=UBS6NfRWdJXu5po1rsbs8kqxBIWMDlBAQSVZGyu9zlWYrhZSVVyMwunaPExFj43GZ/H6tJ JC0fphw4asQGtRxIAb7JAS25SQRLIl2qllemmhFbk2EAgpMBLE0pBi5KvC8tPeSKjud7Cn FYI3TgMJzFRIPNh/8xpz5ll0k5ziioxj9hQUAPxyA8Gb90KQVXUCohNXSQs+pcah3Jczp1 rJqc8JiMsJlziKDvu2rLqWiDswiYUjogk/txn5oORe6ahG7HtsNDmkPgr4+/g+Eqb42/7Q LM8pE603W8UAU8uZjzhJQeXOUdQTdLkkpKlxvOL37kl4sGrrcSfXEa2V90CyCw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670901131; a=rsa-sha256; cv=none; b=UXHo1h4RXa/AvWEF+qpsf5IkWkPTHHtoQkXMXp06l6XVGJ4zERNPo6RNkGdA2YKr4mGa5h gLQPzUsQFUVEAaTVAh6SrmKqtFqLuDuC/KpN6UTsm9v2xQ1ObqRvlEzAv4iNGR+mkqXEes PuZwpfS4sKPwmem/FI5w0U3aT+Qc6e8oV7V1za6kvHYG/Romy2bIhCe8mUPZ3AxlCBGSZC 88FpXqVMN4kqegPDUTfmun4kQ3h1fau3lbDebDOM5NNBTYwC96WhCtW8PGkFzNpwmbQN+h aaryTVU54Wg6aJI27BvapbsYZph/xcm1jJxHZAqfqnAANl+9NKuwbVc1whqHbA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWNp33zDKzyQL for ; Tue, 13 Dec 2022 03:12:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BD3CBQ1025591 for ; Tue, 13 Dec 2022 03:12:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BD3CBsn025590 for fs@FreeBSD.org; Tue, 13 Dec 2022 03:12:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] reboot: clearing /tmp: kernel panic: ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Tue, 13 Dec 2022 03:12:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 --- Comment #4 from Graham Perrin --- > =E2=80=A6 assertion due to an I/O error. Sorry, that was poorly paraphrased. The original lines (L266-L267):=20 >> * Therefore it is remotely possible for some of the assertions >> * regarding the unlinked set below to fail due to i/o error. On a Re: comment #2, to= day describes the 2015 change to OpenZFS on OS X:=20 > Looks like we never figured out how it can happen, and simply made it=20 > a soft-panic: =E2=80=A6 =E2=80=93 with reference to a commit. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 08:56:58 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWXRv12Q5z4kZCq for ; Tue, 13 Dec 2022 08:56:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWXRt6Fblz4W8b for ; Tue, 13 Dec 2022 08:56:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670921818; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=V77+r9aYZKlyfK4YT/opIMAvDzJEsGG840uexAsRPps=; b=xuOWubqf2F+YBJRcpQn0L+tnkX/J7S5Gal60m6M3o9Q4ZmgNfKkRtF3uvKXzflEneu770S wXeCK9mkn5nBWncibg6xByXnLDSa4NfHWZ4Hh83gX9VnJYbE28TUR0QIi8WDT/WQ9aZquP Ot9SeRahS/4ie/kP1HTSx6L7MTU5DO9QeCzubH4mGvd10tZDJarkuIWxzIAiwyIY6/pnHp Eq9e1spx9IQDKRz8JI26stHjRRg+x3BSc/FRz5SX2NK8bXl4Pya5G8HapPanfQR+x4McZy ZfnNfoVit7mzTxT8+RlK7Npc/ut4TPMPE5w0wxL2QbP4EVmdK3aqTmMgZjMszQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670921818; a=rsa-sha256; cv=none; b=FhqfrOFTBZgJggU0egX3oQzVezZYKL6yIj08pvjCj4JSQ8bOYV+bflU3DBjOYNbiUlTbNx YcOrY5eDsweeGLDjFxysRI8l8ZUDCYCBxq+NFTEMzkiMj0GUFybBQ5/26a9BPlH5KILO7X Sf8BlJhz185j9MTT//Vge2xECOguytUjrPtbgU5YtQA8OIqkfcnsJzo1om7J/dz9r/CXeM 3yeSxhBKWLS4eNZ2HQ+r1BnAV2T89Kj7xdWpSqpYLZee8TqoanTySnMPy6MzDYszA7F5PE T+rMVo0JakS5BxyXkBfhCVHcE0J1SmBGvn9m7h2o1Ns94Aiz/0D9F0YMzqxViQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWXRt54plz170p for ; Tue, 13 Dec 2022 08:56:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BD8uwwm020329 for ; Tue, 13 Dec 2022 08:56:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BD8uwU6020328 for fs@FreeBSD.org; Tue, 13 Dec 2022 08:56:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268338] zfsdev_ioctl prints an error message if called with FIONBIO Date: Tue, 13 Dec 2022 08:56:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dfr@rabson.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268338 --- Comment #1 from dfr@rabson.org --- Probably best if I get this fixed upstream. I'll open an issue in https://github.com/openzfs/zfs and make a PR. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 10:16:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWZCz6WS5z4kjnK for ; Tue, 13 Dec 2022 10:16:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWZCz4T2Dz4cMH for ; Tue, 13 Dec 2022 10:16:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670926607; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ktwLCwT+B3ZptrH6zaOjN3JxtRFin1cQ3/bsB8mfKVU=; b=cBdHggaZw0mdFVZdw1VH/44VuYaJyUsW/XWj2YeGtmLox60TCKN38WninQsNxON2djvOR9 t5tEa/lDay84GXOoCMxhMKx8goHlZg6ohdDFXNGxiICW/UL4qjQ2AG9DX267eVwBgnngUb lV1Lche4O/nfPtvoY0kRXMmN21nAyknkWG5bCfL1DWhcPoPcVXg2F9YfK7rRWXg4QDBYwR ZYzUpUZn5OZcdhB5jc1tp8K2M0LtdmEARr9nNWU/JG90BvQL3vfQXnkAfhCJyJVPxCrAPY YTJBnkl+zVR8eSf98KbeM6Pq2KNR2FndfCRthubVm570TCy1nTR58Bw829WwMQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670926607; a=rsa-sha256; cv=none; b=KZyCLZ0BoENstZK5pRiSlE3yjFgMw7H8s/K0KNeICTuXKJjbIrSwJCiidOV83Wq/ywyzWl zYO49c2iPajjz5B8S0GT4KgNZ80CxsKrSE1QKwiILPDmMjec4mmh9bvxzkMtZ1W7MGdSjV 0WxRYQYQcAbwbb6isgK8gUlZbQoqXJ4OR21v7kHB4OzsMp0JsSJPWJy9fPTnj8PmAguM87 wTt6zbNgBpJIzomiLRXq45oPhD3F/8yJRWCBNvF1fXCXPeq8fnrncwfo78/R0D2eZMaROd q6JPriVCvBjdAqmHnsUbOtoOax7jFxqYO9rr9b6rMiroIzGlsz5U+gvV7tRx0A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWZCz3Xz7z19Ls for ; Tue, 13 Dec 2022 10:16:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BDAGl9n038274 for ; Tue, 13 Dec 2022 10:16:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BDAGlDB038273 for fs@FreeBSD.org; Tue, 13 Dec 2022 10:16:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268333] reboot: clearing /tmp: kernel panic: ZFS ; VERIFY3(0 == zap_add_int(zfsvfs->z_os, zfsvfs->z_unlinkedobj, zp->z_id, tx)) failed (0 == 97) Date: Tue, 13 Dec 2022 10:16:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: martin@bxlr.sk X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268333 --- Comment #5 from martin --- Yeah, I googled that. And even Oracle docs. But.. > Looks like we never figured out how it can happen, and simply made it=20 > a soft-panic: =E2=80=A6 I'd assume people want to hunt this bug down, hence the opened PR. Pool was scrubbed, it didn't help. As it was the rpool/tmp dataset that has this corruption I was able to disable it (set mountpoint to none) and system booted up.=20 According to docs I found if I can't fix the issue with scrub the whole pool should be restored, i.e. don't trust the pool if the dataset is in this sta= te. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 13 10:58:43 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWb8M3C2Hz4knJC for ; Tue, 13 Dec 2022 10:58:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWb8M0gGtz3Cwj for ; Tue, 13 Dec 2022 10:58:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1670929123; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ODM4qaeAFk3V9uZDVN0sIKGYm0BpKZRF5FSa5x9VR/A=; b=Aa+QlcupLhJIW3shNaVZPAY6PlR/hVzELEU7bw1Oi5YQA2ICwmrZVMngiVkLvZHFPWvz7E Vomrto7lgyslSWXtqzjqUQgEZ5rqx3qdwf9h9jfIgjeYZcoT+Hd0+S8wHpavNlCFdcVJrX GhglaX+P2qq69LgD2NVf96r80iA4wN6Mh3WgD9DxZlzYcVik8PirNwkjzCQsn6ZNZ1uqIG wgu+kA2tB/2jBPfzure0Fq3nLqqRmL/i5xW2yCOdA3CwyJsxSZBFX7i/bWcdehu8qr8Dm4 5t8YPgK23qhTFI14CSGhNGeq5fkyhfTIwujl/kj0jILMqO4EwNlYIU4OkMiPGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1670929123; a=rsa-sha256; cv=none; b=bQUlSZmQ+kjTBi51TdXf+6xnoPu2rqIErK6OriQOyHcgoUfzf8jH7S6JsQJrsMKO9HP9iH B9ASb5qPaFHCF3lf9yGzFj+pNs7/4jdcsogXBj5sG3O9GwxQFjBkBvJ5iJaE8XswqjdO5e yX6c12YDNvgudYq6tQGNOG/jUl+fyPfp6uLP/t/zFJDC7w18okSOZWbWOVm9LS59qL5hYR qD/GPvCGSEoSGopmyApK40440nHmW+oqcQ33FZVW2173GZLYDIzqTRrncSkpu3LHbebekI YLjm+WBhHBX3eA8LtOlVTsTqw+sJs2hS5ZbEr7b7rlMKBWa4vIRkvWEo0DFJKA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NWb8L6pqpz1B2j for ; Tue, 13 Dec 2022 10:58:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BDAwgUD093982 for ; Tue, 13 Dec 2022 10:58:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BDAwgsq093981 for fs@FreeBSD.org; Tue, 13 Dec 2022 10:58:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268338] zfsdev_ioctl prints an error message if called with FIONBIO Date: Tue, 13 Dec 2022 10:58:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dfr@rabson.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268338 --- Comment #2 from dfr@rabson.org --- Upstream issue: https://github.com/openzfs/zfs/issues/14286 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 15 18:11:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NY0fZ2r5vz4l1Zf for ; Thu, 15 Dec 2022 18:11:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NY0fX1rWJz3wjW for ; Thu, 15 Dec 2022 18:11:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671127876; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7GDRrKXVrMwCHcfvlEBSJIVBPcAOX/hTA3Vwl8pLGa0=; b=SUNlcIDZqaXgdG9l1Pj0b1DvqOpPG/iOxG47hKfjdAT6m/cdOe24uFMnb80jMe82yx2iNM zlGkb8ZtgCvsumNr8SJ/Tk4DunE3ZgJbzrEE7OeMnLfdkaQ3l9YQqXqDlLEtFfpt2xRd9Q JvGPcJELi4IaeTbZZAcHmVAwOBL/veTFWf8v7zAn0Oth46EWYHmjQq7O18QZkj6pZ6QPh7 2ZKIYKZMxA2/h6w0k8gueSCrssdjd/RyfA34ghwD9FXg7pkO/zfhYuxD+4VopsM3tjZ4GN uGuOeCv5jkmQTEDQ1trTs27no1+pSSt9sia0XfuBzNgQfAIzm3X2o0LSOo3PoQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671127876; a=rsa-sha256; cv=none; b=NSA798mChZ7thYup0ZPfehtYfGPEuz6yWcqcrDuO85DfMaCo0lc8m8JSfzJZgmKOjeCYDV ytndr7eEcC99g3XPWXwrCs1mvF6zkb+B8NOytDFgfvW601CaQq0rUQFA8Eo+pe3UjD1f/g vd7ggQHzVbEkXK5lbY5yZEQrv79OS+DIBaJtSWh+h3G3tS3OJlduj3ihZ8OsXURIgS1tk2 6NT7k7qutlR6w/MS3LC0MqrATC4npSTYQSFPkZXrujMLblceD87M86e4Wz6G0KBFxqBayu N+gL2ECy29PvHwzMgRnDxUr9IYszij9a1EDYbNeFYCY5bcPxjQ4aCyULtdmpZg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NY0fX0w7fzjPV for ; Thu, 15 Dec 2022 18:11:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BFIBG2K011641 for ; Thu, 15 Dec 2022 18:11:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BFIBG4m011640 for fs@FreeBSD.org; Thu, 15 Dec 2022 18:11:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Thu, 15 Dec 2022 18:11:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: freqlabs@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 Ryan Moeller changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress CC| |freqlabs@FreeBSD.org --- Comment #7 from Ryan Moeller --- https://github.com/openzfs/zfs/pull/14291 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 15 18:19:14 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NY0ql1Fscz4l2Mm for ; Thu, 15 Dec 2022 18:19:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NY0qk6Tlzz3xk0 for ; Thu, 15 Dec 2022 18:19:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671128354; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RLHyR83Yety1i6VSVkzrfeKMWNovk4FWLNWWc2JgH6M=; b=D4uKFNpLMAYBtrkI6yvkoGolHAMfZrSWOKKw8+pTPsYl5oUM1dXUFU7eRDm4hI+y3Bub6I n6aELPv1iRZLI3iF7HBdcogyhu9hIgs4KKCnikpTU4joWOJDo2JwgPIdQwo1Hw/nx4qM/8 4EWxHq0i/uDECdCf12klG1DXKSyGgPTd47Io8idbA8qnptel0vXAlzsB6xKZdMx1M0WGC7 zUT5W1NAXvxtH4L2Y1Tl7mkCeA7K0oKfEzPS8bohFKLuCHGrdzpR2pGO25M9FB4vPpB2zV /MWEoX42zg1DZvYDBa7/M5dTIMdTas2VZqNV+rv6t1CFyisJ0MkW4+XaDG4U9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671128354; a=rsa-sha256; cv=none; b=oTq2ZaHpPo6sADWjaLRNVp1VOHFzrtrnohhBLMUEFrQksDWeI/eaBMcYJWDJAIwWPa65E7 uq7jPmzsAGdweAu7lVLAPYdhzZ50jmDIXKJczWOpd3Zb/VQM+0wJk4yk/6k94fZVP+b8Zz 686muQoumeDA2NHeFQ2mrmi2wvp3GG/2P0eIsuwNLPWsHlSEuEGeaN9JHLzkF/XUKqJCfD f35TvWFIwiKEKEoKmlQusqIGx8SmzMJQzTgzzp2ba3tR+PjvLEwdVT35hAdnVhYfR38MWk V9vkaDQqHaztVNZDTJMMjuOJFehp9iL2I1OvxJ+fs3OMaiKEgH4LQUGi2xag6g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NY0qk5PWvzjDC for ; Thu, 15 Dec 2022 18:19:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BFIJEKE019966 for ; Thu, 15 Dec 2022 18:19:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BFIJE4b019965 for fs@FreeBSD.org; Thu, 15 Dec 2022 18:19:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 149015] [zfs] [patch] misc fixes for ZFS code to build on Glibc Date: Thu, 15 Dec 2022 18:19:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: freqlabs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D149015 Ryan Moeller changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |Overcome By Events CC| |freqlabs@FreeBSD.org --- Comment #5 from Ryan Moeller --- This isn't relevant anymore, OpenZFS is now maintained in a combined tree f= or FreeBSD and Linux. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 15 19:57:13 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NY30p2Jrvz4V896 for ; Thu, 15 Dec 2022 19:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NY30p0rK2z45B6 for ; Thu, 15 Dec 2022 19:57:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671134234; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q9+9vlA3O610fdTpzUkRRNp9rfGaB6jzPuyLfPVj2vw=; b=e1DezI23Hol7HvyGVScckJeBbLNO5XpXNVbMH7WwsYeEEHhbxTJoCU1Z6aaXw7/+sBrrdr MfztSx7vbgRlgCtY5cba6yYD/EutQiGNrJYS494jSS7K3GkooFaGMkgHr6IosJebKkaUoS cyQBrItinrF/8VlH0pJa7XiC2KQzeoGNzZHgsWhBdXjcSijF27iRxZCMMlaplhD0fKsnpS y0QpxuTFS9LHENZRvHdsUdgWudJ2wwh0zixcoVRXwJd7c8qmatvsbz0R1baaF8woySwhE8 0sPbs6si1a/i15iE68EuBsLUDUDZBs3eEXKJs+nND0f3ww4MQkPJ/A+tZShQHQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671134234; a=rsa-sha256; cv=none; b=BHYZjlG8GZuCmicgv0jWLv3GMnmpwkfwLx61QZnXyKCMSJc93A2E69wqgZ+LHy5DHmDSSH 8JsGD1YfxW1XVMykjpcqu86W5Srl+LwhkD3pMHiRAyIzF6NQme+gZ5Kj46KfrAuJRpsKsL sHxTwEyI7IvzOfbIPPcOumpiEBjN00wFnqAuo/Cp9tjiFHGmqpJW6pGV5xtJdsNuni5RoN ezJfX3OXCyRE1EXhhoUUBEEj7lej67wt6y1KdPVV1RaV8QZHSkqWw/M5+EzocXaRfLabL5 ISlUeAVBWi7q9168z3ztujPWuYTiPMJ3jFflpfp4E4yO1Ck2gXXuVmzj9duomg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NY30n6vbRzlmG for ; Thu, 15 Dec 2022 19:57:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BFJvDDc056041 for ; Thu, 15 Dec 2022 19:57:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BFJvDtB056040 for fs@FreeBSD.org; Thu, 15 Dec 2022 19:57:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Thu, 15 Dec 2022 19:57:13 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freqlabs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc see_also assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org See Also| |https://github.com/openzfs/ | |zfs/pull/14291 Assignee|fs@FreeBSD.org |freqlabs@FreeBSD.org --- Comment #8 from Graham Perrin --- Triage: in progress (status) involves assignment to a person.=20 (Thanks) --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Thu Dec 15 19:59:26 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NY33L4mDcz4V8Fs for ; Thu, 15 Dec 2022 19:59:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NY33L3hz3z45t6 for ; Thu, 15 Dec 2022 19:59:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671134366; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rJrKkhRQWDTpM2tJA3cgOoScRoQDzCoGL7qTqnhtLvc=; b=fy08B3d7BzCA7X0+W8q1xpvuACI8uuyDgNaKo/SVkR8wn0GLnSsoneYH3dWEs017eU+leM Em08F/KXaJiVEJELTWeVbPJEZwB2RIAutCcOCmYLGow9xx+xCMO755ANrDBqxFLZgnviqC lhA5dP0ZO8M7PxcKbZGKSV1rTZ52C9AxVNTQo1uvDlReeUH5tHPrN/p0X5WIx0TvOp1X1Y WAT4/qQybYd1xW31z+RTxi8pIqHJoSS8+7HIPQKlAkweNVlp7TsbO+0Y/bMTU1rTTKv+aW MVLxrObEgKWw/+6nxsa/pEMr8r9lnAxqDPNKBL+gj312f6rQzyyH1FROpQqVnA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671134366; a=rsa-sha256; cv=none; b=k88pB0gu9e3ou4PdZ6CfiH7zETd2rSKn1haKcKNwt5pXfyJ+ZRC/akw4Fght5oPzEqU1t9 SzZvKkHFZluiwp3xsgXfJaA6RaJ5IwtwoE+W9n9ztJm/RRDaUq1cBjyjY8LRiAm71dAB1Y 4OS0mMWNYVNxXancd6ue8LTzrdibw8lFSIEyKS3m/DJakqI95rC2GEdAqZrqFFWORVxr5D vzOmQBNYLaFml/e7/KIDfdvsdEcl7FWolFtKgwIhW7E+4hxlNmhLA5JtrD89MbYQyaB1wo SOVJALVWqIAqWj0jJW4U3mBm0bMxiFl5QjCNBCsJj1YtPuxGJ7l8do8BG3ECkQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NY33L2mYzzlwt for ; Thu, 15 Dec 2022 19:59:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BFJxQFj056780 for ; Thu, 15 Dec 2022 19:59:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BFJxQ9M056779 for fs@FreeBSD.org; Thu, 15 Dec 2022 19:59:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: =?UTF-8?B?W0J1ZyAyNjgxMTZdIFpGUzogcGFuaWMgKFZFUklGWTAoMCA9PSBu?= =?UTF-8?B?dmxpc3RfbG9va3VwX3VpbnQ2NChudmwsIG5hbWUsICZydikpIGZhaWxlZCAo?= =?UTF-8?B?MCA9PSAyMikpIOKAkyByZWJvb3QgYWZ0ZXIgcmVhZGRpbmcgWklMIGRldmlj?= =?UTF-8?B?ZQ==?= Date: Thu, 15 Dec 2022 19:59:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268116 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfs/ | |zfs/pull/14291 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 16 04:25:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NYGHL3Hj8z4dDLq for ; Fri, 16 Dec 2022 04:25:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NYGHL1GGxz3NNf for ; Fri, 16 Dec 2022 04:25:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671164734; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Q4Ro3PcWpTVccsUSkgqAu6AZVH8tofcNjlFHWwZZmMA=; b=jZCvZ1bqvT27s9hZQ4JS9ffFqq9N6WLyX9jerIMhs1goZOLAslxH8YEn/vAf7TpEbads9X kC9gbxARLuQABDiQg6JlDt6xhMfY5qhqx00v9kW+/RVrciT9MvsV86UVLlbGORw7uqrDg9 quLPpMDTLhHdPClsa5bpsv9UrjdXd5tqQLTiTz2xjlAd4KTPpfZ26k0vNRKBG7oWNpBpoo RSTnJM8AeTbUi2JpPHOmYb3zE0m5hDMp5HiN8RAPAlOHyrayM7IU3h8/Xmu+9Qatg8gAQG ceEGKjTyZfBEo0PYZkxsjzQ9wTyXWxyipJKF4d+oyPTAhxtCftt8BR2eFmzrFQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671164734; a=rsa-sha256; cv=none; b=ePjsL7qO8H0n0IXYjOf2rA7N96+QqVMytUQjEUIZid4x5/ryNAH8rLcs3LO/jKYPjEJJRh s5cKdAwT/FigPwYww0wC2Hi6FHtqq8pysrzlqxpvVkkU22y5C/hipmVaZ5mk8TOBgWK9wO xluJlJ85z1HyKpaaZhLQW7ounXSkvoSAgvY+naPsgCBjbV8t+yMEc6yjq4HZfTgvUrQ4IV YP36ElI1XbxJL6h/t+b31CAkdIn+CNl28gKjH6q/pgN3EV3TaoLauua71ySsNtweS1bWMJ s6ncP83SY+AZMAro9UhZclszS/ZtLAwgoXW9ABJhYnvvVv90SRmkzLkPCrSQyQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NYGHL025Sz10W4 for ; Fri, 16 Dec 2022 04:25:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BG4PXPd096432 for ; Fri, 16 Dec 2022 04:25:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BG4PXIW096431 for fs@FreeBSD.org; Fri, 16 Dec 2022 04:25:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244692] gjournal: Does not support TRIM Date: Fri, 16 Dec 2022 04:25:34 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: feature, needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: danfe@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244692 Alexey Dokuchaev changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |danfe@FreeBSD.org --- Comment #1 from Alexey Dokuchaev --- I'm in the process of moving to an SSD, and now considering various approac= hes to data storage. One of the things I wanted to try is UFS+gjournal(8)+async which potentially performs noticeably better than ZFS, esp. on lower-end and mobile CPUs, and gives explicit control over sync(2) and fsync(2) which e.g. databases can benefit from. Unfortunately, I've encountered the same problem as Paul: apparently gjournal(8) does not propagate TRIM support from the drive to upper levels,= so even forcing TRIM on UFS won't help as underlying provider would just ignore such requests rather than passing them down to the hardware. (In reply to Paul from comment #0) > It seems, gjournal still does not support TRIM in 2020?!.. neither for da= ta > device nor for journal device. It's the end of 2022, and it still does not. =C2=AF\_(=E3=83=84)_/=C2=AF --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Dec 16 13:48:56 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NYVnQ2JvGzt2vs for ; Fri, 16 Dec 2022 13:48:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NYVnQ19H6z4Kvp for ; Fri, 16 Dec 2022 13:48:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671198538; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=12ZvXh8pQzWSZM8yMW3jkBb7ty7vbMRG3xSReMDj4x8=; b=tHWBKdylUG7VE+d91AgPO52ZRQl5j5X0qRbwW3VM4Dq6grHBdjcPK2dnox0RMlqeQcbVHZ dcfrAxSJ0FsEk5+b/h0E4xnpviqeqzvdWKJW+TPMiC/etV/JFpbdQnqgWGLTMT4KkOjIvI VZ8olebqLuqFc4Mg8Xs0MD6NBteyEFKo2VL4J3JTFC2aLTRNlTdwPVFOUBdZXz5VTjn0uC SB9nFOqbNe/CtffhbZoHrPJ20uDyYMPv/A71OASJc7tdqAnamc4cAKeohCm5gn4E8bsSZc Ma1r6CKSTIbsNlgmX6wTBqzHEJVTsMGrTSPu8LEo3HDhIAlcpE/8o/HpSz5qqQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671198538; a=rsa-sha256; cv=none; b=MInXiQRxYaE6VIFiM+pwjT9wiNwO3tOiH2HQ5ri4yBWtBrw4mj7pX2mVhwmJub8ZIJIfQn bMI4UBm51d/Gzt5j3L6cHO9OCLhg6IZ8P7bIEEj19i1dilpwcFESGtax6Qsvv0SNAJlSKl nXsakgEmntx48nVC4JokDTQgZ7cApV6ArayxlalkhBjKtS0K3HmqmYHqmy205mTIpwSPnT g0L1ptijQUQ2p/upwXyvjXYU8SMkK8cZpIl5WfjwBp45uAI0HY5D4j2Au44d+slOqUShia Z8kjFVwSc3EA8g0WpQVfX6A51z2XQqsU+sF26lBzL23a2/VWLfmgVTNf90wfIw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NYVnP74TDzFP6 for ; Fri, 16 Dec 2022 13:48:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BGDmv5O096563 for ; Fri, 16 Dec 2022 13:48:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BGDmv9q096562 for fs@FreeBSD.org; Fri, 16 Dec 2022 13:48:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256368] ZFS: FreebBSD 13 does not boot after ZIL remove: panic: VERIFY(nvlist_lookup_uint64(configs[i], ZPOOL_CONFIG_POOL_TXG, &txg) Date: Fri, 16 Dec 2022 13:48:56 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ruben@verweg.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freqlabs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256368 --- Comment #9 from ruben@verweg.com --- I can confirm that this patch, manually applied to 13.1p5, lets you remove = and add SLOG devices again without panics. the diff of zdb -e before and after shows --- zdb-root.txt 2022-12-16 11:59:06.691436000 +0100 +++ zdb-root-slog-readded.txt 2022-12-16 14:44:34.417938000 +0100 @@ -1,6 +1,7 @@ Configuration for import: - vdev_children: 2 + vdev_children: 3 + hole_array[0]: 1 version: 5000 pool_guid: 4167832821587494122 name: 'zroot' @@ -24,6 +25,7 @@ id: 0 guid: 4024934502194417417 whole_disk: 1 + DTL: 97 create_txg: 4 path: '/dev/ada0p3' children[1]: @@ -31,19 +33,24 @@ id: 1 guid: 18122104391858199043 whole_disk: 1 + DTL: 96 create_txg: 4 path: '/dev/ada1p3' children[1]: - type: 'disk' + type: 'hole' id: 1 - guid: 4122499541960188698 + guid: 0 + children[2]: + type: 'disk' + id: 2 + guid: 11454742377729792592 whole_disk: 1 - metaslab_array: 45900 + metaslab_array: 1932 metaslab_shift: 26 ashift: 12 asize: 1068761088 is_log: 1 - create_txg: 46027 + create_txg: 138279 path: '/dev/gpt/log' load-policy: load-request-txg: 18446744073709551615 (replaced) log device is present in configuration % zpool status=20=20=20 pool: zroot state: ONLINE scan: scrub repaired 0B in 00:00:20 with 0 errors on Fri Dec 16 13:10:06 = 2022 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 logs=20=20=20=20 gpt/log ONLINE 0 0 0 cache gpt/l2arc ONLINE 0 0 0 errors: No known data errors --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Dec 16 21:42:11 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NYjHR2NSJzZj66 for ; Fri, 16 Dec 2022 21:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NYjHR03trz42tK for ; Fri, 16 Dec 2022 21:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671226931; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AXGsoa4U6eOhLZaui/pkkCX004aEbyRHRg0G9GDvNEI=; b=qwpwbF1x3Xypw1U0KF1Ll4QxPr7LkHy/5ZsoqsT3/l45cDkstUuSYGlopLiToWcWozIy16 wchxQVirYOuUMJAq5G0kMzsrNlByideiFlmjRCwNdKToIZKERdmjX3ksXoGXscqbnSFh4Q M1S/t6/7sb0zzmMS0X1DDdtv8rOIorpERKqEgDxc+B5CqlhLleC6Vafsb0cytWUvZGsBX5 PJ+hhgmA27OBJRWT8IK6UgnjBE6GSb+jpOCHXdWZy74YuET2wv+407ZrvXbxT5hbuxqjfI 78ba8vLclFJNW/SPz+oIvckLTESL/Tb86cnBguXEnqE/L3fHxgzO0hcjiXuxWg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671226931; a=rsa-sha256; cv=none; b=aCJYXDPgB22+nQl0wHOQkj3id/M1TwS9GV/6sgBblMF9s6OapKQq9IDimJrXYkEplOP+2z vdcppLoB8sdUukl1ZI7FdPTbVTaFcZoGRnzMu8VYzICOp5IqxNmBDm58aBZj7rOoNEk/g2 E1oELxQwZ++0hBZ+Cuo28/FkIYTuHQI/7ocR/ByGyBkWn+C+5SAufjcR5O2ashXRM7TAVs e0UKpKEMUATYFE3dUMw/daqYfOa51XiaGEJBUwXRru+DjEtZ5ci85CdIcnklSDV6wr/Ri0 w1pTuJPjouZxFhajDaNYVdMYAjaYMDYs8j59jrMZTVZ9c1ag2HKrDQwhtBfd5A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NYjHQ6Gh9zSn0 for ; Fri, 16 Dec 2022 21:42:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BGLgANc087438 for ; Fri, 16 Dec 2022 21:42:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BGLgAUm087437 for fs@FreeBSD.org; Fri, 16 Dec 2022 21:42:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268416] Crash on boot while tasting large USB ZFS disk Date: Fri, 16 Dec 2022 21:42:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268416 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open Keywords| |crash, needs-qa Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 17 10:02:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZ1jM4Tl5zsxSf for ; Sat, 17 Dec 2022 10:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZ1jM1yDnz4G4D for ; Sat, 17 Dec 2022 10:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671271335; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Wri8R3nSgqENwsdhyyBDWfsM06nNMwXU1GFfktN7nQo=; b=vaEaA76EMH9tq6LahlkPtlePUfC5dMxtXH8P77ZKQMClwtLno/3IQ1F/nxOmVqZLwslwy9 Ua2v3zATWEw9hmh6p4umoWSc5rCcr427QaRANATETVOX4druOLN2Mj4sISkB+s3XTixEPf mki5pDFjOVOM4lxn1uLSazZC+nqwHD4xHyx5LwlpP3I/KcgyXxlvAO9SsK6pNs25yr+aq6 tCEfGnn4n7fod+Jfjnn5Z6PiyM7pa6v9DypXvYZtPaCGAdDcodXvOrzIC/DLKGOXcxiUEJ dq547L4lwGznb6ptHy417Z6eTVaNx7I94lwl9z+sB7Ht6A9Nq6joKDt0awyH8w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671271335; a=rsa-sha256; cv=none; b=VlbmJj30JU90xFDvNBw28ExRvi2aRzpWTmV8oWBdRvOHPLyNCThzxA3NGW7B1uJmjg1hwr dzNSFhnCS2kU/nXR20XJvVZQMLzrprRCMB4cNmitnxT9Mfo7oeQ9YT6T4NuWf5MX2etp1t 5a5RgLDQActE6LBVG3NY2KfVMERnLbeLg21UH7Gpkn+vU83j4j3pGcF+gKPandLZ5quahY dbj6jj+k9LPId7r3jI7tktiXXY0rWqTVsYcvdbot3j2AT/DeDmBbwCM6LZjvKdCJ6qacoX Yoqj8dgFsJIEhPXlR3ZFEJTmqVKlqWHDSZRbq1C2Y/J5LTPkSRCPA6Sniv7KYA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZ1jM125szp6V for ; Sat, 17 Dec 2022 10:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHA2FLf063247 for ; Sat, 17 Dec 2022 10:02:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHA2F6h063246 for fs@FreeBSD.org; Sat, 17 Dec 2022 10:02:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: maintainer-feedback requested: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 10:02:15 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N Graham Perrin has asked freebsd-fs (Nobody) for maintainer-feedback: Bug 267028: kernel panics with ZFS and/or amdgpu https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #29 from Graham Perrin --- (In reply to George Mitchell from comment #26) > FreeBSD court 13.1-RELEASE-p2 FreeBSD 13.1-RELEASE-p2 752f813d6 M5P amd64 Please update the OS.=20 ---- Given comment #5 from avg@, and (for example) comment #24 the different typ= es of kernel panic:=20 fs@ x11@ please: if panics recur with an updated OS, would you recommend continuing with this report (267028)? Or start afresh, with a new report for the more recent type of panic? From nobody Sat Dec 17 10:02:15 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZ1jN2571zsxZ6 for ; Sat, 17 Dec 2022 10:02:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZ1jN08Wnz4Fyp for ; Sat, 17 Dec 2022 10:02:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671271336; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BIQt+s7r3E2j+5ODp56zdEoBmpKGxSs1gG/Pkvuec44=; b=vgDwan0OsrhsCo1HPUjT6+dSl2mZxUQm8fihPKM5ktU6bXwHdl3NHFA+sDAtuex8Z9MMTQ Jxv0XmqT8A35WGzGaDR/uLjSbRy2MkpZVIdokXtP2p1reLnscibZdXXDMCflmaS/1FakY4 4smau12YX/Jn3e/1uPIG7Cj74JENZUGpFcxUlaHQuDeE7PsKq9q4zDXGF8swgmsGygjX03 NG8AJLKzM0UTJQ5229ZwvSGguYy9wwsSp4wUHhVUcoI14+omq3XIaYFMPwbpD4XPvya6o0 PaAfTMcbsnGPdWj97BcviiFB9gxy4242lLo73Qi0dviqsgzX6E0Xiua1nJnQ8Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671271336; a=rsa-sha256; cv=none; b=WPO2b5GUHXVoVkzMlPAl+DlSsl8DdSCLUNoKm96udMsxedRYv62FrZ2hhEVmr2XfYPBTfH BC70nVMydaiMmk2jDGnYDOGI1dOZgT99jNMWYl8W+GVIAUravtsnU41Dh2+lfSQsx0uGrB RwSU6agFTQ0Wz1Ihk/97roURSPa6w4ONzM3rJI+g4scEQOltRmrD/ugKdMfUT00Dp9dhc3 aVbdZAf4Ceu1AXnESvzbiWhO16v8KSLmeIrTIfk08gtn8DI/Vd9Iue/Ys6dj6k5l0qA7XE V+lU5z/PLNSR5pVHjl23nGT1jXYEl8hw1CtDKq6Nepsiatzne9n/P4n5rwBMKw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZ1jM6LCKznsR for ; Sat, 17 Dec 2022 10:02:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHA2FUs063279 for ; Sat, 17 Dec 2022 10:02:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHA2FeM063278 for fs@FreeBSD.org; Sat, 17 Dec 2022 10:02:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 10:02:15 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: short_desc assigned_to flagtypes.name cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|General protection fault |kernel panics with ZFS |kernel panic immediately |and/or amdgpu |after kldload amdgpu | Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Flags| |maintainer-feedback?(fs@Fre | |eBSD.org), | |maintainer-feedback?(x11@Fr | |eeBSD.org) CC| |avg@FreeBSD.org, | |fs@FreeBSD.org, | |x11@FreeBSD.org --- Comment #29 from Graham Perrin --- (In reply to George Mitchell from comment #26) > FreeBSD court 13.1-RELEASE-p2 FreeBSD 13.1-RELEASE-p2 752f813d6 M5P amd64 Please update the OS.=20 ---- Given comment #5 from avg@, and (for example) comment #24 the different typ= es of kernel panic:=20 fs@ x11@ please: if panics recur with an updated OS, would you recommend continuing with this report (267028)? Or start afresh, with a new report for the more recent type of panic? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Dec 17 10:21:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZ27B15cczt0ht for ; Sat, 17 Dec 2022 10:21:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZ2796d5zz4Kpb for ; Sat, 17 Dec 2022 10:21:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671272469; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1TkqK2u4+sFi8T7LDznwpphGom4IKjEAYZSu9lonyRs=; b=v2RKOHP+4UoXc4sFTowprrrWDCPFkme6eycGWilkXmlXVFmTKmUWxqb0frHVDDBrSjOK23 eDgEJuUxtCH4ZouvXZRhNC+v3i+sGbOt45QwUMAnjT216KOyMxqAfXPzDjtZpMwevHW09Z rnL5Wa4onX8/df50hghFOWbjt3s3P9ZRypsngxu/XOqkOd//x/Kqv7MmltEjKOb3NpMmwW hxIKu4ttYTrLHcxw1+ZbdTvPTyL0OSin5dbun47s5+flTaV+a1bQeZaa44I/G2iefFVX4s qkMwa7NwDJTf1GtwVyavI3BcK+votGYXZy7amdcAOK90xAAGUkHjDqK7nTl6HQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671272469; a=rsa-sha256; cv=none; b=BjAxSsL0jvEAnc9ydRKwyeAPRnjJam9kDT8v4UvmQdSr0ltN9P2XQyQVgiohq8epHD/d4M SbPslxhryzik7dRg2oYZKtfaehHasR2mMdenrHb9DpOr97v/oLi6SXdhWRfAZuQoJq+yRU rC5KbA/zF//BrSSJb4oRmJa7NDoxU2nV3RfHTwkBtPzSZkJoiKQ9ezFnKOR+dbPWF2lYed BfNKd8sEM0blfXXQ0JldeljJiO/cVfB5atRKpoYxZNhI1bkl2kJeG7wfqseoFAmA4EGw6C BgzpCv0BYGqRJ32tGrlx+ENjKZMM/kOfBoc/cyQv3y+1M1kbZ650tiN9ZKDxKQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZ2795bvGzp6C for ; Sat, 17 Dec 2022 10:21:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHAL9FM092066 for ; Sat, 17 Dec 2022 10:21:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHAL96x092065 for fs@FreeBSD.org; Sat, 17 Dec 2022 10:21:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 10:21:09 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Emmanuel Vadot changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |manu@freebsd.org --- Comment #30 from Emmanuel Vadot --- This is not drm related, the drm message are noises that we should fix one = day when we switch ttys. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Dec 17 10:21:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZ27Q3qYvzt0V3 for ; Sat, 17 Dec 2022 10:21:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZ27P4mzJz4LSb for ; Sat, 17 Dec 2022 10:21:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671272481; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=e4jcJuV15AngJfnB527C72Z7ZiMep/oe0C41cVD27ZA=; b=tobN/sApk79gx5ioiEwEdE5Ir95X53HrJj5oaAzqK0UrqhNryjjpUQ9TsWYgEu/1r9Sjkt tDA+d3jF9iGKt8tCZgQz/Df3lVZ+rvJqPX06xtiljL0wWJsTe946mh2gu8+TeJbbnQEqlx u+pWxfAmhOaadv+W/G2Pln8Vsuv9G8wU2xQn3HDcNEFYqzLtboRGpvG4lzHoTNs00V0RCk zNbTIOLozfgiPHHTMJsn5gNSALSrc8zh+ThiKJtzBc71hZOGlgbhHITzW7m77cu7INCth5 UmA0xGj5GamlDAbd3OsECD/JnaqbthLn/XvRrcoRmpl4arr90qww/oNuD5tIbw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671272481; a=rsa-sha256; cv=none; b=ZGRKyuHrRAsdTwufpW+0dYJP9GCpRiYkfc+7xd+K+PA/4ePk9/eJ3IChb2Or132zp6ckQ7 MU1xnUC2lJByVPGbaOgBKeGr9VdoDdjbpDeOiGWkXCeHZWZvEDWUMrTZtz8v45NhlWzTiZ /BDBr0y8cvBJKm7qKOKDKl2TDLtBkIV021Y6k1nOETOLMSYeiZEU4HjV74XTS5CFQaJ+OZ nVr0kctVezEfCxZqCqEETSnRn1inwq7Weef3GxDuR0zGlWo2Y8/MkMRC0MIEpB0p+A/8+I /L+YGtYZDOALbZ36LxlolaxKrGk1dNdYd8kxa7HhQXRtcYk14e8tBf+JIQ5kog== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZ27P3t5XzpWQ for ; Sat, 17 Dec 2022 10:21:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHALLqL092106 for ; Sat, 17 Dec 2022 10:21:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHALL9O092105 for fs@FreeBSD.org; Sat, 17 Dec 2022 10:21:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 10:21:21 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Emmanuel Vadot changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|maintainer-feedback?(x11@Fr |maintainer-feedback? |eeBSD.org) | --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Dec 17 15:12:17 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZ8b52Qszz1G6Ld for ; Sat, 17 Dec 2022 15:12:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZ8b50hCJz3hN6 for ; Sat, 17 Dec 2022 15:12:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671289937; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kfGBwCpxvb94H+4SyHpxjhDw9Xbd+oXXzOwMfzHWeic=; b=PRSc0Y/5PV3Ypi6QnlTDb/wxMskC6x4GW15njfnbGBKNZuizRTbj+KLfXhQrM1vCjx/cOK /HqjkHGfTYsscM0/KJJxwqrBxIPPY8/Ab3sWAU5F/XW9ObmBfZcV/qWnLDzS7F50o8TNJS vSIml5rcmWm6CmMgHHx/C0tpk1xADu9tcCzOGoCgykKobUv9XtQmIdTpwfX7GBCbqtezdB INCoCy/XiBJqAV1//SyYWZ58DoU2F1COo/H+7gXm9+AFwyf8Nf9UfwjgThOM0aEjS/ThLu QHVnL5DwqFhcKmxbdnnnQ61ueK0utXwm6SsJAdB6trASeoQRkpdbhKcmmcKJZw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671289937; a=rsa-sha256; cv=none; b=P15Nlr82vrCoVCjV0Rd5KAjxs7wSSU0m8s/U+xsvjrMz3s/5Xz9Xwzn2nVLhWrd1G9qoZ4 NFlW3m/sdLp+OZyAAxK/CSvZu6spUDBsWE/lqQiqr5uIqCK1d6YScgIcRKP70MiG1Ocjny mJ0NPEULICNkTTI+VCFFO3V7SPV3I6cqJwl5ep4tiIiQ2dpaYtjkUEmdjHn3L+x2LCdl+n m4FKwd0NlumjmwjOSs6W5zHnOqWnqaDBh9cmgCZCRsOK8FoOMBsKBIkHXnUIbHUdkWcdAp t2V7Pqt07bomDkykfsJJ70zrqMSTf2RNk0n1t8YGt/AVsuKUjLiPbJkuQzDz7g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZ8b46skqzwVY for ; Sat, 17 Dec 2022 15:12:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHFCG7o021995 for ; Sat, 17 Dec 2022 15:12:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHFCG8O021994 for fs@FreeBSD.org; Sat, 17 Dec 2022 15:12:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 15:12:17 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #31 from George Mitchell --- (In reply to Graham Perrin from comment #29) I'm on the release branch, not the stable branch. So you are suggesting I update from 13.1-RELEASE-p2 to 13.1-RELEASE-p5? And then recompile the ker= nel module as well, I assume? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Dec 17 17:45:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZCzm0Mppzt9LH for ; Sat, 17 Dec 2022 17:45:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZCzl5zvfz428n for ; Sat, 17 Dec 2022 17:45:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671299123; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6MKhoVr3HGfIga2NukuZd27lszj+IyK4H6Xbe1adqvs=; b=TCmSpntElCMaDAu/TiypN3Uj4rdMSAQmZpJAaiClgvA7meg0ajHVCGSkxHIcbNAR9PKzTO gG9UtTxIrqKl4VUz9ze9UU30xrX9+P1A3gggSbyExwRtvZ1/H3Tlh+N7gs1U3CASSzEE0s OmLEuIwSW5knT6I/Sg1wxynuzc7dNpY5PXohKr5SB4YP2v0WkCenvPlW6VGG+1dXcTW4cd CNIfYzB630pjKMMkGIMcRKS/J4zugoL29I0cAnMUTDHKNzKf34Hh6htTw46E3KFOAltLMN xwSZhpNTGTiYvrQ+coK2Mn0aKwmUbA8y+2q9Sk1Ms5vNTLU+QZgOnfSIsAqDhw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671299123; a=rsa-sha256; cv=none; b=af53AaRCTWMH6qIOm7a8G8U/mESv+z/2KlQLYsOEc0mTBgzybSrtOery0Ew1a63rzC0uKD 7nHifQxHD9Qez4qZhQzsKcSXDUmA9Im8o2PK47lCRXQrfsHetTu3MjBKSwlnyQRwrBZFSk HJy5PiztCJYPseUhuxdKqjyVZFvI62cW/8DqygbxSi12zKxz36IaIA2bnlvRNcd5/B8wnp eWAqCwhAiNVPyUEe7MjAnzR0ycVY4fkblfd1WEzEI+5/reBqBXCtIWonF9g4UvdopxFDyx 7HRwgT1DB9lNtQr9XlQzsAALh00YNMrHYeq7aaVtl761xqvIpWRhPHP8Zm1RLw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZCzl54bXz11Fn for ; Sat, 17 Dec 2022 17:45:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHHjNVm037420 for ; Sat, 17 Dec 2022 17:45:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHHjNnk037419 for fs@FreeBSD.org; Sat, 17 Dec 2022 17:45:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 17:45:23 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #32 from George Mitchell --- For what it's worth, I'm doing this testing on a desktop machine, so setting kern.smp.disabled=3D1 actually doesn't impact operation too much -- except = for Thunderbird. And so far I haven't seen the crash with that setting. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Dec 17 17:51:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZD6p5rGSzt9qx for ; Sat, 17 Dec 2022 17:51:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZD6p4SHHz438n for ; Sat, 17 Dec 2022 17:51:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671299490; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1fcxj6oiSToz0LqwmNR+uqDBK8pm7RceNnKYlr1XDjY=; b=i+jmeX0ZI0LVt+dFYKKAhoMgMJ1trsn32Xxliw6OzNGJVsmEQeSjcahDhbsagmhRAbFo/0 KPNyktLJ+wWv9I4/CbXFvv8YfnV6to3x74nSeQ/m3GEZVNl5X4QvDZqVz3UvO6aDgbUQ5e BznKQOnm2wQgMMPIaVxmzrN7Z3+1T0hQOTR+9apl8DsZo7SVlM/gUnWFiOq41Z9WZa3LtP Qk7EKZWfdyzKaUHMCHBbBUPIxfOeUAo2jWqL2eN/iHwVN1ZqMEGCKucvuaQb5q1HSqRl7t YgXEAK4GjmMz6BIv561/gLQG4a3dqlW/iHFtb1ZVxNxjtTNkQ45sbGyWEXYCHQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671299490; a=rsa-sha256; cv=none; b=XKkodozKPdDaE1GAZ++yFcE9phonz4VkmB14WlSzv/ZWU8JKOWfEaL2TWZt0ZkV409tY8H VkCEicEwjOmwWupUAb7JhvX1RcK7AA/egxRArk0d3wTRvQ4zlDDxf0jXALbVFQxV3BWhrw /Q/33/WtUmlLAIPIaSwX8DByFuX/S5oNn5XEKhEdS/rmVcB6U/6uqSAlZqDFsBS5GtqvbB SNbOapg8QJJeP/oL9053DPpGj2cp9po3Pf2F6xUWEZSSTNqFpwJwSnq+B9kDQ2f8nGgww0 y/r9MTEK4gdc3RsBprxp69unLKbsbCfSANoir43VOs3TMqpVxef3Wp2yn8Bajw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZD6p3Wtxz1131 for ; Sat, 17 Dec 2022 17:51:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHHpUSB047377 for ; Sat, 17 Dec 2022 17:51:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHHpUeh047376 for fs@FreeBSD.org; Sat, 17 Dec 2022 17:51:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 17:51:30 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tomek@cedro.info X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Tomasz "CeDeROM" CEDRO changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |tomek@cedro.info --- Comment #33 from Tomasz "CeDeROM" CEDRO --- Does switch to graphics/drm-510-kmod and updating graphics/gpu-firmware-amd-kmod helps? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Dec 17 18:03:21 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZDNT3mV0z1CWQJ for ; Sat, 17 Dec 2022 18:03:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZDNT2Gknz44qh for ; Sat, 17 Dec 2022 18:03:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671300201; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8qflNxasr8GhFiYRWWGQJZFKM08I//ItoDLyr2TtXQs=; b=UTsfE3ExBlCIn3TmvIskVsaAlSi5pCNxYOXVZc48xqhVQrWTdb9pq8+JGoJD0PmM0bBA/a DHms5yzaflQn1h7HG2ODOIb3NuiMN9YKmpMmDCHUBsDkW17DHpumjiqGyAxsEqeKg0rPUf A6LqYqKGxHDXC90fyp4mqdyaB6Mm//BzLwV8A++Ngoua+eNmoNScIJfOfgOYCGNZaCe0l7 NFuuhACQuie/9zmlpEM8Vosg87Xp3MQTeXvOF/QrSf6OgASD5CTOxThhgkpq4mVoVi9+6+ Mq5pA/E1nlDj6DrNxGmUO1DEcVb14MLwnKKEPkxNtZH0qZCynRGaDVc9TEUNsw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671300201; a=rsa-sha256; cv=none; b=qecg7o4jNBPQRnG+go3KOZ8eFqZf/dnVc+m6KxfwQkRRjyjwNXjWyquBX/lUJq/ZMBOWac jQvzlcwmjcBtCUHeumqZGmBq/bMTWSKH58hLntL3V8P6MSgXc3J8y1+nEq0OoyFklGS/48 AW/8cB2XjHsINL8sDzFx76CVI4kHHo448tKFM13SAWROQou9nogSmhW8B3kDMh+PWkp40w 9B/750wgd7fgi5vJunR5uG72qrjt+8fCstnVGAWeMLNnezp1NcJ16DiRxpg27RyINhIeGj kyJl9/ZTjB6Y7y1/ad2oNe/sySqi9VLFdv1oRHxt/jXBUzBKipQ37c11EG+Bdg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZDNT1MfSz11wr for ; Sat, 17 Dec 2022 18:03:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHI3LKD066392 for ; Sat, 17 Dec 2022 18:03:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHI3L1u066391 for fs@FreeBSD.org; Sat, 17 Dec 2022 18:03:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 18:03:21 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #34 from George Mitchell --- In fact, switching to graphics/drm-510-kmod from the generic VESA driver is what originally triggered this bug. Without using amdgpu.ko there is no problem. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Dec 17 18:33:59 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZF3r0qVGz1CZbQ for ; Sat, 17 Dec 2022 18:34:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZF3q6WYdz479y for ; Sat, 17 Dec 2022 18:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671302039; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jmHdYPvFFlHCotigWQnE9XplwBzyHdYe2PC44dW4WIw=; b=CsbnfgWLoX9x/2ahhp9U55rcQ/sgrnaVQRzdX9Zsh6kC0ANio4wN0wldgYdrW08/orznuA XC+fA0/099eBybLdJf91/8BLA+pZDVBLNLYe4Er7W37HewOFA69UxpJFbqLrLaEE0/fOBO gTcVlDhAxKggmg+GI9xCArEcK3qBujq6DmuTGv1+MXk+SuVCbamgCxHpyCFvhK0ADCr8lo xLOki51suEso1Ev6gfopdGTjFQycUdzq1SxBj3RkXyxvmDCEu90wNK/IOb4WxLc78gBIYq CXUhHFj8Fa1hp7dIqsaODpR9ZE2MWHu7OfyyTVlGkessL5YFlwuvuINKWeryZg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671302039; a=rsa-sha256; cv=none; b=BdRXWcK7sgMvV8K4IjGKGx6TpRWiywR9wZ9PohJtG+EU9KWhkfqvM5+P3QlU/kEwEEX10Z 4GTe33VT/XbPa2b/dR/qNUvveReOH2S3Kd2ucq+wZBU2lKeFD9E10QoOcApLhBuz0y6yY1 FUAPZxhw37aRbOQEHPrrvRMZWNyOLxYwfNM7iQ8wFalHdLVfG1VQZt5uPoFdFWemVLm3Ol q+1GeLFWP+9Erv3uhEbipmqeHs2Ww9Np5SLbG/WJJij18b66ryCrJ+nzLxHvaqL+CpeQSb iAAe0rlIx4YNRp5VCLkbcFZo74miBqTfgbM7Ps9eUUg1dutJq5ba4jPawv3cFQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZF3q5Zd0z11yG for ; Sat, 17 Dec 2022 18:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BHIXxap011649 for ; Sat, 17 Dec 2022 18:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BHIXxLG011648 for fs@FreeBSD.org; Sat, 17 Dec 2022 18:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sat, 17 Dec 2022 18:33:59 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: manu@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Emmanuel Vadot changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |manu@freebsd.org --- Comment #35 from Emmanuel Vadot --- All your reports show that it's from zfs, again the drm messages are noises. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sun Dec 18 02:16:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZRKb578czt2rH for ; Sun, 18 Dec 2022 02:16:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZRKb444yz3vRb for ; Sun, 18 Dec 2022 02:16:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671329795; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lAHVO0k+wDkshzfVWHdWtwQ/KT1TsjiBuS3lEqdPAbw=; b=xD2bV+JBN5l7a2s43NU7l5U9FEYtenjWyNiAw267QJpnpnOhZ9WWmYqTrbEGb2RHdoxGvk A1IzbUN+a1bX4sFdZ9L+7Q4iyuWeR/e7Mw/fXrcIWjXPfwwzhc/GaN7Kcia6g1dpGjYPh1 Tx2Nv2BatJT1m6VzJLeLa+93+fB1z7EoHqbWrI9Yx6D4SvgK86ugAgTpzQYkf4HEU+EfrP atn4gvlp6Swcaedo2Pte60n9OI0iY5kIpFK37blLaIyz4vtuVDR/ax3RXWr6xd37XGd62L orMiAehTrO5rskfDu2n1vInL5GlAypjaZlCDgfYDUeGik7WS29/F5EHkj87LOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671329795; a=rsa-sha256; cv=none; b=pkQF+OO2aUoH32N0cN+JoITn5PLt4XdiR9KCD5XVUZCCghID78o2nY5TMD2WokctxDA76T 0sIKZKrBcdD8u4X1uPFTxu/nNqryXU4JkSh/MlteBTqrkmL85L4yhGZoPksNPA99M0C0E/ tfT4/ZTwBfbP7EJPtkgvcxReGESuhYqO3OVOKuCVYiA6ubUq7Az0l/GIyZSlfzWObWXnLX D3rOVzneMMUWcmADHE82ixIuvZCWkRAGTBb6Djq+9ui4oW9lgLtqqrtYxHq/IKZQBaZ2m5 iFeG/Yk7mLLE3xQ2sFESiorUZtJ7B0mO6wFVFIygKtrV4X4bIBV73jDVAMU44A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZRKb37kZz1Dlg for ; Sun, 18 Dec 2022 02:16:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BI2GZD9070138 for ; Sun, 18 Dec 2022 02:16:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BI2GZ7F070137 for fs@FreeBSD.org; Sun, 18 Dec 2022 02:16:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Sun, 18 Dec 2022 02:16:34 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #36 from George Mitchell --- Created attachment 238886 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D238886&action= =3Dedit Crash after updating kernel/world to 13.1-RELEASE-p5 This is after updating my kernel and world to 13.1-RELEASE-p5. I grant you= the backtrace here sure points to the openzfs code, but why does the crash happ= en only with graphics/drm-510-kmod installed and amdgpu.ko loaded, but not otherwise? For the time being, I will be running WITHOUT amdgpu.ko in my kld_list, and I am confident this crash will not occur. I got maybe six boots with kern.smp.disabled=3D1 with no crashes on 13.1-RELEASE-p2. But based on an earlier comment I updated to 13.1-RELEASE= -p5. Then after going back to kern.smp.disabled=3D0 I got another of the crash. I did observe that something in sys/contrib/openzfs/module/zfs got updated between p2 and p5, but it doesn't seem to have fixed this crash. Compiling graphics/drm-510-kmod under p5 yielded an amdgpu.ko that was identical to amdgpu.ko compiled under p2. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Dec 18 18:34:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZs1N4mDRz1Gsjc for ; Sun, 18 Dec 2022 18:34:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZs1N0Ysvz3Dcl for ; Sun, 18 Dec 2022 18:34:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671388440; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TwtCDqO+Fz6JcxzG64ghkKJZ/AO0dF/5VbdWocA4rYU=; b=cq++0qvyuimfNlsy+MLI8oV8RqRKaqJWSvWNSCxP3WZAKgrnkf43uhqBU0Tf+3/5n5f5KN 2ivKDzEn+UDvYvC4zCzIkcfEvaHGLkJTR/Gb2/A19Pv6T7QJrrQdYnPL3OB6n2cAegYbhJ w/Er9jvWisU6gApw4kQx46mcXknfGJgbKDw7Pz7dVTTXIQgacIjAQyIgdaHEJHdByVZNvl 0cEzGBibzn9hO/tpcPzaHKXHUhtYkwDkkDdapzknNbPJXf0V6djc+TNyDRg4hywFMMM3Di G5eJFsqcKbbChefx8YYO6xmuIE/KpuDhIVQEPqMF/uRlmOUevja6nxJ3PURsTQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671388440; a=rsa-sha256; cv=none; b=hOoGV9Y6rNQulxQZJVRgfO50JwEKKSliTF9oR2bEJ7HuDYoSKXMkMBjgb5k9rZhmPQSx52 2DQKUpeRmQmSWnfxM1ttgUPfUS93K9GcP6+B1orQPBKkvnokRoh+KK0ciDEC1Z6kMTo5s1 98io/zYA8AlL/x6PP++Pyu+afv/kgk1hZKNaLqUqLg47aa3NuaYuqDuyQ6upUQlbk1Xz9b 6RMQdGh+rRMzfI3OcgiGZ+v85dbiupeo1Ed9wfEtaWiNskqSQYsDcnCVg9S06R6UJx9BrN WVehi2I0AlPyC1ZmfIa0bm1tWboReDDhHhKqzs1iTOjhum1HNGTBhcQqgdICYA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZs1M6jvbzQry for ; Sun, 18 Dec 2022 18:33:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BIIXxw2085011 for ; Sun, 18 Dec 2022 18:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BIIXxRT085010 for fs@FreeBSD.org; Sun, 18 Dec 2022 18:33:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268416] Crash on boot while tasting large USB ZFS disk Date: Sun, 18 Dec 2022 18:34:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268416 --- Comment #2 from George Mitchell --- https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D238886 from bug #2670= 28 is another instance of this crash, Although all these crashes seem to be happening in ZFS code, there are no crashes when amdgpu.ko has not been loa= ded. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Dec 18 21:00:27 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NZwGM6Cfxzt9hh for ; Sun, 18 Dec 2022 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NZwGM3Qn8z3nTP for ; Sun, 18 Dec 2022 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671397227; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=N6OXQ/RssShQXY7FTIBsO9+TVEuIcsAFoBWNK0nKZbo=; b=RLlxDtgJWRlOU/6TMn2lkVifuu6nD79eS9XcdnYFrAsnEnOiBNLD3yQBUOcNuCyoIBBtB7 TUbjbk3CQvSjbHkXOMFIAjiwohhFQLBoKx3OcJgCM5oGTu0MuAhESg4998zUXzWH2s1pBP qb7C09H/usmkZWlslm4TGz9/YYxubtiOXgP379vuBeHFqcp3jbDWJFMLlbsdKqZsNIIBpf RIgA89LxOjUDfkEFhhdol+G1oHhqwB3s1iu0Hw3vICvuDKZE85i9PWySMAG5j6bu8Bp9Zj +l61eiihRiBZKggfPncHBupHK9XsgOcXTzw5+Ad2up2qj9ZJysRM8sJNoOzgKA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671397227; a=rsa-sha256; cv=none; b=DVrNIM3jrhQFsiK6pNvv3i2ZlshZSS/T6PiKqHcJU/nXdqvWkhU/4h2t58/albqkBwqZoY Nknj8/D4hUN5/2eEQwkc9IpWVY0ll7fyn6GSCgocxdR6iMyJUK/KJ4+458s3Jrhz+PQ6YL v4lqZcRAaUP4iVUoinxurtItzszsQBp7SpuwPn+yvalQD3y6HNoi7CUTa6Sv8P4lmGUWRD ky7Tc2BVgyoSFEAwUEAwHo33DTKWvMHNdjrbcY8Rc57A67rdSgpeplA7szunOncq5ppa8s gY2/yBA/mq/GMklMf+6gRTgrpjg1I0tnchXoRgUjnWGQ4jFG5UvHMkqc/eNXBA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NZwGM2XKVzVv2 for ; Sun, 18 Dec 2022 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BIL0R8L088430 for ; Sun, 18 Dec 2022 21:00:27 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BIL0RX7088429 for fs@FreeBSD.org; Sun, 18 Dec 2022 21:00:27 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202212182100.2BIL0RX7088429@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 18 Dec 2022 21:00:27 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16713972270.CDAcf.86272" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16713972270.CDAcf.86272 Date: Sun, 18 Dec 2022 21:00:27 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 6 problems total for which you should take action. --16713972270.CDAcf.86272 Date: Sun, 18 Dec 2022 21:00:27 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

6 problems total for which you should take action.
--16713972270.CDAcf.86272-- From nobody Mon Dec 19 12:18:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbJd80Qhsz1GnHV for ; Mon, 19 Dec 2022 12:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbJd75M9yz44Fj for ; Mon, 19 Dec 2022 12:18:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671452283; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w8UpbHsHEVm8wYt0tuvEDKqK6II+Z/Ve11om1JDU6I0=; b=SK7S6Rc9gjx4crfJI7WGvkS/MjjyHFopPX2zt7TWgREYbMTKA1n4DiNwsAWdyMMHDjQ143 OH0yAfw3IE46DhcBc0fSqC7G7LsP9rFzgFziBxA7HvMlXtmcfqlbVhWqosVpX9HabzAK/L Y7brzd0RgklUDEJtLT+2gMLByM6psJehnU3g80OnfrYr/9AiPVBYZR4gp5gmucwGxZ9r0M eAg8N/gGLwg5QVC7pfe8OMKL6LYDstF3PVyJeGFpGsnxWOz6xAnkmrlMdXod2BzrTPD0wf esUWYKExblMNq2RLV3/cH9uwvzNx5P15MmXNSsWj7/ndgMQFtSqNwpS/Fg5l1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671452283; a=rsa-sha256; cv=none; b=hO/I0N5AZmpWQqLYwPoaPHs5vHVFUBRXGonYfKwgirIWhXwLlrDAj5m8OOhNFpzavoYdQ9 O13VvkZXQ/cjp5o9Ok+azeQ93ECGnQ2bOML3EXH2xlIYjhW66x4MhCfTcxYwHytkhk1OT5 Q6SnUKUuvchUNT9BvhxN9v8edolwHYTvbXh4yDf7EFKYWyalA/MqP36bpesxrNGO5yPHl1 VNVTEVyhH4av5tc1xXn/15/xy6y0AOSbdCdp/J/EDzwv4GJcTcaUi8feCxzXrwWzzB1zpX 2H1gDjQNge9cLoKJfBmr9QlPQ1NuJrZX7Pc/39EoaJG4jeb2zKaW6aewcHZpRA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbJd74Qs1zvrh for ; Mon, 19 Dec 2022 12:18:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BJCI3Tf025255 for ; Mon, 19 Dec 2022 12:18:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BJCI3QB025254 for fs@FreeBSD.org; Mon, 19 Dec 2022 12:18:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268416] Crash on boot while tasting large USB ZFS disk Date: Mon, 19 Dec 2022 12:18:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268416 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 670 | |28 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 19 12:18:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbJd92P0Vz1GnY2 for ; Mon, 19 Dec 2022 12:18:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbJd869Zwz446h for ; Mon, 19 Dec 2022 12:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671452284; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=q/wrBRNRfY3GzlFjM7Fw3VO+0/aEmYqi1gQYU1yuK1E=; b=Qem1ltyvwCNHz96t7VrYd3M97zoVGAoso3hEVjMPxjFi1JSgld3tNwOC6kI7YXPweTMUzX Orqw9K+dBgx4qX8160UFcsRAvKcJTI/WdSUVmwnFzTi3LzG4EBUArVctcNnRtyNUy1ZXqr 0mOc7/pHwoU0vKcavVlXcLNOOkYlmZnZPCdHQM1t5yF6SKe4OAnuf/cYMMD3D136LX7Sqt siY5YkXYxVVIotlZRqhE6AX8MFTfS3RxT6zA5XM1vBPqnT3gQpBmXhdPXot0sNkVQ2gEeI llvqiSlnCejqaeK4alHW2++zPje9xR1GxNMlFPEuVx0ioRJrOLjxhVvMQIUKpw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671452284; a=rsa-sha256; cv=none; b=KyhrTEK2Ddxn/j4boDaSrm2I++SO3u5rlNjBILma+IPrTIzw+a/bVVc+veNoOoXWBT+hAm laCU77O2U4NgZ7hs51qCyEEtvGH+NMSxELktutkVKPPUOiuiAB9rGrYbidpDhea0rZ25WW CxZbYm9e2qMnN4+R4CXXfg0zDMoGVK61z0dzpkDj87JET/1n4h46cKFgRy4YIZb6G5LvE1 NZl7VP2cHWOV5f4ZAS27wZYdU6Iska2NxYJcN1chuJYis//M/kRZdothWwCxq9+SwnQ8kS vgsB6gkTCj3yPdpQD6p6ZpBZ+dNIgUBaarSkivS9pnnn7KKbHZQV8l5Cwa2QAg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbJd83SFyzvPB for ; Mon, 19 Dec 2022 12:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BJCI4va025282 for ; Mon, 19 Dec 2022 12:18:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BJCI4JQ025281 for fs@FreeBSD.org; Mon, 19 Dec 2022 12:18:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and/or amdgpu Date: Mon, 19 Dec 2022 12:18:03 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 684 | |16 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Dec 19 21:21:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbXhJ0RHBz1H4Xw for ; Mon, 19 Dec 2022 21:21:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbXhH51nzz4P7Q for ; Mon, 19 Dec 2022 21:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671484895; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vk8W8rRegPKJe0yFF5ECzdP8wppTXo73Zewf+Yd7o2E=; b=QbfmxesIoCv0sUPVV2xtEUVjfXwJYxrU7gK98aQp/dx9N1RlWuCo0Gq2o/vRZhQj1hXA52 3TUI9Z306izIP755W8ID6L+qnf1HZM3Sahmi1rnDfLSeHQv+Oia1ShaqKLAJzd+sJefZ8s 9H9hUkWxxh0Gxt/BBlsYnl4yKHf0kaSJxhxqZNYDBMyv2QGunTvwYpzIFL4PjJMv/5bIH/ LmYnLsvwehbp7wy0pdbqPS1cuOCHMsPbAoBbg4fjWergLVSPnzsBCYENhdTkGserttNJE8 nIt64mMrp9DTat6l5iUya6lpWx0Q3CAnytBmaYEsZa5/CNOgEyDskROC/ef98w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671484895; a=rsa-sha256; cv=none; b=wZTdSbKSG8XMHlLAgS666tSnDLAqyVfxFaHLhEsuIWbQ/7op8o5YzoERYsaZKM6O8lZW9+ ngyw3rfnLnycoDVfo//fGGdGluEHhZA7J3C8jigjbYyo9z7CnO7Cg02PQK/NTjoFax/F8b aLNAxZ30PQZtAszPWTxyX5hMtQNfRT6M4mLDWHO+C6xdzNRqeOAyL4e8J+qD8pWeGfriim tyiq85cYdapuMcBiljTzPiuiZtJEvNLaBereVCukXa8YhLQQ6qPjy4rJiXwBVUeaXWMfDu KjODzdj4GSf9H+7gsGF2oq/mB4G+1RZcjDn338AfueFuVoUcIUS7YeDZuiVeUg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbXhH47lNz1984 for ; Mon, 19 Dec 2022 21:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BJLLZx3010914 for ; Mon, 19 Dec 2022 21:21:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BJLLZw3010913 for fs@FreeBSD.org; Mon, 19 Dec 2022 21:21:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Mon, 19 Dec 2022 21:21:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jhb@FreeBSD.org, | |mav@FreeBSD.org, | |trasz@FreeBSD.org --- Comment #1 from John Baldwin --- This message means that an internal call to uma_zalloc to allocate a PDU structure failed on the server side. This just means that your server is u= nder memory pressure, but that it handled that condition gracefully. You might monitoring the memory usage for the "icl_soft_pdu" zone in vmstat -z output= to see if it seems like it is growing super large. Alternatively, it might be that you need to set a limit on the growth of the ZFS ARC to leave enough R= AM free for your existing iSCSI connections. Limiting the ARC might have effe= cts on other workloads, so you'd have to decide how to balance that based on yo= ur needs. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 20 00:10:05 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbcQk0k9Mz1GF0d for ; Tue, 20 Dec 2022 00:10:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbcQj6Gtdz3jZ2 for ; Tue, 20 Dec 2022 00:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671495005; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KNEs5fDjnmvbCs8q7w5r09pU4LhgTr89H0SibkWTXXc=; b=jVl4H0FEuSinSQp4liPi661zCDfCJEHbSklQJS3q7aFn5xvaQjS7PrgJXIdJj6JTaSE2EY xE9DlTYHBLj6/FORkiJiN8vyPdd7Ryc7uBdDa/eN2wQ7hS4OUeUlglTeh5q27F0HI6ZgBP FmuuZvORJDJBzgvbxCwfwokciX0KG5c7D/mJoeBfTz/Wfwr4N4ACQyUF3dsaMzJp0Ct7Ic Ta7YvLGl8/ZCYCNLer3TimpJ90DbwxjsGWXVcOxPsJUCes21VpSeisnpWGb+tmi9r+bKLL o0rv/ZHs5Sq5aXgfy7gVuswLfHmNRLL+VrJPtJs9mRTcWFCihAQ8hqWeb115HA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671495005; a=rsa-sha256; cv=none; b=nHs9fimJRVSAOPEnM91/PU5kN47+OQniM7NtkfoPZgC4FiJ2EfAC5mdVtV6DTvRTvMzNR9 w6KzQoIsibLeVkgxr2klD9CLShRQZz4sBEkx3ux4Sf+m0Fm/gq/uMOG1ff6SkGvXYXW90x EAdNz+mZblteFdtVj5lKwPwBvyYYZ+8lWiTgpzc8bgGvxjZpyU1bjMRPFsxv0XSq0GDpCU nyj+qdQu0KCPCFHgiYu/sPfpoUZSXPFmwqQTd0HT/rwtKr142NXYdNaiWgiZ3kZzgZjnW8 tZnU/doY5HOcgK32goToMDhCG+5QDICGYNcFCVIVz0Qq8Jb973XpGfYE3fUNbw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbcQj5FWLzFWg for ; Tue, 20 Dec 2022 00:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BK0A5gi047776 for ; Tue, 20 Dec 2022 00:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BK0A5th047775 for fs@FreeBSD.org; Tue, 20 Dec 2022 00:10:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Tue, 20 Dec 2022 00:10:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 --- Comment #2 from eborisch+FreeBSD@gmail.com --- What's interesting is that, in the latest one I have data for, the free mem= ory never fell below 10GB. (Granted, that is only being sampled every 30s in my logging, so it could have much lower briefly.) I see a spike (monitoring vmstat -z) of a large number of frees just after = the error was detected -- abd_chunk, zio_buf_comb_131072, and dnode_t being the largest, freeing a combined 2.2GB, and a spike in failures for 'vm pgcache' immediately before it, and continuing immediately after the failure. I've p= ut a copy of the logging (1m) of vmstat -z and some analysis here: https://github.com/eborisch/pdu-error/blob/main/pdu_analysis.ipynb The log stops _after_ the error was detected, so it has considerable data leading up to, and then one data point after an instance of this error, if you're interested in looking at it. In the interim, I can further restrict vfs.zfs.arc_max; I already have it s= et to 75% of the 64GB system. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 20 14:19:16 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NbzGX0sPZz1HG6d for ; Tue, 20 Dec 2022 14:19:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NbzGW654qz4JLW for ; Tue, 20 Dec 2022 14:19:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671545955; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w5yLgzigkyD9SC1I1lPIgDqKRvwgvAkL3i1/RYu/zl0=; b=vcOmxdG+A86HR8vcmnITn1JZ9gj/VrDhgS7gRq68flBegu8A2AbfbtvYck9y7EpmsmgCbs T0galKTl4ibPsq7wqSIBYyZjdAS+LsHpyglFlMSi/rYkcycmd/dp2Odk5siWk43x/f1IRG O76yHTzv2Yws8H4CcLDdC1mmkIekJdM3PhqcYaCZhtJpuxjsHpkPito1dlJ6pJDJBmBHyP MO2LGTZCYjDAnjNRpWDKTfqdl/VoAdppBQ5Go2df+RWTtRiluCUHQnR6CP3u8rC1P0N8KJ HxYRWBge8UPWFxF7q6lSm7pcmcVxdPTz6ioTluBn+HkPD1fjAq4ekE1FvPPvBw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671545955; a=rsa-sha256; cv=none; b=IlQ+Ebi0OuNlQ7mO1Oh0qwICoF8/LUvo/PjKYWSvlUuvLQI1YZWKc3OPIW2usuQbxzBlpw OWybgI0eXq9EnrbzT+oiZ/nNkU++R7HMVIGFCOOvoKzWGdMvfLTusIBT3LCLvBEFOS6Ac0 u3W6YQGuVaqluivMkJqrqPiavkSx+NAACo4XikFviN8go/C14kvqBgt5Gnzu7yMNXGYaBz zmUOBWxQdsI/whXEcBNnHOVRbKppiLIt1KcuoS6plciYFUWxdVu3Efo8q+wyqOIGTju6qb o4Wirup7e5yIJIAj6+hz0LEQNzeU2SzT8UyYgL4utm7ToORA6h7KHmmLJPPhnA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NbzGW58GLzdlr for ; Tue, 20 Dec 2022 14:19:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BKEJFnX074151 for ; Tue, 20 Dec 2022 14:19:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BKEJFf3074150 for fs@FreeBSD.org; Tue, 20 Dec 2022 14:19:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Tue, 20 Dec 2022 14:19:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 --- Comment #3 from eborisch+FreeBSD@gmail.com --- Should I resubmit this as a ZFS / memory management bug? Is iSCSI just the innocent bystander here? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 20 18:29:25 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nc4qB0hX9z1GMjq for ; Tue, 20 Dec 2022 18:29:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nc4q96mYzz40fS for ; Tue, 20 Dec 2022 18:29:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671560965; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1a3+AizhRF2hC72ZuK5/QR9T+nQ0LzegGw0Tu7MHkxc=; b=lfFZpfj1lACWyfFO54ftsr/DjJv9dEBqACkFAAwmfAuhrk0PYUzvu8rxCAUAQq5EvM3lSF HbKLn2Qf/RpEsyml7evLcmTGGHoCx7AoduQb3qWxhpwxSRQ9L9D0UXGnHdxKF3HDNeMeRF F9R29di5wYd1ade17DgCkosQcOsX8qFZu3LIFncEF/QzsQMrAOdMWxY3zmfdBVY28cS3Dl BVQHo9ddu9ZlbfMaQHd0FejB4EBJxyjf7mii/Q36bm+7/lCDFAAMebQPMFnXkr3iYkBCR9 KKqVNBTe9BftiClWRy23SzebQxIPtAwdRZ2ii+HQ9AuRkN0abxZmjID6demv9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671560965; a=rsa-sha256; cv=none; b=Ad5KwGLuF90AhfRVISqirogcEiNygVXROnwe38oCn5IdxXpJysoFEOF9yYppoWveXGz6TV zl0PzGZ7lRyZv6uTIXhQK2ucafDN/z0hD3x649g0LaQ3DJ4XikTWJC4KTmBi1Tconc9F1+ s9KhK71vwcaViONwgu1h4wKpO9p9bWnBJMIMwDnOakepNniz9gs2hZqvD52ub30dm/OUL2 lO4WfPhlXOaT4GVMO2iQ7QRKpYxeJtrX+yicqcKYri2FK5vfgVbiYwqgoRRYerwYNaSL1Q HUwrqhQUwcLdkhJPi7OJ2yQzgfrt2y1s6Fhm/enEEtEnicHCG0oeZVcYapt5xA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nc4q95rDxzl39 for ; Tue, 20 Dec 2022 18:29:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BKITPLL032658 for ; Tue, 20 Dec 2022 18:29:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BKITPnM032657 for fs@FreeBSD.org; Tue, 20 Dec 2022 18:29:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Tue, 20 Dec 2022 18:29:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |markj@FreeBSD.org --- Comment #4 from John Baldwin --- I think the large number of frees of various items is probably due to the vm_lowmem handler running due to the system running out of memory, and that= the 30s probably is simply too large of a granularity to notice the event. I t= hink you'd have to do more work to figure out what is allocating more memory dur= ing the spike and why. I do think iSCSI is just a victim here as the relevant = UMA zone doesn't show up in any of your graphs as a top memory consumer, just f= or allocation failures. Note that you also had a fairly big spike of vm_pagca= che2 at the time of failure, and a spike in requests for several ZFS-related zon= es.=20 The zio_buf_comb_1048576 wasn't in the request graph at all until the spike= at the very end. I don't know if that's another indication that vm_lowmem was triggered or not. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 20 18:41:46 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nc55R0yqvz1GP4d for ; Tue, 20 Dec 2022 18:41:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nc55Q71QRz42Nd for ; Tue, 20 Dec 2022 18:41:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671561707; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jX9VkJq7dHbPisN7cyHXe3i4SU2ObEbus+yKEZtlF+g=; b=OsBlecZ2+BFaXw0bMmqtg5RBPVNM0OgQ4odeycOXPa1IAELH8k+bZ+NKWdYGYuY9SJ+5Qp pGXzBx2I0p3CAwdLjTcd4GnWM0XiE+fnDyFbOjNEv7waKpOmQWuOTTyTw1RwY4HwUSaZAc h5b5AK3zvcKmk1PcqBSUicnw5TorSPfqNhguedYjuJ47taeUS2N7nK1LM17mDFXZiT4WU+ UPlU2L6/lMRTXK0NGx6dL9ZbDyX08eISmG2Ucgvx2yJOkAq59ozqPz+EZXhF0gbCzCuqgu RKK7PH2laJBtilhfx4OkUMCmvjJC3f2z08k8HntrPJfek2dvi7exej45mWtVOA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671561707; a=rsa-sha256; cv=none; b=iAiUfikkRB/qOI4934NvqXnMHcMN6GnOPgs9pHRugNQFlmY/KSEFfA+LAgEMk3Hbs65P+i 9MdyLVDmN410JyNjMVxS/56X0yxYJb3gtQFhNC5Prsr3UjEAVKUVv+NmlHJrOqXwGvySE4 Bq+FjWp9N3GulwEVQI77xwmevkEi4GmHQVYjBZjFgTwCFip0iwC/veJLTsffRQbVJOx+pv mTzE4k/9DyZ7EishO+qdIYMfLL8wLtuM09ScDJUDT0F4qXdm9U5wXewV8mBEK74CIkgrrl WLCV/6IQUdw3GeAr1DjN/QxY65D+vy3xkqRolCanoeE3+AioWGeU0g5GcmQ9rg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nc55Q5S9lzlmd for ; Tue, 20 Dec 2022 18:41:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BKIfkSP055694 for ; Tue, 20 Dec 2022 18:41:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BKIfk1I055693 for fs@FreeBSD.org; Tue, 20 Dec 2022 18:41:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 266302] [zfs][iscsi] Periodic drops by ctl with "failed to allocate soft PDU" since 13.1 Date: Tue, 20 Dec 2022 18:41:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eborisch+FreeBSD@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266302 eborisch+FreeBSD@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Works As Intended --- Comment #5 from eborisch+FreeBSD@gmail.com --- Thanks for taking a look; I'm closing this report. If others run into it, perhaps they'll find this and comment on it; in the meantime I'm further constraining the ARC to see if that helps stop / significantly reduce these occurrences. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 23 10:56:53 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ndkdf3QT9z1HTRs for ; Fri, 23 Dec 2022 10:56:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ndkdd4t1Hz4Sl2 for ; Fri, 23 Dec 2022 10:56:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1671793013; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vbeU9imfRBgfJ+PM3TKsZ8f0XYl7Rj7I3D2XJGNhhcY=; b=JqfBD1pYKzfFguv8oU+mwm6lAs04v2hdanlyp1uqQcPXqpFzIGcG6Lc/X3FUs4WLs3fdea mpVhKUg10w+q1T4Kz+KQxiOEgd45NH4OaF6StX4cP11IRQ2lbsu3GEmjjKpKlytinttakt SVJezA0SLpAsOmkK+lNNm8dn0+Y9oJZmneTx0XC+T2We7LXUZI+/rFvI5i50TiczMoh5yE 5X9bJEbHzs+y795WwgZq4HdABMUp4lzeTugNMIxmjgP6+GI0JdwFrR3Zl31ODXYspD4h4R oBAQJ0sBzrYmX0Wt8IDsDE1/54YSdzdLDKl3BY1ZND6h6Jn3OkC9/jr3QPRTgA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1671793013; a=rsa-sha256; cv=none; b=ZumWGpTFU7ZTn55vOP6xYkoVxvkCkUR6cgu+N9rA0DSMpOwRABEru8Ml+otNnK+E1smh4I gU/6OX7pDbxJ996/PrfwytHbCqVoV4dG9Z7Q7WvWZXcjjo2vJTt/BnbeB8L1s0Hmtcc7nP ECAZ3jvbnD8evIrwcwmpTUazojSfTLyeLSZW2bETldvyv8pQfI6qvFRqqIvg3h0xj1r9lI 4kQeSTl/KEQeRkZfW8fvb4/uRDX2siyvMiJYd2kw0YmGRYmpTolUo9iFWobm7uEGochUML BDC6Ej7DMosWolQPziNSHEkMABXd0C7MeTs0dflcYfaUpmyPgm7l4wQmq0MElg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ndkdd3rCHzWDn for ; Fri, 23 Dec 2022 10:56:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BNAurT4077094 for ; Fri, 23 Dec 2022 10:56:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BNAurel077093 for fs@FreeBSD.org; Fri, 23 Dec 2022 10:56:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 176636] Occasional crashes with ZFS in 9.1-RELEASE Date: Fri, 23 Dec 2022 10:56:53 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.1-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Overcome By Events X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc keywords assigned_to bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D176636 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[zfs] [patch] Periodical |Occasional crashes with ZFS |crashes with 9.1-R |in 9.1-RELEASE Keywords|patch |crash Assignee|bugs@FreeBSD.org |grahamperrin@freebsd.org Status|Open |Closed CC| |fs@FreeBSD.org, | |grahamperrin@freebsd.org Resolution|--- |Overcome By Events --- Comment #19 from Graham Perrin --- We might reasonably assume that the type of crash that occurred in 2013 is = no longer reproducible with ZFS or OpenZFS in 2022. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Dec 25 21:01:00 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NgCxn2DCpz1HZM1 for ; Sun, 25 Dec 2022 21:01:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NgCxm6qzSz3tph for ; Sun, 25 Dec 2022 21:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672002061; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=8a1rZkIoHFvflHpumjZoCkhEnQq2IbpdG5Z5HRByS9E=; b=o9yiDKUVDVrSgjmdP7GXWpJcTGRKJhDYMs0+7cTsGDzlJK+gxaNXw0EpsUBgxUGvXzt2qI BuEPvRNY8VC78vDsrC2UrVd+hsz0FDYVPirqEsiwCu+LUlqmxRDUbcfpuR+SJIng890Sy9 usD8mIKmFLThXDZjymB4pRvjgbEhL/kAWjwSXvD0rg8CgrIW/RL8Bqn9sBdQP9iEJfwaSm NbIJO3BjOiMWmW+nlgqFlKCsOWPO2quW9EPM2quubkt4cS2zDAmKfVpiRDEaO2iWnDsu5x Fnsz2bOBhld0rz4oj1LcNmAlRhiBupI5acWW/XQXe6cQMNwWJ0zMiDBJnvM4NQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672002061; a=rsa-sha256; cv=none; b=NvnEkIsCa4yVs2Y77RJzk1/3Ym0sv0oK1pGtIENlqbeMdPdgpLfUAHsc5cMmWxjtnTUox8 ULFFkEDrRfGHRC5a822qOaryd0i/XeMc3xhiwN2AU2hJxHzMCVagyGC9HCNE7/RS7lqqcz 6iURtod7e14nPEeexBmhPfyVn5rsRe/edigsw6LIYW0XFt1eWm/imvXvHY0g2iX49Z2qeU 0V3FU9OoyQeu/XIosQkQiJ49xlezFC40FsgVAtgj7BgrcV7tN9ofkqjQFIvrTL52llZR93 vgi+kpHWgG9L5hxCGGMZVYc7zlNSqjs0tFRfSFIWlFTqqH8afcPu+CBWwE0pTQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NgCxm5xH4z15lQ for ; Sun, 25 Dec 2022 21:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BPL10Cu006453 for ; Sun, 25 Dec 2022 21:01:00 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BPL10dc006452 for fs@FreeBSD.org; Sun, 25 Dec 2022 21:01:00 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202212252101.2BPL10dc006452@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 25 Dec 2022 21:01:00 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16720020606.60FF.729" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16720020606.60FF.729 Date: Sun, 25 Dec 2022 21:01:00 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16720020606.60FF.729 Date: Sun, 25 Dec 2022 21:01:00 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16720020606.60FF.729-- From nobody Mon Dec 26 19:32:05 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ngnwv5gNMz1HV1y for ; Mon, 26 Dec 2022 19:32:15 +0000 (UTC) (envelope-from list_freebsd@bluerosetech.com) Received: from echo.brtsvcs.net (echo.brtsvcs.net [IPv6:2607:f740:c::4ae]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ngnwt6tjdz3s85 for ; Mon, 26 Dec 2022 19:32:14 +0000 (UTC) (envelope-from list_freebsd@bluerosetech.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of list_freebsd@bluerosetech.com designates 2607:f740:c::4ae as permitted sender) smtp.mailfrom=list_freebsd@bluerosetech.com; dmarc=none Received: from chombo.houseloki.net (65-100-43-2.dia.static.qwest.net [65.100.43.2]) by echo.brtsvcs.net (Postfix) with ESMTPS id 5E8CE38D07 for ; Mon, 26 Dec 2022 19:32:07 +0000 (UTC) Received: from [10.26.25.100] (ivy.pas.ds.pilgrimaccounting.com [10.26.25.100]) by chombo.houseloki.net (Postfix) with ESMTPSA id EFEB112991 for ; Mon, 26 Dec 2022 11:32:06 -0800 (PST) To: freebsd-fs@freebsd.org From: Mel Pilgrim Subject: zpool bootfs restrictions when boot and root pools are different? Message-ID: Date: Mon, 26 Dec 2022 11:32:05 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.12.0 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-1.60 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.30)[-0.295]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:36236, ipnet:2607:f740:c::/48, country:US]; DMARC_NA(0.00)[bluerosetech.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4Ngnwt6tjdz3s85 X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N I asked this on freebsd-questions a while back and didn't get an answer, so I'm trying here instead. The setup: "bootkey" pool: A UEFI-boot USB flashdrive with /boot on it. It's ZFS so I can use copies=2 and scrubs to ensure integrity, but it was UFS in its prior incarnation. "nvme" pool: Contains the BootEnv-managed root. The nvme pool sits on GELI-encrypted drives, and the keys are on the bootkey pool. This is so the keys are never on the same devices as the partitions they decrypt. This is where I run into an issue: BootEnv uses the bootfs property to steer the loader, but I can't set bootfs to point to a different pool: # zpool set bootfs=nvme/ROOT/13.1p5 bootkey cannot set property for 'bootkey': 'nvme/ROOT/13.1p5' is an invalid name In order for BootEnv to "work" I let it set bootfs on nvme instead: # zpool get bootfs NAME PROPERTY VALUE SOURCE bootkey bootfs - default mech bootfs - default nvme bootfs nvme/ROOT/13.1p5 local and have a script that copies that value to /boot/loader.conf: # grep ROOT /boot/loader.conf vfs.root.mountfrom="zfs:nvme/ROOT/13.1p5" That somewhat defeats the ease of BootEnv, but does make the rest of it work. With neither vfs.root.mountfrom nor bootfs set on bootkey, the kernel assumes /boot is on the root filesystem then panics because it can't find /sbin/init. And now the questions: 1. Why does the bootfs property restrict the value to only datasets on that pool if it also requires the pool name in the value? 2. Is there a way around this that would make BootEnv work without vfs.root.mountfrom in loader.conf? 3. If the answer to (2) is no, would it be welcome if I added to bectl the option to have it use vfs.root.mountfrom instead of bootfs? From nobody Mon Dec 26 23:57:34 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ngvq65X4jz1LqjZ for ; Mon, 26 Dec 2022 23:57:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ngvq64TsWz4TLg for ; Mon, 26 Dec 2022 23:57:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672099058; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ux599TQLBr40us+fg9KZlfEYY4YXgxpabyIxOdlQ0lI=; b=ptAZ5kwkQZj/pj6qA/VMljYTiAs7H2rzoYk40QO0QUtpodgk3beZE6W+ooBOhL77QKaWT2 VnsFkQdYRoO0OFoZu4GHWSeGA1uFykEYlpdvG/ZmuFef0af7iGVJm7KG8rIM7uvE5xFeoo rgBD7qtlgsPTFIPSJTKCrU+PmDZsC0V+wgteIOP4dk2yMhIzz27lxi4lBdBwWwec513YqP fTzhUiSVz+sH5E8phi2fXjg+MFxHIRpw3jkSgEP8FZPHaMcyZNOhv6rfbzS7b7lJVQpf0Y tFsKFhq7HJvkmHN2sum1GzAaBTo3HOR2lJLfjbg81u9O3emhULEAiQtL43VVVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672099058; a=rsa-sha256; cv=none; b=KUSNfVK0m6fY0LcnI8mamkZpHmn5uJwhOwByKR/y0D+QLHjiOZdk8k6sb1HUz+LFdCdgbz XHS7Z60u5dt1YHzhweSDry6vkiZa0FoADQhRHxZYXMaxciphkIoycF88nI5W3zxiTAVW0r eLb10cfl/XR9dyOlK/6DiLmGpZJlOotdGLAklm9TRC3MchZTyEnRpA7Wk9K9+3qE7aNv6C czjZDPeJz8uBREjNjD/4Lt2/4D5fFH3gzoSiADS0aGUrJl+cCzQS5JscUlaE6UAi/tVJZR uLxK7+lpfxLIHjA76pq9xAhhtZMfPbsi0XAwKYHbNIQWQ4DHyde7TrusXuO3xQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ngvq63Yzrzpkt for ; Mon, 26 Dec 2022 23:57:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BQNvcLA068098 for ; Mon, 26 Dec 2022 23:57:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BQNvcnX068097 for fs@FreeBSD.org; Mon, 26 Dec 2022 23:57:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 230962] Kernel panic when writing extended attributes with soft updates enabled Date: Mon, 26 Dec 2022 23:57:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: dewayne@heuristicsystems.com.au X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230962 --- Comment #24 from dewayne@heuristicsystems.com.au --- (In reply to koro from comment #23) I'm reviewing PR's associated with biba and multilabel, so I'm late to the party. Both of Kirks patches are in 12.4Stable as of Dec 2022. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 28 14:23:04 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NhtzD4PM2z1LnRx for ; Wed, 28 Dec 2022 14:23:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NhtzD20zHz3M9F for ; Wed, 28 Dec 2022 14:23:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672237384; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=oL+8NSf/5rZ3LQ+A6cK88p/V5WFHdH8V0LSLNFPW4lA=; b=KpiXQ0xmyoOW8IRd8xRn1svrDHkfUJnD0RakZG2VRijlPcs9sWBxHDo/ZRB/jZ1Eb+jVlv 706u0qBILoD4kfaRYBrwHHMgD2BElIdisNMA3xnBVnMedylqKbxDA/WnI7m5mxBewywiuP NFxaBNLuLbPRidV0jOzZ8A/ziz4mbyOG3h02hheq0RINzeO3sjpj58lB6LDkRYzQ58PBXY 34oabx//N13mnXsP5Z7oVwQJOUY1+Hgb+IijBpexwLTRAGYVhR2WOEzK/IvYEfzF/RnMZp xuZiasFiRXXZpFvhK2S925Cu0ltmVvZV4DpzmXCeuYjQCoEon0hAzbHewdj91w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672237384; a=rsa-sha256; cv=none; b=ekHdqWxjqU5iXMlD2LqkmCawHfLdumQNaXmkNz1r8Qv47qh8MN2Y8CWOVRdbBUveNEznK6 g2xWnof4lRqyaL6XoOmnM4vLgUC8ovIJOEUmw1yIniGA4HeqJGabipKpOkCoMGU+mkOUlB OgrPYNYQ6cCY/zXNOetz+Oxq1ZmEq5nEIfWD12rBtjvf3aRgfcYF1xjFPyPzlCBl7oeGQp 6wJSpJIqlsVsS1rINjxni1yYQw/uSrmaDu9mITRLK44uxBJjKlf6Tht+7r+AYlIytTy/7+ LkFx6oKOmwIEolqWAdmEbUepAO5EEMoZQkMOfklhgf9dnZO/RfXeTRRnIrp09g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NhtzD162FzsJ2 for ; Wed, 28 Dec 2022 14:23:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BSEN40b080255 for ; Wed, 28 Dec 2022 14:23:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BSEN4DQ080254 for fs@FreeBSD.org; Wed, 28 Dec 2022 14:23:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Wed, 28 Dec 2022 14:23:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |needs-patch Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 28 23:04:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nj6Xv0X1Hz2cH9N for ; Wed, 28 Dec 2022 23:04:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nj6Xt6QpNz3NTN for ; Wed, 28 Dec 2022 23:04:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672268670; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=f89ASDwUfTdEy7XQs7P0p5vhfiolL8NjWSQkfKZ0Yh0=; b=bnh93lR5Ft91qOf+uztxXkBG8BrMzwDKK95GbdWn0GWVCh6XOTswE60bfnjitTalzS1i8r 7S5ktRy6TAvVI4fcz8u4eNvp+OhY9R1iqElBTwP0+OzlGWj1TDwFQEvDOsXO3DfLBzU0L3 NOCxdm3C+/AB3WVJPhfg+KQ0PceuFoVUbeD43AJT6n6iwK3HKNV4sn3KXoBIid/mhsayd7 vFh95YTP2XYnX7JRziF42iIdYmKNGKmTkVfdjP0bNhhwpX4LhzFKS3DhvnlcZA8w/MMf3j VXDUdROv2VKgJkBPDKh7+TnEwzst244dZUzfEOt4EokT7mivkDRaQ/PoJ12zkg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672268670; a=rsa-sha256; cv=none; b=uDLXkvSFW9QA68lttR9tqljy17ycxNPEU36JHkD4vixUId3dQ+qqUXb6ukqzSoZIWlp1BK LtiXVZmk+DMUF7IEcHdD5+EriGtwo1979ktiRVWKrUMq61e0F985DlAgvYfzVb2UPjCUVP tDB+24vZXVujfafvTZrPegquowNgt32TTusXebQKgIrpQmxZTkwY1pfMBr+Rlz6a2zssvV K1nHXRfrCg/0u/oJSaK03J/U7ZigbyGQJrRLyXKdBeppmZ2uZnVqIXGcanDF41WbbH3jEi Y9ooT+AmhWPyi4t/Vyp/b6DWLn8X62sqEXhLkPZDQPKEYdYESrwEEsQwbL7FcQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nj6Xt5HwHz16c3 for ; Wed, 28 Dec 2022 23:04:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BSN4UnB056164 for ; Wed, 28 Dec 2022 23:04:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BSN4UwE056163 for fs@FreeBSD.org; Wed, 28 Dec 2022 23:04:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Wed, 28 Dec 2022 23:04:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org --- Comment #2 from Kirk McKusick --- I am inclined to your third suggestion in the case that you are writing to a file in the filesystem being grown (i.e., detected as in your first suggestion). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Dec 28 23:38:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nj7JY2sz9z2cM7m for ; Wed, 28 Dec 2022 23:38:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nj7JY1lrpz3hPw for ; Wed, 28 Dec 2022 23:38:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672270733; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G1b2RHurD4+xJWjI7vpj6MxW9BK6Sbq6ckMl4sa9i2s=; b=tpXbZSZLDjNslwE77IEjOzC+VP7gHct21m8oJkUCDt5czd4tw+y7X/9ZvS/TnwpwUFyTo0 RzxTru5pcSUNI0LNxJaqSyDwpemVQIycFyJu0MssMKtX8xBm3Mg4Pf6OIikFZ4zLvRCdtz ZSrY5foRWmDA9QZlg5ogS70xUNvdtGame4TbcwIhT4G7cVub/6duEDYeE6aB9OhCMay5jg SQyVbhM74prCgTGFf2rLrYHKueNa2xjSkuzB1kzJa/yIpeKHg5X3RLgythIhiroqYMMBT2 U0Ry6sHMstPMSJd393YUzTJIxNwyK7wVcA0ulsZ04ugBd7iv09XT6lBK/7pv4Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672270733; a=rsa-sha256; cv=none; b=PS+//wp2e+Tl1PLXFvpqbkZJOTvdtF6wZrnK+fHvZpf9bFbqhv+U0ZYpG8MrF8ebY6vaPT CDGjhUfYUvZwekskCgA2YXsiRRdxrS5u6pxtTJc0cdnQGxXVdc+wxYIP3QfIDXqvqpwyB5 aMSnfGxpGrE/FW7xIzHesKIuQhyyoFaVwZgQVCeHEkAfsb5jh6FKB2z9f3uclDuPIriios m68PcrAVOe20ExQAnCsqkaJ+5IfDhHXwlcGMov21IAybEzW78R7l2/HW7x7lwSLjwUmdIg WTMLq4reukYszVeDI5Dmd/K7H0T4W+98pzrScR3Q7YLwxVngF51cC7dsddoiuA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nj7JY0qT6z16tM for ; Wed, 28 Dec 2022 23:38:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BSNcrm1000051 for ; Wed, 28 Dec 2022 23:38:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BSNcrik000050 for fs@FreeBSD.org; Wed, 28 Dec 2022 23:38:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Wed, 28 Dec 2022 23:38:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org --- Comment #3 from Konstantin Belousov --- I suggest just disable a process to have files opened for write on the target filesystem. There are more problems due to this. https://reviews.freebsd.org/D37896 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 00:12:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nj82r1RtSz2kc3h for ; Thu, 29 Dec 2022 00:12:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nj82q719Hz3lDg for ; Thu, 29 Dec 2022 00:12:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672272724; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3h+htRGnxMI3EIj0RajbhBvj+HaVjRlKT+YX9Y5x57Y=; b=aAApLTAgnJjaPF0C7D7itaccih/1Qa2bvvxm8kHcUoYNY3uR4zwDeF+T+odILoS1ImxTf0 nfHiykCNHP6eYjy7WNjiXdpJfJPaekN2g8PIvV52ZL++OKPR50beZLoqRriT6JHmrD1eP4 zJB2AWEZhTPrSM2i1QHktx0a6wADAjNVEceVRnDhFJg0Q7ABLUcfJxDmFmJhS9S7AAZUIR AiDkn/0ZOTUb/fJ4I67Wg9WzCaAdRPiMp0kVXroFyKy8KjXvoJllqcQhuMyLuSfZrvLWNv NaXubmZMEh3WW4TIsYe8cdpgwnyyhdoxkP40J4pFKq4oeZQWRD02Wi68oBegkQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672272724; a=rsa-sha256; cv=none; b=dlXNNaWG7+L8D/gXNSm91EcFyK7/rmST1Lv/fRxX9iGPbVCnxWERfULhvwZaOwdfj1gx1D 9AStAgBrKMVeJtEc9ttDPnlHOJe26uy/MAeWiYzWtEWfugsWZub0ymJ/DOYvYTx5JEBMic s2vYIIAybr1MTxScWVaPG36uRfG+h9C/G37UIYSnHhRNjIZ0M1+AG+UXetyneSCb0fOaLB fAOquKYWhFjZa303rYoEmRTy7w+P6S3h86ilDHTHJ4JchN0CJthkYJ59sU9f9N3r+pmkho dEN4/3vhQi+FkjRYh8pnK2/73L7NR3MDRKXYNBVl6bO3QQYEU4Fk1tWZYEo0mA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nj82q65wjz17Z3 for ; Thu, 29 Dec 2022 00:12:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT0C3wW059433 for ; Thu, 29 Dec 2022 00:12:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT0C3K7059432 for fs@FreeBSD.org; Thu, 29 Dec 2022 00:12:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics with ZFS and amdgpu.ko (both are required) Date: Thu, 29 Dec 2022 00:12:03 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 George Mitchell changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|kernel panics with ZFS |kernel panics with ZFS and |and/or amdgpu |amdgpu.ko (both are | |required) --- Comment #37 from George Mitchell --- I'm still having this problem, though I can reduce its frequency by booting= in single-user mode, kldloading amdgpu, waiting five or ten seconds, and then going to multi-user mode with control-D. I've updated the title to emphasi= ze that the bug happens only when amdgpu.ko (from graphics/drm-510-kmod version 5.10.113_8) and ZFS are both in use. Also, it happens during booting, or e= lse never. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Thu Dec 29 00:22:31 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nj8Gv6xtQz2kdft for ; Thu, 29 Dec 2022 00:22:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nj8Gv5wtXz3mCQ for ; Thu, 29 Dec 2022 00:22:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672273351; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=STdm9byINeE5qm0isA16bjmDiAwYRy9OmhO8Zhw3Qf8=; b=eQ5H3s4PIaaDBNSVI7DNq4xF5mrxbGQzHtUJVCDsTJYWoFR9UeZ09W0sKE1PqexFdzNL9j WKS7fw5VcTvRVHYfJZ62FhJ+g/RNAla9nxeGzEMaNvLkjrB8WiqTIQ68xMJY5m21KRcpzs gP8MerIktY0SItzOE6VlJyKZ8MQWV1GN/T6X0GziHKsNkjtmdnfT1JCzL4uXnfjWieEWtY CNGUqnVEWeWOAhuDYh1YPvb3GVNYRlz84KngtI/DdYB/pZCaNMsmpYzjt0DRfTQ0S2udtu E6etODx2V2aWZXZvQFwQm3EqrLnCEbyHbOlprKDmcuRyMiFAVSerBj+AixV2yA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672273351; a=rsa-sha256; cv=none; b=FolWEzS+n1csnXZbbLJI4ZmQTj5ha4IXvJk9cfwR1+9Mzns11jZYoLFgXWXxgOTKRpSVuL u+iSL06aZ8AL0hjE+vR6e6bLAB70e86HZ+N+v+zdEDwQcqs9q9ZvuxHlbIQW7Gz5u9AZk7 N2McUu10Rs2zB4wM8caKZ3KMd32BSA6Nvokvv+vBR9d5vmIKUzGQhHTJhzWqMSpxa4JJD/ /lUHa1UY70uSSctRBIZZ67OOrOm/DB0xl5ieCv8Gl+ngX8nwmhn7X5ZVBER35QXI9vvp87 KEoxqVhBTr6/tb+wh/e2GVwBvBMbX7/Ain0WEeMNKBo9VsAXsM8+wtyTc7g7nA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nj8Gv50pxz18Nj for ; Thu, 29 Dec 2022 00:22:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT0MVmO074952 for ; Thu, 29 Dec 2022 00:22:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT0MVBE074950 for fs@FreeBSD.org; Thu, 29 Dec 2022 00:22:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Thu, 29 Dec 2022 00:22:31 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 George Mitchell changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|kernel panics with ZFS and |kernel panics when booting |amdgpu.ko (both are |with ZFS and amdgpu.ko |required) |(both are required) --- Comment #38 from George Mitchell --- I don't want the title to become too wordy, but also I'll note again that my 1TB USB disk (GPT formatted with one ZFS partition only) that takes a measurable, variable amount of time to become ready may be the main reason = this crash doesn't always happen. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Thu Dec 29 03:20:52 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjDDj1NkBz2l5NZ for ; Thu, 29 Dec 2022 03:20:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjDDh6lssz47pP for ; Thu, 29 Dec 2022 03:20:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672284053; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qc9R8/JTkIGi2vdqfu3snE8xBWJCMo5RXeFUCL7d800=; b=NKYS8wUJpzvglthd6IT6e4+usmyz2OHf17ey5lMiGhTnP3k3nkcLGikjhIoIH2l4WVqoie F7tMpFyuZVTWt/izRaeCGx7pkxF/k8JOP14vaW7bJinFO6Oz0Slhdr2Fv6/vTTRro6Rlcn AZGwnOkemPrZ8WCOQTh/Zj04+U2ceobbrjil0rYspjjBinKGXxktrYehXdvd/W8OSEsuso dOI43GDhIH8GhE2sbroRQe36YIOfyNPiWOOpfJv1wGEPPuzph7eIT6DDmc53xGhqCZSTAT TCiIWrDNPKwBKqTLubGbQlUyXa9n8E/4HDDp5jNGiJkwtOhVY3ON4uIuRXQ62A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672284053; a=rsa-sha256; cv=none; b=MOQVF9j+TZnvZs590BALfRLC5I3GP3j/zUYCRL1uxBzPzuecbcIoO8cjAyBn5yxvDMX2eQ aU8kOIr8oDOhuq+FWsiKXgN+afyI89PpNFLSZmAsrYKcFLqraYfVrAk5t1ME0Vpo8ZiFB1 +CAJXGcNjn0B3HLtbnpJATF02OMwMDTWvM796OaGGZfWyJqodldtGzSR2wSJ18r0JQfX6M Etc0p1gbZXj42gffgzZgZspKCPAzlWpS36SoG6DZysU+dexk8DANHDt844HsH1xgjQFSQu 6/95TB7wG4A7TdDuCkGFnP3wTGmM+H1HhOFeRii5EfsUy08qZoN3KLHb29RfCA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjDDh5sQczDc9 for ; Thu, 29 Dec 2022 03:20:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT3KquN033888 for ; Thu, 29 Dec 2022 03:20:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT3KqPr033887 for fs@FreeBSD.org; Thu, 29 Dec 2022 03:20:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207902] zfs boot into Safe Mode & Single User leads to auto mount failure. Date: Thu, 29 Dec 2022 03:20:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: dependson Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |260812 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260812 [Bug 260812] Safe boot (safe mode): improve documentation --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 03:22:06 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjDG662NHz2l5Lj for ; Thu, 29 Dec 2022 03:22:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjDG64qWKz49R7 for ; Thu, 29 Dec 2022 03:22:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672284126; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1ybaHSE7eSF67alRmgonjWlFBTqn4DTksj/m4He2TTc=; b=M+sWZGmOCSX9+BbxLmQrRHGacmnrtw1+9LxOswqAF+4bK0WpCVbKbjVClWlNP8mL/RLfrK TtCfGN6lG1M93A+s4hNFt54/0iA56RabeM37J4swu5tjkYy5b5Ol3ugVjtdG73o72yswiT W8/O8iUqRQezzoWwRi6iiiJmWp2ssqviFyFB8UbEPoB3uY3c3zDAbpCkWs3fojq+S7l0e/ Xau1ruMVhVhQQmgOOmsiYzK2wKVg9oKuIHZS1yHZHeqe8kNAfOYFm4rYrOzIYpz0XFz73F YFkF00K6kNAbVNjtQLZKh87JbE7IScXinuSEB/DsMkervz+XQCFEmv0UPRUplg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672284126; a=rsa-sha256; cv=none; b=AaZ0YCvJqEX0Gx2fV5qeGHEvokyjUPJyyC53eBKZG8UAMFQczMZzwUVpqIoEF5DmTZ5WN9 1/IejL0zhzzwkgbyaPgHbOYygIQrtumJJfZFQ826UDvM9EoS6qrQ+cw71u9w12IyfVVsaF iiyAX/l9FtFBWR9AIghPIzMNSzEbX/7uJllMR2R+4s6jxtdii7HiRKe48akVGQpy3QwU9X KwYgtvdHmRVTrk5/qsCY3paGT64UM2VPRSSfIMeWSAQJwIBhineBbwsefhFcXpK5UcGaZd EFQj88FQQS675iC71ez9HjpQPnS/a9qrPdQDs/vAXKr34n7Eo8mX5SoDDfr+Uw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjDG63vBGzDcR for ; Thu, 29 Dec 2022 03:22:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT3M69B038808 for ; Thu, 29 Dec 2022 03:22:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT3M67L038807 for fs@FreeBSD.org; Thu, 29 Dec 2022 03:22:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207902] zfs boot into Safe Mode & Single User leads to auto mount failure. Date: Thu, 29 Dec 2022 03:22:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: dependson see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on|260812 | See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 608 | |12 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260812 [Bug 260812] Safe boot (safe mode): improve documentation --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 03:50:18 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjDtf6C95z2l8lY for ; Thu, 29 Dec 2022 03:50:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjDtf3dDKz4DJ0 for ; Thu, 29 Dec 2022 03:50:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672285818; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6DuYBiQeaIZAlxQjVFCBeQQSjgr0ITubccAGy8eRtfI=; b=QSQ2JigSDB+9RvmDiN5d6bSdsiwHHFMW60rAVlEML6iS2Wcam8d2V7/2OLpYL6EV+EeKjS JCTp/cXmjF6EOQO47LxPNOsqoG7b8EyfOMJTUZfoa1YiYgQZ2eUCzpnZ/E3bqLN7e0xkds O/cXmZ2Gxq33RKjS/gVB5N1/1EnpJKtagY9TFTIDeVmD1qWK12y3u5s90RBaEXQeyah9Du AZBGFCcUJtc95QQgcFB4Nh5EuaPYYEFWuJcUUbG/UcVTifJgQvicdAx904i0nEnneX3RXp 8jWWUumPGs9wobgNToZ4Xc3EtZILS4FyBX7ho6EeGi6vTcklBbOcuczrLUetEQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672285818; a=rsa-sha256; cv=none; b=URGY/XOZAVow0Aq2UiQi63rbOGESRhPYDhC+MKEbzOdnw1aDH5j1ZBg4bOPIwmXyrVLNXY Q7aKIbe9+cPJzjqnvt/aH6VA5Tefh8vtD6+HofghYNpM4G1U3nOIYl3cGYQSh90uox11Mq C5j1WkMqYw3O5G6MK0rr/fUu9cUm/BC2oj0451U+Jm7DDxIiUaGduRd7fZXGo8CRXoSZdA k0HnYURn99fVY/A6cmv6+xQdTSAi6Avvf9Fvivev8IrgBu349Z9KZSGYYg4zngmIxRsPLI uxUEnfjWCNJocLW931GTEjrwjPJD6rV8mr2HkLSk1qE3hNo8XCtTv8fbRvfVVQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjDtf2jXzzFXV for ; Thu, 29 Dec 2022 03:50:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT3oIqX072337 for ; Thu, 29 Dec 2022 03:50:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT3oIiL072336 for fs@FreeBSD.org; Thu, 29 Dec 2022 03:50:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207902] ZFS mounts in single user mode: design, documentation Date: Thu, 29 Dec 2022 03:50:18 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: doc@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: rep_platform short_desc keywords assigned_to product bug_severity bug_file_loc version component blocked cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Hardware|amd64 |Any Summary|zfs boot into Safe Mode & |ZFS mounts in single user |Single User leads to auto |mode: design, documentation |mount failure. | Keywords| |needs-patch Assignee|fs@FreeBSD.org |doc@FreeBSD.org Product|Base System |Documentation Severity|Affects Many People |Affects Some People URL| |https://openzfs.github.io/o | |penzfs-docs/man/8/zfs-mount | |.8.html#a Version|CURRENT |Latest Component|bin |Books & Articles Blocks| |263315 CC| |fs@FreeBSD.org, | |grahamperrin@freebsd.org --- Comment #5 from Graham Perrin --- If all available ZFS file systems are required in single user mode, then =E2=80=93 after e.g. mount -uw / zfs mount -a (Preferable to 'service zfs onestart'; .) (In reply to Andriy Gapon from comment #1) mentions (amongst other things) no networking.=20 This subsection of the FreeBSD Handbook might be improved with brief outlin= es of:=20 * mount expectations * how to mount. Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263315 [Bug 263315] [meta] FreeBSD Handbook Revamp --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Thu Dec 29 04:24:23 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjFf01jX8z2lFCH for ; Thu, 29 Dec 2022 04:24:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjFf00g7fz4Gxm for ; Thu, 29 Dec 2022 04:24:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672287864; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MqA6674MJ4WXpCtNx/y9ZG2JqapW5XNmtfoYADOr4DQ=; b=HomHEIHxuEdgRmAYoHRlGI5Lw4kI8QHb29ZyhZkzt2rGc+Phfa+Zi5wDKv87iIlUQsUWeX zGpBLGX+MKw+dF0rqvB9uP5UOI6AU0n6rXzylfvcX817P73If6xmcK+5mk/yWKRTHOSxTe 5e3SYQ0ljGAfQCTM4GLWxNLyE4mTCvac+zOOdMYZQvGwpO/YY2Ubp9ga9W/5wS0kjNCPWd ckIU1Bdnqa04UYmQTlx/+l0/u9aNFwd/D/KNevjAhC4WB80xYfwYm6PUKYSEuHHH64J1YD 3tXsA87ubkZfO+ObRGU46mNqqcp7SufmnpyRv8csEp2T5OqcSqEfyN5rAdI8gg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672287864; a=rsa-sha256; cv=none; b=aUCM4rdMCRS9lW6fLbsCEWvTa3rC+6Mx1sAr0mmSnq6JE3byqYAD2SwxqmVRah2NYj4J1R OLdKEk6M/LrF2LgZE1Zv7cb7p5LpTcfDb5dtDK9l4bv3L5S6uP7BxvuGWlTTOatT9ugVbC TtZwvvuudY5ERIi8XjBq9GUxW05AgcwFw7cc9xFMz2tfHZxug8ICW/Id+QwzMJccmK8w2h 6oS4k3sjIOqukcYw9maDesIIgAbWfwFgweJ94YMehKC6+/4Z2dAJE9OwzSQEjIcnJEei2z WyOB3hJNpUbDaFPwHfeMTKEFS8pDeZYDpogq6JRIU/SOIPqbawBMYinMfNAifw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjFdz6tjPzG9l for ; Thu, 29 Dec 2022 04:24:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BT4ONfF036051 for ; Thu, 29 Dec 2022 04:24:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BT4ONh4036050 for fs@FreeBSD.org; Thu, 29 Dec 2022 04:24:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 207902] ZFS mounts in single user mode: design, documentation Date: Thu, 29 Dec 2022 04:24:23 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: doc@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 686 | |32 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Thu Dec 29 07:01:19 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjK7F5Y7nz2cDBD for ; Thu, 29 Dec 2022 07:01:29 +0000 (UTC) (envelope-from manav1811kumar@gmail.com) Received: from mail-pg1-x52c.google.com (mail-pg1-x52c.google.com [IPv6:2607:f8b0:4864:20::52c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjK7F3xNMz4TTc; Thu, 29 Dec 2022 07:01:29 +0000 (UTC) (envelope-from manav1811kumar@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52c.google.com with SMTP id f3so11880064pgc.2; Wed, 28 Dec 2022 23:01:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:subject:references:in-reply-to:message-id:to:from:date :from:to:cc:subject:date:message-id:reply-to; bh=+6XleyeYIvAeob5CJrj2Ojl8lfyCcvJm8gkmduBm/PA=; b=mHpnzN7U+l0E4mUrn5PbfrYicWNZ4szMvZwr0FoMcxfmv+XMlLQDOpkS+9Cigwcnnd 1J1aA6eEXJNP87Tc2cnwt0TSRkQsl4gyNox1fgKtpZ8xhFvaV+wviuLvWWrMBwqBsihW EL4u0xJcLkJs3MPZ06FaXU3wRCGQL+fDweeZT/FrSwheZ8vLU0dzrh8fqr0zOT2uMdMv Rg330/HZfchjhag1seS27uwfRN4tHd0d+rjS+E62CxHYky400PzTDv8xf45LwJf4xl6I 5keQnFWm9u41tnVzxudioA63znQ/VFE7QsvMsxcoe/HeaUozOE28jYXNSCLWzSmhDZ// jdBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=mime-version:subject:references:in-reply-to:message-id:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=+6XleyeYIvAeob5CJrj2Ojl8lfyCcvJm8gkmduBm/PA=; b=lxuP7lldlDUUNd4qUw466qIGdOejiX5oNcaCN4xS3PPU4QXUQTYkeXy9Xv16bwOJpW Soj3LPxDozxgB5erM0HlIOckeFrS/CLLkeI/79Uq1vzrrvhzo2RhVJtQxseltwEp4HFb BCuIi3R+Kgp7uNEzDD3rXqdV+jGnc4gK9OywJxEW+j5lFZxxHPXoWd1OkWx4/bWKYsUu ujEowKG0nKCybkzAceiLj5YNGszPZHvZwSO8mZsDBRUjVkhagHviizYKJEWhOu3AAg3Z Eo6b9k8QCFn0GhKhRRfjBdh4V3TY+6vhCfLigTuUh+QeItuhNExy3jXiNTLEIpZ6Ln7u Fzdg== X-Gm-Message-State: AFqh2krujmE8eHlC6Wni6Cdr5b7KqfEiYX+8qyMkVvR/h5ilNf1Oq7yR dvmIh8wMIyek+bzTecKrJFmW9DljuNCPc4w33Zg= X-Google-Smtp-Source: AMrXdXveZqsDhbfGWz+1XwgSz87h8xGcaGDCiZIEfOyntVdt+B5+rzXTitE8Xp0Zvi3eB0GNT4FoRA== X-Received: by 2002:a05:6a00:be9:b0:580:f5a8:2e2b with SMTP id x41-20020a056a000be900b00580f5a82e2bmr17605376pfu.8.1672297287920; Wed, 28 Dec 2022 23:01:27 -0800 (PST) Received: from [2405:201:500b:b041:100::] ([2405:201:500b:b041:f4c0:7f9b:201d:f564]) by smtp.gmail.com with ESMTPSA id f145-20020a623897000000b005775c52dbc4sm11225450pfa.167.2022.12.28.23.01.26 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 28 Dec 2022 23:01:27 -0800 (PST) Date: Thu, 29 Dec 2022 12:31:19 +0530 From: MANAV KUMAR To: fs@freebsd.org, bugzilla-noreply@freebsd.org Message-ID: <281873d4-7154-4e2f-b222-1f6b55b56840@Spark> In-Reply-To: References: Subject: Re: [Bug 207902] ZFS mounts in single user mode: design, documentation X-Readdle-Message-ID: 281873d4-7154-4e2f-b222-1f6b55b56840@Spark List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="63ad3b44_625558ec_e91" X-Rspamd-Queue-Id: 4NjK7F3xNMz4TTc X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --63ad3b44_625558ec_e91 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline I don=E2=80=99t want to receive further notifications for sometime, As go= ing busy with full time job. How can I unsubscribe from all emailing list= . Sent with a Spark On 29 Dec 2022, 9:54 AM +0530, bugzilla-noreply=40freebsd.org, wrote: > https://bugs.freebsd.org/bugzilla/show=5Fbug.cgi=3Fid=3D207902 > > Graham Perrin changed: > > What =7CRemoved =7CAdded > -----------------------------------------------------------------------= ----- > See Also=7C =7Chttps://bugs.freebsd.org/bu > =7C =7Cgzilla/show=5Fbug.cgi=3Fid=3D2686 > =7C =7C32 > > -- > You are receiving this mail because: > You are on the CC list for the bug. --63ad3b44_625558ec_e91 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline
I don=E2=80=99t want to receive further notificatio= ns for sometime, As going busy with full time job. How can I unsubscribe = from all emailing list.

Sent with a Spark
On 29 Dec 2022, 9:54 AM +0530, bugz= illa-noreply=40freebsd.org, wrote:
https://bugs.freebsd.org/bugzilla/show=5Fbug.cgi=3Fid=3D207902<= br />
Graham Perrin <grahamperrin=40freebsd.org> changed:

What =7CRemoved =7CAdded
-------------------------------------------------------------------------= ---
See Also=7C =7Chttps://bugs.freebsd.org/bu
=7C =7Cgzilla/show=5Fbug.cgi=3Fid=3D2686
=7C =7C32

--
You are receiving this mail because:
You are on the CC list for the bug.
--63ad3b44_625558ec_e91-- From nobody Thu Dec 29 10:24:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjPdy1y0Yz2ktkB for ; Thu, 29 Dec 2022 10:24:54 +0000 (UTC) (envelope-from garyj@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjPdx4vMNz3jYP for ; Thu, 29 Dec 2022 10:24:53 +0000 (UTC) (envelope-from garyj@gmx.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1672309491; bh=kaR57/wZtc884BsWpSL/e2jiq9W4BY2WEgHyuaNPIPs=; h=X-UI-Sender-Class:Date:From:To:Cc:Subject:In-Reply-To:References: Reply-To; b=ItE53l3EgzoXu//03UmL/fdSlECEluawgoc6yhh9i8FqohhdAZoA1noMBcIKf1/jV TPDGNqY/gOgMgfyHM+2TP02nIjdnSa/RTdtobXHvkSDR8O1vvRl1vnjEiqAV6DR+3h 56L3ADgKqi83Vpy9AnZYXgoUxa0NM6i1eD6M/QUkI8s/Nu2tg8Wf2WQ1WKmvTsDGA2 cMlcg3NwldjUkc6OQrnC5mRmz4aditM2gbVFzhPfytlf8zEmMEGkyrSCF81UyXWf6j 41hHQyfeGF9j42/YvEpMU4vsEKhjwO1N0ouxipb7VRp+yKHZxR4P+j5ovDcGaTcF3Y YJFDyhngzXZog== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from ernst.home ([91.59.233.240]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MsYv3-1orNEW1OtX-00tz3P; Thu, 29 Dec 2022 11:24:51 +0100 Date: Thu, 29 Dec 2022 11:24:37 +0100 From: Gary Jennejohn To: MANAV KUMAR Cc: fs@freebsd.org Subject: Re: [Bug 207902] ZFS mounts in single user mode: design, documentation Message-ID: <20221229112437.7fe2b81a@ernst.home> In-Reply-To: <281873d4-7154-4e2f-b222-1f6b55b56840@Spark> References: <281873d4-7154-4e2f-b222-1f6b55b56840@Spark> Reply-To: garyj@gmx.de X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:fniinKjtdWkC+JYX3eT7ftuRCRlbav9lE1WFplqiaT7qWC3w+45 KEfDu9PatYqPkNvGS758SdbltCnAM49dOYvRn5olYYQO4SLnlCcImmzcozhuBQ06EjANywt rKFCzddArrHM48xU/TvHMQkc2paIKL1ydAu6+3W1SXib1AAXc/3VDq7nnV20CipAPHBdYql KGQy3boXBRZLOfMCxRTwg== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:NzgSZ3SpGv4=;kOhOcPUpmVjWyk34VsZHcUgVzaB j6CeFX+m9AnTKPFmNHAbRPa8mQ2AkqmWb3lXNVw0yIjoc9X72uleNOiEUbrGIE5/Jgl6oKqsw rJrj6HxZUDMUrhlFJbrNXGWIlU2hfRB52gxkhJX58Dn84TIQQKjXNqOzwV4XdclyFopgPVMX5 8x/2B+aMd1efAGeFyxvjubcbVZVr+4WYjBk+nkYHZ74DgkINU9sJbn7N4mwQCkk6Wjiwz/jL+ va+Ke/q2KzNakeJbEaBxu6MJNMWo4UnR7+rRgDz9bv1Qwvgohw1cbSBTuPBi2F2zvfFRr/0S8 MB2F+w7LOfbIKT4zoQLymr8pK/hnhYqozcQKyWBpdI8fkSajWF0ZxBH0qhZl9s/eSUN7K/hJP 5aDx0GzVo7XlCiWeH3kbwl0JpVdtVxjzO8xVbU1l0bTQDuPJ2MgKlI7msQiEQq39EVLieK019 /RdMyfE4Czg1D9QkXZ98GEhAEvIGIojzOCdZEysRUIF45B1NmxEtu4RZcpO6MwRR9fJF/aUnv OlNKueU04wYUN9a5YhzhWiplKh5claMmgTtlo8tllGSiZ3haVQEVCVdUCOJFDoCS0fiEJleGQ QN5Qz7CI8O92OjvGwcDAs8iKQnehZvhU5uUUayKTXLFvhJbMU5ER5x6YPqCcDpsQn+pMAFlBY 0VLnUIDTkATiJYoqGF3V484TQbzq9rvW5FkVWo72FQLb2jmT3AS9d0dU3RATUtRpiv2T2JzwQ ZmP8JJs2GbsHzGVFPfY5xhnz556fP2+w2/PHpnfJMrnOWxn0hvcC1rnUvd284O45IP9OVF+vS 7xgXFVzVhOVS87qn7vHHm7jVj9VnuoHgyDGklzCWSI0i83IOJ39KYaRVCGGKwjYUo0NJt84G7 ymLgUhCJWG5is/RR9fcCkvw3NZxoNGlc+efPWK6jmtQZNDHLl81m7MZFmXLiJokfp45ksQ80a aqY68vRkdlvTghC8DAG/LWZVYrs= X-Rspamd-Queue-Id: 4NjPdx4vMNz3jYP X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Thu, 29 Dec 2022 12:31:19 +0530 MANAV KUMAR wrote: > I don?t want to receive further notifications for sometime, As going > busy with full time job. How can I unsubscribe from all emailing > list. > You have to unsubscribe from each subscribed mail list separately. This is part of the message I received when I subscribed to freebsd-fs: If you ever wish to unsubscribe, send a message to using this email address. The subject and the body of the message can be anything. You will then receive confirmation or further instructions. Simply replace fs with the names of the mail lists you're subscribed to, e.g. freebsd-current if you're subscribed to current. > Sent with a Spark > On 29 Dec 2022, 9:54 AM +0530, bugzilla-noreply@freebsd.org, wrote: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 > > > > Graham Perrin changed: > > > > What |Removed |Added > > ----------------------------------------------------------------------= ------ > > See Also| |https://bugs.freebsd.org/bu > > | |gzilla/show_bug.cgi?id=3D2686 > > | |32 > > > > -- > > You are receiving this mail because: > > You are on the CC list for the bug. =2D- Gary Jennejohn From nobody Thu Dec 29 12:38:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjSbn01Zxz2lDWj for ; Thu, 29 Dec 2022 12:38:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjSbm5Q8mz3wLF for ; Thu, 29 Dec 2022 12:38:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672317492; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nR+2AEtTY+ffkaBblkinNK6rfy+X+6pPAXYzQhQ9Pew=; b=dvmmUKooFJs+XqDa6d+KKYSdi00l/w7MRdpfE/8I3zSoRgHts+RLK3bBMVjnZnTPb5AGPR VAnc5m8K0aQV6zpzyDVdXhmE1rpbpQzpVXNFOKN2/W3cjUy7U6ZSg0EwIleQfy5azoo/A2 c/ihNPhUr/dy+hHmlTLf4FrJD6jOcrVCaQSRzvfnot46K+jKzLfebNHAQ9s7WZTVE9M5r1 7RTLLvRAbIl7X+mfqRDJzQCkuAYzkR680R+Ow755zfH0rar1w8YzRiW2bgNsubBYLCwWsX 8aCj4QHJy8kLQxrfu5NTJvTLTC3iflCC6KHqk3kCvIDXo9BoiNIqikDG4I5KeQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672317492; a=rsa-sha256; cv=none; b=CzTsHeyBIDc0sAO6gkS+417+uK6ujeortY68a8m65Ld4mN9NkGu8qi6jrrU7RYD72HIrhW sIsRuZ5BbwBwAXvRT1tpHVTL8Z10UpLpKSyv2qvYHtobfDenhRvXGe1ARGYNiW5XKHdMYF okipflybwZJRT45rZPMX2hILvGdrr3cvTXJ5A1695bxwtezrNs3jqYy3vVvziJNU9be0dX IKtRxvZcJngzGUcrlBItVh1n7ddxJccviIu0Xfay/oLjaYEi/glVjBcxYlEz4SojF9Wtys 13qZRULURHKSKg4IRZYenBiK1L3OKyWOfLM/f/mOSbS3KZLkIfhBJa/CcdVn0Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjSbm4D9VzV22 for ; Thu, 29 Dec 2022 12:38:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTCcCAO068599 for ; Thu, 29 Dec 2022 12:38:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTCcCc0068598 for fs@FreeBSD.org; Thu, 29 Dec 2022 12:38:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Thu, 29 Dec 2022 12:38:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also cc keywords bug_severity Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://reviews.freebsd.org | |/D37896 CC| |grahamperrin@freebsd.org Keywords|needs-patch | Severity|Affects Only Me |Affects Some People --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 13:29:03 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjTkS10nrz1LjCq for ; Thu, 29 Dec 2022 13:29:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjTkR6xQmz42JZ for ; Thu, 29 Dec 2022 13:29:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672320544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iOTptZWD4cARZ9m4u1zXT+XO/+3nZLMV0XWttUTT3iM=; b=wb+1ud4zl6Er+vSNO6ZWloPM1uFEju5RVEtsfr95AxqLgqi3Ym3HCnBH1JKXIydWowXpNt 3tUEGPxFQa8TvI9HhktU6GCDztCFPp/vQRIRZeKGgbUIT0sxZdsAKQ3pJJWQKbAyRzLE7H CiuS0z1Is4pXk/fPGnWtcw8MrD1InNNJ0yilH9PbEE4OEyC/VgIAgjMAx/p3Wm4FRQ2zic iAKFimChPlyJhWkBv11Sm6bB6HUxcjsYNmWiJo/XwyJcUlvwbOB7lkmKMQJeNcHlJ6cV3Y 8i1ivT42/rqayDs5eicLsgV2WdYD1rz1DvZkdR8AiRsOrsP44S3cwdudYBroIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672320544; a=rsa-sha256; cv=none; b=t6w1yJXsfc9pSz2oiGN2kmfTFu7gyb90DDoCnoV6vv/zfv7iNPdmyH/Z9chdtcefgzyFJS 5BzEDfhy4tkmRPuGYrOFeuYNP4KFHPZKEBl6Ku/PDEJTd/ijrrsWT6J4CpQQUv9W3l5tfZ 8xZNImtYK/hLG3CnhiIabA0vFHXFyeF0+KMcNI0LgDU+4Ggodz4klplMZ65C7VGJhTOQzK jV2WdSOyhBySMY6hozA8HtE6Vh8xEWz9pxzrEyJZZjwPe0g/XJEAb1ROWXL8E/lfqF+zi3 FPF2vD/soNg7y1ZHcqr3LK6AIQjvftkOniQqVl+lVwhR1jx9z4Lq+9YOEtzk2g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjTkR60wXzW41 for ; Thu, 29 Dec 2022 13:29:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTDT3wJ041944 for ; Thu, 29 Dec 2022 13:29:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTDT37B041943 for fs@FreeBSD.org; Thu, 29 Dec 2022 13:29:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 106107] UFS: fsck_ffs: left-over fsck_snapshot after unfinished background fsck if filesystem clean Date: Thu, 29 Dec 2022 13:29:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 6.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: short_desc assigned_to priority cc flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D106107 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[ufs] left-over |UFS: fsck_ffs: left-over |fsck_snapshot after |fsck_snapshot after |unfinished background fsck |unfinished background fsck |if filesystem clean |if filesystem clean Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Priority|Normal |--- CC| |rew@FreeBSD.org Flags| |maintainer-feedback?(rew@Fr | |eeBSD.org) --- Comment #6 from Graham Perrin --- Anyone, please: are the symptoms in opening comment #0 (2006) likely to be reproducible with any current branch of FreeBSD?=20 I recall relatively recent attention to background fsck in (a cherry-pick to releng/13.1) =E2=80=A6 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 17:13:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjZjp4dgVz2kh6f for ; Thu, 29 Dec 2022 17:13:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjZjp2FDwz4PhP for ; Thu, 29 Dec 2022 17:13:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672334030; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qszmun3C7uYPO6glc/2PcWJ7mGg2dYtOdCslgtIV4fw=; b=oM042w3YE1FtFNZdWRj57d4Y74MNYx+FUs2pehCpofZHNK/ZbiEL3e+Uza1cYMyal7tXKe hwtcHcwsVPAWPeot/Fg9WWRZlj4delkQWbfJ1g5lUvrl/pjIzpxkRdf0ejiwfcMrbugTj0 dKyIyVd4ZceHdTdHTrgei9opARn3SywdHeXOZwyQAeRb9Q54rBhIPYC3e6RqUserxygiJ4 6uRtMs9Hh+wZlphKeTIdZ0IsGkgiN9LmqjZJAsDXuJI4DZ2mC3xlDk3h5OE+myqKvul1Bu 9cj/eWThLuk2krs9E40Df7P18q6fhk3Mah3SqcE9BNfRZfcfnFHs13wk3DZg+g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672334030; a=rsa-sha256; cv=none; b=sc8Bup8HSHp19WVWrvoOMMqoBYtxG1K4cto+7S/YaW2Khd2+3+qs69M5Ehy0fnzrZXq9Mu pbWMG5QU3X57sjxN1cpz9HZNXfFTzCVD0z2WmSUit6lrZsBspwvqoJU9wZPIUQcqJiDGpQ 0ARn8cuA+v380BDfWql3DXSEHmfOxLJVRXxPkd/WUq6eRU18q0Gt7qeeaq9BzNFXIfFYz+ N1Q2zswNyFEdoCVQe5rt2Iqjoy9xbSVWLuqNUKKPooOeCeq36EYyf44mhevfDjydOdNafx cFWELrZiRfZANvvchxi+e5zjhw+IoyVrmGVN3lUKvNKs2ogkwy50CupMCb/KdQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjZjp1JVnzbpp for ; Thu, 29 Dec 2022 17:13:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTHDoni081470 for ; Thu, 29 Dec 2022 17:13:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTHDonY081469 for fs@FreeBSD.org; Thu, 29 Dec 2022 17:13:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263885] fsck fails with UFS journaled soft-updates filesystem under ESXI 7.0u2a due to 13.0 increased kern.maxphys Date: Thu, 29 Dec 2022 17:13:50 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mav@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_file_loc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263885 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org, | |imp@FreeBSD.org URL| |https://cgit.freebsd.org/sr | |c/commit/sys/dev/vmware/pvs | |csi/pvscsi.c?h=3Dstable/13= &id | |=3Df51c1d1dd595ce51059489d= 7e1 | |248ff6ba39664a Assignee|fs@FreeBSD.org |mav@FreeBSD.org --- Comment #7 from Graham Perrin --- Triage:=20 * assignment to the committer of f51c1d1dd595ce51059489d7e1248ff6ba39664a=20 (thanks for the then fix/resolution) * CC author * reopen, or make a new report for comment 6? --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Thu Dec 29 20:56:42 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Njgfz022fz2lFjS for ; Thu, 29 Dec 2022 20:56:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Njgfy3tWkz3lWw for ; Thu, 29 Dec 2022 20:56:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672347402; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BabvUL9pK2aopppjgUDQwvDmINKl4e7zkh1SftCX6LA=; b=uIwaLFoaAJ5cDWvjr+eG7+ZYio1snsGSRKwww/hS64kbyPGafYsYLf8GyB0j+ByApMDOzl OjQkppUdygkH09cQSRsSrZ5ikTRKd9MwlNrp0C/197G9HsaZfYT6sQroNaS05iZ14LczJZ NxR34Kxp3vWNW5QiOI0p8MDyL4VCsvx+GLsHbe6H11LFI6yWlJ92rjciD0akkCffy8H93P IIZSB7OmBvG+PkkfvvvmIda/vW+h7ITgw9EGws+eAS3InPygTVUSMNGSuDNsF6HUX6YlKu lTadqZTz1O5rvHJjxWOwD2DcSNCtwcDav4DAMfPBLpcper2MYUt32JNitdddqw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672347402; a=rsa-sha256; cv=none; b=oG5JpAbAToH8IUQYtP8OxT3XnF+eS9729YgP3YTXIluXw9MLRjJTIgxQ8UaN+eMGURXBtX /O2cyb8Zn0tgFWw5IHXOb60WWVg931V+/+F8P1DtKJ/qL4TGzogMSWguwbPKGeB/ht+VAM CrKQqHLYrfF03ZgS0UOUqex7rVEDypYI2rh8p+gAR49CurUY5tjwwzDFyGSY82+K1eihqO FaYq5B2kx9PDwGpr9rHmwlefEQP7ZPhdvVd/7FSggXSzNFcuWFxnFaa0/yuxCrn2f/Fh66 z4tSQRJP2Sm/1TN331xW64mZy8fD0Wfi6XnySRe6lE25yVN/U/SPUuJNHkljQA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Njgfy2jyWzj4b for ; Thu, 29 Dec 2022 20:56:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTKugfh008868 for ; Thu, 29 Dec 2022 20:56:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTKugGQ008866 for fs@FreeBSD.org; Thu, 29 Dec 2022 20:56:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Thu, 29 Dec 2022 20:56:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 --- Comment #4 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D701b36961cbd2084c36eb828402d0ef89= 211d929 commit 701b36961cbd2084c36eb828402d0ef89211d929 Author: Konstantin Belousov AuthorDate: 2022-12-28 18:14:52 +0000 Commit: Konstantin Belousov CommitDate: 2022-12-29 20:55:39 +0000 ufs/suspend: deny suspension if the calling process has a file from mp opened for write Also deny suspension if we cannot check the above condition race-free because there is more than one thread in the calling process. PR: 267628, 267630 Reviewed by: mckusick Sponsored by: The FreeBSD Foundation MFC after: 1 week Differential revision: https://reviews.freebsd.org/D37896 sys/ufs/ffs/ffs_suspend.c | 11 +++++++++++ 1 file changed, 11 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 21:22:55 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjhFD1Y6Pz1HxfZ for ; Thu, 29 Dec 2022 21:22:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjhFD0WQhz3pb9 for ; Thu, 29 Dec 2022 21:22:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672348976; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kVpFE2u8ySqKY9l617KP2a/PEM7UkAYowO68w0L8Muk=; b=Np77wJ7guoBfvqmikuhAqetI+MtYsY2cjJE/iwJ+vCZ+QLB9TQ+ayXb0MJIw1UFt/xdVzM kBGG/0PLeNxD/5fSddrb+M8TjNXaHBMXpYq79eS4+6YdgHSwiIZa8N7MMncDumfiEzH5wm DoCEDzMvLVrUNZH6ZMcmhiZ2p9HFnV2/S53XesBUbZHfxfAeWQcfU0kEEET2yPzrXKmwc3 tVvDhIdVrLdYYBtWuPT7aZPLm2HBM7WKQrTxdp525UToTyG8RnpquSHyKtujsQHT2samWf hySy01kI1kVnt5H0b74I8HoIuy/yacNJcQXGQQ8KleMQuLFcfRFkTf6vb6QsUQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672348976; a=rsa-sha256; cv=none; b=mvr0fqGPVsBZ8I2bUMX6fPO7XG7e1DjysO9MBJ+2WPYiuowBsQgn33GSt6qLYiJqZg9J8j YRdDc7M9dF0wQ8lAImsqaU0A8GFCShVDWXOBlDLwOqa1hQxqB2rqeMHFtdhFkISElaQdNv lZmISD1VkxwN8A/e7k1ou8WmvI5CGsIlAnA5jI6lQokOjKUIyeyjX1x428lCCE9ZUi0k/r xsMiPhrsIprfgQ45pQrkv+TFusTS35F1q8Zb0bxNCal/VKdFocdv9Zu2RmvsKZzROBQkk7 sAhqKjI/iC8tvxnQjUpQKyZkZCyPhazzWSVW6UTO7vr1V4ifZ61li4x7i84DZg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjhFC6hWLzk0m for ; Thu, 29 Dec 2022 21:22:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTLMtgK049649 for ; Thu, 29 Dec 2022 21:22:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTLMtTg049648 for fs@FreeBSD.org; Thu, 29 Dec 2022 21:22:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Thu, 29 Dec 2022 21:22:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: cgull@glup.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 --- Comment #5 from cgull@glup.org --- I have some WIP addressing this and adding enhancements, which I'd not fini= shed testing before the holidays. It may be a bit late now, but my fix to growfs is to check stdout/stderr for mountpoints in growfs.c instead. That's less general, but growfs() and /sbin/growfs aren't very general-purpose to begin with. I think kib's appr= oach is fine, though. I have some other minor changes to growfs to avoid writing to stdout/stderr unnecessarily, and I also implemented my proposed enhancements to growfs.c, growfs() syscall, and /dev/ufssuspend to write new cylinder groups before rewriting the last existing cylinder group. I'll finish testing these and make them available for review soon. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 21:26:47 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjhKh3FWVz1HyTY for ; Thu, 29 Dec 2022 21:26:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjhKg5zpnz3qK7 for ; Thu, 29 Dec 2022 21:26:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672349207; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=giXrNxxrsi+PA9AezTn/L2rBj4tgSgGLqj19yzlM0ls=; b=wXnJ3RAvZQZARCDK5JL5yDG6AsSG5a9gphFrt8SCMbWRKC8un6I6Pt/dFQNrFBUpru6AB7 r4WqbJnqFLQMlKqE38ckEVxnLD8av5/jq6Pzo9O5lM8QS6EM6vZv21+RZu2GRmiDKZTFXo Us1w7VwKUtoqwNbESWN3xoKiNh5C+0VyLvtfEB+wIdHb3sGWJz5bMqHATG9ixlcscZ4cUd e6kwKsl/PUFA2sIoOETAM+htW7f0lbNSivElbFHl4U46nV2NTVzre5TM6mdPlM1DS8D1Y1 +t1tSx/jABME2riGd8I6X6gtwTat0lFk8PdtU5nWsqFpNX2eQevSV2/085eCgw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672349207; a=rsa-sha256; cv=none; b=l4tGjug+sVrZk2LpVVqeyJqcwqCrs9nsYyxcBW5SHCVnsS0qETOnGlc5tFV0hHtN4LZS3o E/rWiAN+lBtuQ8SdvqTQuK6J278WcbWsFrWe9J7/EvHCZZzQUEyg+oDvYmJbx4ktFJDdjm zZwm8rzEKAadw29i0b3ie7/a0++kZ0Uu7r8rLJIUUnmaREnRnnpOOH0DKL2Pe0MbXcL4kr 1xo/1XV92/uFmvbP2pYmDf7hTl6CjNWtqpqMLdcFSQO1irEqnymfoI0CVhCoVc2uMh5aRk bp0XAn2vZdLiKj8NEJD9G2iXpMD1Hkr3HA13Xp7ZEo/uvDwtPqHdd9BYq3nLow== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjhKg52rtzk2x for ; Thu, 29 Dec 2022 21:26:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTLQlHB050997 for ; Thu, 29 Dec 2022 21:26:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTLQlHT050996 for fs@FreeBSD.org; Thu, 29 Dec 2022 21:26:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 106107] UFS: fsck_ffs: left-over fsck_snapshot after unfinished background fsck if filesystem clean Date: Thu, 29 Dec 2022 21:26:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 6.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D106107 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --- Comment #7 from Kirk McKusick --- This problem was fixed not long after this bug report was filed (though I w= as unaware of the bug report until now so did not close it). The fix is to open the snapshot and then unlink it immediately after it is created. Since the snapshot will have no references it will be removed when fsck closes the fi= le and/or exits. If the system crashes prior to fsck exiting then the next run= of fsck will find the unreferenced snapshot and remove it. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 29 23:13:37 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Njkhy6klZz1Lj7k for ; Thu, 29 Dec 2022 23:13:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Njkhy5XMjz40bR for ; Thu, 29 Dec 2022 23:13:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672355618; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7pTZHSjOjkH9wHiiGtq2KLNPNHG3oGAHSgKrKmQRoRk=; b=xg1Zn3mfNOmaPe/GsUtUwcMVa19U/RrEF4jSDkv5e7ZkuRinAd+9jtjvPxC5bS6sZS91lj AAoH0/EgeXqHI5aapdlb8R1V5VyPMpCZybyUIeA8G0tvKlC2Q5lA7A65hDOiHsINivq8gi e6amia9QuuiYKOTaIbcSwXl+G6ZIxog9KgyRlySA8ikvlRmCbd9rGa+opkJZJhfBZu9YSZ RVEakY+pmwNSbfyOXAuUKtz0On4SUxzPwUcgHjtO2F/2zzkq3tQ8dMtYvLh/fZd+o62VRo aSYK71JYQVZ6RTREz513MY9bmH/MZih96Lbh5uBGwKXpcg99XyH3AZjnYaJ3Vg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672355618; a=rsa-sha256; cv=none; b=AJCj3CNwBqX8TRo2m8C2P0xvWqzUCP33NqrNMg15p8FNK3rmVdVdMfi/Wb3Q92SdCzio7A GtG7aBVRapghfstP2GNp9eg8FMER+JobyqUDlQnHAzU5NJN5aTqryj6GjwxgI3HTnMoP6K dNRyrQYY87+5OpIj7U3NTB8Byj3e2ap6CkqsgQH0RVWPcbELSRK5TOqmsnWDbB2UbQrfWl KGRZ953XTcgKdOOpYDQTJQ+9MBWQpGm/1DcbQW2omtMzPjK+jkpyhAKBk9weTVbnl5NkTq VqwGnCk0mfJ7EODhSbSwPIyEn0n4ODz03xxO3LBCOGuZJIgN2pNBjAJATKuzlQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Njkhy44lzzlkp for ; Thu, 29 Dec 2022 23:13:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BTNDc1U010097 for ; Thu, 29 Dec 2022 23:13:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BTNDc2H010096 for fs@FreeBSD.org; Thu, 29 Dec 2022 23:13:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267628] growfs deadlocks if output is redirected to the filesystem being grown Date: Thu, 29 Dec 2022 23:13:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267628 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #6 from Kirk McKusick --- (In reply to cgull from comment #5) I am happy to review your proposed changes. Kostik's changes are needed in = any event as the kernel must protect against the deadlock and not just depend o= n a utility to do so. However having the utility avoid the problem and give a m= ore specific error message is still good to have. Also the reordering to narrow= the window of vulnerability to filesystem corruption is much appreciated. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 30 00:44:10 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjmjQ5NJjz2kZS6 for ; Fri, 30 Dec 2022 00:44:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjmjQ2TZpz4651 for ; Fri, 30 Dec 2022 00:44:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672361050; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yb+DwQlmfEFjwjE9kVwL/KCLEex4rUxBndKYGwyY1O0=; b=j9nY40YI6MwCwNU6EovlcNLjscp6/TjikXT3uHFQO/jRD3Anxwbz5tn3AJDVmgu8je3oAV X/067ZIeE9LiEObLK8R2ghHvewixWG49K2UbwCdwWWU4tpcC/sYamQPIB+Xq5jwh9aFl8V 7ssRLRS9aFilufb1kgRecD/YGhPrhxew0X43qCmHqaW6Gi1if0RWBA72qYzBjci7ukZAVE JtAmREGx1DJ8DC4yzRDFBXyBEqKgQp3ih+SfEhV+6U64m93LIZ61BI3SSO6VwDOwl1+7f6 iD89KYD4a8Oyq2YGxCEcxP8C4WHsuqFtpipuIiP23CTboKTOE1XIwbyXcHLzqg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672361050; a=rsa-sha256; cv=none; b=hSEX5t41H5qXr1xqWj7XLYKDNd2crnUC4/wwWNr4SkTt1VHVinqwH0/qqvtZ+AyFuMQFJh akIRWbYJKyrEQN/YICDHD0TUvS8hdpWXZ9eP83Z3gLv9aefdCTXCdU9t4aTHSSW1cg+kqp vsqmeVdv+hVJQR7RaHp790B8XHleYkgdbEHhdD2iV52O1KW16xFur/INmEIsv62PGeGw/i 8S8adChC6HhY8nYkZB5F5MZUXvwW12KLyyKKLazwplhKoQgC4tr6O6LinJ3YTlaBvBoW0l qAnLHeDNZ9X+CIXIRuzAaTB3eAUd0DRIczEGN8WAkQj3KYe/hd+oRo9Jvsd5sA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjmjQ1QT3zpNJ for ; Fri, 30 Dec 2022 00:44:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BU0iAVs044796 for ; Fri, 30 Dec 2022 00:44:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BU0iASh044795 for fs@FreeBSD.org; Fri, 30 Dec 2022 00:44:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 256586] running firefox from a tmpfs backed unionfs causes instant crash, no panic seen. system resets Date: Fri, 30 Dec 2022 00:44:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256586 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 30 04:18:35 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjsSr6l6Bz2l6wD for ; Fri, 30 Dec 2022 04:18:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjsSr5hp6z4PvK for ; Fri, 30 Dec 2022 04:18:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672373916; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n/KQq8Uh3jjLiaNstGDHCNyYG5RU9gK3XlTUAz8F3sA=; b=Bl+VmCrXWsbfcV2B5pjmsnPxhH9jCaAQ1PNW5zyZ5V/R0+3XwmGSTM0H+4kJAezN6+Knkc J8azvbf/pnV1CSZmzwzOiPTIGk2M79QAAtTzVtjsy8pnaFJp6zjqNiKfBRwlXwpppCUn2/ z2f3S5Wj28zmzfEO2vBm5xUeNmG2LEjEFmlcqj0/zOCkNfVX2QPmYQKyGb8Q8su464IUax nO9Zsbqq+En1oJOhDappYg71we4gSb17NPKfziHa3Y/jKQKarI41AfCOiiue/RASB9D1zU kF/enTQZPFBiL+MO0/AWUG3FBVdZpW+h2vascW1JiFZd4BjIJxit0/xeN6hTVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672373916; a=rsa-sha256; cv=none; b=uGxOPeN1CtG9TcPJqjwpc7rLLWJP71TblwCN9/w9eMqc24l8ndxhelgd8khyA/UgxFBxX2 VqOdfvanBJsgWz3X+j/9e8VSm2NV4BPMJo2J9uYJ7QUKYASm6JWpSvOPNafvyVHx+Iv5X6 AgR1iT3e2nFd4gh2JnwgqX06N5NWEhxZ9RGxunFdHdIaQRwn37nW5IdZ2yhUBm31S6p2M4 cktN2Bw395+BT/J9lWhoRQmqg3/ar6IpcwqBK427A/lSR014YYjynVJnl4M4Jy7iSDyWlT WR6kYlZOm0Avw3YvKMQC9vSnYuiZV49IJFQ/FtT8Q39llE5fn7KEXT7quBHkjg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjsSr4m22zvLK for ; Fri, 30 Dec 2022 04:18:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BU4IaKE055581 for ; Fri, 30 Dec 2022 04:18:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BU4Iali055580 for fs@FreeBSD.org; Fri, 30 Dec 2022 04:18:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter of the FreeBSD Handbook, and other OpenZFS-related pages Date: Fri, 30 Dec 2022 04:18:35 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|Update the ZFS chapter (20) |Update the ZFS chapter of |of the FreeBSD Handbook, |the FreeBSD Handbook, and |and other OpenZFS-related |other OpenZFS-related pages |pages | --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Dec 30 05:06:30 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NjtX76GSHz2lDTb for ; Fri, 30 Dec 2022 05:06:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NjtX75FQlz3FhZ for ; Fri, 30 Dec 2022 05:06:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672376791; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5E0cijqIHJOj5bEwbPDs6CaXMMlaZrHmXrNs8R/hOC4=; b=XFzaSrxpf+qrtAbV6YLufxrr18BNkTtSG0j6yB6Yk6kdK6/CaKVfnSYwoVYJ8vNDVj3+w7 H36qxc4AN56jRqz6WiOHOnzUFGssi0Pr5ZQZ0GuA873xKX43zpVynX4VC79mjP0bff1CkA lGf5OZ+Zi9bMmubSe7Gis9P39ixdTK1OVZFo+qcDKv6Jv4+rtpv70FUeUCOPoLQzkN9j28 ZeuD67QUDwMHcfJUeUuA/JYUF6xwgVnsOVysfvNbc4PAbh7vtlpRZnlAKKB6tDynRUZR28 CTUQLtmmn8eMaJG8/59YtMkYZmmT/ZrjEHg42uOV87YCdU9VLYTU9xVxYEvQvQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672376791; a=rsa-sha256; cv=none; b=I/0UpAcuRfmi0gcdxm2jmSEV2B7RxD+I+WOlrWgd4TT099IXdAXi2Ks3Z2ojz7h/RMn/iA Z8TjO2RELEMO0azgfCybONJ1gwqobk6R1ihIc6gRhn4+Vsx73aKgA6wPTcNxoWpbax2DMO Mzbr5lV2k8m2VOG3Q0qvYlTxlfIzPvvxL0kKwCRww4skwdqd1B8vHoilLGd51V8uSZrqMO +7WN1qzZsg4idnN6VtM/p8QbU2HjnItkeCZ+tRRxy9N2nweRAgwWcjVzx78+6u8x7Lwjfc glQLnr5E+07LjV2cJRGJqKZ1fd8oWvX1OU+EPWsZ8lVTl27MrDjVhPnQ5kECXA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NjtX73nXSzw8p for ; Fri, 30 Dec 2022 05:06:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BU56Va5025198 for ; Fri, 30 Dec 2022 05:06:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BU56Vpi025197 for fs@FreeBSD.org; Fri, 30 Dec 2022 05:06:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter of the FreeBSD Handbook, and other OpenZFS-related pages Date: Fri, 30 Dec 2022 05:06:30 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also bug_severity dependson Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 404 | |21, | |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 645 | |31, | |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 656 | |11 Severity|Affects Many People |Affects Some People Depends on| |263321 --- Comment #16 from Graham Perrin --- For OpenZFS in FreeBSD 13.0-RELEASE and greater, we already benefit from the authoritative point of reference:=20 OpenZFS Documentation 12.4-RELEASE is expected to reach its end of life one year from now . I'm not inclined to put great effo= rt into documenting the ways in which its ZFS differs from OpenZFS in superior versions of the operating system. ---- Refocusing on OpenZFS, the preamble at includes this:=20 > =E2=80=A6 A complete list of features and terminology is in=20 > ZFS Features and Terminology. For starters, let's remove that paragraph and the linked subsection =E2=80= =A6 Referenced Bugs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263321 [Bug 263321] FreeBSD Handbook: The Z File System (ZFS): expand chapter including RAID-Z note with new content (including raidz2/z3) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Dec 30 11:59:41 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nk3hv4WRyz2l54S for ; Fri, 30 Dec 2022 11:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nk3hv2Lqnz3t8N for ; Fri, 30 Dec 2022 11:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672401583; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7Ici/3LN+Sfwx2qX0melZbXU4OyURqtlVRBnpADIWGs=; b=icEx60mMo52jXL4lwpWp+LMfxa2CC3TpaAMccU0+rzZqjuSG8qV03gZTmj5aGT0EvkejvY Uva3Z4MetdM6OB1WLpEpR98N/udLmmARDh0rlY2c8Pv/PRiDzqMGP0mc65182/OzhmTUsM s9rW0BourQFN35L2HCG8mWxEsGfJyL6zypg78RXVm6uTsKGN5gsrPo9uJzk0KYf/c76FR8 Vm1qOmqy+mr2VjO0yWSesNvYyn5mR79tXGIOWIrI+Dhl1zmxPLnfcvjYuYuBmGY7gcAQ9p F+cOZ3wmkoK0d4ppxNgfspNDhHauUI19/OMpoQnahT1UUPnHHBdoIkljF9XmBg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672401583; a=rsa-sha256; cv=none; b=MadH2WSA+zX7RnGtxPssrY6FvMBhvi8O5muCeLe2i4sULPMxKs95I+jXIwd68id1ellmKa hZSM6ken2kD1jeb/7B4ywzBG4lootxkRkfh0YyImE7+KnOinMX4Z3tGMKmvNkrR/FxQaTB PHPIU5NJpgqDvD9zz8NNC+Fs6hQOWu1IvJsznodMVQWk8ydU3fd4EsfkG9sorh6lUM8OYP Yhu7If//5E2TICJmz2k8/lJn4+x6LJib6xkzr1C6QCbGuk9cycA5oSFf94xbgipAkKQQLd qVynfuj/7vEO0Ze44liPa6oJSFVDy3wHcn9RfnnAK/t3jjtDMuaCApcBdeBnCA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nk3hv1Rzmz176m for ; Fri, 30 Dec 2022 11:59:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BUBxhE1024119 for ; Fri, 30 Dec 2022 11:59:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BUBxhMe024118 for fs@FreeBSD.org; Fri, 30 Dec 2022 11:59:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 261212] Update the ZFS chapter of the FreeBSD Handbook, and other OpenZFS-related pages Date: Fri, 30 Dec 2022 11:59:41 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Documentation X-Bugzilla-Component: Books & Articles X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: grahamperrin@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261212 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |doc@FreeBSD.org --- Comment #17 from Graham Perrin --- Triage, batch edit (just one):=20 * for twenty-eight FreeBSD Handbook-related reports that had gained a=20 personal assignee, prior group/list assignee doc@ was=20 missing from the CC list. Gentle hint: =E2=96=B6 do, don't =E2= =80=A6 --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Fri Dec 30 19:13:19 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkFLX5pNfz2lMxS for ; Fri, 30 Dec 2022 19:14:28 +0000 (UTC) (envelope-from jafarlihi@gmail.com) Received: from mail-pg1-x52d.google.com (mail-pg1-x52d.google.com [IPv6:2607:f8b0:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkFLW1yJCz3MmQ for ; Fri, 30 Dec 2022 19:14:27 +0000 (UTC) (envelope-from jafarlihi@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=UlhGuoXv; spf=pass (mx1.freebsd.org: domain of jafarlihi@gmail.com designates 2607:f8b0:4864:20::52d as permitted sender) smtp.mailfrom=jafarlihi@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pg1-x52d.google.com with SMTP id h192so9883594pgc.7 for ; Fri, 30 Dec 2022 11:14:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=0uzOPyTC5KtbbH4j72xt64H+D9uoXqAIguTMNmFcZaA=; b=UlhGuoXvzbTnWFyydOvCaJDR9v0UE9UJtgjifrtrJOhLFmhq44xGaqy1V7h84WLBX8 n/SYp7dvMPLbtXDAarqEMQqi+T38Z8ziJlWNE1InwxzomyEsZpQQOpkdz8hT6Ne979Ik f1T6QwobNNzwtdTb4Qklo9XiyNlWIu4gfDws2qZpfIG0wdr2M/CFShKnawkH1f582M0Z whZJhg2QqwB/R1OM7+5lflDRK1vI1I8sIc4axHTznezN07FTd9OfMUKFnHZidPho65nC Sqlsa9FoT88UDSKLcxPhYn9ASFPt0YUnmXM6cMeKEK8ORCZkKYb3TL/X8rWpf2Gpv46v 1ekw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=0uzOPyTC5KtbbH4j72xt64H+D9uoXqAIguTMNmFcZaA=; b=OwlN8A2kvWq4xyWeK2Li+u+r+yNLzth6PMTL8fRNIbqM45WzZITUxHAu0wxlAE5tlf F8fCJrgC2EYLf4QjefftTZ9rM3rBw8EDMAXUqRFplLyJeoMmqNSXO18w19ZfXoDkpNdA C6pIVd48CndzLS3o59JsHlO/828bMwM/FerimhroqMRhxRJMblEcTOcR0ZyWldUYoD0e LAWo4h4oqtUfuaZGzigtT3B4+CpOTIgwi6679Vucxtxi+RsnfwVwt7TjtOxi7WTXlEqJ RFYiRzYSt3bUpix5Z4JcfGTsnqHCUw6J6eeLjjBaR3tvToNvN1Fe+O+iKHYlKSUbNcsC 7d1w== X-Gm-Message-State: AFqh2kpwoH1iAu/l/P6l2Svqm2GPS3/OJigOdMebXngm/kuP4cWMKwgg IqoB408IshPn+9Pz4NsXshb5W39JbV1YpuY4C9m6NLmdP2w= X-Google-Smtp-Source: AMrXdXsrI6UtfPPv7BeMxEc68D6HSsHXXX7ZUvamTE8u2WV6BXnYCxAhlzC3vLSJOaFe2TElmmBvdXSPTz2A+hRPy/Q= X-Received: by 2002:a62:198a:0:b0:577:16ac:8447 with SMTP id 132-20020a62198a000000b0057716ac8447mr1886458pfz.56.1672427665257; Fri, 30 Dec 2022 11:14:25 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 From: Hikmat Jafarli Date: Fri, 30 Dec 2022 23:13:19 +0400 Message-ID: Subject: Trying to implement BFS, page fault at vfs_domount_first, how to debug? To: freebsd-fs@freebsd.org Content-Type: multipart/alternative; boundary="000000000000e67b7e05f1106808" X-Spamd-Result: default: False [-3.00 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::52d:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4NkFLW1yJCz3MmQ X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --000000000000e67b7e05f1106808 Content-Type: text/plain; charset="UTF-8" I'm trying to implement the BeOS filesystem (BFS) for FreeBSD. The repository is here: https://github.com/jafarlihi/freebsd-bfs (Please don't mind bad styling and all the copy-paste work, I'll polish it later, I'm just trying to get to some PoC where it works) Now when I try to mount a valid BFS partition (reported as BFS by `fstyp`) it executes all the way to printf that logs "Either not a BFS volume or corrupted" and then crashes with "page fault while in kernel mode" in vfs_domount_first+0x271. Here's the log: ``` Either not a BFS volume or corrupted Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x18 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff82b2427b stack pointer = 0x28:0xfffffe00df399ac0 frame pointer = 0x28:0xfffffe00df399ac0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1208 (mount) trap number = 12 panic: page fault cpuid = 0 time = 1672414952 KDB: stack backtrace: #0 0xffffffff80c694a5 at kdb_backtrace+0x65 #1 0xffffffff80c1bb5f at vpanic+0x17f #2 0xffffffff80c1b9d3 at panic+0x43 #3 0xffffffff810afdf5 at trap_fatal+0x385 #4 0xffffffff810afe4f at trap_pfault+0x4f #5 0xffffffff810875b8 at calltrap+0x8 #6 0xffffffff80cf0651 at vfs_domount_first+0x271 #7 0xffffffff80cece9d at vfs_domount+0x2ad #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8 #9 0xffffffff80ceb9a9 at sys_nmount+0x69 #10 0xffffffff810b06ec at amd64_syscall+0x10c #11 0xffffffff81087ecb at fast_syscall_common+0xf8 ``` Now I'm trying to understand what exactly goes wrong here and how to map 0x271 to the exact source line. I'd appreciate it if someone could tell me how to debug this. (Sorry for noob question, I already tried IRC and was directed here) --000000000000e67b7e05f1106808 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I'm trying to implement the BeOS filesystem (BFS) for = FreeBSD.
The repository is here:=C2=A0https://github.com/jafarlihi/freebsd-b= fs
(Please don't mind bad styling and all the copy-paste work,I'll polish it later, I'm just trying to get to some PoC where it= works)

Now when I try to mount a valid BFS partition (reported as B= FS by `fstyp`)
it executes all the way to printf that logs "Either = not a BFS volume or
corrupted" and then crashes with "page fau= lt while in kernel mode" in
vfs_domount_first+0x271. Here's the= log:
```
Either not a BFS volume or corrupted

Fatal trap 12: = page fault while in kernel mode
cpuid =3D 0; apic id =3D 00
fault vir= tual address =3D 0x18
fault code =3D supervisor read data, page not pres= ent
instruction pointer =3D 0x20:0xffffffff82b2427b
stack pointer =C2= =A0 =C2=A0 =C2=A0 =C2=A0=3D 0x28:0xfffffe00df399ac0
frame pointer =C2=A0= =C2=A0 =C2=A0 =C2=A0=3D 0x28:0xfffffe00df399ac0
code segment =3D base 0= x0, limit 0xfffff, type 0x1b
=3D DPL 0, pres 1, long 1, def32 0, gran 1<= br>processor eflags =3D interrupt enabled, resume, IOPL =3D 0
current pr= ocess =3D 1208 (mount)
trap number =3D 12
panic: page fault
cpuid = =3D 0
time =3D 1672414952
KDB: stack backtrace:
#0 0xffffffff80c69= 4a5 at kdb_backtrace+0x65
#1 0xffffffff80c1bb5f at vpanic+0x17f
#2 0x= ffffffff80c1b9d3 at panic+0x43
#3 0xffffffff810afdf5 at trap_fatal+0x385=
#4 0xffffffff810afe4f at trap_pfault+0x4f
#5 0xffffffff810875b8 at c= alltrap+0x8
#6 0xffffffff80cf0651 at vfs_domount_first+0x271
#7 0xfff= fffff80cece9d at vfs_domount+0x2ad
#8 0xffffffff80cec2d8 at vfs_donmount= +0x8f8
#9 0xffffffff80ceb9a9 at sys_nmount+0x69
#10 0xffffffff810b06e= c at amd64_syscall+0x10c
#11 0xffffffff81087ecb at fast_syscall_common+0= xf8
```

Now I'm trying to understand what exactly goes wrong = here
and how to map 0x271 to the exact source line.

I'd appre= ciate it if someone could tell me how to debug this.

(Sorry for noob= question, I already tried IRC and was directed here)
--000000000000e67b7e05f1106808-- From nobody Fri Dec 30 19:35:43 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkFqB3cT4z2lQVr for ; Fri, 30 Dec 2022 19:35:50 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-5.mit.edu (outgoing-exchange-5.mit.edu [18.9.28.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkFqB0Yl4z3PvJ for ; Fri, 30 Dec 2022 19:35:50 +0000 (UTC) (envelope-from jfc@mit.edu) Authentication-Results: mx1.freebsd.org; none Received: from oc11exedge2.exchange.mit.edu (OC11EXEDGE2.EXCHANGE.MIT.EDU [18.9.3.18]) by outgoing-exchange-5.mit.edu (8.14.7/8.12.4) with ESMTP id 2BUJZkmw017851; Fri, 30 Dec 2022 14:35:47 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1672428948; bh=36eN4/rVGU0M9HNBgtZxShJAD7IQ4+QFeaRO+G5vOX4=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=j9jtgbNGa6r8bMFaEMkSuxU1w29dZF0igMvp+PgePxsdpxmeBjOrjwJxomNPLyedn VAv7nSkfxcY4pllb5stB73KBpNQOUvn9F3p7Wc2o4g+Hoo6xjtVOjm3fsCXAPiJrU6 t/uvtuWQId+edfNpExKlkcDi3XczqjW38HNlA6mYxcn9sbTlaj8CD86HJap0uRqK20 q7q9AbLWM38Zbvgwl3K++Yj/w1bQY/dzuPEZRlltQQvGamWOBMOBbqeOUA40/5YOZa sjtClu7JUXg9fSaTRaUBEObKQ/FGkGT3QbMixJYyy1I5iT6vZP3UTo+AvhU4HbJVCe DgFYHuGzzUjbQ== Received: from w92expo17.exchange.mit.edu (18.7.74.71) by oc11exedge2.exchange.mit.edu (18.9.3.18) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Fri, 30 Dec 2022 14:35:16 -0500 Received: from oc11exhyb5.exchange.mit.edu (18.9.1.110) by w92expo17.exchange.mit.edu (18.7.74.71) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Fri, 30 Dec 2022 14:35:46 -0500 Received: from NAM12-MW2-obe.outbound.protection.outlook.com (104.47.66.46) by oc11exhyb5.exchange.mit.edu (18.9.1.110) with Microsoft SMTP Server (TLS) id 15.0.1497.42 via Frontend Transport; Fri, 30 Dec 2022 14:35:46 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LuYyDFQhVoe9E+jkPJNQPUb3uHDsq5lHgjFuyT+1m8FLutk30CqghcHLoj3rdB5ta+37hTTJrdJxPwoT1aELFiAo6CHF0gPN3nysESyV9WpRrt1spCrM/zpPwGZVwMce0uS61q9tmu44eO0RvVYnS9wsT7oAElvo2c09LR+398eunJw79veR3F+d0rxxHnO2jEMZZ/GridZvQ1+v0arwWGKyJgZ7mSKko8vCoVwnwygo3yKbuCG1sesedBaV4Cwozix6cAPv1ecaxGcowWS6OiCtTtvM49VQpElsxZqGgmg+mkVnwaPSEFA/bfKMptwd/8k4M0YKGTr/YrrIUzbArA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=36eN4/rVGU0M9HNBgtZxShJAD7IQ4+QFeaRO+G5vOX4=; b=MHr5PwG8qJUkx0/kv6eCx23utyGkkL7audJwxVDyQrJeUPvPa+n4sxaoeeT9xrKy50gbZ5C8PU6uOx2sucVH0HsbIlrcoX+cbkVJ5CvSj8IOUoKOpIRCSdgBgO7sY4DeNcgEyZifUg77abDCO06BO2bwrt/GhHQLNhxi/9zHLW1NpKcsZ7Ub6g62NgoVIceOXRqfhtfZ/9Kzn4qW5REFkSgTX2nFWW8g7YCC2cYIQ8CDTnMUSsPcxTPRpydrr+3R4q5pGTFAVnU3dcj96enO5Cu/XL8/HiSv1f97khTf6ioJh1NNNkwF7u2WoVqBKYYd/LVKytyyBMHt9txO6xdViA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mit.edu; dmarc=pass action=none header.from=mit.edu; dkim=pass header.d=mit.edu; arc=none Received: from DS7PR01MB7712.prod.exchangelabs.com (2603:10b6:8:7b::17) by BL0PR0102MB3410.prod.exchangelabs.com (2603:10b6:207:1d::25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5944.13; Fri, 30 Dec 2022 19:35:43 +0000 Received: from DS7PR01MB7712.prod.exchangelabs.com ([fe80::b8dd:4b3b:3d80:500b]) by DS7PR01MB7712.prod.exchangelabs.com ([fe80::b8dd:4b3b:3d80:500b%6]) with mapi id 15.20.5944.016; Fri, 30 Dec 2022 19:35:43 +0000 From: John F Carr To: Hikmat Jafarli CC: "freebsd-fs@freebsd.org" Subject: Re: Trying to implement BFS, page fault at vfs_domount_first, how to debug? Thread-Topic: Trying to implement BFS, page fault at vfs_domount_first, how to debug? Thread-Index: AQHZHIM2ei2NZ3IY1keIHpEfCzDQDa6G0rwA Date: Fri, 30 Dec 2022 19:35:43 +0000 Message-ID: <23A1E4DF-320A-4BCB-ADB8-83FEFC3D7649@mit.edu> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR01MB7712:EE_|BL0PR0102MB3410:EE_ x-ms-office365-filtering-correlation-id: ba2c90dc-5bec-4741-433e-08daea9d0a60 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 3qBX0PDtYKfcLfMKQLiyJGQlVpO3XgaVGgGAeNKIHrd53a5BIsq4jObLrOS9K44ShgICxf3awlIfQzFIDMFLoL01+V4H74Kbwi1fp/4vpqmF22dQzkMsFdq8qUEFt3TYvvJotZ/lT419wV+TUKahsVHWwiwMetkVlK5IwPRaAGEjdJNfYTW3HTitYRLKNZxHXM1YR/8/1nkaVCQervYuLkm5dkT3M+7Ec47QVOY4/toL0ucM7eRLIc07onziTMyaltPhG1AxNwNKJD82RWMvaYUhzbX2Nxs4W8S17gWiO4V/sGOQ3oPKRdaUN2FTyQAJ+HiQgwpV8IUWMxk2BY5gILBBsr/Tcq6K+ZiYNyBFQYbSbjePF0zXLhanhV2cYSFmBy7yz2PsPiKtpyi5lKEkURN2cprdgnT21chatNbBz6SHXw8oLSvUORNpzd4/ZclN8UEqbIXivyUhSFk8PelDJu3attMarHjmTmFsMyOjDE9gGfn6kprRbEz8dDau8itGROXVQPMk/fezrugOLJXVoZ+qV8KimKqOcOGi70K3xc3Fv2j+aDDPvkaYQDz4JVCmW7EtPRaw2ZD85/UVbDJbSUfokVy8VtGHhr8Xep/blbkGzoup2fqZfxMpR9eS6oStkY2agO/1HWTIVptDctSU8E+V0sR4s6RPfXPFaF2fULTKLYR9QabT05g1Mg/+Dbk5cIqy5fPKZrtwiFKSzJ3HDNGUd97izaKltPsB7x2mk8Q= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR01MB7712.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(13230022)(4636009)(366004)(396003)(136003)(376002)(346002)(39860400002)(451199015)(2906002)(5660300002)(38100700002)(122000001)(38070700005)(41300700001)(75432002)(83380400001)(6506007)(71200400001)(8936002)(36756003)(66946007)(66556008)(91956017)(64756008)(66446008)(66476007)(8676002)(76116006)(4326008)(316002)(786003)(86362001)(33656002)(6512007)(2616005)(6916009)(26005)(53546011)(186003)(6486002)(966005)(478600001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?q/LFghnCnlVPIKj7KovX+ArQFOFHgbmHN7/rgM2LBAhNbfsaHvwt+xU1DWYY?= =?us-ascii?Q?/6+Mvnxi/XJUiP9ehHkGj4CeRtJpT+lZcSyMIkDY1FYBgSu+ThWN7F8osUnw?= =?us-ascii?Q?e/ruNfWTgkK24yPOFpQSWsEeBRiBjowUDYHRNXUMeaeFW2GUA2/IW4pCF4YD?= =?us-ascii?Q?3CRxlvoUTPFWjrS8k5OyDQpQPC2J4b1+pCBC0FHii6VLzxMsmuC4tLXHfeXH?= =?us-ascii?Q?MBBt02MC2D1J2cykRoj8loXoXegxDim8FQI1OIHZn8j3+1WuVIgWT0yI6lGH?= =?us-ascii?Q?svMHtvN3T5QE9qwLQB45WyEy19/Xi07sWYwI3zY2pzYoLzSdoB6yVOamFeXU?= =?us-ascii?Q?TnlfrrBNeF5wPaeTZwd/moU5lGPVOv0mFMeHwRgrmiZZ+3ViHJHJgO8GWmZh?= =?us-ascii?Q?tL+KAryc24KfhUN6JaZv2Z677X1vvSpoiFJpXS2cvMDu2do5zibHw3kXQjCX?= =?us-ascii?Q?KTi+sW2+CZnSbdtH5KUR0tSlSrO4iZA/+ccAHFg8i0Nc+deKNUFGmMLYGOb5?= =?us-ascii?Q?5iXmD9Pkcsccevcd9LfpjDVPXkVhZgTgTip8E69tWMxoetT98mgj7HIeoAq+?= =?us-ascii?Q?u211QigGMtiPQOUkxaozCEhRMKaqw8VisYU9tDcHdp5xrq51Xwv6mZYi101Z?= =?us-ascii?Q?eq/5WzRL1zBAdZPILWdNMS2/CzkZ10UE2F9Hw60BYfhQCm3tRWLCGPa/ZzTA?= =?us-ascii?Q?a3wFNCTep5nv7G/G92wgCsfxc5k4Ka892m1dQHwxrTKLs0U77N9hdiVgCfNa?= =?us-ascii?Q?5ZtcH8iWLVVh0BozL1PBF2q93lZ18DxqiDHjAdZzGM/e7lvhYH8tjH/rCSeu?= =?us-ascii?Q?dnP2AyAlfjMKugAxOt22X7mRYQxGACb2zZTKHnLu0DfVpP0txBNOSzfdbFqJ?= =?us-ascii?Q?JC7QAqFbkfEo5WtW/cU4fRBYlYbW69WiJvXvCRor5O4n9AHVrh9Dew1ZfV4H?= =?us-ascii?Q?GMwK/oUxeOdd5omShNzUM3IFG3ywcb5OP+UiqKFmuPsOybbrdBdMh1G4raQG?= =?us-ascii?Q?2FCwjb3jDst3/bQTKhHHXXbZxkbptE8Aqgst16p3i7ZhqncOY6v/L5DFWYbx?= =?us-ascii?Q?nyITGJVYJicky2Gd4o6MLdc4ao+NrZCrlRlHtEASQBB8t43nunXJ+FtI0CnP?= =?us-ascii?Q?voUQiGBFRCU1aTXm8SUTj3quZVS9+TjyvTgruWkcU64Ogq6b9X4hD+gAzx9l?= =?us-ascii?Q?cI7VR2k7TjuMaeJQzQO4Z059Epi70g3aUtO59jJu5/Uxs+MNYZ9XebxkdiNx?= =?us-ascii?Q?fLlwPzzsbIO+qtUs1xXipsrhGdnyQSsyyrTHn8+jUGLuP1R9WVcFS1XFXJHF?= =?us-ascii?Q?T+rpkMyNZMRcvj9olKA3PZ0uZS697O0JIuE96VV6GjG3yRyxLfaIpIm3JRqB?= =?us-ascii?Q?AyZV4kgKsQGPtYkcYj2G7gHAVg5xLHqJ9xPjmhqoc8TLZmthJqgl0e+Ybo5k?= =?us-ascii?Q?qUTDLfbAxc5V8RMOdZWl++52SM+pqwau4l3sow34ie9T6KdSQlC1lo3eDzZV?= =?us-ascii?Q?EoOsznCwk9oHDoTuKkWHW9f95f0xaOuNusZxBbLVOrqlzt1ry+NWNGA+xA4G?= =?us-ascii?Q?WK0NITNR/47wxYyt6ic=3D?= Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR01MB7712.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: ba2c90dc-5bec-4741-433e-08daea9d0a60 X-MS-Exchange-CrossTenant-originalarrivaltime: 30 Dec 2022 19:35:43.0880 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 64afd9ba-0ecf-4acf-bc36-935f6235ba8b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: r2Ktdp3Sxi47VvxdJptJl2Ec+7Y3AHQTXycfs7gJDecqgUh+ruWwnxiJWId105VP X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0102MB3410 X-OriginatorOrg: mit.edu X-Rspamd-Queue-Id: 4NkFqB0Yl4z3PvJ X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On Dec 30, 2022, at 14:13, Hikmat Jafarli wrote: >=20 > I'm trying to implement the BeOS filesystem (BFS) for FreeBSD. > The repository is here: https://github.com/jafarlihi/freebsd-bfs > (Please don't mind bad styling and all the copy-paste work, > I'll polish it later, I'm just trying to get to some PoC where it works) >=20 > Now when I try to mount a valid BFS partition (reported as BFS by `fstyp`= ) > it executes all the way to printf that logs "Either not a BFS volume or > corrupted" and then crashes with "page fault while in kernel mode" in > vfs_domount_first+0x271. Here's the log: > ``` > Either not a BFS volume or corrupted >=20 > Fatal trap 12: page fault while in kernel mode > cpuid =3D 0; apic id =3D 00 > fault virtual address =3D 0x18 > fault code =3D supervisor read data, page not present > instruction pointer =3D 0x20:0xffffffff82b2427b > stack pointer =3D 0x28:0xfffffe00df399ac0 > frame pointer =3D 0x28:0xfffffe00df399ac0 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 1208 (mount) > trap number =3D 12 > panic: page fault > cpuid =3D 0 > time =3D 1672414952 > KDB: stack backtrace: > #0 0xffffffff80c694a5 at kdb_backtrace+0x65 > #1 0xffffffff80c1bb5f at vpanic+0x17f > #2 0xffffffff80c1b9d3 at panic+0x43 > #3 0xffffffff810afdf5 at trap_fatal+0x385 > #4 0xffffffff810afe4f at trap_pfault+0x4f > #5 0xffffffff810875b8 at calltrap+0x8 > #6 0xffffffff80cf0651 at vfs_domount_first+0x271 > #7 0xffffffff80cece9d at vfs_domount+0x2ad > #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8 > #9 0xffffffff80ceb9a9 at sys_nmount+0x69 > #10 0xffffffff810b06ec at amd64_syscall+0x10c > #11 0xffffffff81087ecb at fast_syscall_common+0xf8 > ``` >=20 > Now I'm trying to understand what exactly goes wrong here > and how to map 0x271 to the exact source line. >=20 > I'd appreciate it if someone could tell me how to debug this. >=20 > (Sorry for noob question, I already tried IRC and was directed here) Your BFS module tried to dereference a null pointer to structure. It's a null pointer dereference because of "fault virtual address =3D 0x18"= . That normally means you tried to access the fourth word of a structure b= ut the pointer to structure was null. It could be something else, but play= the odds. It's in your module because the instruction pointer address is far beyond t= he other kernel functions in the stack trace. Stack traces in crash report= s are misleading: they tend to omit the function that triggered the crash. = The address of vfs_domount_first is 0xffffffff80cf03e0 (0xffffffff80cf0651= - 0x271). That's the function that called your module. The address of th= e faulting instruction is 0xffffffff82b2427b. That's in your module. From nobody Fri Dec 30 19:47:54 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkG5Q0GdQz2lRbf for ; Fri, 30 Dec 2022 19:48:10 +0000 (UTC) (envelope-from rob.fx907@gmail.com) Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkG5P5K09z3R36 for ; Fri, 30 Dec 2022 19:48:09 +0000 (UTC) (envelope-from rob.fx907@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x534.google.com with SMTP id z11so15748775ede.1 for ; Fri, 30 Dec 2022 11:48:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=V0UcoQlzaWhXOzuJXgjcrBKDIe6KJMRokzKTqNKa4Ts=; b=m3A5jzOruRAUpxWrO7u09K5HOSWGqtb17ZBNqb4jHavBtIzvJcFBg5ev7SoaZ0Gq15 8KhBSTVqyp+eVLq35HPD4YrkSAO1rHZ3p0cc9Jl1SS1owQMJgsLa75+N5yJ8Mb97gho8 oOopvrBZnRwkmk8SBU7FMGgdmfd2qQPAO2zS5fVWHuRpBIjpgcFel82a3JKv76RWUE8k QrAESibChuJibFV3gP01Y3k2O8FMs815SgMzqMTy5KI6hc5e0jcdP90TEbbT+lzmxkN1 L+nPO0s8gkBl6aA43nd+pMxxJ+d7kah4oMgc5yhys++L6umNLwxDbEqDZUERe6LL2qBV 7mdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=V0UcoQlzaWhXOzuJXgjcrBKDIe6KJMRokzKTqNKa4Ts=; b=rWa2qrpc89AFDKYZrbPni5AnAvMU6w+eaTinl8ZgQ0igr0otev1kL9uin1p38aUK2y wH0ZkmlARkP5tSNfx/HjAUtyXOf0QBXX+oJg3pJVp/K98DUdHUNj+OgovOyvz6cnDd5r RCmnQrwDWJxlHzWgdyaA5D/Mv7rt8XFgrg48EmKjXOYtkXnb8yxuLjfHw6oXdWitUAZS ieC0P772ckNdYG65MI01nc7/KPwsDPser1FnTB9LXsUrK4M3JYgqvJP6TLXgyI0CvpZC BkMsMSKvLM2OdyzalS3QjGZ2pR3gte7hUabQhxTYBX/vai+TDenaRR7TkoH4M4/bB8Jx hGxw== X-Gm-Message-State: AFqh2kouhIwn9g7IVD48fC+NRunWKSFXYCttxq7jcBNTTE3swaQR2/hf /gyVDsb5m5T0zSOfPyFI3OI6h+uD+ZqgIttqGZ8= X-Google-Smtp-Source: AMrXdXshb0cIDZ4ubnn/0MWitR+TKWF2sd6jd2uvm+m8gdujzrG6K5dokmYobi7e6K0WkAwelgZP6+hHDPh8l3zVbns= X-Received: by 2002:a05:6402:2a04:b0:46c:6707:1036 with SMTP id ey4-20020a0564022a0400b0046c67071036mr3185945edb.308.1672429686257; Fri, 30 Dec 2022 11:48:06 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <23A1E4DF-320A-4BCB-ADB8-83FEFC3D7649@mit.edu> In-Reply-To: <23A1E4DF-320A-4BCB-ADB8-83FEFC3D7649@mit.edu> From: Rob Wing Date: Fri, 30 Dec 2022 10:47:54 -0900 Message-ID: Subject: Re: Trying to implement BFS, page fault at vfs_domount_first, how to debug? To: John F Carr Cc: Hikmat Jafarli , "freebsd-fs@freebsd.org" Content-Type: multipart/alternative; boundary="0000000000005c7ce405f110e1db" X-Rspamd-Queue-Id: 4NkG5P5K09z3R36 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000005c7ce405f110e1db Content-Type: text/plain; charset="UTF-8" you might try `addr2line -e $path_to_kernel 0xffffffff80cf0651` Aside from that, it looks like errors aren't being handled correctly after failing to find the BFS superblock in bfs_mountfs(). Since no error is returned after failing to find the superblock..I'm guessing that the NULL pointer `bfsmp` is being de-referenced in bfs_statfs(). On Fri, Dec 30, 2022 at 10:35 AM John F Carr wrote: > > > > On Dec 30, 2022, at 14:13, Hikmat Jafarli wrote: > > > > I'm trying to implement the BeOS filesystem (BFS) for FreeBSD. > > The repository is here: https://github.com/jafarlihi/freebsd-bfs > > (Please don't mind bad styling and all the copy-paste work, > > I'll polish it later, I'm just trying to get to some PoC where it works) > > > > Now when I try to mount a valid BFS partition (reported as BFS by > `fstyp`) > > it executes all the way to printf that logs "Either not a BFS volume or > > corrupted" and then crashes with "page fault while in kernel mode" in > > vfs_domount_first+0x271. Here's the log: > > ``` > > Either not a BFS volume or corrupted > > > > Fatal trap 12: page fault while in kernel mode > > cpuid = 0; apic id = 00 > > fault virtual address = 0x18 > > fault code = supervisor read data, page not present > > instruction pointer = 0x20:0xffffffff82b2427b > > stack pointer = 0x28:0xfffffe00df399ac0 > > frame pointer = 0x28:0xfffffe00df399ac0 > > code segment = base 0x0, limit 0xfffff, type 0x1b > > = DPL 0, pres 1, long 1, def32 0, gran 1 > > processor eflags = interrupt enabled, resume, IOPL = 0 > > current process = 1208 (mount) > > trap number = 12 > > panic: page fault > > cpuid = 0 > > time = 1672414952 > > KDB: stack backtrace: > > #0 0xffffffff80c694a5 at kdb_backtrace+0x65 > > #1 0xffffffff80c1bb5f at vpanic+0x17f > > #2 0xffffffff80c1b9d3 at panic+0x43 > > #3 0xffffffff810afdf5 at trap_fatal+0x385 > > #4 0xffffffff810afe4f at trap_pfault+0x4f > > #5 0xffffffff810875b8 at calltrap+0x8 > > #6 0xffffffff80cf0651 at vfs_domount_first+0x271 > > #7 0xffffffff80cece9d at vfs_domount+0x2ad > > #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8 > > #9 0xffffffff80ceb9a9 at sys_nmount+0x69 > > #10 0xffffffff810b06ec at amd64_syscall+0x10c > > #11 0xffffffff81087ecb at fast_syscall_common+0xf8 > > ``` > > > > Now I'm trying to understand what exactly goes wrong here > > and how to map 0x271 to the exact source line. > > > > I'd appreciate it if someone could tell me how to debug this. > > > > (Sorry for noob question, I already tried IRC and was directed here) > > Your BFS module tried to dereference a null pointer to structure. > > It's a null pointer dereference because of "fault virtual address = > 0x18". That normally means you tried to access the fourth word of a > structure but the pointer to structure was null. It could be something > else, but play the odds. > > It's in your module because the instruction pointer address is far beyond > the other kernel functions in the stack trace. Stack traces in crash > reports are misleading: they tend to omit the function that triggered the > crash. The address of vfs_domount_first is 0xffffffff80cf03e0 > (0xffffffff80cf0651 - 0x271). That's the function that called your > module. The address of the faulting instruction is 0xffffffff82b2427b. > That's in your module. > > > > --0000000000005c7ce405f110e1db Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
you might try `addr2line -e $path_to_kernel 0xfffffff= f80cf0651`

Aside from that, it looks like errors a= ren't being handled correctly after failing to find the BFS superblock = in bfs_mountfs(). Since no error is returned after failing to find the supe= rblock..I'm guessing that the NULL pointer `bfsmp` is being de-referenc= ed in bfs_statfs().

On Fri, Dec 30, 2022 at 10:35 AM John F Carr <<= a href=3D"mailto:jfc@mit.edu">jfc@mit.edu> wrote:


> On Dec 30, 2022, at 14:13, Hikmat Jafarli <jafarlihi@gmail.com> wrote:
>
> I'm trying to implement the BeOS filesystem (BFS) for FreeBSD.
> The repository is here: https://github.com/jafarlihi/fr= eebsd-bfs
> (Please don't mind bad styling and all the copy-paste work,
> I'll polish it later, I'm just trying to get to some PoC where= it works)
>
> Now when I try to mount a valid BFS partition (reported as BFS by `fst= yp`)
> it executes all the way to printf that logs "Either not a BFS vol= ume or
> corrupted" and then crashes with "page fault while in kernel= mode" in
> vfs_domount_first+0x271. Here's the log:
> ```
> Either not a BFS volume or corrupted
>
> Fatal trap 12: page fault while in kernel mode
> cpuid =3D 0; apic id =3D 00
> fault virtual address =3D 0x18
> fault code =3D supervisor read data, page not present
> instruction pointer =3D 0x20:0xffffffff82b2427b
> stack pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D 0x28:0xfffffe00df399ac0 > frame pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D 0x28:0xfffffe00df399ac0 > code segment =3D base 0x0, limit 0xfffff, type 0x1b
> =3D DPL 0, pres 1, long 1, def32 0, gran 1
> processor eflags =3D interrupt enabled, resume, IOPL =3D 0
> current process =3D 1208 (mount)
> trap number =3D 12
> panic: page fault
> cpuid =3D 0
> time =3D 1672414952
> KDB: stack backtrace:
> #0 0xffffffff80c694a5 at kdb_backtrace+0x65
> #1 0xffffffff80c1bb5f at vpanic+0x17f
> #2 0xffffffff80c1b9d3 at panic+0x43
> #3 0xffffffff810afdf5 at trap_fatal+0x385
> #4 0xffffffff810afe4f at trap_pfault+0x4f
> #5 0xffffffff810875b8 at calltrap+0x8
> #6 0xffffffff80cf0651 at vfs_domount_first+0x271
> #7 0xffffffff80cece9d at vfs_domount+0x2ad
> #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8
> #9 0xffffffff80ceb9a9 at sys_nmount+0x69
> #10 0xffffffff810b06ec at amd64_syscall+0x10c
> #11 0xffffffff81087ecb at fast_syscall_common+0xf8
> ```
>
> Now I'm trying to understand what exactly goes wrong here
> and how to map 0x271 to the exact source line.
>
> I'd appreciate it if someone could tell me how to debug this.
>
> (Sorry for noob question, I already tried IRC and was directed here)
Your BFS module tried to dereference a null pointer to structure.

It's a null pointer dereference because of "fault virtual address = =3D 0x18".=C2=A0 That normally means you tried to access the fourth wo= rd of a structure but the pointer to structure was null.=C2=A0 It could be = something else, but play the odds.

It's in your module because the instruction pointer address is far beyo= nd the other kernel functions in the stack trace.=C2=A0 Stack traces in cra= sh reports are misleading: they tend to omit the function that triggered th= e crash.=C2=A0 The address of vfs_domount_first is 0xffffffff80cf03e0 (0xff= ffffff80cf0651 - 0x271).=C2=A0 That's the function that called your mod= ule.=C2=A0 The address of the faulting instruction is 0xffffffff82b2427b.= =C2=A0 That's in your module.



--0000000000005c7ce405f110e1db-- From nobody Fri Dec 30 22:06:38 2022 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkK9Q3V38z2nV43 for ; Fri, 30 Dec 2022 22:06:50 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkK9P0ssWz3qQm for ; Fri, 30 Dec 2022 22:06:49 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=kZOHwann; spf=pass (mx1.freebsd.org: domain of rick.macklem@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=rick.macklem@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pg1-x530.google.com with SMTP id w37so14918680pga.5 for ; Fri, 30 Dec 2022 14:06:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=WfyQj0d2/UKUWgwGKb/WRUBrZfGUg0GUNlYPyR3do6g=; b=kZOHwannOlB17w3a+cXJ301jfTDycAM+EfE5TfRnkXt31CRn5EwUR+z/1k/ooZT5dG DEHaM5YmAGszEmJPiwS6v34eueLEbUJcCCvmbfRf6HLO549sQ3zNNZ1/nkOXglMXVK2X OLyk/1jcH8b2WSMajyXivIg0/HD1PvNizBu+rXFMfJAZPdsyENO55dwp5pSqhP/v55y3 +S6Oapl43DLjxCqDYzXVeTEWNf1m8RpIQTQOP/v4sF0l1BkGJfVyxrCp/s9/aSRsgUji dejFlU5d+6lNJMAu6/HcRUwiEGhSJutbnzGn31sTjqzJDkljFAhn/RJyjSW0BXYxM+QS yyfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=WfyQj0d2/UKUWgwGKb/WRUBrZfGUg0GUNlYPyR3do6g=; b=YD54E6jQxHL12caYWl01nYHdRpHGFLsL1TaqgF/SoV7bXLRRfysSDVZASFcvEoyK3t 5Gc9Xji2cmbe93whAtzCrtA1H8cDgvnhrjN6N8E9UHDtlTie61Ev/zii39BIo5HPgJ9B gYtB/TNGWTUdrRwIGUQwmUQ/h1RLT8l4/cbXK/cmO/h3QgsGBPhXTOZEyWH2W+jbLASK q9E8es5Ckutv7hM05kohlqkP6N7MwiNDaHKv8ezbcmJHm7w5TckT43W4aVjg/Z7Q8z0h /oC0pNlAHMDUQG2+yVtLhbihReD5hAq/xmmhJ95BnN604nqIgffGTSfLe7h5Y2AOsFIk 0MBA== X-Gm-Message-State: AFqh2kre6Tut4Dj5gX8VfVED8fFFvVbukIC1e08/k532TkYigr/jXEfG QahofuS8KOcVdE7e6c3HMwpUVQ6gZxnNDF3jQw== X-Google-Smtp-Source: AMrXdXt5ZJR7hl+YTO5MRlukp3JB4ogIl7iPByzqo4u2f+YGaEkU3lwW5wW4ryp43xzfrCZ9k/2YNpF01ZMuVF0Tmrg= X-Received: by 2002:a05:6a00:4108:b0:581:e84d:c2b6 with SMTP id bu8-20020a056a00410800b00581e84dc2b6mr337854pfb.39.1672438007546; Fri, 30 Dec 2022 14:06:47 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <23A1E4DF-320A-4BCB-ADB8-83FEFC3D7649@mit.edu> In-Reply-To: From: Rick Macklem Date: Fri, 30 Dec 2022 14:06:38 -0800 Message-ID: Subject: Re: Trying to implement BFS, page fault at vfs_domount_first, how to debug? To: Rob Wing Cc: John F Carr , Hikmat Jafarli , "freebsd-fs@freebsd.org" Content-Type: multipart/alternative; boundary="00000000000059449005f112d1f8" X-Spamd-Result: default: False [-1.50 / 15.00]; SUSPICIOUS_RECIPS(1.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; RCVD_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::530:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_CC(0.00)[mit.edu,gmail.com,freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TAGGED_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_DN_EQ_ADDR_SOME(0.00)[] X-Rspamd-Queue-Id: 4NkK9P0ssWz3qQm X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N --00000000000059449005f112d1f8 Content-Type: text/plain; charset="UTF-8" On Fri, Dec 30, 2022 at 11:48 AM Rob Wing wrote: > you might try `addr2line -e $path_to_kernel 0xffffffff80cf0651` > Just a note. I find I need the kernel called "kernel.debug" for addr2line to work. It normally lives in the kernel build directory under /usr/obj. rick > > Aside from that, it looks like errors aren't being handled correctly after > failing to find the BFS superblock in bfs_mountfs(). Since no error is > returned after failing to find the superblock..I'm guessing that the NULL > pointer `bfsmp` is being de-referenced in bfs_statfs(). > > On Fri, Dec 30, 2022 at 10:35 AM John F Carr wrote: > >> >> >> > On Dec 30, 2022, at 14:13, Hikmat Jafarli wrote: >> > >> > I'm trying to implement the BeOS filesystem (BFS) for FreeBSD. >> > The repository is here: https://github.com/jafarlihi/freebsd-bfs >> > (Please don't mind bad styling and all the copy-paste work, >> > I'll polish it later, I'm just trying to get to some PoC where it works) >> > >> > Now when I try to mount a valid BFS partition (reported as BFS by >> `fstyp`) >> > it executes all the way to printf that logs "Either not a BFS volume or >> > corrupted" and then crashes with "page fault while in kernel mode" in >> > vfs_domount_first+0x271. Here's the log: >> > ``` >> > Either not a BFS volume or corrupted >> > >> > Fatal trap 12: page fault while in kernel mode >> > cpuid = 0; apic id = 00 >> > fault virtual address = 0x18 >> > fault code = supervisor read data, page not present >> > instruction pointer = 0x20:0xffffffff82b2427b >> > stack pointer = 0x28:0xfffffe00df399ac0 >> > frame pointer = 0x28:0xfffffe00df399ac0 >> > code segment = base 0x0, limit 0xfffff, type 0x1b >> > = DPL 0, pres 1, long 1, def32 0, gran 1 >> > processor eflags = interrupt enabled, resume, IOPL = 0 >> > current process = 1208 (mount) >> > trap number = 12 >> > panic: page fault >> > cpuid = 0 >> > time = 1672414952 >> > KDB: stack backtrace: >> > #0 0xffffffff80c694a5 at kdb_backtrace+0x65 >> > #1 0xffffffff80c1bb5f at vpanic+0x17f >> > #2 0xffffffff80c1b9d3 at panic+0x43 >> > #3 0xffffffff810afdf5 at trap_fatal+0x385 >> > #4 0xffffffff810afe4f at trap_pfault+0x4f >> > #5 0xffffffff810875b8 at calltrap+0x8 >> > #6 0xffffffff80cf0651 at vfs_domount_first+0x271 >> > #7 0xffffffff80cece9d at vfs_domount+0x2ad >> > #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8 >> > #9 0xffffffff80ceb9a9 at sys_nmount+0x69 >> > #10 0xffffffff810b06ec at amd64_syscall+0x10c >> > #11 0xffffffff81087ecb at fast_syscall_common+0xf8 >> > ``` >> > >> > Now I'm trying to understand what exactly goes wrong here >> > and how to map 0x271 to the exact source line. >> > >> > I'd appreciate it if someone could tell me how to debug this. >> > >> > (Sorry for noob question, I already tried IRC and was directed here) >> >> Your BFS module tried to dereference a null pointer to structure. >> >> It's a null pointer dereference because of "fault virtual address = >> 0x18". That normally means you tried to access the fourth word of a >> structure but the pointer to structure was null. It could be something >> else, but play the odds. >> >> It's in your module because the instruction pointer address is far beyond >> the other kernel functions in the stack trace. Stack traces in crash >> reports are misleading: they tend to omit the function that triggered the >> crash. The address of vfs_domount_first is 0xffffffff80cf03e0 >> (0xffffffff80cf0651 - 0x271). That's the function that called your >> module. The address of the faulting instruction is 0xffffffff82b2427b. >> That's in your module. >> >> >> >> --00000000000059449005f112d1f8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Fri, Dec 30, 2022 at 11:48 AM Rob Wing <= ;rob.fx907@gmail.com> wrote:<= br>
you might try `addr2line -e $path_to_kernel 0xffffffff80cf0651`
=
Just a note. I find I need the kernel called "kernel.debug&= quot; for
addr2line to work. It normally lives in the kernel build dire= ctory
under /usr/obj.

rick
=C2=A0

<= div>Aside from that, it looks like errors aren't being handled correctl= y after failing to find the BFS superblock in bfs_mountfs(). Since no error= is returned after failing to find the superblock..I'm guessing that th= e NULL pointer `bfsmp` is being de-referenced in bfs_statfs().
<= br>
On Fri,= Dec 30, 2022 at 10:35 AM John F Carr <jfc@mit.edu> wrote:


> On Dec 30, 2022, at 14:13, Hikmat Jafarli <jafarlihi@gmail.com> wrote:
>
> I'm trying to implement the BeOS filesystem (BFS) for FreeBSD.
> The repository is here: https://github.com/jafarlihi/fr= eebsd-bfs
> (Please don't mind bad styling and all the copy-paste work,
> I'll polish it later, I'm just trying to get to some PoC where= it works)
>
> Now when I try to mount a valid BFS partition (reported as BFS by `fst= yp`)
> it executes all the way to printf that logs "Either not a BFS vol= ume or
> corrupted" and then crashes with "page fault while in kernel= mode" in
> vfs_domount_first+0x271. Here's the log:
> ```
> Either not a BFS volume or corrupted
>
> Fatal trap 12: page fault while in kernel mode
> cpuid =3D 0; apic id =3D 00
> fault virtual address =3D 0x18
> fault code =3D supervisor read data, page not present
> instruction pointer =3D 0x20:0xffffffff82b2427b
> stack pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D 0x28:0xfffffe00df399ac0 > frame pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D 0x28:0xfffffe00df399ac0 > code segment =3D base 0x0, limit 0xfffff, type 0x1b
> =3D DPL 0, pres 1, long 1, def32 0, gran 1
> processor eflags =3D interrupt enabled, resume, IOPL =3D 0
> current process =3D 1208 (mount)
> trap number =3D 12
> panic: page fault
> cpuid =3D 0
> time =3D 1672414952
> KDB: stack backtrace:
> #0 0xffffffff80c694a5 at kdb_backtrace+0x65
> #1 0xffffffff80c1bb5f at vpanic+0x17f
> #2 0xffffffff80c1b9d3 at panic+0x43
> #3 0xffffffff810afdf5 at trap_fatal+0x385
> #4 0xffffffff810afe4f at trap_pfault+0x4f
> #5 0xffffffff810875b8 at calltrap+0x8
> #6 0xffffffff80cf0651 at vfs_domount_first+0x271
> #7 0xffffffff80cece9d at vfs_domount+0x2ad
> #8 0xffffffff80cec2d8 at vfs_donmount+0x8f8
> #9 0xffffffff80ceb9a9 at sys_nmount+0x69
> #10 0xffffffff810b06ec at amd64_syscall+0x10c
> #11 0xffffffff81087ecb at fast_syscall_common+0xf8
> ```
>
> Now I'm trying to understand what exactly goes wrong here
> and how to map 0x271 to the exact source line.
>
> I'd appreciate it if someone could tell me how to debug this.
>
> (Sorry for noob question, I already tried IRC and was directed here)
Your BFS module tried to dereference a null pointer to structure.

It's a null pointer dereference because of "fault virtual address = =3D 0x18".=C2=A0 That normally means you tried to access the fourth wo= rd of a structure but the pointer to structure was null.=C2=A0 It could be = something else, but play the odds.

It's in your module because the instruction pointer address is far beyo= nd the other kernel functions in the stack trace.=C2=A0 Stack traces in cra= sh reports are misleading: they tend to omit the function that triggered th= e crash.=C2=A0 The address of vfs_domount_first is 0xffffffff80cf03e0 (0xff= ffffff80cf0651 - 0x271).=C2=A0 That's the function that called your mod= ule.=C2=A0 The address of the faulting instruction is 0xffffffff82b2427b.= =C2=A0 That's in your module.



--00000000000059449005f112d1f8-- From nobody Sat Dec 31 10:07:50 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nkd9N09bVz2lH1d for ; Sat, 31 Dec 2022 10:07:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nkd9M4Kj8z3wfJ for ; Sat, 31 Dec 2022 10:07:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672481271; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CzFvnBzWQacE4JmqKAUF0QhMonrWutlAOQFkhhZ7OUw=; b=lYNDE9d23T3PRSaHEThSgdDsByfQOcfHh3Rs6Yryy4Ndni8eNMjW1lt/XPGeYLiCMZeBLf 5gHJNXS0AQdORlQR+IsiGEKJ5xCu8z9rM5+P9WXw5fC7HmnLHGXdAHGRJ1ahtI9YtAR2bm VU4E59FfbqC/++cU4w9XHdTHAHwzcu4QZg3OPyk1jFYZ8ouc7jDsLrV9lNNfVxGBEUKqUq qMY4iztF0aZO1Xek3W0SD2D08c0voQBN5trhwAzWI6SzYZNawF8Gfk7BpFmE0kOvVaDMBl tGROZ/d9XK+dq81+XXKFXtw5QBREp1NveokSa26VCtW07CznpvLODMRdZtimhw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672481271; a=rsa-sha256; cv=none; b=UiNDo0DkEts+oJjT54ZFsjlmtNmoJXmPRqbjZR7YCMk+73dgH6KLvsctlhXVWIHjHC2ZNL a7l0ci0cuXnK7fm91Nnr3oJFyRvy5DuZfxNpl9c9f8xMUFEo0y5atGvy1jzcL+xRLrHqq/ xhepu9+icuCNfC1ZoZZZ5ivw0XyuEADtXtJoB+NIVu5d2l6w0DCbymUzRhvnGEOuyasRrv HaCAwpBrVm6fo6WVMq/HHhLF+7EayR6S49pqHKivS1lirYsae5qt5zq9ZE07i8D655GGwF j/LkUlg5uJQZ+ZJfXEol7XlIf8NP0mfQfWtupGqjM7bWcXtdxIU8+EqxOiQoug== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nkd9M3NZBzl4F for ; Sat, 31 Dec 2022 10:07:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BVA7pIA059232 for ; Sat, 31 Dec 2022 10:07:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BVA7pBA059231 for fs@FreeBSD.org; Sat, 31 Dec 2022 10:07:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 163461] vfs.zfs.arc_max and vfs.zfs.arc_meta_limit defaults: review Date: Sat, 31 Dec 2022 10:07:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa, performance X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords short_desc assigned_to bug_severity Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D163461 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-qa, performance Summary|[vfs] |vfs.zfs.arc_max and |vfs.zfs.arc_max/vfs.zfs.arc |vfs.zfs.arc_meta_limit |_meta_limit defaults aren't |defaults: review |wise | Assignee|bugs@FreeBSD.org |fs@FreeBSD.org Severity|Affects Only Me |Affects Some People --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 31 20:46:12 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkvKx6HlBz2lM0y for ; Sat, 31 Dec 2022 20:46:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkvKx4MqPz3rwT for ; Sat, 31 Dec 2022 20:46:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672519573; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fbibyr9sSAG9T2UfXyCwgg3QFX0I/x84HymzdLsAq4w=; b=bmwFAHJpl9KifFqE6E4pwc/r2xgZGIJnigeBW3xB4OKAaqhJcfQegutRBwuzbuhvSHQrNs s+tYt+JwxrM8Lfq0xfdfWO9Cnbdo+O7cRllJYcm3SuvXJahKpo7tLWlndHVR1jF8UfkjvI NnsW1PLBIEpjdGo2mx3OtnuexxJDK3lylkgZMZdhwrkIiQauUCks7x3lU3BbFT3okx5BJl 5GhIcKBXan/R1LF6Wabjw0S7VpTn3VkYSnh5qKIs0/OUaaNVJL7ujwasgP7bATFf1vnrX8 k9JprN6zpNtVFFOjstS8fXE1TS/YYnoBWqZo6RrEWKABMX0RwOElgzoeOwsCjg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672519573; a=rsa-sha256; cv=none; b=krnHd+0pQDc+akWq1uyPFO+JxulH5kVxUkkQ7m9NZvZbHiybF52Wfo16CrvK+X+nxWmu2q wr8WzmoZnSU7I/HuRkcrsC9J+/gLxV9n4qvz//eq+XQKwL+56KLrgefUx7r0fvC8Bn9PDO j3ieRohvaJYCBZlFyGGQP2SD1pMdCw5yLRRw8zXLekOYWg0nQ1BzpVcQWuYvLIlLlzVngN tYfuOv9l8Ayr+2eXztsxX5t0IdfvDzckGiCLbYsf5v3ZjlK1VzXWz4WkJbZmyxUR/7p4jb qqRmTJP2wpQCkg3ytMNIZ92qpsrMa7XwY3Rv3+k2lBCzfOpPBKCgzXe+Dsdq6A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NkvKx3DbPz12cq for ; Sat, 31 Dec 2022 20:46:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BVKkD39032577 for ; Sat, 31 Dec 2022 20:46:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BVKkDUW032576 for fs@FreeBSD.org; Sat, 31 Dec 2022 20:46:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250323] OpenZFS L2ARC size shrinking over time Date: Sat, 31 Dec 2022 20:46:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_severity bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250323 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grahamperrin@freebsd.org Severity|Affects Many People |Affects Some People Status|New |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 31 21:14:09 2022 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NkvyB4g1sz2lQhq for ; Sat, 31 Dec 2022 21:14:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NkvyB3ZJ2z3tcg for ; Sat, 31 Dec 2022 21:14:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672521250; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MXjyuMBbcMClqlioIo7mpSAShJKvIj0DPyhmJrdEhWU=; b=TLElD/xq2QJcorZ7ZQHjg24n3IS90pVh4PBBorlQcruGMVNIwMQPiWcWq9F/Urpc2a4MN8 YD40KRIl6KMNr8N/X2EJ37E5m9X+nDQDrqgQQgIrxNC3VaPEHOpu8QGsMeMSYMHPo6IxmH +aDwPcS4a0X78hPuvO1OFiv6OhuOJUFOtTZki57VQ0+oowGsRRsABgzep/YPDJh0t9iwTh qJsR7L5lWSPhUrbKTOq3SMBQmbGXvdKhOqRCfgrWJnRWBYF9Zz3q+Q9f4psrUE3b7OgjdR BmY4ub2zrvofrHqScXuAbEAL5GP39wdefIRoOcQPCW7sDFQgk6D6goymJCHDQQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672521250; a=rsa-sha256; cv=none; b=R7rNZBL9dvIzHPrRxo2YrJGPB3yp4DdS4eOR3yEfTUbD4YyW5KKxrqec/TLqWf+bQ/Nvky y6taNNu3awC4D1J8RCf/9EdlMpFpnBpHQmlb91PlpOFDLhbgEBafB/efqAOJwUlmRQcIkS A/IgDMr2uUffneiqwdez162pUF2m8gqqLpQ2oxoxiV20AEKHrxnlOQ5Akkha35OV/1o02E 7HfZkoOSAgoVIPnI61cWlO2HfmCaXXszlhNRVZem3vyX43YQVUYq8HpjUstD/Uvma54iXz xRPaagT2xHEtpRSJJ/otcPlWF9VO+FBuxIl8T9iRD/raS5khlFvy+sfgsBkgng== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NkvyB1pHdz12rF for ; Sat, 31 Dec 2022 21:14:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 2BVLEAJK075418 for ; Sat, 31 Dec 2022 21:14:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 2BVLEAf7075417 for fs@FreeBSD.org; Sat, 31 Dec 2022 21:14:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 250323] OpenZFS L2ARC size shrinking over time Date: Sat, 31 Dec 2022 21:14:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250323 --- Comment #5 from Graham Perrin --- Created attachment 239168 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D239168&action= =3Dedit Screenshot: Netdata, one month, HP EliteBook 8570p with L2ARC across two low-end USB thumb drives (In reply to Stefan E=C3=9Fer from comment #0) > =E2=80=A6 there might be a wrap-around after several weeks of up-time, = =E2=80=A6 I never looked (with my local-only installation of Netdata ) at a period longer than one month. 14.0-CURRENT here.=20 For what it's worth: over the past year or so I have looked often enough, at periods involving a few days of uptime, to _not_ suspect a bug affecting longer-term uptimes.=20 Still, maybe worth investigating.=20 Do check upstream, . --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Jan 1 21:00:01 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NlWbQ2LWxz2nrqg for ; Sun, 1 Jan 2023 21:00:02 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NlWbQ03Z5z3xsv for ; Sun, 1 Jan 2023 21:00:02 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672606802; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=JxQ41ZALVgP+eM0hZXrtA4urdTswBA/+lwwj0/5OeeM=; b=akK1Nwxop1aQVd5ZXcmZRUYkLXIG+0Gd7Dr6uwFhQuZuU0K8enaazPk5+UTpy81itrR9J9 +FNW4M5C2Jz5aVGuwr3QtEcu/KYqJweIdXd8iQNjMU+YgGCm8byatAqjg3MmdogbvokHR9 W4nz+qnzKMggFclsHE9OAvr3FgqOd1q0kjkooRPCkkCkhFgR94/Rj7+JckD2riq313C4s8 MpavaUB6LPDzrfbaNVyOnO8U+v681ZBfy3h+wAxr46AkdTq7iqaPsFHmM13DzHxz+o9MdD o51IY47anJuPmtrBOFLaI1D6Zv8Y/pXCh06gvAarS8wggHWD0QBo5w72utzhfA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672606802; a=rsa-sha256; cv=none; b=U+IPIlz76yNdPbEa+14CM7FPxyitn8OPlV4pZ/7v/HmkMlRuB7P05g+ipWYvRxSQcCSjhE 1ihQqRcNdcmnSzs2tsVCCr4G8OiQ1pLj9WceWFEm+wPVywooG0Ats+pkW0PVr6x91PUzwh XCCz3mYynP7LklySwcA7BwTTvm0ft4EFfGec7H6/6LhtPIU7b8P82PgKQkSPHwzbW47O6r aw1KRdAgBIAFUgRTIoz65zpkEtRRZTbm9mWtLc6SOC8ZkKrFoMY0H1rvM88lyC47HXLKMZ fGSv9nc1tmrpSUnm3oW1OSrG4Aw7Rb9tvNAIirE2+gmggSS/9DYJuQw6pJx9Ng== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NlWbP69KvzgrR for ; Sun, 1 Jan 2023 21:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 301L01IV071401 for ; Sun, 1 Jan 2023 21:00:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 301L01Ll071396 for fs@FreeBSD.org; Sun, 1 Jan 2023 21:00:01 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202301012100.301L01Ll071396@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 1 Jan 2023 21:00:01 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16726068015.a1A6Ed14.70717" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16726068015.a1A6Ed14.70717 Date: Sun, 1 Jan 2023 21:00:01 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16726068015.a1A6Ed14.70717 Date: Sun, 1 Jan 2023 21:00:01 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16726068015.a1A6Ed14.70717-- From nobody Sun Jan 1 21:32:47 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NlXKD25Ycz2nx7n for ; Sun, 1 Jan 2023 21:32:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NlXKD15KVz45Dc for ; Sun, 1 Jan 2023 21:32:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672608768; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kgDRhNC8HjaimqIpRel0YL1om8jmbADX11IaN2JR89Q=; b=DjHOr6YOVUD01OON8Ikti5x1CO9caQfwjNb7Xz1UiSBm2f38mxgkoj+t8byvo24aVbnzY3 IIndyGM3ShxgAHcX1dWtXUC8cbXKlYWsaSo+O1HmufBUQU3lR8O5DVf7gu6VxDP6sANWpt JgfQ1oDRsRSbUz7Ff5bq5qIbhp84b4Tyl7g9tDD2RBXMQEfdelbZKoOeitq5a+Lwl8rkN/ b8v2kXkeRSv3gsz14pNszXYT81ls+2l2LEuXjgCL2YhMjFsEtZ8HLWMvIsadwpoVeGD7lk ccR1a55ZTy7A7NYnAlKzRo19+AtxC1Nj+TPADZIkP0FtHPXk6e5caYX0uRtnAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672608768; a=rsa-sha256; cv=none; b=xZ4oM10E1x+x0VEQ4IMSAHcq4EVat4eF7lCqEai1V8fcwyGXg0Sp5xhnR/EC89WGh6tyxk XX0Qz5Ii9fkrxKQhZfQIwXRK06a4VguTy7h8oyox63ZU67vEsJ0PpX8jxV5tUhkCf1N4sz pawM/NGEttJYpfNNxmx80kO7BF658szF2LOXLj/naO3fcbuhZofExmTn4HC6Gbs2GY4Sl0 Fp2TJqv7+N4EmKm34XY25ze1dz9xlMtJPrrwvsXVhuqFPjXz+tX+TMChfZxAF9YeG0Urb/ VXeDAKdqI/nGvwRtghgqVBfXPyGEhzhXOv432ZfOWGc8IaEZlmQeKxgAC8Apfw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NlXKD0Btdzjkj for ; Sun, 1 Jan 2023 21:32:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 301LWlD9025922 for ; Sun, 1 Jan 2023 21:32:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 301LWlvG025921 for fs@FreeBSD.org; Sun, 1 Jan 2023 21:32:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 264139] ata: NCQ_DSM_TRIM trim method for Seagate IronWolf 110 SATA SSD hangs drives Date: Sun, 01 Jan 2023 21:32:47 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? mfc-stable13? mfc-stable12? X-Bugzilla-Changed-Fields: flagtypes.name Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264139 Warner Losh changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|maintainer-feedback?(bsdimp |maintainer-feedback?(imp@Fr |@FreeBSD.org) |eeBSD.org) --- Comment #7 from Warner Losh --- Sorry for the delay. I'll try to get this committed before 13.next. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Mon Jan 2 03:53:29 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NlhmW3jLFz2njDv for ; Mon, 2 Jan 2023 03:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NlhmW2htPz4d88 for ; Mon, 2 Jan 2023 03:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672631611; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SY7CPpUw2rqb0y6QrSqZ6MU/Fg6lXlEgPQcSVvN326E=; b=TI0jmNZBunFtKOgguq4Eu2PmefowH1zXgOshtvLd9mCNQaJvW5D3cBN/sYrlPErhOUKXWc TY7EL1DOHiAz7nm4ayU+8KalnbZdIESbFEBxQJUqV16vPCIprQhxzGtWRRoWUsB1cGNAL2 5hhjTwGB2uwWFf4Ql1bwJBXDaGXzQBEETxtD7jZ9g0Z8xUP0ftEIjJxbYWkiPhVI9s2TZv 63orYAUGB/sDTF4lrLTuJ4iOFl4lg8ScnumzMHWR8y/fjo+B3iWctqDARwfoM3zTCFzxCq HEDxyDY3Ab4cQD9szlEQjKIuv/Q4xt5g81IYRcmTXjPoTdz/mlvQ+EnYsoq+kg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672631611; a=rsa-sha256; cv=none; b=qrUzHzvcNWXjhjEnqpj8B5kAQ+7xMfsG3vph8TML1/cvv7GFe0f7CpMVkLIOJ4gnlIKirY 0eozOn5L4RxvlQYt96ZPkIX5IJaI2LNZyILhsn+hSoBIEG7udftpB0PAmMAcS6Oi3MZbqq coCH7s+pInEgcP+TK3+At2cWCna0NpNWwZiYeav2PPr2ARxTZjreb/0/T4GR8kYbM/pH8y u1JU1hl3h+oTJpNumD+B9luEww13zIByg2Tsqf/cGczya25R6zZW2OzzLErdHsfSh/twZA lycs0lsQK/Tq7tCbSSbC1Uo9H/3nveiYEcEBIh0Sb4dJSat8Sya1apKlp+RrsQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NlhmW1p0Yzt9C for ; Mon, 2 Jan 2023 03:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3023rVNB085707 for ; Mon, 2 Jan 2023 03:53:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3023rV8f085706 for fs@FreeBSD.org; Mon, 2 Jan 2023 03:53:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Mon, 02 Jan 2023 03:53:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: virushuo@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 virushuo@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |virushuo@gmail.com --- Comment #17 from virushuo@gmail.com --- I can confirm vfs.root_mount_always_wait=3D1 works for me. Moved my disk array to a new server with 13.1-RELEASE without zfs on root, = then the zpool auto import was not working, but the old server with zroot had no problem. Check dmesg output and found zpool trying to import pools before = the disk array is ready, the add vfs.root_mount_always_wait=3D1 can fix the iss= ue. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Jan 3 05:14:02 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NmLVz2CjHz2lPC3 for ; Tue, 3 Jan 2023 05:14:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NmLVz0fvBz3nvg for ; Tue, 3 Jan 2023 05:14:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1672722843; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GCbS/VmDcvJf/y+xnjuTiEOGpH9n1A3GJ8I8oHJ4bLg=; b=OFof+1LY7sHdfZsSsK0/9hc2H5pJ9ZiwSA40buRymYHEjEQZya3QXPR2YNwwHj2dpVj3m3 9Tu/fjrREgtFtHEUVM5sPS2kNvNhD7PZU0cPLpVqQinU2ZRIIR99TlDypGSlJxMqArHNPv Zivd6Ey3r0EJrHHac3ZXUM6xH4A7NPgR7mVwv8wtyEwFDmh+f8lI67DRbn841P3mofUneH QhZ0MoXLHEXN6IrDQc4q2MCuDD4OpABbii5O9p/sqUacT6ezqBziZsmbA7KCQ8IPm/9fRK E0ov+XMWAuxJXBmTDYjl2kbegJw8OUo3B+6Rm5eocrBXtanX3i4NxbSKtFROnQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1672722843; a=rsa-sha256; cv=none; b=WWOuRy47TZUis49Oj6WpFmaNob8F70g1H6sWxU8Xmnr72+/5Ho3ZLiAMS6uPbK5/xDb2h7 jaGJQ9Hd+95041BnWuxjcPfhedpxQTjq3311lvcOQ8NelbYgM/1XYBSzZflQMboK2+oYoK FRjCX3hsWHhCccVRkfr6f3FaZmHtv9pJMrIr0VQZRQPbmnm3y+/dck7O8rkXxKCQrjB5Gc Q3vqNXpZTJ1gqxNji8QS1WoReOlFZXCOcBCKW1hbOC7kLKHcdoz+ZWoyJmxmXXwWezua34 ZIKWJoo9vWjCK+XyTnvt9D/u+OTCZeMHwZcNm6VVVKJKv3M5lDgYZcKi2GxV8A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NmLVy6s4jzKL5 for ; Tue, 3 Jan 2023 05:14:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3035E2Qg014282 for ; Tue, 3 Jan 2023 05:14:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3035E2ua014281 for fs@FreeBSD.org; Tue, 3 Jan 2023 05:14:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 263473] ZFS drives fail to mount datasets when rebooting - 13.1-RC4 Date: Tue, 03 Jan 2023 05:14:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263473 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |delphij@FreeBSD.org --- Comment #18 from Xin LI --- (In reply to virushuo from comment #17) Some additional details (I've talked with the reporter over Telegram): Both old and new systems have on board RAID controller; the old system was flashed to IT mode, the new system was Dell H730, and the owner chooses to = not flash it to avoid bricking it. On the old system, / was ZFS (using two disks in a mirrored zpool); the new system was using a mirrored UFS for /. The disk array showed up as NETAPP DS424IOM6; it was connected to the same = HBA moved from the old system to the new system. We observed that the ses(4) device for the NetApp disk array appeared pretty *late* at boot time, which was after /etc/rc.d/fsck and the disks only show= ed up after that. In the current RC order, /etc/rc.d/zfs runs much earlier, s= o it died with: cannot import '': no such pool or dataset Destroy and re-create the pool from a backup source. cannot import '': no such pool or dataset Destroy and re-create the pool from a backup source. cachefile import failed, retrying nvpair_value_nvlist(nvp, &rv) =3D=3D 0 (0x16 =3D=3D 0) ASSERT at /usr/src/sys/contrib/openzfs/module/nvpair/fnvpair.c:586:fnvpair_value_nvli= st() pid 48 (zpool), jid 0, uid 0: exited on signal 6 Abort trap --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 6 19:08:20 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpXtP1lxbz2pDVv for ; Fri, 6 Jan 2023 19:08:29 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpXtN3N9fz3Pl3 for ; Fri, 6 Jan 2023 19:08:28 +0000 (UTC) (envelope-from bsdlists@jld3.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=PcQ6S59d; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net; dmarc=pass (policy=quarantine) header.from=jld3.net Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 4248B41654 for ; Fri, 6 Jan 2023 12:08:22 -0700 (MST) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id p7xzjg94tbbq for ; Fri, 6 Jan 2023 12:08:21 -0700 (MST) Received: from [172.21.35.229] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 646A140615 for ; Fri, 6 Jan 2023 12:08:21 -0700 (MST) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 646A140615 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 646A140615 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1673032101; bh=OjUXQj43iAgf3QXb9TLQmVAP5kZPD4FkZbdN47L3kI8=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=PcQ6S59dRWp58v/EIVP3ndUjj+hpZJwLCElh5nhDZgKFtxLCFhd3EMD6/MBgU4Rvj YbotTmcK65q2PJY5ttc5vZp4jsK9THxtxQxqPhWCjq4Njgj/3pP1hfjawZCQxBLu1r L/8CQM2/ckZ5QP1tCV3yK72p6W48cfUCR71wIrAw= From: "John Doherty" To: freebsd-fs Subject: ZFS: i/o error - all block copies unavailable Date: Fri, 06 Jan 2023 12:08:20 -0700 X-Mailer: MailMate (1.13.2r5673) Message-ID: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NpXtN3N9fz3Pl3 X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N Posting this to freebsd-fs because the problem appears to be related to ZFS. I have a system running FreeBSD 12.3-RELEASE to which I have only remote access (about 3,300 miles from where I am). This morning I ran "freebsd-update fetch" and "freebsd-update install" on it. This was to get it up to date with 12.3 in preparation for a further update to 13.1-RELEASE. I rebooted the machine after "freebsd-update install" and it doesn't boot all the way. I connected to its IPMI and by recording the screen while trying to boot it, I was able to capture error messages that went by too fast to read otherwise: ZFS: i/o error - all block copies unavailable ZFS: can't read MOS of pool zp0 zp0 is not the pool from which the machine boots. It boots from a pool named zroot, which is a pair of mirrored SATA SSDs. zp0 is a pool of 24 SAS disks in the chassis. If I let the machine try to boot normally, it gets to a point at which I can ping both of its network interfaces (it has one 1GbE and one 10GbE) but sshd is apparently not running, or at any rate, attempts to connect via ssh just get me "Connection refused." Via IPMI, I can get to a beastie menu. Trying to boot the machine to single-user mode doesn't really get me anywhere and I never get a login prompt. Not sure if that's because the machine is not booting or some IPMI oddity. The IPMI text console display stops updating at "Loading kernel..." x8+0xla5dbc and that never changes. I'm pretty well stumped about how to proceed from here. Any advice or insights much appreciated. From nobody Fri Jan 6 19:13:04 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpXzs0r4bz2pDqr for ; Fri, 6 Jan 2023 19:13:13 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpXzr5zzTz3Qr7 for ; Fri, 6 Jan 2023 19:13:12 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 306JD4CB021612 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Fri, 6 Jan 2023 14:13:04 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:9423:c96b:ab98:2f26] ([IPv6:2607:f3e0:0:4:9423:c96b:ab98:2f26]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 306JD30T046585 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 6 Jan 2023 14:13:04 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> Date: Fri, 6 Jan 2023 14:13:04 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Subject: Re: ZFS: i/o error - all block copies unavailable Content-Language: en-US To: John Doherty , freebsd-fs References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> From: mike tancsa In-Reply-To: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4NpXzr5zzTz3Qr7 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 1/6/2023 2:08 PM, John Doherty wrote: > Posting this to freebsd-fs because the problem appears to be related > to ZFS. > > I have a system running FreeBSD 12.3-RELEASE to which I have only > remote access (about 3,300 miles from where I am). > > This morning I ran "freebsd-update fetch" and "freebsd-update install" > on it. This was to get it up to date with 12.3 in preparation for a > further update to 13.1-RELEASE. > > I rebooted the machine after "freebsd-update install" and it doesn't > boot all the way. I connected to its IPMI and by recording the screen > while trying to boot it, I was able to capture error messages that > went by too fast to read otherwise: > > ZFS: i/o error - all block copies unavailable > ZFS: can't read MOS of pool zp0 > Is the disk controller's driver being loaded by the kernel ? What is the driver ?  Is it possible that the disk order has been messed up and its trying to boot not from the boot pool, but from disks in zp0 and not trying zroot ? If you have ipmi, try and go into the BIOS and make sure the disk its trying to boot from first is indeed part of zroot     ---Mike From nobody Fri Jan 6 19:17:30 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpY5l4PKSz2pFYr for ; Fri, 6 Jan 2023 19:18:19 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpY5l3w74z3hB6 for ; Fri, 6 Jan 2023 19:18:19 +0000 (UTC) (envelope-from bsdlists@jld3.net) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 4A69741654; Fri, 6 Jan 2023 12:18:19 -0700 (MST) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id N24vN7NLoDsU; Fri, 6 Jan 2023 12:18:18 -0700 (MST) Received: from [172.21.35.229] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 66D9E40615; Fri, 6 Jan 2023 12:18:18 -0700 (MST) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 66D9E40615 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 66D9E40615 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1673032698; bh=wQ1ECJ3nsBpi/gx4499fw4sLcMFuixWBn5Di/69AEZg=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=zqT8yt9BSgsccwwSDZ5ZFc4zozzonp4KJyH4oIfI0St9FA6CeLZo8okXCe6OLZKNA GaH2DJc7AmdWzExKy3aFjRhjbU8sIvjufPfoTu/sVgWqoh+0xXzyi92uXArRAgELui XwQvbP0TGVnyFZar0EIVH5h67kLGkWNFcLhxUQX8= From: "John Doherty" To: "mike tancsa" Cc: freebsd-fs Subject: Re: ZFS: i/o error - all block copies unavailable Date: Fri, 06 Jan 2023 12:17:30 -0700 X-Mailer: MailMate (1.13.2r5673) Message-ID: <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> In-Reply-To: <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4NpY5l3w74z3hB6 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N Thanks for your response, that's a good idea. The HDDs are connected to a Supermicro AOC-S3008L-L8e, which has a Broadcom 3008 SAS controller supported by mpt(4). I have to take a break now but will try getting into the BIOS next. On Fri 2023-01-06 12:13 PM MST -0700, wrote: > On 1/6/2023 2:08 PM, John Doherty wrote: > >> Posting this to freebsd-fs because the problem appears to be related >> to ZFS. >> >> I have a system running FreeBSD 12.3-RELEASE to which I have only >> remote access (about 3,300 miles from where I am). >> >> This morning I ran "freebsd-update fetch" and "freebsd-update >> install" on it. This was to get it up to date with 12.3 in >> preparation for a further update to 13.1-RELEASE. >> >> I rebooted the machine after "freebsd-update install" and it doesn't >> boot all the way. I connected to its IPMI and by recording the screen >> while trying to boot it, I was able to capture error messages that >> went by too fast to read otherwise: >> >> ZFS: i/o error - all block copies unavailable >> ZFS: can't read MOS of pool zp0 >> > > Is the disk controller's driver being loaded by the kernel ? What is > the driver ?  Is it possible that the disk order has been messed up > and its trying to boot not from the boot pool, but from disks in zp0 > and not trying zroot ? If you have ipmi, try and go into the BIOS and > make sure the disk its trying to boot from first is indeed part of > zroot From nobody Fri Jan 6 19:19:13 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpY6v35Pmz2pFg9 for ; Fri, 6 Jan 2023 19:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpY6v09zwz3hv9 for ; Fri, 6 Jan 2023 19:19:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673032759; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uOJhhqkuA5vtoRoUAzMo0k56vnkEx+klY8X1KEfBHNI=; b=owfmHv2iecQSbH1f00xjeUx+o2+nEV1EJSYzio3Jlr3W2Ehq7wACU269WlCwVuf3cwmU3W Zi5gjTknrxd3+UJaqGclKIs+ysZfVIXODlmE3rjExaxBBRlu8LoQfXjcLyA4vYe2zS+jZX n6Ow3BhBlZlJiiHG6r46E9QAuEMfw9p8S+jozEw9aEMbk3oJv4y7pahlUWmFteNtk0vMmC xXZPgcxwQB/NHK+Un63dsQ3fRVbeubpis9IMEBzQLNl/y7guM91AidkzrM5Xx08Ilihfif gBZ2WF2uofOGc2V5JfNAAu1x10/y6JwJHOXZwFMx1KCKqNR/V9on6kSL4ZFWRQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673032759; a=rsa-sha256; cv=none; b=Xtl/n6QDHRvmDxAa/zoqE0dL6VIYNVxqZ6Dn+0cVai0uwp3zpOaN9N4INt7jBMSC3QstOx s01r9cACz25KvKfR9Ua1/uT2fKLIeVhLmg6GXSFE8ETtL7zCh89R07t9ywO6GUsX681RX2 76vs5N+/Dovdbqz0M+26BbZilfNKZf3nXDcDz1k+1qsQL3jl3n7m7mLZJ3ANq1KXeMoN/Q DkN6WCoj059QVekdf7VPK8eKPUupj/MMPx+/nNqHPBU0oXlyGUas6OLJjbu3TdpWavcyuv D5Ufv+x7/+NL2Mp09s9H1KZPRdvR8yqFtUWnGPDJzB4ekrvviB9AOeG6vysy3Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NpY6t6FZBzhGJ for ; Fri, 6 Jan 2023 19:19:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 306JJIF2083283 for ; Fri, 6 Jan 2023 19:19:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 306JJI43083282 for fs@FreeBSD.org; Fri, 6 Jan 2023 19:19:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Fri, 06 Jan 2023 19:19:13 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #39 from Graham Perrin --- (In reply to George Mitchell from comment #37) grep -e solaris -e zfs /boot/loader.conf grep zfs /etc/rc.conf What's reported? --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Fri Jan 6 19:53:18 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpYt65fxpz2pKSk for ; Fri, 6 Jan 2023 19:53:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpYt6463Tz3lqN for ; Fri, 6 Jan 2023 19:53:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673034798; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uTy0hwhFejgqHxwWdLzdjpoVgGyuZ7nyS5aFg5gm1cA=; b=vHjhv5y4tNhN/RCi8jEIFBQeIXQOxHSYt/SqixGkAsLd8TxlHr0AsiK2catCgQXRy+dPMP snmBq9tygQkbzxGv+0GFU+sIzjl2Hk+MbZRM4z4Pf0sNbkNwbIztqCSHOMpI839jchsm6B o812vkeyejE/BcuOZFE8w5ZVrdoD1D51szTgtsGNFlpYyW3Lc/JbPvBq+bahN4dCALDX1v 66A/P8rq9lz7MIxDZtRxPgy8w2KVyRC2XnyDMIVG6uModCZK4HXTm5ac/3dGE/G1Hd+z4O 8+s2M6vkYtyDZTKOF5dECJdZy7y/78e7P9JWSR9EytQCurNWUKUXY/8wI5OtXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673034798; a=rsa-sha256; cv=none; b=xClV8hYa1JTerbpXxwZi7ERmD74vJodcbIS4bPbSWkNlupLgvXjNMMGONOf5YPExKMels7 Iv+YzCUygfHkaW9QvK39k2nNVjSpYX0DT9+EGLP7KvSDTOGUa4zqnQSQ3vD9fPCYDbJW7G qRlM8KKHcmmmwZBZOvVefVvzTxZ5o+I1zL5v6KoHHe1QG9iW/dpgAT7Caqe81YKORFdu+q 4iVo+rbPNh4HmTmAnbQw0FW9yCO7LIU66jxhZL8CWNs6OhCg2m5Lw2FGHfQwEfdamUo84m zVkbTfswZ9vUtq2dojgrCx2c4fJd7HeNI+yoNWmL24OVjk3AgNhC5Rmhrzt+/Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NpYt63B87zhqD for ; Fri, 6 Jan 2023 19:53:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 306JrImM037729 for ; Fri, 6 Jan 2023 19:53:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 306JrItu037728 for fs@FreeBSD.org; Fri, 6 Jan 2023 19:53:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Fri, 06 Jan 2023 19:53:18 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #40 from George Mitchell --- (In reply to Graham Perrin from comment #39) > grep -e solaris -e zfs /boot/loader.conf > grep zfs /etc/rc.conf zfs_enable=3D"YES" # Set to YES to automatically mount ZFS f= ile systems --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Fri Jan 6 21:06:50 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpbW15Kbmz2pTwP for ; Fri, 6 Jan 2023 21:06:53 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpbW11p5yz3tqc for ; Fri, 6 Jan 2023 21:06:53 +0000 (UTC) (envelope-from bsdlists@jld3.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jld3.net header.s=8d052f02dde2 header.b=Ezbm5FWk; spf=pass (mx1.freebsd.org: domain of bsdlists@jld3.net designates 45.55.236.93 as permitted sender) smtp.mailfrom=bsdlists@jld3.net; dmarc=pass (policy=quarantine) header.from=jld3.net Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id 8866F41654 for ; Fri, 6 Jan 2023 14:06:52 -0700 (MST) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id huDSKb2aHoRi for ; Fri, 6 Jan 2023 14:06:51 -0700 (MST) Received: from [172.21.35.229] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id 8DD9F4061A for ; Fri, 6 Jan 2023 14:06:51 -0700 (MST) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net 8DD9F4061A DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net 8DD9F4061A DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1673039211; bh=eA/FpytURlSNRlulfhoWXlSN1waRefvqliD6lbz9HWc=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=Ezbm5FWkY7D6xGaCevyf2AiCXyv83tv1wbfs3PrqgfwsGX28MLk2FhrArBRT0SXxy L8JXGm9XZUdId8LRICE05oIZvWztWzuxOaUOkLqLvZL/L894WzKA2u0pmau4PD6zVM 8st/yCq304DdANugtRZfaXP2ao3KW9h0Zw1hn0i0= From: "John Doherty" To: freebsd-fs Subject: Re: ZFS: i/o error - all block copies unavailable Date: Fri, 06 Jan 2023 14:06:50 -0700 X-Mailer: MailMate (1.13.2r5673) Message-ID: <3C4D1747-53D4-4A5A-9153-5777D2D895CE@jld3.net> In-Reply-To: <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[jld3.net,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:45.55.236.93]; R_DKIM_ALLOW(-0.20)[jld3.net:s=8d052f02dde2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[fs@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[jld3.net:+]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4NpbW11p5yz3tqc X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N BIOS settings look fine. Boot option #1 is a Micron SSD as it should be. It's not clear which of the two installed devices like that it is. There's one on SATA port 0 and an identical one on SATA port 1. Also, occurred to me after my previous message that the machine can't be trying to boot from zp0, there's no OS installed there. If I let it try to boot normally, it gets far enough that I can ping its network interfaces, so it must be trying to boot from the zroot pool. Now wondering whether there's a problem with one of the two SSDs configured as the zroot pool. So far, don't see how to choose whether it boots from SATA P0 or SATA P1 but there's got to be a way, I think. On Fri 2023-01-06 12:17 PM MST -0700, wrote: > Thanks for your response, that's a good idea. The HDDs are connected > to a Supermicro AOC-S3008L-L8e, which has a Broadcom 3008 SAS > controller supported by mpt(4). I have to take a break now but will > try getting into the BIOS next. > > On Fri 2023-01-06 12:13 PM MST -0700, wrote: > > >> On 1/6/2023 2:08 PM, John Doherty wrote: >> > >>> Posting this to freebsd-fs because the problem appears to be related >>> to ZFS. >>> >>> I have a system running FreeBSD 12.3-RELEASE to which I have only >>> remote access (about 3,300 miles from where I am). >>> >>> This morning I ran "freebsd-update fetch" and "freebsd-update >>> install" on it. This was to get it up to date with 12.3 in >>> preparation for a further update to 13.1-RELEASE. >>> >>> I rebooted the machine after "freebsd-update install" and it doesn't >>> boot all the way. I connected to its IPMI and by recording the >>> screen while trying to boot it, I was able to capture error messages >>> that went by too fast to read otherwise: >>> >>> ZFS: i/o error - all block copies unavailable >>> ZFS: can't read MOS of pool zp0 >>> > >> >> Is the disk controller's driver being loaded by the kernel ? What is >> the driver ?  Is it possible that the disk order has been messed up >> and its trying to boot not from the boot pool, but from disks in zp0 >> and not trying zroot ? If you have ipmi, try and go into the BIOS and >> make sure the disk its trying to boot from first is indeed part of >> zroot From nobody Fri Jan 6 21:15:43 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpbjD41lvz2qkj5 for ; Fri, 6 Jan 2023 21:15:44 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpbjD1Zx6z3vRB for ; Fri, 6 Jan 2023 21:15:44 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 306LFhtY064919 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Fri, 6 Jan 2023 16:15:43 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:9423:c96b:ab98:2f26] ([IPv6:2607:f3e0:0:4:9423:c96b:ab98:2f26]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 306LFgJH084361 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 6 Jan 2023 16:15:43 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <8d73d0b1-a175-79b7-f74d-f19977dca9b1@sentex.net> Date: Fri, 6 Jan 2023 16:15:43 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Subject: Re: ZFS: i/o error - all block copies unavailable Content-Language: en-US To: John Doherty , freebsd-fs References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> <3C4D1747-53D4-4A5A-9153-5777D2D895CE@jld3.net> From: mike tancsa In-Reply-To: <3C4D1747-53D4-4A5A-9153-5777D2D895CE@jld3.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4NpbjD1Zx6z3vRB X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 1/6/2023 4:06 PM, John Doherty wrote: > BIOS settings look fine. Boot option #1 is a Micron SSD as it should > be. It's not clear which of the two installed devices like that it is. > There's one on SATA port 0 and an identical one on SATA port 1. > > Also, occurred to me after my previous message that the machine can't > be trying to boot from zp0, there's no OS installed there. If I let it > try to boot normally, it gets far enough that I can ping its network > interfaces, so it must be trying to boot from the zroot pool. > > Now wondering whether there's a problem with one of the two SSDs > configured as the zroot pool. So far, don't see how to choose whether > it boots from SATA P0 or SATA P1 but there's got to be a way, I think. > Does it mount anything from zp0 like /usr thats required for the OS to fully boot ?  Can you not use ipmi to bring up the console and log in via single user mode ?  You can change the boot pref in the BIOS (on most motherboards anyways) but if its a mirror, beyond the boot loader I dont think it should make much of a difference or even hit F11 to bring the boot menu at bios time. But its when you move to RELENG_13 with the different zfs features you need to be really careful to update the boot loaders in order to recognize the new features of the pool.     ---Mike > On Fri 2023-01-06 12:17 PM MST -0700, wrote: > >> Thanks for your response, that's a good idea. The HDDs are connected >> to a Supermicro AOC-S3008L-L8e, which has a Broadcom 3008 SAS >> controller supported by mpt(4). I have to take a break now but will >> try getting into the BIOS next. >> >> On Fri 2023-01-06 12:13 PM MST -0700, wrote: >> >> >>> On 1/6/2023 2:08 PM, John Doherty wrote: >>> >> >>>> Posting this to freebsd-fs because the problem appears to be >>>> related to ZFS. >>>> >>>> I have a system running FreeBSD 12.3-RELEASE to which I have only >>>> remote access (about 3,300 miles from where I am). >>>> >>>> This morning I ran "freebsd-update fetch" and "freebsd-update >>>> install" on it. This was to get it up to date with 12.3 in >>>> preparation for a further update to 13.1-RELEASE. >>>> >>>> I rebooted the machine after "freebsd-update install" and it >>>> doesn't boot all the way. I connected to its IPMI and by recording >>>> the screen while trying to boot it, I was able to capture error >>>> messages that went by too fast to read otherwise: >>>> >>>> ZFS: i/o error - all block copies unavailable >>>> ZFS: can't read MOS of pool zp0 >>>> >> >>> >>> Is the disk controller's driver being loaded by the kernel ? What is >>> the driver ?  Is it possible that the disk order has been messed up >>> and its trying to boot not from the boot pool, but from disks in zp0 >>> and not trying zroot ? If you have ipmi, try and go into the BIOS >>> and make sure the disk its trying to boot from first is indeed part >>> of zroot > From nobody Fri Jan 6 21:54:55 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Npcb76ZRxz2qq33 for ; Fri, 6 Jan 2023 21:55:31 +0000 (UTC) (envelope-from bsdlists@jld3.net) Received: from mail.jld3.net (mail.jld3.net [45.55.236.93]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Npcb73kmyz3xZ8 for ; Fri, 6 Jan 2023 21:55:31 +0000 (UTC) (envelope-from bsdlists@jld3.net) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.jld3.net (Postfix) with ESMTP id E9F8D41654; Fri, 6 Jan 2023 14:55:30 -0700 (MST) X-Virus-Scanned: amavisd-new at jld3.net Received: from mail.jld3.net ([127.0.0.1]) by localhost (mail.jld3.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id BVBv9QYmu3fZ; Fri, 6 Jan 2023 14:55:30 -0700 (MST) Received: from [172.21.35.229] (c-24-9-144-115.hsd1.co.comcast.net [24.9.144.115]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jld) by mail.jld3.net (Postfix) with ESMTPSA id BB6594061A; Fri, 6 Jan 2023 14:55:29 -0700 (MST) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.jld3.net BB6594061A DKIM-Filter: OpenDKIM Filter v2.11.0 mail.jld3.net BB6594061A DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jld3.net; s=8d052f02dde2; t=1673042129; bh=B/H2xAsUO7QDuxB/hqP+v5aOrn56YILCXOKbrp15tek=; h=From:To:Subject:Date:Message-ID:MIME-Version:From; b=mZ5fLRhd+pxWlmv7h62dVg9tjBK+4Z8nCcrl/ssgmW2GJp1W1fgZyzIhGEoFom5aq bgLo93E+l6/KXqPOWxz1iMzjEp0WnJtV8gIg9aDOttxE0nerMSlpcO3zOjBIiQHYZA eHBxASMqQPl/SQ2TJlbdKnKkfVe3L2Wol7xa/ncY= From: "John Doherty" To: "mike tancsa" Cc: freebsd-fs Subject: Re: ZFS: i/o error - all block copies unavailable Date: Fri, 06 Jan 2023 14:54:55 -0700 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: <8d73d0b1-a175-79b7-f74d-f19977dca9b1@sentex.net> References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> <3C4D1747-53D4-4A5A-9153-5777D2D895CE@jld3.net> <8d73d0b1-a175-79b7-f74d-f19977dca9b1@sentex.net> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Npcb73kmyz3xZ8 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:14061, ipnet:45.55.192.0/18, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Fri 2023-01-06 02:15 PM MST -0700, wrote: > On 1/6/2023 4:06 PM, John Doherty wrote: > >> BIOS settings look fine. Boot option #1 is a Micron SSD as it should >> be. It's not clear which of the two installed devices like that it >> is. There's one on SATA port 0 and an identical one on SATA port 1. >> >> Also, occurred to me after my previous message that the machine can't >> be trying to boot from zp0, there's no OS installed there. If I let >> it try to boot normally, it gets far enough that I can ping its >> network interfaces, so it must be trying to boot from the zroot pool. >> >> Now wondering whether there's a problem with one of the two SSDs >> configured as the zroot pool. So far, don't see how to choose whether >> it boots from SATA P0 or SATA P1 but there's got to be a way, I >> think. >> > > Does it mount anything from zp0 like /usr thats required for the OS to > fully boot ?   Can you not use ipmi to bring up the console and log > in via single user mode ?  You can change the boot pref in the BIOS > (on most motherboards anyways) but if its a mirror, beyond the boot > loader I dont think it should make much of a difference or even hit > F11 to bring the boot menu at bios time. But its when you move to > RELENG_13 with the different zfs features you need to be really > careful to update the boot loaders in order to recognize the new > features of the pool. Thanks for your response. No, it doesn't mount anything from zp0 that's required to boot. Figured out how to choose between SATA P0 and P1 as the boot device. Was set to P0, now set to P1, not really making any difference. Cannot get to single-user mode via IPMI. Not sure if the machine is really not booting or if I'm having some problem with IPMI. I'm using SuperMicro IPMIView on a linux machine which seems to work OK. Right now, I have the BIOS set to boot from SATA P1 and when I try to boot to single-user mode from the beastie menu, it gets this far: Loading kernel... /boot/kernel/kernel text=0x1752e24 data=0x140 data=0x7662b0 syms=[0x8+0x188a18+0x8+0x1a5dbc] loading required module 'smbus' /boot/kernel/smbus.ko size 0x2680 at 0x24a7000 loading required module 'opensolaris' /boot/entropy size=0x1000 And then the display stops updating. If I try to boot normally, the IPMI text console display also stops updating after "Loading kernel..." but things seem to proceed farther than that, in that about 15 seconds later, it starts responding to ping. The IPMI display never updates, though. Wishing I could connect to this thing via serial console and ditch IPMI but don't have that available. Getting to IPMI on this thing is sort of roundabout because of some goofiness in the networks involved, might try to simplify that if I can figure out how. From nobody Fri Jan 6 22:01:38 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NpckC4Qf9z2qqp6 for ; Fri, 6 Jan 2023 22:01:39 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NpckC3lnVz3xvQ for ; Fri, 6 Jan 2023 22:01:39 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 306M1cci081183 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Fri, 6 Jan 2023 17:01:38 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:9423:c96b:ab98:2f26] ([IPv6:2607:f3e0:0:4:9423:c96b:ab98:2f26]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 306M1bRq097860 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 6 Jan 2023 17:01:38 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <96bf3f48-8c18-357b-e5dd-f16c851e2577@sentex.net> Date: Fri, 6 Jan 2023 17:01:38 -0500 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Subject: Re: ZFS: i/o error - all block copies unavailable Content-Language: en-US To: John Doherty Cc: freebsd-fs References: <9DDC68E1-4321-45D9-831E-A73F70C66191@jld3.net> <48b9848c-2e47-0d4b-f8b0-6a8ef7a7c982@sentex.net> <867AADBE-60F8-4B54-BBE8-875D381DA296@jld3.net> <3C4D1747-53D4-4A5A-9153-5777D2D895CE@jld3.net> <8d73d0b1-a175-79b7-f74d-f19977dca9b1@sentex.net> From: mike tancsa In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4NpckC3lnVz3xvQ X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 1/6/2023 4:54 PM, John Doherty wrote: > Right now, I have the BIOS set to boot from SATA P1 and when I try to > boot to single-user mode from the beastie menu, it gets this far: > > Loading kernel... > /boot/kernel/kernel text=0x1752e24 data=0x140 data=0x7662b0 > syms=[0x8+0x188a18+0x8+0x1a5dbc] > loading required module 'smbus' > /boot/kernel/smbus.ko size 0x2680 at 0x24a7000 > loading required module 'opensolaris' > /boot/entropy size=0x1000 > Did ipmi console mode work before ? On my supermicro boards, I usually have to add to loader.conf comconsole_speed="115200"       # Set the current serial console speed console="comconsole,vidconsole"         # A comma separated list of console(s) comconsole_port="0x2F8" so "serial" (aka ipmi console) works. Maybe try and set comconsole_port="0x2F8" from the beastie menu and see if ipmi works for you after that     ---Mike From nobody Sat Jan 7 00:33:26 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nph5L61qwz2r9kV for ; Sat, 7 Jan 2023 00:33:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nph5L3rt7z4C9T for ; Sat, 7 Jan 2023 00:33:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673051606; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=k4H7gKSqM2Le6DAIb9EMPOMucteyo28Xbc8R/QdVBUU=; b=uRnKh0VOLN0tULSDJBN99fKVescyXiUag2V+ZlqhvIWQR03TSPMzVh+ZfEhUVusQnRyUwO KPzjvQ9nnk0v6uPrt5DRo52EO3zVgFSu1wyEbhKRGgrdRk/8gI1tFDG3raE6P/VjwLm7Es WpC/mRTgLPK0FUjKMYFPczhpSGowzoEBFMmObcDTv3lF5MbxsqI/ol8wbFN6QUs/DrDsbI 4yGMjvH6nwzL5KC0WyGf6SMWC4gC1eHleS6tfNbU/3wMfmxaaUSr0dp9veU9F8/eUnefll jEcIcT96vyaAV/FhtQLxC2UfVk7JrHdJK2mZuKLZsCyQIipHHH/JE8xU1PtKIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673051606; a=rsa-sha256; cv=none; b=bvoVFB4/LCd6udqYNFusNmBBHdhWn4F5Vt5ADTRlAmk59NJj24KgCJ3ADWE+P9HiCJ2CUM o36V4wLQUV9PEd/wWKDRNxZ1vz2AdZDHaDBtjZEsHBGOWCleVcDVbupYppKTLHuvxJIRMU l/KpmVp0HqQFDdCEUQeaR+roCps5zDsqNSNDx/XjAThFil1YaPfWWieZMAooE19AQXkyht TSYaEu1SGrWaCbK7KGYgbA3e0s7EOavg8BT9mgRFg1H1vqBVk3OcK/KffGgf3GAYSSonjC 0z8PBPzDd5/vSyysD1S++T/qgLrQWxtyVSmTt1hFYs+9CIhHqaDrnIf3+TAt5A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nph5L2wqzzq7N for ; Sat, 7 Jan 2023 00:33:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3070XQrv052268 for ; Sat, 7 Jan 2023 00:33:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3070XQ5K052267 for fs@FreeBSD.org; Sat, 7 Jan 2023 00:33:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Sat, 07 Jan 2023 00:33:26 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #41 from Graham Perrin --- (In reply to George Mitchell from comment #40) (In reply to George Mitchell from comment #20) > =E2=80=A6 timing related, =E2=80=A6 Please add to /boot/loader.conf zfs_load=3D"YES" --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Jan 7 18:08:53 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nq7WB0B5cz2rCBW for ; Sat, 7 Jan 2023 18:08:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nq7W96FBZz3NxT for ; Sat, 7 Jan 2023 18:08:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673114933; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TQrJTfh7K392e/Cl/bjiEoCpRocIV15tV9pAZj+bEzk=; b=g5tlvCG0PL2l7uckTlzdKUPx1jKK37yxrRuUO5dQ4k2QAccGVqG7WauSZBvbUD+qrm9HeA bvYbWU7pZ7jyPjo7BjJVL1sx81ReQdIIsHX3FWZb0UAHqv965ScCuVbZjEbPY+zGz0QFTA WNb07XoojKDz0GWbopd1hSeugT71wk3yTRENtAPv5sUEwUpLmLSD9aR73LBt9yTE+19FYy DshjPzMFhYc/q869+1/mVba4jj1Tiz0TDrOpts15FuTUoidlFtQYchoOqNaS3rOmWhBwau 0PA7eun9LU40AmU4xYyE2T5lMChYtgMxveRpwnkOuYBoRFte1AO2w/FMEcYdkw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673114933; a=rsa-sha256; cv=none; b=MNj5VCkWZIiDXYRn0OvtQ3+EpROKGBiE3U0pu8KHV5EPQBiBWQs/WNYJ4kGAgHv7KQk8xq YnbocO32be91egtu4pQQ1e231MgcYogVRmlJeSHY9ElrjMgOYeR+xk1YiZMM4P5hFc7XVl 90zIW5sgEnr9zYRckZq1LIE1itD9xkSjelExHCztBhMvmfuCCZZoF128DG358pmTSIidb0 ye97NFyQhYuCQUrL8XD0C58MPk/jNmfZfd0DpbtbHkFxnnp7FRQaInAQBa5hDC1HSiINYW Sv0fa+TpiglXdx911NkfKi/zPjkUOL4dkeCZtgy1MB3evPlNcis6p9utOCUgkw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nq7W95CZczJMg for ; Sat, 7 Jan 2023 18:08:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 307I8rAG092614 for ; Sat, 7 Jan 2023 18:08:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 307I8rjS092613 for fs@FreeBSD.org; Sat, 7 Jan 2023 18:08:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Sat, 07 Jan 2023 18:08:53 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #42 from George Mitchell --- Created attachment 239336 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D239336&action= =3Dedit Crash dump Well, this helps a bit. By adding that line to /boot/loader.conf and resto= ring kld_list=3D"amdgpu" to my /etc/rc.conf, I was able to reboot without the cr= ash four times in a row, whereas before it would crash about every other time. = But it crashed on the fifth time. (See attached core.txt.0.) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sat Jan 7 18:13:56 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nq7d04sFxz2rCsW for ; Sat, 7 Jan 2023 18:13:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nq7d03cFvz3PYt for ; Sat, 7 Jan 2023 18:13:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673115236; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=JHfj4Sh3vT+vicLcs6tgQHtaFPW3tjNkGKaeNA1GWbA=; b=GBHcwuTJZaVzVPFkmY/rlYH1YZl4Kf1fUBzv39oiCGv/pNMgWas2gdF9w2fXfT7a7KaW2h CKN/4X7saKIAKa9a9smvkxVOEezGY/vZfCSNtP8Gc2y1oZ964+X8xAcnRWQ29N3CXWlmPO 91ymtswTaHsK9y/GKnvmXq1qLDZehgh9EFYdEXS9wTdjHC+Ww6xi05cadMJ8b6enJBAGr4 Pf74EnvnKOYaknsXy4a1HBHLmCvsjDGYn3DtH9ucG0OBt0nTZxV3hxWfYURDnRoEEbIEXG iokTMbbfjsnRfVZCNLKrxdDCGOUWZuJKaIY0Rk97fW7EpCvFXSZgwM0q/vZx3A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673115236; a=rsa-sha256; cv=none; b=XfPe3+81hXTMoWZNyzjf3DT7z9H6kEHEMqz70R939OXuXHg867oMZKcGhrh9QXiWOzXjuG lEFWc6QQ7iqZLq++krKH4o/4Inn5QuY3vwYR9Bnl/Ab4Mf4sk4lcmaU9r+YSzS1JGrUnLI cYyg8ndDoE7PyTtc8uVNdkUrbH55zgOPEEQXev0tkpl1hDwWxHulJPgQmEbsHni2oytbXG J8YUENI24+0BuwcDdr18PXqbQp2WWO7opB23qp5a2PI1PLnR89Nem4xOyJ7OF6zBGdNjj6 P+IzqgHVylnXZ1loLWYa7Cl+KEAOgQ8osurnrphauQTvw5BLWiCzRqrwBa0LvQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nq7d02gWmzK9h for ; Sat, 7 Jan 2023 18:13:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 307IDuWw012190 for ; Sat, 7 Jan 2023 18:13:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 307IDubF012189 for fs@FreeBSD.org; Sat, 7 Jan 2023 18:13:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Sat, 07 Jan 2023 18:13:56 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: george@m5p.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #43 from George Mitchell --- In the new core.txt.0, there are about 19 lines of text from the previous shutdown near the beginning of the file. But the substance of the backtrace looks identical to all the previous ones. So loading ZFS early mitigates t= he problem but does not fix it. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From nobody Sat Jan 7 23:36:50 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NqGnb1ZLNz2pRcw for ; Sat, 7 Jan 2023 23:36:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NqGnZ70fpz44PK for ; Sat, 7 Jan 2023 23:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673134611; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1eFqPkQSLaQ6I8g5KslFmNgqQ4wfpLJRu1wF1ECsJ54=; b=ir4d1ATbGLDY5bdIcZtgtZXA9+bNaMpUZzMsGxiGGosD9qwU03z71P1qNfsZ/Fd4s7Q1J9 xkiyVaSCugYmUZWNEqi1XSFwB8SMBGRN59w75MP5dgmlD0maNALOdZpwwzmzr0jdUZOqMJ IWaY/edHlTgubZAP2c9Yrdqiwkk6sWWGVPzUVoeiBFtPqZ0JDWbgBw+vHzgngYedgajie+ W5uWa2GgHzTqwE4uhJV8az5MctLSd+BXvz0TF7NWVv2gZv/M/QVbXtjYsejfVYioIEreSk stfHX1/VkoZ2+DCftUCAcBiXsPsXp9JAcN5C815wav35HGIS7oefJScfqX+Fjg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673134611; a=rsa-sha256; cv=none; b=t4m321ufSZiKWnjwu5oCYQOD9gxLazwImPWAWPfpIaMBBS2oi+Kq377evK3qRGis0stG/U NTgpDsFqUMXWOPYSKVNzbhFdFcWF0exuPuEglI6ncTz6UyGg+vuUODBhvbwLC1qfLOyzoc ZRZiJ8eUiedOEgFZlxVoOuzV8uwHvohuzE0Ylv10lmG/3RKH8FAILN3Ik5kh4GnrVuwv2U XNfmbkDrNeK9qe9vFc4Ad5Z+iV8ay/Hi+NXENDD84mGhGsONK+8bjEQpxRzcVrLm9z3tU8 sRfLqrZkK62TMnTsy/mn4YDarELQa79hZtLMALD/uNCfmKTos/xByOVNhO86xA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NqGnZ65DVzSWg for ; Sat, 7 Jan 2023 23:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 307NaouU083693 for ; Sat, 7 Jan 2023 23:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 307NaoGY083692 for fs@FreeBSD.org; Sat, 7 Jan 2023 23:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 267028] kernel panics when booting with ZFS and amdgpu.ko (both are required) Date: Sat, 07 Jan 2023 23:36:50 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D267028 --- Comment #44 from Andriy Gapon --- I think that in these frames we clearly see a bogus pointer / address: #7 #8 vtozoneslab (va=3D18446735277616529408, zone=3D,=20 slab=3D) at /usr/src/sys/vm/uma_int.h:635 #9 free (addr=3D0xfffff80000000007, mtp=3D0xffffffff824332b0 ) at /usr/src/sys/kern/kern_malloc.c:911 #10 0xffffffff8214d251 in nv_mem_free (nvp=3D,=20 buf=3D0xfffff80000000007, size=3D16688648) at /usr/src/sys/contrib/openzfs/module/nvpair/nvpair.c:216 I'd recommend poking around frames 11-13 to see from where that address com= es. Also, I don't get an impression that the latest crash is similar to earlier ones. kern_reboot / zfs__fini vs dbuf_evict_thread. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Jan 8 21:00:47 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NqqH42kzwz2r7c4 for ; Sun, 8 Jan 2023 21:00:48 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NqqH33QbYz3JKJ for ; Sun, 8 Jan 2023 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673211647; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=F2/udJxxP0Rcs0wYTQiAS1EVKSA+SPMrdd8drE/twWc=; b=BV4L7AMTrLH1M93HZ8RkCl2E7sOlL8ksKwXBAOrRr4nLas2WuH7+Thpnc7aOsvuZOswuTj YlE2dm3HJmbfCDpU9RQSS6402/OYgBdyyicLCL3mMMdZ2QOM8skol3QRcPavozT27BcMZ3 BrtVFodBQ137j1rk/1OGTqc2DKVnvy+k5ANfP/NxONqwoW4lwrtDzDK+gPQC2OlOU0LzlV URsDgKnzAlEH3OHov42Fj+zcnVioUF5CKGkj3rIc+89m8oZPdLqWtR1fllu7TSJ0OWKU0L s2fvr9NqB5n1FxM+CAOOJmQ76s/Cs3RyYonKtc+jGn8vGcfQGcI4nrcC0NjFQw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673211647; a=rsa-sha256; cv=none; b=m1lLA7ILEBwkUWB8yjrd9A0xeLjYG5Z+NHi4ttkK/Ih+adwRtnBg23d/et69UzcTve2zjG wf2eKPuF42SJCgrehBjivlo1CH3eJLSEXHPiTyA8WajGa31fxyIYpSefMDclREE3wElkcD jT1jJUTcpTBP1oqf0qAsN4Bw8sjYInqE2MK1kgGTCpjetk2Oa6wbxmdZOZmCNtulipVwrw P8f86FwoFzEdCAkgEQrP7JWX8pNBmDZsEk+vTR6e/UpV+uzFAyg1Jp6IDaTKEWrZoFpxOv RPb9Mc144Njsg6eryGURvqDb/BolzA7AMO8swMgEG+G15d+VmosJZl0GMociPQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NqqH32WV5z13Mg for ; Sun, 8 Jan 2023 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 308L0l1k092458 for ; Sun, 8 Jan 2023 21:00:47 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 308L0l57092457 for fs@FreeBSD.org; Sun, 8 Jan 2023 21:00:47 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202301082100.308L0l57092457@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 8 Jan 2023 21:00:47 +0000 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16732116473.8C4A5AAd9.88098" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16732116473.8C4A5AAd9.88098 Date: Sun, 8 Jan 2023 21:00:47 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W 7 problems total for which you should take action. --16732116473.8C4A5AAd9.88098 Date: Sun, 8 Jan 2023 21:00:47 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    211491 | System hangs after "Uptime" on reboot with ZFS
Open        |    237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w
Open        |    240831 | zfs: Panic during snapshot on 12.1-STABLE r352648
Open        |    243973 | [zfs] rollback segmentation fault
Open        |    244656 | zfs: resilver doesn't provide enough information 
Open        |    244692 | gjournal: Does not support TRIM
Open        |    251035 | ZFS: Allow 64 bit ZFS to support 32 bit ioctls (W

7 problems total for which you should take action.
--16732116473.8C4A5AAd9.88098-- From nobody Sun Jan 8 21:10:13 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NqqTx4jfgz2r8TN for ; Sun, 8 Jan 2023 21:10:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NqqTx23s5z3Mm9 for ; Sun, 8 Jan 2023 21:10:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673212213; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wIZ6qO0xvXwVitkENj1I3hWuWw7b/mrpgCidL52Tvt0=; b=qA0BzIjfm+GcSos0PlLnTDXLlHxHG2snhdiBhtNmi1yOBIevMB4PuVDDVnk2RqoEKfVE5D VfRNPRmBLV+ZnBYaiggHD/NJXZVpJjhN4iFCAvy6OaR/YdaiPqtoVWfATX+aD15SkTk7yr YQUQ8+Ns1amd1CMW89aWIQc57n5SyNm2uLeY5mmGKiADQVUgndOAhUB/g1x6o4T3PdinVO 5vloiH1edjsW87szi6+dzP1VyDTOGTTLGsHaLMvR6405tcAH4p4qwL3zerV2sVl12E4Kb0 GAOyByPxjnQK5PyThfHhBb559LM8Q4XY6fo+r33IsPBXlb4NztDodliUbp7Ang== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673212213; a=rsa-sha256; cv=none; b=WBNYHo/eVLt5rs8OI5XCteqYkn4KgsyCY4DkNnufasRfqVN3Q3nh5snLjRfJ/3v1nHS3RF sX/5yxkdCWwqISoTVqCjarcZbJwZB9N4MthflEyyl6FP1wZ4WLo3Yh2f9mkds+wY+xQNsT ocJ45NK65Hi04UO9OTFw45raqSNHz2mQmHMvTjW6pwx7k05rCMZ2hSCYCBmI0nSaLosSfs sOC5B2lW38A0FSmldVhnvINopI4jXVz3/2r9HVGVs5t5C3OvQZ6JAJklfdmVYmtv81ocnn M6UvsZltnNGCSCVUvVyL/ir7rEgdn3zr3jyaGBBahTx2P+f+h3QLqPbZ0JKKsQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NqqTx11Yxz13P0 for ; Sun, 8 Jan 2023 21:10:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 308LADFA003873 for ; Sun, 8 Jan 2023 21:10:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 308LAD3N003872 for fs@FreeBSD.org; Sun, 8 Jan 2023 21:10:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268830] After 12.3 to 13.1 upgrade, with a ZFS dataset named 'tank/.': mount failures Date: Sun, 08 Jan 2023 21:10:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc keywords short_desc bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268830 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org CC| |grahamperrin@freebsd.org Keywords| |needs-qa Summary|After 12.3 to 13.1 upgrade, |After 12.3 to 13.1 upgrade, |failed to mount zfs |with a ZFS dataset named |filesystems |'tank/.': mount failures Status|New |Open --- Comment #1 from Graham Perrin --- Consider this, from :=20 [A-Za-z_.:/ -] Was bectl(8) in 12.3 used before the attempted upgrade? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 9 00:19:21 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nqvh95JGgz2p67S for ; Mon, 9 Jan 2023 00:19:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nqvh93gPNz3rSH for ; Mon, 9 Jan 2023 00:19:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673223561; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QM2+eN0monbCVArFnS4P6YL5qg/SXz8JvABuL93R48M=; b=IZxWPf4BlVxANSvRuGFO1SufqDaOxdtQK/NNz6gmrlmHxq8/CID7XXrI+Pw9i3nL4R8UyE B3PB0Jv3ApEyztdKFXLFFFO+mcifjemZGLh0gFDNjSPUNF6wR8KOm3rueMo9D5os18KPPM PV8vCaM2LgJyVdPjShLOuPUmZrGUy53NpGRCs6sXG5oNCwnCHq9RJhXWzgimoQGV7Y0q7e Qqix5dWfHCRspHbLPc85300WCa93MzVjx+qJBDyKCKLnU++JFvb50fsNq8UVoDWcc4kjJ1 tsIjYSJb7dWi9ra65yFE/jNsSTCVSNeYfo7iw/Wcd3QIG+CKH1d78iOSO8rMKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673223561; a=rsa-sha256; cv=none; b=jP+Vel605dORU4ONl76olpy8dmW8rrr4vhwyXJYV3CPc4hsiN9LYYefTGRzzToUNRVeBZG TI57XKNfgt4eMCQ+TnOVvyi+B4ZiLHQ9BDlPiAxLMZ8Ap2cZNCWPXic2qyFzP55hqDocfL yuohvQ6R3Eus5QQ15m8qBDm4WU3MYABd6jKrOl1sHbk/McipzwY0PyBmAevBelhL6NYGcS 9bDRc+SEs9ruLAHZVOi0QsU9T5DXUGbKV29wIrxdUsF1EowCAOr7OfEF21D3MSk6yQimbv 1Ph9R3qaA64Fsz0UBdHcvw1Klp/IT1vvaQxpNTsTqR6YHr9jz0nCn/1lgDpakA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nqvh92d1Cz17RQ for ; Mon, 9 Jan 2023 00:19:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3090JLsi090060 for ; Mon, 9 Jan 2023 00:19:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3090JLa1090059 for fs@FreeBSD.org; Mon, 9 Jan 2023 00:19:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268830] After 12.3 to 13.1 upgrade, with a ZFS dataset named 'tank/.': mount failures Date: Mon, 09 Jan 2023 00:19:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: leif@ofWilsonCreek.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268830 --- Comment #2 from Leif Pedersen --- No, I've never used boot environments...although they look handy. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 9 06:31:06 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nr3x70Wrvz2r85s for ; Mon, 9 Jan 2023 06:31:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nr3x63cKtz4HM8 for ; Mon, 9 Jan 2023 06:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673245866; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xwPIViQ4ZefGoir3x/mHZmFq++BG3+6JP/WJa11NgWM=; b=G2m0LvyReB6tWy6wC2Rl8+8AwsGYvrlQHqwbVpuRpqDCIpCaDTbwHMqlXjwWva52luDHAh M3jtHLHz704S8/w0uv/Gs3m5kLJsCbSDKJLGNUHBEVF78/BUETar4ukSGEN7JDR6SsdAN0 0ONQe161NbIUEjUKa56YmMCmQoEKKu/9HBHPj6YacmRAgVe9UGj53bTUkdTZiRg+HMBT+Z 4wQdHRvasdHK29FApT7BFvgLOvKlXX9CZhaLFNlTx5V3fnjY0zjNY0jyZssfdACqLtke9c TxB1BOFctHnngDkDLuzis1lJE81uvGIj85jT+zvbFkSHZwaHFn7m63YUAURBoQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673245866; a=rsa-sha256; cv=none; b=dWPQDctQIUj6jO2puiBTwrSg/4opElPKaUEoGMwUURiVcWps8WvvRO5xdsFOCdmD0IufrF TTQG6SI6462QWPkLHa92sfIyf2h9g2/iXhArKPs7MIX/49gYY6eLwHyaxTXp8E2E4LjIZE VCu3thRphhusP6oG9g12MGanTRq1lXakyMU7wZ9wIMVXNZa2HcqPNEfmAIuWVsUzKa/Axu mL5ur7d/Ckj62ezxfg+a3Mj+x4BzZDlfIXSGjlMZ+QEMVfy9h0Oie+bL0QslLYmj4mX8pl u714Sv+qjlD/TiisRbmKgRTsSPVUSv82EoLSwKKGRo22pigZWHPHVemu6LcVBA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nr3x62g9YzK1X for ; Mon, 9 Jan 2023 06:31:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3096V6RR034297 for ; Mon, 9 Jan 2023 06:31:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3096V6UI034296 for fs@FreeBSD.org; Mon, 9 Jan 2023 06:31:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268830] After 12.3 to 13.1 upgrade, with a ZFS dataset named 'tank/.': mount failures Date: Mon, 09 Jan 2023 06:31:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: Rincebrain@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268830 Rich Ercolani changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |Rincebrain@gmail.com --- Comment #3 from Rich Ercolani --- 9c7da9a95aaaecced0a1cfc40190906e7a691327 is probably what's making you sad,= if I had to guess, or a side effect of implementing it and assuming it would be true, since that commit postdates 12.0 and thus I would guess you first saw= it in 13, since 12.4 doesn't seem to have it. [1] Probably wouldn't be unreasonable to plumb in a special case allowing renam= ing _from_ these so people aren't stuck on upgrade if they were doing it before= , as well as better error reporting... [1] - https://github.com/freebsd/freebsd-src/commits/releng/12.4/sys/cddl/contrib= /opensolaris/common/zfs/zfs_namecheck.c --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 9 08:06:48 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nr63Y4Lxqz2p77j for ; Mon, 9 Jan 2023 08:06:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nr63Y3Kmdz4PTD for ; Mon, 9 Jan 2023 08:06:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673251609; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=u26D4voBmI+WcYuRnL3h67+PQKwiTD4dZU2lIsMizYs=; b=XZnodAtFAY2bWPAlcxZvOgoqIFv3rzPF+dIYvVRuCg0YHc8XhdjPNylM7/T5V6L7a/bLCs ZvbpK4+BHJpHdgV1q2BjIoQXCMB0OH0y7eJ3fFkfW7mKme5onWJAbhI+CW3psRsTGhrnAR lbQKCZdOs1e8bOQJIEKPStXG09C3qNAeyYxjRFmOybauivrLHWrzDmk14TLjyuRBIUUbXG X42xPyfDophyMbPeJy+kBFQlxKCi4NSVi8HuZWB3QUWz3Raj5KhGnqK0LjKuOcdrZ/XF0n cjh0OCvnpc84uDP3BBv3GuXzgkGUq3umJIQKc3nRISOJuMBi5IraunFA+5pMFg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673251609; a=rsa-sha256; cv=none; b=vVabcFbmgpwJbjHKp8jDfVXqGegs7RpgaLkqxzzvF/KlHiQ+phGX1oHyOu5y4GiK8UE+Hq OtWCrJxrcztsN05lTmBapMSomD7QUuDRZX1zxghpO8UHPQoUiPGo+HiPlgrkgcqb7cK/PL 4S2F61Xwm7/aSXlMKxcmgsXqAvB1T6dFzWTu/KgFk/Wrfa1jiBx1b974mnql3J2v1aUn/s yWbRYWsThfl/ddKPvN85m2MtG2S/kehDJKbg+7H9LJF5uZyDFlPip+98X2I+tRtKUovx2C F2r7+Vgp9qzzJfrhCuU1CB8o1ijI7n7RRxZ+x+gNx8yDiWkCN/dh15Qg1NGadQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Nr63Y2NgjzM2d for ; Mon, 9 Jan 2023 08:06:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 30986nUo069540 for ; Mon, 9 Jan 2023 08:06:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 30986ngn069539 for fs@FreeBSD.org; Mon, 9 Jan 2023 08:06:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 268830] After 12.3 to 13.1 upgrade, with a ZFS dataset named 'tank/.': mount failures Date: Mon, 09 Jan 2023 08:06:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grahamperrin@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: see_also bug_file_loc flagtypes.name cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268830 Graham Perrin changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://github.com/openzfs/ | |zfs/pull/8842, | |https://github.com/openzfs/ | |zfs/issues/8564 URL| |https://github.com/freebsd/ | |freebsd-src/commit/9c7da9a9 | |5aaaecced0a1cfc40190906e7a6 | |91327 Flags| |maintainer-feedback?(jpaetz | |el@FreeBSD.org) CC| |jpaetzel@FreeBSD.org --- Comment #4 from Graham Perrin --- (In reply to Rich Ercolani from comment #3) Thanks for identification.=20 I see in illumos. jpaetzel@ please, do you have an opinion on how to proceed here?=20 Historically (casting my mind back to the era of Ten's Complement), I thoug= ht it was fairly well-known that a dataset name must begin with an alphanumeric character. , and so on. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jan 9 15:02:08 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NrHGn2qbJz2sFgh for ; Mon, 9 Jan 2023 15:02:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NrHGm5QFCz3sTP for ; Mon, 9 Jan 2023 15:02:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1673276528; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FYHRTiuvFm8rnsPyIDYegO2GhB6RInNmFgxeMtDpp2M=; b=hXBOYIlE+De3pvzt+PVy0WMY7nhG6AW7+RsLv7+rBy8pbbKzXREaq5CGKAHVlEX+DldhMC vmgj5zuDnrOT6RsC+Xi6xOA2IB+hAmnEJnqnrxmqEVXBVdz2FFxylj7zCd7w7kQNJ2UzGw SIKffjIuPd05C8RsanV2mQ/1AsYeyV2SuKG/d0OIU5bZ2Pla/43iIAyMxzT8v6jx46wHyu 3kwnpSxsGTkXSxDaZinhBq60VUoFvIVPNgi/gApg64rZKW6wWkgJbsw4bqXMGxXfecvpvC 6ifxkmz4t+P7CJnL7qwdu+bCbEKNkt7t1eYrmS7YFga+ShEcr/FmR+OijBOweg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1673276528; a=rsa-sha256; cv=none; b=NgJ7lFkIp1h50S4NHz07gyw5T99AGkTD6jtgwaNvjVX5W5jpQOiQ6COlYiqbut24xentoh DH1NTfQPekyshxzRolZGIpiYpzw4JJr7fxj8ayqn2KhI9uoRInLP6oYcsUebF8qgMQSJBS GyTB1ktuxnJ1C2KGB2kuwNIpBZT4l4cfOk1ICEY7RgsYmtwH3obb0Ex3HVmEVaR27MXkd8 XwxSTeiHKmgHa1QTfL+8ZXsiEIGKkWJjpEWGJ+epFlNbdSjBfwmAKuKZgvDSI2x00P+x+O c3BFTylj/vvRIdP2tMCYGIHacY/yoXN9folx98RrYyXkqfMc2RI0af8iSBeVyQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4NrHGm4WSbzXY7 for ; Mon, 9 Jan 2023 15:02:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 309F28BA077198 for ; Mon, 9 Jan 2023 15:02:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 309F28DV077197 for fs@FreeBSD.org; Mon, 9 Jan 2023 15:02:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 251342] fs/unionfs: VOP_UNSET_TEXT without VOP_SET_TEXT leads to panic Date: Mon, 09 Jan 2023 15:02:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251342 --- Comment #4 from commit-hook@FreeBSD.org --- A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D04f8674aa7486ec2d73d60c2247fe5e33= b5399c5 commit 04f8674aa7486ec2d73d60c2247fe5e33b5399c5 Author: Jason A. Harmening AuthorDate: 2021-12-21 23:51:51 +0000 Commit: Ed Maste CommitDate: 2023-01-09 02:31:15 +0000 unionfs: implement VOP_SET_TEXT/VOP_UNSET_TEXT The implementation simply passes the text ref to the appropriate underlying vnode. Without this, the default [un]set_text implementation will only manage the text ref on the unionfs vnode, causing it to be out of sync with the underlying filesystems and potentially allowing corruption of executable file contents. On INVARIANTS kernels, it also readily produces a panic on process termination because the VM object representing the executable mapping is backed by the underlying vnode, not the unionfs vnode. PR: 251342 Reviewed by: kib Differential Revision: https://reviews.freebsd.org/D33611 (cherry picked from commit 9e891d43f586e91541bd61fb12550de296d76fd9) sys/fs/unionfs/union_vnops.c | 34 ++++++++++++++++++++++++++++++++++ 1 file changed, 34 insertions(+) --=20 You are receiving this mail because: You are the assignee for the bug.=