From owner-freebsd-fs@freebsd.org Sun Jun 10 21:00:45 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B57D41004DE3 for ; Sun, 10 Jun 2018 21:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 461E777B77 for ; Sun, 10 Jun 2018 21:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 069121004DDD; Sun, 10 Jun 2018 21:00:45 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD9D51004DD8 for ; Sun, 10 Jun 2018 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5649177B66 for ; Sun, 10 Jun 2018 21:00:44 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 993ED20FDF for ; Sun, 10 Jun 2018 21:00:43 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w5AL0hTS075569 for ; Sun, 10 Jun 2018 21:00:43 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w5AL0hJK075543 for fs@FreeBSD.org; Sun, 10 Jun 2018 21:00:43 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201806102100.w5AL0hJK075543@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 10 Jun 2018 21:00:43 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jun 2018 21:00:46 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic New | 217062 | for file systems mounted with -o noexec, exec=off New | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 140068 | [smbfs] [patch] smbfs does not allow semicolon in Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS 8 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Tue Jun 12 11:34:36 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 26E5710048EE for ; Tue, 12 Jun 2018 11:34:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AC8CB7E300 for ; Tue, 12 Jun 2018 11:34:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6B8F110048EA; Tue, 12 Jun 2018 11:34:35 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A17910048E8 for ; Tue, 12 Jun 2018 11:34:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EDF167E2EB for ; Tue, 12 Jun 2018 11:34:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 216211567D for ; Tue, 12 Jun 2018 11:34:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w5CBYXAP098462 for ; Tue, 12 Jun 2018 11:34:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w5CBYX6n098461 for fs@FreeBSD.org; Tue, 12 Jun 2018 11:34:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 228750] panic on zfs mirror removal Date: Tue, 12 Jun 2018 11:34:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gjb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jun 2018 11:34:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D228750 --- Comment #1 from Glen Barber --- Can you provide dmesg(8) output, so we know what type of hardware is involv= ed? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Jun 12 13:20:55 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43F36101115C for ; Tue, 12 Jun 2018 13:20:55 +0000 (UTC) (envelope-from James@Lodge.me.uk) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0102.outbound.protection.outlook.com [104.47.1.102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7BCC682EF3 for ; Tue, 12 Jun 2018 13:20:54 +0000 (UTC) (envelope-from James@Lodge.me.uk) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gavinlodge.onmicrosoft.com; s=selector1-Lodge-me-uk; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=S88TkRefNARKSI2aT9gS4zeUvygdk3CiJABlmWMzXc4=; b=QOOS1e2B9ilTDi25iI3xf+3IwV15Lg+f2wZtQWmfVcfAm8BMsXsV/S5v7GIpA9Ir2uVxJEYQKHLYyGn+O2d4dFsrAgbZPqPOIGNPUAE1Cz7gbFGiYvwvkqahCbMWm6uVFjtLBZp13sYketkfJV4At38RxcPMB6BGZka5HwTAi7o= Received: from DB6PR0601MB2600.eurprd06.prod.outlook.com (10.168.81.145) by DB6PR0601MB2326.eurprd06.prod.outlook.com (10.169.212.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.863.16; Tue, 12 Jun 2018 13:20:52 +0000 Received: from DB6PR0601MB2600.eurprd06.prod.outlook.com ([fe80::4484:608b:3461:39df]) by DB6PR0601MB2600.eurprd06.prod.outlook.com ([fe80::4484:608b:3461:39df%6]) with mapi id 15.20.0841.019; Tue, 12 Jun 2018 13:20:52 +0000 From: James Lodge To: "freebsd-fs@freebsd.org" Subject: 11.1-RELEASE zfs zpool kernel panic blkptr at 0x806764a40 has invalid CHECKSUM 0 Thread-Topic: 11.1-RELEASE zfs zpool kernel panic blkptr at 0x806764a40 has invalid CHECKSUM 0 Thread-Index: AQHUAlAvu8IhVRaJ+EelFF7oMCGhKw== Date: Tue, 12 Jun 2018 13:20:51 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=James@Lodge.me.uk; x-originating-ip: [90.255.21.222] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB6PR0601MB2326; 7:CyZEdrlBOzcvPFSHA/K4Daqxx1LxNt//+DyIfGgfgFWv+P76EUzGy9ymenl3rcdW29CVHlV49HWrRg6Y437seGRCyv4+M6eHQZNvZd0UqdvL8k43QdurgOHJ+zYL7pWHlbQkkaMDzdaU7TD7boc7AIpMIR++k9wHk9YyCbkuxuYPaPutkwRLddh2vy0RVaxA+Um1uf+BrMnSWUbUv1cf6+EmAvpx6A+fKcgTcNQCSJvuvyH0vFAYV/sCufoah6YE x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(7021125)(5600026)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(2017052603328)(7153060)(7193020); SRVR:DB6PR0601MB2326; x-ms-traffictypediagnostic: DB6PR0601MB2326: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(21748063052155); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(10201501046)(93006095)(93001095)(3002001)(3231254)(944501410)(52105095)(149027)(150027)(6041310)(20161123560045)(20161123564045)(20161123558120)(20161123562045)(2016111802025)(6072148)(6043046)(201708071742011)(7699016); SRVR:DB6PR0601MB2326; BCL:0; PCL:0; RULEID:; SRVR:DB6PR0601MB2326; x-forefront-prvs: 07013D7479 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(346002)(376002)(39380400002)(396003)(39830400003)(366004)(189003)(199004)(106356001)(7736002)(25786009)(105586002)(68736007)(2501003)(5250100002)(80792005)(97736004)(2900100001)(6486002)(6436002)(66066001)(6916009)(5660300001)(5640700003)(3846002)(6116002)(2351001)(81156014)(53936002)(81166006)(8676002)(8936002)(82746002)(74482002)(236005)(6512007)(6306002)(54896002)(316002)(14454004)(2906002)(3280700002)(606006)(478600001)(3660700001)(99286004)(966005)(83716003)(36756003)(486006)(2616005)(476003)(186003)(26005)(6506007)(72206003)(86362001)(102836004)(33656002)(40753002); DIR:OUT; SFP:1102; SCL:1; SRVR:DB6PR0601MB2326; H:DB6PR0601MB2600.eurprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: Lodge.me.uk does not designate permitted sender hosts) x-microsoft-antispam-message-info: cITZcHpbDte91NfZ87PW0eW5c7Hx9IahXovrcO3gim0xDGZ6NhzrQFRk5379XXv4uBKtTqyRnyB7DLPFHv70JupbEMN9sw+j5UB/2f/XlEnJ16g6GOcbzh8VOiIuqg4qXz6twEL0fi0Lo/uHNAzMVU9VMrypVS95ICvhPqeAAfMNZlInCOBOzrSd4KvlpFJ1 spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 8280c006-771d-465b-89a1-08d5d0675230 X-OriginatorOrg: Lodge.me.uk X-MS-Exchange-CrossTenant-Network-Message-Id: 8280c006-771d-465b-89a1-08d5d0675230 X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Jun 2018 13:20:52.0363 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: ded56ae9-7c77-4cf6-bbfd-39e6a505742d X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0601MB2326 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jun 2018 13:20:55 -0000 RGVhciBhbGwNCg0KSeKAmW0gaW4gYSBzcG90IG9mIGJvdGhlci4gSSBoYXZlIGEgNiBkcml2ZSBS QUlELVozIHdoaWNoIHdpbGwgbm8gbG9uZ2VyIGltcG9ydCBhbmQga2VybmVsIHBhbmljcyB3aXRo IGJsa3B0ciBhdCAweDgwNjc2NGE0MCBoYXMgaW52YWxpZCBDSEVDS1NVTSAwDQoNClJ1bm5pbmcg emRiIFRBTkswMSBoYXMgdGhlIHNhbWUgcmVzdWx0cyB3aGVuIGJvb3RpbmcgaW4gdG8gc2luZ2xl IHVzZXIgbW9kZSB3aXRoIHNhZmUgYm9vdGluZy4gSWYgSSBhdHRlbXB0IGFueSB6ZnMvenBvb2wg Y29tbWFuZCB0aGUgbWFjaGluZSBrZXJuZWwgcGFuaWNzIGFuZCByZWJvb3RzLiBaREIgY29tbWFu ZCBzZWVtIHRvIHdvcmsgd2l0aG91dCBwYW5pYy4NCg0KQ2FuIHNvbWVvbmUgcGxlYXNlIHBvaW50 IGluIG1lIHRoZSByaWdodCBkaXJlY3Rpb24gdG8gZWl0aGVyIHJlc29sdmUgb3IgcmVjb3ZlciBk YXRhLiBJZiBpdCB3YXMgcG9zc2libGUgdG8gbW91bnQgcmVhZCBvbmx5LCB0aGF0IHdvdWxkIGJl IGZpbmUsIGJ1dCBhZ2FpbiwgYW55IHpwb29sIGltcG9ydCAoZXZlbiByZWFkb25seSkgcGFuaWNz LiBJIHNlZSB0aGlzIGlzc3VlIHdhcyByYWlzZWQgcHJldmlvdXNseSBoZXJlIGh0dHBzOi8vYnVn cy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjIyNzM0IGJ1dCBjbG9zZWQu DQoNClByZXZpb3VzIHRvIHRoaXMgSeKAmWQgaGFkIG5vIGlzc3VlcyB3aXRoIHRoZSBwb29sIHdo aWNoIGhhZCBiZWVuIHJ1bm5pbmcgaGFwcGlseSBmb3IgNC01IHllYXJzLCB3aXRoIHRoZSBvY2Nh c2lvbmFsICBkaXNrIHJlcGxhY2VtZW50LiBUaGlzIHBvb2wgaGFzIGFsd2F5cyBiZWVuIGluIGEg bWFjaGluZSB3aXRoIEVDQyBtZW1vcnkgYXMgaXQgaXMgbm93Lg0KDQpKdXN0IHRvIHJlaXRlcmF0 ZSB0aGUgenBvb2wgd2FzIHNob3dpbmcgbm8gaXNzdWUgb24gYW55IGRpc2tzIG9yIG9uIHNjcnVi LiBUaGUgbWFjaGluZSB3YXMgcnVubmluZyBub3JtYWxseSBhbmQgSSB3YXMgYWNjZXNzaW5nIChy ZWFkaW5nKSBhIGZpbGUgd2hlbiBpdCBwYW5pY2tlZCBhbmQgdGhlbiBmYWlsZWQgdG8gYm9vdCBk dWUgdG8gdGhlIGFib3ZlIGNoZWNrc3VtIGVycm9yLg0KDQpUaGFua3MgSmFtZXMNCg0K From owner-freebsd-fs@freebsd.org Tue Jun 12 13:41:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3F01110136DA for ; Tue, 12 Jun 2018 13:41:40 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9FFD184138 for ; Tue, 12 Jun 2018 13:41:39 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w5CDfchH094143 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Tue, 12 Jun 2018 09:41:38 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w5CDfaRG014155; Tue, 12 Jun 2018 09:41:37 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: 11.1-RELEASE zfs zpool kernel panic blkptr at 0x806764a40 has invalid CHECKSUM 0 To: James Lodge , "freebsd-fs@freebsd.org" References: From: Mike Tancsa Openpgp: preference=signencrypt Autocrypt: addr=mike@sentex.net; prefer-encrypt=mutual; keydata= xsBNBEzcA24BCACpwI/iqOrs0GfQSfhA1v6Z8AcXVeGsRyKEKUpxoOYxXWc2z3vndbYlIP6E YJeifzKhS/9E+VjhhICaepLHfw865TDTUPr5D0Ed+edSsKjlnDtb6hfNJC00P7eoiuvi85TW F/gAxRY269A5d856bYrzLbkWp2lKUR3Bg6NnORtflGzx9ZWAltZbjYjjRqegPv0EQNYcHqWo eRpXilEo1ahT6nmOU8V7yEvT2j4wlLcQ6qg7w+N/vcBvyd/weiwHU+vTQ9mT61x5/wUrQhdw 2gJHeQXeDGMJV49RT2EEz+QVxaf477eyWsdQzPVjAKRMT3BVdK8WvpYAEfBAbXmkboOxABEB AAHNHG1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5jYT7CwHgEEwECACIFAkzcA24CGwMGCwkI BwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEJXHwM2kc8rX+sMH/2V6pTBKsQ5mpWWLgs6wVP2k BC+6r/YKNXv9Rw/PrC6+9hTbgA+sSjJ+8gxsCbJsOQXZrxF0x3l9oYdYfuKcwdwXFX1/FS8p HfBeDkmlH+dI709xT9wgrR4dS5aMmKp0scPrXPIAKiYVOHjOlNItcLYTEEWEFBepheEVsgmk GrNbcrHwOx/u4igUQ8vcpyXPyUki+BsftPw8ZQvBU887igh0OxaCR8AurJppQ5UQd63r81cX E1ZjoFoWCaGK/SjPb/OhpYpu5swoZIhOxQbn7OtakYPsDd5t2A5KhvjI8BMTnd5Go+2xsCmr jlIEq8Bi29gCcfQUvNiClevi13ifmnnOwE0ETNwDbgEIALWGNJHRAhpd0A4vtd3G0oRqMBcM FGThQr3qORmEBTPPEomTdBaHcn+Xl+3YUvTBD/67/mutWBwgp2R5gQOSqcM7axvgMSHbKqBL 9sd1LsLw0UT2O5AYxv3EwzhG84pwRg3XcUqvWA4lA8tIj/1q4Jzi5qOkg1zxq4W9qr9oiYK5 bBR638JUvr3eHMaz/Nz+sDVFgwHmXZj3M6aE5Ce9reCGbvrae7H5D5PPvtT3r22X8SqfVAiO TFKedCf/6jbSOedPN931FJQYopj9P6b3m0nI3ZiCDVSqeyOAIBLzm+RBUIU3brzoxDhYR8pz CJc2sK8l6YjqivPakrD86bFDff8AEQEAAcLAXwQYAQIACQUCTNwDbgIbDAAKCRCVx8DNpHPK 1+iQB/99aqNtez9ZTBWELj269La8ntuRx6gCpzfPXfn6SDIfTItDxTh1hrdRVP5QNGGF5wus N4EMwXouskva1hbFX3Pv72csYSxxEJXjW16oV8WK4KjKXoskLg2RyRP4uXqL7Mp2ezNtVY5F 9nu3fj4ydpHCSaqKy5xd70A8D50PfZsFgkrsa5gdQhPiGGEdxhq/XSeAAnZ4uVLJKarH+mj5 MEhgZPEBWkGrbDZpezl9qbFcUem/uT9x8FYT/JIztMVh9qDcdP5tzANW5J7nvgXjska+VFGY ryZK4SPDczh74mn6GI/+RBi7OUzXXPgpPBrhS5FByjwCqjjsSpTjTds+NGIY Organization: Sentex Communications Message-ID: Date: Tue, 12 Jun 2018 09:41:37 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jun 2018 13:41:40 -0000 On 6/12/2018 9:20 AM, James Lodge wrote: > > Previous to this I’d had no issues with the pool which had been running happily for 4-5 years, with the occasional disk replacement. This pool has always been in a machine with ECC memory as it is now. > > Just to reiterate the zpool was showing no issue on any disks or on scrub. The machine was running normally and I was accessing (reading) a file when it panicked and then failed to boot due to the above checksum error. Can you try and boot from an 11.2RC USB stick and see if you can mount / import the pool that way ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-fs@freebsd.org Tue Jun 12 14:38:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3FC881019D27 for ; Tue, 12 Jun 2018 14:38:40 +0000 (UTC) (envelope-from James@Lodge.me.uk) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0726.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe02::726]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A4B788767D for ; Tue, 12 Jun 2018 14:38:39 +0000 (UTC) (envelope-from James@Lodge.me.uk) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gavinlodge.onmicrosoft.com; s=selector1-Lodge-me-uk; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZFQzOKXL+YZfn1PHVDg5FjfLxszfvkwzIS0YsfOV0FE=; b=YPV3RHSVD9SX3nh6VarzTzfUd9e0xIVT98eSmtfIfQs122uWrYcWLHVHTohUTISRmK9+b4Lt9+lpZ9VBUFFqPjYy01Jb52G/yX120hCto55E+vYuX4rz0WGsp3BJhDeB+U7gyEwHNpmDWIosoNqkYQIVqtjBK0w+68p3zi+wnAg= Received: from DB6PR0601MB2600.eurprd06.prod.outlook.com (10.168.81.145) by DB6PR0601MB2485.eurprd06.prod.outlook.com (10.169.214.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.841.14; Tue, 12 Jun 2018 14:38:37 +0000 Received: from DB6PR0601MB2600.eurprd06.prod.outlook.com ([fe80::4484:608b:3461:39df]) by DB6PR0601MB2600.eurprd06.prod.outlook.com ([fe80::4484:608b:3461:39df%6]) with mapi id 15.20.0841.019; Tue, 12 Jun 2018 14:38:37 +0000 From: James Lodge To: Mike Tancsa , "freebsd-fs@freebsd.org" Subject: Re: 11.1-RELEASE zfs zpool kernel panic blkptr at 0x806764a40 has invalid CHECKSUM 0 Thread-Topic: 11.1-RELEASE zfs zpool kernel panic blkptr at 0x806764a40 has invalid CHECKSUM 0 Thread-Index: AQHUAlAvu8IhVRaJ+EelFF7oMCGhK6RcoYuAgAAgsIA= Date: Tue, 12 Jun 2018 14:38:37 +0000 Message-ID: <69DA19A2-88E7-4CA1-9081-60D0CE1D6553@lodge.me.uk> References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=James@Lodge.me.uk; x-originating-ip: [90.255.21.222] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB6PR0601MB2485; 7:ZkIKG9fmbLq3EXyS+RIjlKN4wyet3OpFq+V3SaxZ1NuWYFuYeLswjsfR/1v1tcREAFLHfKEcjsjzYn+mtWaB6GlGZ/DY9rVGwsfyu7RJbCPvhnIZcn5bmpNLK4VE930VfxOJqEr32dicnVubLRdSFtHFIzQTRluroT0nnwATA+w/D9TNrDXThNrHH39Mf12nyCEPk1SGqIzvl5xWPBjkGI0kZEPHJpMGjhQi4MpNfIJ0EZzUGmUjpBIAwm1zhQj6 x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(7021125)(5600026)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(2017052603328)(7153060)(7193020); SRVR:DB6PR0601MB2485; x-ms-traffictypediagnostic: DB6PR0601MB2485: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3002001)(3231254)(944501410)(52105095)(10201501046)(93006095)(93001095)(149027)(150027)(6041310)(20161123564045)(20161123558120)(20161123560045)(20161123562045)(2016111802025)(6043046)(6072148)(201708071742011)(7699016); SRVR:DB6PR0601MB2485; BCL:0; PCL:0; RULEID:; SRVR:DB6PR0601MB2485; x-forefront-prvs: 07013D7479 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(396003)(346002)(39830400003)(376002)(39380400002)(189003)(199004)(7736002)(186003)(2501003)(68736007)(6486002)(2900100001)(446003)(11346002)(66066001)(476003)(53936002)(26005)(86362001)(6246003)(83716003)(6512007)(76176011)(5250100002)(229853002)(305945005)(110136005)(6506007)(478600001)(53546011)(14454004)(5660300001)(316002)(25786009)(2616005)(74482002)(8676002)(3846002)(6116002)(36756003)(106356001)(105586002)(99286004)(6436002)(80792005)(8936002)(3660700001)(3280700002)(97736004)(81166006)(81156014)(2906002)(102836004)(33656002)(15974865002)(82746002)(72206003)(486006)(40753002); DIR:OUT; SFP:1102; SCL:1; SRVR:DB6PR0601MB2485; H:DB6PR0601MB2600.eurprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: Lodge.me.uk does not designate permitted sender hosts) x-microsoft-antispam-message-info: 1F7NlCIT5xCB6sGwtLLFjd5RT/1/BpZCK18D5mu/srR1hjqdQHhE1L7sxDk9Tdip83/AMhHfO65NsML9AhxJv4Deu4F+9gxrMRIyZPaVaQizGn9BNSBj+fBeXKk4MLlW8twvx8qXPK2204/bhEf5DzifsbrCAPW+zxZR75FSHa7TtTNkK66jU55gw9qNr3Ac spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <49796E1D2E7CE843A8C2B879B956F544@eurprd06.prod.outlook.com> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 8e46962d-4aad-438e-b427-08d5d0722efd X-OriginatorOrg: Lodge.me.uk X-MS-Exchange-CrossTenant-Network-Message-Id: 8e46962d-4aad-438e-b427-08d5d0722efd X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Jun 2018 14:38:37.4559 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: ded56ae9-7c77-4cf6-bbfd-39e6a505742d X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0601MB2485 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jun 2018 14:38:40 -0000 DQoNCu+7v09uIDEyLzA2LzIwMTgsIDE0OjQxLCAiTWlrZSBUYW5jc2EiIDxtaWtlQHNlbnRleC5u ZXQ+IHdyb3RlOg0KDQogICAgDQogICAgDQogICAgT24gNi8xMi8yMDE4IDk6MjAgQU0sIEphbWVz IExvZGdlIHdyb3RlOg0KICAgID4gDQogICAgPiBQcmV2aW91cyB0byB0aGlzIEnigJlkIGhhZCBu byBpc3N1ZXMgd2l0aCB0aGUgcG9vbCB3aGljaCBoYWQgYmVlbiBydW5uaW5nIGhhcHBpbHkgZm9y IDQtNSB5ZWFycywgd2l0aCB0aGUgb2NjYXNpb25hbCAgZGlzayByZXBsYWNlbWVudC4gVGhpcyBw b29sIGhhcyBhbHdheXMgYmVlbiBpbiBhIG1hY2hpbmUgd2l0aCBFQ0MgbWVtb3J5IGFzIGl0IGlz IG5vdy4NCiAgICA+IA0KICAgID4gSnVzdCB0byByZWl0ZXJhdGUgdGhlIHpwb29sIHdhcyBzaG93 aW5nIG5vIGlzc3VlIG9uIGFueSBkaXNrcyBvciBvbiBzY3J1Yi4gVGhlIG1hY2hpbmUgd2FzIHJ1 bm5pbmcgbm9ybWFsbHkgYW5kIEkgd2FzIGFjY2Vzc2luZyAocmVhZGluZykgYSBmaWxlIHdoZW4g aXQgcGFuaWNrZWQgYW5kIHRoZW4gZmFpbGVkIHRvIGJvb3QgZHVlIHRvIHRoZSBhYm92ZSBjaGVj a3N1bSBlcnJvci4NCiAgICANCiAgICBDYW4geW91IHRyeSBhbmQgYm9vdCBmcm9tIGFuIDExLjJS QyBVU0Igc3RpY2sgYW5kIHNlZSBpZiB5b3UgY2FuIG1vdW50IC8NCiAgICBpbXBvcnQgdGhlIHBv b2wgdGhhdCB3YXkgPw0KICAgIA0KICAgIAktLS1NaWtlDQogICAgDQogICAgDQogICAgLS0gDQog ICAgLS0tLS0tLS0tLS0tLS0tLS0tLQ0KICAgIE1pa2UgVGFuY3NhLCB0ZWwgKzEgNTE5IDY1MSAz NDAwIHgyMDMNCiAgICBTZW50ZXggQ29tbXVuaWNhdGlvbnMsIG1pa2VAc2VudGV4Lm5ldA0KICAg IFByb3ZpZGluZyBJbnRlcm5ldCBzZXJ2aWNlcyBzaW5jZSAxOTk0IHd3dy5zZW50ZXgubmV0DQog ICAgQ2FtYnJpZGdlLCBPbnRhcmlvIENhbmFkYQ0KDQpTb3JyeSwgZGlkbid0IHJlcGx5IHRvIGFs bC4uLi4NCg0KVW5mb3J0dW5hdGVseSBzYW1lIHJlc3VsdHMgd2l0aCAxMS4yUkMsIHdoaWNoIHdv dWxkIHN1Z2dlc3QgYW4gaXNzdWUgd2l0aCB0aGUgcG9vbC4gRG9pbmcgenBvb2wgaW1wb3J0IGRv ZXMgaG93ZXZlciBzaG93IGFsbCA2IGRpc2sgaW4gdGhlIFJBSUQtWjIgYXMgb25saW5lLiBJIGFz c3VtZSBzb21lIGtpbmQgb2YgbWV0YWRhdGEgY29ycnVwdGlvbi4gSSdtIG5vdCBzdXJlIHdoYXQg Y291cnNlIG9mIGFjdGlvbiBJIGNvdWxkIHRha2Ugd2l0aG91dCB6cG9vbC96ZnMgY29tbWFuZC4N Cg0KSmFtZXNVbmZvcnR1bmF0ZWx5IHNhbWUgcmVzdWx0cyB3aXRoIDExLjJSQywgd2hpY2ggd291 bGQgc3VnZ2VzdCBhbiBpc3N1ZSB3aXRoIHRoZSBwb29sLiBEb2luZyB6cG9vbCBpbXBvcnQgZG9l cyBob3dldmVyIHNob3cgYWxsIDYgZGlzayBpbiB0aGUgUkFJRC1aMiBhcyBvbmxpbmUuIEkgYXNz dW1lIHNvbWUga2luZCBvZiBtZXRhZGF0YSBjb3JydXB0aW9uLiBJJ20gbm90IHN1cmUgd2hhdCBj b3Vyc2Ugb2YgYWN0aW9uIEkgY291bGQgdGFrZSB3aXRob3V0IHpwb29sL3pmcyBjb21tYW5kLg0K DQpKYW1lcw0KICAgIA0KDQo= From owner-freebsd-fs@freebsd.org Tue Jun 12 17:28:56 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 83F86100A60B for ; Tue, 12 Jun 2018 17:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 1926C70099 for ; Tue, 12 Jun 2018 17:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C4378100A60A; Tue, 12 Jun 2018 17:28:55 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B287F100A609 for ; Tue, 12 Jun 2018 17:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 50E7770088 for ; Tue, 12 Jun 2018 17:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7CEC818811 for ; Tue, 12 Jun 2018 17:28:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w5CHSsgv007309 for ; Tue, 12 Jun 2018 17:28:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w5CHSso1007308 for fs@FreeBSD.org; Tue, 12 Jun 2018 17:28:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 228750] panic on zfs mirror removal Date: Tue, 12 Jun 2018 17:28:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: panic X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gjb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jun 2018 17:28:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D228750 --- Comment #2 from Glen Barber --- FYI, this is an issue on 12-CURRENT as well. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Jun 13 20:09:34 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91577100F2E2 for ; Wed, 13 Jun 2018 20:09:34 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from mx-p1.obspm.fr (mx-p1.obspm.fr [145.238.193.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "*.obspm.fr", Issuer "TERENA SSL CA 3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0665F77DFF for ; Wed, 13 Jun 2018 20:09:33 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from io.chezmoi.fr (vpn.obspm.fr [145.238.186.39]) (authenticated bits=0) by mx-p1.obspm.fr (8.14.4/8.14.4/DIO Observatoire de Paris - 15/04/10) with ESMTP id w5DK6goG246074 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 13 Jun 2018 22:06:45 +0200 Date: Wed, 13 Jun 2018 22:07:00 +0200 From: Albert Shih To: freebsd-fs@freebsd.org Subject: What append when arc full Message-ID: <20180613200700.GA3156@io.chezmoi.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: Mutt/1.10.0 (2018-05-17) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.5.11 (mx-p1.obspm.fr [145.238.193.20]); Wed, 13 Jun 2018 22:06:45 +0200 (CEST) X-Virus-Scanned: clamav-milter 0.99.3 at mx-p1.obspm.fr X-Virus-Status: Clean X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jun 2018 20:09:34 -0000 Hi everyone On one of my server I need to reserve some ram to the application. So I would like to know what's happend when the ARC are full. Regards -- Albert SHIH DIO bâtiment 15 Observatoire de Paris xmpp: jas@obspm.fr Heure local/Local time: Wed Jun 13 21:56:23 CEST 2018 From owner-freebsd-fs@freebsd.org Thu Jun 14 03:41:19 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45980101A558 for ; Thu, 14 Jun 2018 03:41:19 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by mx1.freebsd.org (Postfix) with ESMTP id 7A3486F955 for ; Thu, 14 Jun 2018 03:41:18 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from 220-253-34-10.dyn.iinet.net.au (HELO leader.local) ([220.253.34.10]) by ipmail06.adl2.internode.on.net with ESMTP; 14 Jun 2018 13:06:09 +0930 Subject: Re: What append when arc full To: Albert Shih , freebsd-fs@freebsd.org References: <20180613200700.GA3156@io.chezmoi.fr> From: Shane Ambler Message-ID: <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> Date: Thu, 14 Jun 2018 13:06:07 +0930 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <20180613200700.GA3156@io.chezmoi.fr> Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 03:41:19 -0000 On 14/06/2018 05:37, Albert Shih wrote: > Hi everyone > > > On one of my server I need to reserve some ram to the application. > > So I would like to know what's happend when the ARC are full. ARC is a cache and it will use any unused ram that it can. When a process makes a memory request some of the ARC can be released to satisfy the request. This can add a delay to a process starting, which is not always desirable. If you want to keep some ram free for your processes, then you can set vfs.zfs.arc_max to limit the ram used by ARC. On recent system versions you can change it dynamically using sysctl or you can set it in /boot/loader.conf to set it at startup, it accepts human units so you can use vfs.zfs.arc_max=25G -- FreeBSD - the place to B...Storing Data Shane Ambler From owner-freebsd-fs@freebsd.org Thu Jun 14 05:43:19 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B4DFC10017E1 for ; Thu, 14 Jun 2018 05:43:19 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from mx-p1.obspm.fr (mx-p1.obspm.fr [145.238.193.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "*.obspm.fr", Issuer "TERENA SSL CA 3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 589FE7446B for ; Thu, 14 Jun 2018 05:43:19 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from io.chezmoi.fr (vpn.obspm.fr [145.238.186.39]) (authenticated bits=0) by mx-p1.obspm.fr (8.14.4/8.14.4/DIO Observatoire de Paris - 15/04/10) with ESMTP id w5E5hFHY179344 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 14 Jun 2018 07:43:17 +0200 Date: Thu, 14 Jun 2018 07:43:33 +0200 From: Albert Shih To: Shane Ambler Cc: freebsd-fs@freebsd.org Subject: Re: What append when arc full Message-ID: <20180614054333.GA7053@io.chezmoi.fr> References: <20180613200700.GA3156@io.chezmoi.fr> <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> User-Agent: Mutt/1.10.0 (2018-05-17) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.5.11 (mx-p1.obspm.fr [145.238.193.20]); Thu, 14 Jun 2018 07:43:17 +0200 (CEST) X-Virus-Scanned: clamav-milter 0.99.3 at mx-p1.obspm.fr X-Virus-Status: Clean X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 05:43:19 -0000 Le 14/06/2018 à 13:06:07+0930, Shane Ambler a écrit > On 14/06/2018 05:37, Albert Shih wrote: > > > > > > On one of my server I need to reserve some ram to the application. > > > > So I would like to know what's happend when the ARC are full. > > ARC is a cache and it will use any unused ram that it can. When a > process makes a memory request some of the ARC can be released to > satisfy the request. This can add a delay to a process starting, which > is not always desirable. Ok. Because in my case it's not just a delay. Here my problem (I know I should start here), I'm planing to change my current imap server (for 2000 users) to a new one running FreeBSD 11 + Cyrus Imap. So I got a server with 192Go of Ram, 2 SSD, 28 mechanicals disks for email, and 2 mechanicals disks for the host system boot. The imap server run inside a jail on the host, the imap server root FS is a zpool with two ssd, and the data are on a zpool with 4 vdev (7 disks each). The perf are good, and everything seem working fine, but I just find out I can't use zfs send/recv. When I try to send (recv are OK) a snapshot (especially with a large one) after 1-5 minutes from the moment I start the sending the host become extremely slow, the "zfs list" command hang, and my jail cannot be join. To be honest the server (both) don't crash, but I can't let the imap server hang during long time (it are in pre-production) event I think after the sending everything will be fine. I try last night, if I put vfs.zfs.arc_max=96G everything work fine (the sending). So I think that's the point. But my concern are what append if I shrink a little more the arc_max, let's say 64G knowing I got < 30To of data. Does I'm going to loose lot of performance ? > > If you want to keep some ram free for your processes, then you can set > vfs.zfs.arc_max to limit the ram used by ARC. On recent system versions > you can change it dynamically using sysctl or you can set it in "dynamically" .... I though it's only can set at boot time, at least it's what https://www.freebsd.org/doc/handbook/zfs-advanced.html say... > /boot/loader.conf to set it at startup, it accepts human units so you > can use vfs.zfs.arc_max=25G Lots of thanks for your help. Regards -- Albert SHIH Observatoire de Paris France xmpp: jas@obspm.fr Heure local/Local time: Thu Jun 14 07:29:32 CEST 2018 From owner-freebsd-fs@freebsd.org Thu Jun 14 06:28:23 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9E050100579F for ; Thu, 14 Jun 2018 06:28:23 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wr0-x230.google.com (mail-wr0-x230.google.com [IPv6:2a00:1450:400c:c0c::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0C18F76DCE for ; Thu, 14 Jun 2018 06:28:23 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wr0-x230.google.com with SMTP id a12-v6so5081087wro.1 for ; Wed, 13 Jun 2018 23:28:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=I1c9yciTg+yk7jA8C6UNfGpN57tIqLXVdGl3CqeunUM=; b=ZZgen8B/HdU/MH/W59jvF69JfeRMtpfuwcZElaEIall7p6MWVA6PTEMQ4NDHrgFcnA ZVYnlIXR0COQBxcipbT/eOMBNHo8is9O4ERhG1FZ6ubxOJbPt5xDOu9fevQGm+wu0qvQ Ia9Hzls0xHYF0GIwXEGjmEK1Eh9I9rJWpRbL7n/vahHino12GWqjgPYr1+Id8dOsxng7 m4jLsBX6MNljUS9Rzf9qTe6F8Uk2XuvTNTmyAIANCZI8G4Y2J3gWIrTQlhYIQvfdl3Pq Uc0YHqy1yB6QuuZGa3nZvDTCqipzY15a29kdPAb6GcLvid+QuYKguXXKz63hAH3rcjLN zURA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=I1c9yciTg+yk7jA8C6UNfGpN57tIqLXVdGl3CqeunUM=; b=s179UvjYf4KyvdP0A9gegrY+j2OlKsxai8FmeSPY04HMeDKOE69NdXL7qz1YrwpBPa Mp51XdFb0IQ77kBOMCvMs0kDbVpH+QCVZ6Hy22OnRdgz//MeeYakHKk/k090BZs4WwJY Xql9aGg4251BTlpm41C3rs+ndDXqELyJaLEwhrHSvYUj2CB+Dje2iwPL9g5VXk25dwNv QSnSTudhjIZf3DQfSiB1MtexvAvhvv03T1wjtH3zPx+QYLkdULhaqM2Dp5mkYiaXeZu0 Ai8+0I8oke8LVvW2zDYBJUdM9QJKDE2qbejgYc9W1V20cxanUIT0L9UDcflsQrRNXbT+ BJqQ== X-Gm-Message-State: APt69E2cFrweB6C+qZuqx5Vgnuf3Bb+O5tbVDvadpZd0aOeE64oJG+nw q/Hos8IYNxOrtje29vmJTbjOOD4z X-Google-Smtp-Source: ADUXVKKa6WDA9rbyDJunrcvPg/+Dg042pfEiLZythi7pTsUYLsC/FqlZXK3QJZrxqH+/Zx/RMwZV9Q== X-Received: by 2002:adf:a686:: with SMTP id t6-v6mr899262wrc.51.1528957700919; Wed, 13 Jun 2018 23:28:20 -0700 (PDT) Received: from bens-mac.home (LFbn-NIC-1-162-72.w2-15.abo.wanadoo.fr. [2.15.243.72]) by smtp.gmail.com with ESMTPSA id b204-v6sm4732164wmh.22.2018.06.13.23.28.19 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 13 Jun 2018 23:28:20 -0700 (PDT) Content-Type: text/plain; charset=iso-8859-1; delsp=yes; format=flowed Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: What append when arc full From: Ben RUBSON In-Reply-To: <20180614054333.GA7053@io.chezmoi.fr> Date: Thu, 14 Jun 2018 08:28:18 +0200 Content-Transfer-Encoding: 7bit Message-Id: <842D180A-4725-418D-8EF8-639B50C8B72D@gmail.com> References: <20180613200700.GA3156@io.chezmoi.fr> <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> <20180614054333.GA7053@io.chezmoi.fr> To: Tom Evans via freebsd-fs X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 06:28:23 -0000 On 14 Jun 2018 07:43, Albert Shih wrote: > I try last night, if I put > > vfs.zfs.arc_max=96G > > everything work fine (the sending). So I think that's the point. > > But my concern are what append if I shrink a little more the arc_max, let's > say 64G knowing I got < 30To of data. Does I'm going to loose lot of > performance ? The least recently used buffers of (meta)data (the colder ones) will be evicted to make room for the new needed (meta)data buffers. ZFS has a "constantly" background job running to keep ARC size under the limit. Performance will of course depend on the amount of hot (meta)data you play with. Perhaps you could benefit from setting a L2ARC with your 2 SSDs. Evicted buffers would then be stored there for faster access when needed. >> If you want to keep some ram free for your processes, then you can set >> vfs.zfs.arc_max to limit the ram used by ARC. On recent system versions >> you can change it dynamically using sysctl or you can set it in > > "dynamically" .... I though it's only can set at boot time I also have it in /etc/sysctl.conf on 11.0 systems, I think it was also the case with 10.3. Ben From owner-freebsd-fs@freebsd.org Thu Jun 14 07:01:47 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 70D8F1008965 for ; Thu, 14 Jun 2018 07:01:47 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vtr.rulingia.com (vtr.rulingia.com [IPv6:2001:19f0:5801:ebe:5400:1ff:fe53:30fd]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vtr.rulingia.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9488378A42 for ; Thu, 14 Jun 2018 07:01:46 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from server.rulingia.com (ppp59-167-167-3.static.internode.on.net [59.167.167.3]) by vtr.rulingia.com (8.15.2/8.15.2) with ESMTPS id w5E71Yar017067 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 14 Jun 2018 17:01:40 +1000 (AEST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.15.2/8.15.2) with ESMTPS id w5E71Thd053419 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 14 Jun 2018 17:01:29 +1000 (AEST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.15.2/8.15.2/Submit) id w5E71Tff053418; Thu, 14 Jun 2018 17:01:29 +1000 (AEST) (envelope-from peter) Date: Thu, 14 Jun 2018 17:01:29 +1000 From: Peter Jeremy To: Albert Shih Cc: freebsd-fs@freebsd.org Subject: Re: What append when arc full Message-ID: <20180614070129.GE88895@server.rulingia.com> References: <20180613200700.GA3156@io.chezmoi.fr> <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> <20180614054333.GA7053@io.chezmoi.fr> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="1UWUbFP1cBYEclgG" Content-Disposition: inline In-Reply-To: <20180614054333.GA7053@io.chezmoi.fr> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.9.5 (2018-04-13) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 07:01:47 -0000 --1UWUbFP1cBYEclgG Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2018-Jun-14 07:43:33 +0200, Albert Shih wrote: >But my concern are what append if I shrink a little more the arc_max, let's >say 64G knowing I got < 30To of data. Does I'm going to loose lot of >performance ? This really depends on your workload and the disk access pattern. I suggest you install sysutils/zfs-stats and look at the various ARC hit/miss rates once your system has stabilised. You might find that tuning vfs.zfs.arc_meta_limit can also help - by default, it's 1/4 of ARC but in my experience, metadata misses are more expensive so increasing that can help. --=20 Peter Jeremy --1UWUbFP1cBYEclgG Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAlsiEsRfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzRJ7Q//Uwc3NmYksOaFmDr9Pr7qjXY6LtmqFacIHsrQ1X7M3x873l1g10O0l1jR TTgO7ZQi+8h9KvKLpCQSZLp8ez6Nd1QX/Bx+t1Yq2lFMfOJLvk8VyfKcTtUteLjn wVHRtgBDxSezcAbyGPTVrjqHp89K9LDQu3dhw5SDU1KmFIZxOt9t4fOUMfE/o1cK qL/+D1skBY7DFABwMqL+w7HINYQDTPp3HWduBI5tsJ5NtuJrL1BRA3A6G1wT8zl4 kZCmtbyr5avEfBqaTbAqU7hs7hC9XbHgtsM0x0a0kB28I8JasA+9vC37Qu68myWD O7kSxN7UfjRQUcqmKJjeseGSVzerYsOWyF8+Tf/59Y4Rc/ULBTwzjPHl2X+aL3ca OyBb0eexwSBox9KbroBdZQHd1FvLbhqIsmIiSlINjZAuIlkidVvYuTCYq2H6d4z1 72qRn0vj89wSI2YHJkDKXwrkDNkId4rsJSFWhLhuIyrUt6Y0PIwyLOszio6hxHHA h6cBoWNeNTFlBDIiC6nHK+y4e2xN6c4pcCiXaEV2yQfA7sar6cPtmjVikTH8IuNU PEjhNAmdpLHmaw1pwzOPtFechoIGkHxaFpbgS7DUcji6RwavB22mzoBCh9qOxgt0 +uWXTU9vYBOpsH1PSvfTwMTdb64KKjyMGG83Yx+PXFaux3OCIKY= =lubT -----END PGP SIGNATURE----- --1UWUbFP1cBYEclgG-- From owner-freebsd-fs@freebsd.org Thu Jun 14 17:54:31 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 944151018430 for ; Thu, 14 Jun 2018 17:54:31 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from mx-p1.obspm.fr (mx-p1.obspm.fr [145.238.193.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "*.obspm.fr", Issuer "TERENA SSL CA 3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 26F4178049 for ; Thu, 14 Jun 2018 17:54:30 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from io.chezmoi.fr (vpn.obspm.fr [145.238.186.39]) (authenticated bits=0) by mx-p1.obspm.fr (8.14.4/8.14.4/DIO Observatoire de Paris - 15/04/10) with ESMTP id w5EHsR4B157214 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 14 Jun 2018 19:54:29 +0200 Date: Thu, 14 Jun 2018 19:54:45 +0200 From: Albert Shih To: freebsd-fs@freebsd.org Subject: ZFS send problem Message-ID: <20180614175445.GA1781@io.chezmoi.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: Mutt/1.10.0 (2018-05-17) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.5.11 (mx-p1.obspm.fr [145.238.193.20]); Thu, 14 Jun 2018 19:54:29 +0200 (CEST) X-Virus-Scanned: clamav-milter 0.99.3 at mx-p1.obspm.fr X-Virus-Status: Clean X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 17:54:31 -0000 Hi, I still got a very serious problem with zfs send (not recv). After I take a snapshot and try to send it, the server begin to send the snapshot (I can see on the target the incomming data) and after sometime (5=10m) on the server the zfs command freeze, I can launch zpool command either. I check arc size, and if I let the max amount of memory to the vfs.zfs.arc_max (~ Max RAM ~ 192Go) the zfs command freeze simultaneously with the arc reach 100.3% of the max (but I cannot make lots of test, so I'm not sure it's related). If I set le vfs.zfs.arc_max at half of the RAM ( = 96Go) I can see thought zfs-stats the arc come to 100.3% and empty to 98-99% and raise again. Either way the zfs command not really freeze totally but take lot of time to answer (~10-20 seconds when normally it's < 1sec). The only « special » configuration (vs my other server doing same thing without problem) is I got two zpool on this one. I've no idea if that can be a problem (one with 2 ssd, the other with 4 vdev of 7 disks) I check dmesg, /var/log/all.log and don't find any information or error message. Any idea ? Regards. -- Albert SHIH DIO bâtiment 15 Observatoire de Paris xmpp: jas@obspm.fr Heure local/Local time: Thu Jun 14 19:46:04 CEST 2018 From owner-freebsd-fs@freebsd.org Thu Jun 14 20:09:08 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7241E102283B for ; Thu, 14 Jun 2018 20:09:08 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E32797EA1E for ; Thu, 14 Jun 2018 20:09:07 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w5EK96PY053615 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Thu, 14 Jun 2018 16:09:07 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w5EK94E5029334; Thu, 14 Jun 2018 16:09:04 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: ZFS send problem To: Albert Shih , freebsd-fs@freebsd.org References: <20180614175445.GA1781@io.chezmoi.fr> From: Mike Tancsa Openpgp: preference=signencrypt Autocrypt: addr=mike@sentex.net; prefer-encrypt=mutual; keydata= xsBNBEzcA24BCACpwI/iqOrs0GfQSfhA1v6Z8AcXVeGsRyKEKUpxoOYxXWc2z3vndbYlIP6E YJeifzKhS/9E+VjhhICaepLHfw865TDTUPr5D0Ed+edSsKjlnDtb6hfNJC00P7eoiuvi85TW F/gAxRY269A5d856bYrzLbkWp2lKUR3Bg6NnORtflGzx9ZWAltZbjYjjRqegPv0EQNYcHqWo eRpXilEo1ahT6nmOU8V7yEvT2j4wlLcQ6qg7w+N/vcBvyd/weiwHU+vTQ9mT61x5/wUrQhdw 2gJHeQXeDGMJV49RT2EEz+QVxaf477eyWsdQzPVjAKRMT3BVdK8WvpYAEfBAbXmkboOxABEB AAHNHG1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5jYT7CwHgEEwECACIFAkzcA24CGwMGCwkI BwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEJXHwM2kc8rX+sMH/2V6pTBKsQ5mpWWLgs6wVP2k BC+6r/YKNXv9Rw/PrC6+9hTbgA+sSjJ+8gxsCbJsOQXZrxF0x3l9oYdYfuKcwdwXFX1/FS8p HfBeDkmlH+dI709xT9wgrR4dS5aMmKp0scPrXPIAKiYVOHjOlNItcLYTEEWEFBepheEVsgmk GrNbcrHwOx/u4igUQ8vcpyXPyUki+BsftPw8ZQvBU887igh0OxaCR8AurJppQ5UQd63r81cX E1ZjoFoWCaGK/SjPb/OhpYpu5swoZIhOxQbn7OtakYPsDd5t2A5KhvjI8BMTnd5Go+2xsCmr jlIEq8Bi29gCcfQUvNiClevi13ifmnnOwE0ETNwDbgEIALWGNJHRAhpd0A4vtd3G0oRqMBcM FGThQr3qORmEBTPPEomTdBaHcn+Xl+3YUvTBD/67/mutWBwgp2R5gQOSqcM7axvgMSHbKqBL 9sd1LsLw0UT2O5AYxv3EwzhG84pwRg3XcUqvWA4lA8tIj/1q4Jzi5qOkg1zxq4W9qr9oiYK5 bBR638JUvr3eHMaz/Nz+sDVFgwHmXZj3M6aE5Ce9reCGbvrae7H5D5PPvtT3r22X8SqfVAiO TFKedCf/6jbSOedPN931FJQYopj9P6b3m0nI3ZiCDVSqeyOAIBLzm+RBUIU3brzoxDhYR8pz CJc2sK8l6YjqivPakrD86bFDff8AEQEAAcLAXwQYAQIACQUCTNwDbgIbDAAKCRCVx8DNpHPK 1+iQB/99aqNtez9ZTBWELj269La8ntuRx6gCpzfPXfn6SDIfTItDxTh1hrdRVP5QNGGF5wus N4EMwXouskva1hbFX3Pv72csYSxxEJXjW16oV8WK4KjKXoskLg2RyRP4uXqL7Mp2ezNtVY5F 9nu3fj4ydpHCSaqKy5xd70A8D50PfZsFgkrsa5gdQhPiGGEdxhq/XSeAAnZ4uVLJKarH+mj5 MEhgZPEBWkGrbDZpezl9qbFcUem/uT9x8FYT/JIztMVh9qDcdP5tzANW5J7nvgXjska+VFGY ryZK4SPDczh74mn6GI/+RBi7OUzXXPgpPBrhS5FByjwCqjjsSpTjTds+NGIY Organization: Sentex Communications Message-ID: <5428a0a5-1bbf-80e5-16b2-992b10b0a20c@sentex.net> Date: Thu, 14 Jun 2018 16:09:05 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <20180614175445.GA1781@io.chezmoi.fr> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 20:09:08 -0000 On 6/14/2018 1:54 PM, Albert Shih wrote: > Hi, > > I still got a very serious problem with zfs send (not recv). > > If I set le vfs.zfs.arc_max at half of the RAM ( = 96Go) I can see thought > zfs-stats the arc come to 100.3% and empty to 98-99% and raise again. > Either way the zfs command not really freeze totally but take lot of time > to answer (~10-20 seconds when normally it's < 1sec). What version of FreeBSD are you running ? Also, have you tried doing a scrub on the pool to make sure there are no errors ? I take it zpool status shows all is ok ? Is this a straight up send or incremental ? Is it recursive or just part of the pool ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-fs@freebsd.org Thu Jun 14 20:25:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76AFE10013A0 for ; Thu, 14 Jun 2018 20:25:03 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from mx-p1.obspm.fr (mx-p1.obspm.fr [145.238.193.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "*.obspm.fr", Issuer "TERENA SSL CA 3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 08CC680001 for ; Thu, 14 Jun 2018 20:25:02 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from io.chezmoi.fr (vpn.obspm.fr [145.238.186.39]) (authenticated bits=0) by mx-p1.obspm.fr (8.14.4/8.14.4/DIO Observatoire de Paris - 15/04/10) with ESMTP id w5EKOqPZ045641 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 14 Jun 2018 22:24:55 +0200 Date: Thu, 14 Jun 2018 22:25:11 +0200 From: Albert Shih To: Mike Tancsa Cc: freebsd-fs@freebsd.org Subject: Re: ZFS send problem Message-ID: <20180614202511.GA2636@io.chezmoi.fr> References: <20180614175445.GA1781@io.chezmoi.fr> <5428a0a5-1bbf-80e5-16b2-992b10b0a20c@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <5428a0a5-1bbf-80e5-16b2-992b10b0a20c@sentex.net> User-Agent: Mutt/1.10.0 (2018-05-17) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.5.11 (mx-p1.obspm.fr [145.238.193.20]); Thu, 14 Jun 2018 22:24:55 +0200 (CEST) X-Virus-Scanned: clamav-milter 0.99.3 at mx-p1.obspm.fr X-Virus-Status: Clean X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2018 20:25:03 -0000 Le 14/06/2018 à 16:09:05-0400, Mike Tancsa a écrit > On 6/14/2018 1:54 PM, Albert Shih wrote: > > Hi, > > > > I still got a very serious problem with zfs send (not recv). > > > > If I set le vfs.zfs.arc_max at half of the RAM ( = 96Go) I can see thought > > zfs-stats the arc come to 100.3% and empty to 98-99% and raise again. > > Either way the zfs command not really freeze totally but take lot of time > > to answer (~10-20 seconds when normally it's < 1sec). > > What version of FreeBSD are you running ? Also, have you tried doing a FreeBSD 11.1-p10 (last one). > scrub on the pool to make sure there are no errors ? I take it zpool I do that now. > status shows all is ok ? Yes. > > Is this a straight up send or incremental ? Is it recursive or just part > of the pool ? Not sure because the problem is erratic but It seem I got much more problem with the straight up send, the incremental seem to work a little better. Knowing I don't get a big incremental (~100Mo-few Go). Thanks for your help. Regards. -- Albert SHIH DIO bâtiment 15 Observatoire de Paris xmpp: jas@obspm.fr Heure local/Local time: Thu Jun 14 22:22:29 CEST 2018 From owner-freebsd-fs@freebsd.org Fri Jun 15 04:18:17 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3C96F101398D for ; Fri, 15 Jun 2018 04:18:17 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from ipmail01.adl6.internode.on.net (ipmail01.adl6.internode.on.net [150.101.137.136]) by mx1.freebsd.org (Postfix) with ESMTP id 72B1E7640C for ; Fri, 15 Jun 2018 04:18:16 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from ppp121-45-90-218.bras1.adl6.internode.on.net (HELO leader.local) ([121.45.90.218]) by ipmail01.adl6.internode.on.net with ESMTP; 15 Jun 2018 13:43:04 +0930 Subject: Re: What append when arc full To: Albert Shih Cc: freebsd-fs@freebsd.org References: <20180613200700.GA3156@io.chezmoi.fr> <248ad0be-2002-89b5-0c1a-3ac73d493149@ShaneWare.Biz> <20180614054333.GA7053@io.chezmoi.fr> From: Shane Ambler Message-ID: <8311a9a9-1a14-3520-aea3-8078e99713b9@ShaneWare.Biz> Date: Fri, 15 Jun 2018 13:43:02 +0930 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <20180614054333.GA7053@io.chezmoi.fr> Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Jun 2018 04:18:17 -0000 On 14/06/2018 15:13, Albert Shih wrote: > Le 14/06/2018 à 13:06:07+0930, Shane Ambler a écrit >> If you want to keep some ram free for your processes, then you can set >> vfs.zfs.arc_max to limit the ram used by ARC. On recent system versions >> you can change it dynamically using sysctl or you can set it in > > "dynamically" .... I though it's only can set at boot time, at least it's > what > > https://www.freebsd.org/doc/handbook/zfs-advanced.html It seems the handbook has dropped behind. The ability to change arc_max and arc_min at runtime was merged into stable/10 and stable/11 almost two years ago, that means 10.4 and 11.x can do it but 10.3 or older will have to be set in /boot/loader.conf -- FreeBSD - the place to B...Storing Data Shane Ambler From owner-freebsd-fs@freebsd.org Sat Jun 16 01:04:07 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D58371023626 for ; Sat, 16 Jun 2018 01:04:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 72B7B6B469 for ; Sat, 16 Jun 2018 01:04:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 37CFA1023624; Sat, 16 Jun 2018 01:04:07 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 268B11023623 for ; Sat, 16 Jun 2018 01:04:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC4016B468 for ; Sat, 16 Jun 2018 01:04:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 16678223F7 for ; Sat, 16 Jun 2018 01:04:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w5G145IQ068869 for ; Sat, 16 Jun 2018 01:04:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w5G1456K068868 for fs@FreeBSD.org; Sat, 16 Jun 2018 01:04:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229007] [zfs] kernel crashes on remove disk Date: Sat, 16 Jun 2018 01:04:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Jun 2018 01:04:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229007 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.=