From owner-freebsd-fs@freebsd.org Sun Nov 4 07:58:35 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 335CD10F7B40 for ; Sun, 4 Nov 2018 07:58:35 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 3C5BB7E2FF; Sun, 4 Nov 2018 07:58:34 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (c-73-225-95-163.hsd1.wa.comcast.net [73.225.95.163]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id wA47wV9W018926 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Sun, 4 Nov 2018 00:58:32 -0700 (PDT) (envelope-from julian@freebsd.org) Subject: Re: How to fill in the fsid for file systems? To: Rick Macklem , Andriy Gapon , Konstantin Belousov Cc: FreeBSD Filesystems References: <20181030012240.GM5335@kib.kiev.ua> From: Julian Elischer Message-ID: Date: Sun, 4 Nov 2018 00:58:26 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 3C5BB7E2FF X-Spamd-Result: default: False [0.07 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[163.95.225.73.zen.spamhaus.org : 127.0.0.10]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-0.81)[-0.806,0]; IP_SCORE(-0.01)[country: US(-0.06)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:36236, ipnet:204.109.60.0/22, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 07:58:35 -0000 On 1/11/18 7:24 pm, Rick Macklem wrote: > Andriy Gapon wrote >> On 31/10/2018 17:50, Rick Macklem wrote: >>> I alluded to this option in my last post. I think both fsids will need to be in the >>> mount structure, since finding the correct mount point via the fsid is the first >>> step in translating a file handle to a vnode. (After that VFS_FHTOVP() does the rest.) >>> >>> And I think it will get messy. A couple of examples. >>> There are some syscalls that use file handles. fhopen(2), fhstat(2), fhstatfs(2), >>> getfh(2), lgetfh(2) >>> I had assumed that the "file handles" used by these should be the same file >>> handles that NFS uses (ie. file handles are a generic VFS component and not NFS >>> specific) but I can see the argument either way. I actually don't know what >>> apps/utilities use fhopen/fhstat/fhstatfs, but getfh(2) is used by mountd. >>> Since mountd uses getfh(2) to get a file handle for NFS mounts, it needs to >>> return the NFS fsid to keep the old binaries working, even if you add a >>> new getnfsfh(2) function for mountd to use. >>> - Now you have some file handle system calls using file handles with the NFS >>> fsid in them and some using file handles with the "true" fsid in them. >>> (Sounds confusing to me.) >>> >>> Since the first step in turning a file handle into a vnode is looking up the fsid >>> in the mount list, if you had two fsids, I think they both would end up in the >>> mount structure so that lookup could be done easily. >>> This lookup is normally done by vfs_busyfs() { that appears to be the only use >>> of vfs_busyfs() in sys/kern. I haven't looked in the various file systems }. >>> With two fsids, you need two functions and need to be careful which one you use. >> I originally thought about having a separate filesystem list for NFS that would >> contain only exported filesystems. But I suspect that managing it could be >> problematic. >> >> An alternative idea is to use osd(9) framework to attach NFS specific data to >> struct mount without modifying the structure and without exposing the NFS data >> to other consumers. > I have two comments. The first is related to the above and the second is a big > picture question related to doing this. > > Specifically w.r.t. the above. I probably rambled and didn't make what I was > trying to say clear, so I'll try again... > - getfh(2) returns a file handle that is used for NFS, but is also used for system > calls (fhopen(2), fhstat(2) and fhstatfs(2)) that are not related to NFS. > --> A file handle isn't really NFS specific, although NFS is the big user of it. > If the above is correct, then it seems that there should only be one kind of file handle. > --> Since the fsid is a key part of a file handle, one kind of file handle implies one > kind of fsid. > I just think trying to create two kinds of fsid and two kinds of file handle would > make the code confusing and unnecessarily complex. > > On the big picture..the more I look at this, the less obvious the usage of setting > an fsid other than what the file system sets seems to become. I thought the usage > of this was to ensure that when a file system was moved (just moving the storage > hardware or a block by block cloning) to a different system, the same fsid would > be used so that file handles wouldn't change. Note that a file handle also has > a fileid number (think I-node#) in it, so the file system "move" can't change the > file system's structure. > - UFS keeps the fsid in the superblock, so moving the file system should retain > the same fsid value. (There might be an obscure case of another file system > having the same fsid, so it has to change. However, since newfs(8) uses the > creation time and a random# to create it, a conflict seems highly unlikely.) > - This leaves ZFS. I know nothing about ZFS, but a glance at the code seems > to indicate it normally comes out of the "physical dataset" field ds_fsid_guid. > --> Does this mean it changes when "moved" or stays the same, like UFS? > If the answer is "stays the same", I don't see that being able to manually set > the fsid is useful? > (There are file systems like cd9660 and msdosfs where the fsid will change, > but I don't see those used a storage for NFS servers where they might be > moved/cloned/…) > > Maybe someone can explain when it would be useful for FFS (or not)? SO lets' just make the usage model clear: I believe that what Josh needs is to have a  two High availability servers viewing a single (cloud based) filesystem, export the same FSID so that when one takes over for the other the clients don't notice. The second usage is that over a reboot an NFS client may not notice (if there were no transactions while the system was down). Even if for some reason the file systems came up in a different order.. > > rick > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > From owner-freebsd-fs@freebsd.org Sun Nov 4 08:04:36 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A71D10F803A for ; Sun, 4 Nov 2018 08:04:36 +0000 (UTC) (envelope-from SRS0=FBvO=NP=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 61A4F7E785; Sun, 4 Nov 2018 08:04:35 +0000 (UTC) (envelope-from SRS0=FBvO=NP=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 934DD2840C; Sun, 4 Nov 2018 09:04:33 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 4A79F28417; Sun, 4 Nov 2018 09:04:21 +0100 (CET) Subject: Re: zpool scrub 9TB finishes in ~40 mins From: Miroslav Lachman <000.fbsd@quip.cz> To: Mariusz Zaborski Cc: freebsd-fs@freebsd.org References: <5BDC3DF5.9020501@andyit.com.au> <20181102133254.GA35599@jarvis> Message-ID: Date: Sun, 4 Nov 2018 09:04:20 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 61A4F7E785 X-Spamd-Result: default: False [3.48 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FORGED_MUA_SEAMONKEY_MSGID_UNKNOWN(2.50)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[quip.cz]; AUTH_NA(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.00)[country: CZ(0.01)]; MX_GOOD(-0.01)[cached: elsa.codelab.cz]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.105.124.94.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.21)[-0.214,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[000.fbsd@quip.cz,SRS0=FBvO=NP=quip.cz=000.fbsd@elsa.codelab.cz]; RECEIVED_SPAMHAUS_PBL(0.00)[209.16.49.86.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:42000, ipnet:94.124.104.0/21, country:CZ]; FROM_NEQ_ENVFROM(0.00)[000.fbsd@quip.cz,SRS0=FBvO=NP=quip.cz=000.fbsd@elsa.codelab.cz]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 08:04:36 -0000 Miroslav Lachman wrote on 2018/11/02 15:35: > Mariusz Zaborski wrote on 2018/11/02 14:32: >> Probably because: >> https://github.com/zfsonlinux/zfs/pull/6256/commits/1c6275b1fcdacd734bb4eefd02a123b6b610ca48 >> >> >> FreeBSD commit - r334844. > > Was it MFCed to 11.2? > My data was from 10.4 but the machine was upgraded to 11.2 week ago so > next scrub will be on 11.2. It seems it was not merged in to 11.2. I am running scrub now at 23MB/s pool: tank0 state: ONLINE status: Some supported features are not enabled on the pool. The pool can still be used, but some features are unavailable. action: Enable all features using 'zpool upgrade'. Once this is done, the pool may no longer be accessible by software that does not support the features. See zpool-features(7) for details. scan: scrub in progress since Sun Nov 4 03:01:45 2018 502G scanned out of 11.1T at 23.8M/s, 130h9m to go 0 repaired, 4.40% done config: NAME STATE READ WRITE CKSUM tank0 ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 gpt/disk0tank0 ONLINE 0 0 0 gpt/disk1tank0 ONLINE 0 0 0 gpt/disk2tank0 ONLINE 0 0 0 gpt/disk3tank0 ONLINE 0 0 0 errors: No known data errors FreeBSD 11.2-RELEASE-p4 amd64 GENERIC Miroslav Lachman From owner-freebsd-fs@freebsd.org Sun Nov 4 15:38:17 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE1F810DA770 for ; Sun, 4 Nov 2018 15:38:16 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670066.outbound.protection.outlook.com [40.107.67.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 127C3764F8; Sun, 4 Nov 2018 15:38:14 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM (52.132.50.155) by YTOPR0101MB1308.CANPRD01.PROD.OUTLOOK.COM (52.132.45.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1294.28; Sun, 4 Nov 2018 15:38:13 +0000 Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b]) by YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b%3]) with mapi id 15.20.1294.028; Sun, 4 Nov 2018 15:38:13 +0000 From: Rick Macklem To: Julian Elischer , Andriy Gapon , Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: How to fill in the fsid for file systems? Thread-Topic: How to fill in the fsid for file systems? Thread-Index: AQHUb557F1RNqdJl0kuwS+F5J/DjsKU2/twAgAGdwkKAAGQrgIAAehmGgAELs4CAATs6uIADh0gAgAB6NSw= Date: Sun, 4 Nov 2018 15:38:13 +0000 Message-ID: References: <20181030012240.GM5335@kib.kiev.ua> , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YTOPR0101MB1308; 6:ZgvyleSHiqCWiv9XxRZRlP27nUS3Qp5ZAbMMvgZ6NsLOwW8C75g4ShweZANJ2Aws2lIglxS2It1hqQNDf4C9KHT0u+vmS6OevrXiWWawsGzyVO4xdgwIu+U+Kmn8i8J4aKFh6pPNEGxno3McOq//ODwN+K6XCk3BwuKrZaZmF9mqEQNngmO60swsRJK4FED1JMvL2TBR8tEecn5B9Zsv42WyHvL3MjWZk5ArNIanSVnAfn8Qu/vSN/TNArunOeJPSy9cdAGOc+lAwnT2/rLZ7xUwWlq2h83dv2Al4pTHha3IkS3JnyCQJD0jc7A+3gFZwlF9vBgnEd20UkKhRmUTUHDCMTLHpqK0+NHyWWvRV+x2CyREUFVtN3Vw/JUh7B3jE1uV92r+OOvo9dHKhRu7ONYXcbM1wWQ1H6YgZqu2V57btBf+VKpKFqxSCYPdyOcLY+p3tx6kZFqyjOOU8Owt+w==; 5:pWmpYMiNRuj+KwkjyyQQfC610wiIa2Fckem8El4odNjJoXLlTQCLDYUx6ENCRQAhctyJsFpe5gAOyI6SLGpcRXs5W6BfWF6PGwlV2G78qOGR8burxHk/Maj9nYxd+JyUD6DqtJIkvoXVYsYzUFVp2o2r8c7yuebdhKfwFuCdJ28=; 7:AwIOKgi2s7dr75AbhLBs3ll6+u3kEIm0tQ/loTxMBb7RQs88qcy30SLN/1LWEhNWPZUOXSP5j2lEXmsFo0G6Nr5tsVD0tTtTcz45v1UZHWgsp5jZojMlzyLYP53NF9QGe9vwvbmHBpbWJGIFyoPPdQ== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 70fd35d0-0827-4ee8-d2df-08d6426b8861 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(5600074)(711020)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:YTOPR0101MB1308; x-ms-traffictypediagnostic: YTOPR0101MB1308: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3231382)(944501410)(52105095)(93006095)(93001095)(10201501046)(3002001)(148016)(149066)(150057)(6041310)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123562045)(20161123564045)(20161123560045)(201708071742011)(7699051)(76991095); SRVR:YTOPR0101MB1308; BCL:0; PCL:0; RULEID:; SRVR:YTOPR0101MB1308; x-forefront-prvs: 084674B2CF x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(346002)(376002)(136003)(366004)(39860400002)(189003)(199004)(106356001)(53936002)(105586002)(8936002)(81156014)(55016002)(81166006)(5660300001)(6436002)(6246003)(8676002)(9686003)(68736007)(33656002)(186003)(305945005)(74316002)(97736004)(71200400001)(71190400001)(76176011)(46003)(99286004)(7696005)(486006)(11346002)(446003)(476003)(2900100001)(74482002)(110136005)(93886005)(316002)(786003)(6506007)(478600001)(102836004)(4326008)(2906002)(86362001)(229853002)(25786009)(14454004)(39060400002)(256004)(14444005); DIR:OUT; SFP:1101; SCL:1; SRVR:YTOPR0101MB1308; H:YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) x-microsoft-antispam-message-info: jxwyZO071d2J7lG38v5WmXE3B6INHBUQZzgUfgVm6LW0mRRL344gfq3pG8nLpNeztsJqD3gwdNHwnTGcCK8tuKvYG1XhJNmxqpBhoCsY+pmtbnWxVFUmrqkPGIVhhKbTP6/BHYbe0pB49MqJIsdK8n7Z735DiJhomStRPZn5U256+ir+I3CQOt1c7xkBTPwgXBHav5E7+63U5H3jTng5tVtIznW9nfVhSH2fMeRqPzVW+WX+FcMlMO40nvblzvaW30CzNPK6nJsLR/o8J/Mz8ysfU9toz8fxgBvJsxmC1t+RNwWBC2uQXHgCuz0PN3k/z7SQT4EcsVy5KXp/iFWrvW+FbRvyhDiUtAKXxqfQe5w= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: 70fd35d0-0827-4ee8-d2df-08d6426b8861 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Nov 2018 15:38:13.5768 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTOPR0101MB1308 X-Rspamd-Queue-Id: 127C3764F8 X-Spamd-Result: default: False [-0.79 / 200.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[uoguelph.ca]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com,mx2.hc184-76.ca.iphmx.com,mx1.hc184-76.ca.iphmx.com]; NEURAL_HAM_SHORT(-0.89)[-0.894,0]; RCVD_IN_DNSWL_NONE(0.00)[66.67.107.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(-0.58)[asn: 8075(-2.84), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 15:38:17 -0000 Julian Elischer wrote: [stuff snipped] >Rick Macklem wrote: >> >> Maybe someone can explain when it would be useful for FFS (or not)? >SO lets' just make the usage model clear: >I believe that what Josh needs is to have a two High availability >servers viewing a single >(cloud based) filesystem, export the same FSID so that when one takes >over for the other >the clients don't notice. Well, for UFS/FFS, if it is the same physical storage or the file system wa= s cloned via a block for block copy (like using dd(1)), then it shouldn't be a probl= em, since the fsid comes out of the superblock. That leaves ZFS, which is what I was asking. I don't understand the ZFS code well enough to understand what dmu_objset_fsid_guid() is doing to get the fsid. I also don't know if the v= alue changes for snaphots of the same file system? - If it does ever change, then that is the usage case for this option. I suppose there is nullfs. It uses vfs_getnewfsid() to fill in the fsid, so= if a nullfs mount were exported instead of the underlying UFS or ZFS file system, this option would be needed. (I think it would be wiser to just avoid exporting the nullfs mount, but some might have a use of this?). > The second usage is that over a reboot >an NFS client may not notice (if there were no transactions while the >system was down). >Even if for some reason the file systems came up in a different order.. This should be fine for all the file system types (UFS, cd9660, msdosfs) th= at I have checked, except maybe ZFS. Other than UFS, they mostly use vfs_getnewf= sid(), which should return the same value for a given file system type. (I don't think anyone really cares about cd9660, msdosfs w.r.t. this anyhow= .) Again, ZFS is the one I don't know enough about. So, the question really was "what does ZFS do to generate the fsid?". Now, Panzura does something else w.r.t. fsid, but that isn't a generic Free= BSD issue. rick From owner-freebsd-fs@freebsd.org Sun Nov 4 15:47:19 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C85AE10DAC62 for ; Sun, 4 Nov 2018 15:47:18 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660051.outbound.protection.outlook.com [40.107.66.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0BF72769D0; Sun, 4 Nov 2018 15:47:17 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM (52.132.50.155) by YTOPR0101MB1098.CANPRD01.PROD.OUTLOOK.COM (52.132.50.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1294.20; Sun, 4 Nov 2018 15:47:16 +0000 Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b]) by YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b%3]) with mapi id 15.20.1294.028; Sun, 4 Nov 2018 15:47:16 +0000 From: Rick Macklem To: Julian Elischer , Andriy Gapon , Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: How to fill in the fsid for file systems? Thread-Topic: How to fill in the fsid for file systems? Thread-Index: AQHUb557F1RNqdJl0kuwS+F5J/DjsKU2/twAgAGdwkKAAGQrgIAAehmGgAELs4CAATs6uIADh0gAgAB6NSyAAAgETg== Date: Sun, 4 Nov 2018 15:47:16 +0000 Message-ID: References: <20181030012240.GM5335@kib.kiev.ua> , , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YTOPR0101MB1098; 6:gU64IulEtzi4XjnQ+GKvZMYO/Tiidx1WnLHI5Dh57iHtvTzdlw8+pE4ds56JrMfJaxX1wmznIHKCa3Xut4L9eLkna2/a65Z+a+kSMcj+Dp7AGM/V0KeTsER1mwWCY0Ad8H7rlbHAyy0JeyZbAgs6CI4kvdBc7sxKeHBgAvPn3CyLcN+Ad0YezBoHlOAU+Un/VUDXYk3KBDHxGIsDvuPN3h6id0uS+0mJiZqTw0esVLHs+Tdd1bFhExWbJ9hIYBxjVxomA75QkyirAuSRecqyUsKR4iwR951EBqS7DxDwNhM2YMtStTcECmCzfLWbQCLXuL6t+uhu+uL7AUaTCK27KlUg7DmVJEXktN5XNYYdwDFOUSB2JUSbcd5N+nodPBacWhSXEl9422l367j7iA5NjWe/52MaPoWW7xXRaJpklMrJXuY26q7JxbElmEjC3FeZj+N5eqPX34PAIMWL8x8Rlw==; 5:rkHxyyE2O6j5o184/GnyVFOe4JefENsg3bEG1aFbRawpdCdRsNiDov61V93vn/esIYJ3yRikVR9/kPw7vjZBafDNb378jbFgDVf/bTbuBEEVClizeU3cq/RuDJgSNdDguqgFLU4zbEvXNGJ4M0vDQAbzu5mIXy/EOPmAqk6EuSk=; 7:gAY+tCjX9OlwpYEj6+BXhJBSrUrpUivQCpoqLwEf54FAoON7A7unsn8gb8k6hsMuWsuIW5vMezfb1sRAY2v7BYRIUUy0bbYSJGAkTT1n6uR3bZyQuv9O1zaPVv5Y3WaVylgwKywh1bB/sJyQOEwPpQ== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 39a3f120-c824-485e-a479-08d6426ccc2c x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(5600074)(711020)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:YTOPR0101MB1098; x-ms-traffictypediagnostic: YTOPR0101MB1098: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(3002001)(10201501046)(93006095)(93001095)(3231382)(944501410)(52105095)(148016)(149066)(150057)(6041310)(20161123562045)(20161123564045)(20161123560045)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(201708071742011)(7699051)(76991095); SRVR:YTOPR0101MB1098; BCL:0; PCL:0; RULEID:; SRVR:YTOPR0101MB1098; x-forefront-prvs: 084674B2CF x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(136003)(376002)(39850400004)(396003)(346002)(366004)(199004)(189003)(7696005)(99286004)(33656002)(4326008)(6246003)(102836004)(39060400002)(71200400001)(71190400001)(76176011)(68736007)(6506007)(97736004)(106356001)(105586002)(2900100001)(2940100002)(5660300001)(2906002)(55016002)(6436002)(53936002)(9686003)(478600001)(14454004)(229853002)(186003)(110136005)(93886005)(316002)(8936002)(74316002)(81156014)(81166006)(305945005)(256004)(93156006)(86362001)(786003)(8676002)(476003)(11346002)(446003)(25786009)(46003)(486006)(74482002)(14444005); DIR:OUT; SFP:1101; SCL:1; SRVR:YTOPR0101MB1098; H:YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) x-microsoft-antispam-message-info: mUUvgurs8jYh29ue//jYiW+j/KAlwPO9WOQVpIa0JNCZpMDmndHtTTAp/SBJPQW7QWUjNn+g9iq3D36h4npwdwry7dLVuXwwSNFpvlr+ziRt5gIGixo979GO0ABf31YDJ3SXrBQStc9lYdNEwnRLiCSaaW0i8ad1Gs0L9lVdvt+Yn58vGEszy+fEY4wRe4QqkDRYzOSk0vdxLcSPRibPajq3cBAHdaRsure3tX6DGUghRycbSAvAwVSNLHIKyKimCwQnBe4PZ6gocjL8nWwWlqqE8WysozZ+qqeNgcewUN7hjG8MN3I3HTCwaPTEPQu3UoA9dSVeNX4+c0zzEG0xVjVkyciHCnJ3t6kPAKNS59M= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: 39a3f120-c824-485e-a479-08d6426ccc2c X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Nov 2018 15:47:16.8414 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTOPR0101MB1098 X-Rspamd-Queue-Id: 0BF72769D0 X-Spamd-Result: default: False [-0.77 / 200.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[uoguelph.ca]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx2.hc184-76.ca.iphmx.com]; NEURAL_HAM_SHORT(-0.89)[-0.892,0]; RCVD_IN_DNSWL_NONE(0.00)[51.66.107.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(-0.57)[asn: 8075(-2.79), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 15:47:19 -0000 Julian Elischer wrote: [stuff snipped] >Rick Macklem wrote: >> >> Maybe someone can explain when it would be useful for FFS (or not)? >SO lets' just make the usage model clear: >I believe that what Josh needs is to have a two High availability >servers viewing a single >(cloud based) filesystem, export the same FSID so that when one takes >over for the other >the clients don't notice. Well, for UFS/FFS, if it is the same physical storage or the file system wa= s cloned via a block for block copy (like using dd(1)), then it shouldn't be a probl= em, since the fsid comes out of the superblock. *** added comment Oh, and I am not sure what happens w.r.t. the fsid for UFS snapshots? rick From owner-freebsd-fs@freebsd.org Sun Nov 4 15:54:16 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1572410DB3E4 for ; Sun, 4 Nov 2018 15:54:15 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf1-f51.google.com (mail-lf1-f51.google.com [209.85.167.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1ECC9770EB; Sun, 4 Nov 2018 15:54:15 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf1-f51.google.com with SMTP id c16so4380285lfj.8; Sun, 04 Nov 2018 07:54:15 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=NGV273pk2RKhsk3DxMNExUGe6BJ2vwQ8+W2WkknV3d4=; b=ObnHfPAti+MQmTCwm3IQ1BuH/iWIpp4hgcBZ0eTkqtK+REB4MC+87odvIzMlpahKOY PaUXdp/WgvfBAGGOoqpPZhAaeAONBckRyYYULkODuC1vtoCl66sNCYP3RUEDvsdxN2wr j5W33PuGEFpPWMk+9PnoHcXu+2ljZ9/5I971lwaflB4BiznzLEO8/V4vnyOlT39aqC8J LhKs46zowKzvjaegzjLzmqklxna84yqzW6ua1d3D2He5mRVBtONVD9MprL60ecEkltB5 Nfu5tuwalAzKlml+yVwRZ0NaTNXCp6U60a/CQO9EeAn9TNzLxjFeJ1Pbr94GMOHOCo5O lJTQ== X-Gm-Message-State: AGRZ1gLwH7w4Pktz25hxu1AetAQRP2w4G//iew9Ofq2FVrQ/iUVYQhPu GU3+wTz3RAilMwr+J/Ikr9woM5BQ X-Google-Smtp-Source: AJdET5fpD2yjpgGbojjohewQo3LO4oLwUDLidsEOOwOngiSjzU8Zs1C2FkLh4Kx8Untba9+zPZ/1bg== X-Received: by 2002:a19:f813:: with SMTP id a19mr10424508lff.67.1541346527518; Sun, 04 Nov 2018 07:48:47 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id o17sm847041lff.77.2018.11.04.07.48.46 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 04 Nov 2018 07:48:46 -0800 (PST) Subject: Re: How to fill in the fsid for file systems? To: Rick Macklem , Julian Elischer , Konstantin Belousov Cc: FreeBSD Filesystems References: <20181030012240.GM5335@kib.kiev.ua> From: Andriy Gapon Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABzR5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz7CwZQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryM7BTQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAcLBfAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: <03f24451-c0d0-0701-0e00-b2ce0f946887@FreeBSD.org> Date: Sun, 4 Nov 2018 17:48:45 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1ECC9770EB X-Spamd-Result: default: False [-1.08 / 200.00]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.97)[-0.973,0]; RCVD_IN_DNSWL_NONE(0.00)[51.167.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.09)[ipnet: 209.85.128.0/17(-4.32), asn: 15169(-1.08), country: US(-0.07)]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 15:54:16 -0000 On 04/11/2018 17:38, Rick Macklem wrote: > That leaves ZFS, which is what I was asking. > I don't understand the ZFS code well enough to understand what > dmu_objset_fsid_guid() is doing to get the fsid. I also don't know if the value > changes for snaphots of the same file system? > - If it does ever change, then that is the usage case for this option. A good ZFS example is this. A filesystem is duplicated using zfs send + zfs recv. The content would be exactly the same (provided no modification of the source and the target after the duplication), but GUIDs of the source and target would be different. The latter is required because the source and the target could be in the same pool. But even if they are in different pools (and different machines), the GUIDs would still be different. -- Andriy Gapon From owner-freebsd-fs@freebsd.org Sun Nov 4 16:58:50 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2E1E810DCC55 for ; Sun, 4 Nov 2018 16:58:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4A28479EE1; Sun, 4 Nov 2018 16:58:49 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wA4GwcWs004587 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 4 Nov 2018 18:58:41 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wA4GwcWs004587 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wA4Gwc3E004586; Sun, 4 Nov 2018 18:58:38 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 4 Nov 2018 18:58:38 +0200 From: Konstantin Belousov To: Rick Macklem Cc: Julian Elischer , Andriy Gapon , FreeBSD Filesystems Subject: Re: How to fill in the fsid for file systems? Message-ID: <20181104165838.GA5335@kib.kiev.ua> References: <20181030012240.GM5335@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: 4A28479EE1 X-Spamd-Result: default: False [-1.33 / 200.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.98)[-0.977,0]; IP_SCORE(-1.34)[ipnet: 2001:470::/32(-3.57), asn: 6939(-3.08), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 16:58:50 -0000 On Sun, Nov 04, 2018 at 03:47:16PM +0000, Rick Macklem wrote: > Oh, and I am not sure what happens w.r.t. the fsid for UFS snapshots? Superblock for the snapshot is the verbatim copy of the superblock for the actual UFS volume. As the consequence, their fsids are same. You cannot quite substitute the real export by a snapshot export, because snapshot is read-only. But if it is fine, equal fsids are also fine. From owner-freebsd-fs@freebsd.org Sun Nov 4 21:00:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DDD4210EB51A for ; Sun, 4 Nov 2018 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 5D8C685FCA for ; Sun, 4 Nov 2018 21:00:25 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 222B110EB517; Sun, 4 Nov 2018 21:00:25 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC10E10EB515 for ; Sun, 4 Nov 2018 21:00:24 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 44F9D85FC5 for ; Sun, 4 Nov 2018 21:00:24 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 154CA16F60 for ; Sun, 4 Nov 2018 21:00:23 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA4L0MOQ032432 for ; Sun, 4 Nov 2018 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA4L0MKW032431 for fs@FreeBSD.org; Sun, 4 Nov 2018 21:00:22 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201811042100.wA4L0MKW032431@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 4 Nov 2018 21:00:22 +0000 MIME-Version: 1.0 X-Rspamd-Queue-Id: 5D8C685FCA X-Spamd-Result: default: False [-3.06 / 200.00]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; URI_COUNT_ODD(1.00)[13]; RCPT_COUNT_ONE(0.00)[1]; SPF_FAIL_FORWARDING(0.00)[]; DMARC_NA(0.00)[FreeBSD.org]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx1.FreeBSD.org]; FROM_NO_DN(0.00)[]; NEURAL_HAM_SHORT(-0.89)[-0.893,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.95)[ip: (-9.19), ipnet: 2001:1900:2254::/48(-3.22), asn: 10310(-2.30), country: US(-0.07)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; RCVD_COUNT_SEVEN(0.00)[7]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 21:00:26 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic New | 217062 | for file systems mounted with -o noexec, exec=off New | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 140068 | [smbfs] [patch] smbfs does not allow semicolon in Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS 6 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Sun Nov 4 23:57:32 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7A3F10F1F9C for ; Sun, 4 Nov 2018 23:57:32 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670044.outbound.protection.outlook.com [40.107.67.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E740E8DA9D; Sun, 4 Nov 2018 23:57:31 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM (52.132.50.155) by YTOPR0101MB1212.CANPRD01.PROD.OUTLOOK.COM (52.132.43.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1294.21; Sun, 4 Nov 2018 23:57:30 +0000 Received: from YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b]) by YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM ([fe80::9c71:6eb6:1bff:727b%3]) with mapi id 15.20.1294.032; Sun, 4 Nov 2018 23:57:30 +0000 From: Rick Macklem To: Andriy Gapon , Julian Elischer , Konstantin Belousov CC: FreeBSD Filesystems Subject: Re: How to fill in the fsid for file systems? Thread-Topic: How to fill in the fsid for file systems? Thread-Index: AQHUb557F1RNqdJl0kuwS+F5J/DjsKU2/twAgAGdwkKAAGQrgIAAehmGgAELs4CAATs6uIADh0gAgAB6NSyAAAkzgIAAhZMS Date: Sun, 4 Nov 2018 23:57:30 +0000 Message-ID: References: <20181030012240.GM5335@kib.kiev.ua> , <03f24451-c0d0-0701-0e00-b2ce0f946887@FreeBSD.org> In-Reply-To: <03f24451-c0d0-0701-0e00-b2ce0f946887@FreeBSD.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YTOPR0101MB1212; 6:UJS5pI6xlpjv5Y1oH5AvAHA4oXOz2qzz+Ki27f7ZuciZ9iXp1fSyTCxxcm3prg/FLdqy7ufKTEFjd+ZOhQYbuz0tJPTeSDc35x47kPr3QJpz9eNQk3KmSb+1EFLw2BlAA+bWftEBC+zUHzyNMiWo7LQyqVLArkGkPhPBf/DxHwG6Ctrtw6doPb2TKKHrWCqLDJh8TJoq1eXqMEn+R7lP/YDcv89D6WBse++/GmyBdkJeWFNwPyNPm7UcbC5B6P8l4sXzgmqpynQXHnNJu6E3IfQCvjV7xEe8E6OXR+w7Xye8n8fW84bPSgF/OsNJA6mH3+c/Uz4qQTnPKjhsUWznDD8YRjg8pgJK5QeSUcQUI4aVBElkyh9SdkZ1cV8SHl+el9djC/wTKYCOIMdG5G89eDa5qYbapVfGF9K9sgChF0Fq95VNslPjoCTRJLCAFKDGg50x1v6RzA9Kt6djtdH/bQ==; 5:zFsvZcomgNHUnbW/L1pyElQ83mclqAkGpA1BabdsqolRql9c1E2HW+/cJK6lOFL8TS9jAKyVEeNlYAeFuIitRTy6qe0WPhRc9wR6RXQpCwdUb5jpOEOMKfDMFBwkhBjJSuA25prUVGTJxypsZXn/+MsRnUnyUGSidS931XIyo+E=; 7:YxqBfAmuIiBPWrSb97Dpvu7ZaWKcdTwVG+rEViCuqKGdpp6DRMgmbFrjscNFtw8qmAVa+GqvQfhFW53Fof0Z8E+vIg+cVuOAYrmgGSv3hValZ43QP2b9kpNvar6HgDo6YOem+4dD6W8A8E4VtFwjvw== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 9047a111-5d7d-48fe-5803-08d642b147ec x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(49563074)(7193020); SRVR:YTOPR0101MB1212; x-ms-traffictypediagnostic: YTOPR0101MB1212: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040522)(2401047)(8121501046)(5005006)(3231382)(944501410)(4983020)(52105095)(3002001)(10201501046)(93006095)(93001095)(148016)(149066)(150057)(6041310)(20161123558120)(20161123562045)(20161123564045)(20161123560045)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(201708071742011)(7699051)(76991095); SRVR:YTOPR0101MB1212; BCL:0; PCL:0; RULEID:; SRVR:YTOPR0101MB1212; x-forefront-prvs: 084674B2CF x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(136003)(346002)(376002)(39860400002)(366004)(189003)(199004)(99286004)(316002)(14454004)(74316002)(39060400002)(81166006)(81156014)(478600001)(7696005)(55016002)(99936001)(9686003)(110136005)(53936002)(8936002)(97736004)(5660300001)(6246003)(76176011)(229853002)(786003)(8676002)(93886005)(74482002)(305945005)(6436002)(2906002)(6506007)(33656002)(25786009)(86362001)(4326008)(68736007)(186003)(71200400001)(71190400001)(46003)(446003)(486006)(476003)(11346002)(102836004)(106356001)(5024004)(14444005)(256004)(105586002)(2900100001); DIR:OUT; SFP:1101; SCL:1; SRVR:YTOPR0101MB1212; H:YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) x-microsoft-antispam-message-info: o43fNoP69O1sfUlclmyIrmj7WAvyNzt89COnzaPvqs3bB8+UhXVRu3dmaai3zKfxOtfAh3Wt/YTAb4NqveEFwo2NRK0+by9Skm4Eb4MYFjxT+NRHCvS9yi4y9r6K4k6SVno5ohj8s7E/xmY9XypmIfkSJjmbx4L+smQ0vRG+JTlipkhvxQscs2yR+HvFZJFv9B3pXHXznoDDSG5Gauzfz/6vPhmjiP72GlV7n1hxQ3G7G8G6NF1WrM++XSSJTqRlB2w3PhezOlupU7VgS6qfX1OwdyrSFgZpH6t2vq3itcplsNBHBP7Gnml4HiJSKgCFIwmxNvz6m9xV0xkbwjSnOhjXe9XMQtK03D4GFRc0IHw= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/mixed; boundary="_002_YTOPR0101MB116276DDB031C76E1F8B0560DDC90YTOPR0101MB1162_" MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: 9047a111-5d7d-48fe-5803-08d642b147ec X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Nov 2018 23:57:30.2351 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTOPR0101MB1212 X-Rspamd-Queue-Id: E740E8DA9D X-Spamd-Result: default: False [-1.68 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.950,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; DMARC_NA(0.00)[uoguelph.ca]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx2.hc184-76.ca.iphmx.com]; NEURAL_HAM_SHORT(-0.86)[-0.865,0]; RCVD_IN_DNSWL_NONE(0.00)[44.67.107.40.list.dnswl.org : 127.0.3.0]; IP_SCORE(-0.56)[asn: 8075(-2.71), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2018 23:57:32 -0000 --_002_YTOPR0101MB116276DDB031C76E1F8B0560DDC90YTOPR0101MB1162_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Andriy Gapon wrote: >On 04/11/2018 17:38, Rick Macklem wrote: >> That leaves ZFS, which is what I was asking. >> I don't understand the ZFS code well enough to understand what >> dmu_objset_fsid_guid() is doing to get the fsid. I also don't know if th= e value >> changes for snaphots of the same file system? >> - If it does ever change, then that is the usage case for this option. > >A good ZFS example is this. >A filesystem is duplicated using zfs send + zfs recv. The content would b= e >exactly the same (provided no modification of the source and the target af= ter >the duplication), but GUIDs of the source and target would be different. = The >latter is required because the source and the target could be in the same = pool. >But even if they are in different pools (and different machines), the GUID= s >would still be different. Cool. Assuming the duplicated file system created via zfs send + zfs recv s= till has the same fid for any given file (the stuff used by zfs_fid() stays the = same for any given file in the file system), then this would be good use case. It will need some ZFS magic to make a generic fs mount option work for ZFS. Maybe you can do that? The current patch I have for adding a generic "fsid=3DN" mount option is in D17839. I've also attached it to this message in case that is easier. (It currently doesn't allow fsid=3DN to be used during an update "mount -u"= . This made sense to me, since an fsid shouldn't change, but if others think it should be changeable via "mount -u" the patch can easily be changed.) rick ps: I did notice the code is "slightly racy" in that there is a period of t= ime between when VFS_MOUNT() sets the mnt_stat.f_fsid and when the mount structur= e is=20 entered in the mountlist, where another mount could happen using the= same mnt_stat.f_fsid value, but that has been there for a long time and wo= uldn't be easy to fix. --_002_YTOPR0101MB116276DDB031C76E1F8B0560DDC90YTOPR0101MB1162_ Content-Type: application/octet-stream; name="setfsid.patch" Content-Description: setfsid.patch Content-Disposition: attachment; filename="setfsid.patch"; size=2608; creation-date="Sun, 04 Nov 2018 23:54:10 GMT"; modification-date="Sun, 04 Nov 2018 23:54:10 GMT" Content-Transfer-Encoding: base64 LS0tIGtlcm4vdmZzX21vdW50LmMubm9mc2lkCTIwMTgtMDktMjkgMDE6MTM6MzQuNTIzMjQwMDAw IC0wNDAwCisrKyBrZXJuL3Zmc19tb3VudC5jCTIwMTgtMTEtMDQgMjI6NDk6NDYuNjE0MDA3MDAw IC0wNTAwCkBAIC0xMTAsNiArMTEwLDcgQEAgc3RhdGljIGNvbnN0IGNoYXIgKmdsb2JhbF9vcHRz W10gPSB7CiAJInJ3IiwKIAkibm9zdWlkIiwKIAkibm9leGVjIiwKKwkiZnNpZCIsCiAJTlVMTAog fTsKIApAQCAtODM4LDYgKzgzOSw5IEBAIHZmc19kb21vdW50X2ZpcnN0KAogCXN0cnVjdCBtb3Vu dCAqbXA7CiAJc3RydWN0IHZub2RlICpuZXdkcDsKIAlpbnQgZXJyb3I7CisJdWludDY0X3QgZnNp ZHZhbDsKKwljaGFyICpmc2lkc3RyLCAqZnNpZGVuZDsKKwlpbnQgZnNpZGxlbjsKIAogCUFTU0VS VF9WT1BfRUxPQ0tFRCh2cCwgX19mdW5jX18pOwogCUtBU1NFUlQoKGZzZmxhZ3MgJiBNTlRfVVBE QVRFKSA9PSAwLCAoIk1OVF9VUERBVEUgc2hvdWxkbid0IGJlIGhlcmUiKSk7CkBAIC04OTAsNiAr ODk0LDI4IEBAIHZmc19kb21vdW50X2ZpcnN0KAogCSAqIGdldC4gIE5vIGZyZWVpbmcgb2YgY25f cG5idWYuCiAJICovCiAJZXJyb3IgPSBWRlNfTU9VTlQobXApOworCisJLyoKKwkgKiBTZXQgdGhl IGZzaWQgaWYgdGhlIG1vdW50IG9wdGlvbiB3YXMgc3BlY2lmaWVkLgorCSAqLworCWlmIChlcnJv ciA9PSAwKSB7CisJCWZzaWRsZW4gPSAwOworCQllcnJvciA9IHZmc19nZXRvcHQobXAtPm1udF9v cHRuZXcsICJmc2lkIiwgKHZvaWQgKiopJmZzaWRzdHIsCisJCSAgICAmZnNpZGxlbik7CisJCWlm IChlcnJvciA9PSAwKSB7CisJCQlpZiAoZnNpZGxlbiA9PSAwIHx8IGZzaWRzdHJbZnNpZGxlbiAt IDFdICE9ICdcMCcpCisJCQkJZXJyb3IgPSBFSU5WQUw7CisJCQlpZiAoZXJyb3IgPT0gMCkgewor CQkJCWZzaWR2YWwgPSBzdHJ0b3VxKGZzaWRzdHIsICZmc2lkZW5kLCAwKTsKKwkJCQlpZiAoKmZz aWRlbmQgIT0gJ1wwJykKKwkJCQkJZXJyb3IgPSBFSU5WQUw7CisJCQl9CisJCQlpZiAoZXJyb3Ig PT0gMCkKKwkJCQllcnJvciA9IHZmc19zZXRmc2lkKG1wLCBmc2lkdmFsKTsKKwkJfSBlbHNlCisJ CQllcnJvciA9IDA7CisJfQorCiAJaWYgKGVycm9yICE9IDApIHsKIAkJdmZzX3VuYnVzeShtcCk7 CiAJCW1wLT5tbnRfdm5vZGVjb3ZlcmVkID0gTlVMTDsKLS0tIGtlcm4vdmZzX3N1YnIuYy5ub2Zz aWQJMjAxOC0wOS0yOSAwMjozOToyNy4zMTI2NzcwMDAgLTA0MDAKKysrIGtlcm4vdmZzX3N1YnIu YwkyMDE4LTExLTAyIDIwOjM3OjQwLjAwMDAwMDAwMCAtMDQwMApAQCAtNzY5LDYgKzc2OSwzNyBA QCB2ZnNfZ2V0bmV3ZnNpZChzdHJ1Y3QgbW91bnQgKm1wKQogfQogCiAvKgorICogU2V0IHRoZSBm X2ZzaWQgdG8gdGhlIGFyZ3VtZW50LCBpZiBwb3NzaWJsZS4KKyAqLworaW50Cit2ZnNfc2V0ZnNp ZChzdHJ1Y3QgbW91bnQgKm1wLCB1aW50NjRfdCB2YWwpCit7CisJc3RydWN0IG1vdW50ICpubXA7 CisJZnNpZF90IHRmc2lkOworCisJQ1RSMihLVFJfVkZTLCAiJXM6IG1wICVwIiwgX19mdW5jX18s IG1wKTsKKwkvKgorCSAqIEZpbGwgaW4gdGhlIHR3byAzMmJpdCBmaWVsZHMgb2YgdGhlIGZzaWQg dG8gInZhbCIuCisJICovCisJdGZzaWQudmFsWzBdID0gdmFsOworCXRmc2lkLnZhbFsxXSA9IHZh bCA+PiAzMjsKKwltdHhfbG9jaygmbW50aWRfbXR4KTsKKwlpZiAoKG5tcCA9IHZmc19nZXR2ZnMo JnRmc2lkKSkgIT0gTlVMTCkgeworCQl2ZnNfcmVsKG5tcCk7CisJCW10eF91bmxvY2soJm1udGlk X210eCk7CisJCWlmIChubXAgIT0gbXApCisJCQlyZXR1cm4gKEVJTlZBTCk7CisJCXJldHVybiAo MCk7CisJfQorCU1OVF9JTE9DSyhtcCk7CisJbXAtPm1udF9zdGF0LmZfZnNpZC52YWxbMF0gPSB0 ZnNpZC52YWxbMF07CisJbXAtPm1udF9zdGF0LmZfZnNpZC52YWxbMV0gPSB0ZnNpZC52YWxbMV07 CisJTU5UX0lVTkxPQ0sobXApOworCW10eF91bmxvY2soJm1udGlkX210eCk7CisJcmV0dXJuICgw KTsKK30KKworLyoKICAqIEtub2IgdG8gY29udHJvbCB0aGUgcHJlY2lzaW9uIG9mIGZpbGUgdGlt ZXN0YW1wczoKICAqCiAgKiAgIDAgPSBzZWNvbmRzIG9ubHk7IG5hbm9zZWNvbmRzIHplcm9lZC4K LS0tIHN5cy9tb3VudC5oLm5vZnNpZAkyMDE4LTA5LTI5IDAxOjEzOjA0LjY1OTQxNzAwMCAtMDQw MAorKysgc3lzL21vdW50LmgJMjAxOC0xMS0wMyAwMTowNjozNy44NTQ5NDgwMDAgLTA0MDAKQEAg LTkxOCw2ICs5MTgsNyBAQCB2b2lkCXZmc19kZWFsbG9jYXRlX3N5bmN2bm9kZShzdHJ1Y3QgbW91 bnQgKik7CiBpbnQJdmZzX2Rvbm1vdW50KHN0cnVjdCB0aHJlYWQgKnRkLCB1aW50NjRfdCBmc2Zs YWdzLAogCSAgICBzdHJ1Y3QgdWlvICpmc29wdGlvbnMpOwogdm9pZAl2ZnNfZ2V0bmV3ZnNpZChz dHJ1Y3QgbW91bnQgKik7CitpbnQJdmZzX3NldGZzaWQoc3RydWN0IG1vdW50ICosIHVpbnQ2NF90 KTsKIHN0cnVjdCBjZGV2ICp2ZnNfZ2V0cm9vdGZzaWQoc3RydWN0IG1vdW50ICopOwogc3RydWN0 CW1vdW50ICp2ZnNfZ2V0dmZzKGZzaWRfdCAqKTsgICAgICAvKiByZXR1cm4gdmZzIGdpdmVuIGZz aWQgKi8KIHN0cnVjdAltb3VudCAqdmZzX2J1c3lmcyhmc2lkX3QgKik7Cg== --_002_YTOPR0101MB116276DDB031C76E1F8B0560DDC90YTOPR0101MB1162_-- From owner-freebsd-fs@freebsd.org Mon Nov 5 09:30:05 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BEAB10FDA93 for ; Mon, 5 Nov 2018 09:30:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7F9DB7704A for ; Mon, 5 Nov 2018 09:30:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 443F810FDA91; Mon, 5 Nov 2018 09:30:04 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2293910FDA90 for ; Mon, 5 Nov 2018 09:30:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9E9D877044 for ; Mon, 5 Nov 2018 09:30:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CFEC31D64A for ; Mon, 5 Nov 2018 09:30:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA59U2jU021188 for ; Mon, 5 Nov 2018 09:30:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA59U2T6021187 for fs@FreeBSD.org; Mon, 5 Nov 2018 09:30:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Mon, 05 Nov 2018 09:30:00 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andreas.sommer87@googlemail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 7F9DB7704A X-Spamd-Result: default: False [-4.02 / 200.00]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCPT_COUNT_ONE(0.00)[1]; XAW_SERVICE_ACCT(1.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; FROM_NO_DN(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; SPF_FAIL_FORWARDING(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.82)[ip: (-8.97), ipnet: 2001:1900:2254::/48(-2.98), asn: 10310(-2.11), country: US(-0.06)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; RCVD_COUNT_SEVEN(0.00)[7]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2018 09:30:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #34 from Andreas Sommer --- Here's a different stack trace I found: $ sudo procstat -kk 92301 PID TID COMM TDNAME KSTACK 92301 100454 sync - mi_switch+0xe6 critical_exit+0x6d xen_intr_handle_upcall+0x1b7 Xxen_intr_upcall+0xa5 vputx+0x2ea zfs_zget+0x1aa zfs_get_data+0x3c zil_commit_impl+0xa9a zfs_sync+0xa6 sys_sync+0x116 amd64_syscall+0xa38 fast_syscall_common+0x101 This sync process hung (I'm running find, sync and other stuff in a loop to trigger the issue faster). Later I seemingly couldn't run procstat on (the still existing) PID 92301 anymore... `procstat` hangs after outputting colu= mn headers and my SSH connection goes away i.e. instance has crashed. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 5 09:45:30 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90AF710FDF7C; Mon, 5 Nov 2018 09:45:30 +0000 (UTC) (envelope-from pkubaj@anongoth.pl) Received: from mail.anongoth.pl (mail.anongoth.pl [46.248.190.61]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mail.anongoth.pl", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5C907778B2; Mon, 5 Nov 2018 09:45:29 +0000 (UTC) (envelope-from pkubaj@anongoth.pl) Received: from anongoth.pl (unknown [10.8.0.2]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: pkubaj@anongoth.pl) by mail.anongoth.pl (Postfix) with ESMTPSA id 080E427967; Mon, 5 Nov 2018 10:45:17 +0100 (CET) Date: Mon, 5 Nov 2018 10:45:17 +0100 From: Piotr Kubaj To: freebsd-current@freebsd.org, freebsd-ppc@freebsd.org, freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Subject: FreeBSD/powerpc64 (POWER9) with ZFS on / Message-ID: <20181105094517.GA42797@smtp.iq.pl> Mail-Followup-To: freebsd-current@freebsd.org, freebsd-ppc@freebsd.org, freebsd-stable@freebsd.org, freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="zhXaljGHf11kAtnf" Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 5C907778B2 X-Spamd-Result: default: False [-5.08 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[anongoth.pl]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:46.248.190.61]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[anongoth.pl:+]; DMARC_POLICY_ALLOW(-0.50)[anongoth.pl,reject]; MX_GOOD(-0.01)[mail.anongoth.pl]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.983,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.01)[country: PL(0.03)]; ASN(0.00)[asn:47544, ipnet:46.248.160.0/19, country:PL]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2018 09:45:30 -0000 --zhXaljGHf11kAtnf Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable ZFS is by default not available for partitioning in bsdinstall. We can, how= ever, use manual partitioning in shell to make ZFS partitions. But what if we want to do ZFS on /? This is currently not supported out-of-= the-box. The reason is that Petitboot, used on POWER9 to boot kernel, doesn= 't support loading modules (at least when booting FreeBSD). ZFS is by defau= lt distributed only as a module, to overcome licensing issues. There are two ways to boot ZFS on root with Petitboot: 1. We can use initramfs, which will load necessary modules. It's said to be= supported on FreeBSD/powerpc64, but no one knows how to create one for Fre= eBSD :) 2. We can actually compile a custom kernel with ZFS in it (not as a module)= =2E This the approach that I use. Unfortunately, I can't redistribute this = kernel, because of ZFS's license. I created a custom installation iso, whic= h uses my kernel with ZFS included. Here are the steps to do it (on an installed powerpc64 system, but should b= e possible on other architectures after redefining TARGET and TARGET_ARCH): 1. cd /usr/src/sys/powerpc/conf 2. cat << EOF > ZFS include GENERIC64 options ZFS EOF 3. cd ../../../ 3. make buildworld buildkernel KERNCONF=3DZFS 4. cd release 5. make release When it's done, there will be iso files in /usr/obj/usr/src/powerpc.powerpc= 64/release. You can use it to install ZFS on root. Note that you need a FAT32 partition to mount on /boot. This partition needs to have /boot/etc/kboot.conf file, with a line like: FreeBSD=3D'/kernel/kernel kernelname=3D/boot/kernel/kernel vfs.root.mountfr= om=3Dzfs:zroot/ROOT/default' You also need the appriopriate /etc/fstab: /dev/nda0p1 /boot msdosfs rw 2 2 Other than that, howto at https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot#Cre= ate_Partitions (from point 2., omit 1.) is totally ok to follow. Thanks to mmacy for informing me about this little trick with including ZFS= to kernel. --=20 _________________________________________=20 / It has been said that man is a rational \ | animal. All my life I have been | | searching for evidence which could | | support this. | | | \ -- Bertrand Russell / -----------------------------------------=20 \ ^__^ \ (oo)\_______ (__)\ )\/\ ||----w | || || --zhXaljGHf11kAtnf Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQJkBAABCgBOFiEEycyIeNkkgohzsoorelmbhSCDnJ0FAlvgES0wFIAAAAAAFQAS cGthLWFkZHJlc3NAZ251cGcub3JncGt1YmFqQGFub25nb3RoLnBsAAoJEHpZm4Ug g5ydkKMP/0Xuk8dEY5/ZTu9Olokm4JRw2hXOzVvOhMQG4lJFUfDnAHStWkGEfiYT 4a/6OZJ27mp6g90Rt9vwaMCvD7cSIaVuUYQWDYZ2F0kXVdHzIJdTciFa+CBGEH82 cxirf+hO8sF87jionIhSo9U7U8UKQPYhYtUiH7OdTtFkCUlOIV7TbebdUrlSm90e 4Bf1Sy4g45V58Cn942kyvh8e+xs3lPs/v/lEvi/AoIv9jBkURp/8U8TIGn/Hp/t2 I84wvnRQvlj8oH5m8w6Uzxg9Xj9FFJXzJOcmc/sDpfcKOs+hZBIw1+FybI/Y+sdz yNU+QttBymFJWSDJVG1i5XcKj5WQWJCV4vYKofjI8KiHYgMq+IUnRXO0tWhqrnYB L0S+q8OBI7R7EjrOfETJqxmhouXmIyb5NOXXcA94QI40oMbeLIWCiPJps0tyW53V UCdj4VfdbBfZq8moKaLU5WDsBu5ggxAE4UOStFavDLfomH9CpfYoHgiyEsUEoK7a Nxx+i1+mImGwqGx/u5v8XO4eBWf6UEFR4DU+8rwTUH03QuEVXWApKg8gim7+bbc0 wolPNm1PODjqIjX/6oFKpYDBYWpYv5nJn66SFLGMAE8ecz0+fTPZhULgP7+QMoQp 51HtwiM0X1a8D+nu8W7XaGaGJ9UTzQEvQoytErTp4ZG56SqudOAR =UvqB -----END PGP SIGNATURE----- --zhXaljGHf11kAtnf-- From owner-freebsd-fs@freebsd.org Mon Nov 5 10:23:56 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5DEC010FEF08; Mon, 5 Nov 2018 10:23:56 +0000 (UTC) (envelope-from instructionset@gmail.com) Received: from mail-pl1-x62b.google.com (mail-pl1-x62b.google.com [IPv6:2607:f8b0:4864:20::62b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B3C97916D; Mon, 5 Nov 2018 10:23:55 +0000 (UTC) (envelope-from instructionset@gmail.com) Received: by mail-pl1-x62b.google.com with SMTP id c13-v6so4234718plz.13; Mon, 05 Nov 2018 02:23:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=taTkOU/h0+uB4Qxzojt9kZnoXGPpivSBvTNphgutLM4=; b=a1Mke/pULh2ETPK4kQ2OtCQ49LVEf+K+S/UGoh1BGcx26by1uc/Ikt5S+scFCIvFhB i5W2CQ1+dvAIJ++7Gl0fpgTPfwU1ICZUS5sN0OTIQ6TFlXGwhV2ID08phBLQiM6h0zE1 sIjedUatyT2V5mCEQT4DsB8CJuRrTfZ/PgDlhIyHxQNCR5e/kc3lls8iawWRz2XB4e2Q pGGE/6oZBBQJdFwb4AwQkkXUqCNVds3WcNrGByLHEVz7lboxNhLa4D3Duah/DGSwzWfk RMpnr1va5vkiQXey04w6IqFY0M73CeLjSWok8DEwyF1D55pxEwxvXevwSsQ8Sr22dCvb Yoeg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=taTkOU/h0+uB4Qxzojt9kZnoXGPpivSBvTNphgutLM4=; b=YjZovXPLZTllJ5Fe+Q6XP4QAyutKztZSMfAiWM+W6Sdx0jpgQ6RwDKT+U3N3ze70U9 MuyWKhf4HzFZRqta0O+AGpblQu5DiueHmLvEJZDySjrocxpkwIm9en86Atcsb1C8FMFy PYIMfedCMkYMenQKi2MIgRIiMxgz9jZJ7Q0Q0bAvlSYbZvOlHiaXLDzJ8Y/dfosqdoaT CTgjK4GvZmbMD9WvlT/pdEFz89LOtFOIRbR/bc2kEy99809j979ke92waEVDFps/pkcS Fp8YMhSWAL/RnyJKzo5ke4iY4Y/YW+qPuwEQEju7EnOWu/SFuG3IM6OSroWIjTKBtwAA ++Ag== X-Gm-Message-State: AGRZ1gL4cUM12m2ksslFCGpkogh/rsP5PeWLDxlV9SgcSYVIK39YeSnC o5Nf4F4FKPXA72CdT0o9R0GehjcXmu/9eXMO9ISbOw== X-Google-Smtp-Source: AJdET5c2Ml9xsI0DMbUbLNAT5zJDorqLATC1tTu562j/HFMhnaZPQwdCpR+024fw0kyIt5XuwmDMM2UlaG+2qL+QSjY= X-Received: by 2002:a17:902:5e3:: with SMTP id f90-v6mr22077742plf.286.1541413434219; Mon, 05 Nov 2018 02:23:54 -0800 (PST) MIME-Version: 1.0 References: <20181105094517.GA42797@smtp.iq.pl> In-Reply-To: <20181105094517.GA42797@smtp.iq.pl> From: Bill Sorenson Date: Mon, 5 Nov 2018 04:23:45 -0600 Message-ID: Subject: Re: FreeBSD/powerpc64 (POWER9) with ZFS on / To: pkubaj@anongoth.pl, freebsd-current@freebsd.org, FreeBSD PowerPC ML , freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 9B3C97916D X-Spamd-Result: default: False [-3.26 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.947,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.32)[ipnet: 2607:f8b0::/32(-0.28), asn: 15169(-1.27), country: US(-0.06)]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[b.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.98)[-0.978,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2018 10:23:56 -0000 On Mon, Nov 5, 2018, 3:45 AM Piotr Kubaj via freebsd-ppc > ZFS is by default not available for partitioning in bsdinstall. We can, h= owever, use manual partitioning in shell to make ZFS partitions. > > But what if we want to do ZFS on /? This is currently not supported out-o= f-the-box. The reason is that Petitboot, used on POWER9 to boot kernel, doe= sn't support loading modules (at least when booting FreeBSD). ZFS is by def= ault distributed only as a module, to overcome licensing issues. > > There are two ways to boot ZFS on root with Petitboot: > 1. We can use initramfs, which will load necessary modules. It's said to = be supported on FreeBSD/powerpc64, but no one knows how to create one for F= reeBSD :) > 2. We can actually compile a custom kernel with ZFS in it (not as a modul= e). This the approach that I use. Unfortunately, I can't redistribute this = kernel, because of ZFS's license. I created a custom installation iso, whic= h uses my kernel with ZFS included. > > Here are the steps to do it (on an installed powerpc64 system, but should= be possible on other architectures after redefining TARGET and TARGET_ARCH= ): > 1. cd /usr/src/sys/powerpc/conf > 2. cat << EOF > ZFS > include GENERIC64 > options ZFS > EOF > 3. cd ../../../ > 3. make buildworld buildkernel KERNCONF=3DZFS > 4. cd release > 5. make release > > When it's done, there will be iso files in /usr/obj/usr/src/powerpc.power= pc64/release. > > You can use it to install ZFS on root. > > Note that you need a FAT32 partition to mount on /boot. > This partition needs to have /boot/etc/kboot.conf file, with a line like: > FreeBSD=3D'/kernel/kernel kernelname=3D/boot/kernel/kernel vfs.root.mount= from=3Dzfs:zroot/ROOT/default' > > You also need the appriopriate /etc/fstab: > /dev/nda0p1 /boot msdosfs rw 2 2 > > Other than that, howto at https://wiki.freebsd.org/RootOnZFS/GPTZFSBoot#C= reate_Partitions (from point 2., omit 1.) is totally ok to follow. > > Thanks to mmacy for informing me about this little trick with including Z= FS to kernel. > > -- > _________________________________________ > / It has been said that man is a rational \ > | animal. All my life I have been | > | searching for evidence which could | > | support this. | > | | > \ -- Bertrand Russell / > ----------------------------------------- > \ ^__^ > \ (oo)\_______ > (__)\ )\/\ > ||----w | > || || I don't think there are any license issues distributing a FreeBSD kernel with ZFS statically linked like there are with Linux. For a long time it wasn't supported and ZFS will probably never be in GENERIC but a custom kernel with ZFS built in should be freely redistributable. I don't claim to be an expert on the license issues so if someone else has better information feel free correct me. -Bill Sorenson From owner-freebsd-fs@freebsd.org Mon Nov 5 18:12:24 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C34751107F15 for ; Mon, 5 Nov 2018 18:12:23 +0000 (UTC) (envelope-from matthew.ahrens@delphix.com) Received: from mail-vk1-xa35.google.com (mail-vk1-xa35.google.com [IPv6:2607:f8b0:4864:20::a35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E1C586BFF6 for ; Mon, 5 Nov 2018 18:12:22 +0000 (UTC) (envelope-from matthew.ahrens@delphix.com) Received: by mail-vk1-xa35.google.com with SMTP id 197so2242803vkf.4 for ; Mon, 05 Nov 2018 10:12:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphix.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=e0nuVUTA47/SnDAz3bClnr9Oc0tPtKetRKxdQBlmXlQ=; b=ElpWyrhspKNpHAOzM3/yEzKq6/JENrlAOEMP8qhuygifnOef5GZoRjIwjmpGcmZ81/ UtKfOVXrYe96ytGRKuFSmEtzSEL+6md0XB8EmDN8shwHIYRAXlnyx7qFs4L0uUM6MpWB Qkfo0hUruIhstHwuDE/uOOZkZvHNaKVEc/dNU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=e0nuVUTA47/SnDAz3bClnr9Oc0tPtKetRKxdQBlmXlQ=; b=KhaYL+w8M3TxO6Cni1XYmwP+ZvoYbyn1wXcWloMI2QtB5zW/dqt6gcB198PDZOl618 Yfc7rL3cIkDf7cxyF2oGBUFM7mkR5MryuUIsMZBRCogar1Le+HdkRyquMuVfR1t01Jvu fp7C+ghZ+DtKkFkwQhyxKTUv6jVUgRZ6w3+ojB8mGatyKZ4k3sPqlpLdrFk1RMkxlafZ /1q/1oHGyUHPCv7ic+46NyP3j5Yo0SM//EXVDYV5nEN3u4NS/ghqaVTKDJemKZvOQojD MIsmL7nBeWa3BrQbqyK9Hig2ybao5ATogzveaHb87v+7iucJuFXvXl9e2lBr9rHaSos+ p7yQ== X-Gm-Message-State: AGRZ1gLVuFDJqUSN56eSYji5A2BQJR2psCrNL9YW8FjVomUJR1ievyqz rb/V4aPnZAhbkn4sC3Dv1Y8SIL7AJMD7XE2ZcXMrag== X-Google-Smtp-Source: AJdET5daoZoOcLyMEOXbFVAdGava4emgqP08LQ19d4HmC+ZUfyumczKOraE8Os5iwcHCFBsnXu12j8tGF2HYxVIz7C8= X-Received: by 2002:a1f:6b14:: with SMTP id g20mr3335543vkc.47.1541441172870; Mon, 05 Nov 2018 10:06:12 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Matthew Ahrens Date: Mon, 5 Nov 2018 10:06:01 -0800 Message-ID: Subject: Second OpenZFS Leadership Meeting To: developer , illumos-zfs , zfs-devel@list.zfsonlinux.org, zfs-devel@freebsd.org, freebsd-fs , zfs-discuss X-Rspamd-Queue-Id: E1C586BFF6 X-Spamd-Result: default: False [3.34 / 200.00]; RSPAMD_URIBL(4.50)[zoom.us]; ARC_NA(0.00)[]; R_DKIM_ALLOW(0.00)[delphix.com]; NEURAL_HAM_MEDIUM(-0.87)[-0.870,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_FIVE(0.00)[6]; BAD_REP_POLICIES(0.10)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[delphix.com:+]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DMARC_POLICY_ALLOW(0.00)[delphix.com,none]; RCVD_IN_DNSWL_NONE(0.00)[5.3.a.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.16)[-0.159,0]; FORGED_SENDER(0.30)[mahrens@delphix.com,matthew.ahrens@delphix.com]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.42)[ipnet: 2607:f8b0::/32(-0.61), asn: 15169(-1.44), country: US(-0.06)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[mahrens@delphix.com,matthew.ahrens@delphix.com]; GREYLIST(0.00)[pass,body]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2018 18:12:24 -0000 The second OpenZFS Leadership meeting will be held *November 6th, 1:00-1:30pm Pacific time*, and we plan to hold this every 4 weeks thereafter. Everyone is welcome to attend and participate, and we will try to keep the meeting on agenda and on time. The meetings will be held online via Zoom , and recorded and posted to the website and YouTube after the meeting. The agenda for the meeting will be a discussion of *feature availability on each platform*, with a goal of finding owners for everything in the "integrated to at least one platform" section. For more information and details on how to attend, as well as notes and video from the previous meeting, please see the agenda document: https://docs.google.com/document/d/1w2jv2XVYFmBVvG1EGf-9A5HBVsjAYoLIFZAnWHhV-BM/edit --matt From owner-freebsd-fs@freebsd.org Tue Nov 6 10:09:20 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8592F110E4CA for ; Tue, 6 Nov 2018 10:09:20 +0000 (UTC) (envelope-from francois@billard.me) Received: from mail-oi1-x22b.google.com (mail-oi1-x22b.google.com [IPv6:2607:f8b0:4864:20::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A24F66FF83 for ; Tue, 6 Nov 2018 10:09:19 +0000 (UTC) (envelope-from francois@billard.me) Received: by mail-oi1-x22b.google.com with SMTP id g188-v6so4245058oif.8 for ; Tue, 06 Nov 2018 02:09:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=billard-me.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=ZjhQPx3Pfb4DerZId5KhAlgj9AlNicuk4c+mGiZwKMk=; b=PQV5N7jmqUKt+Q6ST8yeGyBWPN6bwCXxvmWM5c/OmvOr8j5IFukg/IhKaZ2s9CM+JV GElQnJoeTkrcErc4LGMxduXwZG739LzIFaWlwu2b0a7dL5i6P5R4WFbYE3VbXOsEhMeM +aJ/EKjhn7YIBFU5voPJ9MoB6mNWf5JTsUTjwv4hUErmjxC8Q0GGF6g5x55eCYrLxc56 +MN3aHwIWt6XAwMOS6EZ+4oFGFXrqeMXUuNgoh+6vJdbNdfKzykINv2UEx6Uk7kAVfpe JQaRI3v3lfEgpTKaNBOmm1EVdlwZ/hfoJkZhOgSNXXus3jMqaQxsqMPqGyiZiPtC3FaQ NReA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=ZjhQPx3Pfb4DerZId5KhAlgj9AlNicuk4c+mGiZwKMk=; b=IWslFl7w0N1V2lIGI7tKVJArGQ8Ng4EDiUzRb6+LynZnSfUpoO1VGlQDlpssJePaVk NqZqj9cMUyUTr81Z0hlyRShpzUbfFFnR5slL4icnqEPiBN9hMZVkk9+hh9UwlZku7ssa T2e5PZIL+MwWroQWcP1rYC8OylcbXpK+KO6BdeHN4CjF6szHrCa0bVT2QpGqee9Wgftr TW7mn3jADRs5n2UPZUDoJe0S/tJR4oK2NVxoUrR+gx4UENRe3MsUGRHLeHzSN+trlUtB zbW61Hue1tliOHfPht0jz4xzC5gyFcDB4KRPAnzkM5FFd/BeUpRwRPE0wKux4Ve3QbOV FhgA== X-Gm-Message-State: AGRZ1gJd9yeMIGTfhet1nuHSSpZiN9mvEdQ7hT+/G+p+0/anL9F/4170 g8f/N5LGjKLbr7VNGHR/f7b6XPJXLRJNHU8YPdbuAKiADvw= X-Google-Smtp-Source: AJdET5ft4tNCBGGHeUErdEGoS3VdCRRtxaBtOAK6dfgUNBBvNpvyw+s+aC3hTtZ6fL6IwxC3rOzT02a/OCKogdn9PEQ= X-Received: by 2002:aca:e48d:: with SMTP id b135-v6mr15864516oih.291.1541498957935; Tue, 06 Nov 2018 02:09:17 -0800 (PST) MIME-Version: 1.0 From: Francois Billard Date: Tue, 6 Nov 2018 11:08:42 +0100 Message-ID: Subject: [ ZFS ] Resuming full recursive replication To: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: A24F66FF83 X-Spamd-Result: default: False [-3.21 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.81)[-0.813,0]; R_DKIM_ALLOW(-0.20)[billard-me.20150623.gappssmtp.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.83)[-0.834,0]; DMARC_NA(0.00)[billard.me]; DKIM_TRACE(0.00)[billard-me.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx3.googlemail.com,alt2.aspmx.l.google.com,aspmx2.googlemail.com]; RCVD_IN_DNSWL_NONE(0.00)[b.2.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.50)[-0.498,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.55)[ipnet: 2607:f8b0::/32(-1.22), asn: 15169(-1.46), country: US(-0.08)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2018 10:09:20 -0000 Hi folks, Here is my issue : On my server i have 2 datasets: tank tank/data I send a full recursive replication to my backup server, i stop the replication at the middle, tank is not finished and data don't exists yet on the backup. i grab the receive_resume_token on the backup and retry the send with -t option of ZFS send, it works and stop when tank is fully replicated, leaving tank/data not replicated !! what happened with the resursive option ? is there a way to continue the recursive replication i began ? Thanks in advance for any advice Regards, Francois From owner-freebsd-fs@freebsd.org Wed Nov 7 00:51:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09EE0110757E for ; Wed, 7 Nov 2018 00:51:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 79BF378EC5 for ; Wed, 7 Nov 2018 00:51:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 3ECF2110757B; Wed, 7 Nov 2018 00:51:39 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2DA8B110757A for ; Wed, 7 Nov 2018 00:51:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AD14A78EBA for ; Wed, 7 Nov 2018 00:51:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CCCF912044 for ; Wed, 7 Nov 2018 00:51:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA70pbLN047145 for ; Wed, 7 Nov 2018 00:51:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA70pbih047144 for fs@FreeBSD.org; Wed, 7 Nov 2018 00:51:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227784] zfs: Fatal trap 9: general protection fault while in kernel mode on shutdown Date: Wed, 07 Nov 2018 00:51:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 79BF378EC5 X-Spamd-Result: default: False [-105.67 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.46)[ip: (-9.64), ipnet: 2001:1900:2254::/48(-4.34), asn: 10310(-3.25), country: US(-0.08)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 00:51:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227784 --- Comment #17 from Mark Johnston --- Created attachment 199035 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D199035&action= =3Dedit proposed patch Would anyone hitting the problem be willing to test the attached patch? I = have only compile-tested it; please be correspondingly cautious when testing. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 7 15:48:20 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2C4E51128D99 for ; Wed, 7 Nov 2018 15:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9F7416DE49 for ; Wed, 7 Nov 2018 15:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6100D1128D98; Wed, 7 Nov 2018 15:48:19 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4FD6A1128D97 for ; Wed, 7 Nov 2018 15:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CB4786DE42 for ; Wed, 7 Nov 2018 15:48:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 0626919BD1 for ; Wed, 7 Nov 2018 15:48:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA7FmHXn057403 for ; Wed, 7 Nov 2018 15:48:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA7FmHwV057402 for fs@FreeBSD.org; Wed, 7 Nov 2018 15:48:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Wed, 07 Nov 2018 15:48:16 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grembo@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 9F7416DE49 X-Spamd-Result: default: False [-105.73 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.52)[ip: (-9.68), ipnet: 2001:1900:2254::/48(-4.46), asn: 10310(-3.38), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 15:48:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #35 from Michael Gmelin --- (In reply to Allan Jude from comment #21) Based on Andreas' documentation (https://github.com/AndiDog/zfs-lockup) I c= ould reproduce the issue both on AWS and in a bhyve VM running 11.2-p4 (on top of 12-BETA2). In both environments, Allan's patch fixed the problem for me (i.e. I can't reproduce the issue any more when running a patched kernel). --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 7 15:57:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A8131129354 for ; Wed, 7 Nov 2018 15:57:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id ECA136E598 for ; Wed, 7 Nov 2018 15:57:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id AE451112934D; Wed, 7 Nov 2018 15:57:10 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9D246112934C for ; Wed, 7 Nov 2018 15:57:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25AB06E592 for ; Wed, 7 Nov 2018 15:57:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 5692D19D3B for ; Wed, 7 Nov 2018 15:57:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA7Fv9lU075077 for ; Wed, 7 Nov 2018 15:57:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA7Fv9Bl075076 for fs@FreeBSD.org; Wed, 7 Nov 2018 15:57:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Wed, 07 Nov 2018 15:57:07 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andreas.sommer87@googlemail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: ECA136E598 X-Spamd-Result: default: False [-105.73 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.52)[ip: (-9.68), ipnet: 2001:1900:2254::/48(-4.46), asn: 10310(-3.38), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 15:57:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #36 from Andreas Sommer --- You can discard all my statements from comment 27 onwards. I made a blatant mistake while installing the patched kernel to our live CI host (where the issue appeared originally), so my repeated findings were with an old kernel. After testing again with the patched kernel, I could *not* reproduce the is= sue anymore. Will keep two instances running with the new kernel for a few days, one of them with heavy filesystem action in background loops. That will show whether the patch is complete and stable. Sorry for the confusion! --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 7 17:24:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45B32112B017 for ; Wed, 7 Nov 2018 17:24:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BAA7371C30 for ; Wed, 7 Nov 2018 17:24:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7B270112B016; Wed, 7 Nov 2018 17:24:25 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 69D9E112B015 for ; Wed, 7 Nov 2018 17:24:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EA6EE71C2D for ; Wed, 7 Nov 2018 17:24:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 2D04C1A96E for ; Wed, 7 Nov 2018 17:24:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA7HOOQp009259 for ; Wed, 7 Nov 2018 17:24:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA7HOOrq009258 for fs@FreeBSD.org; Wed, 7 Nov 2018 17:24:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Wed, 07 Nov 2018 17:24:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grembo@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: BAA7371C30 X-Spamd-Result: default: False [-105.74 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.53)[ip: (-9.69), ipnet: 2001:1900:2254::/48(-4.47), asn: 10310(-3.39), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 17:24:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #37 from Michael Gmelin --- As a side note, not directly related to this PR and its fix: While load tes= ting to provoke the problem I ran into the issue described in bug #209759 and bug #219355 (geli encrypted swap interlocks under memory pressure, resulting in "swap_pager: indefinite wait buffer" messages and essentially hanging the instance). --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 7 18:21:13 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9181C112BFA5 for ; Wed, 7 Nov 2018 18:21:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 0E91473749 for ; Wed, 7 Nov 2018 18:21:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C78F1112BFA1; Wed, 7 Nov 2018 18:21:12 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6517112BFA0 for ; Wed, 7 Nov 2018 18:21:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3FCE97373D for ; Wed, 7 Nov 2018 18:21:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 00EF51B056 for ; Wed, 7 Nov 2018 18:21:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA7ILAl8065147 for ; Wed, 7 Nov 2018 18:21:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA7ILAku065141 for fs@FreeBSD.org; Wed, 7 Nov 2018 18:21:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Wed, 07 Nov 2018 18:21:10 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 0E91473749 X-Spamd-Result: default: False [-105.74 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.53)[ip: (-9.69), ipnet: 2001:1900:2254::/48(-4.48), asn: 10310(-3.39), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 18:21:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #38 from Allan Jude --- (In reply to Michael Gmelin from comment #35) The patch I committed only stops the deadlock in the case where the vnode b= eing reclaimed belongs to a deleted file. It can still happen in other circumstances. I am wondering if the correct approach is just to limit the number of times= it can loop, and return an error. I am not sure what side effects returning an error will have. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 7 18:57:34 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 66E2C112C83A for ; Wed, 7 Nov 2018 18:57:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C7DED74D6E for ; Wed, 7 Nov 2018 18:57:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8C717112C839; Wed, 7 Nov 2018 18:57:33 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 52366112C838 for ; Wed, 7 Nov 2018 18:57:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CFDD074D68 for ; Wed, 7 Nov 2018 18:57:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 137FA1B59F for ; Wed, 7 Nov 2018 18:57:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA7IvVHu047655 for ; Wed, 7 Nov 2018 18:57:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA7IvV7I047654 for fs@FreeBSD.org; Wed, 7 Nov 2018 18:57:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Wed, 07 Nov 2018 18:57:30 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grembo@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C7DED74D6E X-Spamd-Result: default: False [-105.74 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.53)[ip: (-9.69), ipnet: 2001:1900:2254::/48(-4.48), asn: 10310(-3.40), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2018 18:57:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #39 from Michael Gmelin --- (In reply to Allan Jude from comment #38) > The patch I committed only stops the deadlock in the case where the vnode= being reclaimed belongs to a deleted file. It can still happen in other ci= rcumstances. Obviously (like avg pointed our), but the main issue in this test case was `find` iterating over files that were deleted. So beforehand it would hang 9 out of 10 times when running the test case, while I couldn't reproduce it a= fter patching the kernel. So the patch is effective for this specific scenario. Let's see if Andreas' CI runs into issues again (like he pointed out, his observations in the last two weeks were done using an unpatched kernel by accident). > I am wondering if the correct approach is just to limit the number of tim= es it can loop, and return an error. I am not sure what side effects return= ing an error will have. Based on my gut feeling this sounds dangerous, just thinking of possible scenarios where one process could cause another process to make an important write fail that way where it wasn't expected. What kind of error would you return in such a scenario, maybe EINTR? --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 9 02:01:01 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3396B110FE23 for ; Fri, 9 Nov 2018 02:01:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A520478E01 for ; Fri, 9 Nov 2018 02:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 66759110FE22; Fri, 9 Nov 2018 02:01:00 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2ADC0110FE21 for ; Fri, 9 Nov 2018 02:01:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A3C1878DFA for ; Fri, 9 Nov 2018 02:00:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DC0D4B774 for ; Fri, 9 Nov 2018 02:00:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wA920w72023959 for ; Fri, 9 Nov 2018 02:00:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wA920wIw023956 for fs@FreeBSD.org; Fri, 9 Nov 2018 02:00:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 195485] [ufs] mksnap_ffs(8) cannot create snapshot with journaled soft updates enabled Date: Fri, 09 Nov 2018 02:00:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: t_uemura@macome.co.jp X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: A520478E01 X-Spamd-Result: default: False [-105.83 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.62)[ip: (-9.78), ipnet: 2001:1900:2254::/48(-4.65), asn: 10310(-3.57), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Nov 2018 02:01:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D195485 t_uemura@macome.co.jp changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |t_uemura@macome.co.jp --- Comment #1 from t_uemura@macome.co.jp --- Hi. Is there any chance to re-enable snapshot on SU+J? Rev. 232351 and many more changes have applied to ffs_softdep.c in the past 6 years, I think snapshot support can be re-enabled on SU+J filesystem, at least via sysctl to get wider evaluation. For me, a couple of machines running recent (as of September) 11-STABLE amd64, snapshot is working without deadlock or/and panic. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 9 13:16:28 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B84C911302BB for ; Fri, 9 Nov 2018 13:16:28 +0000 (UTC) (envelope-from jack@gandi.net) Received: from gandi.net (mail12.gandi.net [IPv6:2001:4b98:dc4:5:ae1f:6bff:fe2d:9fdc]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C0B7E7AAD5 for ; Fri, 9 Nov 2018 13:16:27 +0000 (UTC) (envelope-from jack@gandi.net) Received: from thinkpad-gandi (tgordon.gandi.net [217.70.181.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gandi.net (Postfix) with ESMTPS id 27FD7160432; Fri, 9 Nov 2018 13:16:17 +0000 (UTC) Date: Fri, 9 Nov 2018 14:16:17 +0100 From: Jack Halford To: freebsd-fs@freebsd.org Cc: fatih@gandi.net Subject: d_off support Message-ID: <20181109131617.pm26wjv4eg6fqdvl@thinkpad-gandi> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline User-Agent: NeoMutt/20180716 X-Rspamd-Queue-Id: C0B7E7AAD5 X-Spamd-Result: default: False [-2.96 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:4b98:dc4:5::/64]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[gandi.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mail8.gandi.net,mail12.gandi.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.69)[-0.688,0]; IP_SCORE(-0.47)[asn: 203476(-2.31), country: FR(-0.02)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:203476, ipnet:2001:4b98:dc4::/48, country:FR]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Nov 2018 13:16:28 -0000 Hello all, With the new 'd_off' field in struct dirent, we've (gandi.net) pushed a patch[1] to add support for it in multiple filesystems. Our specific usecase is for a userspace nfs server (nfs-ganesha) with zfs. At the moment we cache direntry offsets by calling lseek once per entry, with the patch we can get the offset directly from getdirentries calls which provides a significant speedup. [1]: https://reviews.freebsd.org/D17917