From owner-freebsd-fs@freebsd.org Wed Nov 4 22:08:24 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8DCDF467DC0 for ; Wed, 4 Nov 2020 22:08:24 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-il1-f170.google.com (mail-il1-f170.google.com [209.85.166.170]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRLPz4G7Pz4MG1; Wed, 4 Nov 2020 22:08:23 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-il1-f170.google.com with SMTP id x20so20707947ilj.8; Wed, 04 Nov 2020 14:08:23 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=aXY/hHHQzMclvYjMKrsrqPqbHPyXmnZQBi6+hoojU1E=; b=pdGGIbUvY78KfuX06ulFME/WsQOs+RZ2dPlMAv1xlpQwzTh0r+ucLEB86JdRdIG1dQ v/cfJvwSAAtfSDbQWQOoJsqxAy2DWl5UxoCeL6CMzSSeE6mvqOguhpD+fH5VGmfechwy z4jO1zHT3qQqlii56ggF/r9SnHdZfI1t9yrmAB8LbF/l4jGzQxN6Kilgj2gIdiWkgbgJ KWe0b1u0eYZfw+F9w5YVUcAAUjghQVoIxCAyDEy+8Min0/vzfaiMrBuUix7GEtKMkopG UIKk27RoKXeoRmYreIXvPjul8odObtNVP7U41OtHGAXN2i06KL9cDiGOydUfVHEHibe+ PfMg== X-Gm-Message-State: AOAM530oTFvqvzK6Cq76nWgaDwo0Ng3QhbZw+ulWR22vklgUH6HC7t08 7xXD70Ob+ny6Esvp6uldJKQVBnpgg7w9BDws1k8= X-Google-Smtp-Source: ABdhPJxI+bnS+8+pm1paNWgvNWFfHkoCSI6iI4qWcO4ITfFigu/wyPVfsnmkqpkjUGA/UdCFNWFjcOb1KbE5v5hFhi4= X-Received: by 2002:a92:4a0d:: with SMTP id m13mr37056ilf.100.1604527702525; Wed, 04 Nov 2020 14:08:22 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Ed Maste Date: Wed, 4 Nov 2020 17:08:10 -0500 Message-ID: Subject: Re: Always-0 NFS statistics To: Rick Macklem Cc: Alan Somers , freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4CRLPz4G7Pz4MG1 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.170 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-2.31 / 15.00]; RCVD_TLS_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEFALL_USER(0.00)[carpeddiem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.04)[-1.044]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.28)[-0.276]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.170:from]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.170:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 22:08:24 -0000 On Thu, 22 Oct 2020 at 21:46, Rick Macklem wrote: > > >nfsstat's name kernel name > >Retfailed srv_errs > >Faults srvrpc_errs > >Idem srvcache_idemdonehits > I believe these are left over from when the code was originally written > for OpenBSD2.6, which did not have a separate kernel RPC, where the > NFS code did the RPC calls. > > I suppose they should have been deleted from the FreeBSD port once > it was incorporated into FreeBSD using the kernel RPC, but they were > not. > > Revising the nfsstats structure yet again is a bother. > I suppose you could modify nfsstats.c so that it never displays these > fields. I doubt that would be considered a POLA violation. Would it make sense to also rename them to int reserved_{1,2,3} to make it clear in kernel that they're unused? From owner-freebsd-fs@freebsd.org Wed Nov 4 22:38:00 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C30134687B3 for ; Wed, 4 Nov 2020 22:38:00 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f170.google.com (mail-oi1-f170.google.com [209.85.167.170]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRM483CJPz4Nbg; Wed, 4 Nov 2020 22:38:00 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f170.google.com with SMTP id d9so17966903oib.3; Wed, 04 Nov 2020 14:38:00 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=IcdcrsE6G9kGLwDSKpu73HKEI0wyUuaqTvInNwI+4yY=; b=ZPeitIqwufo07pkNgqbl3+gd09aro/bfuKWZwQD33i8FcS9nRKId6+O2g71obO9URA Fd3ML2UhjHJTxleBjN7nU9Y3Q5FQQqR6fF414hD8lF43fuwvc9zhAZeuv/pagbuCg5Hu tD/sdSJad17yHQ+Qm7Tqcdg/vSFT3qq81pIiAj5ElkysoNGOuS4gN1hwcBfudUt2HcmO LIhK55NdMmlA79zmRCoBMdvBtmn6m6ziJq03qVxpHBNupPrJpGgSEge242NPI/9CrxGA 71W9s/JmWBw9I31SGwasbZTnJ0IKh+N0Daey0dPtbWqyIQV/0t350thu2D/srqKqcHyJ 0Gdw== X-Gm-Message-State: AOAM531NeQBLd3Sn6V9oVFK2lA7n1y+0bZR7oSHZu+8nAJUa5tcWcwH9 tVqajZeuVuBT7hAI9gXFek5ey1/XGtIoKR7lBBJEFtbOVdQ= X-Google-Smtp-Source: ABdhPJytHbr+Zxl/SIixjYi1CeY7FjI0TtiKbeaHwkQnKpJ3B0VipxQqFVhdvawgrISV17AE2CrTBk3YHU4iDzyJ1Rs= X-Received: by 2002:aca:e185:: with SMTP id y127mr7055oig.57.1604529478928; Wed, 04 Nov 2020 14:37:58 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Wed, 4 Nov 2020 15:37:48 -0700 Message-ID: Subject: Re: Always-0 NFS statistics To: Ed Maste Cc: Rick Macklem , Alan Somers , freebsd-fs X-Rspamd-Queue-Id: 4CRM483CJPz4Nbg X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 22:38:00 -0000 On Wed, Nov 4, 2020 at 3:08 PM Ed Maste wrote: > On Thu, 22 Oct 2020 at 21:46, Rick Macklem wrote: > > > > >nfsstat's name kernel name > > >Retfailed srv_errs > > >Faults srvrpc_errs > > >Idem srvcache_idemdonehits > > I believe these are left over from when the code was originally written > > for OpenBSD2.6, which did not have a separate kernel RPC, where the > > NFS code did the RPC calls. > > > > I suppose they should have been deleted from the FreeBSD port once > > it was incorporated into FreeBSD using the kernel RPC, but they were > > not. > > > > Revising the nfsstats structure yet again is a bother. > > I suppose you could modify nfsstats.c so that it never displays these > > fields. I doubt that would be considered a POLA violation. > > Would it make sense to also rename them to int reserved_{1,2,3} to > make it clear in kernel that they're unused? > Yes, that would be a good idea. From owner-freebsd-fs@freebsd.org Fri Nov 6 14:05:05 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 15AEE2EF75A for ; Fri, 6 Nov 2020 14:05:05 +0000 (UTC) (envelope-from ali.abdallah@suse.com) Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp2.suse.de", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSMbN1RgDz3pq1 for ; Fri, 6 Nov 2020 14:05:03 +0000 (UTC) (envelope-from ali.abdallah@suse.com) X-Virus-Scanned: by amavisd-new at test-mx.suse.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1604671502; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=/BTQCOY4dgSwpDG90bk917H3+r5mWLOlJFRF9ij6P7Y=; b=KKdEXH+3cQm1YDdYTmIPj1WGJ0A4/B/Zu7U8f+WJ0xUXOv/y4gzrJcrkYx+vigCACVGQC6 O3PUttBWnpRH7jXL6SD572eDWamaRTOZivkIfzo82BPqPPjjTztoW+oD599XSiHehP/dQU cKS/4V6SGtygPeviE+SYPvRdY1dRpLM= Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 5C6E6ABCC for ; Fri, 6 Nov 2020 14:05:02 +0000 (UTC) Date: Fri, 6 Nov 2020 15:05:01 +0100 From: Ali Abdallah To: freebsd-fs@freebsd.org Subject: Cannot remove zfs empty directory Message-ID: <20201106140501.kdlrytkjtqzuyd5t@frix230> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline X-Rspamd-Queue-Id: 4CSMbN1RgDz3pq1 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=suse.com header.s=susede1 header.b=KKdEXH+3; dmarc=pass (policy=none) header.from=suse.com; spf=pass (mx1.freebsd.org: domain of ali.abdallah@suse.com designates 195.135.220.15 as permitted sender) smtp.mailfrom=ali.abdallah@suse.com X-Spamd-Result: default: False [-5.20 / 15.00]; MID_RHS_NOT_FQDN(0.50)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[suse.com:s=susede1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[suse.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.135.220.15]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[195.135.220.15:from]; RCPT_COUNT_ONE(0.00)[1]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCVD_IN_DNSWL_MED(-0.20)[195.135.220.15:from]; DKIM_TRACE(0.00)[suse.com:+]; DMARC_POLICY_ALLOW(-0.50)[suse.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29298, ipnet:195.135.220.0/22, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 14:05:05 -0000 Hello, I'm having a strange issue deleting an empty folder on the zfs dataset zroot/usr/home $ cd $HOME/.cache/chromium/Default $ ls -la drwx------ 3 ali ali 3 Nov 6 14:40 ./ drwx------ 3 ali ali 3 Nov 6 14:33 ../ drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ $ rm -rf cache rm: cache/: Directory not empty $ ls -ld cache drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ the size is 4, which is strange since the directory looks totally empty. ls -la cache/ drwxr-xr-x 2 ali ali 4 Oct 19 11:30 ./ drwx------ 3 ali ali 3 Nov 6 14:40 .. I don't have chromium since long time, originally the machine was running FreeBSD 12.1 (now running FreeBSD 12.2), but the issue was present before the upgrade. zpool status -v gives not errors at all. It is not a big deal, but just trying to understand what is happening here. Regards, Ali From owner-freebsd-fs@freebsd.org Fri Nov 6 15:20:17 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A765A44149A for ; Fri, 6 Nov 2020 15:20:17 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSPG852PQz3t7d for ; Fri, 6 Nov 2020 15:20:15 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mail-wr1-x430.google.com with SMTP id g12so1696920wrp.10 for ; Fri, 06 Nov 2020 07:20:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :mime-version:content-transfer-encoding; bh=SrdkteQJozf5VV9z2BbZN8JSKupmYo9SHB/cU5Pmjmk=; b=CT/iiydbay15GAmMKEElsdRoU24FhFujk6v4mvXsNAJ18JYPoiUgpNp3KIsctN+mTR Ix5xHmqkBln6xfZ0VT+SJZqpE/hv7ZW9tApNYhzEDEd9T4rAqvr/iglCNAw7Y701soBI TsiNInGaA4/YbPAkfRtjZWomqmBzEwjnRIA7yfP9GGCjS7/KdiZHzqurqPxLM6ZunRXw /qBtj+3A6q59aOX8jgJQclsAeIiZK2/TG6EP5bUA5BHU7G2Xuptgrs9/3p9BGAaCYQDG 1Qp5x1sObEarFmYC+o+d2LHf9Xo8efzvpTK9OCaxGtXDZiJ7qUla7TFfCQ20VamQ0qPy FojA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:reply-to:mime-version:content-transfer-encoding; bh=SrdkteQJozf5VV9z2BbZN8JSKupmYo9SHB/cU5Pmjmk=; b=PHkd+qFUuIUlWuYTJLobfADWglggdO04NOwNuL5WvsOnH6xiURH+nMt5tciaBwGOUH sUUvOG52HlRR/4+llrwGhU5UxoeffeekYAFJ3BOUP4Cv9dxZuRiVy95Vdoc6vNnpcEPW FUXzkd0biuhWQlp4e1NbK6e8omEhdoNBSaukC47VajVotKbPxYukivTGpEDQRN1yUH2O fjDSUHfPmiM3fg2k71Bng84tGNMtsEGX6kIxIVQdRAmX94CqUwHRlGp5HyW7Sc7OxZ0r S9K2ELiHP68jsNW8eH5M71jXMD8Ox/167kTsZbdarRWVJlG15JP1zOWA2Zv6LgJh5qUL WGKQ== X-Gm-Message-State: AOAM533GYIT36GqN3pZd8j4XznmkjdQKV/K23j4bAbvM4O61XtBgldDV yiFWtH6SZi2kA8JxvG2j02Q= X-Google-Smtp-Source: ABdhPJwqfkAP+Zho9x5Zi7XzgCEYV4JPFZCmKfruA0ZFzHSqRQKA7kWZwnoxZI1/y5xm/liS5VarmA== X-Received: by 2002:adf:df88:: with SMTP id z8mr3197826wrl.113.1604676013439; Fri, 06 Nov 2020 07:20:13 -0800 (PST) Received: from ernst.home (pd9e23482.dip0.t-ipconnect.de. [217.226.52.130]) by smtp.gmail.com with ESMTPSA id v19sm2615656wmj.31.2020.11.06.07.20.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 06 Nov 2020 07:20:12 -0800 (PST) Date: Fri, 6 Nov 2020 16:20:08 +0100 From: Gary Jennejohn To: Ali Abdallah Cc: freebsd-fs@freebsd.org Subject: Re: Cannot remove zfs empty directory Message-ID: <20201106152008.2e78020f@ernst.home> In-Reply-To: <20201106140501.kdlrytkjtqzuyd5t@frix230> References: <20201106140501.kdlrytkjtqzuyd5t@frix230> Reply-To: gljennjohn@gmail.com X-Mailer: Claws Mail 3.17.5 (GTK+ 2.24.32; amd64-portbld-freebsd13.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSPG852PQz3t7d X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=CT/iiydb; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of gljennjohn@gmail.com designates 2a00:1450:4864:20::430 as permitted sender) smtp.mailfrom=gljennjohn@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; HAS_REPLYTO(0.00)[gljennjohn@gmail.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.99)[-0.989]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::430:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[217.226.52.130:received]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::430:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::430:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 15:20:17 -0000 On Fri, 6 Nov 2020 15:05:01 +0100 Ali Abdallah wrote: > Hello, > > I'm having a strange issue deleting an empty folder on the zfs > dataset zroot/usr/home > > $ cd $HOME/.cache/chromium/Default > $ ls -la > drwx------ 3 ali ali 3 Nov 6 14:40 ./ > drwx------ 3 ali ali 3 Nov 6 14:33 ../ > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > $ rm -rf cache > rm: cache/: Directory not empty > > $ ls -ld cache > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > > the size is 4, which is strange since the directory looks totally empty. > > ls -la cache/ > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 ./ > drwx------ 3 ali ali 3 Nov 6 14:40 .. > > I don't have chromium since long time, originally the machine was > running FreeBSD 12.1 (now running FreeBSD 12.2), but the issue was > present before the upgrade. > > zpool status -v gives not errors at all. > > It is not a big deal, but just trying to understand what is happening > here. > Try ls -lo. There might be some chflags(1) flags set which prevent deletion. -- Gary Jennejohn From owner-freebsd-fs@freebsd.org Fri Nov 6 15:57:33 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0425444200B for ; Fri, 6 Nov 2020 15:57:33 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-ot1-x335.google.com (mail-ot1-x335.google.com [IPv6:2607:f8b0:4864:20::335]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSQ580Rv7z4QsW for ; Fri, 6 Nov 2020 15:57:31 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: by mail-ot1-x335.google.com with SMTP id l36so1658041ota.4 for ; Fri, 06 Nov 2020 07:57:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=iMsckueaFJMnKm9VS25hnMvWdWdU6bclKD6/fVoCAPM=; b=QAZleQVfdE6WxJwb+dAl0g7j8ZG+b3Kf4QDXkGPcHONZKscFJpdH6BE5FpDq4HiyLD wJXWflNOi7BjYuIwY+cJaAIzYyKsw2eYob/hdMLxR+Gn1beCXx4MUxAsT3PKT2FBYZDN IuTBiwror9Zd9/k0lQNj0V3vGXrw37H1OH0oANGsYjSIQDZYhgV3qX82saUpGFfTEKTP n8navOISVnNConLRF+4N+XEGqQbfVOcW1//+ChzyPhd/j1AnJKFkNW8+pTqHDq/UeXXf eTqUIOwPg+KRakuqsIPBc095tpIvFBnziV4O7ZtI25tf5MrqU+1WDB+QN3ehFivQPEs1 YY1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=iMsckueaFJMnKm9VS25hnMvWdWdU6bclKD6/fVoCAPM=; b=Xs0kg8ccoJW7veKWHZg3K8l5DAPFU5/LKiLW9rOPWvKHUtrn7JLs8S8dOiqtmhkf4A YWBraThtppBCR3SrRNcI1NZ8qBdFXB8Mjh4rnwd46g4O7ebikyS7ESN/ZdKc3BknRyiz NWz2AB5B3FAqB2hb+Zy1nT+IrS69hRwnmdmlkz111BAp21azSwqxHGiaLQmBc5/6eZjJ otM+4TN8+eartQUZoXdVD6Fw1JTKy71xcjOOX1ymAR+tmoajFRgxvz/tXNB0X6dm7J8A 7tjsaEYX3XuBVhxxrXSBMZ12Z3FfvXODmu8doxaLMp/lLHJVVCw/rJyjXkBntog/apad HYPA== X-Gm-Message-State: AOAM5308UZwOZwmWQRDJKSx0Q35hCk5OlgwNWPBfz1iwXODlKis648s7 W8b7fNaivpx/xxJI1HOVIJ4Wy4IidNcdkFrdcg0= X-Google-Smtp-Source: ABdhPJxo0PZnysZ5pcyxQpaNjTgY/kz3l0u2e3zF5+blWV/W8XzNkNWo5igWVEZdOzEs4YuAUo+dJ1/Ba28zIsCPebw= X-Received: by 2002:a9d:6c4b:: with SMTP id g11mr1479529otq.265.1604678250904; Fri, 06 Nov 2020 07:57:30 -0800 (PST) MIME-Version: 1.0 References: <20201106140501.kdlrytkjtqzuyd5t@frix230> <20201106152008.2e78020f@ernst.home> In-Reply-To: <20201106152008.2e78020f@ernst.home> From: Mehmet Erol Sanliturk Date: Fri, 6 Nov 2020 18:56:52 +0300 Message-ID: Subject: Re: Cannot remove zfs empty directory To: gljennjohn@gmail.com Cc: Ali Abdallah , freebsd-fs@freebsd.org X-Rspamd-Queue-Id: 4CSQ580Rv7z4QsW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=QAZleQVf; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mesanliturk@gmail.com designates 2607:f8b0:4864:20::335 as permitted sender) smtp.mailfrom=mesanliturk@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::335:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::335:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::335:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 15:57:33 -0000 On Fri, Nov 6, 2020 at 6:20 PM Gary Jennejohn wrote: > On Fri, 6 Nov 2020 15:05:01 +0100 > Ali Abdallah wrote: > > > Hello, > > > > I'm having a strange issue deleting an empty folder on the zfs > > dataset zroot/usr/home > > > > $ cd $HOME/.cache/chromium/Default > > $ ls -la > > drwx------ 3 ali ali 3 Nov 6 14:40 ./ > > drwx------ 3 ali ali 3 Nov 6 14:33 ../ > > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > > $ rm -rf cache > > rm: cache/: Directory not empty > > > > $ ls -ld cache > > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > > > > the size is 4, which is strange since the directory looks totally empty. > > > > ls -la cache/ > > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 ./ > > drwx------ 3 ali ali 3 Nov 6 14:40 .. > > > > I don't have chromium since long time, originally the machine was > > running FreeBSD 12.1 (now running FreeBSD 12.2), but the issue was > > present before the upgrade. > > > > zpool status -v gives not errors at all. > > > > It is not a big deal, but just trying to understand what is happening > > here. > > > > Try ls -lo. There might be some chflags(1) flags set which prevent > deletion. > > -- > Gary Jennejohn > _______________________________________________ > > Also there may be a file with a "blank" name . Mehmet Erol Sanliturk From owner-freebsd-fs@freebsd.org Fri Nov 6 20:52:42 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 373F92D1C5D; Fri, 6 Nov 2020 20:52:42 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from relay11.mail.gandi.net (relay11.mail.gandi.net [217.70.178.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSXdj1tj0z4l90; Fri, 6 Nov 2020 20:52:40 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from [192.168.0.88] (east.meadow.volia.net [93.72.151.96]) (Authenticated sender: andriy.gapon@uabsd.com) by relay11.mail.gandi.net (Postfix) with ESMTPSA id AB2EA100002; Fri, 6 Nov 2020 20:52:38 +0000 (UTC) To: freebsd-current@FreeBSD.org, freebsd-fs@FreeBSD.org From: Andriy Gapon Subject: panic: VERIFY(ZFS_TEARDOWN_READ_HELD(zfsvfs)) failed Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; keydata= mDMEX1iFDhYJKwYBBAHaRw8BAQdAiu8JG/oLFkVkOAJqJc7Dx5KI/Q6C3SBI20EQm+DXnAu0 HkFuZHJpeSBHYXBvbiA8YXZnQEZyZWVCU0Qub3JnPoiWBBMWCAA+FiEEyCHHZM09l0OE3Ir/ 1A1+Gq8+L1EFAl9YhQ4CGwMFCQeEzgAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQ1A1+ Gq8+L1Fc0wD/ZjmhHfbCJywZU3aOxXIPjcz73FYEGMvqMCCLAWyLbSABALFL+1ZNrjV3BGjq 889cOYFuboA/Yn3eWezS+tfqYBsGuDgEX1iFDhIKKwYBBAGXVQEFAQEHQL6B20Xi600TrkpG P9fWjl7JtHNxqrHKhX6Kg7kgb4ILAwEIB4h+BBgWCAAmFiEEyCHHZM09l0OE3Ir/1A1+Gq8+ L1EFAl9YhQ4CGwwFCQeEzgAACgkQ1A1+Gq8+L1F3cgEAktp4h+IJUJxL1vn6zMOt//znni/J TanKfQuA8wGXcGkBAKpZJhqMkg+pKk7MGvJhgJ6nCpTZ+rMK6vZVZLUWc3QF Message-ID: <98c87b4f-4327-8a19-cf51-f3a14e42edf4@FreeBSD.org> Date: Fri, 6 Nov 2020 22:52:37 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSXdj1tj0z4l90 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:29169, ipnet:217.70.176.0/20, country:FR]; local_wl_from(0.00)[FreeBSD.org] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 20:52:42 -0000 The subject panic happens for me with r367410 when mounting root filesystem. The panic is in zfs_freebsd_cached_lookup -> zfs_lookup -> zfs_dirlook. I have a picture of the screen with a little bit more details, I'll share it later. -- Andriy Gapon From owner-freebsd-fs@freebsd.org Fri Nov 6 21:04:19 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D04E82D2790; Fri, 6 Nov 2020 21:04:19 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from relay7-d.mail.gandi.net (relay7-d.mail.gandi.net [217.70.183.200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSXv73jG9z4m25; Fri, 6 Nov 2020 21:04:19 +0000 (UTC) (envelope-from avg@FreeBSD.org) X-Originating-IP: 93.72.151.96 Received: from [192.168.0.88] (east.meadow.volia.net [93.72.151.96]) (Authenticated sender: andriy.gapon@uabsd.com) by relay7-d.mail.gandi.net (Postfix) with ESMTPSA id 9314820004; Fri, 6 Nov 2020 21:04:10 +0000 (UTC) Subject: Re: panic: VERIFY(ZFS_TEARDOWN_READ_HELD(zfsvfs)) failed To: Mateusz Guzik Cc: freebsd-current@freebsd.org, freebsd-fs@freebsd.org References: <98c87b4f-4327-8a19-cf51-f3a14e42edf4@FreeBSD.org> From: Andriy Gapon Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; keydata= mDMEX1iFDhYJKwYBBAHaRw8BAQdAiu8JG/oLFkVkOAJqJc7Dx5KI/Q6C3SBI20EQm+DXnAu0 HkFuZHJpeSBHYXBvbiA8YXZnQEZyZWVCU0Qub3JnPoiWBBMWCAA+FiEEyCHHZM09l0OE3Ir/ 1A1+Gq8+L1EFAl9YhQ4CGwMFCQeEzgAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQ1A1+ Gq8+L1Fc0wD/ZjmhHfbCJywZU3aOxXIPjcz73FYEGMvqMCCLAWyLbSABALFL+1ZNrjV3BGjq 889cOYFuboA/Yn3eWezS+tfqYBsGuDgEX1iFDhIKKwYBBAGXVQEFAQEHQL6B20Xi600TrkpG P9fWjl7JtHNxqrHKhX6Kg7kgb4ILAwEIB4h+BBgWCAAmFiEEyCHHZM09l0OE3Ir/1A1+Gq8+ L1EFAl9YhQ4CGwwFCQeEzgAACgkQ1A1+Gq8+L1F3cgEAktp4h+IJUJxL1vn6zMOt//znni/J TanKfQuA8wGXcGkBAKpZJhqMkg+pKk7MGvJhgJ6nCpTZ+rMK6vZVZLUWc3QF Message-ID: Date: Fri, 6 Nov 2020 23:04:09 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSXv73jG9z4m25 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 21:04:19 -0000 On 06/11/2020 22:58, Mateusz Guzik wrote: > Note the underlying primitive was recently replaced. > > One immediate thing to check would be exact state of the lock. > READ_HELD checks for reading only, fails if you have this > write-locked, which is a plausible explanation if you are coming in > from less likely codepath. > > iow what's the backtrace and can you print both rms->readers and > rms->owner (+ curthread) Unfortunately, I do not have a vmcore, only a picture of the screen. ZFS code looks correct, the lock should be held in read mode, so indeed I suspect that the problem is with rms. It looks like rms_rlock() does not change rmslock::readers, but rms_rowned() checks it? That's just from a first, super-quick look at the code. > On 11/6/20, Andriy Gapon wrote: >> >> The subject panic happens for me with r367410 when mounting root >> filesystem. >> The panic is in zfs_freebsd_cached_lookup -> zfs_lookup -> zfs_dirlook. >> I have a picture of the screen with a little bit more details, I'll share it >> later. -- Andriy Gapon From owner-freebsd-fs@freebsd.org Fri Nov 6 21:50:20 2020 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 12DCE2D4074 for ; Fri, 6 Nov 2020 21:50:20 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf1-f45.google.com (mail-lf1-f45.google.com [209.85.167.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSYwC2QJHz4qcQ for ; Fri, 6 Nov 2020 21:50:19 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf1-f45.google.com with SMTP id v144so3892361lfa.13 for ; Fri, 06 Nov 2020 13:50:18 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=GXChy5fv6NfQV1Rkr7ll88LKD+WaxpR1pzeD3mK9dxM=; b=cFMm6/aYhOHMGOIiwpIR5A+SgcRWsS6foYkw3TWelMDBpKw7tQz52cIkrPPdjOtwQo YuJ+UI77OYcpMJdBG1WDYO7cKMrL6/kOyaPO4ZCNkneteDRYrEyCo4C7ui8371sTZ6RE S9fG+xiWrfz92PMiI4k9zq6vtNnOFdJYi9d76nFT9QkdWd4Qj9C9m7bbx6YuGJndWwqm mC5OzuBkvpBslerhGMttahYTIGz9tVbgcv2UXOPsCAsv6Wjyt+MjcCGXRQu4hh0VsKzy uy8CwCdjdosLXgG1Wyy0qo95EBJ229DO+YAXL9kKPjQtnZnV54EL6QDwpqJKMS5luK0K xzTw== X-Gm-Message-State: AOAM533/1LOHotA9r2QVp69BuIF8dzjEDpHIvcDaHAcETSYsXYbtx7pf xYcajVvxMk2ttnQvUcREYTZogfEmPrjheg== X-Google-Smtp-Source: ABdhPJyHRFi8yAjmb7K9v3FUYVq9jQEg1Ozku/D1KMII34KyDVvVDAfuLHKT0qIarBlLkmfRwnKNeg== X-Received: by 2002:ac2:4422:: with SMTP id w2mr1505700lfl.219.1604699416685; Fri, 06 Nov 2020 13:50:16 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id q16sm267555ljj.32.2020.11.06.13.50.15 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 06 Nov 2020 13:50:15 -0800 (PST) Subject: Re: Cannot remove zfs empty directory To: Ali Abdallah , freebsd-fs@freebsd.org References: <20201106140501.kdlrytkjtqzuyd5t@frix230> From: Andriy Gapon Message-ID: Date: Fri, 6 Nov 2020 23:50:14 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <20201106140501.kdlrytkjtqzuyd5t@frix230> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSYwC2QJHz4qcQ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of agapon@gmail.com designates 209.85.167.45 as permitted sender) smtp.mailfrom=agapon@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[93.72.151.96:received]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.167.45:from]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; SPAMHAUS_ZRD(0.00)[209.85.167.45:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.45:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.45:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 21:50:20 -0000 On 06/11/2020 16:05, Ali Abdallah wrote: > Hello, > > I'm having a strange issue deleting an empty folder on the zfs > dataset zroot/usr/home > > $ cd $HOME/.cache/chromium/Default > $ ls -la > drwx------ 3 ali ali 3 Nov 6 14:40 ./ > drwx------ 3 ali ali 3 Nov 6 14:33 ../ > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > $ rm -rf cache > rm: cache/: Directory not empty > > $ ls -ld cache > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 cache/ > > the size is 4, which is strange since the directory looks totally empty. > > ls -la cache/ > drwxr-xr-x 2 ali ali 4 Oct 19 11:30 ./ > drwx------ 3 ali ali 3 Nov 6 14:40 .. > > I don't have chromium since long time, originally the machine was > running FreeBSD 12.1 (now running FreeBSD 12.2), but the issue was > present before the upgrade. > > zpool status -v gives not errors at all. > > It is not a big deal, but just trying to understand what is happening > here. Yet another suggestion, find inode number of the directory and its zfs dataset name, then do zdb -dddd . -- Andriy Gapon