From nobody Thu Nov 11 14:15:27 2021 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E011417EF0C3 for ; Thu, 11 Nov 2021 14:15:37 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [IPv6:2a01:4f8:13b:240c::25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.bsd4all.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HqkJn0RYJz4r8k for ; Thu, 11 Nov 2021 14:15:36 +0000 (UTC) (envelope-from herbert@gojira.at) Date: Thu, 11 Nov 2021 15:15:27 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1636640127; bh=QTFMQZbi2gk7DtZX56NrNPBYOrey+YZBI91a4ybD668=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=LfVdsLYOjwtCGoxf10xU6l6ROv19Be28/nv0J9agsChrpSApA7pcQ8uLhAbE9xs6r f16yjkd4ruuI1xmqlfvtMAV30U9F31UmL2aKV1kvUZc02u97xML8jgMGcIAlIdhOF3 sLpEZf/5xiq4Um1FuvnxzDJTuaE+Tu5g4wKMuPqQ38HobIqjObG13GBJ78iEmsJQO3 i6Bgz4lpOrkGH04zkMPL84wNtRJ0OQCWPeYQCghNFsleyi10iacPosOeR9pj1FPvZr /yDuX1vzAA2J43TV1WBRkL0XGdBrpvphCqiGxPoYslXRd65dWtwv7H68k79IOJZWDe uLHAgCJnAjEGQ== From: "Herbert J. Skuhra" To: stable@freebsd.org Subject: Re: cannot delete some files in stub /usr Message-ID: References: <19d4667d-ec43-5989-1b5d-e1afc056e36b@zhegan.in> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <19d4667d-ec43-5989-1b5d-e1afc056e36b@zhegan.in> X-Rspamd-Queue-Id: 4HqkJn0RYJz4r8k X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b=LfVdsLYO; dmarc=none; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 2a01:4f8:13b:240c::25 as permitted sender) smtp.mailfrom=herbert@gojira.at X-Spamd-Result: default: False [0.50 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:4f8:13b:240c::25]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[gojira.at]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(1.00)[1.000]; DKIM_TRACE(0.00)[gojira.at:+]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE] X-ThisMailContainsUnwantedMimeParts: N On Thu, Nov 11, 2021 at 06:44:20PM +0500, Eugene M. Zheganin wrote: > Hello. > > I have a server with 12.2-R, it was installed on a remote hosting witch > patched bsdinstall which didn't create the separate /usr zfs dataset. > Recently I've created one, mounted it ontop of the /, exported the / with > nfs, mounted it on the same server and tried to delete the stub /usr. > > Everything is fine except... yeah, I cannot delete some files: > > # mount > zroot/ROOT/default on / (zfs, NFS exported, local, noatime, nfsv4acls) > devfs on /dev (devfs, local, multilabel) > zroot on /zroot (zfs, local, noatime, nfsv4acls) > zroot/www on /var/www (zfs, local, noatime, nfsv4acls) > zroot/home on /home (zfs, local, noatime, nfsv4acls) > zroot/mysql on /var/db/mysql (zfs, local, noatime, nfsv4acls) > zroot/usr on /usr (zfs, local, noatime, nfsv4acls) > zroot/ports on /usr/ports (zfs, local, noatime, nfsv4acls) > zroot/ports/distfiles on /usr/ports/distfiles (zfs, local, noatime, > nfsv4acls) > 127.0.0.1:/ on /mnt/usr (nfs) > > # pwd > /mnt/usr/usr/lib32 > > # ls -l > total 1210 > -r--r--r--  1 root  wheel  1778272 11 нояб. 12:31 libc.so.7 > -r--r--r--  1 root  wheel    56492 11 нояб. 12:31 libcrypt.so.5 > -r--r--r--  1 root  wheel    19592 11 нояб. 12:31 librt.so.1 > -r--r--r--  1 root  wheel   121324 11 нояб. 12:31 libthr.so.3 > > # rm libc.so.7 > override r--r--r-- root/wheel for libc.so.7? y > rm: libc.so.7: Input/output error > > There's more in stub /usr/bin. This is what nfsv3 gives me. nfsv2 says > "operation not permitted". > > I'm aware about chflags, currently there are none: > > # ls -ol > total 1210 > -r--r--r--  1 root  wheel  - 1778272 11 нояб. 12:31 libc.so.7 > -r--r--r--  1 root  wheel  -   56492 11 нояб. 12:31 libcrypt.so.5 > -r--r--r--  1 root  wheel  -   19592 11 нояб. 12:31 librt.so.1 > -r--r--r--  1 root  wheel  -  121324 11 нояб. 12:31 libthr.so.3 Have you checked this on the server or the client? Server: # ls -lo file.img -rw-r--r-- 1 root wheel schg 1048576 11 Nov 14:59 file.img Client: # ls -lo file.img -rw-r--r-- 1 root wheel - 1048576 Nov 11 14:59 file.img -- Herbert