From owner-freebsd-questions@freebsd.org Fri Apr 10 18:01:49 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ADC9A2C493D for ; Fri, 10 Apr 2020 18:01:49 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32d.google.com (mail-wm1-x32d.google.com [IPv6:2a00:1450:4864:20::32d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48zQnS6Sb4z4Mkf for ; Fri, 10 Apr 2020 18:01:48 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x32d.google.com with SMTP id r26so3497627wmh.0 for ; Fri, 10 Apr 2020 11:01:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding:content-language; bh=VHqM+Ym6v/R2dwmC5dlsDIEJxVzqzkGXkanhtnUwD+E=; b=ka/nYAonu2VlnUb0m0tkwKPjJzGRRycNg47EKSFu2ggcjYQfsT5nAO8hDr83vA7TK1 mdXs1ar+BjkFz2ZpJtuVW0IFYZAzql7+tnziC3Wa4E7F556cEXe5H8cK6RAWknW5MJ/I RLqcqwiBdWXbEvAgzO2DVmWqBoUs0gwmBj2Bl1EyAjYyG+g4qHptC39Yw8V0hiRHJpfb VGvbFlp1SXS07w3X6OrMHqV5Fcm0bwtuOJJ3Wsz9BC7A2Dr9Tz1hXvULmEmgJDYmy442 PR8GwMfxJ7k599nD1s62+IiwdXNKQT5SwSZP2CEOHaz0HNfBZKE2Ddkag7XOV2PHV4q5 X8xw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding:content-language; bh=VHqM+Ym6v/R2dwmC5dlsDIEJxVzqzkGXkanhtnUwD+E=; b=p3b/nX3LO1sloOV6AYYDpZewOCmM/D4J47LZCSzB3rWHHq/TQVPy+4/unz48iV49T4 50My9VY5H05i+P9qEG67hTCD0kx0TKoNOn5q682A2bJwkfeIoTof9XtWNClO70ZVEChE CMQBN/yqQeqD564OslrKEd0eVMBk81PcDmkSDmORbH48Ffa7R9kJyM3b1fpZl+c2Nb+/ zz7kVr7ssgtZOiQzzsIv6U40uZ9erG9HZyFligslWJ8m/zC+5vrFQdZ37Yz0pva+HjQP J9fwnTzFbh2ctUVx3LRIb/zovTTxgX4L0GIoKNAoKk+b3Fyq5EC25ICFpE80AH7OayOp q5+Q== X-Gm-Message-State: AGi0Pua20DeWK3oUrtAXdTSCJIiQe8qyYQpmzuhtCxKLb5WMX6viXoR6 KKjbOGfLFKoXBND2dKZoULGy2mjwwJs= X-Google-Smtp-Source: APiQypIUnCQ7I/xyUeuKw1AhYFFfBO3y/VIhcsJZ4j0F344pFocjWXah9LO6SLIWY6s6ZdrV4yHOZQ== X-Received: by 2002:a05:600c:2255:: with SMTP id a21mr6243381wmm.150.1586541706144; Fri, 10 Apr 2020 11:01:46 -0700 (PDT) Received: from [192.168.1.7] (79-66-147-78.dynamic.dsl.as9105.com. [79.66.147.78]) by smtp.gmail.com with ESMTPSA id x8sm4175803wrn.27.2020.04.10.11.01.45 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 10 Apr 2020 11:01:45 -0700 (PDT) To: freebsd-questions@freebsd.org From: Graham Perrin Subject: Can't remove files from a directory that was partially used by a jail Message-ID: <22daa8dc-cb20-6b08-b85f-161e6aca06ec@gmail.com> Date: Fri, 10 Apr 2020 19:01:42 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 48zQnS6Sb4z4Mkf X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ka/nYAon; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32d as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RECEIVED_SPAMHAUS_PBL(0.00)[78.147.66.79.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(0.00)[ip: (-9.08), ipnet: 2a00:1450::/32(-2.36), asn: 15169(-0.43), country: US(-0.05)]; RCVD_IN_DNSWL_NONE(0.00)[d.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Apr 2020 18:01:49 -0000 Below, I can't remove files to make way for (re)creation of a jail. Any suggestions? If it helps: at some point a few hours ago I might have accidentally begun (then cancelled) a bulk operation whilst using a different boot environment; the build began with a warning about the jail being newer than the host. root@momh167-gjp4-8570p:~ # poudriere jail -c -j head -v head -a amd64 -m src=/usr/src [00:00:00] Error: Directory /usr/local/poudriere/jails/head already exists root@momh167-gjp4-8570p:~ # poudriere jail -l JAILNAME VERSION ARCH METHOD TIMESTAMP PATH root@momh167-gjp4-8570p:~ # rm -rf /usr/local/poudriere/jails/head rm: /usr/local/poudriere/jails/head/libexec/ld-elf32.so.1: Operation not permitted rm: /usr/local/poudriere/jails/head/libexec/ld-elf.so.1: Operation not permitted rm: /usr/local/poudriere/jails/head/libexec: Directory not empty rm: /usr/local/poudriere/jails/head/sbin/init: Operation not permitted rm: /usr/local/poudriere/jails/head/sbin: Directory not empty rm: /usr/local/poudriere/jails/head/var/empty: Operation not permitted rm: /usr/local/poudriere/jails/head/var: Directory not empty rm: /usr/local/poudriere/jails/head/usr/lib32/libthr.so.3: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/lib32/librt.so.1: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/lib32/libcrypt.so.5: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/lib32/libc.so.7: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/lib32: Directory not empty rm: /usr/local/poudriere/jails/head/usr/bin/login: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/crontab: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/opiepasswd: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/chpass: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/opieinfo: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/passwd: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin/su: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/bin: Directory not empty rm: /usr/local/poudriere/jails/head/usr/lib/librt.so.1: Operation not permitted rm: /usr/local/poudriere/jails/head/usr/lib: Directory not empty rm: /usr/local/poudriere/jails/head/usr: Directory not empty rm: /usr/local/poudriere/jails/head/lib/libcrypt.so.5: Operation not permitted rm: /usr/local/poudriere/jails/head/lib/libc.so.7: Operation not permitted rm: /usr/local/poudriere/jails/head/lib/libthr.so.3: Operation not permitted rm: /usr/local/poudriere/jails/head/lib: Directory not empty rm: /usr/local/poudriere/jails/head: Directory not empty root@momh167-gjp4-8570p:~ # rm /usr/local/poudriere/jails/head/libexec/ld-elf32.so.1 override r-xr-xr-x root/wheel schg for /usr/local/poudriere/jails/head/libexec/ld-elf32.so.1? y rm: /usr/local/poudriere/jails/head/libexec/ld-elf32.so.1: Operation not permitted root@momh167-gjp4-8570p:~ # zfs list NAME                                           USED  AVAIL  REFER MOUNTPOINT copperbowl                                     312G   122G    88K /copperbowl copperbowl/ROOT                               94.8G   122G    88K none copperbowl/ROOT/Waterfox                       314M   122G  59.3G  / copperbowl/ROOT/r357746g                      1.22M   122G  59.8G  / copperbowl/ROOT/r357746h                      1.37M   122G  60.0G  / copperbowl/ROOT/r359628c                      19.1G   122G  60.9G  / copperbowl/ROOT/r359750a                      1.37M   122G  61.4G  / copperbowl/ROOT/r359750b                      75.0G   122G  60.7G  / copperbowl/ROOT/r359750c                       392M   122G  62.7G  / copperbowl/iocage                             4.35G   122G  3.68M /copperbowl/iocage copperbowl/iocage/download                     359M   122G    88K /copperbowl/iocage/download copperbowl/iocage/download/12.0-RELEASE        359M   122G   359M /copperbowl/iocage/download/12.0-RELEASE copperbowl/iocage/images                        88K   122G    88K /copperbowl/iocage/images copperbowl/iocage/jails                       2.75G   122G    88K /copperbowl/iocage/jails copperbowl/iocage/jails/jbrowsers             2.75G   122G    92K /copperbowl/iocage/jails/jbrowsers copperbowl/iocage/jails/jbrowsers/root        2.75G   122G  3.99G /copperbowl/iocage/jails/jbrowsers/root copperbowl/iocage/log                          100K   122G   100K /copperbowl/iocage/log copperbowl/iocage/releases                    1.24G   122G    88K /copperbowl/iocage/releases copperbowl/iocage/releases/12.0-RELEASE       1.24G   122G    88K /copperbowl/iocage/releases/12.0-RELEASE copperbowl/iocage/releases/12.0-RELEASE/root  1.24G   122G  1.24G /copperbowl/iocage/releases/12.0-RELEASE/root copperbowl/iocage/templates                     88K   122G    88K /copperbowl/iocage/templates copperbowl/poudriere                          29.6G   122G    88K /copperbowl/poudriere copperbowl/poudriere/data                     1.92G   122G    96K /usr/local/poudriere/data copperbowl/poudriere/data/.m                    88K   122G    88K /usr/local/poudriere/data/.m copperbowl/poudriere/data/cache                 88K   122G    88K /usr/local/poudriere/data/cache copperbowl/poudriere/data/logs                1.48G   122G  1.48G /usr/local/poudriere/data/logs copperbowl/poudriere/data/packages             446M   122G   446M /usr/local/poudriere/data/packages copperbowl/poudriere/data/wrkdirs               88K   122G    88K /usr/local/poudriere/data/wrkdirs copperbowl/poudriere/jails                      88K   122G    88K /copperbowl/poudriere/jails copperbowl/poudriere/ports                    27.7G   122G    88K /copperbowl/poudriere/ports copperbowl/poudriere/ports/default            27.7G   122G  27.7G /usr/local/poudriere/ports/default copperbowl/tmp                                 456K   122G   456K /tmp copperbowl/usr                                 179G   122G    88K /usr copperbowl/usr/home                            175G   122G   159G /usr/home copperbowl/usr/ports                          1.90G   122G  1.90G /usr/ports copperbowl/usr/src                            2.09G   122G  2.09G /usr/src copperbowl/var                                4.65G   122G    88K /var copperbowl/var/audit                            88K   122G    88K /var/audit copperbowl/var/crash                          1.27M   122G  1.27M /var/crash copperbowl/var/log                            14.5M   122G  14.5M /var/log copperbowl/var/mail                            128K   122G   128K /var/mail copperbowl/var/tmp                            4.64G   122G  4.64G /var/tmp root@momh167-gjp4-8570p:~ #