From owner-freebsd-current@freebsd.org Sun May 3 05:05:35 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 069B72D3F35 for ; Sun, 3 May 2020 05:05:35 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x42a.google.com (mail-wr1-x42a.google.com [IPv6:2a00:1450:4864:20::42a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49FDTB0GJdz4FF5 for ; Sun, 3 May 2020 05:05:33 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x42a.google.com with SMTP id x18so16867436wrq.2 for ; Sat, 02 May 2020 22:05:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=0982GGyMT8ZeZ+kzb1cvZnn+JYIhtKaD2MNiEUPF0Hc=; b=NluyiL/8HJ9eYYrLHFrv13b/lVKqlar1qzP8kwfssfBLWUGTMLKhDEw+JcDlhUwc1z rCcT28mBd9jW2Z3ln+D/7rNcxJLuEKKjy1xEwe53aD2CqZqJcYiueWYmWOAmPQ++N+Zx HuR8soDNdsBsAl/sE/W4T4fRt+Lx57npoLlAFwlzr0wHbOuvke3C+P9lbgwu9t9/+iXk C4X79mAijpoXHNfHgESdNQkYCvTTZ6SewcRkIRy/Wh3aCYShKnpEgokuB5H/NNyJNbUu XjzPS5qN/Z8a44g3zgcU2Bv/IK1iHowneBIXQs/pQeBgL51B3BXz/uXQOflIW3dWCV3R w/hg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=0982GGyMT8ZeZ+kzb1cvZnn+JYIhtKaD2MNiEUPF0Hc=; b=lkdB5/uiHBgbp52wasfSS6Vi35cblroC4GF2AHsRxK9OR7tiYtnxW03CbGAWt4GgqD SYd46rorzgX7vUxxKRZy6vAzzJmYQAI15hw7KZ/WSOLYCfOWCOxjmp8X7LKXZs/Oanb6 hjLOgK8c3VCZ7R/Hd6qwzf8ziDaysKKd3gyE6ymcATDXaEfIzqFzY4nZyhs6n0KW9Xoj YqtbCbIrVbSv1Pm3gq5hNJv9voO3SPD93WJh7y+Q5gL/v02X1c1+Lpjg+/dBNSFJ18hU XPFleFdX92miuCCh8IK2X6Rak/BDjdrrtvKKpI+F3qJHAuwkgSgQataLNKPjItXfPxh4 ERdA== X-Gm-Message-State: AGi0PuaoGhWh/KrULbdXGf8fIyIoiEnGi1j3cSUBB46bU9ZIknjDfRqL 91lEZ+fFg73D63bDFjJbrpnfoHneJqQ= X-Google-Smtp-Source: APiQypLE0ecddlt0xmuyP1SZTdMde+vDebcYzbWWIuLsNed8mJ+VOeITmcr1s9n7jbu4QiDez9YJFA== X-Received: by 2002:adf:fe51:: with SMTP id m17mr12006842wrs.414.1588482331357; Sat, 02 May 2020 22:05:31 -0700 (PDT) Received: from [192.168.1.7] (79-66-147-78.dynamic.dsl.as9105.com. [79.66.147.78]) by smtp.gmail.com with ESMTPSA id r15sm78206wrq.93.2020.05.02.22.05.29 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 02 May 2020 22:05:30 -0700 (PDT) Subject: Re: beadm no longer able to destroy, maybe since using OpenZFS From: Graham Perrin To: freebsd-current@freebsd.org References: Message-ID: <8e30bce4-e740-2d8b-24dd-b73471bf0fab@gmail.com> Date: Sun, 3 May 2020 06:05:29 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 49FDTB0GJdz4FF5 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=NluyiL/8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::42a as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RECEIVED_SPAMHAUS_PBL(0.00)[78.147.66.79.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(0.00)[ip: (-9.33), ipnet: 2a00:1450::/32(-2.31), asn: 15169(-0.43), country: US(-0.05)]; RCVD_IN_DNSWL_NONE(0.00)[a.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 May 2020 05:05:35 -0000 After reverting from OpenZFS to ZFS, I was able to destroy two of the boot environments that previously (below, 1st May, OpenZFS) could not be destroyed. I'm left with at least one BE 'r360237c' that can not be destroyed. Is it ever normal to find a snapshot described as '-'? root@momh167-gjp4-8570p:~ # kldstat | grep zfs  2    1 0xffffffff82109000   3a8b40 zfs.ko root@momh167-gjp4-8570p:~ # date Sun May  3 05:59:06 BST 2020 root@momh167-gjp4-8570p:~ # beadm list -as BE/Dataset/Snapshot                            Active Mountpoint Space Created Waterfox   copperbowl/ROOT/Waterfox                     -      - 314.0M 2020-03-10 18:24     r360237c@2020-03-20-06:19:45               -      - 1.0G 2020-03-20 06:19 r357746h   copperbowl/ROOT/r357746h                     -      - 3.4M 2020-04-08 09:28     r360237c@2020-04-09-17:59:32               -      - 1.1G 2020-04-09 17:59 r360237c   copperbowl/ROOT/r360237c@2020-03-20-06:19:45 -      - 1.0G 2020-03-20 06:19   copperbowl/ROOT/r360237c@2020-04-09-17:59:32 -      - 1.1G 2020-04-09 17:59   copperbowl/ROOT/r360237c@2020-04-29-13:24:52 -      - 11.2M 2020-04-29 13:24   copperbowl/ROOT/r360237c                     -      - 80.4G 2020-04-29 13:24 r360237e   copperbowl/ROOT/r360237e@2020-05-01-17:58:33 -      - 96.6M 2020-05-01 17:58   copperbowl/ROOT/r360237e                     NR     / 1.3G 2020-05-01 17:58     r360237c@2020-04-29-13:24:52               -      - 11.2M 2020-04-29 13:24 root@momh167-gjp4-8570p:~ # beadm destroy r360237c Are you sure you want to destroy 'r360237c'? This action cannot be undone (y/[n]): y Boot environment 'r360237c' was created from existing snapshot Destroy '-' snapshot? (y/[n]): y cannot destroy 'copperbowl/ROOT/r360237c': filesystem has dependent clones use '-R' to destroy the following datasets: copperbowl/ROOT/r360237e@2020-05-01-17:58:33 copperbowl/ROOT/r360237e copperbowl/ROOT/r357746h copperbowl/ROOT/Waterfox root@momh167-gjp4-8570p:~ # zfs list -t snapshot NAME                                                     USED AVAIL  REFER  MOUNTPOINT copperbowl/ROOT/r360237c@2020-03-20-06:19:45            1.02G -  59.2G  - copperbowl/ROOT/r360237c@2020-04-09-17:59:32            1.15G -  60.0G  - copperbowl/ROOT/r360237c@2020-04-29-13:24:52            11.2M -  62.2G  - copperbowl/ROOT/r360237e@2020-05-01-17:58:33            96.6M -  62.3G  - copperbowl/iocage/releases/12.0-RELEASE/root@jbrowsers     8K -  1.24G  - copperbowl/poudriere/jails/head@clean                    376K -  1.91G  - copperbowl/usr/home@2020-05-03-05:55-r360237            57.7M -   171G  - root@momh167-gjp4-8570p:~ # uname -v FreeBSD 13.0-CURRENT #54 r360237: Fri Apr 24 09:10:37 BST 2020 root@momh167-gjp4-8570p:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG root@momh167-gjp4-8570p:~ # ---- On 01/05/2020 18:57, Graham Perrin wrote: > root@momh167-gjp4-8570p:~ # date ; uname -v > Fri May  1 18:52:31 BST 2020 > FreeBSD 13.0-CURRENT #54 r360237: Fri Apr 24 09:10:37 BST 2020 > root@momh167-gjp4-8570p:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG > root@momh167-gjp4-8570p:~ # beadm list > BE       Active Mountpoint  Space Created > Waterfox -      -            1.3G 2020-03-10 18:24 > r357746h -      -          928.4M 2020-04-08 09:28 > r360237b -      -          213.6M 2020-04-28 20:17 > r360237c -      -           92.0G 2020-04-29 13:24 > r360237d -      -          153.2M 2020-04-30 13:08 > r360237e NR     /          720.4M 2020-05-01 17:58 > root@momh167-gjp4-8570p:~ # beadm destroy r360237b > Are you sure you want to destroy 'r360237b'? > This action cannot be undone (y/[n]): y > cannot promote 'copperbowl/ROOT/r360237d': not a cloned filesystem > root@momh167-gjp4-8570p:~ # beadm destroy r360237c > Are you sure you want to destroy 'r360237c'? > This action cannot be undone (y/[n]): y > Boot environment 'r360237c' was created from existing snapshot > Destroy '-' snapshot? (y/[n]): y > cannot destroy 'copperbowl/ROOT/r360237c': filesystem has dependent > clones > use '-R' to destroy the following datasets: > copperbowl/ROOT/r360237e > copperbowl/ROOT/r360237d@2020-05-01-17:58:54 > copperbowl/ROOT/r360237d@2020-05-01-17:58:33 > copperbowl/ROOT/r360237d > copperbowl/ROOT/r360237b@2020-04-30-13:08:36 > copperbowl/ROOT/r360237b > copperbowl/ROOT/r357746h > copperbowl/ROOT/Waterfox > root@momh167-gjp4-8570p:~ # beadm destroy r360237d > Are you sure you want to destroy 'r360237d'? > This action cannot be undone (y/[n]): y > cannot promote 'copperbowl/ROOT/r360237e': not a cloned filesystem > root@momh167-gjp4-8570p:~ # beadm list -as > BE/Dataset/Snapshot                            Active Mountpoint Space > Created > > Waterfox >   copperbowl/ROOT/Waterfox                     -      - 314.0M > 2020-03-10 18:24 >     r360237c@2020-03-20-06:19:45               -      - 1.0G > 2020-03-20 06:19 > > r357746h >   copperbowl/ROOT/r357746h                     -      - 3.4M > 2020-04-08 09:28 >     r360237c@2020-04-09-17:59:32               -      - 925.0M > 2020-04-09 17:59 > > r360237b >   copperbowl/ROOT/r360237b                     -      - 202.4M > 2020-04-28 20:17 >     r360237c@2020-04-29-13:24:52               -      - 11.2M > 2020-04-29 13:24 >   copperbowl/ROOT/r360237b@2020-04-30-13:08:36 -      - 1.4M > 2020-04-30 13:08 > > r360237c >   copperbowl/ROOT/r360237c@2020-03-20-06:19:45 -      - 1.0G > 2020-03-20 06:19 >   copperbowl/ROOT/r360237c@2020-04-09-17:59:32 -      - 925.0M > 2020-04-09 17:59 >   copperbowl/ROOT/r360237c@2020-04-20-06:44:01 -      - 11.6G > 2020-04-20 06:44 >   copperbowl/ROOT/r360237c@2020-04-29-13:24:52 -      - 11.2M > 2020-04-29 13:24 >   copperbowl/ROOT/r360237c                     -      - 92.0G > 2020-04-29 13:24 > > r360237d >   copperbowl/ROOT/r360237d                     -      - 151.8M > 2020-04-30 13:08 >     r360237b@2020-04-30-13:08:36               -      - 1.4M > 2020-04-30 13:08 >   copperbowl/ROOT/r360237d@2020-05-01-17:58:33 -      - 440.0K > 2020-05-01 17:58 >   copperbowl/ROOT/r360237d@2020-05-01-17:58:54 -      - 408.0K > 2020-05-01 17:58 > > r360237e >   copperbowl/ROOT/r360237e                     NR     / 720.0M > 2020-05-01 17:58 >     r360237d@2020-05-01-17:58:54               -      - 408.0K > 2020-05-01 17:58 > root@momh167-gjp4-8570p:~ # zfs list -t snapshot > NAME                                                     USED AVAIL  > REFER  MOUNTPOINT > copperbowl/ROOT/r360237b@2020-04-30-13:08:36            1.36M - 62.3G  - > copperbowl/ROOT/r360237c@2020-03-20-06:19:45            1.02G - 59.2G  - > copperbowl/ROOT/r360237c@2020-04-09-17:59:32             925M - 60.0G  - > copperbowl/ROOT/r360237c@2020-04-20-06:44:01            11.6G - 61.7G  - > copperbowl/ROOT/r360237c@2020-04-29-13:24:52            11.2M - 62.2G  - > copperbowl/ROOT/r360237d@2020-05-01-17:58:33             440K - 62.3G  - > copperbowl/ROOT/r360237d@2020-05-01-17:58:54             408K - 62.3G  - > copperbowl/iocage/releases/12.0-RELEASE/root@jbrowsers     8K - 1.24G  - > copperbowl/poudriere/jails/head@clean                    384K - 1.91G  - > copperbowl/usr/home@2020-04-28-10:42-r360237            5.89G - 172G  - > root@momh167-gjp4-8570p:~ # >