From owner-freebsd-geom@freebsd.org Tue Dec 18 05:25:05 2018 Return-Path: Delivered-To: freebsd-geom@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C6C013409C3 for ; Tue, 18 Dec 2018 05:25:05 +0000 (UTC) (envelope-from jmpalacios@gmail.com) Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AF6E080522 for ; Tue, 18 Dec 2018 05:25:04 +0000 (UTC) (envelope-from jmpalacios@gmail.com) Received: by mail-pl1-x62a.google.com with SMTP id u18so7264343plq.7 for ; Mon, 17 Dec 2018 21:25:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=3ZHPgcCzDTkRoWWI7KQJBKmgQzXuFlJT4NjYNfk+F2o=; b=tPRJO+LDGGiGnqmcLCwgqpWkCmEzLvIYOMnHLQJU6QgGVe67NhNtY2fWj1/wTvGSOY NQCZDxAl2ImJwTflM+tqGqvmZ8nxvXd4X7OVNRJDkzBOypPT8yQFwtwxk+yFqrf7UJ2z lUhWGWae40avnL7xbamYdOhWyf1FijLQQKoyQ13fv8zQ0gZAFNmPilFyMgM+ExsbwMv5 iMBJqsOaJ/E9pwzeJGnqTm3/+lAvDT3lVzSkEnD1EW1/wQRTPvgCkShgdxTC/fBOMvGW eHAQeZJEt3BA86hamrI1719bb3d5mNoi5ENwGbDCToWnoVEXD+8wKb6CYN5xyCjOiG5I 9x8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=3ZHPgcCzDTkRoWWI7KQJBKmgQzXuFlJT4NjYNfk+F2o=; b=UAOM9hyPyRG9bbWP7L705phQLl0vnNAE/AR4HewjLCldv4mX/LHc17wYYeh7jGcEon 3Vd1vQ0of4PIT4DofgulV6QhdtVfhqV0O3bJAy4JJLNGn2+Y5Df6yw6VX6t8Zk6YogWG eQk8NkWRn3n90KFX/bdv13Iv0pqvfGjSZKWPsoggA5Tqe39vICoeLyy81HpnznKbHoPT wGcIPU7rom/ZjR3J2Uo3Nahapr0QmnIaG2qhKxpiGu6Ej6l/R1whG3ISKgp3RsXQNoM9 tV67zoJ41+zD7TMXWmip/Tbw7kP3TkccpoGTes5aIGdOaJ0Wv5MaJ3HqyAtx29J5BT31 jTrw== X-Gm-Message-State: AA+aEWYlE/rwfbrhZxDwzGWNOiKpsgeBlntBDAkkuoQHx9I/MrywAlfp JAj3pyusnF9rTPFzuMRM58g3ZnbFz7g2Rz2yJvZAVNvo X-Google-Smtp-Source: AFSGD/UgmwTykXEzrbPXh5bP6vyTa5vg89G+5X8BGd/rGYq8eb4W2PKNpPKkrBnrcjAbkTKcLM6fw2aWiQfCIjgR3bw= X-Received: by 2002:a17:902:280b:: with SMTP id e11mr15334084plb.269.1545110703240; Mon, 17 Dec 2018 21:25:03 -0800 (PST) MIME-Version: 1.0 From: Juan Manuel Palacios Date: Tue, 18 Dec 2018 00:24:52 -0500 Message-ID: Subject: Questions about withering To: freebsd-geom@freebsd.org X-Rspamd-Queue-Id: AF6E080522 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=tPRJO+LD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of jmpalacios@gmail.com designates 2607:f8b0:4864:20::62a as permitted sender) smtp.mailfrom=jmpalacios@gmail.com X-Spamd-Result: default: False [-6.02 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-geom@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[a.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.52)[ip: (-9.46), ipnet: 2607:f8b0::/32(-1.70), asn: 15169(-1.37), country: US(-0.08)]; NEURAL_HAM_SHORT(-0.48)[-0.483,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Dec 2018 05:25:05 -0000 Hi, I'm not only new here, but I'm also pretty new to GEOM, so hopefully my question wont be too out-of-line and/or uninformed. I'm on FreeNAS 11.2 (FreeBSD 11.2), and I'm trying to understand the concept of withering of geoms. Here's how my disks, partitions, and labels currently look: -> geom disk status Name Status Components ada0 N/A N/A ada1 N/A N/A ada2 N/A N/A ada3 N/A N/A ada4 N/A N/A da0 N/A N/A -> gpart status Name Status Components ada0p1 OK ada0 ada0p2 OK ada0 ada1p1 OK ada1 ada1p2 OK ada1 ada2p1 OK ada2 ada2p2 OK ada2 ada3p1 OK ada3 ada3p2 OK ada3 ada4p1 OK ada4 ada4p2 OK ada4 da0p1 OK da0 da0p2 OK da0 zvol/baudrillard/jarp1 OK zvol/baudrillard/jar -> glabel status Name Status Components gptid/d8bd51a6-74dd-11e7-ac3e-ac1f6b1737ba N/A ada0p2 gptid/4b4e423d-6de3-11e8-a335-ac1f6b1737ba N/A ada1p2 gptid/b4743975-d695-11e8-ae82-ac1f6b1737ba N/A ada2p2 gptid/d834fa68-74dd-11e7-ac3e-ac1f6b1737ba N/A ada3p2 gptid/4a35f7d5-6de3-11e8-a335-ac1f6b1737ba N/A ada4p2 gptid/cc1d2cae-f785-11e8-a1dc-ac1f6b1737ba N/A da0p1 label/strawberry N/A zvol/baudrillard/jarp1 gptid/d8b87fab-74dd-11e7-ac3e-ac1f6b1737ba N/A ada0p1 As it's common for FreeNAS, some of those p1 partitions are being consumed by (encrypted) mirrors used for swap: -> gmirror status Name Status Components mirror/swap0 COMPLETE ada4p1 (ACTIVE) ada3p1 (ACTIVE) mirror/swap1 COMPLETE ada2p1 (ACTIVE) ada1p1 (ACTIVE) -> swapinfo -h Device 1K-blocks Used Avail Capacity /dev/mirror/swap0.eli 2097152 0B 2.0G 0% /dev/mirror/swap1.eli 2097152 0B 2.0G 0% Total 4194304 0B 4.0G 0% And when queried individually to glabel, there's no information found for them: -> glabel status ada1p1 glabel: No such geom: ada1p1. But `gpart list ada1` does show the GPT partition with a "rawuuid" property, as expected. All the while, the same query to glabel for the unused ada0p1 partition does succeed: -> glabel status ada0p1 Name Status Components gptid/d8b87fab-74dd-11e7-ac3e-ac1f6b1737ba N/A ada0p1 So I'm wondering if that "disappearing" of the labels for p1 partitions for ada providers 1 through 4 is the effect of withering, given that the swap mirrors are consuming the partitions directly and not their gptid labels. And if it's not withering, what is it, then? Also, shouldn't withering cause entries in the /dev fs to disappear? -> glabel status zvol/baudrillard/jarp1 Name Status Components gptid/a7bb1b7f-0183-11e9-b296-ac1f6b1737ba N/A zvol/baudrillard/jarp1 -> glabel label strawberry zvol/baudrillard/jarp1 -> glabel status zvol/baudrillard/jarp1 Name Status Components label/strawberry N/A zvol/baudrillard/jarp1 gptid/a7bb1b7f-0183-11e9-b296-ac1f6b1737ba N/A zvol/baudrillard/jarp1 -> geli init -s 4096 -l 256 -K /tmp/jar.key -P -B none label/strawberry -> geli attach -k /tmp/jar.key -p label/strawberry -> zpool create -R /mnt waffle label/strawberry.eli -> ls /dev/zvol/baudrillard/jar /dev/zvol/baudrillard/jarp1 /dev/gptid/a7bb1b7f-0183-11e9-b296-ac1f6b1737ba /dev/label/strawberry ls: /dev/gptid/a7bb1b7f-0183-11e9-b296-ac1f6b1737ba: No such file or directory crw-r----- 1 root operator 0xa0 Dec 16 19:00 /dev/label/strawberry crw-r----- 1 root operator 0x9e Dec 16 18:51 /dev/zvol/baudrillard/jar crw-r----- 1 root operator 0x9f Dec 16 18:51 /dev/zvol/baudrillard/jarp1 Needless to say, a node for the gptid label did exist in /dev/ before I created the strawberry label. Is that disappearing also the effect of withering? And if so, do only equal-rank providers wither away from /dev? Otherwise, I would expect the disk and partition nodes for the jar zvol to also disappear from /dev, but a simple `ls` on e.g. `/dev/ada*` shows that's not the case for any of the disk and partition geoms for my SATA drives, nor for their corresponding gptid label nodes that are then consumed by my geli providers that FreeNAS fed to `zpool create` when I created my encrypted pools. I'm trying to use my understanding of attachment modes, and what the various GEOM `list` commands are showing me for that property in these providers, when trying to understand withering, i.e. an exclusive attachment to a provider should cause lower and/or equal rank providers to wither. But I'm getting sorely confused, because what I'm seeing is directly contradicting a large part of the (obviously wrong and incomplete) understanding I currently have. Thanks in advance for the help!