From owner-freebsd-current@freebsd.org Wed Sep 16 09:03:43 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 941513DEA25 for ; Wed, 16 Sep 2020 09:03:43 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BrvKB4x9gz4TNb for ; Wed, 16 Sep 2020 09:03:42 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-ed1-x529.google.com with SMTP id l17so5465300edq.12 for ; Wed, 16 Sep 2020 02:03:42 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=d0Wg30Kkayg6NHkBcrj8eVER0RZWm1juVaLAe3XJg40=; b=QpWjVDEyxnbhEpDSELtc4pZ11QjlZrMxN92+V3JPEydtKcLqeoECoIg3NLqIo23mOy 0B5duHhmvVzA0+gBEHrrHiQYTZM3TDZr56K52yge/QR9wk9MN87fDP/MMe1oueWNFlc7 UoyfL3FFkkMTsU8FT2jzUX8euDl44u34dNZwoQUlhEpBQUK8evMy+fyZuQAmBcuI+KhU Sru6ixP6Q5qqe3cf+/7kij6T1fDkgtZA4JQFR3HwJXqzimIYDYxqbU+jo8vITuU/VKRw 2w9jcJPpB2vjDdhUNStbVeyrm+FmgItkR+gdbY5f4YLBlMoCvgW0d0ZV7ORk/htdN5LV pHbA== X-Gm-Message-State: AOAM532sSmimzEiVVX2ZMaytzUFsD2A8ig7yX/easB56L4kjh2ttZf6W fqLSHCdEc5bj2a41Chs0ERv7p9CdUCbX+o3lnIKwzNRW52Snbw== X-Google-Smtp-Source: ABdhPJxW2RBr+j966WPr4Y948u6OKVPWNs6ve9fT1gQ7vU00WtdVtDJYIcQaOxQCURlkAydrLQiKZtGU8b9ke1pqe4s= X-Received: by 2002:a05:6402:45a:: with SMTP id p26mr28030680edw.8.1600247020843; Wed, 16 Sep 2020 02:03:40 -0700 (PDT) MIME-Version: 1.0 From: Dustin Marquess Date: Wed, 16 Sep 2020 04:03:29 -0500 Message-ID: Subject: USB drives & OpenZFS To: FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4BrvKB4x9gz4TNb X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.31 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.94)[-0.942]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-0.98)[-0.983]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::529:from]; NEURAL_HAM_SHORT(-0.39)[-0.387]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 09:03:43 -0000 There seems to be a problem with OpenZFS when shutting down a machine that boots from USB. My machine has two SD cards in an adapter board that plugs into an internal USB port on the motherboard. On these two cards I have the UEFI loader and a mirror zpool containing just the bare minimum to boot. Once the machine boots, it mounts the "big" SAS tank containing everything else. This worked perfectly and still works mostly after the OpenZFS merge. The only problem now is shutting down/rebooting. if I try to reboot, it hangs: Freed UMA keg (rtentry) was not empty (1 items). Lost 1 pages of memory. Waiting (max 60 seconds) for system process `vnlru' to stop... done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining... 0 0 0 0 0 0 0 0 done Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-2' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-3' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-4' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-5' to stop... done Waiting (max 60 seconds) for system thread `bufspacedaemon-6' to stop... done All buffers synced. Uptime: 1h52m34s uhub4: detached uhub2: detached uhub3: detached uhub1: detached uplcom0: detached umass0: detached Solaris: WARNING: Pool 'zroot' has encountered an uncorrectable I/O failure and has been suspended. I'm guessing it's because it appears that the USB subsystem shuts down before the pool itself? Once this happens I have to reset the machine via IPMI to get everything to boot back up. Has anybody else seen this? Thanks! -Dustin