From nobody Fri Apr 1 03:40:39 2022 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 901091A550D9 for ; Fri, 1 Apr 2022 03:40:52 +0000 (UTC) (envelope-from ggm@algebras.org) Received: from mail-lf1-x133.google.com (mail-lf1-x133.google.com [IPv6:2a00:1450:4864:20::133]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KV5YH5WcLz4qDj for ; Fri, 1 Apr 2022 03:40:51 +0000 (UTC) (envelope-from ggm@algebras.org) Received: by mail-lf1-x133.google.com with SMTP id d5so2558176lfj.9 for ; Thu, 31 Mar 2022 20:40:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=algebras-org.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=VboJbk5Tq6JSxtgRooxtQKzYwGFeumlqg5oe+f/cYUw=; b=mGJuRyAnGhuTGU8SKyx0SRzuNHPrsR3fjxS3iHoIJ2wqlrxXqlDkkAM5XSaBN2yiIi 374qM5Piw/rtEc7B3XDpKVNDMBRuhGW51UCZ58v5nd8vt8T+KApzyi9SrA/nUUSwGc7d 3yVa+M7ZvOFgoYXAOCwIvkTyZ1Xn8wuDvoGhUBwUR5y3ladic1LjqDD8r7G4sEddAyAm OQnhpHrfM1pXbisQ81hSaN/5APyisEjZlukn/25SJiuA5iBk0ea/2IfQnQPLaU5Da+dp nc2kowyeBKKGZfVmeOBC4FAuX55oe1OWfxBF2e0kzqj02iLH6DLV1GSmlrO6WTQHVrEE YofA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=VboJbk5Tq6JSxtgRooxtQKzYwGFeumlqg5oe+f/cYUw=; b=LMSuwENGJJFxlmVyfbX7EvzkrKVB9zc2t1aH4zZ8vUqqt+svmwtByiBX6nawOfl6nt /lEfe1jijOJT7uofKmvofMKFB47Y4Ht6M3DiudXDNprcjppkc1t/kEqUbB0rdTh8XJLl 5aCZ7PY1WI8ZvnWhsIVKZna9Y4/DBMI9siQ3VnzHaiVL2jwJ3FKclle2xdfzm2ZLPd9d rx1TQ9FEUQztUR8k1yndpxgl1U9I7wH31dU4Ws0UpJv6sGllBgzNzQhDmN0H2u8Cuguh e0BGJau3QB1sltahdqTcWxXbBIO9RNn5LGS7wDXqM7qOEfnKrJ3pokHWpT7qWPbxU7o1 fJGw== X-Gm-Message-State: AOAM530ivCgszkkW0nZD3FbTNzT+PDHAr2XE7KOoPe2JBYD2yaChP5DC 1b6nhj0YMlV1i217rYnBkGwJo0yNQcuUStXVKro7pcy4Zdc= X-Google-Smtp-Source: ABdhPJwk/kxUVyISoyylti7r2iCOPAB36oTBPlrBMnhRiQhC4o7Rc50Rj9AsCmy2Tz24dytPgEc10mquigC/hhlEwb8= X-Received: by 2002:a05:6512:2301:b0:44a:394e:2add with SMTP id o1-20020a056512230100b0044a394e2addmr12461740lfu.177.1648784450506; Thu, 31 Mar 2022 20:40:50 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: George Michaelson Date: Fri, 1 Apr 2022 13:40:39 +1000 Message-ID: Subject: Re: CAM timeouts on boot (13.0-p8, Dell R730xd, mrsas controller) To: Warner Losh Cc: FreeBSD Stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4KV5YH5WcLz4qDj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=algebras-org.20210112.gappssmtp.com header.s=20210112 header.b=mGJuRyAn; dmarc=none; spf=pass (mx1.freebsd.org: domain of ggm@algebras.org designates 2a00:1450:4864:20::133 as permitted sender) smtp.mailfrom=ggm@algebras.org X-Spamd-Result: default: False [-3.50 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[algebras-org.20210112.gappssmtp.com:s=20210112]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[algebras.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[algebras-org.20210112.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::133:from]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MLMMJ_DEST(0.00)[freebsd-stable]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N I checked /boot/zfs/zpool.cache and /etc/zfs/zpool.cache both have the tank in question, zdb agrees, they are identical, multiple reboots re-tested: without a manual zpool import tank, only the zfs zroot which is magically mounted appears. The other tank does not unless you call it into being. Doing that after multiuser/daemon is bad if your daemons work in it. (and bad for NFS exports) The zfs pages are a bit cryptic about altroot and other zpool get all values, but the basics seem to be that if you do zpool import, and its in cache, then it should be detected during zfs/zpool activation. People expect that once you import, it will re-import automatically thereafter unless you tell it not to. I checked zpool values on a system which doesnt have the problem and I don't see any variance for zpool params. zpool.cache was the recommended "have you checked" reference. Not that this can't be PBCAK, but I have tried not to be the root cause here. It happened across my upgrade, and the CAM timeout intruded in the same window. G On Fri, Apr 1, 2022 at 1:31 PM George Michaelson wrote: > > Thanks for the cluestick. I don't disagree with anything you said btw. > > Here's the dmesg. (attachment, can in-line if thats better)