From owner-freebsd-stable@freebsd.org Fri Apr 5 14:36:41 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CBCC41578943 for ; Fri, 5 Apr 2019 14:36:41 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x832.google.com (mail-qt1-x832.google.com [IPv6:2607:f8b0:4864:20::832]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A6525940A3 for ; Fri, 5 Apr 2019 14:36:40 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x832.google.com with SMTP id w5so7575356qtb.11 for ; Fri, 05 Apr 2019 07:36:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZaVy1pm8lTjhngkO5DxX5/yqciB2CTDoqKCD20X2fh0=; b=hhUQOpnwoubWJHD5Ru2wqX1552kzi2SDcLpWx94AGCE95Aaqk2B1Hrk5TVVWcHDpPz Co78Dmnu6kCTyIVwZugRCDV73T9bzmBVHaVH2aOd/ZyxFSKdYxkWdD12S9fgl1aT4VJ/ ePW0IBown8yzg8Hp8SCZRRhjmPAxmzdfOEmkKm7fNLJgYXWyjReJ8GK0Bl4P7VJb3BRL LXeNhBnki6jONWhGOnxS7E5mQiRPnwbIWNa64jZqRWLvqmMnUsKVN2N8WkZEQ2PjajmG w0CgAVB4rtDAu94ftA32Qv+h9suzaFwMW6R3UQmPze0SYJvSF7yzSKG0iEu2/RK7mayx mECw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZaVy1pm8lTjhngkO5DxX5/yqciB2CTDoqKCD20X2fh0=; b=b75rv4bcEqRUsKeDpWFwNSXO4nQUSR0yGM5i/167mpADD/91U/MKTsaahAbRl27+Ow 2kuQNpOmI7IXOnumNmsJv1FAMYfkUnonFAe6Ae9hRgf/SmITmp/Lnhy1trf/3QwA+z6K hXpDKZB/befVDaQUyx3ZCBT0rtQB9DKh63x6Jio9JGHpXQWaiz5P7dja4TSI9/jNWW34 V//FdSmpC1JRfH5JkQyUU4jPgxnm5Youg2HipON/aDWTbzq3+hdl+O8CAEIIuuM20jH7 acRNCPWSAPFqWxBORYLCiZrdLcNdpDcSuH0U8cl/vTNYIQrcIJzPONz0vpIHzoAZn5Lb WlXQ== X-Gm-Message-State: APjAAAVzRlN03/oLzawcbBIDx6hIe1d5Mbyi1mGYVqaKGrMLlSr0XhRL r7RdVgg6rdullhV/+M1ObIi4nsi0+G6ra8HO+tyeP66P X-Google-Smtp-Source: APXvYqx7b6cAiuJ0npa0rrs/UbH9dHuP+fkD+2IUrCSqkusOn5u+ccVAIG0lwFevPxEBWZ+pjCIpxEHhfNdUShFdDAk= X-Received: by 2002:ac8:3328:: with SMTP id t37mr11067678qta.246.1554475000125; Fri, 05 Apr 2019 07:36:40 -0700 (PDT) MIME-Version: 1.0 References: <818CF16A-D71C-47C0-8A1B-35C9D8F68F4E@punkt.de> <58E4FC01-D154-42D4-BA0F-EF9A2C60DBF7@punkt.de> <7070F9C7-556F-4BE5-B274-8318CD62E2DD@punkt.de> In-Reply-To: <7070F9C7-556F-4BE5-B274-8318CD62E2DD@punkt.de> From: Warner Losh Date: Fri, 5 Apr 2019 08:36:29 -0600 Message-ID: Subject: Re: Rare NVME related freeze at boot (was: Re: NVME aborting outstanding i/o) To: "Patrick M. Hausen" Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: A6525940A3 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=hhUQOpnw X-Spamd-Result: default: False [-5.82 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.95)[-0.952,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-2.86)[ip: (-9.15), ipnet: 2607:f8b0::/32(-2.92), asn: 15169(-2.17), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Apr 2019 14:36:42 -0000 On Fri, Apr 5, 2019 at 6:41 AM Patrick M. Hausen wrote: > Hi all, > > in addition to the aborted commands every dozen of system boots or so > (this order of magnitude) the kernel simply hangs during initialisation of > one of the NVME devices: > > https://cloud.hausen.com/s/TxPTDFJwMe6sJr2 > > The particular device affected is not constant. > > A power cycle fixes it, the system has not shown hangs/freezes during > multiuser operation, yet. > > > Any ideas? > What normally comes after the nvme6 line in boot? Often times it's the next thing after the last message that's the issue, not the last thing. Warner