From owner-freebsd-current@freebsd.org Fri Apr 17 21:30:41 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 463C82AB73F for ; Fri, 17 Apr 2020 21:30:41 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 493q5D22wQz3J3g; Fri, 17 Apr 2020 21:30:40 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id BAA2D514; Fri, 17 Apr 2020 17:30:38 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Fri, 17 Apr 2020 17:30:39 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsco.org; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=fm3; bh=T sF400PcsiqQ6OL/lqm7nqYiuvvrB3E2wnDRMNnPA40=; b=Wgs/JrG0WZvHFCyfw RxRb7EliIiyiUaPqE0twDUXKLGbJZrYPAMX3R7NVEOWv0hTXGHYidomhS3EqMHnW B1u5ZBnDKguZSiILwYb/hfUF+1IsPv8TTqQuAaqIFx2nwB/sKApEGcl93N2ZZGhP ozBsYOpqLIsQTNcI0ADf0cfFxR/kb/OtEIKM4yGtPaqJ7eo2iPRNll/pacznsbWR 3qzcMVCbOIhxZONhth1y7XaXcfzk+rbdrY7R7QVMOVe8D2V9YKaI0+P4N/OSYj4o zYDs20Ufcql91jU1O8ys7NNRpjOLm7RoeAHjeTuFO2+lLT231eIp2cxRPaXcsHt8 WnA0A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=TsF400PcsiqQ6OL/lqm7nqYiuvvrB3E2wnDRMNnPA 40=; b=qFwUYewzT1JCXJoP3HzUGvNT5ROMF1d2gLHS5x2X+OzmjKpCkB4OwVXPq TwIDS+k5t/fgAJrykhgHTwOJTxp471Dw5PrvWQrwpyXsarsFZPhP2JP7BoKooTLh Hoe/f54GEAumPdVSJMh+q40+JC5acUYPMJacg28/3F0slyRr5+tdmKfjp6i8YXF8 mgXX5kRffBgtauO745oSkpSmxrfLzxEbooaEysxkaSO0eSPM5pBAM8lCzlelVqPA 9Xz8Qh+GoLpzSJtTsTnNx7/+z/fer901C3V8dNlHMpXwJ5f8pQ3u3V+fhUJ8LLgZ qgb7IAWS/A1LVrb7anRXVwyZTD7bQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrfeejgdduiedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucgoufhushhpvggtthffohhmrghinhculdegledmne cujfgurheptggguffhjgffgffkfhfvofesthhqmhdthhdtjeenucfhrhhomhepufgtohht thcunfhonhhguceoshgtohhtthhlsehsrghmshgtohdrohhrgheqnecuffhomhgrihhnpe hisggsrdgtohdpphgrshhtvggsihhnrdhplhenucfkphepkedrgeeirdekledrvddufeen ucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehstghoth htlhesshgrmhhstghordhorhhg X-ME-Proxy: Received: from [192.168.0.114] (unknown [8.46.89.213]) by mail.messagingengine.com (Postfix) with ESMTPA id 914BF3280064; Fri, 17 Apr 2020 17:30:37 -0400 (EDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: PCIe NVME drives not detected on Dell R6515 From: Scott Long In-Reply-To: <015c7aa8-9385-4219-1bf1-0137f65ed80d@quip.cz> Date: Fri, 17 Apr 2020 15:30:37 -0600 Cc: Kurt Jaeger , Warner Losh , FreeBSD-Current Content-Transfer-Encoding: quoted-printable Message-Id: <90C35FEF-690C-4D04-A0D8-D3E5A448C744@samsco.org> References: <0F8BCB8C-DE60-4A34-A4D8-F1BB4B9F906A@samsco.org> <9EF043C1-FF8F-4997-B59A-EC3BF7D1CEEE@samsco.org> <31E8B2BE-BED2-4084-868D-32C48CB3CD6E@samsco.org> <573f5fab-1ef6-151f-18ca-58d3a4a89c72@quip.cz> <07B6763F-C23B-4B7C-B76A-26267AC35453@samsco.org> <20200417194431.GD39563@home.opsec.eu> <148dcdf7-f185-f14f-52ee-d4df3a2a1dc7@quip.cz> <8D8E1F62-AB66-47E1-8444-3D66F8EADA74@samsco.org> <015c7aa8-9385-4219-1bf1-0137f65ed80d@quip.cz> To: Miroslav Lachman <000.fbsd@quip.cz> X-Mailer: Apple Mail (2.3601.0.10) X-Rspamd-Queue-Id: 493q5D22wQz3J3g X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=samsco.org header.s=fm3 header.b=Wgs/JrG0; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=qFwUYewz; dmarc=none; spf=pass (mx1.freebsd.org: domain of scottl@samsco.org designates 64.147.123.21 as permitted sender) smtp.mailfrom=scottl@samsco.org X-Spamd-Result: default: False [-5.60 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[samsco.org:s=fm3,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[samsco.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[samsco.org:+,messagingengine.com:+]; IP_SCORE(-3.50)[ip: (-9.86), ipnet: 64.147.123.0/24(-4.92), asn: 11403(-2.69), country: US(-0.05)]; RCVD_IN_DNSWL_LOW(-0.10)[21.123.147.64.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Apr 2020 21:30:41 -0000 > On Apr 17, 2020, at 3:07 PM, Miroslav Lachman <000.fbsd@quip.cz> = wrote: >=20 > Scott Long wrote on 04/17/2020 23:04: >>> On Apr 17, 2020, at 2:45 PM, Miroslav Lachman <000.fbsd@quip.cz> = wrote: >>>=20 >>> Scott Long wrote on 04/17/2020 22:17: >>>>> On Apr 17, 2020, at 1:47 PM, Miroslav Lachman <000.fbsd@quip.cz> = wrote: >>>>>=20 >>>>> Kurt Jaeger wrote on 04/17/2020 21:44: >>>>>> Hi! >>>>>>>> pciconf -lBc pcib12 >>>>>>>> pciconf -lBc pcib13 >>>>>>>=20 >>>>>>> Printscreen attached. >>>>>> Attachments are stripped from the list -- can you put them = somewhere >>>>>> online ? >>>>>=20 >>>>> Here it is https://ibb.co/c1dZrTf >>>>>=20 >>>>> Miroslav Lachman >>>>>=20 >>>> Ok, the bridges know about their downstream bus numbers, but I see = nothing that suggests that they=E2=80=99re being probed. The next step = would be bootverbose, but that=E2=80=99s going to be a lot of output to = collect in screen captures. >>>=20 >>> Over 3000 lines long but I finally managed to make SOL work so I = have it as text! >>>=20 >>> https://pastebin.pl/view/90fdaafb >>>=20 >> This helped a lot, thanks. It looks like these PCIe buses are marked = as being hotplug, and for some reason we=E2=80=99re not probing them. = At this point, I=E2=80=99d need to feed you some kernel patches that = will dump out more info, but you=E2=80=99d have to compile them and get = them onto your boot media. Is that a possibility? >=20 > Currently I have all machines on 11.3 (where I can rebuild kernel = without problem) > If CURRENT is required I would need to setup some CURRENT VM in = VirtualBox. >=20 > Can you send me some link to documentation who should I create new ISO = after rebuild? >=20 I don=E2=80=99t know of any docs for doing custom releases, and it looks = like it=E2=80=99s harder than it used to be to insert custom patches. = That said, I recommend doing the following on your 11.x build system: 1. Do a clean `make buildworld` with an up-to-date tree 2. change into the `release` directory that you just did the buildworld = from 3. `sudo make release NOPORTS=3D NODOC=3D CHROOTDIR=3D/usr/tmp/release = SRCBRANCH=3D"base/stable/11@rHEAD=E2=80=9D` You can set CHROOTDIR to whatever you want that has a few GB of space, = but remember where you=E2=80=99ve set it for later steps. This will = build a release with stock sources. Let it complete, both to prepare = for the next step and to ensure that it works. It=E2=80=99ll take an = hour or two depending on your machine speed 4. Take the patch that I=E2=80=99ll send you shortly and apply it to = $CHROOTDIR/usr/src 5. `sudo make memstick NOPORTS=3D NODOC=3D SRC_UPDATE_SKIP=3D = CHROOTDIR=3D/usr/tmp/release` Scott