From owner-freebsd-current@freebsd.org Fri Apr 17 15:54:59 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DEDF82BE90B for ; Fri, 17 Apr 2020 15:54:59 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 493gdt6p44z48gS for ; Fri, 17 Apr 2020 15:54:58 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 82DB15C02BD; Fri, 17 Apr 2020 11:54:58 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Fri, 17 Apr 2020 11:54:58 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsco.org; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=fm3; bh=h leXxx/YjL9a7SZru3yF4kZBAta7ZYWzvw6IejuS3lo=; b=rFJVk/SNmV2MBDDTI fWdzoLQwOvjJjhMcR6pLM2BXNFDBEkhvdFPh7ZrdKvHXYbFMGnlZJuGPaZH6xHUa IxGAJupl9vaqreAt+AvSjrSPZ0Sh2I/kGTB8E+Wc8AiEAMj1w8DCO6xe/niKjku6 UesdMWfMNVvhKhmYdyg0DIsj3pnhaNTQ3sH3wKp8uI6xQQhMDl4fIJ+2zs1cvZlY znYYmBIe4bXFcjye4E6OLCsBEZZc3f+rQU4N92vwbU00oFrLuf9sR2OGYCLykmNa US1xT/BQZFEeYlApKFFR6t0DAfaP102C9M1sJdn/qdxWiUzZnYojApK7MEFp8zwI pfaaw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=hleXxx/YjL9a7SZru3yF4kZBAta7ZYWzvw6IejuS3 lo=; b=b947QVwqmNFOVEkE3oqydlsjNoyHoBCqr9EolQHKz8vGu0UMbA3qXx1pN my72nzYgqmYOdTi3lL0V0aOVXXYD+KJF1lN5yi18apt/srlc0BQq/qOH1NVF57NN fCaUIZwhl2kFH1wNtKHFHyKTIqp+RPMDUeC5H6agUYKDimO+F7eE+3iv/LBzNtTc 5+dPptJNeTx3Qi8P9yBZSou6GxZ4yJgX3ywr37BOqx4vpCKIIXbDFCwivgAmD7P0 9fWEyY3kiD1bTY7hn1i+DEAwaoOAZOhBPvyQUaultBQ40wUS/6wG7zB3jYLbsGQk 0RDcnCrL5UichD8TXpxIcuhwNfx4w== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrfeejgdelhecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecuogfuuhhsphgvtghtffhomhgrihhnucdlgeelmdenuc fjughrpegtggfuhfgjfffgkfhfvffosehtqhhmtdhhtdejnecuhfhrohhmpefutghothht ucfnohhnghcuoehstghothhtlhesshgrmhhstghordhorhhgqeenucffohhmrghinhepih gssgdrtghopdhfrhgvvggsshgurdhorhhgnecukfhppeekrdegiedrkeelrddvudefnecu vehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepshgtohhtth hlsehsrghmshgtohdrohhrgh X-ME-Proxy: Received: from [192.168.0.114] (unknown [8.46.89.213]) by mail.messagingengine.com (Postfix) with ESMTPA id 5CB733060069; Fri, 17 Apr 2020 11:54:57 -0400 (EDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: PCIe NVME drives not detected on Dell R6515 From: Scott Long In-Reply-To: Date: Fri, 17 Apr 2020 09:54:56 -0600 Cc: Miroslav Lachman <000.fbsd@quip.cz>, FreeBSD-Current Content-Transfer-Encoding: quoted-printable Message-Id: <9EF043C1-FF8F-4997-B59A-EC3BF7D1CEEE@samsco.org> References: <0F8BCB8C-DE60-4A34-A4D8-F1BB4B9F906A@samsco.org> To: Warner Losh X-Mailer: Apple Mail (2.3601.0.10) X-Rspamd-Queue-Id: 493gdt6p44z48gS X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=samsco.org header.s=fm3 header.b=rFJVk/SN; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=b947QVwq; dmarc=none; spf=pass (mx1.freebsd.org: domain of scottl@samsco.org designates 66.111.4.29 as permitted sender) smtp.mailfrom=scottl@samsco.org X-Spamd-Result: default: False [-5.59 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[samsco.org:s=fm3,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29:c]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[samsco.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[samsco.org:+,messagingengine.com:+]; IP_SCORE(-3.49)[ip: (-9.84), ipnet: 66.111.4.0/24(-4.89), asn: 11403(-2.69), country: US(-0.05)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[29.4.111.66.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Apr 2020 15:54:59 -0000 Would that be the Intel VMD/VROC stuff? If so, there=E2=80=99s a driver = for FreeBSD, but it=E2=80=99s not well tested yet. Will have to dig in = further. Scott > On Apr 17, 2020, at 9:50 AM, Warner Losh wrote: >=20 >=20 >=20 > On Fri, Apr 17, 2020 at 9:39 AM Scott Long wrote: > Can you send me the output of =E2=80=98pciconf -llv=E2=80=99, either = in 12-STABLE or 13-CURRENT? Also, can you send me the output of = =E2=80=98dmesg=E2=80=99? >=20 > There was another thread that said there was a raid card in the way... = It would be cool to find a way to get it out of the way... :) >=20 > Warner > =20 > Thanks, > Scott >=20 >=20 > > On Apr 17, 2020, at 5:23 AM, Miroslav Lachman <000.fbsd@quip.cz> = wrote: > >=20 > > I already asked on stable@ but as I tried it on 13-CURRENT with the = same result I am trying to ask for help here. > >=20 > > I have rented dedicated server Dell PowerEdge R6515 with iDRAC = access only. > > There are 2 NVME drives which I wanted to use as ZFS root pool. > >=20 > > They are shown in iDRAC > >=20 > > Device Description: PCIe SSD in Slot 1 in Bay 1 > > Device Protocol: NVMe-MI1.0 > > Model: Dell Express Flash NVMe P4510 1TB SFF > > Bus: 130 > > Manufacturer: INTEL > > Product ID: a54 > > Revision: VDV1DP23 > > Enclosure: PCIe SSD Backplane 1 > >=20 > >=20 > > pciconf -l show many things, some of them are named "noneN@pci..." = but none "nvme" > >=20 > > The is printscreen (12.1 but 13-CURRENT is the same) > >=20 > > https://ibb.co/tPnymL7 > >=20 > > But I booted Linux SystemRescueCd and nvme devices are there visible = in /dev/ > > https://ibb.co/sj22Nwg > >=20 > > There is verbose output of Linux lspci https://ibb.co/dPZTwV1 > >=20 > > Linux dmesg contains: > > nvme nvme0: pci function 0000:81:00.0 > > nvme nvme1: pci function 0000:82:00.0 > > nvme nvme0: 32/0/0 default/read/poll queues > > nvme nvme1: 32/0/0 default/read/poll queues > >=20 > >=20 > > The machine is Dell PowerEdge R6515 with AMD EPYC 7302P > >=20 > >=20 > > More details extracted from iDRAC web interface > >=20 > > I found this informations > >=20 > > PCIe SSD in Slot 1 in Bay 1 > > Bus: 82 > > BusProtocol: PCIE > > Device: 0 > > DeviceDescription: PCIe SSD in Slot 1 in Bay 1 > > DeviceProtocol: NVMe-MI1.0 > > DeviceType: PCIeSSD > > DriveFormFactor: 2.5 inch > > FailurePredicted: NO > > FQDD: Disk.Bay.1:Enclosure.Internal.0-1 > > FreeSizeInBytes: Information Not Available > > Function: 0 > > HotSpareStatus: Information Not Available > > InstanceID: Disk.Bay.1:Enclosure.Internal.0-1 > > Manufacturer: INTEL > > MaximumCapableSpeed: 8 GT/s > > MediaType: Solid State Drive > > Model: Dell Express Flash NVMe P4510 1TB SFF > > NegotiatedSpeed: 8 GT/s > > PCIeCapableLinkWidth: x4 > > PCIeNegotiatedLinkWidth: x4 > > PrimaryStatus: Ok > > ProductID: a54 > > RaidStatus: Information Not Available > > RAIDType: Unknown > > RemainingRatedWriteEndurance: 100 % > > Revision: VDV1DP23 > > SerialNumber: PHLJxxxxxxWF1PxxxxN > > SizeInBytes: 1000204886016 > > Slot: 1 > > State: Ready > > SystemEraseCapability: CryptographicErasePD > >=20 > > PCIe SSD in Slot 1 in Bay 1 - PCI Device > > BusNumber: 130 > > DataBusWidth: 4x or x4 > > Description: Express Flash NVMe 1.0 TB 2.5" U.2 (P4510) > > DeviceDescription: PCIe SSD in Slot 1 in Bay 1 > > DeviceNumber: 0 > > DeviceType: PCIDevice > > FQDD: Disk.Bay.1:Enclosure.Internal.0-1 > > FunctionNumber: 0 > > InstanceID: Disk.Bay.1:Enclosure.Internal.0-1 > > LastSystemInventoryTime: 2020-04-17T03:21:39 > > LastUpdateTime: 2020-03-31T13:55:06 > > Manufacturer: Intel Corporation > > PCIDeviceID: 0A54 > > PCISubDeviceID: 2003 > > PCISubVendorID: 1028 > > PCIVendorID: 8086 > > SlotLength: 2.5 Inch Drive Form Factor > > SlotType: PCI Express Gen 3 SFF-8639 > >=20 > >=20 > > Can anybody shed some light what the real problem is? > >=20 > > Is the hardware not properly detected or is the driver completely = missing? > >=20 > > NVME PCIe architecture is out of my knowledge. > >=20 > > I really appreciate any help. > >=20 > > Kind regards > > Miroslav Lachman > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to = "freebsd-current-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to = "freebsd-current-unsubscribe@freebsd.org"