From owner-freebsd-questions@freebsd.org Thu Aug 19 10:54:48 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7A951663101 for ; Thu, 19 Aug 2021 10:54:48 +0000 (UTC) (envelope-from dan@langille.org) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gr1qq3N9Pz4cgT for ; Thu, 19 Aug 2021 10:54:47 +0000 (UTC) (envelope-from dan@langille.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 40BD65C0041; Thu, 19 Aug 2021 06:54:40 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Thu, 19 Aug 2021 06:54:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= from:subject:to:references:cc:message-id:date:mime-version :in-reply-to:content-type:content-transfer-encoding; s=fm2; bh=8 271g00r4rG4Gvb8YbkeviEjfX7RMqbBdgH012JUldo=; b=iJT1qEF38oQsqqjRs 5Pa+D+sS0h5oTcpiMrjt5EHaWkm3Td7PY+OoXmtJqqlvlGYM5GqauQo+MWhQX4Kk OSvbi2SSLZRNAFDsUXaaw4J+z5dlIa09+zo86v0kx4vpKh78YH40B2zcTthgXI9t 8AkvCDzIshkXex+msE1duezGvDZbKACi61yboviIV98tKOTA/hYrCkesiYCVdidD h4k4Jl9kHFBkexxPACx1jYPkmMPnMAigFfArbW9XuQhs/b+2FUmTkFVwD+lW7SH1 vsLoo2mpTixJNsDxOxUMDshLlVEPYUeMtJQWfTI2iMkgz5ys1fu33DZazEGd7vAa mzsUQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=8271g00r4rG4Gvb8YbkeviEjfX7RMqbBdgH012JUl do=; b=XL3XVqYyhU6BwJzrFa6YnCdXShu+9SB/ldskfUmhz0SgonOZ6xm0ylhG5 A48sO6xrq+VGwOEEeZEYoTZf/Ahp5wV92nLdpCmYEuaUrJ3mJDO7NoEWKn+GU6a+ IO6cMrkpUHZMrqdIbW/iWaz4DjLeP20TY8EgdXnCp/ueSEfkxDHbJvbJuG9trh6r C8gbkw0Fv2VZQMIFIEA8FP5+XmkbyPNdMHLK0Od1O+Sh2A0M8M80EC0MzLAeS3Tp YkPRf9ECKVAjL+uxxvokc5xF69etxvG5CemBSPpAIWJB2qbkoh2p0SbdOY74UoNJ rbYFTp3orx5yLgzLcVFS0uq+U1UMQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddrleejgdeffecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenuc fjughrpefhuffvfhfkffgfgggjtgfgsehtkeertddtfeejnecuhfhrohhmpeffrghnucfn rghnghhilhhlvgcuoegurghnsehlrghnghhilhhlvgdrohhrgheqnecuggftrfgrthhtvg hrnhepfefgueehffejkeffgefhhffgudegtddtveegveekleegfedutdeuieefjeektdeu necuffhomhgrihhnpehlrghnghhilhhlvgdrohhrghdpshhmrghrthhmohhnthhoohhlsh drohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pegurghnsehlrghnghhilhhlvgdrohhrgh X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 19 Aug 2021 06:54:39 -0400 (EDT) From: Dan Langille Subject: Re: nvme detached To: Graham Perrin References: <3b332fd8-24be-5a2f-15a8-630edb2a7226@gmail.com> <5ff30e22-d355-4a0c-b13b-02ac709f0fbc@www.fastmail.com> Cc: "freebsd-questions@freebsd.org" Message-ID: <10dddb1e-0756-56e0-1fac-6dc91663e823@langille.org> Date: Thu, 19 Aug 2021 06:54:38 -0400 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.16; rv:52.0) Gecko/20100101 PostboxApp/7.0.48 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4Gr1qq3N9Pz4cgT X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm2 header.b=iJT1qEF3; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=XL3XVqYy; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 66.111.4.29 as permitted sender) smtp.mailfrom=dan@langille.org X-Spamd-Result: default: False [-5.10 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.0.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm2,messagingengine.com:s=fm3]; FREEFALL_USER(0.00)[dan]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.111.4.29:from]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Aug 2021 10:54:48 -0000 Dan Langille wrote: > > On Wed, Aug 4, 2021, at 2:04 PM, Graham Perrin wrote: >> >> On 04/08/2021 18:45, Dan Langille wrote: >> >>> >>> On Wed, Aug 4, 2021, at 1:35 PM, Graham Perrin wrote: >>> >>>> >>>> A normal run of StressDesk might be enough to expose a problem; I >>>> recently had a new drive (less than 100 hours' use) that failed >>>> consistently after around seven minutes of the run (before filling the >>>> file UFS system). >>> >>> Is that sysutils/stressdisk? >> >> >> Yes, sorry for the typo. > > > stressdisk now underway: > > Bytes read:      26649996 MByte (1633.90 MByte/s) > Bytes written:     235880 MByte ( 491.77 MByte/s) > Errors:                 0 > Elapsed time:  4h40m0.000371674s > > FYI, it seems my newly arrived NVME is not actually new. > > * gpart shows a partition. > * smarctl says 4 power on hours > * 56 power cycles > * 104GB written > > https://dan.langille.org/2021/08/09/i-bought-a-new-nvme-drive-or-did-i/ $ sudo gpart create nvd0 $ sudo gpart create -s gpt nvd0 $ sudo gpart add -a 4k -t freebsd-zfs nvd0 $ sudo zpool create nvd0 /dev/nvd0p1 $ sudo chown dvl:dvl /nvd0 $ stressdisk run /nvd0/ -duration 1h I returned that unit and got another. 2021/08/17 15:05:28 Exiting after running for > 1h0m0s 2021/08/17 15:05:28 Bytes read:       2970440 MByte (1574.04 MByte/s) Bytes written:     229910 MByte ( 134.56 MByte/s) Errors:                 0 Elapsed time:  1h0m0.00184772s 2021/08/17 15:05:28 PASSED with no errors In that hour, it read just over 3 TB (see smartctl output below) [dvl@test /nvd0]$ zpool list nvd0 NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP HEALTH  ALTROOT nvd0   232G   224G  8.25G        -         -    36%    96%  1.00x ONLINE  - [dvl@test /nvd0]$ zpool list nvd0 NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP HEALTH  ALTROOT nvd0   232G   224G  8.25G        -         -    36%    96%  1.00x ONLINE  - [dvl@test /nvd0]$ sudo smartctl -a /dev/nvme0 smartctl 7.2 2020-12-30 r5155 [FreeBSD 13.0-RELEASE-p3 amd64] (local build) Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number:                       WDC WDS250G2B0C-00PXH0 Serial Number:                      [redacted] Firmware Version:                   233010WD PCI Vendor/Subsystem ID:            0x15b7 IEEE OUI Identifier:                0x001b44 Total NVM Capacity:                 250,059,350,016 [250 GB] Unallocated NVM Capacity:           0 Controller ID:                      1 NVMe Version:                       1.4 Number of Namespaces:               1 Namespace 1 Size/Capacity:          250,059,350,016 [250 GB] Namespace 1 Formatted LBA Size:     512 Namespace 1 IEEE EUI-64:            001b44 8b4111e9c1 Local Time is:                      Tue Aug 17 15:11:06 2021 UTC Firmware Updates (0x14):            2 Slots, no Reset required Optional Admin Commands (0x0017):   Security Format Frmw_DL Self_Test Optional NVM Commands (0x005f):     Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Log Page Attributes (0x1e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg Maximum Data Transfer Size:         128 Pages Warning  Comp. Temp. Threshold:     80 Celsius Critical Comp. Temp. Threshold:     85 Celsius Namespace 1 Features (0x02):        NA_Fields Supported Power States St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat 0 +     3.50W    2.00W       -    0  0  0  0        0       0 1 +     2.40W    1.80W       -    0  0  0  0        0       0 2 +     1.90W    1.50W       -    0  0  0  0        0       0 3 -   0.0250W       -        -    3  3  3  3     3900   11000 4 -   0.0050W       -        -    4  4  4  4     5000   44000 Supported LBA Sizes (NSID 0x1) Id Fmt  Data  Metadt  Rel_Perf 0 +     512       0         2 1 -    4096       0         1 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning:                   0x00 Temperature:                        37 Celsius Available Spare:                    100% Available Spare Threshold:          10% Percentage Used:                    0% Data Units Read:                    5,980,477 [3.06 TB] Data Units Written:                 472,529 [241 GB] Host Read Commands:                 23,385,657 Host Write Commands:                1,957,158 Controller Busy Time:               70 Power Cycles:                       3 Power On Hours:                     1 Unsafe Shutdowns:                   0 Media and Data Integrity Errors:    0 Error Information Log Entries:      1 Warning  Comp. Temperature Time:    0 Critical Comp. Temperature Time:    0 Error Information (NVMe Log 0x01, 16 of 256 entries) No Errors Logged [dvl@test /nvd0]$