From owner-freebsd-questions@freebsd.org Thu Aug 19 03:46:49 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B377565C5C1 for ; Thu, 19 Aug 2021 03:46:49 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x42a.google.com (mail-wr1-x42a.google.com [IPv6:2a00:1450:4864:20::42a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GqrL10PqPz4rLV for ; Thu, 19 Aug 2021 03:46:49 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x42a.google.com with SMTP id r7so6833005wrs.0 for ; Wed, 18 Aug 2021 20:46:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=P6XhKhZot07D7odz7lwmize4sneKXAxiTLoHZ0euW50=; b=Sc8A97tNbfKxqj/e8HEL+ZlLzkNfA+FYFSbXV+MTsslGv7GsRTL+LH6DXnjEZE+cju vVCbuQ4aG+xRJhuN3dneBth2PQ2k5oco0owDhcBS+VAGZeW8ZqT33wXXaM5vh3wja2QJ sgUF9m4SRQAX51FvinydQxZqF8bVQ+zAuP6V94gBG9v12G11i1190XoRt/75HXomY7JO gSS3rPgvngOt2PTUsohwuY1ipTtVH4NcPwAH9i76kkAd9InRVAy7C3P7UNjiJuaa+kNl YGLc3vwKO0b3kSnNBsT/k5pF85R7n8E2s0hCQD2bQi1TgtpTlFbvoBv/r+J2+W88xQ6+ SctA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=P6XhKhZot07D7odz7lwmize4sneKXAxiTLoHZ0euW50=; b=L3NqWUplDw1KRjNGLD9Kjn09ZI2NyRmc1pH4fPnbLMM0pEuj4QUeFy9w7eAU3fIilj 9Em8hpuXjqUSKwjoaiw/mB6OCwOepJIga8KstLy5+3qjR2mDlBiq+RhMxj3R0i6oZHfb lD4TLPbEyLY58gxNMqS26b4Tl0LITxmaQqUe035vz64rEMwzuMN5XqgTQH5KbJsWs4PV 67W7G7OgkldJvsPZpeF9b73Za2rNNDL5ql9ouXMGQm/GdbqczY44xCyUGA2XtdL98WCB GgMBe6+Y9o6wRoa/7W3wK+gqVsGe1evdV2E/T8O+CWGbffYBWlRCqaaOzytZz5mHFsqk VFTQ== X-Gm-Message-State: AOAM531HpcUZnvWpduSGBJ6ZTqA6XhV8pDt0D3j7o72/GEbySxqoWjc/ BkY8hbnyldyI93UvN0vAofvCGN0UvKn2jg== X-Google-Smtp-Source: ABdhPJwOMxOg0N0rJZt08Bx4ErGIHb43QC8eIlX2O7zpj/pAsD2bfk5gPUVPvoQnOhPPtWj64Y9Ucw== X-Received: by 2002:a5d:6b92:: with SMTP id n18mr964203wrx.343.1629344807861; Wed, 18 Aug 2021 20:46:47 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id y10sm7083853wmo.18.2021.08.18.20.46.46 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 18 Aug 2021 20:46:47 -0700 (PDT) Subject: Re: nvme detached To: Dan Langille References: <3b332fd8-24be-5a2f-15a8-630edb2a7226@gmail.com> <5ff30e22-d355-4a0c-b13b-02ac709f0fbc@www.fastmail.com> Cc: FreeBSD questions From: Graham Perrin Message-ID: <93a02a57-9f7b-473a-a63f-1c541fdd2225@gmail.com> Date: Thu, 19 Aug 2021 04:46:46 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4GqrL10PqPz4rLV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Sc8A97tN; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::42a as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42a:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Aug 2021 03:46:49 -0000 On 17/08/2021 16:12, Dan Langille wrote: > Dan Langille wrote: >> >> On Wed, Aug 4, 2021, at 2:04 PM, Graham Perrin wrote: >>> >>> On 04/08/2021 18:45, Dan Langille wrote: >>> >>>> >>>> On Wed, Aug 4, 2021, at 1:35 PM, Graham Perrin wrote: >>>> >>>>> >>>>> A normal run of StressDesk might be enough to expose a problem; I >>>>> recently had a new drive (less than 100 hours' use) that failed >>>>> consistently after around seven minutes of the run (before filling the >>>>> file UFS system). >>>> >>>> Is that sysutils/stressdisk? >>> >>> >>> Yes, sorry for the typo. >> >> >> stressdisk now underway: >> >> Bytes read:      26649996 MByte (1633.90 MByte/s) >> Bytes written:     235880 MByte ( 491.77 MByte/s) >> Errors:                 0 >> Elapsed time:  4h40m0.000371674s >> >> FYI, it seems my newly arrived NVME is not actually new. >> >> * gpart shows a partition. >> * smarctl says 4 power on hours >> * 56 power cycles >> * 104GB written >> >> https://dan.langille.org/2021/08/09/i-bought-a-new-nvme-drive-or-did-i/ > > > > > $ sudo gpart create nvd0 > $ sudo gpart create -s gpt nvd0 > $ sudo gpart add -a 4k -t freebsd-zfs nvd0 > $ sudo zpool create nvd0 /dev/nvd0p1 > $ sudo chown dvl:dvl /nvd0 > $ stressdisk run /nvd0/ -duration 1h > > I returned that unit and got another. > > 2021/08/17 15:05:28 Exiting after running for > 1h0m0s > 2021/08/17 15:05:28 > Bytes read:       2970440 MByte (1574.04 MByte/s) > Bytes written:     229910 MByte ( 134.56 MByte/s) > Errors:                 0 > Elapsed time:  1h0m0.00184772s > > 2021/08/17 15:05:28 PASSED with no errors > > In that hour, it read just over 3 TB (see smartctl output below) > > [dvl@test /nvd0]$ zpool list nvd0 > NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP DEDUP    > HEALTH  ALTROOT > nvd0   232G   224G  8.25G        -         -    36%    96% 1.00x    > ONLINE  - > > [dvl@test /nvd0]$ zpool list nvd0 > NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP DEDUP    > HEALTH  ALTROOT > nvd0   232G   224G  8.25G        -         -    36%    96% 1.00x    > ONLINE  - > [dvl@test /nvd0]$ sudo smartctl -a /dev/nvme0 > smartctl 7.2 2020-12-30 r5155 [FreeBSD 13.0-RELEASE-p3 amd64] (local > build) > Copyright (C) 2002-20, Bruce Allen, Christian Franke, > www.smartmontools.org > > === START OF INFORMATION SECTION === > Model Number:                       WDC WDS250G2B0C-00PXH0 > Serial Number:                      [redacted] > Firmware Version:                   233010WD > PCI Vendor/Subsystem ID:            0x15b7 > IEEE OUI Identifier:                0x001b44 > Total NVM Capacity:                 250,059,350,016 [250 GB] > Unallocated NVM Capacity:           0 > Controller ID:                      1 > NVMe Version:                       1.4 > Number of Namespaces:               1 > Namespace 1 Size/Capacity:          250,059,350,016 [250 GB] > Namespace 1 Formatted LBA Size:     512 > Namespace 1 IEEE EUI-64:            001b44 8b4111e9c1 > Local Time is:                      Tue Aug 17 15:11:06 2021 UTC > Firmware Updates (0x14):            2 Slots, no Reset required > Optional Admin Commands (0x0017):   Security Format Frmw_DL Self_Test > Optional NVM Commands (0x005f):     Comp Wr_Unc DS_Mngmt Wr_Zero > Sav/Sel_Feat Timestmp > Log Page Attributes (0x1e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg > Pers_Ev_Lg > Maximum Data Transfer Size:         128 Pages > Warning  Comp. Temp. Threshold:     80 Celsius > Critical Comp. Temp. Threshold:     85 Celsius > Namespace 1 Features (0x02):        NA_Fields > > Supported Power States > St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat > 0 +     3.50W    2.00W       -    0  0  0  0        0       0 > 1 +     2.40W    1.80W       -    0  0  0  0        0       0 > 2 +     1.90W    1.50W       -    0  0  0  0        0       0 > 3 -   0.0250W       -        -    3  3  3  3     3900   11000 > 4 -   0.0050W       -        -    4  4  4  4     5000   44000 > > Supported LBA Sizes (NSID 0x1) > Id Fmt  Data  Metadt  Rel_Perf > 0 +     512       0         2 > 1 -    4096       0         1 > > === START OF SMART DATA SECTION === > SMART overall-health self-assessment test result: PASSED > > SMART/Health Information (NVMe Log 0x02) > Critical Warning:                   0x00 > Temperature:                        37 Celsius > Available Spare:                    100% > Available Spare Threshold:          10% > Percentage Used:                    0% > Data Units Read:                    5,980,477 [3.06 TB] > Data Units Written:                 472,529 [241 GB] > Host Read Commands:                 23,385,657 > Host Write Commands:                1,957,158 > Controller Busy Time:               70 > Power Cycles:                       3 > Power On Hours:                     1 > Unsafe Shutdowns:                   0 > Media and Data Integrity Errors:    0 > Error Information Log Entries:      1 > Warning  Comp. Temperature Time:    0 > Critical Comp. Temperature Time:    0 > > Error Information (NVMe Log 0x01, 16 of 256 entries) > No Errors Logged > > [dvl@test /nvd0]$ Thanks If/when you begin using the new disk, then maybe give the old disk entirely to UFS for a run of StressDisk (or whatever you like) to tell whether there was/is a problem with the old … (Copied to the list at Dan's request.)