From owner-freebsd-scsi@freebsd.org Mon Jun 8 16:35:43 2020 Return-Path: Delivered-To: freebsd-scsi@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F17A3356A0 for ; Mon, 8 Jun 2020 16:35:43 +0000 (UTC) (envelope-from peter.blok@bsd4all.org) Received: from smtpq1.tb.mail.iss.as9143.net (smtpq1.tb.mail.iss.as9143.net [212.54.42.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49gf4t5JL1z40Bl for ; Mon, 8 Jun 2020 16:35:42 +0000 (UTC) (envelope-from peter.blok@bsd4all.org) Received: from [212.54.42.136] (helo=smtp12.tb.mail.iss.as9143.net) by smtpq1.tb.mail.iss.as9143.net with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jiKkO-0000PZ-93; Mon, 08 Jun 2020 18:35:40 +0200 Received: from 94-209-85-88.cable.dynamic.v4.ziggo.nl ([94.209.85.88] helo=wan0.bsd4all.org) by smtp12.tb.mail.iss.as9143.net with esmtp (Exim 4.90_1) (envelope-from ) id 1jiKkO-000508-0V; Mon, 08 Jun 2020 18:35:40 +0200 Received: from newnas.bsd4all.local (localhost [127.0.0.1]) by wan0.bsd4all.org (Postfix) with ESMTP id 83ACF1E1; Mon, 8 Jun 2020 18:35:39 +0200 (CEST) X-Virus-Scanned: amavisd-new at bsd4all.org Received: from wan0.bsd4all.org ([127.0.0.1]) by newnas.bsd4all.local (newnas.bsd4all.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TEonWOx4HzHx; Mon, 8 Jun 2020 18:35:38 +0200 (CEST) Received: from [192.168.1.65] (unknown [192.168.1.65]) by wan0.bsd4all.org (Postfix) with ESMTPSA id DE647285; Mon, 8 Jun 2020 18:35:38 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: TRIM on mixed SSD/HHD ZFS pool From: peter.blok@bsd4all.org In-Reply-To: <7a9a0c2b-ef62-a4ad-61f4-f1ba88115f64@gmail.com> Date: Mon, 8 Jun 2020 18:35:38 +0200 Cc: freebsd-scsi@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <2F0DC649-4E6D-4520-8258-A6EE652C2949@bsd4all.org> <7a9a0c2b-ef62-a4ad-61f4-f1ba88115f64@gmail.com> To: Riccardo Veraldi X-Mailer: Apple Mail (2.3608.80.23.2.2) X-SourceIP: 94.209.85.88 X-Ziggo-spambar: / X-Ziggo-spamscore: 0.0 X-Ziggo-spamreport: CMAE Analysis: v=2.3 cv=ALm2FEO8 c=1 sm=1 tr=0 a=LYXyOGYQqFYBMgK+Y6iqTg==:17 a=kj9zAlcOel0A:10 a=nTHF0DUjJn0A:10 a=pGLkceISAAAA:8 a=6Q3WNqvRAAAA:8 a=6I5d2MoRAAAA:8 a=9A1ug2ppbBArn70qWhYA:9 a=CjuIK1q_8ugA:10 a=I8PBwKCn76L9oNdl0isp:22 a=IjZwj45LgO3ly-622nXo:22 X-Ziggo-Spam-Status: No X-Spam-Status: No X-Spam-Flag: No X-Rspamd-Queue-Id: 49gf4t5JL1z40Bl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of peter.blok@bsd4all.org designates 212.54.42.164 as permitted sender) smtp.mailfrom=peter.blok@bsd4all.org X-Spamd-Result: default: False [-2.83 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[212.54.42.164:from]; RCVD_COUNT_FIVE(0.00)[6]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:smtp.ziggo.nl/16]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[bsd4all.org]; NEURAL_HAM_LONG(-1.04)[-1.042]; RECEIVED_SPAMHAUS_PBL(0.00)[94.209.85.88:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.85)[-0.852]; RCPT_COUNT_TWO(0.00)[2]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.04)[-1.036]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:33915, ipnet:212.54.32.0/20, country:NL]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.54.42.164:from] X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jun 2020 16:35:43 -0000 Thx for your answer, but 6 enterprise SSD are way over my budget. > On 5 Jun 2020, at 11:23, Riccardo Veraldi = wrote: >=20 > you may opt for enterprise level SSD disks. I have been using the 9300 > NVMe series with Lustre/ZFS writing extensive data and I have never > needed any trimming on them. They do automatic garbage collection. > They are quite expensive piece of hardware though. >=20 > On 05/06/2020 08:37, peter.blok@bsd4all.org wrote: >> Hi, >>=20 >> I have decided to gradually move over to SSD in my ZFS pool. Anybody = knows if ZFS will issue a TRIM designated for the SSD in this mixed = case, while the HDD do not support this? >>=20 >> Peter >>=20 >>=20 >> _______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >=20 >=20 From owner-freebsd-scsi@freebsd.org Mon Jun 8 19:44:05 2020 Return-Path: Delivered-To: freebsd-scsi@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 46FB1339628 for ; Mon, 8 Jun 2020 19:44:05 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49gkGD2XPdz4Mn2 for ; Mon, 8 Jun 2020 19:44:03 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr1-x430.google.com with SMTP id c3so18737369wru.12 for ; Mon, 08 Jun 2020 12:44:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=Bqgwo5DzPsiRL7yf7N0wqyYurABN5oT09IDTspz09Ro=; b=agC+E7hCq/YdioNowyYMfbKLsr9dNLW5uN27HmhqURk/uC+gMRGXqC4LOABVYgC5Bq XMkJXID5TPTli+QoQfHeF5yQgjE48NPxNIFzfGwAiUChDG+Csjp7R5B+Fnps3vER0OHJ 3eFAJPJXQa7p2ivHhmku/C0Q+ZjUBXHnIMYlcJA2BKGCStJQl7fTwLZLqpbDiPtBp3fp /CrsL4lwEjp0F5NAvtg5DNhyTntgodhzckw6B2WV+g979KKyK2tf3xK4MyayVeprUjEn 18dWPHPr6QvB8uNlDF6CH64j2Cj+f8qAYz6k7c8kDbx14zUi7tXiDUpgA4Tq/7nWynbQ yDGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=Bqgwo5DzPsiRL7yf7N0wqyYurABN5oT09IDTspz09Ro=; b=Dmd2ig0F2IOWygdJYh+C2Cd3Y2jRu4a75X/6yQTYWI6XfalknnxDKcT0s54Cgu28jW hHka8tE2NMM8FVD5sYLy6//WwZrTbDPQWXJvO1Q9X9adLZk1pmEsExfKejT91Tq7qXgi kg25Dvc2Fo2jc6CczqYB8n3u+moEHg4MoFoQlx1KUTNEJInyLGOcQsxdHIPlsJXX7sUS ay45/yMHUM/NFhHa2zIOFGMkwjLLzJbSo9j8G2osQLKVALYMSpvXZv4EFyl/7xDusx3a 3Uwa6nCgQhEfL8oTgIz9/lZfVH5Se63YHEduCE+DrRNHwIdQjWpM4YUSyS8Tm6oviZzp cMeQ== X-Gm-Message-State: AOAM53304i1O4GpEowSk+lYloYiH/tmFej0KDbwDKYQjUkVVvMnUhxxo ZcaUGCsNmBlnSUkvCfExHsA2VHpaJCwT6w== X-Google-Smtp-Source: ABdhPJyG2uwQJw3TdatelzvIjKzy4lMQYjIh3DJ2566bFQuCN+JhOZq6YQAZkxZ+nuuY8JGiBR2B6Q== X-Received: by 2002:a5d:4e8c:: with SMTP id e12mr391157wru.194.1591645441885; Mon, 08 Jun 2020 12:44:01 -0700 (PDT) Received: from [10.44.128.75] ([193.117.175.106]) by smtp.gmail.com with ESMTPSA id y37sm795038wrd.55.2020.06.08.12.44.00 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 08 Jun 2020 12:44:01 -0700 (PDT) Subject: Re: TRIM on mixed SSD/HHD ZFS pool To: freebsd-scsi@freebsd.org References: <2F0DC649-4E6D-4520-8258-A6EE652C2949@bsd4all.org> From: Steven Hartland Message-ID: <4fdd2335-7c40-c6dd-cd20-82f84e24bbbe@multiplay.co.uk> Date: Mon, 8 Jun 2020 20:44:00 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <2F0DC649-4E6D-4520-8258-A6EE652C2949@bsd4all.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-Rspamd-Queue-Id: 49gkGD2XPdz4Mn2 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=multiplay-co-uk.20150623.gappssmtp.com header.s=20150623 header.b=agC+E7hC; dmarc=pass (policy=none) header.from=multiplay.co.uk; spf=pass (mx1.freebsd.org: domain of killing@multiplay.co.uk designates 2a00:1450:4864:20::430 as permitted sender) smtp.mailfrom=killing@multiplay.co.uk X-Spamd-Result: default: False [-2.61 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[multiplay-co-uk.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.03)[-1.033]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-scsi@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.02)[-1.024]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.45)[0.447]; DKIM_TRACE(0.00)[multiplay-co-uk.20150623.gappssmtp.com:+]; DMARC_POLICY_ALLOW(-0.50)[multiplay.co.uk,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::430:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jun 2020 19:44:05 -0000 TRIM is on a per vdev so yes it will work. On 05/06/2020 07:37, peter.blok@bsd4all.org wrote: > Hi, > > I have decided to gradually move over to SSD in my ZFS pool. Anybody knows if ZFS will issue a TRIM designated for the SSD in this mixed case, while the HDD do not support this? > > Peter > > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" From owner-freebsd-scsi@freebsd.org Tue Jun 9 12:53:38 2020 Return-Path: Delivered-To: freebsd-scsi@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EF82F32C2F2 for ; Tue, 9 Jun 2020 12:53:38 +0000 (UTC) (envelope-from riccardo.veraldi@gmail.com) Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49h96B07y1z4X7s for ; Tue, 9 Jun 2020 12:53:37 +0000 (UTC) (envelope-from riccardo.veraldi@gmail.com) Received: by mail-ed1-x52b.google.com with SMTP id d15so3752893edm.10 for ; Tue, 09 Jun 2020 05:53:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:subject:to:cc:references:autocrypt:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=2GgqhoGeT+xu5rVej+naaZM9nta7zCoUFSsBdTfoloE=; b=u4xG6lLEkQyq3fZ33fOC9rUkrL9uKlwPuM0BM1iywrqj3P4RVlmuGmPiumpppiWcDg to1UZMZsXm0Ib8aOTxtLCmvLescykL6qeWJsgG1P+pIEpm1yp33YhaMrfIlQ1gmVvvdz o2YOYvAGxI2NkkCB727egQQnpbRRdeYy5PtlSsDZqfRGUYvAUmfgXTqEfOnjUQWkA8ks MbkYcQlc1ajBVOx3BiqrnGxEbw1czG40EQGKeJqLCS4+6K8lCfVShhkxNrDtq+QF086u F26SPBrYQGvjVNLk/QsbaidOSJnmLRTVgy7yhgf+jzohBOUVwHPYL6bjBtavEu93/7tZ m8Pg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:cc:references:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding:content-language; bh=2GgqhoGeT+xu5rVej+naaZM9nta7zCoUFSsBdTfoloE=; b=hBv9ckRe7zvosf7JDjt3p/i6UQR2IInjvXi58yajwJM/rZ2TsRo83B4BHqTXHJ0Nqy WEnJWdVyU4TUGtOv7f/lZAivt4NJk1zAWPw2t7cr+CCmgoJpzxebNq3ZLwcTthNEFDz/ 32NbTce1nV9QTLByQYlNRl6LqlyhdrwA2/gd3qPXnRN0Eg6976RGl/JjhDGM09RUzuwY Ih0xd0/kvJ9w6BPre4y8brA/HDcdj2byklACRT4ko7vvCN3kg3UoFHKcFuwrX8vHYsB5 SH85SF8ZhG0lJ2YgyHiAXaljNbHicY9zFOH2W+Pgmq1NDDeoamVHs5ZL8zfCQJeGQKBg wGUg== X-Gm-Message-State: AOAM531hqR8DsQgSgHX/yMlxWGc3Wb/S7tPa3WrGFqHuV/V0l4jc99YS TL0SdMYpq5OPqrb1+sIAaGh+FsJRdoQ= X-Google-Smtp-Source: ABdhPJzmJIjapo1Hp7Dch+/LdBEjpqw0hgBGLxNL7CUzqJAF12q7IPhD6Cw0l764SXH3iR/pnLFDYg== X-Received: by 2002:aa7:c756:: with SMTP id c22mr27029867eds.239.1591707216095; Tue, 09 Jun 2020 05:53:36 -0700 (PDT) Received: from ercolino-4.local ([88.147.90.33]) by smtp.gmail.com with ESMTPSA id k9sm15032720edl.83.2020.06.09.05.53.34 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 09 Jun 2020 05:53:35 -0700 (PDT) From: Riccardo Veraldi X-Google-Original-From: Riccardo Veraldi Subject: Re: TRIM on mixed SSD/HHD ZFS pool To: peter.blok@bsd4all.org Cc: freebsd-scsi@freebsd.org References: <2F0DC649-4E6D-4520-8258-A6EE652C2949@bsd4all.org> <7a9a0c2b-ef62-a4ad-61f4-f1ba88115f64@gmail.com> Autocrypt: addr=Riccardo.Veraldi@gmail.com; prefer-encrypt=mutual; keydata= mQINBFzjvLwBEADOmF2K2Olb9T8T9I3k+xT3ripWI8lZ8wUlAATF8mKO5WmLvLT1Z4DQZ+d6 P1IlvID/nwgEQGYICfRlDVoVR01hA1OsUt4Uzu7zRH7Eeasg199jWz9xSUeC+LTw/wqFb3mU +oYqpthJZO5gICNZ1X5ob6JjmpP4I/6WyZbxiRVFhgLMJvobU8fO9rMYIk1dkEfhYitDC74P BFmLFpA0mx9GZ2ZL7rFszjQ7LiD8fvygUEMeJ3yTCmn2ugQUw2x4yAlZ11Fp9kxsG+m1Apju MziTU8y9DY5OGDRP4cAnNwBVostT604+Uoh9Yss8y+l+oAT08/7XtuWeXoT5vcIvsWsgi92H FZoAppoS+C7ya4ANVPmzWoYXzHhlU/ibuDe2TCRkl3dR1vKk1Z+rQMagU8azJxH9gxs1fQ2E OEwBsE+11ihAGn8HY5O507BBkeOMMT7dkkY+HHRYM6kES9vUT6jKlq+Y8/zxfshOZKswgAhT dDGp8n0WaTGcLt6EW39yHBdmrqnT3fqQZCguLWS2nnY7vUjWqDrpfZaSl87/GYhkZPfkMFUL +ts5tpSX7ELSfP1aLcdw4tdqc+HaiJLo9Af9pt54aKU3gLrzB8nhb3eCK8Pd8DUXxaI27e30 RlKGMRKRYavpED8iHiu417r0THUeKdS/xDNo59WfselAwdRpQQARAQABtDBSaWNjYXJkbyBW ZXJhbGRpIDxSaWNjYXJkby5WZXJhbGRpQGNuYWYuaW5mbi5pdD6JAk4EEwEIADgCGyMFCwkI BwIGFQoJCAsCBBYCAwECHgECF4AWIQS86utP4lpXDcJ3VAQK64vO9D64lAUCXOO9AwAKCRAK 64vO9D64lFhdEACYvzshTipzdi9GR5sH0QuUCMdZxOkIp8UTAAX2f8oho1ThYfl1myF6VWDZ KzbDnYmb8S+MOIi66fE7AeNvnYBQ4uOpMrHdUWJ1weUvDrsXcsSDrtXShhOWdonWGw3jq2qm UXrJXGEZhn7Wf9EaFJQVXETM3nc8VF5MPhMrJwMW3hzxmt4yj/fok5YKip2L2udfNXB341Ed Ax7szNU90642CxTqFRi00/nhJxSngnz1rvsXWDsSgU+5GO61TYV/hkOgC2T9xTZetQ4u9SVY fKDdfup6yp+kN8xoBnZm6RlPiyVi4EHoZx7xqV+xFeXKJna56DHqTYScfDOeSftHXCKBRyoR Nh5md4aAaaT1LU68MTnjypMSS6mPQ3vxnxLuTQHt0l2fgyyAfy15LjMz3hJdsJxs7Zi0A/cn SRFjDdg8VLVl3SFSX+76ProiV/fRNQ6HveISRWcgt7j20eDca8qKtCgdHv6VmSiNfSr/zNiH yeHbIz2MsKe8E7EPIP7dI1sJHrkT7EuG9bIlWHDQ/IEXHb+JNPvr02Iam64NRQPd+fslULh8 Aimj46BOvfWayYRtyCh9b45RPItRwFfqzeT6WVtpPWAr0ahAj2+NKzk3xDvhj7rpZvuN2XrU Acfr3UZCc0OgLqpiyELCufYwq9+ri1iQYawcADr7RQEdDtzRE7kCDQRc47y8ARAAwGpru+f1 fw4GG4u/kTVKdlYc61i0DFGRaYqwDxMqQsawcEPxH8yO+rc1L72/ToSw7VpIlA1Mh/HX31DF ZhJ7N/Ab2S9Wi4je+g9LwIvybhU70t+RQYgGFCPxbA3sfpW0T8IDBJt+A3Aic8aOO7eI5lua UxZ0affgfBgkXpniQTXG/LP2Z0kRrZlrKwLGwcTaFjU+WwaNREIVPA/3MXiGmGNm4P2zzGou 41UV55OamXjRPjn6u42M/FlP/tYW/DvCSm7jVtrdY8dLh2GPKY9RW9Bw54Q9RiSFB+1bXWFp 8jR8vhpev7R9zqvxwyzeqmDP6MSxpMwn69GWKgabqVswHdOsPXIkgxDlosYfIvAisi8O3jPb 3/niXyIcnEd2J8iX1D/c1jB4mrf3FAenz74j1bN1dT2eDturmi6ABGYpuE9tTouKSxVZa29J 9/d5rB/BvvmjCj7A2qrBMSlONKhL3Siq9R5Sv0Ujkh/6Gn1I3c9i68/GD1I/gi8XhrFkg6eY Mg36PK7sFl+X+7eWjYFowjJqD16/uWzSZVanJxpxQTs9bPSkDdQHQXUno3haL/m9A44JCLjc UHzEiJ4GOCqVpRkSM3ZzTgS4tBrWt5afWFOyNHualJFTO14l5YJHTCWpn7J2j2wA3IKmfER3 uhtxbsqoxMYn+1qy/FHbWYPRArkAEQEAAYkCNgQYAQgAIAIbDBYhBLzq60/iWlcNwndUBArr i870PriUBQJc470DAAoJEArri870PriUswgP/j6CYYkGZdVVEkDB47J8iA1GBnypg5bXUoUi H7h3/H1/NVgHhV6z67bD/cgoqwuCikUMQB0sg7EXc3rvARdfQvq9MCaxA/tqpJw7QDaV/bGX HBGq771cv5DNImypnIkwvPhUw583LHJYC5wHWwCFh/Do/+9V5c7cVm2Qh7UlzXQMjuFKYR4e YkGuQYa/JF1e8K7VgaIKrHrflyxVBgnNjUjbfysLVGu9Bojfcw1DLGvYLgHLNgPBAljn89iD X8hD9Q1RdmN/vFjGBudkWSualpKItpsdAYbD2yVeQaUO9DMNE6DLJSxo0EwwrIimiK0HqjQ6 FIa0GWYwXs01d5QEf++nBhmtgxvZ9/i0iURu92L32dyRDeZL6GsVJPsPv310PeHC1NwYzIQR O2wHChG0BqhjtLlIBMECsbzZ9soCJ97+UH+M8V9WRVj4lIzd9lDOtX4q1EfNm/jl9pNveNH3 96Givk0y0aowElUQ6zRNKopWTiAjbZ1KU8F9c5WbvQba2YZcaWJVkugz58ra5xWxBmP066gB ha/E0OTltCRZsFrMyFAM3fjp/J/u2VDC6M+zfVBfqYKQbaq8r+ywQhCzID0pTlHsqQW7TrHP LT1zWgBxJ7GgteauTDLCLkibG3zdvZhkQ8mz4IDZ0LIuW6c9aZ6o171fMirFBVYjEBInCJPG Message-ID: <68eed401-e74f-1f16-7048-fdc391fcd201@gmail.com> Date: Tue, 9 Jun 2020 14:53:34 +0200 User-Agent: mailx MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: 49h96B07y1z4X7s X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=u4xG6lLE; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of riccardoveraldi@gmail.com designates 2a00:1450:4864:20::52b as permitted sender) smtp.mailfrom=riccardoveraldi@gmail.com X-Spamd-Result: default: False [-2.84 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; XM_UA_NO_VERSION(0.01)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RECEIVED_SPAMHAUS_PBL(0.00)[88.147.90.33:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.05)[-1.045]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; NEURAL_SPAM_SHORT(0.23)[0.228]; NEURAL_HAM_LONG(-1.03)[-1.031]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-scsi@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52b:from]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jun 2020 12:53:39 -0000 On 08/06/2020 18:35, peter.blok@bsd4all.org wrote: > Thx for your answer, but 6 enterprise SSD are way over my budget. I am not sure about the ZFS implementation on FreeBSD but regarding ZFS on Linux (ZoL0 there is a patched version which supports trimming, and I have tryed it (on Linux RHEL7). I had a positive experience with the Intel SSD DC S3510 series 480GB. They are discontinued now but I have seen them on amazon at $280, they are enterprise class, and I never needed to TRIM the FS on them, I Really wrote a lot of data on them, and they are SATA. I also bought a bunch of them second hand which were used intensively and they still run fine even if they have been used a lot before me. I used them as boot disk and system disk on OpenBSD (sparc64). Rick > >> On 5 Jun 2020, at 11:23, Riccardo Veraldi wrote: >> >> you may opt for enterprise level SSD disks. I have been using the 9300 >> NVMe series with Lustre/ZFS writing extensive data and I have never >> needed any trimming on them. They do automatic garbage collection. >> They are quite expensive piece of hardware though. >> >> On 05/06/2020 08:37, peter.blok@bsd4all.org wrote: >>> Hi, >>> >>> I have decided to gradually move over to SSD in my ZFS pool. Anybody knows if ZFS will issue a TRIM designated for the SSD in this mixed case, while the HDD do not support this? >>> >>> Peter >>> >>> >>> _______________________________________________ >>> freebsd-scsi@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >> From owner-freebsd-scsi@freebsd.org Wed Jun 10 21:33:02 2020 Return-Path: Delivered-To: freebsd-scsi@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 916D9340158; Wed, 10 Jun 2020 21:33:02 +0000 (UTC) (envelope-from ctuffli@gmail.com) Received: from mail-pj1-f48.google.com (mail-pj1-f48.google.com [209.85.216.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49j0b15xcsz4bYh; Wed, 10 Jun 2020 21:33:01 +0000 (UTC) (envelope-from ctuffli@gmail.com) Received: by mail-pj1-f48.google.com with SMTP id i4so1452850pjd.0; Wed, 10 Jun 2020 14:33:01 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=4XNBCSL33xik9a3SlnMw/eRS3nqjYX+P0V0G3ILvqMI=; b=iNK0/0E48ypAC/iL5vQHus376n4AaIaVrUf35TrwWSTmVV0BZUAP13IVNfeKAwJv0t rWDOetXG4RjRl4Vgyy9eBjoCRoaUD7aLXJrBZyc/CyG7StfnqhXuQp4q0IstI4W1s3Oh RoIYBu5pOeejZymh6UKRvRCbCJjX8Y1wnzQD/1739OWjZPolHlW6tP9/FfTX2/DRZPEj lcbd1Pn6ntohWcWjCIM6o8aVMYeF9TAhsJee0zpTQlIrfrvERqddXVL2zFWoMIEyA4+G Gqkjr/Y/Gg0QkHQva7mZj6vviJ5V4UKA7ny71tTi9eM0oxe4qkVjuKpBBrzsMsfNB0qM 2enw== X-Gm-Message-State: AOAM533ib9JsZYQMT9aZ/rE+Vxe6DoDpPemGoZwVEjgxN8TLxeboqeCP UdINDNGedc5iqqPUCt3NBC05BVjR X-Google-Smtp-Source: ABdhPJxJvOmrsVDDRDAN7OR/ISzOdLrdXJ4rJzfLmLftJPtyC1xx0W3hGVPMkYy9cxO2+Qo+cChNSw== X-Received: by 2002:a17:902:aa02:: with SMTP id be2mr4524939plb.48.1591824779852; Wed, 10 Jun 2020 14:32:59 -0700 (PDT) Received: from mail-pf1-f178.google.com (mail-pf1-f178.google.com. [209.85.210.178]) by smtp.gmail.com with ESMTPSA id gm11sm626395pjb.9.2020.06.10.14.32.59 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 10 Jun 2020 14:32:59 -0700 (PDT) Received: by mail-pf1-f178.google.com with SMTP id z63so751079pfb.1; Wed, 10 Jun 2020 14:32:59 -0700 (PDT) X-Received: by 2002:a63:6704:: with SMTP id b4mr4338835pgc.419.1591824779297; Wed, 10 Jun 2020 14:32:59 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Chuck Tuffli Date: Wed, 10 Jun 2020 14:32:48 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Updates to bhyve NVMe emulation To: freebsd-virtualization@freebsd.org, freebsd-scsi@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49j0b15xcsz4bYh X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ctuffli@gmail.com designates 209.85.216.48 as permitted sender) smtp.mailfrom=ctuffli@gmail.com X-Spamd-Result: default: False [-1.98 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.216.48:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.03)[0.031]; NEURAL_HAM_LONG(-0.98)[-0.983]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.02)[-1.024]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.216.48:from]; FORGED_SENDER(0.30)[chuck@freebsd.org,ctuffli@gmail.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_TLS_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[chuck@freebsd.org,ctuffli@gmail.com] X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jun 2020 21:33:02 -0000 On Mon, May 18, 2020 at 2:12 PM Chuck Tuffli wrote: > > In an effort to provide better NVMe emulation in bhyve, I've started > running the NVM Express Compliance tests against the bhyve emulation > and fixing issues the tests find. The tests are part of the University > of New Hampshire (UNH) Interoperability Lab (IOL) suite. > > I have posted a series of patches in Phabricator and would appreciate > any feedback people might have. And because there are a few changes, > the plan is to leave them up for review longer than I normally do. > Note that I've cross-posted to the SCSI list to possibly pick up NVMe > expertise. Summary of the patch series with links to differential > reviews: Thank you to those who have tested this patch series. Note there is still time to review these changes if you are interested. If at all possible, I'd like to commit this by the end of this month. --chuck