Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 28 Dec 2023 17:01:32 +0100
From:      Dimitry Andric <dim@FreeBSD.org>
To:        "lev@freebsd.org" <lev@FreeBSD.org>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: ZFS pool hangs (live-locks?) after adding L2ARC
Message-ID:  <3260F369-4F60-46E6-939A-B3668F347622@FreeBSD.org>
In-Reply-To: <e30888e5-44c6-4ce5-b34a-312c6b1bad77@FreeBSD.org>
References:  <b587ebd2-2206-4025-84f5-c855aa59d7ee@FreeBSD.org> <88ae141a-93af-4f23-87c1-f44a99975a28@FreeBSD.org> <FA440727-D5FE-4B9F-AB28-FB591F9F4F07@FreeBSD.org> <e30888e5-44c6-4ce5-b34a-312c6b1bad77@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 28 Dec 2023, at 16:03, Lev Serebryakov <lev@freebsd.org> wrote:
>=20
> On 28.12.2023 15:16, Dimitry Andric wrote:
>=20
>>>>   I can not find any discussion about such problem on Internet. =
Also, "live" system doesn't have these "z_int_X_Y" threads at all.
>>>>   I want my L2ARC, I've payed for this NVMe!
>>>=20
>>> Any ideas?
>> Do you know 100% sure that this new NVMe device is working correctly? =
Are there any errors to be found in SMART information, dmesg or syslog?
>=20
> I'm running "ssd-steadystate.fio" on this SSD now (not whole SSD but =
only l2arc partition, which is 85% of whole SSD to have 15% =
over-provisioning), after running `trim` on it.
>=20
> Let see...
>=20
> If you could advice better scenario for `fio` (with some TRIM added =
for good measure?) I can run it too.

If these tests all work, I would first try making a plain new zpool, =
with just this one device under it, and with the same settings you are =
using for the other zpools.

Then mount the pool somewhere, and exercise it with whatever workload =
you can find, to see if that too "locks up". If not, you may have found =
some sort of problem specific to l2arc, and I would guess it is best to =
take that upstream?

If it does lock up, there is probably some sort of incompatibility =
between your NVMe device and the FreeBSD driver. You could then try =
using another driver, IIRC there are two different ones now?

-Dimitry




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3260F369-4F60-46E6-939A-B3668F347622>