Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 07 Feb 2022 12:29:32 +0000
From:      Jamie Landeg-Jones <jamie@catflap.org>
To:        freebsd-current@FreeBSD.org
Subject:   Re: USB Disk Stalls on -current
Message-ID:  <202202071229.217CTWBe072476@donotpassgo.dyslexicfish.net>
In-Reply-To: <CAD2Ti28KcLcaVaKRk4PVUNKwU-bMgFZe4wydAb6e5G4vetbf1Q@mail.gmail.com>
References:  <7e8459e4-d708-7750-402c-cda2adf6199f@freebsd.org> <CANCZdfqG-%2B9dfFz-%2BeezZaqbPQN5-mQpw%2B214CkiKC%2B_kmW2ig@mail.gmail.com> <60ebd011-c2b8-3524-1476-123f11128ffe@freebsd.org> <CAD2Ti2_WP8y9tADUYjH5PykPm8oJyqRjrj-%2Bk_xHU99kFbWNxw@mail.gmail.com> <CANCZdfp62bbVNJ=VuD3VaOtPpVLPrMg9jaEha6tw33vfWXRDJA@mail.gmail.com> <CAD2Ti28KcLcaVaKRk4PVUNKwU-bMgFZe4wydAb6e5G4vetbf1Q@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
grarpamp <grarpamp@gmail.com> wrote:

> Yes, some USB hw is very flaky,
> but ZFS can work great on these...

For what it's worth, I have had for 2.5 years, tracking stable, a NAS hanging
off a single NUC usb port, with 14 hard disks, 12 of which are used for 2 ZFS,
spools, of two 3X2 mirror spools.

Albeit, I'm using USB3

During heavy writes, I often get:

[1429164] (da10:umass-sim10:10:0:0): WRITE(16). CDB: 8a 00 00 00 00 02 04 39 b2 80 00 00 01 00 00 00
[1429164] (da10:umass-sim10:10:0:0): CAM status: CCB request completed with an error
[1429164] (da10:umass-sim10:10:0:0): Retrying command, 14 more tries remain

, but with no errors or timeouts. I scrub regularly etc.

It rarely has to attempt a retry more than once (although I did bump
"kern.cam.da.retry_count" up to 15 a while back while dealing with another
issue, and never changed it back)

I only get about 300MB/s maximum on file reads though, but the current USB
daisychaining I use isn't ideal. (Each raw disk individually give 150MB/s)

The only issue I have is occasionally the main USB hub craps out, and all
the disks disappear for a few seconds. When it recovers, and the OS sees
the disks again, things remain weird until a reboot.

cheers, Jamie



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?202202071229.217CTWBe072476>