Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 26 Aug 2019 08:39:52 -0500
From:      Jason Bacon <bacon4000@gmail.com>
To:        Hans Petter Selasky <hps@selasky.org>, freebsd-infiniband@freebsd.org
Subject:   Re: Kernel modules
Message-ID:  <d4185139-f16e-51e4-222e-d2f6215b81c5@gmail.com>
In-Reply-To: <bb497012-81c9-f05a-6d1a-6061fa731348@selasky.org>
References:  <0eba9ec9-692f-7677-2b10-4e67a232821c@gmail.com> <f3f94452-155f-79f4-72d8-bf65760ae5b0@selasky.org> <598a58f0-89b8-d00d-5ed7-74dd7005950f@gmail.com> <73ce0738-4d63-2f25-2ff6-00f0092de136@selasky.org> <2090dd24-db43-b689-4289-f50bd70090ea@gmail.com> <6673df26-8bba-ebd3-b2c5-d7e9c97db557@gmail.com> <d82f3a60-6ad4-dba8-a15b-355a536a9a83@gmail.com> <bd42597e-2981-4667-468e-b008b9be290b@selasky.org> <2f4d9a14-4ff6-0d34-06f0-bbb4ac76c6bd@gmail.com> <5166ec29-876b-0bd3-8a84-8a222647e87a@gmail.com> <b6e6f8931f59fb2ecf985478ea4d77b7@postgresql.org> <236a3839-e880-ab17-146a-4521d1894813@gmail.com> <ea3b8d21-3ce0-17ea-1e04-a84ef7c81baa@gmail.com> <691d5884-6947-8044-ecf6-05ab97e9faca@gmail.com> <bb497012-81c9-f05a-6d1a-6061fa731348@selasky.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2019-08-26 08:13, Hans Petter Selasky wrote:
> On 2019-04-18 14:52, Jason Bacon wrote:
>>
>> My NFS over IB has been generally working well, but it's going down=20
>> under very heavy load.=C2=A0 It's getting consistently triggered by 25=
6=20
>> I/O-intensive processes across about a dozen compute nodes.
>>
>> The server remains up and responsive, but ib0 is running out of=20
>> buffer space and going down.
>>
>
> Hi Jason,
>
> Mellanox found a bug in ipoib which can lead to similar sympthoms that =

> you see. Can you try the attached patch?
>
> Thank you!
>
> --HPS
That's great to hear...

Unfortunately, I no longer have admin access to a large cluster with=20
Mellanox HCAs, as I just changed jobs.

I did my best to thoroughly test FreeBSD IB before I left my old=20
position.=C2=A0 This was the only outstanding issue with the FreeBSD file=
=20
server I was testing, so if this fix resolves it, I would say that=20
FreeBSD is production-ready for IB clusters.

--=20
Earth is a beta site.





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?d4185139-f16e-51e4-222e-d2f6215b81c5>