Date: Thu, 1 Nov 2018 04:46:28 +0300 From: Andrew Vylegzhanin <avv314@gmail.com> To: rmacklem@uoguelph.ca Cc: "Rodney W. Grimes" <freebsd-rwg@pdx.rh.cn85.dnsmgr.net>, freebsd-fs@freebsd.org, freebsd-infiniband@freebsd.org Subject: Re: NFS + Infiniband problem Message-ID: <CA%2BBi_YjyGYQpvuEiNVgaudD0PVMtRacZo7RVFCxG4ruP8VM23g@mail.gmail.com> In-Reply-To: <YTOPR0101MB11622A98B2358A0A83CD6927DDCE0@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM> References: <CA%2BBi_YiHoxFc3wsEPnMeBHWgW-nh6sXQCEgBTb=-nD6-XcjZ%2Bg@mail.gmail.com> <201810291506.w9TF6YAP057202@pdx.rh.CN85.dnsmgr.net> <YTOPR0101MB11622A9797376128D2FA182ADDF30@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM> <CA%2BBi_YhHvpqkmP7WVd4wJj0u9rnbMZpum7FsKxZsu=%2B=8ze8-w@mail.gmail.com> <YTOPR0101MB116206BEB6259AA2836B16BCDDCD0@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM> <CA%2BBi_YgpzBYyho_ex4p9nx0HHvvRb5kncKapUBEJQk88Et3BCQ@mail.gmail.com> <YTOPR0101MB11622A98B2358A0A83CD6927DDCE0@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM>
next in thread | previous in thread | raw e-mail | index | archive | help
=D1=87=D1=82, 1 =D0=BD=D0=BE=D1=8F=D0=B1. 2018 =D0=B3. =D0=B2 3:27, Rick Ma=
cklem <rmacklem@uoguelph.ca>:
> >Also need to test setup with infniband set from connected mode to
datagram mode.
> Are you using IPv6 by any chance?
No, I don't.
> Why I ask is that there was a problem with IPv6 fragmentation
re-assembly. If
> InfiniBand is using a larger MTU than the ethernet, the switch would
probably
> fragment the IP datagram. If any fragment is lost (or fragmentation
re-assembly
> is broken), it isn't going to work well.
> "netstat -s | fgrep "fragments dropped after"
[root@nas1 ~]# netstat -s | fgrep "fragments dropped after"
0 fragments dropped after timeout
0 fragments dropped after timeout
> will show you the count of fragments dropped after timeout. If this value
is
> increasing, then fragmentation re-assembly is an issue. (Check on the
receiving
> end. The server for writes.)
>
> You might want to post on freebsd-net@, since someone there might know
more
> about InfiniBand (and someone over there will definitely know about the
IPv6
> fragmentation problem.
I'm cc'ed to freebsd-infiniband@ also, but silence.
>
> rick
--
Andrew
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2BBi_YjyGYQpvuEiNVgaudD0PVMtRacZo7RVFCxG4ruP8VM23g>