Date: Wed, 31 Oct 2018 23:02:25 +0300 From: Andrew Vylegzhanin <avv314@gmail.com> To: rmacklem@uoguelph.ca Cc: "Rodney W. Grimes" <freebsd-rwg@pdx.rh.cn85.dnsmgr.net>, freebsd-fs@freebsd.org, freebsd-infiniband@freebsd.org Subject: Re: NFS + Infiniband problem Message-ID: <CA%2BBi_YgpzBYyho_ex4p9nx0HHvvRb5kncKapUBEJQk88Et3BCQ@mail.gmail.com> In-Reply-To: <YTOPR0101MB116206BEB6259AA2836B16BCDDCD0@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM> References: <CA%2BBi_YiHoxFc3wsEPnMeBHWgW-nh6sXQCEgBTb=-nD6-XcjZ%2Bg@mail.gmail.com> <201810291506.w9TF6YAP057202@pdx.rh.CN85.dnsmgr.net> <YTOPR0101MB11622A9797376128D2FA182ADDF30@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM> <CA%2BBi_YhHvpqkmP7WVd4wJj0u9rnbMZpum7FsKxZsu=%2B=8ze8-w@mail.gmail.com> <YTOPR0101MB116206BEB6259AA2836B16BCDDCD0@YTOPR0101MB1162.CANPRD01.PROD.OUTLOOK.COM>
next in thread | previous in thread | raw e-mail | index | archive | help
=D1=81=D1=80, 31 =D0=BE=D0=BA=D1=82. 2018 =D0=B3. =D0=B2 5:53, Rick Macklem= <rmacklem@uoguelph.ca>: > > > > >net.inet.tcp.cc.algorithm=3Dhtcp > Well, I'm not familiar with the current TCP stack (and, as noted before, I know > nothing about InfiniBand). All I can suggest is testing with the default congestion > control algorithm. (I always test with the default, which appears to be newreno.) > NFS traffic looks very different than a typical use of TCP. Lots of small TCP > segments in both directions interspersed with some larger ones (the write > requests or read replies). With this TCP settings same server serve NFS requests via 40G Ethernet on multiply clients with speed via 1G Eth ~ 105/110 MB/sec write/read. Of course I'll try to change congestion algorithm, but I don't think that will help. Also need to test setup with infniband set from connected mode to datagram mode. -- Andrew > > rick
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2BBi_YgpzBYyho_ex4p9nx0HHvvRb5kncKapUBEJQk88Et3BCQ>