Date: Thu, 27 Aug 2015 13:17:30 -1000 From: Kevin Oberman <rkoberman@gmail.com> To: Chris Stankevitz <chris@stankevitz.com> Cc: "Bjoern A. Zeeb" <bzeeb-lists@lists.zabbadoz.net>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: ssh over WAN: TCP window too small Message-ID: <CAN6yY1sUU=CY%2BkAcORfcKmQ5kXJ8o-Mm5=DQRcz25aSor=7dHg@mail.gmail.com> In-Reply-To: <55DD0453.3040803@stankevitz.com> References: <55DCF080.7080208@stankevitz.com> <27420EDC-5816-4B9E-A834-E4A035B8411C@lists.zabbadoz.net> <55DD0453.3040803@stankevitz.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Aug 25, 2015 at 2:12 PM, Chris Stankevitz <chris@stankevitz.com> wrote: > On 8/25/15 4:11 PM, Bjoern A. Zeeb wrote: > >> >> On 25 Aug 2015, at 22:47 , Chris Stankevitz <chris@stankevitz.com> wrote: >>> >>> Can anyone recommend some tools/tricks to figure out what in FreeBSD >>> and/or >>> >> >> base SSH is limiting the send/recv buffer and/or TCP window? > >> >> if you have the memory, try these sysctls: >> >> kern.ipc.maxsockbuf=146800640 >> net.inet.tcp.recvbuf_max=67108864 >> net.inet.tcp.sendbuf_max=67108864 >> > > Bjoern, > > Thank you for the reply. Before your suggestion my sysctls are: > > kern.ipc.maxsockbuf=2097152 > net.inet.tcp.recvbuf_max=2097152 > net.inet.tcp.sendbuf_max=2097152 > > Each of these is much larger than the limit I am experiencing (~64,000). > So I [naively] expect changing these values will have no effect. Let me > try... > > ... okay... sure enough the sysctrl changes you suggest did not change the > 64,000 bytes-in-flight limit I am experiencing. > > Thanks for the idea (and keep 'em coming!), > > Chris > My former employer, ESnet, was heavily involved in moving very large amounts of data (petabytes) over very long (intercontinental), very fat (100G) pipes. In an effort to improve customer satisfaction they have done extensive research into the issues involved and have published much of it at http://fasterdata.es.net. In particular, they have documented the issues with ssh over long latency links at http://fasterdata.es.net/data-transfer-tools/say-no-to-scp/. It is VERY hard to get good performance on high latency links in the bast of cases and, unfortunately, ssh/scp makes it not the best of cases. -- Kevin Oberman, Goat herder and Retired Network Engineer
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAN6yY1sUU=CY%2BkAcORfcKmQ5kXJ8o-Mm5=DQRcz25aSor=7dHg>