Date: Fri, 17 Dec 1999 14:30:10 -0800 (PST) From: daniel B <danielb@pacex.net> To: Juha Saarinen <juha@saarinen.org> Cc: freebsd-questions@FreeBSD.ORG Subject: RE: Not such good networking performance with FreeBSD Message-ID: <Pine.BSF.4.10.9912171417430.2761-200000@almazs.pacex.net> In-Reply-To: <LNBBIBDBFFCDPLBLLLHFMEGNGGAA.juha@saarinen.org>
next in thread | previous in thread | raw e-mail | index | archive | help
This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. Send mail to mime@docserver.cac.washington.edu for more info. --0-935013279-945469810=:2761 Content-Type: TEXT/PLAIN; charset=US-ASCII Thanks for the info; ATM is cell relay so if too many cells are dropped by your upstream/ISP it cause alot of retransmits, so unless you're running ATM you are forced to resend the whole IP packet again (ATM cells are very small byte-wise). I just did traceroute wiith -S option to cassandra.paradise.net.nz and realy bad latency with 30% loss (see attached file). I also have to deal with other non-FreeBSD issues i.e my dialup switch, teleco local loop, DSL loop e.t.c Dan On Sat, 18 Dec 1999, Juha Saarinen wrote: > Hi Daniel, > > I can only give you some general advice based on my experience with RADSL > (rate-adaptive DSL), and not anything terribly useful for FreeBSD... > > My telco runs ATM over DSL over which a PPP connection to my ISP is > encapsulated, so to speak. To start with, the telco had some problems with > its DSLAMs that caused long pauses and sometimes routing timeouts, making > interactive apps like ssh unusable. The telco said this was partly due to > ATM cells being lost which is disastrous for the larger IP packets, as it > causes lots of retransmissions... not so sure about that, but anyway, it > shows the complexity of squeezing that amount of bandwidth through plain old > copper wires, I guess. > > Even though the router says I've got 5.7Mbps (bits per second) to the > exchange, the telco appears to have capped each TCP session at 2Mbps max > (grrr...). That's still pretty good, but what complicates things for me is > the high latencies I see as soon as I connect to servers outside New > Zealand: > > traceroute to pacex.net (204.1.219.156), 30 hops max, 40 byte packets > 1 m10 (192.168.1.254) 1.075 ms 0.993 ms 0.913 ms > 2 203-79-82-254.adsl-wns.paradise.net.nz (203.79.82.254) 86.952 ms > 85.922 ms 66.505 ms > 3 192.168.253.225 (192.168.253.225) 45.744 ms 45.747 ms 45.314 ms > 4 kelly.ipnet.paradise.net.nz (203.96.153.138) 46.478 ms 45.642 ms > 46.252 ms > 5 cassandra.paradise.net.nz (203.96.152.3) 46.431 ms 45.809 ms 46.426 > ms > 6 a4-0-0-5.akbr1.netgate.net.nz (202.37.246.77) 55.911 ms 56.173 ms > 56.100 ms > 7 a0-0-0-2.tkbr1.netgate.net.nz (202.37.246.121) 57.310 ms 56.517 ms > 59.378 ms > > Leaving NZ, going to LA: > > 8 s1-1-4.labr1.netgate.net.nz (202.37.245.166) 238.127 ms 181.145 ms > 181.776 ms > 9 s5-0-0.lsanca1-cr1.bbnplanet.net (4.24.24.17) 180.932 ms 185.284 ms > 181.803 ms > 10 p2-1.lsanca1-ba1.bbnplanet.net (4.24.4.5) 184.113 ms 180.490 ms > 181.832 ms > 11 p7-0.lsanca1-br1.bbnplanet.net (4.24.4.2) 236.089 ms 237.078 ms > 236.339 ms > > <snip> > > 22 dsl1.irvnca01.us.ra.verio.net (192.215.247.103) 218.263 ms 218.406 ms > 215.212 ms > 23 compappcon-dw.customer.ni.net (204.1.216.14) 216.128 ms 217.187 ms > 218.471 ms > 24 almazs.pacex.net (204.1.219.156) 272.606 ms 273.758 ms 272.252 ms > > These are quite good roundtrip times for me actually. Sometimes they go well > into the 300-400ms range, which really makes applications that depend on > opening lots of connections and getting small files (like Web browsing) > suck, despite my multi-Mbps connection. > > Anyway, what I've found to help on all operating systems apart from FreeBSD > is to enable and tune the TCP High Performance extensions settings (RFC > 1323). It's less than obvious how you do this on FreeBSD, unfortunately. > This is what I've dug up so far... correct me if I'm wrong by all means. > > Put: > > tcp_extensions="YES" > > into /etc/rc.conf > > Then, it looks like you have to use the sysctl command to check and tune > some of the TCP settings: > > sysctl -w net.inet.tcp.sendspace=65536 && sysctl -w > net.inet.tcp.recvspace=65536 should give you 65KB TCP windows -- for some > reason, FreeBSD defaults to 16KB which is quite small. > > There are two more settings which I can't find documented anywhere, but > which I suspect affect things as well: > > net.inet.tcp.mssdflt: 512 (is this the default Maximum Segment Size? > shouldn't it be 1460 bytes?) > net.inet.raw.recvspace: 65536 (I've bumped it up as an experiment -- think > the default is 8192). > > sysctl -a | less shows you all the settings. > > Other than that, having an MTU/MRU of 1500 seems to work the best, and you > might want to check that you're not using e.g. PPP compression settings that > aren't compatible with with your ISP's peer. I have no idea how well stuff > like PPP address field and header compression works with high bitrate > connections, but I suspect that enabling them would add latency. > > Hope the above is of some use to you... > > > Cheers, > > -- Juha > > > > -----Original Message----- > > From: daniel B [mailto:danielb@pacex.net] > > Sent: Saturday, 18 December 1999 06:41 > > To: Juha Saarinen > > Cc: freebsd-questions@freebsd.org > > Subject: RE: Not such good networking performance with FreeBSD > > > > > > Sorry to intrude on this thread; but I am kinda having the same problem. > > My DSL speed was kinda OK when I wwas running 2.2.8 but ever since I > > upgraded to 3.x releases I just get poor performance and sometimes ssh > > kinda hungs up when accessing lan via ppp. > > Are there tricks and ways to get better networking performance on FreeBSD? > > this may soung very trival but I have realy noticed performance drop on > > this FreeBSD boxens. > > > > Dan > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-questions" in the body of the message > --0-935013279-945469810=:2761 Content-Type: TEXT/PLAIN; charset=US-ASCII; name=trace-cassandra Content-Transfer-Encoding: BASE64 Content-ID: <Pine.BSF.4.10.9912171430100.2761@almazs.pacex.net> Content-Description: Content-Disposition: attachment; filename=trace-cassandra IDEgIHJvdXRlciAoMjA0LjEuMjE5LjEyOSkgIDAuNzY1IG1zICAwLjc3NCBt cyAgMC44NzYgbXMgKDAlIGxvc3MpDQogMiAgMjA0LjEuMjE2LjEgKDIwNC4x LjIxNi4xKSAgMTkuMzAyIG1zICAxNi40MjIgbXMgIDE2LjYyNCBtcyAoMCUg bG9zcykNCiAzICBmYS02LTAtMC5hMDIuaXJ2bmNhMDEudXMucmEudmVyaW8u bmV0ICgxOTIuMjE1LjI0Ny45MykgIDEwLjkzNCBtcyAgMTEuNjY5IG1zICAx Mi4zMjQgbXMgKDAlIGxvc3MpDQogNCAgZmEtMC0xLTAuYTAzLmlydm5jYTAx LnVzLnJhLnZlcmlvLm5ldCAoMTkyLjIxNS4yNDcuOTYpICAxMi4zNTEgbXMg IDEyLjY2OCBtcyAgMTEuOTkwIG1zICgwJSBsb3NzKQ0KIDUgIHZzYy1pcnZp bmUucGFvNi52ZXJpby5uZXQgKDEyOS4yNTAuMTcuOSkgIDI4LjI4OCBtcyAg MjguMjkzIG1zICAyOC4wMjUgbXMgKDAlIGxvc3MpDQogNiAgcDMtMS5wYWl4 LWJpMS5iYm5wbGFuZXQubmV0ICg0LjAuNi42KSAgMjUuODA1IG1zICAyNi4w NDUgbXMgIDI2LjkwMCBtcyAoMCUgbG9zcykNCiA3ICA0LjAuNi4xMDEgKDQu MC42LjEwMSkgIDI3LjAzNSBtcyAgMjYuMjU5IG1zICAyNi44OTAgbXMgKDAl IGxvc3MpDQogOCAgcDYtMC5sc2FuY2ExLWJyMi5iYm5wbGFuZXQubmV0ICg0 LjI0LjUuMTk3KSAgMzYuODY4IG1zICAzNy40NjIgbXMgIDM2Ljk3OCBtcyAo MCUgbG9zcykNCiA5ICBwMi0wLmxzYW5jYTEtYnIxLmJibnBsYW5ldC5uZXQg KDQuMjQuNC4xMykgIDM4LjI4NiBtcyAgMzYuMTk2IG1zICAzNi4wMTcgbXMg KDAlIGxvc3MpDQoxMCAgcDctMC5sc2FuY2ExLWJhMS5iYm5wbGFuZXQubmV0 ICg0LjI0LjQuMSkgIDM5LjE4MiBtcyAgMzcuMzQyIG1zICAzOC4yOTUgbXMg KDAlIGxvc3MpDQoxMSAgcDAtMC0wLmxzYW5jYTEtY3IxLmJibnBsYW5ldC5u ZXQgKDQuMjQuNC42KSAgNDAuMjI4IG1zICAzNy40MjYgbXMgIDQwLjM1NSBt cyAoMCUgbG9zcykNCjEyICBzMC50ZWxlY29tbnouYmJucGxhbmV0Lm5ldCAo NC4yNC4yNC4xOCkgIDM5LjMyNiBtcyAgMzguNjA0IG1zIGgxLTAudGVsZWNv bW56LmJibnBsYW5ldC5uZXQgKDQuMjQuMjQuNikgIDM5LjI1MiBtcyAoMCUg bG9zcykNCjEzICAqICogKiAoMTAwJSBsb3NzKQ0KMTQgICogKiAqICgxMDAl IGxvc3MpDQoxNSAgcGFyYWRpc2Uud3dicjEubmV0Z2F0ZS5uZXQubnogKDIw Mi4zNy4yNDcuMjMwKSAgMzkzLjMxMiBtcyAgNDYyLjQ3MSBtcyAqICgzMyUg bG9zcykNCg== --0-935013279-945469810=:2761-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.BSF.4.10.9912171417430.2761-200000>