From owner-freebsd-questions@FreeBSD.ORG Thu Oct 19 05:31:48 2006 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 167FC16A403 for ; Thu, 19 Oct 2006 05:31:48 +0000 (UTC) (envelope-from marmoset@malformed.org) Received: from fincher.users.accretive-networks.net (fincher.users.accretive-networks.net [216.127.44.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id BFE1743D49 for ; Thu, 19 Oct 2006 05:31:47 +0000 (GMT) (envelope-from marmoset@malformed.org) Received: from fincher.users.accretive-networks.net (localhost [127.0.0.1]) by fincher.users.accretive-networks.net (8.13.6/8.13.6) with ESMTP id k9J5ViCm024408; Wed, 18 Oct 2006 22:31:44 -0700 (PDT) Received: from localhost (moses@localhost) by fincher.users.accretive-networks.net (8.13.6/8.13.6/Submit) with ESMTP id k9J5Vixf024405; Wed, 18 Oct 2006 22:31:44 -0700 (PDT) X-Authentication-Warning: fincher.users.accretive-networks.net: moses owned process doing -bs Date: Wed, 18 Oct 2006 22:31:44 -0700 (PDT) From: Moses Leslie X-X-Sender: moses@fincher.users.accretive-networks.net To: freebsd-questions@freebsd.org Message-ID: <20061018222030.S11323@fincher.users.accretive-networks.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: increasing transmit speeds in WAN setting? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Oct 2006 05:31:48 -0000 Hi, We're running 6.1-R, and are having difficulty getting decent speeds as latency increases. The server is connected via gbit copper, and is gbit or better to the internet (depending on the path). For everything local, we're able to get what you'd expect (300+MBit without really any tuning). However, when the latency is 60-80ms (IE across the US), we're unable to get better than around 300KB/s. It appears to be possibly related to the tcp.inflight stuff, but disabling it or messing with some of the related sysctls doesn't appear to help much. Downloads often start quickly, but are then throttled back down to 300KB/s within 10 seconds or so. We've changed the hz (100 to 10000), the net.inet.tcp.sendspace, kern.ipc.maxsockbuf, and tried different variations on the inflight tunables, but nothing has made a positive difference of more than ~20KB/s at best. If the server is running linux (2.6 kernel with default TCP settings), we can get much better speeds, 600-1000KB/s easily. If we were going for time/distance records, we would try changing around tcp settings on the client, but we're trying to maximize performance for standard surfers who wouldn't know how to do that, so we're looking for anything that is server side only. We've been searching high and low for any tuning ideas but aren't able to find anything that's made a difference. From looking at how the congestion stuff works in the source, it appears that something like: http://www.sigusr1.org/weblog/index.php?/categories/6-Hacks might be happening here, but we're kind of stabbing in the dark. Does anyone have any tuning ideas for 6.1 in a WAN setting? Thanks, Moses