From owner-freebsd-net@freebsd.org Thu Feb 16 15:35:58 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A980BCE1DEF for ; Thu, 16 Feb 2017 15:35:58 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr0-x22f.google.com (mail-wr0-x22f.google.com [IPv6:2a00:1450:400c:c0c::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46281178E for ; Thu, 16 Feb 2017 15:35:58 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr0-x22f.google.com with SMTP id z61so14191514wrc.1 for ; Thu, 16 Feb 2017 07:35:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=4gF9Lc4pQPh6zPyl8avZaBMgOEnhmXhjql1BXJKFWmM=; b=g+IVW2V3LVPTis9WMpqPic9zXHyiX4PWSbt4IN9tPN1MIdWyil/qmvVm+8npGTEDoA 3wnraYaefk9myQDCPhAzkjp4ktvLX+GEZ18ExjlfdUT6qJd2CzGkpN0d8a4NPwYGGT/e INKaCsdqGhxAxETwCDq/V0NE7bu6nY+jDrHVqnL0s5D+gGoIJ4wwEHoxdHhwa3kc5y2q 8RZLvWVXcygDyxqX4ptSPpB5cq/l9QmmtjYw1UUfMi5ZjW2p85ykqIdWhoNTkCpNnuTw /K13dVZJg3u5/l2JR9zV3M7P0Ei4zFSJvO+Nk5l+yh6N1ZHDWAx9LunPecWHzkgAUHPI M6cg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=4gF9Lc4pQPh6zPyl8avZaBMgOEnhmXhjql1BXJKFWmM=; b=Kb9flYgXiQ4v+xZyyTTnESn/H7fE8yYsNFSgxx3N0+j7uhuRV1HsrgMGUjzzXd1eI5 z6ygIXqlQMWZWKvMAH0Int7aNV164RmJW6txoy584Dmk7chtGjOnMstBPjwLc/2A/fPx tDp4AY87+4BuV/WZq4NXBsKPAUl8DvM4t63JunBntrTXglFfLPwaHkli1Afa16e5Jvg1 wAtA1N85MX0TE+pysGz8x5GYTvQWmxVBT+Sp+TBLz6JDKpnwdw9OdrLCktNXZD9WC+tV A+Ms+Gt7K7YehbmijLrZgXc0lwq5gz36fhtbNnCuY31qCGbaFWBQx4DfJO/goIkXaK+M 9OVA== X-Gm-Message-State: AMke39nCIMg9nWHFpMrocTA2FHa5YdhzzCgRdUCYu8gJkQiUPdZLp+tYl6UOQHaMkEGtrKHj X-Received: by 10.223.133.98 with SMTP id 89mr2853784wrh.200.1487259356001; Thu, 16 Feb 2017 07:35:56 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id y30sm9336085wrc.23.2017.02.16.07.35.54 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 07:35:55 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: From: Steven Hartland Message-ID: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> Date: Thu, 16 Feb 2017 15:35:59 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 15:35:58 -0000 Window scaling and receive buffer scaling is the most likely cause. Check what the sysctl net.inet.tcp.recvspace is set to, then try increasing it e.g. sysctl net.inet.tcp.recvspace=655360 This jumped the transfer rate with a wget and your test URL from 3MB/s to 30MB/s here. Regards Steve On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: > Hello, > > I'm seeing continuous slow download speeds from Amazon S3, but only on FreeBSD. Other OSes saturate the connection without problems. > > This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in different regions (Ireland, London, Frankfurt, US Standard have been tested) whilst using fetch, curl, et. al. > > I have tested this on multiple machines, bare metal, bhyve, Xen and VMware VMs, routed setups and direct pppoe links.. all the same. > > Anyone seeing similar issues? > > Here's a url to try: > > http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zerofile.raw > > Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with "Share with my Mac"-Interface, the machine is doing completely fine, as in saturates the link, 90Mbps otherwise between 12-15Mbps.. > > I also switched the FreeBSD Routers with Linux-based ones and with the isp-provided router box, with the same result. > > I have launched VMs with Digital Ocean to "rule out" my ISP and there seems to be the same issue. Downloading from S3 is multiple times slower than any other connection to services outside of S3 or on any other OS. > > It seems like other people are seeing the same issue: > > https://forums.freebsd.org/threads/59756/#post-343064 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"