From owner-freebsd-net@freebsd.org Sat Feb 18 03:41:04 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2C6D2CE462E for ; Sat, 18 Feb 2017 03:41:04 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wm0-x235.google.com (mail-wm0-x235.google.com [IPv6:2a00:1450:400c:c09::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B305515CD for ; Sat, 18 Feb 2017 03:41:03 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wm0-x235.google.com with SMTP id v186so31713885wmd.0 for ; Fri, 17 Feb 2017 19:41:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=Xb6gzpCm+CW9FfwYo0BWhjW9fckL6LKTcTHg52Hw9xE=; b=AOdutOb8bep4PS24zdDpw8K8I7MRKn95pL171JyNrFR+BGV0ynVI2XEEfLtEh0kPDe W09bxP5jb4IHYqX0qxNZkhOMcZB7LBmaBlld2Ybp5g/eoX31ve+oDCK0U738kwfsrduJ HtcQXMJxd27wWmXwOtb18h3o3qLCZZYGph/0NIbIc1mgeNYv+gFX8Rf4LOdZ1Y3YLTgd 48xUnTdfEm85MQv76ffMdkNw0EG4EX+1x3gIXpTWoUc2jcZcER2avnvI7Fpw/AIwQWxU a7eLS4+jqEGpMgieNJfi1eNsA2nMplLJWlORvai3UmeI8a498ezKMfq0tis6HLGsUleP gT2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=Xb6gzpCm+CW9FfwYo0BWhjW9fckL6LKTcTHg52Hw9xE=; b=dkK/9ucKHAzjRjnAe63FDvQIQ+Mso6RvAy/9OnFOLK4dRCR6YLMWmJdUWrJ0L/ecR8 c1kO1mcQJL5SmjZFrLmyfkBCUV7KZlQy7nHhRqVvJG7R99I7VbxdOW3Vgw39+p1JGt6V oIlnRoO2S5SDTneWnyeQRtcGNbfyASSMWW87EnJamBY3dp6lmSgFBPoGf+pZpmDxE9H0 Tu4Lx/eX0gKnc5LyJ4P/zPCp6TA3qOwR/I1AueoLJr8vJKoh5G41a0NX+9KzcSqsD7YW lfYf1zSgvRy849R+yaPa3qKyAjmLYwoQPjQmUCSGLgfBwJa/OlXNad+6q5/O95glHDSj sU2w== X-Gm-Message-State: AMke39kczzi90dIq9wPjjYhCpvLKMrOn/tYKthLxLrMLMyb7l63S64VpA5o2gr0gj7oydA== X-Received: by 10.28.39.5 with SMTP id n5mr3951046wmn.16.1487389261867; Fri, 17 Feb 2017 19:41:01 -0800 (PST) Received: from ?IPv6:2a02:a03f:a4e:be01:847d:d027:9efb:3b2e? ([2a02:a03f:a4e:be01:847d:d027:9efb:3b2e]) by smtp.googlemail.com with ESMTPSA id q12sm4013157wmd.8.2017.02.17.19.41.01 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 19:41:01 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: Slow Download Speeds from AWS S3 Date: Sat, 18 Feb 2017 04:41:00 +0100 References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> To: freebsd-net@freebsd.org In-Reply-To: Message-Id: <7D26AA10-4A9A-47F8-8D6D-380FCC2A0071@googlemail.com> X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 03:41:04 -0000 Here is a 100MB random file in the Frankfurt region: http://s3.eu-central-1.amazonaws.com/43cf34497f/random.raw Sydney > On 18 Feb 2017, at 04:31, Sydney Meyer = wrote: >=20 > Hi Steve, >=20 > sure, but i have deleted the bucket already.. i'll set a new one up = quickly.. do you have a specific aws region which you prefer? >=20 > Sydney >=20 >> On 18 Feb 2017, at 04:26, Steven Hartland = wrote: >>=20 >> Hey Sydney, I've had some feedback from other team members and armed = with this info I'm having a crack at enabling receive buffer = auto-scaling using RTT estimations when timestamps aren't available. >>=20 >> I don't have any S3 buckets to tests with so Is there any chance you = pop up your test file again for me? >>=20 >> Regards >> Steve >>=20 >> On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: >>> Hi Steve, >>>=20 >>> increasing the buffer size did indeed enhance throughput. >>>=20 >>> I am obviously not an expert in this field, but i don't understand = why or if the TCP Receive Window Size shouldn't increase automatically. >>>=20 >>> I found this thread on the ML and i'm reading myself a bit more into = the topic right now. >>>=20 >>> = https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html >>>=20 >>> Thank you for your tip, however.. >>>=20 >>> Sydney >>>=20 >>>> On 16 Feb 2017, at 16:35, Steven Hartland = wrote: >>>>=20 >>>> Window scaling and receive buffer scaling is the most likely cause. >>>>=20 >>>> Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. >>>> sysctl net.inet.tcp.recvspace=3D655360 >>>>=20 >>>> This jumped the transfer rate with a wget and your test URL from = 3MB/s to 30MB/s here. >>>>=20 >>>> Regards >>>> Steve >>>>=20 >>>> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>>>> Hello, >>>>>=20 >>>>> I'm seeing continuous slow download speeds from Amazon S3, but = only on FreeBSD. Other OSes saturate the connection without problems. >>>>>=20 >>>>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS = S3 in different regions (Ireland, London, Frankfurt, US Standard have = been tested) whilst using fetch, curl, et. al. >>>>>=20 >>>>> I have tested this on multiple machines, bare metal, bhyve, Xen = and VMware VMs, routed setups and direct pppoe links.. all the same. >>>>>=20 >>>>> Anyone seeing similar issues? >>>>>=20 >>>>> Here's a url to try: >>>>>=20 >>>>> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>>>>=20 >>>>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>>>>=20 >>>>> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>>>>=20 >>>>> I have launched VMs with Digital Ocean to "rule out" my ISP and = there seems to be the same issue. Downloading from S3 is multiple times = slower than any other connection to services outside of S3 or on any = other OS. >>>>>=20 >>>>> It seems like other people are seeing the same issue: >>>>>=20 >>>>> https://forums.freebsd.org/threads/59756/#post-343064 >>>>> _______________________________________________ >>>>> freebsd-net@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20