From owner-freebsd-net@freebsd.org Sat Feb 18 03:26:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 81EA6CE4115 for ; Sat, 18 Feb 2017 03:26:12 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2B08DE3E for ; Sat, 18 Feb 2017 03:26:12 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wm0-x22c.google.com with SMTP id c85so31514756wmi.1 for ; Fri, 17 Feb 2017 19:26:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=8VqYL4HLt841J2pIKKRNlpzQR2nrWsFDAdx3KothmNM=; b=bCUIkTJPgVBH06Xw3SArxloGb2+sAthPztjaGKcGgA1i/7oshnUIsclzMiLoO+APp9 1mrslmb5eoEIQWYcZJZKe9dXuqgO2QyPoAJ51QM38EYnRqBKW4lEAO+ZeCkR4A5MZmXM KGnlfvOnuc0A252zlOePd+vu70i1sp6ZUZwFVWKaIjkoOgeKAuCqKis0Bd3mEu4AAl0e 4c7mF9h9Gdj+MjGHoyVyOrMsM7KkMl4TrLbGo5t1Rpm9Ae5hSaSKOXnnwFCYKAU7TY/8 Jd0Gau/nlqOss6Ryj9itPxQhD/opIsziP/8HsuykzH4D8+s5Q1i6V1IcB7vmNeuqUNdy Kgww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=8VqYL4HLt841J2pIKKRNlpzQR2nrWsFDAdx3KothmNM=; b=dcCS1Qc23ZjEnwAQJ0SMzSBvg8CFknwA7hfGAL5e7OVSofaO+k++2LikcCG0zDmk7Z tmxGL72RtAGiFAq9pgvIfJbYwdjZC3adOIc70eDkdPZ3hK/h+ittBTi1J+SMlGc8hID0 Mp1Wpr7Ns3KKSlsb+ntaA+yfq6Vi9VkPoj4NhbBJY/MRvkJdZeJXRJ8yTI9I9A9XEk+a rfyGExgEVMfSMAvzGWLUeiWnGbqvhE/p+97cxhK4+M3/L6k1u1QBSTL0tKgkELHaAx/x /wmxFlgoLbjgfmo4RUM2vzcfnUPjsWwmxZu52DgjsZKBeyIQpL5sp+lKLvQMuH3mFu/f oKLA== X-Gm-Message-State: AMke39lTgKjDKHIkeJg4GrMBb78V0soNmY9ZzvqKCfYyBWMm+zNnhH0edT6OaCHUxdbAQfnA X-Received: by 10.28.146.207 with SMTP id u198mr6717392wmd.36.1487388369154; Fri, 17 Feb 2017 19:26:09 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id x25sm15292882wrx.27.2017.02.17.19.26.08 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 19:26:08 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> From: Steven Hartland Message-ID: <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> Date: Sat, 18 Feb 2017 03:26:14 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 03:26:12 -0000 Hey Sydney, I've had some feedback from other team members and armed with this info I'm having a crack at enabling receive buffer auto-scaling using RTT estimations when timestamps aren't available. I don't have any S3 buckets to tests with so Is there any chance you pop up your test file again for me? Regards Steve On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: > Hi Steve, > > increasing the buffer size did indeed enhance throughput. > > I am obviously not an expert in this field, but i don't understand why or if the TCP Receive Window Size shouldn't increase automatically. > > I found this thread on the ML and i'm reading myself a bit more into the topic right now. > > https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html > > Thank you for your tip, however.. > > Sydney > >> On 16 Feb 2017, at 16:35, Steven Hartland wrote: >> >> Window scaling and receive buffer scaling is the most likely cause. >> >> Check what the sysctl net.inet.tcp.recvspace is set to, then try increasing it e.g. >> sysctl net.inet.tcp.recvspace=655360 >> >> This jumped the transfer rate with a wget and your test URL from 3MB/s to 30MB/s here. >> >> Regards >> Steve >> >> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>> Hello, >>> >>> I'm seeing continuous slow download speeds from Amazon S3, but only on FreeBSD. Other OSes saturate the connection without problems. >>> >>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in different regions (Ireland, London, Frankfurt, US Standard have been tested) whilst using fetch, curl, et. al. >>> >>> I have tested this on multiple machines, bare metal, bhyve, Xen and VMware VMs, routed setups and direct pppoe links.. all the same. >>> >>> Anyone seeing similar issues? >>> >>> Here's a url to try: >>> >>> http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zerofile.raw >>> >>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with "Share with my Mac"-Interface, the machine is doing completely fine, as in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>> >>> I also switched the FreeBSD Routers with Linux-based ones and with the isp-provided router box, with the same result. >>> >>> I have launched VMs with Digital Ocean to "rule out" my ISP and there seems to be the same issue. Downloading from S3 is multiple times slower than any other connection to services outside of S3 or on any other OS. >>> >>> It seems like other people are seeing the same issue: >>> >>> https://forums.freebsd.org/threads/59756/#post-343064 >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"