From owner-freebsd-hackers@freebsd.org Wed Feb 20 11:01:00 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E0CBE14EF6DD for ; Wed, 20 Feb 2019 11:00:59 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5D17272439; Wed, 20 Feb 2019 11:00:59 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [IPv6:2001:8b0:151:1:c4ea:bd49:619b:6cb3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: matthew/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id E3DAF1FA01; Wed, 20 Feb 2019 11:00:58 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from leaf.local (unknown [88.212.184.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: m.seaman@infracaninophile.co.uk) by smtp.infracaninophile.co.uk (Postfix) with ESMTPSA id 6291B186F; Wed, 20 Feb 2019 11:00:56 +0000 (UTC) Authentication-Results: smtp.infracaninophile.co.uk/6291B186F; dkim=none; dkim-atps=neutral To: freebsd-hackers@freebsd.org Cc: cperciva@freebsd.org From: Matthew Seaman Subject: Amazon AMIs Message-ID: Date: Wed, 20 Feb 2019 11:00:44 +0000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 5D17272439 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.94 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.94)[-0.942,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Feb 2019 11:01:00 -0000 Hi, I've been playing with setting up a very simple website on AWS to do speedtesting for the ISP I work for[*]. Naturally I used the FreeBSD 12.0 AMIs. The result with the default m4.large instance was actually pretty dissapointing: speedtest:~:% iperf3 -p 443 -P 3 -c test1.lightspeed.gigaclear.com Connecting to host test1.lightspeed.gigaclear.com, port 443 [ 4] local 46.227.144.15 port 38926 connected to 3.8.245.243 port 443 [ 6] local 46.227.144.15 port 38928 connected to 3.8.245.243 port 443 [ 8] local 46.227.144.15 port 38930 connected to 3.8.245.243 port 443 [...] - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 177 MBytes 148 Mbits/sec 123 sender [ 4] 0.00-10.00 sec 176 MBytes 147 Mbits/sec receiver [ 6] 0.00-10.00 sec 281 MBytes 236 Mbits/sec 155 sender [ 6] 0.00-10.00 sec 280 MBytes 235 Mbits/sec receiver [ 8] 0.00-10.00 sec 206 MBytes 173 Mbits/sec 118 sender [ 8] 0.00-10.00 sec 205 MBytes 172 Mbits/sec receiver [SUM] 0.00-10.00 sec 664 MBytes 557 Mbits/sec 396 sender [SUM] 0.00-10.00 sec 661 MBytes 554 Mbits/sec receiver Couldn't even saturate a 1G link. So I tried one of the newer m5.large instance instead. As well as being rather newer and better integrated with FreeBSD (m5 has if_ena interfaces, nvd disk devices rather than m4 which has ixv and xbd disguised as ada for the root device but not for additional drives), they're actually slightly cheaper for the same nominal CPU count, RAM and disk: speedtest:~:% iperf3 -p 443 -P 3 -c test0.lightspeed.gigaclear.com Connecting to host test0.lightspeed.gigaclear.com, port 443 [ 4] local 46.227.144.15 port 54264 connected to 18.130.169.5 port 443 [ 6] local 46.227.144.15 port 54266 connected to 18.130.169.5 port 443 [ 8] local 46.227.144.15 port 54268 connected to 18.130.169.5 port 443 [...] - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 1.90 GBytes 1.63 Gbits/sec 2484 sender [ 4] 0.00-10.00 sec 1.89 GBytes 1.63 Gbits/sec receiver [ 6] 0.00-10.00 sec 1.87 GBytes 1.60 Gbits/sec 3381 sender [ 6] 0.00-10.00 sec 1.86 GBytes 1.60 Gbits/sec receiver [ 8] 0.00-10.00 sec 1.90 GBytes 1.64 Gbits/sec 3607 sender [ 8] 0.00-10.00 sec 1.90 GBytes 1.63 Gbits/sec receiver [SUM] 0.00-10.00 sec 5.67 GBytes 4.87 Gbits/sec 9472 sender [SUM] 0.00-10.00 sec 5.65 GBytes 4.86 Gbits/sec receiver So, about 2Gb/s with an out-of-the-box configuration and no tuning. Question: Why is m4.large the recommended instance type? Surely we'd be better served and present users with a better experience by recommending an m5 instance as one of the more modern and higher performance types? Cheers, Matthew [*] It's an OfCom requirement here in the UK. If what we sell is described as a 940Mb/s pure fibre connection, then by golly it should be capable of pulling down 940Mb/s even at peak usage times of day[+]. So we need to measure this regularly, which means we need to roll out a bunch of small devices to sit in customer premises and run automated tests downloading large blobs of random data from a website "not on our own network." [+] We can't count packet headers as part of the delivered bandwidth, or this would just be a 1Gb/s service.