From owner-freebsd-performance@freebsd.org Sun Feb 14 01:31:34 2021 Return-Path: Delivered-To: freebsd-performance@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DC4C5543A09 for ; Sun, 14 Feb 2021 01:31:34 +0000 (UTC) (envelope-from raj@gusw.net) Received: from gateway31.websitewelcome.com (gateway31.websitewelcome.com [192.185.144.219]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DdV7n6czFz3rHr for ; Sun, 14 Feb 2021 01:31:33 +0000 (UTC) (envelope-from raj@gusw.net) Received: from cm16.websitewelcome.com (cm16.websitewelcome.com [100.42.49.19]) by gateway31.websitewelcome.com (Postfix) with ESMTP id 9EA513FEE1 for ; Sat, 13 Feb 2021 19:31:32 -0600 (CST) Received: from host2097.hostmonster.com ([67.20.114.243]) by cmsmtp with SMTP id B6G4lOqlnHPnUB6G4lt06R; Sat, 13 Feb 2021 19:31:32 -0600 X-Authority-Reason: nr=8 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=schadow.us; s=default; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version :Date:Message-ID:From:References:To:Subject:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=fGIno0NSInjyQeP30WRVfzKkW/ouNvCqwr9JgSS45g0=; b=WuAM5jcSY3tPTRxzRoWYIRsgSE jatHvpsnl8RTbZZwvyGA5zll8eBE3xm+JdROy7MVNnMr5rwOVdydKv4YvIFjeMtGWOYQAtvarO6MI 7GgEgbpZHTZ3LFCZ1yEIPok18; Received: from [177.143.140.27] (port=51034 helo=[10.0.4.7]) by host2097.hostmonster.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1lB6G3-002YMp-VO for freebsd-performance@freebsd.org; Sat, 13 Feb 2021 18:31:32 -0700 Subject: Re: FreeBSD on Amazon AWS EC2 long standing performance problems To: freebsd-performance@freebsd.org References: <5BC0DEF9-3D58-4FFC-9E20-311B0520A25A@longcount.org> <96d43dbe-ed50-8ba4-f676-673ee99725bd@gusw.net> From: Gunther Schadow Message-ID: <5023785c-18cd-0348-a545-44e727c7cdc2@gusw.net> Date: Sat, 13 Feb 2021 20:31:29 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host2097.hostmonster.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - gusw.net X-BWhitelist: no X-Source-IP: 177.143.140.27 X-Source-L: No X-Exim-ID: 1lB6G3-002YMp-VO X-Source: X-Source-Args: X-Source-Dir: X-Source-Sender: ([10.0.4.7]) [177.143.140.27]:51034 X-Source-Auth: ebiz+schadow.us X-Email-Count: 1 X-Source-Cap: cHJhZ21hdDE7cHJhZ21hdDE7aG9zdDIwOTcuaG9zdG1vbnN0ZXIuY29t X-Local-Domain: yes X-Rspamd-Queue-Id: 4DdV7n6czFz3rHr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=schadow.us header.s=default header.b=WuAM5jcS; dmarc=none; spf=softfail (mx1.freebsd.org: 192.185.144.219 is neither permitted nor denied by domain of raj@gusw.net) smtp.mailfrom=raj@gusw.net X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_X_SOURCE(0.00)[]; TO_DN_NONE(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[schadow.us:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; HAS_X_ANTIABUSE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[192.185.144.219:from]; ASN(0.00)[asn:46606, ipnet:192.185.128.0/18, country:US]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[schadow.us:s=default]; FREEFALL_USER(0.00)[raj]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-performance@freebsd.org]; DMARC_NA(0.00)[gusw.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[192.185.144.219:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[192.185.144.219:from]; MAILMAN_DEST(0.00)[freebsd-performance] X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Feb 2021 01:31:34 -0000 On 2/10/2021 11:47 AM, Sean Chittenden wrote: > Expect to see something about this on this year's Community Survey and the > Core Team will do something with this information. > > Cloud has been an increasingly important workload for FreeBSD users. Thank you Sean, I think it would really be good to have this kind of Wiki or point of visible discussion of FreeBSD on AWS. Because there isn't just bad news, there is also good news. I have a very expensive reporting job on my PostgreSQL database. And I have 3 servers now. An older Amz Linux setup which I did a few years ago, another even earlier. I thought my earlier Amz Linux server was a lot faster than FreeBSD that I set up now. But then in my desperation I set up a new Amz Linux where I even got ZFS installed. But, lo and behold, when I did the report generation I found that FreeBSD worked it in 12 hours while the new Linux system took 21 hours. So there is now clarity that while perhaps some read and write speeds may look better on Linux, in something as complex as my database the result can be better on FreeBSD. There may still be ways to improve the Linux setup, perhaps even more than the FreeBSD, but I don't see anything obvious. The good news is that I can now go forth with my FreeBSD solution which is so much nicer to manage. PS: there are still tremendous slowness. Especially using the AWS CLI Python setup is unbearably and ridiculously slow, so sow in fact that I have rather worked in learning how to sign my own requests and issue those AWS CLI operations with my Java workaround. regards, -Gunther