From owner-freebsd-performance@freebsd.org Fri Feb 5 23:00:14 2021 Return-Path: Delivered-To: freebsd-performance@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1D6C652C9A7 for ; Fri, 5 Feb 2021 23:00:14 +0000 (UTC) (envelope-from jguojun@gmail.com) Received: from mail-ot1-x32e.google.com (mail-ot1-x32e.google.com [IPv6:2607:f8b0:4864:20::32e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DXW8s2yHWz4fvd for ; Fri, 5 Feb 2021 23:00:13 +0000 (UTC) (envelope-from jguojun@gmail.com) Received: by mail-ot1-x32e.google.com with SMTP id v1so8462219ott.10 for ; Fri, 05 Feb 2021 15:00:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=uas030oI5eW4w3MeXn6n/gFjH+WN/Lg9K8jI2p/bgbk=; b=YemOL0+OVfCB1Mqk5AVn9S/Oj23/6nAtVmyNaMAwd2/oycTikaLoP0BUL/vKrFAzjz KDnayMBNd+EAw84EhtYuzOyM0pAuNDAUPRqcOoBI53KIPxW8svLdlT8g3iBOy4QiMDky OKv4p/+QHShovHGVvQ/qrYrpZqDuXqMg/32+vNb7nrbmKJPqgcZnR9srlzyBcmC7kPm1 T3Ef0HlsSwTVd8XOLcsODDYaCTeQmWoQ+RM7IDYnh9nBFCU2oTImO6n7PbtTIOKrnK6g 6COYNCqXY2fDUsoII1nmJ3S0w1houLgJK8LsoFsONGBQ4735M8kAFYvf5aIHioxOy2Pv HXKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=uas030oI5eW4w3MeXn6n/gFjH+WN/Lg9K8jI2p/bgbk=; b=FDPao0QSJrQ+BVCgbrdX28ld9XHTH6YrCHMknx8GYalOSfId7f6yedyb0J+pG3l11C N1kb2UDw3nQzCXjKVrxRsWtEpsf9IC5N0pzAiF5QdMMhb1kQW92K1M+pLe7S7X2qg7bp 7aEUY2na6RZVuFSGmFGvtlMgJHAhBaTbBRXa9flVwVg9JwFVXRhX7m/QhkBN/C8ve3JV 4qn0zjKd5hg4wpUUr5fgblGB1pNxCsF+FP6zVmYJa/JDbGdzl6AP4UHyu6cR1dBXjwCE Xkj7fvgyYoGuDpiVSJhuJixare86AnGJ0iLCtwXDNldNm6USwCbo+vjMKZEIwOdlNqYZ QQHw== X-Gm-Message-State: AOAM531ulAf9IOOmomvkP32EFhb5xSfjgnbTLp+YQ7qwnhPzu18dBReT Kx68JkLUVNhY477tu2TT8ss9QeYbOfPA X-Google-Smtp-Source: ABdhPJx1HsfIqPJphPz9dS7QfI0Ot3CE7+15RVmyBnEk92OL9vs99gus87ssYCTXRU+d8q7iJZjmkA== X-Received: by 2002:a9d:2da2:: with SMTP id g31mr5023042otb.222.1612566011456; Fri, 05 Feb 2021 15:00:11 -0800 (PST) Received: from ?IPv6:2600:1702:2771:1060:e23f:49ff:fe45:91e6? ([2600:1702:2771:1060:e23f:49ff:fe45:91e6]) by smtp.gmail.com with ESMTPSA id m15sm2057273otl.11.2021.02.05.15.00.10 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 05 Feb 2021 15:00:10 -0800 (PST) Subject: Re: FreeBSD on Amazon AWS EC2 long standing performance problems To: freebsd-performance@freebsd.org References: <98fc52d4-caf1-8d48-5cb2-94643a490d4f@gusw.net> <3fde2934-1e18-5ea4-84d6-21200eaf4b20@gusw.net> From: "Jin Guojun[VFF]" Message-ID: <4d53a12a-99a5-6bab-a30a-74f680b77edb@gmail.com> Date: Fri, 5 Feb 2021 15:00:04 -0800 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <3fde2934-1e18-5ea4-84d6-21200eaf4b20@gusw.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: 4DXW8s2yHWz4fvd X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=YemOL0+O; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of jguojun@gmail.com designates 2607:f8b0:4864:20::32e as permitted sender) smtp.mailfrom=jguojun@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::32e:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-performance@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::32e:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::32e:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-performance] X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Feb 2021 23:00:14 -0000 On 2021-02-05 12:45, Gunther Schadow wrote: > Gordon Bergling wrote: >> Can you verify your feelings by numbers? > > Yes, like I said > >>> Not by a few % points, but by factors if not an order of magnitude! > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253261 > > Do this: > > dd if=/dev/zero of=/dev/nvd2 bs=100M status=progress > > and you see that it's writing with the "whopping" speed of 70 MB/s. > > That used to be good, but it is no longer good. Compare Amazon Linux > doing > the same thing at 300 MB/s. > > Now, when you put a file system over it, zfs or ufs, then instantly the > performance gets better: > > newfs /dev/nvd2 > mount /dev/nvd2 /mnt > dd if=/dev/zero of=/mnt/test bs=100M status=progress > > now that works at about 250 MB/s. Decent. So, problem solved? It is not clear if this compares Apple to Apple. What disk drives and CPUs are on FreeBSD, and what are disk drive(s) and CPU(s) on AWS? Knowing the drive brand and models will tell approximately the disk throughput. Agree, 70MB/s is slow for modern disks, but your information does not provide clue why this could be slow. Can this setup get 250MB/s on FreeBSD 11.4? or 300MB/s with Ubuntu 16.04 on the same hardware? -Jin