From nobody Sun Sep 3 12:02:53 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdr4r6vJVz4s1cZ for ; Sun, 3 Sep 2023 12:03:08 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-yb1-xb2d.google.com (mail-yb1-xb2d.google.com [IPv6:2607:f8b0:4864:20::b2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdr4r5JyLz3KFJ for ; Sun, 3 Sep 2023 12:03:08 +0000 (UTC) (envelope-from tomek@cedro.info) Authentication-Results: mx1.freebsd.org; none Received: by mail-yb1-xb2d.google.com with SMTP id 3f1490d57ef6-d7ecdb99b7aso482066276.3 for ; Sun, 03 Sep 2023 05:03:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; t=1693742587; x=1694347387; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=NcrzoYxtqoAfvc9EjknvGSDQWuXjBLddeeUdCsJ5ssM=; b=bBtwWTe0fqEONP0d5Ngr3FcWFmwY1+u5jLSEpjVjcbyxWEEZvDpBpnOVBQoeOZCwC3 6bpRsnriA02EDhK1Xwk8s/rDZsua3UNOn4vPtBaXwo5AKwxDAb9Gf3tr4eVxH2k4cnA9 RTnwVTdGXb2M7SceFB0UuSfpWz+5yqR9dQuC2jbmkQsQ2ZxvvpzJy/5sogWlkWTBYaDB h2fgAVAE3HGtPBpY4z03FmqOj0NtBOPiZH9yqNP/6qh5j5I1pfsPEKApGUsRgV7d8A97 WkEADCB0pOuMOtQjR9rmPChj5RJOPcgSLG8VjYbhq4T/A+Mni9vLodoch20QLC/SPtVR AHFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693742587; x=1694347387; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=NcrzoYxtqoAfvc9EjknvGSDQWuXjBLddeeUdCsJ5ssM=; b=QRwpQv8IaapqSQPfCs89T6hZxDLuxmdRylbogbBhahwh5XmM//3Hp8yqTb+RALeAaE 9ovxgwoLMBqfxWCHE8WtjmEfcnH9C7Q6shpxLPgCrHNbGB6Q/h84fDqmwc3QmuT9Q3x6 D0ePcVO5BcRs7qoI4cBzy5MySUZicnsTPrJoxMGjzlvwACjqu+9FslspSN/gXkzCSVZY pL2TbItEjwAXhfnvgbrZilAtaOn7XqxQCOQMDZRm1OTFj9ZbwyuTMUoxKebuEAy00N7o CUgGfDpTDHYtTCnSFhXSqrpNq0PHYsOFIAoVbWvacIEcv9h+udzb8I8cmfesYM9O8MKC D2cQ== X-Gm-Message-State: AOJu0Yxd40f3CScEBJk5B8dDZIjEQwBYMyJyLZ/EoQARzVsAl2N1vs/X JmqeSssJI9pHIjqVRG8kI9ouRPNm2oWx8MSq8s8= X-Google-Smtp-Source: AGHT+IFh4qSqApyKFB+SfMJIzBJtFViQu6ssw4G/6zofiFKuQy6uvcwp3NmbE4MYJJ45hltZZCcLzg== X-Received: by 2002:a25:734a:0:b0:d12:25d:fd5f with SMTP id o71-20020a25734a000000b00d12025dfd5fmr7813525ybc.5.1693742587664; Sun, 03 Sep 2023 05:03:07 -0700 (PDT) Received: from mail-yw1-f181.google.com (mail-yw1-f181.google.com. [209.85.128.181]) by smtp.gmail.com with ESMTPSA id j143-20020a252395000000b00d7badcab84esm1847580ybj.9.2023.09.03.05.03.06 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 05:03:07 -0700 (PDT) Received: by mail-yw1-f181.google.com with SMTP id 00721157ae682-59254e181a2so5101157b3.1 for ; Sun, 03 Sep 2023 05:03:06 -0700 (PDT) X-Received: by 2002:a25:688c:0:b0:d7a:c4dc:e7b3 with SMTP id d134-20020a25688c000000b00d7ac4dce7b3mr7157340ybc.61.1693742586609; Sun, 03 Sep 2023 05:03:06 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: <6952b7fd-f90f-2677-1997-d0c708cb559e@yahoo.com> <455dc69a-dd15-18d9-8e93-91bbff3997e4@madpilot.net> In-Reply-To: From: Tomek CEDRO Date: Sun, 3 Sep 2023 14:02:53 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Very slow scp performance comparing to Linux To: Wojciech Puchar Cc: Wei Hu , Guido Falsi , Mikhail Zakharov , FreeBSD Hackers Content-Type: multipart/alternative; boundary="00000000000037451e0604732df5" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rdr4r5JyLz3KFJ --00000000000037451e0604732df5 Content-Type: text/plain; charset="UTF-8" On Sat, Sep 2, 2023, 22:12 Wojciech Puchar wrote: > linux filesystem caching is just stupid, optimized to show up good in > benchmarks. > > It just accepts writes as long as there is available memory, without > writing anything to disk, then if it cannot do it anymore or some time > passed, schedules huge amount of writes, often stalling whole system. > > This is how it was almost 20 years ago when i was still using linux, seems > like didn't change much. > > Just think how much data loss and inconsistency would occur if there will > be crash or power loss after "writing" 100000 files of 10GB which can > easily be done in short time as linux just doesn't block writing process > at all and fill memory. > > Since i started using FreeBSD UFS, many machines, lighter of heavier > workload, always mixed workload, i never ever have more that a few files > loss on power outage. > Exactly! I was recently surprised when my friend using Linux copied around 4GB file to my pendrive, it showed over 200MB/s and was rapid fast but then we had to wait for background operation to complete for over an hour with absolutely no information on progress/completion. This is why I prefer FreeBSD :-) -- CeDeROM, SQ7MHZ, http://www.tomek.cedro.info > --00000000000037451e0604732df5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Sat, Sep = 2, 2023, 22:12 Wojciech Puchar=C2=A0 wrote:
linux filesystem caching is just stupid, optimized to show up good in
benchmarks.

It just accepts writes as long as there is available memory, without
writing anything to disk, then if it cannot do it anymore or some time
passed, schedules huge amount of writes, often stalling whole system.

This is how it was almost 20 years ago when i was still using linux, seems =
like didn't change much.

Just think how much data loss and inconsistency would occur if there will <= br> be crash or power loss after "writing" 100000 files of 10GB which= can
easily be done in short time as linux just doesn't block writing proces= s
at all and fill memory.

Since i started using FreeBSD UFS, many machines, lighter of heavier
workload, always mixed workload, i never ever have more that a few files loss on power outage.

Exactly! I was recently surprised when my friend using= Linux copied around 4GB file to my pendrive, it showed over 200MB/s and wa= s rapid fast but then we had to wait for background operation to complete f= or over an hour with absolutely no information on progress/completion. This= is why I prefer FreeBSD :-)

--00000000000037451e0604732df5--