From owner-freebsd-current@freebsd.org Sat Jan 2 16:30:26 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DEA644D5D7C for ; Sat, 2 Jan 2021 16:30:26 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f172.google.com (mail-oi1-f172.google.com [209.85.167.172]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D7S6n6HHjz4bXt for ; Sat, 2 Jan 2021 16:30:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f172.google.com with SMTP id q25so27143880oij.10 for ; Sat, 02 Jan 2021 08:30:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=jnASg1NwfgO9GfApxTvZ2HBmLhhsqOBkSo/9r1W3fqo=; b=B5J74tzSBCtKxTb58cgKZl5DE//WxTtMZSXt2eO2HK0l1SPJKOMHh2BfQ7fL58qHD2 igfr8szsYU/Bm1P8cCnd08Pqs+xOvPVaNgsl2cjgELwQTmtSKpBtMcw02Yxr0hI+xtVH kLRF41E+XcMulyAfzbb9LBrrvsNtHYFlXMZBKLIoTISzIVlGpXC0jg2ggKPFmTmpTCFB n8ln3Lj2R+aq3+VAktdL8gjewP7PtuRWwQlVpviWzpqvVDr6bLwFT0GT8hChiqRnkxlW D4qrnEfTyTDowY57rABK4bbbwFp/J3LVU4V9mHFRjKZmbA8j9z9diOr7aRx+JUUu/8ub xdXg== X-Gm-Message-State: AOAM531NEqvwyaAPyW9NA9IXFX+ZYKKTBDdWeJa3KEf7t5/P4hGEq371 7W0BarCTdbZx3BF8DeUZ03u4ou4852C/qXOHhMI= X-Google-Smtp-Source: ABdhPJziS9I4LRROjiYSqXFWmvqrXgQDZL1LYOpneZkempVMbsHATG9ZukgUcDieDD4ygaIdVfFkMvondC7ybB+M2zw= X-Received: by 2002:aca:af8f:: with SMTP id y137mr13781680oie.55.1609605024857; Sat, 02 Jan 2021 08:30:24 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sat, 2 Jan 2021 09:30:13 -0700 Message-ID: Subject: Re: cp(1) of large files is causing 100% CPU utilization and poor transfer To: Matthias Apitz , FreeBSD CURRENT X-Rspamd-Queue-Id: 4D7S6n6HHjz4bXt X-Spamd-Bar: / X-Spamd-Result: default: False [-0.99 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; HAS_ATTACHMENT(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.09)[-0.090]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:+]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.167.172:from]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/mixed,multipart/alternative,text/plain,text/x-dsrc]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.167.172:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.172:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.172:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 Jan 2021 16:30:26 -0000 On Sat, Jan 2, 2021 at 9:12 AM Matthias Apitz wrote: > El d=C3=ADa s=C3=A1bado, enero 02, 2021 a las 09:06:24a. m. -0700, Alan S= omers > escribi=C3=B3: > > > > As I said, it can be reproduced using only the local file system. Thi= s > > > was setup recently on a SSD: > > > > > > # dmesg | grep ada0 > > > ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 > > > ada0: ACS-2 ATA SATA 3.x device > > > ada0: Serial Number F995890846 > > > ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 1024bytes) > > > ada0: Command Queueing enabled > > > ada0: 488386MB (1000215216 512 byte sectors) > > > > > > and by this procedure: > > > > > > # gpart create -s gpt ada0 > > > # gpart add -t freebsd-boot -s 512k -a4k -l ssdboot ada0 > > > # gpart bootcode -b /boot/pmbr -p /boot/gptboot -i1 ada0 > > > # gpart add -t freebsd-ufs -l ssdrootfs -b 1m -s 2g ada0 > > > # gpart add -t freebsd-ufs -l ssdvarfs -a 1m -s 2g ada0 > > > # gpart add -t freebsd-ufs -l ssdusrfs -a 1m ada0 > > > # newfs -U -t /dev/gpt/ssdrootfs > > > # newfs -U -t /dev/gpt/ssdvarfs > > > # newfs -U -t /dev/gpt/ssdusrfs > > > > > > # gpart show -l ada0 > > > =3D> 40 1000215136 ada0 GPT (477G) > > > 40 1024 1 ssdboot (512K) > > > 1064 984 - free - (492K) > > > 2048 4194304 2 ssdrootfs (2.0G) > > > 4196352 4194304 3 ssdvarfs (2.0G) > > > 8390656 16777216 4 ssdswap (8.0G) > > > 25167872 975046656 5 ssdusrfs (465G) > > > 1000214528 648 - free - (324K) > > > > > > # mount -t ufs > > > /dev/gpt/ssdrootfs on / (ufs, local, soft-updates) > > > /dev/gpt/ssdvarfs on /var (ufs, local, soft-updates) > > > /dev/gpt/ssdusrfs on /usr (ufs, local, soft-updates) > > > > > > When I run in the /usr fs the command > > > > > > # cp -p guru-20210102.tar.gz xxx > > > > > > it copies around 168M per minute. > > > > > > Is that copying from /usr to /usr, or from /usr to /var or /? > > # cd /home/backups > # cp -p guru-20210102.tar.gz xxx > > i.e. from /usr to /usr. > > matthias > Ok, let's narrow this down. Could you please run the command with the attached D script ? sudo dtrace -s copy_file_range.d -c "cp -p guru-20210102.tar.gz xxx"