From owner-freebsd-current@freebsd.org Sat Jan 2 20:05:52 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2AED54DD98E for ; Sat, 2 Jan 2021 20:05:52 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4D7XvN0PyGz4tHj; Sat, 2 Jan 2021 20:05:51 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from [188.174.60.30] (helo=c720-r368166.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kvn9q-0001Mu-44; Sat, 02 Jan 2021 21:05:50 +0100 Received: from c720-r368166.fritz.box (localhost [127.0.0.1]) by c720-r368166.unixarea.de (8.16.1/8.14.9) with ESMTPS id 102K5n0N015910 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 2 Jan 2021 21:05:49 +0100 (CET) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by c720-r368166.fritz.box (8.16.1/8.14.9/Submit) id 102K5nEi015909; Sat, 2 Jan 2021 21:05:49 +0100 (CET) (envelope-from guru@unixarea.de) X-Authentication-Warning: c720-r368166.fritz.box: guru set sender to guru@unixarea.de using -f Date: Sat, 2 Jan 2021 21:05:49 +0100 From: Matthias Apitz To: Alan Somers Cc: Rick Macklem , FreeBSD CURRENT , Konstantin Belousov , Kirk McKusick Subject: Re: cp(1) of large files is causing 100% CPU utilization and poor transfer Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Alan Somers , Rick Macklem , FreeBSD CURRENT , Konstantin Belousov , Kirk McKusick References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.60.30 X-Rspamd-Queue-Id: 4D7XvN0PyGz4tHj X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 Jan 2021 20:05:52 -0000 El día sábado, enero 02, 2021 a las 11:29:36a. m. -0700, Alan Somers escribió: > > El día sábado, enero 02, 2021 a las 05:06:05p. m. +0000, Rick Macklem > > escribió: > > > > > Just fyi, I've reproduced the problem. > > > All I did was create a 20Gbyte file > > > on UFS on a slow (4Gbyte or RAM, > > > slow spinning disk) laptop. > > > (The UFS file system is just what the installer creates these days.) > > > > > > cp still hasn't finished and is definitely > > > taking a looott longer than dd did. > > > > > > I'll start drilling down later to-day. > > > > > > I'll admit doing lots of testing of copy_file_range(2) > > > with large sparse files, but I may have missed testing > > > a large non-sparse file. > > > > > > rick > > > ps: I've added Kostik and Kirk to the cc. > > > > As the problem seems to be clear now, should I still file a PR? > > I'm happy to do so. > > > > Yes please . That will help ensure that we don't lose track of it. Here we go: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252358 Thanks matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub ¡Con Cuba no te metas! «» Don't mess with Cuba! «» Leg Dich nicht mit Kuba an! http://www.cubadebate.cu/noticias/2020/12/25/en-video-con-cuba-no-te-metas/