From owner-freebsd-stable@freebsd.org Sun Mar 14 00:36:15 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2049F56A330 for ; Sun, 14 Mar 2021 00:36:15 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dygb30DrLz3vMH for ; Sun, 14 Mar 2021 00:36:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x829.google.com with SMTP id r14so6770897qtt.7 for ; Sat, 13 Mar 2021 16:36:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=bLee2USem4DuvKSLz7weeEyPI/tpawgezk4BrJxDMfA=; b=Dai8LDnp4uVnxKnbALjhXW6Dkg05g1fwY8I5UgeEiOiXarmxfHMYHaBykNwAfUDl9r kijrg+Y0a8TOukHaIj8lOxG349/4qOSk9FvUty9JlK/edK0js8wmkyAlJYsQLQbqhAct 49xDl5HP7+MYRxrYWfbOM4lH+MeDSx3wv3KmbvEsBj1eKZFMnJ2xX8TuP+ZSHS8TSvYt z/kF627fsWO/qio+YBcjP7CTD9dn1rcHI7waHgIdRWnkZU3PMwzeYmuftndKMZJSUbTH 3xPu4kKmH75b1sjgqjBmL8/IkIwSKLl/r3NxgRt4WXpK3sLx3Z8DQdeUdeyQVBpbT/wb jbHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bLee2USem4DuvKSLz7weeEyPI/tpawgezk4BrJxDMfA=; b=i6NWciHo5np8OMczsPlTMZu5VmG0vjUNmhk9OKbdEy+SySb9bQGY+c6vCfAwdiYJK/ f8DhzxQOG4YKGj/ptD8FHmm1bDUWZWDY39k7KCaPRNA2mcGAUzPBdT9plm2WpraWm4a5 JfneoyeG7B395TPchjHb7XPXrBKJBQR96DgqV9YGK0Oh5Oykd+RkaIXmW2SzcNznYEzQ FgIqotsZ3cgbWR/29g3nKXNdd9PSq1x7duE5ZEaHdqL8BjsJ7DFslcDGJonTok7pPssT 862uyTXsyp4Znjyvbjcrsst1yIuUilDqEGbdZ0QG8n72sRSvfigRQMYLptmODydE3dHJ Sh7A== X-Gm-Message-State: AOAM533XjUb9ozFDxdcs8Lkr0q9kVpOs/bqOtkiKWk7PcmKrF4LE0mDX RlftIuCfVTBdyU6eJuDP+abKhcNJI9g3kdgewW1cWA== X-Google-Smtp-Source: ABdhPJywPR1sHlV6kaseD2vMxyMzkSsemaNOqkAb8AMflzEZuyQj4iLaIv9EsJU8mbSQ+tv3iVNLx9bGJolfcU9XaKU= X-Received: by 2002:ac8:6787:: with SMTP id b7mr741203qtp.244.1615682174120; Sat, 13 Mar 2021 16:36:14 -0800 (PST) MIME-Version: 1.0 References: <12705C29-53EA-4484-8291-C409AF4B3DE5.ref@yahoo.com> <12705C29-53EA-4484-8291-C409AF4B3DE5@yahoo.com> In-Reply-To: From: Warner Losh Date: Sat, 13 Mar 2021 17:36:03 -0700 Message-ID: Subject: Re: Filesystem operations slower in 13.0 than 12.2 To: Kevin Oberman Cc: Mark Millard , Konstantin Belousov , FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4Dygb30DrLz3vMH X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2021 00:36:15 -0000 On Sat, Mar 13, 2021 at 5:33 PM Kevin Oberman wrote: > Just spent a little time looking at my issue and have a few more notes: > What version did you evaluate? There's a number of changes lately that could have a big impact on this... Warner > Seems to only occur on large r/w operations from/to the same disk. "sp > big-file /other/file/on/same/disk" or tar/untar operations on large files. > Hit this today updating firefox. > > I/O starts at >40MB/s. Dropped to about 1.5MB/s. If I tried doing other > things while it was running slowly, the disk would appear to lock up. E.g. > pwd(1) seemed to completely lock up the system, but I could still ping it > and, after about 30 seconds, things came back to life. It was also not > instantaneous. Disc activity dropped to <1MB/s for a few seconds before > everything froze. > > During the untar of firefox, I saw; this several times. I also looked at my > console where I found these errors during : > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 55043, size: 8192 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 51572, size: 4096 > > I should note that some operations continue just fine while this is going > on until I do something that freezes the system. I assume that this > eliminates the disk drive and low-level driver. Is vfs a possible issue. It > had some serious work in the past few months by markj. That does not > explain why more people are not seeing this. > > I have been seeing this since at least September 2020, so it goes back a > way. As this CometLake system will not run graphics on 12, I can't confirm > operation before 13. > -- > Kevin Oberman, Part time kid herder and retired Network Engineer > E-mail: rkoberman@gmail.com > PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 > > > On Fri, Mar 5, 2021 at 10:47 PM Mark Millard via freebsd-stable < > freebsd-stable@freebsd.org> wrote: > > > > > Konstantin Belousov kostikbel at gmail.com wrote on > > Fri Mar 5 23:12:13 UTC 2021 : > > > > > On Sat, Mar 06, 2021 at 12:27:55AM +0200, Christos Chatzaras wrote: > > . . . > > > > Command: /usr/bin/time -l portsnap extract (these tests done with 2 > > different idle servers but with same 4TB HDDs models) > > > > > > > > FreeBSD 12.2p4 > > > > > > > > 99.45 real 34.90 user 59.63 sys > > > > 100.00 real 34.91 user 59.97 sys > > > > 82.95 real 35.98 user 60.68 sys > > > > > > > > FreeBSD 13.0-RC1 > > > > > > > > 217.43 real 75.67 user 110.97 sys > > > > 125.50 real 63.00 user 96.47 sys > > > > 118.93 real 62.91 user 96.28 sys > > > . . . > > > In the portsnap results for 13RC1, the variance is too high to conclude > > > anything, I think. > > > > I'll note that there are other reports of wide variance > > in transfer rates observed during an overall operation > > such as "make extract". The one I'm thinking of is: > > > > > https://lists.freebsd.org/pipermail/freebsd-stable/2021-March/093251.html > > > > which is an update to earlier reports, but based on more recent > > stable/13. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253968 > > comment 4 has some more notes about the context. The "make extract" > > for firefox likely is not as complicated as the portsnap extract > > example's execution structure. > > > > Might be something to keep an eye on if there are on-going > > examples of over time. > > > > === > > Mark Millard > > marklmi at yahoo.com > > ( dsl-only.net went > > away in early 2018-Mar) > > > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org > " > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >