From nobody Fri Nov 12 19:59:30 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BE7C7185D8FA for ; Fri, 12 Nov 2021 19:59:35 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from relay.wiredblade.com (relay.wiredblade.com [168.235.95.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HrTvC3wfKz3sRM for ; Fri, 12 Nov 2021 19:59:35 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from mail.distal.com (pool-108-48-165-176.washdc.fios.verizon.net [108.48.165.176]) by relay.wiredblade.com with ESMTPSA (version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256) ; Fri, 12 Nov 2021 19:59:34 +0000 Received: from smtpclient.apple ( [2001:420:c0c4:1004::33c]) by tristain.distal.com (OpenSMTPD) with ESMTPSA id 6c544083 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 12 Nov 2021 14:59:32 -0500 (EST) From: Chris Ross Message-Id: <953DD67A-1A37-4D03-B878-E65396641B7D@distal.com> Content-Type: multipart/alternative; boundary="Apple-Mail=_8E68A48E-A757-49F9-978D-9D0329E5539A" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.20.0.1.32\)) Subject: Re: swap_pager: cannot allocate bio Date: Fri, 12 Nov 2021 14:59:30 -0500 In-Reply-To: Cc: Ronald Klop , freebsd-fs To: Warner Losh References: <9FE99EEF-37C5-43D1-AC9D-17F3EDA19606@distal.com> <09989390-FED9-45A6-A866-4605D3766DFE@distal.com> <4E5511DF-B163-4928-9CC3-22755683999E@distal.com> <42006135.15.1636709757975@mailrelay> <7B41B7D7-0C74-4F87-A49C-A666DB970CC3@distal.com> <4008C512-31F1-4BE3-B674-A270CF674757@distal.com> X-Mailer: Apple Mail (2.3693.20.0.1.32) X-Rspamd-Queue-Id: 4HrTvC3wfKz3sRM X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[freebsd] X-ThisMailContainsUnwantedMimeParts: Y --Apple-Mail=_8E68A48E-A757-49F9-978D-9D0329E5539A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Nov 12, 2021, at 14:52, Warner Losh wrote: > My swap is on a partition on the non-ZFS disk. A physical disk as far = as the kernel knows, hardware RAID1. >=20 > # pstat -s > Device 1K-blocks Used Avail Capacity > /dev/da0p3 445682648 1018524 444664124 0% >=20 > OK. That's well supported and should work w/o some of the issues that = I raised. I'd misunderstood and thought you were swapping to zvols... > =20 > Let me know if what you=E2=80=99re saying above is true to my case, = and any advice as to how I can avoid it. I had a =E2=80=9Cnot enough = swap space=E2=80=9D a while back, and accordingly increased the size of = my swap partition. I have 128GB of memory, though between the ARC and = the big process I was running, that fills it easily. >=20 > Yea, this is a 'memory is exhausted' problem, and more swap won't help = that. It's unclear why we run out so fast, and why the separate zones = for the bio isn't providing a good level of insulation from out of = memory scenarios. Okay. Well, I can=E2=80=99t easily add more memory to this machine, = though I am investigating it. I certainly can=E2=80=99t do it in short = order. I presume the problem is that I recently increased the size of = this pool by adding a large raidz vdev to it. I=E2=80=99ve only been = seeing this since. Is there any way I can =E2=80=9Climit=E2=80=9D the = perceived size of the ZFS filesystem to ease the problem? Is there = anything I can tune to help? Can I turn off or drastically reduce the = ARC? A decrease in performance would be better than getting stuck after = a day or so. :-) - Chris --Apple-Mail=_8E68A48E-A757-49F9-978D-9D0329E5539A--