From owner-freebsd-stable@freebsd.org Thu Jun 25 03:34:28 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 709A534CE6A for ; Thu, 25 Jun 2020 03:34:28 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x243.google.com (mail-lj1-x243.google.com [IPv6:2a00:1450:4864:20::243]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49slxb70Xbz4T6G; Thu, 25 Jun 2020 03:34:27 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x243.google.com with SMTP id x18so4899848lji.1; Wed, 24 Jun 2020 20:34:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=NzbuGkCZa3S7fj2WOuebOQdlySGfg4gVjwaulxZLc8E=; b=MqwLI4LFbjmN5IDKlWZ3+kb+lLU/9dI8dSBrKPNxCbQFqBhyNPuaPK4AORR5wLeeC1 /Ynv+ZJ7unUUnUy6gmURwEIUNJeeG8JQENSDrIPcjL2qABnLqJIuVGNGlbVnIp86XnJX mdKteoJXKQXyJFppUpj/qavtwH9/HechgAEh5GtS0AXGwVRF6SV/Wa+YyOfTROljXRzL UegUpf9NfUE8jwgeWxqM8fMqAMB2QVuHDzDS6xPjzfc2AhSd/SLqSwfy5yUFgjRJKwJN PLxpy9SWV2UBSKLVh1mgL8tFmIiULtC8v0xEpzlhG7T7DY7Zxh/uIEVyPc6HMVxLCCWs zovg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=NzbuGkCZa3S7fj2WOuebOQdlySGfg4gVjwaulxZLc8E=; b=Edb6hzhsL6vA1z+lW7UkGtbcMgLIfuusjXxr1mgsTYhr8rlaosUig6UryboPxSIMLC EoIyPaz1vWm7CcEzO6sUEf2VvnLdzcLqP1289pbqciIuIuZUBtMqiigGQyPokO9ZDud7 YUvBDJjE8aqNUXsR4fbzzVWxbmHbdw4o3FSbDX0fhzVy7ursYjdYxaQ2k4yjpVWXX/DL mtQ7ZmQ01AMg83rKc10mClR/Mf9oEy7PA05udKQUW0KDM3Wgt5cF/KcP8MlhGYRdFeF/ vI5vIBd6lNZWB7+y5f+xCf21dA+p/9cibXx5k1Tfh+X1XuHX+Ryyju59qHrbjefVBt+s fgfA== X-Gm-Message-State: AOAM533bbxge8AlAWejx3LDfFMhi3MRag8zYL8cPsmBn0wsH5dU34krW gTslVmDzWMILiNqMImIfo+ZzxSjzY7zfMz+zRNZr6RP5 X-Google-Smtp-Source: ABdhPJzPd5k4AzG8LO6BhygLW+FtJ+XOFKTE9THqcvKqwW3tgHmrxn3mBfwFg4S4LWaUsT5+7Tobh0tqlhnSEk/M+A8= X-Received: by 2002:a2e:90c6:: with SMTP id o6mr3273665ljg.330.1593056065777; Wed, 24 Jun 2020 20:34:25 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 20:34:24 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200625025248.GB10210@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> From: Donald Wilde Date: Wed, 24 Jun 2020 20:34:24 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: freebsd-stable Content-Type: multipart/mixed; boundary="000000000000e88f4e05a8e044e5" X-Rspamd-Queue-Id: 49slxb70Xbz4T6G X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 03:34:28 -0000 --000000000000e88f4e05a8e044e5 Content-Type: text/plain; charset="UTF-8" On 6/24/20, Greg 'groggy' Lehey wrote: > On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >> On 6/24/20, Greg 'groggy' Lehey wrote: >>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>>> All, >>>> >>>> I recently upgraded my 12-STABLE system to the latest, and now my >>>> swap subsystems aren't working. I deliberately set up a 40GB >>>> partition for swap, and when I do 'top -t' I am only seeing 7906M >>>> total. >>> >>> That looks suspiciously like the difference from 32 GB. Could it be >>> numeric overflow? And if so, where? What does pstat -s say? >> >> Well, hi Greg! LTNT2! > > Indeed. > >> pstat -shm: >> >> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% > > Now that's really puzzling. Why does it say 64 G when you said 40 G, > and the error from top tends to confirm it? How big is the partition > (gpart output)? Attached 'gpart list' output Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? 'top' now shows 4597M total swap. > >>>> When using synth, it shows swap usage of < 2%, but then it gives the >>>> 'out of swap' complaint and tosses all my users out into neverland. >>> >>> Unless this also causes kernel messages to that effect, this, too, >>> could be an issue with synth. >> >> I believe the messages about 'out of swap' were from the kernel as >> it died, not synth. As I say, it killed all my active users, both >> root and non-root. Okay, I've now got data on that. It crashed again. :-\ First, the kernel killed init-spawned PIDs up into the 12000s: 'out of swap space'. Next, I get the following 5 times, boldface (this is console, not a GUI): swblk zone ok swap blk zone exhausted, increase kern.maxswzone Back to normal font, the kernel killed four cron-job PIDs, 'out of swap space' At this point, if I hit a , I get a login prompt. > > Hmm. > >> Why does _top_ show the 7906M number? I suspect that it's deeper >> than just synth. > > If top counts swap in a form that overflows at 32 GB, 40 GB could show > up as 8 GB. > >> What else can I share to help diagnose this? > > Background, maybe? You say that you upgraded your system. Did you > change the swap size when you did? What were swap and RAM sizes > before and after? Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I configured the -RELEASE install, I manually messed with the MBR disk partitions. This is nominally a half-TB HDD which showed up as a total of 446 G available (IIRC, gpart should show it's actual size). I did auto partitioning, looked at the sizes, and manually set my partitions to give me 40G of swap instead of the auto-generated size of 4G. This is an old Dell i3 laptop. It's really generic, picked specifically as something I could use for Ubuntu or FreeBSD. Dell SERVICE TAG is 5K8W162, but it's a generic i3 with 4G of RAM. I'm developing a multi-server application for my cousin, so I'm using this as a mule to work my way through some of the issues involved in that project, from FreeBSD itself through NGINX and Lua, etc. > > FWIW, I've had a very large number of issues with -STABLE in recent > months, though not this one. I should send a separate message. > I guess I've been fortunate, then. Most of my issues have been with re-learning FreeBSD. :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** --000000000000e88f4e05a8e044e5 Content-Type: text/plain; charset="US-ASCII"; name="gpart_list.txt" Content-Disposition: attachment; filename="gpart_list.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: file0 R2VvbSBuYW1lOiBhZGEwCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYKZndz ZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxNjcKZmlyc3Q6IDYzCmVudHJpZXM6IDQKc2NoZW1lOiBN QlIKUHJvdmlkZXJzOgoxLiBOYW1lOiBhZGEwczEKICAgTWVkaWFzaXplOiA1MDAxMDc4MjkyNDgg KDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9m ZnNldDogMAogICBNb2RlOiByMncyZTMKICAgZWZpbWVkaWE6IEhEKDEsTUJSLDB4OTA5MDkwOTAs MHg0MCwweDNhMzg1ZmYwKQogICBhdHRyaWI6IGFjdGl2ZQogICByYXd0eXBlOiAxNjUKICAgbGVu Z3RoOiA1MDAxMDc4MjkyNDgKICAgb2Zmc2V0OiAzMjc2OAogICB0eXBlOiBmcmVlYnNkCiAgIGlu ZGV4OiAxCiAgIGVuZDogOTc2NzczMTY3CiAgIHN0YXJ0OiA2NApDb25zdW1lcnM6CjEuIE5hbWU6 IGFkYTAKICAgTWVkaWFzaXplOiA1MDAxMDc4NjIwMTYgKDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUx MgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMncyZTUK Ckdlb20gbmFtZTogYWRhMHMxCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYK ZndzZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxMDMKZmlyc3Q6IDAKZW50cmllczogOApzY2hlbWU6 IEJTRApQcm92aWRlcnM6CjEuIE5hbWU6IGFkYTBzMWEKICAgTWVkaWFzaXplOiA0Mjk0OTY3Mjk2 MDAgKDQwMEcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlw ZW9mZnNldDogMAogICBNb2RlOiByMXcxZTEKICAgcmF3dHlwZTogNwogICBsZW5ndGg6IDQyOTQ5 NjcyOTYwMAogICBvZmZzZXQ6IDAKICAgdHlwZTogZnJlZWJzZC11ZnMKICAgaW5kZXg6IDEKICAg ZW5kOiA4Mzg4NjA3OTkKICAgc3RhcnQ6IDAKMi4gTmFtZTogYWRhMHMxYgogICBNZWRpYXNpemU6 IDcwNjExMDk5NjQ4ICg2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2 CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMXcxZTAKICAgcmF3dHlwZTogMQogICBsZW5n dGg6IDcwNjExMDk5NjQ4CiAgIG9mZnNldDogNDI5NDk2NzI5NjAwCiAgIHR5cGU6IGZyZWVic2Qt c3dhcAogICBpbmRleDogMgogICBlbmQ6IDk3Njc3MzEwMwogICBzdGFydDogODM4ODYwODAwCkNv bnN1bWVyczoKMS4gTmFtZTogYWRhMHMxCiAgIE1lZGlhc2l6ZTogNTAwMTA3ODI5MjQ4ICg0NjZH KQogICBTZWN0b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJpcGVvZmZzZXQ6 IDAKICAgTW9kZTogcjJ3MmUzCgo= --000000000000e88f4e05a8e044e5--