From owner-freebsd-current@freebsd.org Mon Jun 29 07:03:45 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5ED88340BAF for ; Mon, 29 Jun 2020 07:03:45 +0000 (UTC) (envelope-from ohartmann@walstatt.org) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49wJPD1dKYz4R98 for ; Mon, 29 Jun 2020 07:03:43 +0000 (UTC) (envelope-from ohartmann@walstatt.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1593414220; bh=03e4su8TvRN1gyH3pwp5Dtk/0KeqsoXsOJCoOgASrLA=; h=X-UI-Sender-Class:Date:From:To:Subject; b=NancXb1Ax9ipA7RNi50psQR/PG67zsPN+8Mr7lvSwYA9iiP8gOXCd9vG8fOd3n+Fr PhIU8BTurmvwcYmcxeRtX6tJDPp+dKVIcUfaCG9muZk1tyY/Jq4epEo0w7few6qldF 6XQ+SJTNRikV3TGJf4iuKL5GPIPDVFAklLQ0FPV4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from freyja ([79.192.169.141]) by mail.gmx.com (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MvbBk-1j0acM1Eu6-00scv2 for ; Mon, 29 Jun 2020 09:03:40 +0200 Date: Mon, 29 Jun 2020 09:03:32 +0200 From: "O. Hartmann" To: freebsd-current Subject: CURRENT: swap issues and dying jails Message-ID: <20200629090326.63b4830b@freyja> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:+8g8uGeMKO0xPEhE0VmdWT9PFn2VOXPlYReeIyBSmwmLSbBgK4c hETGWYkwK4e28Y4vyU0DfumN6Jditmb5/FllnXaEm8nmCJg0HEmJX38AfAiI2xS4bme/7dO lflpsODnSLrmwLTAdh/oHrv1pyko1DwbCdPWyZU1D+MeT/KydIfUXoEBD7NQxD3KIIe/o23 diP+2iDo7I9ueULJMzcYQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:HSuKk58AT/g=:UalXEt7nCPCFVpTfIE+YcQ kDfzG77UIYBqTgt47wBp53adyeq61xDTjQQvmwxeneUaKfF547FZhmXPet47jLhnmJwCU41Bm DlAlsQCCI6ympGoen6wRvGs2qwyrCPbGPOHDH4s+KNnu/t0nwyJXBNO9QL3eBLGYund1JPs9u iKuTxfVQbs3Unva91Pvxror7Hy44TL1/tVN/86Q/4Tky0AG+cP+hBSTtyI/bqvKb2FXdmbhU4 SYdnpz1QPf0wJX+ZOeq/qkXWURVazokDeQ2VvOZFfjeKRzJzXwD9hr6BKrpJbZf9MX4dmRpyC HlJ05TgSMO/1VVva+TzEYYPiI0f0p/GlZrM8JcSMuvMqgKB1fg4fLoxv0OppNkq5PtukS4i0S dEtCYTqnpkDPsCU3jgD8FlWxLiLAX3ZonXR/Sb3+cP2VovZQTDpZ3HqQYhTo+gG2ZZK87GLy0 4bukguDCneJVkbpfq9AEOR0MUvBQiDYznkO1gxNOr444hwxz5RneUEUhlUSRC1CFtqpNhDGXl TbM44oDNyv7rWGrrTermBHTI/YYyaKy40Vh3vfoyUPAeyBV/Ek8swDg7htNeskR8RIkhSX/v3 VDXw/FBvJTlFpnebS7ynsE2xRWMc31b+F8qGL2Cz2phqM8XZRc+bzEuHsE/FCt/jGaK0pIOul p2wuaj/QnnQcLjAk0G+uNiI/wAeOJ9vjDKypjzEwRD/T8pFCA/Fd/+ipuydGu2u9XfwmMKYut kCO2/1CYHYMcPeLCbODnpv+5rACS709k2rDNie5X1FF96vIMmJZtIdei1z8kmxvkLWOmKJ0tV wvPHFxhYHRPGMIFV68+cEhA+v+6YRJ2H5+S1FBMT2lL5FhkoBlxkks8XYohFKGYc9zqliDLaK G+R3A5N4RKrEKeLkdZupiAvpVen+j+TyPEDADZNbOQsnLEBAnTCe7m6+fv4cfRABsNoxgIsBX LBbNup3anDQ+I35UKdbnbiKjkGLD+DnHB+IGe60rj7F71FemyIenIHNRKIhTijohRB2+qhFci p/HbWYyV32rRyvszDi32VnNR+a8wU4QQLyuEd7Ii6oRolMpm467BPUx+Z1S4mpQZQtvDSZx/m +eWxX56cPeyjNMEoW1q+Ktq+MJdqXyNV9oHwUQrHK33kAncr39E8UR0cPh8C1sR68yGXN0/8I KLa7++1slQfc7OcXb78o506pK9O/QoADjJ1a0Lfypt0gGld9sAAv2pVsZlFNDmODsa1LES/+3 IoYoZVYoDw+J0og1/clf0BEmaD+w4TIsoDOJNYw== X-Rspamd-Queue-Id: 49wJPD1dKYz4R98 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=NancXb1A; dmarc=none; spf=none (mx1.freebsd.org: domain of ohartmann@walstatt.org has no SPF policy when checking 212.227.15.19) smtp.mailfrom=ohartmann@walstatt.org X-Spamd-Result: default: False [-0.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.19:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.48)[-0.484]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[walstatt.org]; RCPT_COUNT_ONE(0.00)[1]; RECEIVED_SPAMHAUS_PBL(0.00)[79.192.169.141:received]; NEURAL_HAM_MEDIUM(-0.37)[-0.368]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; NEURAL_SPAM_SHORT(0.25)[0.252]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.19:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jun 2020 07:03:45 -0000 Due to the circumstance I have no access anymore to the host in question, I'll report a problem occured out of the blue around last week's update of CURRENT with poudriere and swapspace. Problem: under heavy load, the host dies - no ssh connection possible anymore, all jails are in the state "dead". The box in question is running CURRENT, most recent, last update yesterday morning (28th of June, around 1400 UTC). Revision numbers are added as soon I have access to the box again. The host has 16 GB phsyical RAM and 64 GB configured swap - which the kernel complains about to increase swapzone or something similar. The host runs poudriere with both CURRENT and 12-STABLE jails (both recent versions). In the past 18 months we pushed the box to the limits with poudriere allwoing 4 poudriere jobs with each 4 threads - never had any problem except slowing down the system, but always responsive anyhow and never crashing or loosing network connection. The first time the box died this way was 28th, after the last update of both host and jails has been performed 26th June, ~ 1400 UTC. Jails running 12-stable are the first poudriere jobs running and that is the state were the first crash/hung occured yesterday. Is this a known problem? Kind regards, oliver