From owner-freebsd-jail@freebsd.org Mon Feb 4 19:30:15 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B1A814AF9E5 for ; Mon, 4 Feb 2019 19:30:15 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 534F76E6A1 for ; Mon, 4 Feb 2019 19:30:14 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: by mail-lf1-x12f.google.com with SMTP id v5so800223lfe.7 for ; Mon, 04 Feb 2019 11:30:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=BPcT6BxldQJeu6upVtsbuEjzRgpopCUrJB1puIsNT9s=; b=ozmCgsVbGp4q9ghls8Oj/v1IjZ3ukJV4Zh1j702BNB3H+z2SGuoepfw7Q4zaTL1K0F hNSpEnRCPnpCMdgpkfgnlc12EIAwiLHPrm+WnlCFxYpJ+wDBlb0J99CXgehCDNycy6+E lrouEGJufPf/oXQ+DuOPfB6O+XUwHJUFsVcGZEiOFHUMPgL/aB8HADz08Z/l8QDnNm7A 0K8fc6zH8qyKmxPtRN7ALHUuOV9T0RNBSTThVdCsnejuqaFScTeenwHMiN0hqOVEcxeC 8j1s7IadE0odVxWigWVy24FyxwpMkfivxXaCDNUoRxsH7pKh06fMQlS+IszUvjUV+//F 4AwQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=BPcT6BxldQJeu6upVtsbuEjzRgpopCUrJB1puIsNT9s=; b=ihdFtEEKXN3HicOAwh1k7dajRk3OSKLgkq02h6Q/AQLuLHW13/wdUwXz2W5l0IukRg b2XJjO8fmZSatAs3cqFe7DARHgYLRYASZmVrYW37+Kv+I1kTQXlUTD9PBD6ht6w9u+/1 EDcOoTPYBU0mA8aL4Ali9z1mAZ44SXksS7Olh4sQT+ZTrSCl+SzVBx3MSex7bEsYj7an PcsL3iK1Y7FBnjkpUpyoI+mJaLYS9pCb8nbX8mDdgJyNx5aYEUI2zy+1Az866LyFmPjS ZW6+46mZTNmWtaLqwMcsj1L5Wd+xug4sqzXK1u910VCf00K+pyAIg9UdtiWHImvl8Zun VJWQ== X-Gm-Message-State: AHQUAuZQRAjDmnCvHeEmpTS/Aa+pINe7Oq/sb893XOyFj6wD+Nm5CgEA N42GSYvGuDziW956qCCpM1loZiYLCCgI4NEJNOffN3xY X-Google-Smtp-Source: AHgI3IbQTLXtpjNzli4DLATASjzduayEVIyKDkOLdDAqPF7XkNeTAG1Y6X5DKMFAmXh4rHlVoP2VVO5koySpE+mn8+8= X-Received: by 2002:ac2:5087:: with SMTP id f7mr602952lfm.100.1549308611803; Mon, 04 Feb 2019 11:30:11 -0800 (PST) MIME-Version: 1.0 From: Farhan Khan Date: Mon, 4 Feb 2019 14:29:59 -0500 Message-ID: Subject: vnet NAT'd jails extremely slow, connection dies To: freebsd-jail@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 534F76E6A1 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ozmCgsVb; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of khanzf@gmail.com designates 2a00:1450:4864:20::12f as permitted sender) smtp.mailfrom=khanzf@gmail.com X-Spamd-Result: default: False [-6.64 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-jail@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[f.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-2.72)[ip: (-9.28), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-1.94), country: US(-0.07)]; NEURAL_HAM_SHORT(-0.92)[-0.916,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2019 19:30:15 -0000 Hi all, I have a jail NAT'd to a base system, but the connection is extremely slow and frequently disconnects drops, whereas the base is fine has perfectly fine connectivity. My configuration is as follows: vtnet0: Has routeable IPv4 address and 172.16.0.1/16 Jail uses epair4b, base has epair4a. Jail's IP is 172.16.0.5/16. The base and jail can ping each other. bridge0: contains vtnet0 and epair4a. I have gateway_enable="YES" My pf.conf is as follows: nat pass from 172.16.0.0/16 to any -> (vtnet0) When I try to run clamav, the connectivity stalls after a few minutes and eventually disconnects. I ran tcpdump on the bridge and saw a lot of HTTP seq and ack packets but no actual data. I am not using IPv6 yet. Assistance please. Thanks -- Farhan Khan PGP Fingerprint: B28D 2726 E2BC A97E 3854 5ABE 9A9F 00BC D525 16EE From owner-freebsd-jail@freebsd.org Mon Feb 4 19:35:54 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D63814AFEC0 for ; Mon, 4 Feb 2019 19:35:54 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: from mail-lj1-x231.google.com (mail-lj1-x231.google.com [IPv6:2a00:1450:4864:20::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B4D06EC8B for ; Mon, 4 Feb 2019 19:35:53 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: by mail-lj1-x231.google.com with SMTP id k19-v6so865683lji.11 for ; Mon, 04 Feb 2019 11:35:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=MY9TsFm1eclQ/lW/HmOMoo/ub2vKmlEuxaZqn2nmOwc=; b=qKgmbqFlgfKOp4Q9VdAOTeZmyl1qY7wwis6SG5Nmv27t4IoG+QNKl/r7xkJDyUnzR6 /1hSiS+00u21KJ0quvSZRUBt9J/dMjfOqEUiN0H6yz2ZK+d8tXNtKaMT0rVnelFczPL8 XZulpPaBq5XZnNdSHwFSGCjMf5Ro7CfLr791eKEuo/RryV1o7qvDUFkWJP5fGowDeJdL CHyi4ZZCeAwPPfO2LM1IJJpktmJ3sSTNaoO8Uy8qeGXQPPwRA6/V6Be+6oAV8zcwP5an zQcnxO3TIbDjvbEL07oBtQMeL9QcQbPdtIMP+ux94KfUXyzp+p9aJmI+/6II77wunGv5 2ibQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=MY9TsFm1eclQ/lW/HmOMoo/ub2vKmlEuxaZqn2nmOwc=; b=G3HtR9OjhdV4EdhdVDmUNKwBsa/lE0NEj0Ua0sg6EGyQ3iVEJ4pyB04YEmPMmCX0gy dRPblj9jHzdQmIEWBsDFJBKbXkiFQrtSr8yUifsGa+OZZX77cXaAac6+IFFaOT5ji6bU qkeKJm98/CakLa0b/ZSB27uYeK2jWV/4fsoY9H3c064qcj3qfbFx+sf8KXXsQ9zjw2P+ qV8mZU3MEHofh8vpsRjZdhtXYbWDBgYzl4unU1xbTMigIxdEuXpT23JRQVMpc0lwNKGJ z6Gc6NPrV4JyOw24TzV3Z2Ei6W48FyX7sKvU5D3DOrDXz0JHmmedAhhpx6405T2+psT6 mYoQ== X-Gm-Message-State: AHQUAubOw1raByPfh/m1V/aZ/LtmGDdYcdv77l53dohOI/kUjskOOgYz HBB1PERtLasqz4nLY04pxTMhyD0EHzb5938+htEPig== X-Google-Smtp-Source: AHgI3IYT+5D7/Lr7rd5LHz5nEj2iL2AqVhQLKnlNAtWt3eF5LbDENfubErHbK6FOAwtQyj7PrisMJgJJv+fowilCPNs= X-Received: by 2002:a05:651c:c8:: with SMTP id 8mr591429ljr.53.1549308951067; Mon, 04 Feb 2019 11:35:51 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Farhan Khan Date: Mon, 4 Feb 2019 14:35:39 -0500 Message-ID: Subject: Re: vnet NAT'd jails extremely slow, connection dies To: freebsd-jail@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4B4D06EC8B X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=qKgmbqFl; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of khanzf@gmail.com designates 2a00:1450:4864:20::231 as permitted sender) smtp.mailfrom=khanzf@gmail.com X-Spamd-Result: default: False [-6.66 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.91)[-0.915,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-jail@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.73)[ip: (-9.36), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-1.94), country: US(-0.07)]; RCVD_IN_DNSWL_NONE(0.00)[1.3.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2019 19:35:54 -0000 On Mon, Feb 4, 2019 at 2:29 PM Farhan Khan wrote: > > Hi all, > > I have a jail NAT'd to a base system, but the connection is extremely > slow and frequently disconnects drops, whereas the base is fine has > perfectly fine connectivity. > > My configuration is as follows: > vtnet0: Has routeable IPv4 address and 172.16.0.1/16 > Jail uses epair4b, base has epair4a. Jail's IP is 172.16.0.5/16. > The base and jail can ping each other. > bridge0: contains vtnet0 and epair4a. > > I have gateway_enable="YES" > My pf.conf is as follows: > nat pass from 172.16.0.0/16 to any -> (vtnet0) > > When I try to run clamav, the connectivity stalls after a few minutes > and eventually disconnects. I ran tcpdump on the bridge and saw a lot > of HTTP seq and ack packets but no actual data. I am not using IPv6 > yet. > > Assistance please. > Thanks > -- > Farhan Khan > PGP Fingerprint: B28D 2726 E2BC A97E 3854 5ABE 9A9F 00BC D525 16EE Just to provide more context to my previous email, outside of the jail I can download the FreeBSD ISO installer image at 3 MBps. Within the jail it drops to 12KBps. From owner-freebsd-jail@freebsd.org Tue Feb 5 17:47:43 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90BD814C23F3 for ; Tue, 5 Feb 2019 17:47:43 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx2.enfer-du-nord.net (mx2.enfer-du-nord.net [IPv6:2001:41d0:401:2100::5:8a0e]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D6B8185A55 for ; Tue, 5 Feb 2019 17:47:42 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from [IPv6:2003:e9:7f02:4401:1030:7b2a:b6c2:77e0] (p200300E97F02440110307B2AB6C277E0.dip0.t-ipconnect.de [IPv6:2003:e9:7f02:4401:1030:7b2a:b6c2:77e0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx2.enfer-du-nord.net (Postfix) with ESMTPSA id 43vBqN0CL2zcV7; Tue, 5 Feb 2019 18:47:27 +0100 (CET) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.101.1 at mail.enfer-du-nord.net Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: vnet NAT'd jails extremely slow, connection dies From: Michael Grimm In-Reply-To: Date: Tue, 5 Feb 2019 18:47:23 +0100 Cc: freebsd-jail@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2B6B82BC-1105-4D3B-AD6C-E74109A76113@ellael.org> References: To: Farhan Khan X-Mailer: Apple Mail (2.3445.102.3) X-Spam-Status: No, score=-1.0 required=5.0 tests=BAYES_00,RDNS_NONE,TW_VT autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mail.kaan-bock.lan X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 17:47:43 -0000 Farhan Khan wrote: > On Mon, Feb 4, 2019 at 2:29 PM Farhan Khan wrote: >> I have a jail NAT'd to a base system, but the connection is extremely >> slow and frequently disconnects drops, whereas the base is fine has >> perfectly fine connectivity. >>=20 >> My configuration is as follows: >> vtnet0: Has routeable IPv4 address and 172.16.0.1/16 >> Jail uses epair4b, base has epair4a. Jail's IP is 172.16.0.5/16. >> The base and jail can ping each other. >> bridge0: contains vtnet0 and epair4a. >>=20 >> I have gateway_enable=3D"YES" >> My pf.conf is as follows: >> nat pass from 172.16.0.0/16 to any -> (vtnet0) >>=20 >> When I try to run clamav, the connectivity stalls after a few minutes >> and eventually disconnects. I ran tcpdump on the bridge and saw a lot >> of HTTP seq and ack packets but no actual data. I am not using IPv6 >> yet. >=20 > Just to provide more context to my previous email, outside of the jail > I can download the FreeBSD ISO installer image at 3 MBps. Within the > jail it drops to 12KBps. This sounds familiar to me ;-) Please have a look at = https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049470.html Solution in = https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049484.html I ended up with the following additions to /boot/loader.conf (and a = subsequent reboot): # needs to become turned off (LRO) in order to restore tcp = performance within VNET jails: hw.vtnet.lro_disable=3D"1" =20 hw.vtnet.tso_disable=3D"1" HTH, Michael From owner-freebsd-jail@freebsd.org Tue Feb 5 17:58:54 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5906D14C2BB9 for ; Tue, 5 Feb 2019 17:58:54 +0000 (UTC) (envelope-from srs0=z7dd=qm=vega.codepro.be=kp@codepro.be) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EB222868BB for ; Tue, 5 Feb 2019 17:58:53 +0000 (UTC) (envelope-from srs0=z7dd=qm=vega.codepro.be=kp@codepro.be) Received: from vega.codepro.be (unknown [172.16.1.3]) by venus.codepro.be (Postfix) with ESMTP id CB9747DED; Tue, 5 Feb 2019 18:58:45 +0100 (CET) Received: by vega.codepro.be (Postfix, from userid 1001) id C4F5780331; Tue, 5 Feb 2019 18:58:45 +0100 (CET) Date: Tue, 5 Feb 2019 18:58:45 +0100 From: Kristof Provost To: Michael Grimm Cc: Farhan Khan , freebsd-jail@freebsd.org Subject: Re: vnet NAT'd jails extremely slow, connection dies Message-ID: <20190205175845.GA86328@vega.codepro.be> References: <2B6B82BC-1105-4D3B-AD6C-E74109A76113@ellael.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <2B6B82BC-1105-4D3B-AD6C-E74109A76113@ellael.org> X-Checked-By-NSA: Probably User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: EB222868BB X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 17:58:54 -0000 On 2019-02-05 18:47:23 (+0100), Michael Grimm wrote: > Farhan Khan wrote: > > On Mon, Feb 4, 2019 at 2:29 PM Farhan Khan wrote: > > >> I have a jail NAT'd to a base system, but the connection is extremely > >> slow and frequently disconnects drops, whereas the base is fine has > >> perfectly fine connectivity. > >> > >> My configuration is as follows: > >> vtnet0: Has routeable IPv4 address and 172.16.0.1/16 > >> Jail uses epair4b, base has epair4a. Jail's IP is 172.16.0.5/16. > >> The base and jail can ping each other. > >> bridge0: contains vtnet0 and epair4a. > >> > >> I have gateway_enable="YES" > >> My pf.conf is as follows: > >> nat pass from 172.16.0.0/16 to any -> (vtnet0) > >> > >> When I try to run clamav, the connectivity stalls after a few minutes > >> and eventually disconnects. I ran tcpdump on the bridge and saw a lot > >> of HTTP seq and ack packets but no actual data. I am not using IPv6 > >> yet. > > > > Just to provide more context to my previous email, outside of the jail > > I can download the FreeBSD ISO installer image at 3 MBps. Within the > > jail it drops to 12KBps. > > This sounds familiar to me ;-) > > Please have a look at https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049470.html > Solution in https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049484.html > > I ended up with the following additions to /boot/loader.conf (and a subsequent reboot): > > # needs to become turned off (LRO) in order to restore tcp performance within VNET jails: > hw.vtnet.lro_disable="1" > hw.vtnet.tso_disable="1" > Farhan has also solved his issue by turning off lro/tso. (We talked on IRC). I've not seen this issue myself, but I'm interested in a couple of points to hopefully pinpoint and maybe even fix the problem. These are questions for anyone who's running pf on top of a hypervisor and has vnet or other jails, and has seen slowdowns. * What hypervisor are you running? * Does the problem affect only the jails, or also the host system? * Does it only happen with NAT, or with routed packets as well? If anyone is affected and not using pf that'd be interesting information as well. Regards, Kristof From owner-freebsd-jail@freebsd.org Wed Feb 6 15:28:06 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA48214D6CAF for ; Wed, 6 Feb 2019 15:28:06 +0000 (UTC) (envelope-from mwlucas@mail.michaelwlucas.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 22687719F9 for ; Wed, 6 Feb 2019 15:28:06 +0000 (UTC) (envelope-from mwlucas@mail.michaelwlucas.com) Received: by mailman.ysv.freebsd.org (Postfix) id D0A4714D6CAE; Wed, 6 Feb 2019 15:28:05 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE31B14D6CAD for ; Wed, 6 Feb 2019 15:28:05 +0000 (UTC) (envelope-from mwlucas@mail.michaelwlucas.com) Received: from mail.michaelwlucas.com (mail.michaelwlucas.com [104.236.197.233]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3227A719F3 for ; Wed, 6 Feb 2019 15:28:05 +0000 (UTC) (envelope-from mwlucas@mail.michaelwlucas.com) Received: from mail.michaelwlucas.com (localhost [127.0.0.1]) by mail.michaelwlucas.com (8.15.2/8.15.2) with ESMTP id x16FRx6l047883 for ; Wed, 6 Feb 2019 10:28:00 -0500 (EST) (envelope-from mwlucas@mail.michaelwlucas.com) Received: (from mwlucas@localhost) by mail.michaelwlucas.com (8.15.2/8.15.2/Submit) id x16FRxJ2047882 for jail@freebsd.org; Wed, 6 Feb 2019 10:27:59 -0500 (EST) (envelope-from mwlucas) Date: Wed, 6 Feb 2019 10:27:59 -0500 From: "Michael W. Lucas" To: jail@freebsd.org Subject: jail exit code? Message-ID: <20190206152759.GB47586@mail.michaelwlucas.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.2 (mail.michaelwlucas.com [127.0.0.1]); Wed, 06 Feb 2019 10:28:02 -0500 (EST) X-Rspamd-Queue-Id: 3227A719F3 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [5.51 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(0.51)[asn: 14061(2.62), country: US(-0.07)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[jail@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; MIME_TRACE(0.00)[0:+]; NEURAL_SPAM_SHORT(0.82)[0.816,0]; MX_GOOD(-0.01)[cached: mail.michaelwlucas.com]; NEURAL_SPAM_LONG(1.00)[0.999,0]; DMARC_NA(0.00)[michaelwlucas.com]; NEURAL_SPAM_MEDIUM(1.00)[0.997,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[mwlucas@michaelwlucas.com,mwlucas@mail.michaelwlucas.com]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.192.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[mwlucas@michaelwlucas.com,mwlucas@mail.michaelwlucas.com]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:28:06 -0000 Hi, It *appears* from my reading of mailing list archives & forum posts that the return code of a jail is the return code of the last jailed process to exit. Is that the standard? Or is that just an accident, and people shouldn't rely on it? (Either way, might be a nice addition to the man page.) Thanks, ==ml -- Michael W. Lucas https://mwl.io/ author of: Absolute OpenBSD, SSH Mastery, git commit murder, Immortal Clay, PGP & GPG, Absolute FreeBSD, etc, etc, etc... From owner-freebsd-jail@freebsd.org Wed Feb 6 15:48:25 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4385314D74F3 for ; Wed, 6 Feb 2019 15:48:25 +0000 (UTC) (envelope-from dan@langille.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A1D48725A3 for ; Wed, 6 Feb 2019 15:48:24 +0000 (UTC) (envelope-from dan@langille.org) Received: by mailman.ysv.freebsd.org (Postfix) id 65C1214D74F2; Wed, 6 Feb 2019 15:48:24 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5186414D74F1 for ; Wed, 6 Feb 2019 15:48:24 +0000 (UTC) (envelope-from dan@langille.org) Received: from clavin1.langille.org (clavin1.langille.org [162.208.116.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "clavin.langille.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D272725A2 for ; Wed, 6 Feb 2019 15:48:22 +0000 (UTC) (envelope-from dan@langille.org) Received: from (clavin1.int.langille.org (clavin1.int.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) with ESMTPSA id 2DEB4BDCA ; Wed, 6 Feb 2019 15:48:14 +0000 (UTC) From: Dan Langille Content-Type: multipart/signed; boundary="Apple-Mail=_642B7664-518D-40B4-8039-2CDC50E4A372"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: jails which take a long time to shutdown Message-Id: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> Date: Wed, 6 Feb 2019 10:47:53 -0500 Cc: jail@freebsd.org To: Michael W Lucas X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 2D272725A2 X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 162.208.116.86 as permitted sender) smtp.mailfrom=dan@langille.org X-Spamd-Result: default: False [-8.96 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:162.208.116.86]; MV_CASE(0.50)[]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[ALT3.ASPMX.L.GOOGLE.COM,ASPMX.L.GOOGLE.COM,ALT2.ASPMX.L.GOOGLE.COM,ALT1.ASPMX.L.GOOGLE.COM,ALT4.ASPMX.L.GOOGLE.COM]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; NEURAL_HAM_SHORT(-0.90)[-0.899,0]; IP_SCORE(-3.65)[ip: (-9.66), ipnet: 162.208.116.0/22(-4.91), asn: 11403(-3.61), country: US(-0.07)]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:11403, ipnet:162.208.116.0/22, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:48:25 -0000 --Apple-Mail=_642B7664-518D-40B4-8039-2CDC50E4A372 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Michael, Something came to mind with your recent post about exit codes. What if a jail takes minutes to shutdown? Will it be shutdown properly? I ask because I routinely have a jail which when restarted has a = corrupted mongodb database. I have not tracked down the issue, but I know it takes a while to = shutdown. -- Dan Langille - BSDCan / PGCon dan@langille.org --Apple-Mail=_642B7664-518D-40B4-8039-2CDC50E4A372 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEzqcJ4oeyf8sgTIEBIU09XU2nXtMFAlxbAakACgkQIU09XU2n XtMFJgf+Jlf1h2VGOOMnT1hYiID/KMF+qcDVVO/9x3XxywRUayStkAOlRrI1yTmF aMLbIb5sOSQhV3mvZzaHMccQvbnIuA08dh6fcdf7oIikQeoFlXPls7GOGRDJWXV9 sNyrRa5EDmmaJSLmF+7yCFwBwt7SAAnvKel76Z94eIJZXjY+g3+xZb9UWgCC51wM lOIljDLdBVQRn475JbdgOPX+4EbxdGSMFGBGcc5qHlLi6XuD2piEJwMN+ulAZitr ic6dtqHPqCjQEb4CzYJnX6tHguUjVrV05XAuyJHhjSFavxvt5mKJ14+zSbR3udxT XyJ8Vmya9NMwK6xvUZo1TfmOJKONow== =OVWC -----END PGP SIGNATURE----- --Apple-Mail=_642B7664-518D-40B4-8039-2CDC50E4A372-- From owner-freebsd-jail@freebsd.org Wed Feb 6 17:36:22 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 877D814DA19F for ; Wed, 6 Feb 2019 17:36:22 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C99B376736 for ; Wed, 6 Feb 2019 17:36:21 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 8497E14DA19E; Wed, 6 Feb 2019 17:36:21 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72EEC14DA19D for ; Wed, 6 Feb 2019 17:36:21 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: from mail-it1-x12f.google.com (mail-it1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F368276735 for ; Wed, 6 Feb 2019 17:36:20 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: by mail-it1-x12f.google.com with SMTP id b5so8142071iti.2 for ; Wed, 06 Feb 2019 09:36:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-transfer-encoding; bh=kf9eX2utDWMb3HEUBUqCqsRGuhN9UjBeLZV5m0OGOXE=; b=OjnR1vexXCIL/wtyrJ2lypOfv451jRf1i6ri26wSvWzshsHRRViYZAcVWSTDBECkc4 vVzBNimJrp3NJNBfcjj0XIoWxepL0O0IKlPOlP9u1z2qyLcgyPGeFF+g1nBRzkCt3EbQ ADSzYKmMNvJ3XF3j+HWg81BQu3JtYFBbI7CiUzBbI2TpcMUcTMeNt1Ki/XpJiXQ+v08E C1SeRrzj3HARIT6GLP1WuFV6XNCVBxVfammWUiktlb51BVzBZS/55AFWStUIhQ1G1CXA SlB7uf2SNGUN+iirMpqCiXULNHN/qqOJW0AImfcmneBf/3MxN/l/HPUErCPQ3TTeTij1 GJsw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-transfer-encoding; bh=kf9eX2utDWMb3HEUBUqCqsRGuhN9UjBeLZV5m0OGOXE=; b=JfCWtoa3KY5Fe1Cpi92fUH/JkaBkTy6WZXRjt5GGN2XkbMv7mWN6flq66eqbdg9lw2 XzjC/JlBqQKWPOUX1WCIUSrEJNj75PslTBoJpmM3/ZqEj470BPES81q9MNvR93MPFo+6 hhaYb1A/EmudztnZvehwMqTxBpLhi01ggOoyxlpBWlz4n9ydYCIOv5oBOtO9TTl1OM+H ZCrnsMmpzPG1MP/9RO8u/KMSCC+zafuN38kCCXPaeTcAszodj20OH6KSd7IQzWKKDtqh E0nD758cwFs1nMtzuH9BjpuGiGBQNzSJeGehBEgng03pe1yDWnkOUqeeC+W1unK6zKJ9 fRig== X-Gm-Message-State: AHQUAuZJYF4MnlF87z5Ye9CstVh4FLulBrobwe0Cz2/fUYc9nx6rxRdj cKNaqCSEWWFwvpR1alWRfmWtaczd X-Google-Smtp-Source: AHgI3IbBVtOuj8SRsA9U1Mk5QAwEgzjzR033nw/EQ+YX47Zm+NrjGPXdO38Qa8oSVGGsxiKRb99XNQ== X-Received: by 2002:a24:2a4a:: with SMTP id w71mr2732366itw.127.1549474580499; Wed, 06 Feb 2019 09:36:20 -0800 (PST) Received: from [10.0.10.8] (cpe-65-25-53-210.neo.res.rr.com. [65.25.53.210]) by smtp.googlemail.com with ESMTPSA id h13sm3229665ioq.72.2019.02.06.09.36.19 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 06 Feb 2019 09:36:19 -0800 (PST) Message-ID: <5C5B1B12.2060406@gmail.com> Date: Wed, 06 Feb 2019 12:36:18 -0500 From: Ernie Luzar User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Dan Langille CC: Michael W Lucas , jail@freebsd.org Subject: Re: jails which take a long time to shutdown References: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> In-Reply-To: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: F368276735 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.93 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.93)[-0.935,0] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 17:36:22 -0000 Dan Langille wrote: > Michael, > > Something came to mind with your recent post about exit codes. > > What if a jail takes minutes to shutdown? Will it be shutdown properly? > > I ask because I routinely have a jail which when restarted has a corrupted mongodb database. > > I have not tracked down the issue, but I know it takes a while to shutdown. > > -- > Dan Langille - BSDCan / PGCon > dan@langille.org > > Using the halt command will cause jails to bypass an orderly shutdown leaving databases with data in buffers never being written to the database. A very big no no. Use shutdown command always. From owner-freebsd-jail@freebsd.org Wed Feb 6 17:43:29 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5948314DA4AA for ; Wed, 6 Feb 2019 17:43:29 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id EBCBA76ADC for ; Wed, 6 Feb 2019 17:43:28 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id AA22914DA4A2; Wed, 6 Feb 2019 17:43:28 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 975F614DA4A0 for ; Wed, 6 Feb 2019 17:43:28 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org (gritton.org [199.192.165.131]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2BBDC76ADA for ; Wed, 6 Feb 2019 17:43:28 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org ([127.0.0.131]) by gritton.org (8.15.2/8.15.2) with ESMTP id x16HhN1W036189; Wed, 6 Feb 2019 10:43:23 -0700 (MST) (envelope-from jamie@freebsd.org) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 06 Feb 2019 10:43:23 -0700 From: James Gritton To: jail@freebsd.org Subject: Re: jails which take a long time to shutdown In-Reply-To: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> References: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> Message-ID: <62ba257cb405e566d45b54a760017f12@freebsd.org> X-Sender: jamie@freebsd.org User-Agent: Roundcube Webmail/1.3.8 X-Greylist: inspected by milter-greylist-4.6.2 (gritton.org [127.0.0.131]); Wed, 06 Feb 2019 10:43:23 -0700 (MST) for IP:'127.0.0.131' DOMAIN:'[127.0.0.131]' HELO:'gritton.org' FROM:'jamie@freebsd.org' RCPT:'' X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (gritton.org [127.0.0.131]); Wed, 06 Feb 2019 10:43:23 -0700 (MST) X-Rspamd-Queue-Id: 2BBDC76ADA X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.978,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 17:43:29 -0000 On 2019-02-06 08:47, Dan Langille wrote: > Michael, > > Something came to mind with your recent post about exit codes. > > What if a jail takes minutes to shutdown? Will it be shutdown > properly? > > I ask because I routinely have a jail which when restarted has a > corrupted mongodb database. > > I have not tracked down the issue, but I know it takes a while to > shutdown. There are two jail parameters that work will effect that. "exec.timeout" sets a limit that jail(8) will wait for a command such as rc.shutdown to complete. Setting this may cause your jail to fail to stop - at least as far as jail(8) knows. The command will still be running, and rc.shutdown may or may not eventually complete, and then the jail may then go away on its own if "persist" isn't set. Not setting it will make jail(8) sit and wait for an indefinite time. "stop.timeout" sets a limit that jail will wait after successful completion of the stop scripts, between sending everything a SIGTERM and removing the jail outright (which will send then a SIGKILL from the kernel). It has a default of ten seconds, but may be set to zero in which case it's straight to removal and SIGKILL. In addition to these, there's rc.shutdown's $rcshutdown_timeout. It would make sense to set exec.time to at least this long (default 90 seconds) if you use it at all. So if your desire is to protect database integrity over getting a known shutdown time, keep exec.timeout unset and change $rcshutdown_timeout to "". Then jail -r should patiently wait. - Jamie From owner-freebsd-jail@freebsd.org Wed Feb 6 17:43:50 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7849A14DA508 for ; Wed, 6 Feb 2019 17:43:50 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E04A576B13 for ; Wed, 6 Feb 2019 17:43:49 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id A0B9814DA507; Wed, 6 Feb 2019 17:43:49 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8E57E14DA506 for ; Wed, 6 Feb 2019 17:43:49 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org (gritton.org [199.192.165.131]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 232AA76B12 for ; Wed, 6 Feb 2019 17:43:49 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org ([127.0.0.131]) by gritton.org (8.15.2/8.15.2) with ESMTP id x16HFB60035576; Wed, 6 Feb 2019 10:15:11 -0700 (MST) (envelope-from jamie@freebsd.org) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 06 Feb 2019 10:15:11 -0700 From: James Gritton To: jail@freebsd.org Subject: Re: jail exit code? In-Reply-To: <20190206152759.GB47586@mail.michaelwlucas.com> References: <20190206152759.GB47586@mail.michaelwlucas.com> Message-ID: X-Sender: jamie@freebsd.org User-Agent: Roundcube Webmail/1.3.8 X-Greylist: inspected by milter-greylist-4.6.2 (gritton.org [127.0.0.131]); Wed, 06 Feb 2019 10:15:11 -0700 (MST) for IP:'127.0.0.131' DOMAIN:'[127.0.0.131]' HELO:'gritton.org' FROM:'jamie@freebsd.org' RCPT:'' X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (gritton.org [127.0.0.131]); Wed, 06 Feb 2019 10:15:11 -0700 (MST) X-Rspamd-Queue-Id: 232AA76B12 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.97)[-0.975,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 17:43:50 -0000 On 2019-02-06 08:27, Michael W. Lucas wrote: > Hi, > > It *appears* from my reading of mailing list archives & forum posts > that the return code of a jail is the return code of the last jailed > process to exit. > > Is that the standard? Or is that just an accident, and people > shouldn't rely on it? > > (Either way, might be a nice addition to the man page.) Not quite, though there's some relationship. If jail(8) fails to start or stop a jail, it will return an error - just the typical 0 for success, 1 for fail. One reason for this failure may be one of the start or stop scripts returning an error code, in which case while you don't get the command's exit status you do get its general "errorness." But there are other reasons the jail may fail to start/stop, so you can't rely on the exit status to tell you the particulars. - Jamie From owner-freebsd-jail@freebsd.org Wed Feb 6 17:46:02 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DF1A14DA581 for ; Wed, 6 Feb 2019 17:46:02 +0000 (UTC) (envelope-from SRS0=ULNc=QN=quip.cz=000.fbsd@elsa.codelab.cz) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7934B76B90 for ; Wed, 6 Feb 2019 17:46:01 +0000 (UTC) (envelope-from SRS0=ULNc=QN=quip.cz=000.fbsd@elsa.codelab.cz) Received: by mailman.ysv.freebsd.org (Postfix) id 2F3AC14DA580; Wed, 6 Feb 2019 17:46:01 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1CC9D14DA57F for ; Wed, 6 Feb 2019 17:46:01 +0000 (UTC) (envelope-from SRS0=ULNc=QN=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9FFBD76B8F for ; Wed, 6 Feb 2019 17:46:00 +0000 (UTC) (envelope-from SRS0=ULNc=QN=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 98BED28432; Wed, 6 Feb 2019 18:45:52 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id AFB6128429; Wed, 6 Feb 2019 18:45:50 +0100 (CET) Subject: Re: jails which take a long time to shutdown To: Dan Langille , Michael W Lucas Cc: jail@freebsd.org References: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: Date: Wed, 6 Feb 2019 18:45:50 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 9FFBD76B8F X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.988,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 17:46:02 -0000 Dan Langille wrote on 2019/02/06 16:47: > Michael, > > Something came to mind with your recent post about exit codes. > > What if a jail takes minutes to shutdown? Will it be shutdown properly? > > I ask because I routinely have a jail which when restarted has a corrupted mongodb database. > > I have not tracked down the issue, but I know it takes a while to shutdown. Can it be related to calling /etc/rc.shutdown and sort rcshutdown_timeout in rc.conf? (etc/defaults/rc.conf has rcshutdown_timeout=90) Is your mongodb corrupted when you just restart the jail or only in case when you restart the whole machine? I am not sure if the system shutdown will wait 90 for each jail or kill all processes after 90 seconds counted by hosts rcshutdown_timeout. Miroslav Lachman From owner-freebsd-jail@freebsd.org Wed Feb 6 18:58:59 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E37A414DBECE for ; Wed, 6 Feb 2019 18:58:58 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx1.enfer-du-nord.net (mx1.enfer-du-nord.net [IPv6:2001:41d0:302:1100::e:1def]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0DB9D8165E; Wed, 6 Feb 2019 18:58:57 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from [IPv6:2003:e9:7f02:5a01:64fc:de67:d3dd:3664] (p200300E97F025A0164FCDE67D3DD3664.dip0.t-ipconnect.de [IPv6:2003:e9:7f02:5a01:64fc:de67:d3dd:3664]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.enfer-du-nord.net (Postfix) with ESMTPSA id 43vrM928Djzrxc; Wed, 6 Feb 2019 19:58:45 +0100 (CET) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.101.1 at mail.enfer-du-nord.net Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: vnet NAT'd jails extremely slow, connection dies From: Michael Grimm In-Reply-To: <20190205175845.GA86328@vega.codepro.be> Date: Wed, 6 Feb 2019 19:58:43 +0100 Cc: freebsd-jail@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <2B6B82BC-1105-4D3B-AD6C-E74109A76113@ellael.org> <20190205175845.GA86328@vega.codepro.be> To: Kristof Provost X-Mailer: Apple Mail (2.3445.102.3) X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,RDNS_NONE autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mail.mer-waases.lan X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 18:58:59 -0000 Kristof Provost wrote: > These are questions for anyone who's running pf on top of a hypervisor > and has vnet or other jails, and has seen slowdowns. >=20 > * What hypervisor are you running? I do not know. It is a cloud hosted on OVH infrastructure in France = https://www.ovh.co.uk/public-cloud/instances/technologies/ But I do not know which hypervisor they use, sorry. > * Does the problem affect only the jails, or also the host system? The host didn't show any slowdown. Only within a jail the performance = drop dramatically. > * Does it only happen with NAT, or with routed packets as well? In my case it happens with NAT, never tried routed packets. HTH, Michael From owner-freebsd-jail@freebsd.org Wed Feb 6 21:01:07 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C21814DE607 for ; Wed, 6 Feb 2019 21:01:07 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: from mail-lf1-x144.google.com (mail-lf1-x144.google.com [IPv6:2a00:1450:4864:20::144]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5933F85D0E; Wed, 6 Feb 2019 21:01:05 +0000 (UTC) (envelope-from khanzf@gmail.com) Received: by mail-lf1-x144.google.com with SMTP id a16so6500434lfg.3; Wed, 06 Feb 2019 13:01:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=u0kfS0geRNg4L8HzQQ+eJcojeMhwq6UJvPhZy8SQKkE=; b=DfXejZdBtV3NBbfluq4bEYZww0JCIKjhTckl/fQvRXSnjH6d8d7i2JUPLXNQeeO/Nl 3Y//T0qLBnpksEAk2buU1ElUpFUd+tYrZMopfwM3ZaIUo6Y5blOnnEYh9EiZ9jaTLIpS wz7iCavCihsuHTGNh3nEdhNB0Pz4StEWyRhWYp8Yco1bDeCjqec25DLGp1tifXITpTVs eLvwomglbNfALMiXuKVWDUub5vB9DVg0SQkdk5EcO/QYoUMQPlgACb4s1eoAyaOVayPQ PDS1HCp0RPCI4o4z/5xlXcQ37uKmPS9DqZDvZ8/5U+fcGbf9nFhWLqB/Fef/PmMHBYq2 1V3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=u0kfS0geRNg4L8HzQQ+eJcojeMhwq6UJvPhZy8SQKkE=; b=iWT649IXwhTK/JCGGEUu3hlG1l7Gvbfcf1Hf428qHsjtmexcdiie8gsHcPyREalcaA C3iWYOIKWhtbfA1IvPcjn3q71UeT446TdHU5SlMg+JbIzWw8tM+b/HqqNRsF2iTGrMMB BLZtIe7vMyrR/9lzfGhaI9+4NwufeeFIxnDUyQZ5uSVqnv5kuwE5pDVWLEqeXyv6AWGk 7VOLAuhWW+XXk3nkVwPg8AoIEa2ljBYBiqMgpe+JGX5J1HcBBlUjEUhTYn01Qk199+2n D9+FciuH1P+aEM/MaQZ9MWI2f6FPZ/vPpL2s4y0Le7Z7sCmz0SKFB7Sdsu2NpUmdXsEr 52MQ== X-Gm-Message-State: AHQUAuZVepPu8XLRLJuWm737w6L9iBJGoUzvv1wrZXk6/qyI7xiaB/Dp i0r/yKtmYtU/dwlAL8UYIqsR8yAxHOcipsixxTisWw== X-Google-Smtp-Source: AHgI3IYsjIJ5TqLfLrTL3z7rrZPqV90tecKosVnu5jb/6a4QlO5gtEHB+42UbKVtHZGKiWY7bDFpoUZHbVcGLVyzTus= X-Received: by 2002:ac2:42d2:: with SMTP id n18mr7483964lfl.37.1549486862617; Wed, 06 Feb 2019 13:01:02 -0800 (PST) MIME-Version: 1.0 References: <2B6B82BC-1105-4D3B-AD6C-E74109A76113@ellael.org> <20190205175845.GA86328@vega.codepro.be> In-Reply-To: <20190205175845.GA86328@vega.codepro.be> From: Farhan Khan Date: Wed, 6 Feb 2019 16:00:50 -0500 Message-ID: Subject: Re: vnet NAT'd jails extremely slow, connection dies To: Kristof Provost Cc: Michael Grimm , freebsd-jail@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 5933F85D0E X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=DfXejZdB; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of khanzf@gmail.com designates 2a00:1450:4864:20::144 as permitted sender) smtp.mailfrom=khanzf@gmail.com X-Spamd-Result: default: False [-2.70 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.979,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.39)[0.386,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[4.4.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-0.10)[ip: (3.85), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-1.97), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 21:01:07 -0000 On Tue, Feb 5, 2019 at 12:58 PM Kristof Provost wrote: > > On 2019-02-05 18:47:23 (+0100), Michael Grimm wrote: > > Farhan Khan wrote: > > > On Mon, Feb 4, 2019 at 2:29 PM Farhan Khan wrote: > > > > >> I have a jail NAT'd to a base system, but the connection is extremely > > >> slow and frequently disconnects drops, whereas the base is fine has > > >> perfectly fine connectivity. > > >> > > >> My configuration is as follows: > > >> vtnet0: Has routeable IPv4 address and 172.16.0.1/16 > > >> Jail uses epair4b, base has epair4a. Jail's IP is 172.16.0.5/16. > > >> The base and jail can ping each other. > > >> bridge0: contains vtnet0 and epair4a. > > >> > > >> I have gateway_enable="YES" > > >> My pf.conf is as follows: > > >> nat pass from 172.16.0.0/16 to any -> (vtnet0) > > >> > > >> When I try to run clamav, the connectivity stalls after a few minutes > > >> and eventually disconnects. I ran tcpdump on the bridge and saw a lot > > >> of HTTP seq and ack packets but no actual data. I am not using IPv6 > > >> yet. > > > > > > Just to provide more context to my previous email, outside of the jail > > > I can download the FreeBSD ISO installer image at 3 MBps. Within the > > > jail it drops to 12KBps. > > > > This sounds familiar to me ;-) > > > > Please have a look at https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049470.html > > Solution in https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049484.html > > > > I ended up with the following additions to /boot/loader.conf (and a subsequent reboot): > > > > # needs to become turned off (LRO) in order to restore tcp performance within VNET jails: > > hw.vtnet.lro_disable="1" > > hw.vtnet.tso_disable="1" > > > Farhan has also solved his issue by turning off lro/tso. (We talked on > IRC). > > I've not seen this issue myself, but I'm interested in a couple of > points to hopefully pinpoint and maybe even fix the problem. > > These are questions for anyone who's running pf on top of a hypervisor > and has vnet or other jails, and has seen slowdowns. > > * What hypervisor are you running? > * Does the problem affect only the jails, or also the host system? > * Does it only happen with NAT, or with routed packets as well? > > If anyone is affected and not using pf that'd be interesting information > as well. > > Regards, > Kristof Michael, thank you very much. This appears to do the trick, as Kristof also directed me. A. This was on a Vultr instance. Per they are using KVM, per a support ticket. B. Just the Jail, not the post C. I will have to get back to you on that, as I do not have a publicly routeable IP to test on at the moment. From owner-freebsd-jail@freebsd.org Wed Feb 6 21:02:37 2019 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4218514DE77C for ; Wed, 6 Feb 2019 21:02:37 +0000 (UTC) (envelope-from mark@exonetric.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9EB0F85E48 for ; Wed, 6 Feb 2019 21:02:35 +0000 (UTC) (envelope-from mark@exonetric.com) Received: by mailman.ysv.freebsd.org (Postfix) id 0D31E14DE77B; Wed, 6 Feb 2019 21:02:35 +0000 (UTC) Delivered-To: jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D32A114DE77A for ; Wed, 6 Feb 2019 21:02:34 +0000 (UTC) (envelope-from mark@exonetric.com) Received: from relay.exonetric.net (relay0.exonetric.net [178.250.72.161]) by mx1.freebsd.org (Postfix) with ESMTP id 9C80285E3E for ; Wed, 6 Feb 2019 21:02:31 +0000 (UTC) (envelope-from mark@exonetric.com) Received: from imac.localdomain (90.69.187.81.in-addr.arpa [81.187.69.90]) by relay.exonetric.net (Postfix) with ESMTPSA id 7480D2B5A6; Wed, 6 Feb 2019 21:02:24 +0000 (GMT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: jails which take a long time to shutdown From: Mark Blackman In-Reply-To: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> Date: Wed, 6 Feb 2019 21:02:23 +0000 Cc: Michael W Lucas , jail@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2E3C5E27-AE22-4D8B-BC03-F88222214683@exonetric.com> References: <08D0C738-8D03-4618-BC8C-26B076293493@langille.org> To: Dan Langille X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 9C80285E3E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 21:02:37 -0000 > On 6 Feb 2019, at 15:47, Dan Langille wrote: >=20 > Michael, >=20 > Something came to mind with your recent post about exit codes. >=20 > What if a jail takes minutes to shutdown? Will it be shutdown = properly? >=20 > I ask because I routinely have a jail which when restarted has a = corrupted mongodb database. >=20 Isn=E2=80=99t corrupted the natural state for a mongodb database? :) - Mark