From owner-freebsd-net@freebsd.org Wed Jul 3 08:05:50 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C03CE15CB44A for ; Wed, 3 Jul 2019 08:05:50 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com (frv197.fwdcdn.com [212.42.77.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.ukr.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EA39E8EBC7 for ; Wed, 3 Jul 2019 08:05:49 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Type:MIME-Version:Message-Id:References:In-Reply-To:Cc:To: Subject:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=Y3MjRHmeXuDulzszVKj25ExQLMuEV4Nwa9SE8mUEWSs=; b=g9D2IjUVk+wkCo9AI50TTT+8lH oBejeYTEYQH2sVD2u3Rj0lq0bDF0YDFf7VhK4Pe2nPsLzgrcf7DYDajYymEJWxWFiM4TWVvvDbRda MLivOtbpueZJVn8FjDxjejovb2gIwMdBIouuTKaYkRWVUyHCWqFUiIWC0z9AviJk5sMI=; Received: from [10.10.10.50] (helo=frv50.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1hiaGx-000Lj1-3g for freebsd-net@freebsd.org; Wed, 03 Jul 2019 11:05:47 +0300 Date: Wed, 03 Jul 2019 11:05:47 +0300 From: wishmaster Subject: Re[2]: Network issues while jails are starting To: Eugene Grosbein Cc: freebsd-net@freebsd.org Received: from artemrts@ukr.net by frv50.fwdcdn.com; Wed, 03 Jul 2019 11:05:47 +0300 In-Reply-To: <00f0cbdf-b68f-bb6e-c9d9-1abf735cdf19@grosbein.net> References: <1562134249.868399000.r0je57so@frv50.fwdcdn.com> <2deee082-1dca-b93f-39f7-33d4c4f5b09d@grosbein.net> <1562138561.380322000.k6ndni22@frv50.fwdcdn.com> <00f0cbdf-b68f-bb6e-c9d9-1abf735cdf19@grosbein.net> X-Reply-Action: reply Message-Id: <1562140717.195877000.tur1x9sh@frv50.fwdcdn.com> X-Mailer: mail.ukr.net 5.0 MIME-Version: 1.0 X-Rspamd-Queue-Id: EA39E8EBC7 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ukr.net header.s=ffe header.b=g9D2IjUV; dmarc=pass (policy=none) header.from=ukr.net; spf=pass (mx1.freebsd.org: domain of artemrts@ukr.net designates 212.42.77.197 as permitted sender) smtp.mailfrom=artemrts@ukr.net X-Spamd-Result: default: False [-6.47 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[ukr.net:s=ffe]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.42.77.0/24]; FREEMAIL_FROM(0.00)[ukr.net]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE(-1.60)[ipnet: 212.42.77.0/24(-4.46), asn: 8856(-3.64), country: UA(0.08)]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DWL_DNSWL_LOW(-1.00)[ukr.net.dwl.dnswl.org : 127.0.5.1]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ukr.net:+]; RCPT_COUNT_TWO(0.00)[2]; MIME_BASE64_TEXT(0.10)[]; MX_GOOD(-0.01)[cached: mxs.ukr.net]; DMARC_POLICY_ALLOW(-0.50)[ukr.net,none]; NEURAL_HAM_SHORT(-0.96)[-0.958,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[ukr.net]; ASN(0.00)[asn:8856, ipnet:212.42.77.0/24, country:UA]; RCVD_TLS_LAST(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2019 08:05:51 -0000   --- Original message --- From: "Eugene Grosbein"  Date: 3 July 2019, 10:48:51 03.07.2019 14:28, wishmaster пишет: > > > > --- Original message --- > From: "Eugene Grosbein" > Date: 3 July 2019, 10:16:31 > > 03.07.2019 14:08, wishmaster wrote: > >> >> Hi, >> >> the office's server has 6 jails and 2 bhyve virtual servers. >> The problem is when I restart server, jails start for a long time (about 6 minutes). All this time the server does not acts as router, that is no packets between interfaces. From within the server packets are transmitted and received (ping works correctly), but from LAN - no. >> >> I do not remember either this issue has appeared after upgrading to 12.0 or switching from STABLE to RELEASE branch, but this issue has been appearing for about half of year or little more. >> >> Toggle sysctl net.inet.ip.forwarding while jails are starting don't help. >> >> root@e-server: uname -a >> FreeBSD e-server 12.0-RELEASE-p3 FreeBSD 12.0-RELEASE-p3 GENERIC amd64 >> >> jail_enable="YES" >> jail_parallel_start="NO" >> jail_list="basejail jdb jphp jwww jmail jdns" >> jail_reverse_stop="YES" >> Any advices? > > Does your LAN use NAT service of the router and/or its DNS resolver? > You should uncomment /var/log/console.log in the /etc/syslog.conf, > create this file and reboot then read the file carefully and check whether > you NAT/DNS services start before jails. > > Logging to the console log file is already enabled. > I check Internet connection w/o DNS services. > > Some logs... [skip] > Jul 3 07:57:04 e-server kernel: Jul 3 07:57:04 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair8b > Jul 3 07:57:27 e-server kernel: jphp If you use ethernet bridging for jails and real NIC, make sure you do NOT assign any IP addresses to bridge members. Instead, assign all IP addresses to the bridge itself as aliases and make sure you bring the bridge and real nic UP before start of jails. I do not use any bridging on this server, just 192.168.254 subnet for jails. Again, all worked fine until I had upgraded or switched to RELEASE. Upgrading and switching was almost in one time, therefore I don't know what was the reason.