From owner-freebsd-net@freebsd.org Wed Jul 3 07:28:40 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1740C15C9F12 for ; Wed, 3 Jul 2019 07:28:40 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv197.fwdcdn.com (frv197.fwdcdn.com [212.42.77.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.ukr.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 558AC8D516 for ; Wed, 3 Jul 2019 07:28:38 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Type:MIME-Version:Message-Id:References:In-Reply-To:Cc:To: Subject:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=wM8ATwEkLLBbu1gs7L/q+a2h/3XaMxZzEWzsNk+7sgM=; b=cmEat3U/xGjXU/6NtiPdAeU8qj +jtAjH/PzwEvw15lnayetBamHgTFeIia16JZc7baFxaEcj4XGYEjO3SFOu7imMyMkV45Di9nla6V2 tzghNuBou1w1jhQHzZNv72aUDqofdgd4QGJc7IgS++BG2UAMXMefKEBhQk6yHCmSBVnI=; Received: from [10.10.10.50] (helo=frv50.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1hiZgr-0001GI-DK for freebsd-net@freebsd.org; Wed, 03 Jul 2019 10:28:29 +0300 Date: Wed, 03 Jul 2019 10:28:29 +0300 From: wishmaster Subject: Re[2]: Network issues while jails are starting To: Eugene Grosbein Cc: freebsd-net@freebsd.org Received: from artemrts@ukr.net by frv50.fwdcdn.com; Wed, 03 Jul 2019 10:28:29 +0300 In-Reply-To: <2deee082-1dca-b93f-39f7-33d4c4f5b09d@grosbein.net> References: <1562134249.868399000.r0je57so@frv50.fwdcdn.com> <2deee082-1dca-b93f-39f7-33d4c4f5b09d@grosbein.net> X-Reply-Action: reply Message-Id: <1562138561.380322000.k6ndni22@frv50.fwdcdn.com> X-Mailer: mail.ukr.net 5.0 MIME-Version: 1.0 X-Rspamd-Queue-Id: 558AC8D516 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ukr.net header.s=ffe header.b=cmEat3U/; dmarc=pass (policy=none) header.from=ukr.net; spf=pass (mx1.freebsd.org: domain of artemrts@ukr.net designates 212.42.77.197 as permitted sender) smtp.mailfrom=artemrts@ukr.net X-Spamd-Result: default: False [-6.34 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[ukr.net:s=ffe]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.42.77.0/24]; FREEMAIL_FROM(0.00)[ukr.net]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE(-1.57)[ipnet: 212.42.77.0/24(-4.35), asn: 8856(-3.57), country: UA(0.08)]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DWL_DNSWL_LOW(-1.00)[ukr.net.dwl.dnswl.org : 127.0.5.1]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ukr.net:+]; RCPT_COUNT_TWO(0.00)[2]; MIME_BASE64_TEXT(0.10)[]; MX_GOOD(-0.01)[cached: mxs.ukr.net]; DMARC_POLICY_ALLOW(-0.50)[ukr.net,none]; NEURAL_HAM_SHORT(-0.87)[-0.869,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[ukr.net]; ASN(0.00)[asn:8856, ipnet:212.42.77.0/24, country:UA]; RCVD_TLS_LAST(0.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2019 07:28:40 -0000   --- Original message --- From: "Eugene Grosbein"  Date: 3 July 2019, 10:16:31 03.07.2019 14:08, wishmaster wrote: > > Hi, > > the office's server has 6 jails and 2 bhyve virtual servers. > The problem is when I restart server, jails start for a long time (about 6 minutes). All this time the server does not acts as router, that is no packets between interfaces. From within the server packets are transmitted and received (ping works correctly), but from LAN - no. > > I do not remember either this issue has appeared after upgrading to 12.0 or switching from STABLE to RELEASE branch, but this issue has been appearing for about half of year or little more. > > Toggle sysctl net.inet.ip.forwarding while jails are starting don't help. > > root@e-server: uname -a > FreeBSD e-server 12.0-RELEASE-p3 FreeBSD 12.0-RELEASE-p3 GENERIC amd64 > > jail_enable="YES" > jail_parallel_start="NO" > jail_list="basejail jdb jphp jwww jmail jdns" > jail_reverse_stop="YES" > Any advices? Does your LAN use NAT service of the router and/or its DNS resolver? You should uncomment /var/log/console.log in the /etc/syslog.conf, create this file and reboot then read the file carefully and check whether you NAT/DNS services start before jails. Logging to the console log file is already enabled. I check Internet connection w/o DNS services. Some logs... Jul  3 07:56:29 e-server kernel: Starting jails: Jul  3 07:56:30 e-server kernel: Jul  3 07:56:30 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair999b Jul  3 07:56:39 e-server kernel:  basejail Jul  3 07:56:39 e-server kernel: Jul  3 07:56:39 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair7b Jul  3 07:56:40 e-server kernel: wrmsr to register 0x10(0) on vcpu 0 Jul  3 07:56:40 e-server kernel: wrmsr to register 0x10(0) on vcpu 1 Jul  3 07:56:41 e-server kernel: wrmsr to register 0x10(0) on vcpu 2 Jul  3 07:56:41 e-server kernel: wrmsr to register 0x10(0x66e28bcf97) on vcpu 2 Jul  3 07:56:41 e-server kernel: wrmsr to register 0x10(0x66e28bcf97) on vcpu 1 Jul  3 07:56:41 e-server kernel: wrmsr to register 0x10(0x66e28bcf97) on vcpu 0 Jul  3 07:57:04 e-server kernel:  jdb Jul  3 07:57:04 e-server kernel: Jul  3 07:57:04 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair8b Jul  3 07:57:27 e-server kernel:  jphp Jul  3 07:57:27 e-server kernel: Jul  3 07:57:27 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair6b Jul  3 08:01:20 e-server kernel:  jwww Jul  3 08:01:21 e-server kernel: Jul  3 08:01:21 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair5b Jul  3 08:04:53 e-server kernel:  jmail Jul  3 08:04:54 e-server kernel: Jul  3 08:04:54 e-server kernel: ng_ether_ifnet_arrival_event: can't re-name node epair4b Jul  3 08:05:48 e-server kernel:  jdns Jul  3 08:05:48 e-server kernel: Starting background file system checks in 60 seconds. Jul  3 08:05:48 e-server kernel: Jul  3 08:05:48 e-server kernel: Wed Jul  3 08:05:48 EEST 2019