From owner-freebsd-net@freebsd.org Wed Oct 12 05:13:45 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EB48C0DB91 for ; Wed, 12 Oct 2016 05:13:45 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 2929E1B3A for ; Wed, 12 Oct 2016 05:13:45 +0000 (UTC) (envelope-from julian@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 288AEC0DB90; Wed, 12 Oct 2016 05:13:45 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2831EC0DB8F for ; Wed, 12 Oct 2016 05:13:45 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EE43A1B39 for ; Wed, 12 Oct 2016 05:13:44 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from julian-mbp3.pixel8networks.com (50-196-156-133-static.hfc.comcastbusiness.net [50.196.156.133]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id u9C5Dg9U083276 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 11 Oct 2016 22:13:43 -0700 (PDT) (envelope-from julian@freebsd.org) Subject: Re: FreeBSD10.3-RELEASE. Kernel panic. To: donaldbaud@yahoo.com, "net@freebsd.org" References: <57FC859F.5000200@grosbein.net> <2033449965.65391.1476244568309@mail.yahoo.com> From: Julian Elischer Message-ID: Date: Tue, 11 Oct 2016 22:13:37 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <2033449965.65391.1476244568309@mail.yahoo.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Oct 2016 05:13:45 -0000 On 11/10/2016 8:56 PM, Donald Baud via freebsd-net wrote: > I've been plagued with these =daily= panics until I tried the following recipes and the server has been up for 30 days so far: > > Normally I should expermient more to see which one of the receipes is really the fix, but I'm just glad that the server is stable for now. this is really great information. It makes debugging a lot more possible. I know it is a hard question, but do you have a way to simulate this workload? I have no real way to simulate this kind of workload > > > recipe-1: Don't let mpd5 start automatically when server boots: > i.e. in: /etc/rc.conf > mpd5_enable="NO" > and wait about 5 minutes after server boots then issue: > /usr/local/etc/rc.d/mpd5 onestart > > > recipe-2: recompile the kernel with the NETGRAPH_DEBUG option: > options NETGRAPH > options NETGRAPH_DEBUG > options NETGRAPH_KSOCKET > options NETGRAPH_L2TP > options NETGRAPH_SOCKET > options NETGRAPH_TEE > options NETGRAPH_VJC > options NETGRAPH_PPP > options NETGRAPH_IFACE > options NETGRAPH_MPPC_COMPRESSION > options NETGRAPH_MPPC_ENCRYPTION > options NETGRAPH_TCPMSS > options IPFIREWALL > > recipe-3: recompile the kernel and disable the IPv6 and SCTP options: > nooptions INET6 > nooptions SCTP > > recipe-4: Don't use any of the sysctl optimizations > in other words I commented out all values in sysctl.conf: > # net.graph.maxdgram=20480 (this is the default) > # net.graph.recvspace=20480 (this is the default) > > recipe-5: Don't use any of the loader.conf optimizations > in other words I commented out all values in loader.conf > # net.graph.maxdata=4096 (this is the default) > # net.graph.maxalloc=4096 (this is the default) > > ================================ > In my case, I had the panics with 10.3 and 11-PRERELEASE > 11.0-PRERELEASE FreeBSD 11.0-PRERELEASE #2 r305587 > > With those recipes, I have been running without any crash for a month and counting. Thats' 300 l2tp tunnels and 1400 l2tp sessions generating 700Mbit/s. > > > -DBaud > > > On Tuesday, October 11, 2016 7:30 AM, Cassiano Peixoto wrote: > Hi, > > There are many users complaining about this: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=186114 > > I've been dealing with this issue for one year with no solution. mpd5 as > pppoe server on FreeBSD is useless with this bug. > > I really would like to see it working again, i think it's quite important > to both project and many users. > > Thanks. > > On Tue, Oct 11, 2016 at 3:24 AM, Eugene Grosbein wrote: > >> 11.10.2016 11:02, Андрей Леушкин пишет: >> >>> Hello. I have problem with "FreeBSD nas 10.3-RELEASE FreeBSD 10.3-RELEASE >>> #0: Fri Oct 7 21:12:56 YEKT 2016 nas@nas:/usr/obj/usr/src/sys/nasv3 >>> amd64" >>> >>> Kernel panic is repeated at intervals of 2-3 days. At first I thought that >>> the problem is in the hardware, but the problem did not go away after >>> replacing the server platform. >>> >>> Coredumps and more info on link >>> https://drive.google.com/open?id=0BxciMy2q7ZjTTkIxem9wTE1tM2M >>> >>> Sorry for my english. >>> I'll wait for an answer. >>> >> This is known and long-stanging problem in the FreeBSD network stack. >> It shows up when you have lots of network interfaced created/removed >> frequently >> like in your case of Network Access Server (PPtP, PPPoE etc). >> >> Generally, people run into this problem using mpd5 network daemon. >> mpd5 uses NETGRAPH kernel subsystem to process traffic and >> if an interface disappears (f.e., ,user disconnected) >> while kernel still processes traffic obtained from this interface, it >> panices. >> >> There were lots of reports of this problem. Noone seems to be working on >> it at the moment. >> You should fill a PR using Bugzilla and attach your logs to it. >> >> Eugene Grosbein >> >> >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > >