From owner-freebsd-net@FreeBSD.ORG Thu Jan 5 14:16:25 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4E352106566B; Thu, 5 Jan 2012 14:16:25 +0000 (UTC) (envelope-from sodynet1@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id CD1538FC18; Thu, 5 Jan 2012 14:16:24 +0000 (UTC) Received: by ggnp1 with SMTP id p1so229708ggn.13 for ; Thu, 05 Jan 2012 06:16:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=tMeSTAnCH7v11Sdjjv5bJtP8/TcnEZF/HZqEfVzafpY=; b=pwt//hJy0z70YH0j5ZCTDRGWQalBVGQT3Owc5Src1r5dsQX6vpQmQ6wxlIj6qbMwms RI3QjwH4Ka8lNj66KpH22WHQ7OumsenSniO0DS3KhgltoWeQOoHQdt2bkdYpLROHTnve 1KT1RulQ+1oArmEhi3QD54BgS+Wu3PKVe3pmI= MIME-Version: 1.0 Received: by 10.50.188.132 with SMTP id ga4mr3854007igc.4.1325772983836; Thu, 05 Jan 2012 06:16:23 -0800 (PST) Received: by 10.231.41.206 with HTTP; Thu, 5 Jan 2012 06:16:22 -0800 (PST) In-Reply-To: <20120105134902.GP34721@glebius.int.ru> References: <20111227044754.GK8035@FreeBSD.org> <20111227083503.GP8035@glebius.int.ru> <20120105095855.GI34721@glebius.int.ru> <20120105110116.GK34721@glebius.int.ru> <20120105113427.GL34721@glebius.int.ru> <20120105134902.GP34721@glebius.int.ru> Date: Thu, 5 Jan 2012 16:16:22 +0200 Message-ID: From: Sami Halabi To: Gleb Smirnoff Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, Alexander Motin Subject: Re: ng_mppc_decompress: too many (4094) packets dropped, disabling node X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jan 2012 14:16:25 -0000 Hi, is setting these sysctl's that high recommended? i don't really know what they mean, and honestly didn't search to see what they do, i simply tried to set them high in order to improve the service. if its recommended, then i would test these changes if they will be done. Sami 2012/1/5 Gleb Smirnoff > On Thu, Jan 05, 2012 at 03:43:45PM +0200, Sami Halabi wrote: > S> Hmm.. > S> > S> Somthing strange, i did: > S> net.graph.recvspace=8388608 > S> net.graph.maxdgram=8388608 > S> > S> > S> and i suddenly got disconnections and logs like: > S> Jan 5 16:10:01 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:11 mpd2 mpd: PPTP: NgMkSockNode: No buffer space available > S> > S> the mpd as follows: > S> > S> Jan 5 16:10:01 mpd2 mpd: Incoming L2TP packet from 172.25.229.3 1701 > S> Jan 5 16:10:01 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:01 mpd2 mpd: Incoming L2TP packet from 172.27.173.112 1701 > S> Jan 5 16:10:01 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:03 mpd2 mpd: Incoming L2TP packet from 172.19.246.206 1701 > S> Jan 5 16:10:03 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:06 mpd2 mpd: Incoming L2TP packet from 172.27.173.112 1701 > S> Jan 5 16:10:06 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Accepting PPTP connection > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: OPEN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Open event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: state change Initial --> Starting > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: LayerStart > S> Jan 5 16:10:11 mpd2 mpd: [L-14] PPTP: attaching to peer's outgoing call > S> Jan 5 16:10:11 mpd2 mpd: PPTP: NgMkSockNode: No buffer space available > S> Jan 5 16:10:11 mpd2 mpd: [L-14] PPTP call cancelled in state CONNECTING > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: DOWN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Close event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: state change Starting --> Initial > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: LayerFinish > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Down event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: SHUTDOWN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: Shutdown > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Accepting PPTP connection > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: OPEN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Open event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: state change Initial --> Starting > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: LayerStart > S> Jan 5 16:10:11 mpd2 mpd: [L-14] PPTP: attaching to peer's outgoing call > S> Jan 5 16:10:11 mpd2 mpd: PPTP: NgMkSockNode: No buffer space available > S> Jan 5 16:10:11 mpd2 mpd: [L-14] PPTP call cancelled in state CONNECTING > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: DOWN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Close event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: state change Starting --> Initial > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: LayerFinish > S> Jan 5 16:10:11 mpd2 mpd: [L-14] LCP: Down event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: SHUTDOWN event > S> Jan 5 16:10:11 mpd2 mpd: [L-14] Link: Shutdown > S> Jan 5 16:10:16 mpd2 mpd: Incoming L2TP packet from 172.27.173.112 1701 > S> Jan 5 16:10:16 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:21 mpd2 mpd: Incoming L2TP packet from 172.25.229.3 1701 > S> Jan 5 16:10:21 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> Jan 5 16:10:23 mpd2 mpd: Incoming L2TP packet from 172.19.246.206 1701 > S> Jan 5 16:10:23 mpd2 mpd: L2TP: ppp_l2tp_ctrl_create: No buffer space > S> available > S> > S> > S> Now i just returned to my original sysctl: > S> net.graph.recvspace=40960 > S> net.graph.maxdgram=40960 > S> > S> and everything seems fine > S> > S> any ideas? > > mpd has many open sockets, and each socket allocates that much recvspace > and sendspace. Since there are a lot of them, it hits per-user resource > limits, I suppose. > > We need to: > > 1) Change mpd to use one control socket with many hooks. > This also requires improving ng_socket, to have a fast hook lookup > method. > > 2) Implement SO_SNDBUF/SO_RCVBUF for AF_NETGRAPH socket, and utilize > it in ngctl, so there would be no need to bump global tunables. > > Eventually I may do this, but I need brave testers, since my mpd > installation is very small. > > -- > Totus tuus, Glebius. > -- Sami Halabi Information Systems Engineer NMS Projects Expert