From owner-freebsd-net@freebsd.org Mon Feb 19 09:28:23 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CDD2BF12AC7 for ; Mon, 19 Feb 2018 09:28:23 +0000 (UTC) (envelope-from kmisak@gmail.com) Received: from mail-qk0-x22d.google.com (mail-qk0-x22d.google.com [IPv6:2607:f8b0:400d:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6BA146987D for ; Mon, 19 Feb 2018 09:28:23 +0000 (UTC) (envelope-from kmisak@gmail.com) Received: by mail-qk0-x22d.google.com with SMTP id 15so11411501qkl.3 for ; Mon, 19 Feb 2018 01:28:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=wqk4nhuGxU4a3o6wUe0nthsHU4B9g+gh720m3TAfmsU=; b=G7bpIAHK1ltYpkGlq73pptZfQ4M6j1Omt4iTYyR85T9YwKLozN+rIHHMZqn2m1bvB0 YCZ5aH/e2vKkdViPOGPiyE94oRZ0OA6aBTF3QW8n9FGPKKIoDKWfhmyUnSIugeP88mv9 OpJWfHiOWHAwPnVDLa2cFo1+yn44FdjdjoEJ1u+o8LbxjmVVjSKKbbKFl60xgk9RV14u 9EuDaAzAkY8srwT+22msAI2Q+Hn3wtqL9zR01d7NDSbQpDtunJGzqc8TzS4qb3IKVCPe dd5Yk93AviL/yFHR0Z60BEo/eko0yxSzqRpjx5zHEhFgm9WlkdZHEd/pwaMmjTioR+Cq hKHQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=wqk4nhuGxU4a3o6wUe0nthsHU4B9g+gh720m3TAfmsU=; b=TW+xIGqs1g+jiGMZ7QpHpYeXssI4vYBFGQdZa6+VCCouR68Z4Q0avcY55drPQhdxEM k+/E+wM35sjbzPwO1glnbTtOzKtktEiWUDGd74SDrQlrW15YztENH1jjYU7puiDNlOg3 vxbYlQWzkgZ/33m3OqXQRdgdmugw7oO0snArtyLvIpCsi9bJHOVB2/xYw+xTHVuu/HMk k9vIf3LmFfI0/F82hJlv6E/xT5B/4UOSr7nkYkAU3NfxaMsYb3b1SLmqNpOAltBsHDi7 GDqJ4DDGSxlfwAzCO+NuK7YaVCo2qiMiUo2soZPaW60KDtUmHOU+n+S8lgPr9NTLSq2n OViw== X-Gm-Message-State: APf1xPCncb09HWTscm8bwkrxlUKC7A7mBTOJWBcuzZe5aLfauW+1MsN6 GF+DHCj4VS5g1YBs8JVIpc+dls23RJO8uLQ7a5tnLr/G X-Google-Smtp-Source: AH8x226CvTyu0UX5krmR7pYmlFHAg6oSoUyY6Zg+3FCYdKDHEUGNr460w/tZ55GDrk1NxSoWdbED0JsJIdzYUsAVh54= X-Received: by 10.233.214.18 with SMTP id r18mr22369932qkk.175.1519032502921; Mon, 19 Feb 2018 01:28:22 -0800 (PST) MIME-Version: 1.0 Received: by 10.200.112.24 with HTTP; Mon, 19 Feb 2018 01:28:22 -0800 (PST) In-Reply-To: <5A8A97EC.4040103@grosbein.net> References: <5A8A97EC.4040103@grosbein.net> From: Misak Khachatryan Date: Mon, 19 Feb 2018 13:28:22 +0400 Message-ID: Subject: Re: Racoon and setkey problems To: Eugene Grosbein Cc: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 09:28:24 -0000 Hi, # vmstat -m | egrep "sec|sah|pol" inpcbpolicy 122 4K - 4955796 32 secasvar 48558 12140K - 1572045 256 sahead 3 1K - 15 256 ipsecpolicy 256 64K - 9911740 256 ipsecrequest 12 2K - 48 128 ipsec-misc 389632 12176K - 12575976 16,32,64 ipsec-saq 3 1K - 15 128 ipsec-reg 3 1K - 12 32 # netstat -m 3178/8717/11895 mbufs in use (current/cache/total) 3075/4025/7100/524288 mbuf clusters in use (current/cache/total/max) 3075/4009 mbuf+clusters out of packet secondary zone in use (current/cache) 0/248/248/126182 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/37387 9k jumbo clusters in use (current/cache/total/max) 0/0/0/21030 16k jumbo clusters in use (current/cache/total/max) 6944K/11221K/18165K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile # vmstat -z | egrep 'ITEM|mbuf' ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP mbuf_packet: 256, 1615140, 3084, 4000,835233903, 0, 0 mbuf: 256, 1615140, 104, 4707,1373358845, 0, 0 mbuf_cluster: 2048, 524288, 7084, 16, 7084, 0, 0 mbuf_jumbo_page: 4096, 126182, 0, 248, 309522, 0, 0 mbuf_jumbo_9k: 9216, 37387, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 21030, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 # sysctl kern.ipc.nmbclusters kern.ipc.nmbclusters: 524288 Nothing new in messages with net.inet.ipsec.debug=1 Best regards, Misak Khachatryan On Mon, Feb 19, 2018 at 1:25 PM, Eugene Grosbein wrote: > 19.02.2018 13:27, Misak Khachatryan wrote: > >> 1644111 messages with memory allocation failure >> >> 3 of machines running 10.4-RELEASE-p1, one 10.3. >> Two of the machine almost the same, only ip addresses and few lines of >> configs differ. One is OK, other one have problem. >> >> Running almost any setkey command leads to: >> >> # setkey -x >> setkey: send: No buffer space available >> >> All packet versions are completely the same, binaries exactly same size. >> >> Any help will be appreciated. > > Perhaps, that is mbuf cluster exhaustion. Please show output of commands: > > netstat -m > vmstat -z | egrep 'ITEM|mbuf' > sysctl kern.ipc.nmbclusters > > How much RAM do they have? Do they run 32 bit or 64 bit system? > >