From owner-freebsd-net@freebsd.org Tue Jul 11 13:56:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13A32DA071A for ; Tue, 11 Jul 2017 13:56:12 +0000 (UTC) (envelope-from vegeta@tuxpowered.net) Received: from mail-lf0-x22f.google.com (mail-lf0-x22f.google.com [IPv6:2a00:1450:4010:c07::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8AC5074EE3 for ; Tue, 11 Jul 2017 13:56:11 +0000 (UTC) (envelope-from vegeta@tuxpowered.net) Received: by mail-lf0-x22f.google.com with SMTP id z78so496152lff.0 for ; Tue, 11 Jul 2017 06:56:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuxpowered-net.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:organization:user-agent :mime-version; bh=kmxeq4lJsSBc4zHRDGCxMh+Q3wU7Vv/nqgTzExn132s=; b=CyLgq78SCqJJkh1/pSLxeh/XtesCGOFO5AzROgd5I6yGJj7NSToUdtnCJQKngO4lhd K3LKN0Ey0HvWAx81vtFLnChN47cXgMM/oXd5OGjv05ygsgdae+O60lgdx2uex1e+wsKe jox7FaVbGQKTlEU9erth8xB06mC1lxiXcBQ0UELPnDXSatzU1K+B+jMxMEPUqVoFY7ea ZF3EoZMi+Qh3J+I3dni8o8QKswU1QEi90kGErAIRwPcPDf5sZjt6Vaa4qGKwaeuli3GZ 8bcfTGeqzmcf3Ti9Tnj5MgQozMqXdqRCWFkxB9+w5vFrRH/kwFImS1ZwoGyTzRhkLUf7 wgFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:organization :user-agent:mime-version; bh=kmxeq4lJsSBc4zHRDGCxMh+Q3wU7Vv/nqgTzExn132s=; b=DeyxFopSvOlyCHBK7RlDvU6DDXkocWfJ0cSSHzYgZ0RthWViAuQlKvv5J225LF+9Z0 Us4cFuxCkbb0y7bbPS1ac5LlfPmE+sPHe+W7cjNmrmu4PM7afAh+/9aTFGJB9pDe1zC7 f1REnBoU93HpuMBY+f16p75QMzPtXse0d47ewb7RrSdeFw+6k21jR+J4grYpK+4mCEsF 8j0gUvfRJhSnbSeYoCfO8u9YxMOUwNVfbU43ihY+8U3JBZftVN7K+kSm+YwutH6jqayG Pwo3doSteQC/HQW9IXcECeS4StzXFFInjhfsQAh1J/xDEVg/c06zRlrupWfCzxJisk3o WSRg== X-Gm-Message-State: AIVw113PkSxE008+6Wn54uDIbWinwTsdxf8GSWoI5/OrTGxrQhTUKlls 8GPwF7RUkz5xHkZ9TQaQpA== X-Received: by 10.80.172.93 with SMTP id w29mr2634174edc.13.1499781369364; Tue, 11 Jul 2017 06:56:09 -0700 (PDT) Received: from energia.localnet ([212.48.107.10]) by smtp.gmail.com with ESMTPSA id c56sm1017621ede.21.2017.07.11.06.56.08 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 11 Jul 2017 06:56:08 -0700 (PDT) From: Kajetan Staszkiewicz To: freebsd-net@freebsd.org Subject: memory leaks in 11.0? Date: Tue, 11 Jul 2017 15:56:04 +0200 Message-ID: <1771938.JUakJLQFm8@energia> Organization: tuxpowered.net User-Agent: KMail/5.2.3 (Linux/4.11.0-3.3-liquorix-amd64; KDE/5.28.0; x86_64; ; ) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart2532470.jQkXWIcRJI"; micalg="pgp-sha1"; protocol="application/pgp-signature" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Jul 2017 13:56:12 -0000 --nextPart2532470.jQkXWIcRJI Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" Hello, I finally upgraded one of many of my routers to 11.0. Unfortunately after running fine for a month it ran out of memory. "wired" memory slowly grows up to allocating all memory in system when no more memory is left for other programs. Things first get swapped and eventually die. The router runs BIRD which has not much to do, it is for internal networks only, pf, pfsync (currently disabled via `ifconfig pfsync0 down`), filebeat, smokeping, ntp, nrpe and custom python cron job for sending data to Graphite. `vmstat -z` shows constantly increasing allocation of "512" and "UMA Slabs". Memory allocated for all pf-related things seems fine. I have graphite graps for every `vmstat -z` and the icrease on "512" grows in similar way as "wired" memory. "512" has 2 917 392 used objects allocated at this moment, "UMA Slabs" is 379 006, there is 2636MiB "wired" memory. How can I debug which part of kernel is responsible for this? I run GENERIC kernel with ixl driver 1.7.11 from Intel, as the one in GENERIC had issues detecting links on my x710 NIC. I ask here, because it is a router, mostly being busy with his network cards, routing and pf. Please direct me to a better group if you can. I can crash this system if needed and dump memory (I hope that is possible on GENERIC) for analysis. -- | pozdrawiam / greetings | powered by Debian, FreeBSD and CentOS | | Kajetan Staszkiewicz | jabber,email: vegeta()tuxpowered net | | Vegeta | www: http://vegeta.tuxpowered.net | `------------------------^---------------------------------------' --nextPart2532470.jQkXWIcRJI Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iF0EABECAB0WIQSOEQZObv2B8mf0JbnjtFCvbXs6FAUCWWTY9AAKCRDjtFCvbXs6 FLCEAJ9mtFiHta7MbCu/Bif+xz7PZX+vfwCg5CWvwkCyGKRMiyApRLFWwJO53Ts= =smAI -----END PGP SIGNATURE----- --nextPart2532470.jQkXWIcRJI--