From owner-freebsd-current@freebsd.org Thu Apr 5 09:09:59 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B28EAF97873 for ; Thu, 5 Apr 2018 09:09:59 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-wr0-f182.google.com (mail-wr0-f182.google.com [209.85.128.182]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1E7AC71529 for ; Thu, 5 Apr 2018 09:09:58 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-wr0-f182.google.com with SMTP id d1so27140800wrj.13 for ; Thu, 05 Apr 2018 02:09:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=CNzC23n9BX+ApXFb/0uLped2+k2WP0hjZJ5lGmYjWUY=; b=HbeuyXdV+f6Xv7kgBQUwK8E7Ref+Ja3Ta5a6HfvbA6LorV+eSCpNy28B6YXc571uot dWevWlB+qf+T4URZU99FbZqkFmNjOU3v+ve29ABcu1i65erNP4oRin7F0w4Kqjp7jPcM 9q+hHZJfPpdBUoQJupV4/Gex6tBhZMVsMmqIEIes7mHg1WAngr3g51s0vw+WJXAFQTCW 6Wj4S/HUb6sKjLl+wQ3AovV2Ty/VYWzq86WkRCVgwfmM2PUg+5SJlrF69IaooU/NmGz1 5/0DI3on+5/3y3D4kWq67Yany/0kVb04qDFFScyMr7hXZOp1FIvJNPHTqPfEQrgE6H9i 8B+w== X-Gm-Message-State: ALQs6tBByExreV0jZnC01QsAki1mOYfYR6KXn5hTiDmikNwd4IUd8oFF 3qRcbJX+BwdT81RbDKDAO8lZ0HZB X-Google-Smtp-Source: AIpwx49YYAkSzwc961bkXI6gDlG0zgrOTceIOMF9bPdpKJrdo/3w8N1VzQVDz1yItzdsuhQ2Vp9Kzw== X-Received: by 2002:a19:7385:: with SMTP id h5-v6mr13551216lfk.67.1522919003751; Thu, 05 Apr 2018 02:03:23 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id u12sm1202473lji.87.2018.04.05.02.03.22 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 05 Apr 2018 02:03:22 -0700 (PDT) Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT To: Mark Millard Cc: freebsd-current@freebsd.org References: <20180317103915.081ca2dd@thor.intern.walstatt.dynvpn.de> <1b31e36e-e84b-cc63-1422-d1e0ce2f03c8@FreeBSD.org> From: Andriy Gapon Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABzR5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz7CwZQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryM7BTQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAcLBfAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: <14a14c1a-129c-0733-34c8-8eefae3fd084@FreeBSD.org> Date: Thu, 5 Apr 2018 12:03:21 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Apr 2018 09:09:59 -0000 On 05/04/2018 05:03, Mark Millard wrote: > I've classically seen things like (picking on java here): > (no patch yet, so SWAP 0K shows) > > PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME CPU COMMAND > 78694 root 44 52 0 14779M 92720K 0K uwait 22 0:06 9.91% [java] > > when Swap: . . . 0 Used . . . (or some figure much > smaller than SIZE-RES) showed. (SIZE is ki_size and > RES is ki_rssize as I remember.) It suggests some > form of reserved-but-not-allocated contribution to > ki_size (SIZE), space not resident nor swapped out > to a swap partition. Possibly vnode-backed (potential > "VN PAGER in and out" contributions instead of "SWAP > PAGER" ones, in systat -vmstat terms)? > > Are such cases examples of what you were counting > as "wildly inaccurate"? Or do you count vnode-backed > but not resident as perfectly good examples of SWAP > in use? Apologies, but I didn't quite get your question... Instead, I think I now understand better what top actually reports. I think that it reports swap usage based on the archaic swapout algorithm where a whole process is moved to swap when a memory shortage arises. And then the process can be gradually swapped in. So, ki_swrss - ki_rssize is an estimate of how much process's memory still left in swap (the difference between the resident size before the full swapout and the current resident size). Of course, now we have the modern swapout where individual inactive dirty anonymous pages can be paged out to swap (the classic whole-process swapout still can happen, but is quite rare), but top is not aware of that. -- Andriy Gapon