From owner-freebsd-hackers@freebsd.org  Wed Jul  6 22:13:07 2016
Return-Path: <owner-freebsd-hackers@freebsd.org>
Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6CA42B75D3C
 for <freebsd-hackers@mailman.ysv.freebsd.org>;
 Wed,  6 Jul 2016 22:13:07 +0000 (UTC) (envelope-from yuri@rawbw.com)
Received: from shell1.rawbw.com (shell1.rawbw.com [198.144.192.42])
 by mx1.freebsd.org (Postfix) with ESMTP id 5E655160A
 for <freebsd-hackers@FreeBSD.org>; Wed,  6 Jul 2016 22:13:07 +0000 (UTC)
 (envelope-from yuri@rawbw.com)
Received: from yuri.doctorlan.com (c-24-5-143-190.hsd1.ca.comcast.net
 [24.5.143.190]) (authenticated bits=0)
 by shell1.rawbw.com (8.15.1/8.15.1) with ESMTPSA id u66MD0oo015679
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO)
 for <freebsd-hackers@FreeBSD.org>; Wed, 6 Jul 2016 15:13:01 -0700 (PDT)
 (envelope-from yuri@rawbw.com)
X-Authentication-Warning: shell1.rawbw.com: Host
 c-24-5-143-190.hsd1.ca.comcast.net [24.5.143.190] claimed to be
 yuri.doctorlan.com
From: Yuri <yuri@rawbw.com>
Subject: Why kinfo_getvmmap is sometimes so expensive?
To: Freebsd hackers list <freebsd-hackers@FreeBSD.org>
Message-ID: <e6dc27c0-0454-0666-b3e1-887bd116a847@rawbw.com>
Date: Wed, 6 Jul 2016 15:12:59 -0700
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101
 Thunderbird/45.1.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
 <freebsd-hackers.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-hackers>, 
 <mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers/>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-hackers>, 
 <mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 06 Jul 2016 22:13:07 -0000

The function getProcessSizeBytes, calculating the total size of the 
process, runs once per second. I have two processes of the same kind, 
but with the different run history.

Process #1 didn't do much work, its total size is 1.5 GB, google 
perftools library says that it currently has 1.2GB allocated.

Process #2 did a lot of work, its total size is 6.9 GB, but most of the 
used memory was freed, and google perftools library also says that it 
currently has only 1.2GB allocated.

Both processes have about 140 lines in /proc/<pid>/map.


What bothers me is that getProcessSizeBytes run once per second makes 
process #1 to consume ~0.5% CPU, and process #2 to consume ~14% CPU. 
When I stop running getProcessSizeBytes, CPU times of both processes go 
to zero.


Obviously, google perftools doesn't unmap the memory, and the totals of 
block sizes in /proc/<pid>/map is much higher for process #2 with about 
the same block count. But why does this cause 14% of CPU consumption? 
And why another, similar process that goes through about the same number 
of blocks only has 0.5% CPU consumption?


uint64_t getProcessSizeBytes() {
   int i, cnt = 0;
   struct kinfo_vmentry *kvm0, *kvm;
   m_uint64_t memSz = 0;

   kvm0 = ::kinfo_getvmmap(::getpid(), &cnt);

   for (i = 0, kvm = kvm0; i<cnt; i++, kvm++)
     memSz += (kvm->kve_end-kvm->kve_start);

   free(kvm0);
   return (memSz);
}


FreeBSD 10.3


Yuri