From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 17 07:25:08 2010 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 541E7106564A for ; Wed, 17 Nov 2010 07:25:08 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [IPv6:2001:4068:10::3]) by mx1.freebsd.org (Postfix) with ESMTP id D02858FC0C for ; Wed, 17 Nov 2010 07:25:07 +0000 (UTC) Received: from localhost (amavis.fra.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id CBF5D41C650; Wed, 17 Nov 2010 08:25:06 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([192.168.74.103]) by localhost (amavis.fra.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id 9s7scPrIQgCX; Wed, 17 Nov 2010 08:25:05 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id CC8E341C66F; Wed, 17 Nov 2010 08:25:05 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 4FB024448F3; Wed, 17 Nov 2010 07:23:01 +0000 (UTC) Date: Wed, 17 Nov 2010 07:23:01 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Thierry Herbelot In-Reply-To: <201011170729.41894.thierry.herbelot@free.fr> Message-ID: <20101117072103.R24596@maildrop.int.zabbadoz.net> References: <201011170627.28025.thierry.herbelot@free.fr> <20101117055208.S24596@maildrop.int.zabbadoz.net> <201011170729.41894.thierry.herbelot@free.fr> X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD virtualization mailing list Subject: Re: VIMAGE: Freed UMA keg was not empty X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Nov 2010 07:25:08 -0000 On Wed, 17 Nov 2010, Thierry Herbelot wrote: Hi, >> The problem has been present since day 1 and is still present up to >> HEAD. This is about type stability and teardown. So far we are no >> able to actually free TCP (and UDP in SVN) states as they might still >> be accesses after "free". It's a general problem in the network stack >> and has been implemented as a measure to circumvent panics in those >> cases. >> >> I am not sure if that's actually what's biting you wrt to memory or >> if it's something else. Unfortunately boot logs and kernel configs >> don't help much; enable ddb and get show uma and show malloc reports >> after the crash (or watch vmstat -z and vmstat -m) after every 50 jail >> restarts. I might have some patches for a couple of things but cannot >> (yet) help with the additional (duplicate) UMA zones showing up at >> each iteration (for the -z case). > > The context for our problem is that VIMAGE jails are mant to be used "in > production" for automated tests, thus are likely to be multiple on one > physical host, and are likely to be started and stopped according to our > needs. > > We have tried more "classical" virtualization solutions (qemu, kvm, ... , > normal jails with individual FIBs, ...) but only FreeBSD with VIMAGE seems to > be the correct answer. (for other reasons, an i386 version of the kernel must > be used) > > The point of my original email was to simplify the configuration for a test > setup : any machine with the attached configuration file and the above > sequence of commands creating and deleting jails, running in a loop, will > eventually panic. The thing you can do is start the jails persistent and then only garbage collect proceses and network configuration manually and reconfigure/restart things for the next iteration; you might still leak network stack details between runs but if that's not a problem for you the solution might work. Regards, Bjoern -- Bjoern A. Zeeb Welcome a new stage of life. Going to jail sucks -- All my daemons like it! http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/jails.html