From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:18:26 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B697E5EB for ; Fri, 10 Jan 2014 13:18:26 +0000 (UTC) Received: from mail-vb0-x229.google.com (mail-vb0-x229.google.com [IPv6:2607:f8b0:400c:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 73C981AB6 for ; Fri, 10 Jan 2014 13:18:26 +0000 (UTC) Received: by mail-vb0-f41.google.com with SMTP id p14so3242289vbm.28 for ; Fri, 10 Jan 2014 05:18:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=LVJ2Y0f3zPmHbqxVEkVFZeSBymz9a6OhRb4Amp9Qpkk=; b=OiimcTUb0K9BN9IAKZKVlSPELKuj5Mpe1S4lIOWuv7NjTHSDbybFL3r46gH0E+JTeJ TdhvOa0F2qYk0fqQfp+LVajaLzRTT0JB3zm09vEGjbfvc9/VMwCDiJ8WTPv5tNFQHW/t VRKQI0cZZhadmYfavMSxT5USwyHKfMErMAWx32CSsjQLLI7NTNAGZrOOtgpe87cAKLZw JOCLE9ecBXD8+g923XgBpKTbPtWbiCd1Vs0MQHNUZSDto2QYbYUFD9jcE5eVApKil2nl c8am4dj20wEpnp/OaES/nhE6oCZC4q8umo4fyWnau5EoBHidqKRyi3V4GILahlCaD5Po qADQ== MIME-Version: 1.0 X-Received: by 10.52.76.105 with SMTP id j9mr1657175vdw.52.1389359904889; Fri, 10 Jan 2014 05:18:24 -0800 (PST) Received: by 10.58.164.36 with HTTP; Fri, 10 Jan 2014 05:18:24 -0800 (PST) In-Reply-To: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> Date: Fri, 10 Jan 2014 17:18:24 +0400 Message-ID: Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash From: Mikhail Tsatsenko To: Derek Schrock Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:18:26 -0000 2014/1/10 Derek Schrock : > Using VirtualBox 4.2.20_2 (emulators/virtualbox-ose) on a 9.2-RELEASE > amd64 4 core (8 CPU with HT) host a FreeBSD 10.0-RC5 amd64 (also tested > with 3 and 4) VM with 4 allocated CPUs will repeatedly crashes when I > try to build a pkg repo with poudriere (ports-mgmt/poudriere) via the > bulk command. > > From the VM: > root@freebsd10testing:~ # kldstat #VirtualBox additions loaded (tested with/without) > Id Refs Address Size Name > 1 9 0xffffffff80200000 15f0310 kernel > 2 1 0xffffffff81a12000 22d50 vboxguest.ko > 3 1 0xffffffff81a35000 543 vboxvideo.ko > 4 1 0xffffffff81a36000 16d6c drm.ko > root@freebsd10testing:~ # sysctl hw.ncpu > hw.ncpu: 4 > root@freebsd10testing:~ # uname -a > FreeBSD freebsd10testing 10.0-RC5 FreeBSD 10.0-RC5 #0 r260430: Wed Jan 8 05:10:04 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > root@freebsd10testing:~ # poudriere bulk -j testing www/firefox > ====>> Creating the reference jail... done > ====>> Mounting system devices for testing-default > ====>> Mounting ports/packages/distfiles > ====>> Mounting packages from: /usr/local/poudriere/data/packages/testing-default > ====>> Logs: /usr/local/poudriere/data/logs/bulk/testing-default/2014-01-09_19h23m11s > /etc/resolv.conf -> /usr/local/poudriere/data/build/testing-default/ref/etc/resolv.conf > ====>> Starting jail testing-default > ====>> Calculating ports order and dependencies > ====>> pkg package missing, skipping sanity > ====>> Cleaning the build queue > ====>> Building 145 packages using 4 builders > ====>> Starting/Cloning builders > mount_nullfs: /usr/local/poudriere/data/build/testing-default/03/usr/ports: Device not configured > ====>> Error: Failed to mount the ports directory > /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor > Write failed: Broken pipe > > At this point the ssh session dies (Write failed: Broken pipe) and the > VM restarts (watching the console via VNC). The crash appears to occur > during the building of the reference jails (one per CPU - 4). > > I don't see anything in /var/log/messages, /var/crash/ is empty, and savecore > doesn't dump any core files. > > I've tested this with 2, 3, 4, 5, and 6 CPUs allocated to the VM and it > crashes every time. The only way I can have the VM not crash is with 1 > allocated CPU. I believe there's an issue with VirtualBox and FreeBSD > 10.0 VM when the VM has multiple CPUs. > > I don't think this is a poudriere issue however it's the only way I've been > able to crash the VM. I've tried extracting multiple ports trees to different > locations at the same time thinking it's a disk issue because of the above > "Device not configured" (The/a disk disappears?) error, the VM didn't crash. > > I've tried the same command with a FreeBSD 9.2-RELEASE amd64 4 CPU VM > under the same host with out any failure/crashes. > > Could anyone confirm this with a multi-CPU VM and FreeBSD 10.0RC3/4/5 or > recommend any methods on how to debug this issue? First of all attach serial console to VM and see if there is any kernel messages printed upon crash. Also there is a possibly similar problem: http://lists.freebsd.org/pipermail/freebsd-stable/2014-January/076772.html _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Mikhail