From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 01:23:07 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4DE60EC1 for ; Fri, 10 Jan 2014 01:23:07 +0000 (UTC) Received: from mail-qa0-x232.google.com (mail-qa0-x232.google.com [IPv6:2607:f8b0:400d:c00::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0361513CB for ; Fri, 10 Jan 2014 01:23:06 +0000 (UTC) Received: by mail-qa0-f50.google.com with SMTP id cm18so2268620qab.23 for ; Thu, 09 Jan 2014 17:23:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=3/NspsydO7KPn2YeMAqwtRdPet9mwLPtb4a+J3rZBcc=; b=ho140ia1UyyvMhEDt07KhsnhKR47q09U8rF6bHJ4H6JiW1LKjmGuxFZ6TR+l0RSNve eRrHReN/H7WjnsbR6e4jOFdT8pwV+tIZsutH0eB0S/1lrv6JZw4LVgUzJaRjTgQ9Rzqx 6JSpZEmhKM9/P7w5lzaS7jzfxGzoW35R7FlDA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-type:content-disposition:user-agent; bh=3/NspsydO7KPn2YeMAqwtRdPet9mwLPtb4a+J3rZBcc=; b=beJCN6lhSBDjFxkKv1LSrG7PUl7w2AC8TvWGfwGurJXGuk1Hcv1VwU5A12MeHbgtKj Dlkb1SqowZ/d5ufijiJOzNFV0B+MpubN8pjrjkR3bjgsSDOFDVlgFaPwvk3LWWKDwKso jBPxG4CO5SmdiaCFVxQjKLfPSDreHsufkR7qZlDDtazsIoS8fIhj01GznNhE6LAiadER QdOoOCnrPqhe0nPXA6XUqSBTnocOXmVfXZbxA7XX6h7SvHMzK9ZfMfXCBdKMKXxyQwkl KO/mVcnTMCEG53d5pU1vCUcYnGPIeGL485IfQTgE1ex0wpKFYgreZZtDKLShSVG1FELD PzZw== X-Gm-Message-State: ALoCoQn9kC2BCx+BcEF8ul1s6KyaszFYvZFFHmvhncuz+t4iHYzjvDKq3WF/HXGeQ3diop9OOa05 X-Received: by 10.224.2.194 with SMTP id 2mr1567140qak.44.1389316986228; Thu, 09 Jan 2014 17:23:06 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id v3sm1428773qap.4.2014.01.09.17.23.04 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Thu, 09 Jan 2014 17:23:05 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Thu, 09 Jan 2014 20:23:04 -0500 Date: Thu, 9 Jan 2014 20:23:04 -0500 From: Derek Schrock To: freebsd-virtualization@freebsd.org Subject: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 01:23:07 -0000 Using VirtualBox 4.2.20_2 (emulators/virtualbox-ose) on a 9.2-RELEASE amd64 4 core (8 CPU with HT) host a FreeBSD 10.0-RC5 amd64 (also tested with 3 and 4) VM with 4 allocated CPUs will repeatedly crashes when I try to build a pkg repo with poudriere (ports-mgmt/poudriere) via the bulk command. >From the VM: root@freebsd10testing:~ # kldstat #VirtualBox additions loaded (tested with/without) Id Refs Address Size Name 1 9 0xffffffff80200000 15f0310 kernel 2 1 0xffffffff81a12000 22d50 vboxguest.ko 3 1 0xffffffff81a35000 543 vboxvideo.ko 4 1 0xffffffff81a36000 16d6c drm.ko root@freebsd10testing:~ # sysctl hw.ncpu hw.ncpu: 4 root@freebsd10testing:~ # uname -a FreeBSD freebsd10testing 10.0-RC5 FreeBSD 10.0-RC5 #0 r260430: Wed Jan 8 05:10:04 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 root@freebsd10testing:~ # poudriere bulk -j testing www/firefox ====>> Creating the reference jail... done ====>> Mounting system devices for testing-default ====>> Mounting ports/packages/distfiles ====>> Mounting packages from: /usr/local/poudriere/data/packages/testing-default ====>> Logs: /usr/local/poudriere/data/logs/bulk/testing-default/2014-01-09_19h23m11s /etc/resolv.conf -> /usr/local/poudriere/data/build/testing-default/ref/etc/resolv.conf ====>> Starting jail testing-default ====>> Calculating ports order and dependencies ====>> pkg package missing, skipping sanity ====>> Cleaning the build queue ====>> Building 145 packages using 4 builders ====>> Starting/Cloning builders mount_nullfs: /usr/local/poudriere/data/build/testing-default/03/usr/ports: Device not configured ====>> Error: Failed to mount the ports directory /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor Write failed: Broken pipe At this point the ssh session dies (Write failed: Broken pipe) and the VM restarts (watching the console via VNC). The crash appears to occur during the building of the reference jails (one per CPU - 4). I don't see anything in /var/log/messages, /var/crash/ is empty, and savecore doesn't dump any core files. I've tested this with 2, 3, 4, 5, and 6 CPUs allocated to the VM and it crashes every time. The only way I can have the VM not crash is with 1 allocated CPU. I believe there's an issue with VirtualBox and FreeBSD 10.0 VM when the VM has multiple CPUs. I don't think this is a poudriere issue however it's the only way I've been able to crash the VM. I've tried extracting multiple ports trees to different locations at the same time thinking it's a disk issue because of the above "Device not configured" (The/a disk disappears?) error, the VM didn't crash. I've tried the same command with a FreeBSD 9.2-RELEASE amd64 4 CPU VM under the same host with out any failure/crashes. Could anyone confirm this with a multi-CPU VM and FreeBSD 10.0RC3/4/5 or recommend any methods on how to debug this issue?